Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Learning Data Mining with Python
  • Table Of Contents Toc
  • Feedback & Rating feedback
Learning Data Mining with Python

Learning Data Mining with Python

By : Robert Layton
3.7 (7)
Buy this Book
close
close
Learning Data Mining with Python

Learning Data Mining with Python

3.7 (7)
By: Robert Layton
Buy this Book

Overview of this book

If you are a programmer who wants to get started with data mining, then this book is for you.
Table of Contents (15 chapters)
close
close
close
Preface
Icon
Preface
Icon
What this book covers
Icon
What you need for this book
Icon
Who this book is for
Icon
Conventions
Icon
Reader feedback
Icon
Customer support
Lock Free Chapter
1
1. Getting Started with Data Mining
Icon
1. Getting Started with Data Mining
Icon
Introducing data mining
Icon
Using Python and the IPython Notebook
Icon
A simple affinity analysis example
Icon
A simple classification example
Icon
What is classification?
Icon
Summary
2
2. Classifying with scikit-learn Estimators
Icon
2. Classifying with scikit-learn Estimators
Icon
scikit-learn estimators
Icon
Preprocessing using pipelines
Icon
Pipelines
Icon
Summary
3
3. Predicting Sports Winners with Decision Trees
Icon
3. Predicting Sports Winners with Decision Trees
Icon
Loading the dataset
Icon
Decision trees
Icon
Sports outcome prediction
Icon
Random forests
Icon
Summary
4
4. Recommending Movies Using Affinity Analysis
Icon
4. Recommending Movies Using Affinity Analysis
Icon
Affinity analysis
Icon
The movie recommendation problem
Icon
The Apriori implementation
Icon
Extracting association rules
Icon
Summary
5
5. Extracting Features with Transformers
Icon
5. Extracting Features with Transformers
Icon
Feature extraction
Icon
Feature selection
Icon
Feature creation
Icon
Creating your own transformer
Icon
Summary
6
6. Social Media Insight Using Naive Bayes
Icon
6. Social Media Insight Using Naive Bayes
Icon
Disambiguation
Icon
Text transformers
Icon
Naive Bayes
Icon
Application
Icon
Summary
7
7. Discovering Accounts to Follow Using Graph Mining
Icon
7. Discovering Accounts to Follow Using Graph Mining
Icon
Loading the dataset
Icon
Finding subgraphs
Icon
Summary
8
8. Beating CAPTCHAs with Neural Networks
Icon
8. Beating CAPTCHAs with Neural Networks
Icon
Artificial neural networks
Icon
Creating the dataset
Icon
Training and classifying
Icon
Improving accuracy using a dictionary
Icon
Summary
9
9. Authorship Attribution
Icon
9. Authorship Attribution
Icon
Attributing documents to authors
Icon
Function words
Icon
Support vector machines
Icon
Character n-grams
Icon
Using the Enron dataset
Icon
Summary
10
10. Clustering News Articles
Icon
10. Clustering News Articles
Icon
Obtaining news articles
Icon
Extracting text from arbitrary websites
Icon
Grouping news articles
Icon
Clustering ensembles
Icon
Online learning
Icon
Summary
11
11. Classifying Objects in Images Using Deep Learning
Icon
11. Classifying Objects in Images Using Deep Learning
Icon
Object classification
Icon
Application scenario and goals
Icon
Deep neural networks
Icon
GPU optimization
Icon
Setting up the environment
Icon
Application
Icon
Summary
12
12. Working with Big Data
Icon
12. Working with Big Data
Icon
Big data
Icon
Application scenario and goals
Icon
MapReduce
Icon
Application
Icon
Summary
13
A. Next Steps…
chevron up
Icon
A. Next Steps…
Icon
Chapter 1 – Getting Started with Data Mining
Icon
Chapter 2 – Classifying with scikit-learn Estimators
Icon
Chapter 3: Predicting Sports Winners with Decision Trees
Icon
Chapter 4 – Recommending Movies Using Affinity Analysis
Icon
Chapter 5 – Extracting Features with Transformers
Icon
Chapter 6 – Social Media Insight Using Naive Bayes
Icon
Chapter 7 – Discovering Accounts to Follow Using Graph Mining
Icon
Chapter 8 – Beating CAPTCHAs with Neural Networks
Icon
Chapter 9 – Authorship Attribution
Icon
Chapter 10 – Clustering News Articles
Icon
Chapter 11: Classifying Objects in Images Using Deep Learning
Icon
Chapter 12 – Working with Big Data
Icon
More resources
14
Index
Icon
Index

Chapter 5 – Extracting Features with Transformers

Adding noise

In this chapter, we covered removing noise to improve features; however, improved performance can be obtained for some datasets by adding noise. The reason for this is simple—it helps stop overfitting by forcing the classifier to generalize its rules a little (although too much noise will make the model too general). try implementing a Transformer that can add a given amount of noise to a dataset. Test that out on some of the datasets from UCI ML and see if it improves test-set performance.

Vowpal Wabbit

http://hunch.net/~vw/

Vowpal Wabbit is a great project, providing very fast feature extraction for text-based problems. It comes with a Python wrapper, allowing you to call it from with Python code. Test it out on large datasets, such as the one we used in Chapter 12, Working with Big Data.

Visually different images
CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Learning Data Mining with Python
End of Section 13
Next Section
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options
font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful
Order Page Read Now

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon