Book Image

Learning Data Mining with Python - Second Edition

By : Robert Layton
Book Image

Learning Data Mining with Python - Second Edition

By: Robert Layton

Overview of this book

This book teaches you to design and develop data mining applications using a variety of datasets, starting with basic classification and affinity analysis. This book covers a large number of libraries available in Python, including the Jupyter Notebook, pandas, scikit-learn, and NLTK. You will gain hands on experience with complex data types including text, images, and graphs. You will also discover object detection using Deep Neural Networks, which is one of the big, difficult areas of machine learning right now. With restructured examples and code samples updated for the latest edition of Python, each chapter of this book introduces you to new algorithms and techniques. By the end of the book, you will have great insights into using Python for data mining and understanding of the algorithms as well as implementations.

Related Content you might be interested in

Current Title:

Small book image
Learning Data Mining with Python - Second Edition
Robert Layton
Apr, 2017 | 358 pages
Small book image
Hands-On Recommendation Systems with Python
Rounak Banik
Jul, 2018 | 146 pages
Small book image
Building Machine Learning Systems with Python
Matthieu Brucher | Luis Pedro Coelho | Wilhelm Richert
Jul, 2018 | 406 pages
Small book image
Hands-On Automated Machine Learning
Sibanjan Das | Umit Mert Cakmak
Apr, 2018 | 282 pages
Table of Contents (20 chapters)
Title Page
Title Page
Credits
Credits
About the Author
About the Author
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Customer Feedback
Customer Feedback
Preface
Preface
Free Chapter
1
Getting Started with Data Mining
Getting Started with Data Mining
Introducing data mining
Using Python and the Jupyter Notebook
A simple affinity analysis example
Product recommendations
A simple classification example
What is classification?
Summary
2
Classifying with scikit-learn Estimators
Classifying with scikit-learn Estimators
scikit-learn estimators
Preprocessing
Pipelines
Summary
3
Predicting Sports Winners with Decision Trees
Predicting Sports Winners with Decision Trees
Loading the dataset
Decision trees
Sports outcome prediction
Random forests
Summary
4
Recommending Movies Using Affinity Analysis
Recommending Movies Using Affinity Analysis
Affinity analysis
Dealing with the movie recommendation problem
Understanding the Apriori algorithm and its implementation
Summary
5
Features and scikit-learn Transformers
Features and scikit-learn Transformers
Feature extraction
Feature selection
Feature creation
Principal Component Analysis
Creating your own transformer
Unit testing
Putting it all together
Summary
6
Social Media Insight using Naive Bayes
Social Media Insight using Naive Bayes
Disambiguation
Downloading data from a social network
Text transformers
Naive Bayes
Applying of Naive Bayes
Getting useful features from models
Summary
7
Follow Recommendations Using Graph Mining
Follow Recommendations Using Graph Mining
Loading the dataset
Getting follower information from Twitter
Creating a graph
Finding subgraphs
Summary
8
Beating CAPTCHAs with Neural Networks
Beating CAPTCHAs with Neural Networks
Artificial neural networks
Creating the dataset
Training and classifying
Predicting words
Summary
9
Authorship Attribution
Authorship Attribution
Attributing documents to authors
Getting the data
Using function words
Support Vector Machines
Character n-grams
The Enron dataset
Putting it all together
Evaluation
Summary
10
Clustering News Articles
Clustering News Articles
Trending topic discovery
Extracting text from arbitrary websites
Grouping news articles
The k-means algorithm
Clustering ensembles
Online learning
Summary
11
Object Detection in Images using Deep Neural Networks
Object Detection in Images using Deep Neural Networks
Object classification
Application scenario
Deep neural networks
An Introduction to TensorFlow
Using Keras
GPU optimization
Application
Summary
12
Working with Big Data
Working with Big Data
Big data
MapReduce
Applying MapReduce
Naive Bayes prediction
Extracting the blog posts
Training Naive Bayes
Putting it all together
Training on Amazon's EMR infrastructure
Summary
13
Next Steps...
Next Steps...
Getting Started with Data Mining
Classifying with scikit-learn Estimators
Predicting Sports Winners with Decision Trees
Recommending Movies Using Affinity Analysis
Extracting Features with Transformers
Social Media Insight Using Naive Bayes
Discovering Accounts to Follow Using Graph Mining
Beating CAPTCHAs with Neural Networks
Authorship Attribution
Clustering News Articles
Classifying Objects in Images Using Deep Learning
Working with Big Data
More resources

Feature extraction

Extracting features is one of the most critical tasks in data mining, and it generally affects your end result more than the choice of data mining algorithm. Unfortunately, there are no hard and fast rules for choosing features that will result in high-performance data mining. The choice of features determines the model that you are using to represent your data.

Note

Model creation is where the science of data mining becomes more of an art and why automated methods of performing data mining (there are several methods of this type) focus on algorithm choice and not model creation. Creating good models relies on intuition, domain expertise, data mining experience, trial and error, and sometimes a little luck.

Representing reality in models

Given what we have done so far in the book, it is easy to forget that the reason we are performing data mining is to affect real world objects, not just manipulating a matrix of values. Not all datasets are presented in terms of features....

Previous Section
End of Section 2
Next Section