Book Image

Learning Data Mining with Python - Second Edition

By : Robert Layton
Book Image

Learning Data Mining with Python - Second Edition

By: Robert Layton

Overview of this book

This book teaches you to design and develop data mining applications using a variety of datasets, starting with basic classification and affinity analysis. This book covers a large number of libraries available in Python, including the Jupyter Notebook, pandas, scikit-learn, and NLTK. You will gain hands on experience with complex data types including text, images, and graphs. You will also discover object detection using Deep Neural Networks, which is one of the big, difficult areas of machine learning right now. With restructured examples and code samples updated for the latest edition of Python, each chapter of this book introduces you to new algorithms and techniques. By the end of the book, you will have great insights into using Python for data mining and understanding of the algorithms as well as implementations.

Related Content you might be interested in

Current Title:

Small book image
Learning Data Mining with Python - Second Edition
Robert Layton
Apr, 2017 | 358 pages
Small book image
Hands-On Recommendation Systems with Python
Rounak Banik
Jul, 2018 | 146 pages
Small book image
Building Machine Learning Systems with Python
Matthieu Brucher | Luis Pedro Coelho | Wilhelm Richert
Jul, 2018 | 406 pages
Small book image
Hands-On Automated Machine Learning
Sibanjan Das | Umit Mert Cakmak
Apr, 2018 | 282 pages
Table of Contents (20 chapters)
Title Page
Title Page
Credits
Credits
About the Author
About the Author
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Customer Feedback
Customer Feedback
Preface
Preface
Free Chapter
1
Getting Started with Data Mining
Getting Started with Data Mining
Introducing data mining
Using Python and the Jupyter Notebook
A simple affinity analysis example
Product recommendations
A simple classification example
What is classification?
Summary
2
Classifying with scikit-learn Estimators
Classifying with scikit-learn Estimators
scikit-learn estimators
Preprocessing
Pipelines
Summary
3
Predicting Sports Winners with Decision Trees
Predicting Sports Winners with Decision Trees
Loading the dataset
Decision trees
Sports outcome prediction
Random forests
Summary
4
Recommending Movies Using Affinity Analysis
Recommending Movies Using Affinity Analysis
Affinity analysis
Dealing with the movie recommendation problem
Understanding the Apriori algorithm and its implementation
Summary
5
Features and scikit-learn Transformers
Features and scikit-learn Transformers
Feature extraction
Feature selection
Feature creation
Principal Component Analysis
Creating your own transformer
Unit testing
Putting it all together
Summary
6
Social Media Insight using Naive Bayes
Social Media Insight using Naive Bayes
Disambiguation
Downloading data from a social network
Text transformers
Naive Bayes
Applying of Naive Bayes
Getting useful features from models
Summary
7
Follow Recommendations Using Graph Mining
Follow Recommendations Using Graph Mining
Loading the dataset
Getting follower information from Twitter
Creating a graph
Finding subgraphs
Summary
8
Beating CAPTCHAs with Neural Networks
Beating CAPTCHAs with Neural Networks
Artificial neural networks
Creating the dataset
Training and classifying
Predicting words
Summary
9
Authorship Attribution
Authorship Attribution
Attributing documents to authors
Getting the data
Using function words
Support Vector Machines
Character n-grams
The Enron dataset
Putting it all together
Evaluation
Summary
10
Clustering News Articles
Clustering News Articles
Trending topic discovery
Extracting text from arbitrary websites
Grouping news articles
The k-means algorithm
Clustering ensembles
Online learning
Summary
11
Object Detection in Images using Deep Neural Networks
Object Detection in Images using Deep Neural Networks
Object classification
Application scenario
Deep neural networks
An Introduction to TensorFlow
Using Keras
GPU optimization
Application
Summary
12
Working with Big Data
Working with Big Data
Big data
MapReduce
Applying MapReduce
Naive Bayes prediction
Extracting the blog posts
Training Naive Bayes
Putting it all together
Training on Amazon's EMR infrastructure
Summary
13
Next Steps...
Next Steps...
Getting Started with Data Mining
Classifying with scikit-learn Estimators
Predicting Sports Winners with Decision Trees
Recommending Movies Using Affinity Analysis
Extracting Features with Transformers
Social Media Insight Using Naive Bayes
Discovering Accounts to Follow Using Graph Mining
Beating CAPTCHAs with Neural Networks
Authorship Attribution
Clustering News Articles
Classifying Objects in Images Using Deep Learning
Working with Big Data
More resources

scikit-learn estimators

Estimators that allows for the standardized implementation and testing of algorithms a common, lightweight interface for classifiers to follow. By using this interface, we can apply these tools to arbitrary classifiers, without needing to worry about how the algorithms work.

Estimators must have the following two important functions:

  • fit(): This function performs the training of the algorithm - setting the values of internal parameters. The fit() takes two inputs, the training sample dataset and the corresponding classes for those samples.
  • predict(): This the class of the testing samples that we provide as the only input. This function returns a NumPy array with the predictions of each input testing sample.

Most scikit-learn estimators use NumPy arrays or a related format for input and output. However this is by convention and not required to use the interface.

There are many estimators implemented in scikit-learn and more in other open source projects that use the same...

Previous Section
End of Section 2
Next Section