Book Image

Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits

By : Tarek Amr
Book Image

Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits

By: Tarek Amr

Overview of this book

Machine learning is applied everywhere, from business to research and academia, while scikit-learn is a versatile library that is popular among machine learning practitioners. This book serves as a practical guide for anyone looking to provide hands-on machine learning solutions with scikit-learn and Python toolkits. The book begins with an explanation of machine learning concepts and fundamentals, and strikes a balance between theoretical concepts and their applications. Each chapter covers a different set of algorithms, and shows you how to use them to solve real-life problems. You’ll also learn about various key supervised and unsupervised machine learning algorithms using practical examples. Whether it is an instance-based learning algorithm, Bayesian estimation, a deep neural network, a tree-based ensemble, or a recommendation system, you’ll gain a thorough understanding of its theory and learn when to apply it. As you advance, you’ll learn how to deal with unlabeled data and when to use different clustering and anomaly detection algorithms. By the end of this machine learning book, you’ll have learned how to take a data-driven approach to provide end-to-end machine learning solutions. You’ll also have discovered how to formulate the problem at hand, prepare required data, and evaluate and deploy models in production.

Related Content you might be interested in

Current Title:

Small book image
Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits
Tarek Amr
Jul, 2020 | 384 pages
Small book image
scikit-learn Cookbook
Julian Avila | Trent Hauck
Nov, 2017 | 374 pages
Small book image
Machine Learning with scikit-learn Quick Start Guide
Kevin Jolly
Oct, 2018 | 172 pages
Small book image
Mastering Machine Learning with scikit-learn
Gavin Hackeling
Jul, 2017 | 254 pages
Table of Contents (18 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
1
Section 1: Supervised Learning
Section 1: Supervised Learning
Free Chapter
2
Introduction to Machine Learning
Introduction to Machine Learning
Understanding machine learning
The model development life cycle
Introduction to scikit-learn
Installing the packages you need
Summary
Further reading
3
Making Decisions with Trees
Making Decisions with Trees
Understanding decision trees
How do decision trees learn?
Getting a more reliable score
Tuning the hyperparameters for higher accuracy
Visualizing the tree's decision boundaries
Building decision tree regressors
Summary
4
Making Decisions with Linear Equations
Making Decisions with Linear Equations
Understanding linear models
Predicting house prices in Boston
Regularizing the regressor
Finding regression intervals
Getting to know additional linear regressors
Using logistic regression for classification
Getting to know additional linear classifiers
Summary
5
Preparing Your Data
Preparing Your Data
Imputing missing values
Encoding non-numerical columns
Homogenizing the columns' scale
Selecting the most useful features
Summary
6
Image Processing with Nearest Neighbors
Image Processing with Nearest Neighbors
Nearest neighbors
Loading and displaying images
Image classification
Using custom distances
Using nearest neighbors for regression
More neighborhood algorithms
Reducing the dimensions of our image data
Summary
7
Classifying Text Using Naive Bayes
Classifying Text Using Naive Bayes
Splitting sentences into tokens
Vectorizing text into matrices
Understanding Naive Bayes
Classifying text using a Naive Bayes classifier
Creating a custom transformer
Summary
8
Section 2: Advanced Supervised Learning
Section 2: Advanced Supervised Learning
9
Neural Networks – Here Comes Deep Learning
Neural Networks – Here Comes Deep Learning
Getting to know MLP
Classifying items of clothing
Untangling the convolutions
MLP regressors
Summary
10
Ensembles – When One Model Is Not Enough
Ensembles – When One Model Is Not Enough
Answering the question why ensembles?
Downloading the UCI Automobile dataset
Using random forest for regression
Using random forest for classification
Using bagging regressors
Using gradient boosting to predict automobile prices
Using AdaBoost ensembles
Exploring more ensembles
Summary
11
The Y is as Important as the X
The Y is as Important as the X
Scaling your regression targets
Estimating multiple regression targets
Dealing with compound classification targets
Calibrating a classifier's probabilities
Calculating the precision at k
Summary
12
Imbalanced Learning – Not Even 1% Win the Lottery
Imbalanced Learning – Not Even 1% Win the Lottery
Getting the click prediction dataset
Installing the imbalanced-learn library
Predicting the CTR
Sampling the training data
Equal opportunity score
Summary
13
Section 3: Unsupervised Learning and More
Section 3: Unsupervised Learning and More
14
Clustering – Making Sense of Unlabeled Data
Clustering – Making Sense of Unlabeled Data
Understanding clustering
K-means clustering
Agglomerative clustering
DBSCAN
Summary
15
Anomaly Detection – Finding Outliers in Data
Anomaly Detection – Finding Outliers in Data
Unlabeled anomaly detection
Detecting anomalies using basic statistics
Detecting outliers using EllipticEnvelope
Outlier and novelty detection using LOF
Detecting outliers using isolation forest
Summary
16
Recommender System – Getting to Know Their Taste
Recommender System – Getting to Know Their Taste
The different recommendation paradigms
Downloading surprise and the dataset
Using KNN-inspired algorithms
Using baseline algorithms
Using singular value decomposition
Deploying machine learning models in production
Summary
17
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Tuning the hyperparameters for higher accuracy

Now that we have learned how to evaluate the model's accuracy more reliably using the ShuffleSplit cross-validation method, it is time to test our earlier hypothesis: would a smaller tree be more accurate?

Here is what we are going to do in the following sub sections:

  1. Split the data into training and test sets.
  2. Keep the test side to one side now.
  3. Limit the tree's growth using different values of max_depth.
  4. For each max_depth setting, we will use the ShuffleSplit cross-validation method on the training set to get an estimation of the classifier's accuracy.
  5. Once we decide which value to use for max_depth, we will train the algorithm one last time on the entire training set and predict on the test set.

Splitting the data

Here is the usual code for splitting the data into training and test sets:

from sklearn.model_selection...
Previous Section
End of Section 5
Next Section