Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits

By : Tarek Amr

Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits

By: Tarek Amr

Overview of this book

Machine learning is applied everywhere, from business to research and academia, while scikit-learn is a versatile library that is popular among machine learning practitioners. This book serves as a practical guide for anyone looking to provide hands-on machine learning solutions with scikit-learn and Python toolkits. The book begins with an explanation of machine learning concepts and fundamentals, and strikes a balance between theoretical concepts and their applications. Each chapter covers a different set of algorithms, and shows you how to use them to solve real-life problems. You’ll also learn about various key supervised and unsupervised machine learning algorithms using practical examples. Whether it is an instance-based learning algorithm, Bayesian estimation, a deep neural network, a tree-based ensemble, or a recommendation system, you’ll gain a thorough understanding of its theory and learn when to apply it. As you advance, you’ll learn how to deal with unlabeled data and when to use different clustering and anomaly detection algorithms. By the end of this machine learning book, you’ll have learned how to take a data-driven approach to provide end-to-end machine learning solutions. You’ll also have discovered how to formulate the problem at hand, prepare required data, and evaluate and deploy models in production.

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Section 1: Supervised Learning

Free Chapter

Introduction to Machine Learning

Understanding machine learning

The model development life cycle

Introduction to scikit-learn

Installing the packages you need

Summary

Further reading

Making Decisions with Trees

Understanding decision trees

How do decision trees learn?

Getting a more reliable score

Tuning the hyperparameters for higher accuracy

Visualizing the tree's decision boundaries

Building decision tree regressors

Summary

Making Decisions with Linear Equations

Understanding linear models

Predicting house prices in Boston

Regularizing the regressor

Finding regression intervals

Getting to know additional linear regressors

Using logistic regression for classification

Getting to know additional linear classifiers

Summary

Preparing Your Data

Imputing missing values

Encoding non-numerical columns

Homogenizing the columns' scale

Selecting the most useful features

Summary

Image Processing with Nearest Neighbors

Nearest neighbors

Loading and displaying images

Image classification

Using custom distances

Using nearest neighbors for regression

More neighborhood algorithms

Reducing the dimensions of our image data

Summary

Classifying Text Using Naive Bayes

Splitting sentences into tokens

Vectorizing text into matrices

Understanding Naive Bayes

Classifying text using a Naive Bayes classifier

Creating a custom transformer

Summary

Section 2: Advanced Supervised Learning

Neural Networks – Here Comes Deep Learning

Getting to know MLP

Classifying items of clothing

Untangling the convolutions

MLP regressors

Summary

Ensembles – When One Model Is Not Enough

Answering the question why ensembles?

Downloading the UCI Automobile dataset

Using random forest for regression

Using random forest for classification

Using bagging regressors

Using gradient boosting to predict automobile prices

Using AdaBoost ensembles

Exploring more ensembles

Summary

The Y is as Important as the X

Scaling your regression targets

Estimating multiple regression targets

Dealing with compound classification targets

Calibrating a classifier's probabilities

Calculating the precision at k

Summary

Imbalanced Learning – Not Even 1% Win the Lottery

Getting the click prediction dataset

Installing the imbalanced-learn library

Predicting the CTR

Sampling the training data

Equal opportunity score

Summary

Section 3: Unsupervised Learning and More

Clustering – Making Sense of Unlabeled Data

Understanding clustering

K-means clustering

Agglomerative clustering

DBSCAN

Summary

Anomaly Detection – Finding Outliers in Data

Unlabeled anomaly detection

Detecting anomalies using basic statistics

Detecting outliers using EllipticEnvelope

Outlier and novelty detection using LOF

Detecting outliers using isolation forest

Summary

Recommender System – Getting to Know Their Taste

The different recommendation paradigms

Downloading surprise and the dataset

Using KNN-inspired algorithms

Using baseline algorithms

Using singular value decomposition

Deploying machine learning models in production

Summary

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

5 star

4 star

3 star

2 star

1 star

Visualizing the tree's decision boundaries

To be able to pick the right algorithm for the problem, it is important to have a conceptual understanding of how an algorithm makes its decision. As we already know by now, decision trees pick one feature at a time and try to split the data accordingly. Nevertheless, it is important to be able to visualize those decisions as well. Let me first plot our classes versus our features, then I will explain further:

When the tree made a decision to split the data around a petal width of 0.8, you can think of it as drawing a horizontal line in the right-hand side graph at the value of 0.8. Then, with every later split, the tree splits the space further using combinations of horizontal and vertical lines. By knowing this, you should not expect the algorithm to use curves or 45-degree lines to separate the classes.

One trick to plot the decision boundaries that a tree has after it has been trained...

Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits

By : Tarek Amr

Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits

By: Tarek Amr

Overview of this book

Related Content you might be interested in

Current Title:

Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits

scikit-learn Cookbook

Machine Learning with scikit-learn Quick Start Guide

Mastering Machine Learning with scikit-learn

Visualizing the tree's decision boundaries