Book Image

Mastering Machine Learning with scikit-learn - Second Edition

By : Gavin Hackeling
Book Image

Mastering Machine Learning with scikit-learn - Second Edition

By: Gavin Hackeling

Overview of this book

Machine learning is the buzzword bringing computer science and statistics together to build smart and efficient models. Using powerful algorithms and techniques offered by machine learning you can automate any analytical model. This book examines a variety of machine learning models including popular machine learning algorithms such as k-nearest neighbors, logistic regression, naive Bayes, k-means, decision trees, and artificial neural networks. It discusses data preprocessing, hyperparameter optimization, and ensemble methods. You will build systems that classify documents, recognize images, detect ads, and more. You will learn to use scikit-learn’s API to extract features from categorical variables, text and images; evaluate model performance, and develop an intuition for how to improve your model’s performance. By the end of this book, you will master all required concepts of scikit-learn to build efficient models at work to carry out advanced tasks with the practical approach.

Related Content you might be interested in

Current Title:

Small book image
Mastering Machine Learning with scikit-learn - Second Edition
Gavin Hackeling
Jul, 2017 | 254 pages
Small book image
Python Machine Learning, Second Edition
Sebastian Raschka | Vahid Mirjalili
Sep, 2017 | 622 pages
Small book image
Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits
Tarek Amr
Jul, 2020 | 384 pages
Small book image
Machine Learning with PyTorch and Scikit-Learn
Yuxi Hayden Liu | Sebastian Raschka | Vahid Mirjalili
Feb, 2022 | 774 pages
Table of Contents (22 chapters)
Title Page
Title Page
Credits
Credits
About the Author
About the Author
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Customer Feedback
Customer Feedback
Preface
Preface
Free Chapter
1
The Fundamentals of Machine Learning
The Fundamentals of Machine Learning
Defining machine learning
Learning from experience
Machine learning tasks
Training data, testing data, and validation data
Bias and variance
An introduction to scikit-learn
Installing scikit-learn
Installing pandas, Pillow, NLTK, and matplotlib
Summary
2
Simple Linear Regression
Simple Linear Regression
Simple linear regression
Evaluating the model
Summary
3
Classification and Regression with k-Nearest Neighbors
Classification and Regression with k-Nearest Neighbors
K-Nearest Neighbors
Lazy learning and non-parametric models
Classification with KNN
Regression with KNN
Summary
4
Feature Extraction
Feature Extraction
Extracting features from categorical variables
Standardizing features
Extracting features from text
Extracting features from images
Summary
5
From Simple Linear Regression to Multiple Linear Regression
From Simple Linear Regression to Multiple Linear Regression
Multiple linear regression
Polynomial regression
Regularization
Applying linear regression
Gradient descent
Summary
6
From Linear Regression to Logistic Regression
From Linear Regression to Logistic Regression
Binary classification with logistic regression
Spam filtering
Tuning models with grid search
Multi-class classification
Multi-label classification and problem transformation
Summary
7
Naive Bayes
Naive Bayes
Bayes' theorem
Generative and discriminative models
Naive Bayes
Naive Bayes with scikit-learn
Summary
8
Nonlinear Classification and Regression with Decision Trees
Nonlinear Classification and Regression with Decision Trees
Decision trees
Training decision trees
Decision trees with scikit-learn
Summary
9
From Decision Trees to Random Forests and Other Ensemble Methods
From Decision Trees to Random Forests and Other Ensemble Methods
Bagging
Boosting
Stacking
Summary
10
The Perceptron
The Perceptron
The perceptron
Limitations of the perceptron
Summary
11
From the Perceptron to Support Vector Machines
From the Perceptron to Support Vector Machines
Kernels and the kernel trick
Maximum margin classification and support vectors
Classifying characters in scikit-learn
Summary
12
From the Perceptron to Artificial Neural Networks
From the Perceptron to Artificial Neural Networks
Nonlinear decision boundaries
Feed-forward and feedback ANNs
Multi-layer perceptrons
Training multi-layer perceptrons
Summary
13
K-means
K-means
Clustering
K-means
Evaluating clusters
Image quantization
Clustering to learn features
Summary
14
Dimensionality Reduction with Principal Component Analysis
Dimensionality Reduction with Principal Component Analysis
Principal component analysis
Visualizing high-dimensional data with PCA
Face recognition with PCA
Summary
Index
Index

Installing scikit-learn

This book was written for version 0.18.1 of scikit-learn; use this version to ensure that the examples run correctly. If you have previously installed scikit-learn, you can retrieve the version number by executing the following in a notebook or Python interpreter:

# In[1]:
import sklearn 
sklearn.__version__ 

# Out[1]:
'0.18.1'

Note

The package is named sklearn because scikit-learn is not a valid Python package name.

If you have not previously installed scikit-learn, you may install it from a package manager or build it from source. We will review the installation processes for Ubuntu 16.04, Max OS, and Windows 10 in the following sections, but refer to http://scikit-learn.org/stable/install.html for the latest instructions. The following instructions assume only that you have installed Python >= 2.6 or Python >= 3.3. See http://www.python.org/download/ for instructions on installing Python.

Installing using pip

The easiest way to install scikit-learn is to use pip, the PyPA-recommended tool for installing Python packages. Install scikit-learn using pip as follows:

$ pip install -U scikit-learn

If pip is not available on your system, consult the following sections for installation instructions for various platforms.

Installing on Windows

scikit-learn requires setuptools, a third-party package that supports packaging and installing software for Python. Setuptools can be installed on Windows by running the bootstrap script at https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py.

Windows binaries for the 32-bit and 64-bit versions of scikit-learn are also available. If you cannot determine which version you need, install the 32-bit version. Both versions depend on NumPy 1.3 or newer. The 32-bit version of NumPy can be downloaded from http://sourceforge.net/projects/numpy/files/NumPy/. The 64-bit version can be downloaded from http://www.lfd.uci.edu/~gohlke/pythonlibs/#scikit-learn.

A Windows installer for the 32-bit version of scikit-learn can be downloaded from http://sourceforge.net/projects/scikit-learn/files/. An installer for the 64-bit version of scikit-learn can be downloaded from http://www.lfd.uci.edu/~gohlke/pythonlibs/#scikit-learn.

Installing on Ubuntu 16.04

scikit-learn can be installed on Ubuntu 16.04 using apt.

$ sudo apt install python-scikits-learn

Installing on Mac OS

scikit-learn can be installed on OS X using Macports.

$ sudo port install py27-sklearn

Installing Anaconda

Anaconda is a free collection of more than 720 open source data science packages for Python including scikit-learn, NumPy, SciPy, pandas, and matplotlib. Anaconda is platform-agnostic and simple to install. See https://docs.continuum.io/anaconda/install/ for instructions for your operating system.

Verifying the installation

To verify that scikit-learn has been installed correctly, open a Python console and execute the following:

# In[1]:
import sklearn 
sklearn.__version__ 

# Out[1]:
'0.18.1'

To run scikit-learn's unit tests, first install the nose Python library. Then execute the following in a terminal emulator:

$ nosetest sklearn -exe

Congratulations! You've successfully installed scikit-learn.

Previous Section
End of Section 8
Next Section