Book Image

Ensemble Machine Learning Cookbook

By : Dipayan Sarkar, Vijayalakshmi Natarajan
Book Image

Ensemble Machine Learning Cookbook

By: Dipayan Sarkar, Vijayalakshmi Natarajan

Overview of this book

Ensemble modeling is an approach used to improve the performance of machine learning models. It combines two or more similar or dissimilar machine learning algorithms to deliver superior intellectual powers. This book will help you to implement popular machine learning algorithms to cover different paradigms of ensemble machine learning such as boosting, bagging, and stacking. The Ensemble Machine Learning Cookbook will start by getting you acquainted with the basics of ensemble techniques and exploratory data analysis. You'll then learn to implement tasks related to statistical and machine learning algorithms to understand the ensemble of multiple heterogeneous algorithms. It will also ensure that you don't miss out on key topics, such as like resampling methods. As you progress, you’ll get a better understanding of bagging, boosting, stacking, and working with the Random Forest algorithm using real-world examples. The book will highlight how these ensemble methods use multiple models to improve machine learning results, as compared to a single model. In the concluding chapters, you'll delve into advanced ensemble models using neural networks, natural language processing, and more. You’ll also be able to implement models such as fraud detection, text categorization, and sentiment analysis. By the end of this book, you'll be able to harness ensemble techniques and the working mechanisms of machine learning algorithms to build intelligent models using individual recipes.

Related Content you might be interested in

Current Title:

Small book image
Ensemble Machine Learning Cookbook
Dipayan Sarkar | Vijayalakshmi Natarajan
Jan, 2019 | 336 pages
Small book image
Hands-On Ensemble Learning with Python
Konstantinos G Margaritis | George Kyriakides
Jul, 2019 | 298 pages
Small book image
scikit-learn Cookbook
Julian Avila | Trent Hauck
Nov, 2017 | 374 pages
Small book image
Mastering Machine Learning with scikit-learn
Gavin Hackeling
Jul, 2017 | 254 pages
Table of Contents (14 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Sections
Get in touch
Free Chapter
1
Get Closer to Your Data
Get Closer to Your Data
Introduction
Data manipulation with Python
Analyzing, visualizing, and treating missing values
Exploratory data analysis
2
Getting Started with Ensemble Machine Learning
Getting Started with Ensemble Machine Learning
Introduction to ensemble machine learning
Max-voting
Averaging
Weighted averaging
3
Resampling Methods
Resampling Methods
Introduction to sampling
k-fold and leave-one-out cross-validation
Bootstrapping
4
Statistical and Machine Learning Algorithms
Statistical and Machine Learning Algorithms
Technical requirements
Multiple linear regression
Logistic regression
Naive Bayes
Decision trees
Support vector machines
5
Bag the Models with Bagging
Bag the Models with Bagging
Introduction
Bootstrap aggregation
Ensemble meta-estimators
Bagging regressors
6
When in Doubt, Use Random Forests
When in Doubt, Use Random Forests
Introduction to random forests
Implementing a random forest for predicting credit card defaults using scikit-learn
Implementing random forest for predicting credit card defaults using H2O
7
Boosting Model Performance with Boosting
Boosting Model Performance with Boosting
Introduction to boosting
Implementing AdaBoost for disease risk prediction using scikit-learn
Implementing a gradient boosting machine for disease risk prediction using scikit-learn
Implementing the extreme gradient boosting method for glass identification using XGBoost with scikit-learn
8
Blend It with Stacking
Blend It with Stacking
Technical requirements
Understanding stacked generalization
Implementing stacked generalization by combining predictions
Implementing stacked generalization for campaign outcome prediction using H2O
9
Homogeneous Ensembles Using Keras
Homogeneous Ensembles Using Keras
Introduction
An ensemble of homogeneous models for energy prediction
An ensemble of homogeneous models for handwritten digit classification
10
Heterogeneous Ensemble Classifiers Using H2O
Heterogeneous Ensemble Classifiers Using H2O
Introduction
Predicting credit card defaulters using heterogeneous ensemble classifiers
11
Heterogeneous Ensemble for Text Classification Using NLP
Heterogeneous Ensemble for Text Classification Using NLP
Introduction
Spam filtering using an ensemble of heterogeneous algorithms
Sentiment analysis of movie reviews using an ensemble model
12
Homogenous Ensemble for Multiclass Classification Using Keras
Homogenous Ensemble for Multiclass Classification Using Keras
Introduction
An ensemble of homogeneous models to classify fashion products
13
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Decision trees

Decision trees, a non-parametric supervised learning method, are popular algorithms used for predictive modeling. The most well-known decision tree algorithms include the iterative dichotomizer (ID3), C4.5, CART, and C5.0. ID3 is only applicable for categorical features. C4.5 is an improvement on ID3 and has the ability to handle missing values and continuous attributes. The tree-growing process involves finding the best split at each node using the information gain. However, the C4.5 algorithm converts a continuous attribute into a dichotomous categorical attribute by splitting at a suitable threshold value that can produce maximum information gain.

Leo Breiman, a distinguished statistician, introduced a decision tree algorithm called the Classification and Regression Tree (CART). CART, unlike ID3 and C4.5, can produce decision trees that can be used for both...

Previous Section
End of Section 6
Next Section