Ensemble Machine Learning Cookbook

By : Dipayan Sarkar, Vijayalakshmi Natarajan

Ensemble Machine Learning Cookbook

By: Dipayan Sarkar, Vijayalakshmi Natarajan

Overview of this book

Ensemble modeling is an approach used to improve the performance of machine learning models. It combines two or more similar or dissimilar machine learning algorithms to deliver superior intellectual powers. This book will help you to implement popular machine learning algorithms to cover different paradigms of ensemble machine learning such as boosting, bagging, and stacking. The Ensemble Machine Learning Cookbook will start by getting you acquainted with the basics of ensemble techniques and exploratory data analysis. You'll then learn to implement tasks related to statistical and machine learning algorithms to understand the ensemble of multiple heterogeneous algorithms. It will also ensure that you don't miss out on key topics, such as like resampling methods. As you progress, you’ll get a better understanding of bagging, boosting, stacking, and working with the Random Forest algorithm using real-world examples. The book will highlight how these ensemble methods use multiple models to improve machine learning results, as compared to a single model. In the concluding chapters, you'll delve into advanced ensemble models using neural networks, natural language processing, and more. You’ll also be able to implement models such as fraud detection, text categorization, and sentiment analysis. By the end of this book, you'll be able to harness ensemble techniques and the working mechanisms of machine learning algorithms to build intelligent models using individual recipes.

Preface

Who this book is for

What this book covers

To get the most out of this book

Sections

Get in touch

Free Chapter

Get Closer to Your Data

Introduction

Data manipulation with Python

Analyzing, visualizing, and treating missing values

Exploratory data analysis

Getting Started with Ensemble Machine Learning

Introduction to ensemble machine learning

Max-voting

Averaging

Weighted averaging

Resampling Methods

Introduction to sampling

k-fold and leave-one-out cross-validation

Bootstrapping

Statistical and Machine Learning Algorithms

Technical requirements

Multiple linear regression

Logistic regression

Naive Bayes

Decision trees

Support vector machines

Bag the Models with Bagging

Introduction

Bootstrap aggregation

Ensemble meta-estimators

Bagging regressors

When in Doubt, Use Random Forests

Introduction to random forests

Implementing a random forest for predicting credit card defaults using scikit-learn

Implementing random forest for predicting credit card defaults using H2O

Boosting Model Performance with Boosting

Introduction to boosting

Implementing AdaBoost for disease risk prediction using scikit-learn

Implementing a gradient boosting machine for disease risk prediction using scikit-learn

Implementing the extreme gradient boosting method for glass identification using XGBoost with scikit-learn

Blend It with Stacking

Technical requirements

Understanding stacked generalization

Implementing stacked generalization by combining predictions

Implementing stacked generalization for campaign outcome prediction using H2O

Homogeneous Ensembles Using Keras

Introduction

An ensemble of homogeneous models for energy prediction

An ensemble of homogeneous models for handwritten digit classification

Heterogeneous Ensemble Classifiers Using H2O

Introduction

Predicting credit card defaulters using heterogeneous ensemble classifiers

Heterogeneous Ensemble for Text Classification Using NLP

Introduction

Spam filtering using an ensemble of heterogeneous algorithms

Sentiment analysis of movie reviews using an ensemble model

Homogenous Ensemble for Multiclass Classification Using Keras

Introduction

An ensemble of homogeneous models to classify fashion products

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

5 star

4 star

3 star

2 star

1 star

To get the most out of this book

Readers will need a working knowledge of Python programming and basic statistics to help you grasp the concepts in the book.

Download the example code files

You can download the example code files for this book from your account at www.packt.com. If you purchased this book elsewhere, you can visit www.packt.com/support and register to have the files emailed directly to you.

You can download the code files by following these steps:

Log in or register at www.packt.com.
Select the SUPPORT tab.
Click on Code Downloads & Errata.
Enter the name of the book in the Search box and follow the onscreen instructions.

Once the file is downloaded, please make sure that you unzip or extract the folder using the latest version of:

WinRAR/7-Zip for Windows
Zipeg/iZip/UnRarX for Mac
7-Zip/PeaZip for Linux

The code bundle for the book is also hosted on GitHub at https://github.com/PacktPublishing/Ensemble-Machine-Learning-Cookbook. In case there's an update to the code, it will be updated on the existing GitHub repository.

We also have other code bundles from our rich catalog of books and videos available at https://github.com/PacktPublishing/. Check them out!

Download the color images

We also provide a PDF file that has color images of the screenshots/diagrams used in this book. You can download it here: http://www.packtpub.com/sites/default/files/downloads/9781789136609_ColorImages.pdf.

Conventions used

There are a number of text conventions used throughout this book.

CodeInText: Indicates code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles. Here is an example: "We will use the os package in the operating system's dependent functionality, and the pandas package for data manipulation."

A block of code is set as follows:

import os
import pandas as pd

# Set working directory as per your need
os.chdir(".../.../Chapter 1")
os.getcwd()

Warnings or important notes appear like this.

Tips and tricks appear like this.

Ensemble Machine Learning Cookbook

By : Dipayan Sarkar, Vijayalakshmi Natarajan

Ensemble Machine Learning Cookbook

By: Dipayan Sarkar, Vijayalakshmi Natarajan

Overview of this book

Related Content you might be interested in

Current Title:

Ensemble Machine Learning Cookbook

Hands-On Ensemble Learning with Python

scikit-learn Cookbook

Mastering Machine Learning with scikit-learn