Book Image

Hands-On Ensemble Learning with Python

By : George Kyriakides, Konstantinos G. Margaritis
Book Image

Hands-On Ensemble Learning with Python

By: George Kyriakides, Konstantinos G. Margaritis

Overview of this book

Ensembling is a technique of combining two or more similar or dissimilar machine learning algorithms to create a model that delivers superior predictive power. This book will demonstrate how you can use a variety of weak algorithms to make a strong predictive model. With its hands-on approach, you'll not only get up to speed with the basic theory but also the application of different ensemble learning techniques. Using examples and real-world datasets, you'll be able to produce better machine learning models to solve supervised learning problems such as classification and regression. In addition to this, you'll go on to leverage ensemble learning techniques such as clustering to produce unsupervised machine learning models. As you progress, the chapters will cover different machine learning algorithms that are widely used in the practical world to make predictions and classifications. You'll even get to grips with the use of Python libraries such as scikit-learn and Keras for implementing different ensemble models. By the end of this book, you will be well-versed in ensemble learning, and have the skills you need to understand which ensemble method is required for which problem, and successfully implement them in real-world scenarios.

Related Content you might be interested in

Current Title:

Small book image
Hands-On Ensemble Learning with Python
George Kyriakides | Konstantinos G. Margaritis
Jul, 2019 | 298 pages
Small book image
Ensemble Machine Learning Cookbook
Vijayalakshmi Natarajan | Dipayan Sarkar
Jan, 2019 | 336 pages
Small book image
scikit-learn Cookbook
Julian Avila | Trent Hauck
Nov, 2017 | 374 pages
Small book image
Machine Learning with scikit-learn Quick Start Guide
Kevin Jolly
Oct, 2018 | 172 pages
Table of Contents (20 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Section 1: Introduction and Required Software Tools
Section 1: Introduction and Required Software Tools
2
A Machine Learning Refresher
A Machine Learning Refresher
Technical requirements
Learning from data
Supervised and unsupervised learning
Performance measures
Machine learning algorithms
Summary
3
Getting Started with Ensemble Learning
Getting Started with Ensemble Learning
Technical requirements
Bias, variance, and the trade-off
Ensemble learning
Difficulties in ensemble learning
Summary
4
Section 2: Non-Generative Methods
Section 2: Non-Generative Methods
5
Voting
Voting
Technical requirements
Hard and soft voting
​Python implementation
Using scikit-learn
Summary
6
Stacking
Stacking
Technical requirements
Meta-learning
Deciding on an ensemble's composition
Python implementation
Summary
7
Section 3: Generative Methods
Section 3: Generative Methods
8
Bagging
Bagging
Technical requirements
Bootstrapping
Bagging
Python implementation
Using scikit-learn
Summary
9
Boosting
Boosting
Technical requirements
AdaBoost
Gradient boosting
Using scikit-learn
XGBoost
Summary
10
Random Forests
Random Forests
Technical requirements
Understanding random forest trees
Creating forests
Using scikit-learn
Summary
11
Section 4: Clustering
Section 4: Clustering
12
Clustering
Clustering
Technical requirements
Consensus clustering
Using OpenEnsembles
Summary
13
Section 5: Real World Applications
Section 5: Real World Applications
14
Classifying Fraudulent Transactions
Classifying Fraudulent Transactions
Technical requirements
Getting familiar with the dataset
Exploratory analysis
Voting
Stacking
Bagging
Boosting
Using random forests
Comparative analysis of ensembles
Summary
15
Predicting Bitcoin Prices
Predicting Bitcoin Prices
Technical requirements
Time series data
Voting
Stacking
Bagging
Boosting
Random forests
Summary
16
Evaluating Sentiment on Twitter
Evaluating Sentiment on Twitter
Technical requirements
Sentiment analysis tools
Getting Twitter data
Creating a model
Classifying tweets in real time
Summary
17
Recommending Movies with Keras
Recommending Movies with Keras
Technical requirements
Demystifying recommendation systems
Neural recommendation systems
Using Keras for movie recommendations
Summary
18
Clustering World Happiness
Clustering World Happiness
Technical requirements
Understanding the World Happiness Report
Creating the ensemble
Gaining insights
Summary
19
Another Book You May Enjoy
Another Book You May Enjoy
Leave a review - let other readers know what you think

Get in touch

Feedback from our readers is always welcome.

General feedback: If you have questions about any aspect of this book, mention the book title in the subject of your message and email us at [email protected].

Errata: Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you have found a mistake in this book, we would be grateful if you would report this to us. Please visit www.packt.com/submit-errata, selecting your book, clicking on the Errata Submission Form link, and entering the details.

Piracy: If you come across any illegal copies of our works in any form on the Internet, we would be grateful if you would provide us with the location address or website name. Please contact us at [email protected] with a link to the material.

If you are interested in becoming an author: If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, please visit authors.packtpub.com.

Reviews

Please leave a review. Once you have read and used this book, why not leave a review on the site that you purchased it from? Potential readers can then see and use your unbiased opinion to make purchase decisions, we at Packt can understand what you think about our products, and our authors can see your feedback on their book. Thank you!

For more information about Packt, please visit packt.com.

Previous Section
Next Chapter