Book Image

Hands-On Automated Machine Learning

By : Sibanjan Das, Umit Mert Cakmak
Book Image

Hands-On Automated Machine Learning

By: Sibanjan Das, Umit Mert Cakmak

Overview of this book

AutoML is designed to automate parts of Machine Learning. Readily available AutoML tools are making data science practitioners’ work easy and are received well in the advanced analytics community. Automated Machine Learning covers the necessary foundation needed to create automated machine learning modules and helps you get up to speed with them in the most practical way possible. In this book, you’ll learn how to automate different tasks in the machine learning pipeline such as data preprocessing, feature selection, model training, model optimization, and much more. In addition to this, it demonstrates how you can use the available automation libraries, such as auto-sklearn and MLBox, and create and extend your own custom AutoML components for Machine Learning. By the end of this book, you will have a clearer understanding of the different aspects of automated Machine Learning, and you’ll be able to incorporate automation tasks using practical datasets. You can leverage your learning from this book to implement Machine Learning in your projects and get a step closer to winning various machine learning competitions.

Related Content you might be interested in

Current Title:

Small book image
Hands-On Automated Machine Learning
Sibanjan Das | Umit Mert Cakmak
Apr, 2018 | 282 pages
Small book image
scikit-learn Cookbook
Julian Avila | Trent Hauck
Nov, 2017 | 374 pages
Small book image
Hands-On Machine Learning with scikit-learn and Scientific Python Toolkits
Tarek Amr
Jul, 2020 | 384 pages
Small book image
Machine Learning for OpenCV 4.
Vishwesh Ravi Shrimali | Aditya Sharma | Michael Beyeler
Sep, 2019 | 420 pages
Table of Contents (10 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Introduction to AutoML
Introduction to AutoML
Scope of machine learning
What is AutoML?
Why use AutoML and how does it help?
When do you automate ML?
What will you learn?
Overview of AutoML libraries
Summary
2
Introduction to Machine Learning Using Python
Introduction to Machine Learning Using Python
Technical requirements
Machine learning
Linear regression
Important evaluation metrics – regression algorithms
Logistic regression
Important evaluation metrics – classification algorithms
Decision trees
Support Vector Machines
k-Nearest Neighbors
Ensemble methods
Comparing the results of classifiers
Cross-validation
Clustering
Summary
3
Data Preprocessing
Data Preprocessing
Technical requirements
Data transformation
Feature selection
Feature generation
Summary
4
Automated Algorithm Selection
Automated Algorithm Selection
Technical requirements
Computational complexity
Differences in training and scoring time
Linearity versus non-linearity
Necessary feature transformations
Supervised ML
Unsupervised AutoML
Summary
5
Hyperparameter Optimization
Hyperparameter Optimization
Technical requirements
Hyperparameters
Warm start
Bayesian-based hyperparameter tuning
An example system
Summary
6
Creating AutoML Pipelines
Creating AutoML Pipelines
Technical requirements
An introduction to machine learning pipelines
A simple pipeline
FunctionTransformer
A complex pipeline
Summary
7
Dive into Deep Learning
Dive into Deep Learning
Technical requirements
Overview of neural networks
A feed-forward neural network using Keras
Autoencoders
Convolutional Neural Networks
Summary
8
Critical Aspects of ML and Data Science Projects
Critical Aspects of ML and Data Science Projects
Machine learning as a search
Trade-offs in machine learning
Engagement model for a typical data science project
The phases of an engagement model
Summary
9
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Bayesian-based hyperparameter tuning

There are a couple of approaches to be used when it comes to model-based hyperparameter tuning and these approaches come together under Sequential Model-based Global Optimization (SMBO).

When you think about GridSearchCV or RandomizedSearchCV, you may rightfully feel that the way they cross validate hyperparameters is not very smart. Both pre-define sets of hyperparameters to be validated during training time and are not designed to benefit from the information that they might get during training. If you could find a way to learn from previous iterations of hyperparameter validation based on model performance, then you would have an idea about which hyperparameter set is likely to give a better performance in the next iteration.

SMBO approaches emanated from this reasoning and Bayesian-based hyperparameter optimization is one of these approaches...

Previous Section
End of Section 5
Next Section