Book Image

Hands-On Ensemble Learning with R

By : Prabhanjan Narayanachar Tattar
Book Image

Hands-On Ensemble Learning with R

By: Prabhanjan Narayanachar Tattar

Overview of this book

Ensemble techniques are used for combining two or more similar or dissimilar machine learning algorithms to create a stronger model. Such a model delivers superior prediction power and can give your datasets a boost in accuracy. Hands-On Ensemble Learning with R begins with the important statistical resampling methods. You will then walk through the central trilogy of ensemble techniques – bagging, random forest, and boosting – then you'll learn how they can be used to provide greater accuracy on large datasets using popular R packages. You will learn how to combine model predictions using different machine learning algorithms to build ensemble models. In addition to this, you will explore how to improve the performance of your ensemble models. By the end of this book, you will have learned how machine learning algorithms can be combined to reduce common problems and build simple efficient ensemble models with the help of real-world examples.
Table of Contents (17 chapters)
Hands-On Ensemble Learning with R
Contributors
Preface
12
What's Next?
Index

Regression models


Sir Francis Galton invented the simple linear regression model near the end of the nineteenth century. The example used looked at how a parent's height influences the height of their child. This study used data and laid the basis of regression analysis. The correlation between the height of parents and children is well known, and using data on 928 pairs of height measurements, a linear regression was developed by Galton. In an equivalent form, however, the method might have been in informal use before Galton officially invented it. The simple linear regression model consists of a single input (independent) variable and the output is also a single output.

In this supervised learning method, the target variable/output/dependent variable is a continuous variable, and it can also take values in intervals, including non-negative and real numbers. The input/independent variable has no restrictions and as such it can be numeric, categorical, or in any other form we used earlier...