6. Tree-based Methods | Mastering Predictive Analytics with R

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

Mastering Predictive Analytics with R

3.9 (18)

Mastering Predictive Analytics with R

3.9 (18)

Overview of this book

This book is intended for the budding data scientist, predictive modeler, or quantitative analyst with only a basic exposure to R and statistics. It is also designed to be a reference for experienced professionals wanting to brush up on the details of a particular type of predictive model. Mastering Predictive Analytics with R assumes familiarity with only the fundamentals of R, such as the main data types, simple functions, and how to move data around. No prior experience with machine learning or predictive modeling is assumed, however you should have a basic understanding of statistics and calculus at a high school level.

Preface

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Free Chapter

1. Gearing Up for Predictive Modeling

1. Gearing Up for Predictive Modeling

Models

Types of models

The process of predictive modeling

Performance metrics

Summary

2. Linear Regression

2. Linear Regression

Introduction to linear regression

Simple linear regression

Multiple linear regression

Assessing linear regression models

Problems with linear regression

Feature selection

Regularization

Summary

3. Logistic Regression

3. Logistic Regression

Classifying with linear regression

Introduction to logistic regression

Predicting heart disease

Assessing logistic regression models

Regularization with the lasso

Classification metrics

Extensions of the binary logistic classifier

Summary

4. Neural Networks

4. Neural Networks

The biological neuron

The artificial neuron

Stochastic gradient descent

Multilayer perceptron networks

Predicting the energy efficiency of buildings

Predicting glass type revisited

Predicting handwritten digits

Summary

5. Support Vector Machines

5. Support Vector Machines

Maximal margin classification

Support vector classification

Kernels and support vector machines

Predicting chemical biodegration

Cross-validation

Predicting credit scores

Multiclass classification with support vector machines

Summary

6. Tree-based Methods

6. Tree-based Methods

The intuition for tree models

Algorithms for training decision trees

Predicting class membership on synthetic 2D data

Predicting the authenticity of banknotes

Predicting complex skill learning

Summary

7. Ensemble Methods

7. Ensemble Methods

Bagging

Boosting

Predicting atmospheric gamma ray radiation

Predicting complex skill learning with boosting

Random forests

Summary

8. Probabilistic Graphical Models

8. Probabilistic Graphical Models

A little graph theory

Bayes' Theorem

Conditional independence

Bayesian networks

The Naïve Bayes classifier

Hidden Markov models

Predicting promoter gene sequences

Predicting letter patterns in English words

Summary

9. Time Series Analysis

9. Time Series Analysis

Fundamental concepts of time series

Some fundamental time series

Stationarity

Stationary time series models

Non-stationary time series models

Predicting intense earthquakes

Predicting lynx trappings

Predicting foreign exchange rates

Other time series models

Summary

10. Topic Modeling

10. Topic Modeling

An overview of topic modeling

Latent Dirichlet Allocation

Modeling the topics of online news stories

Summary

11. Recommendation Systems

11. Recommendation Systems

Rating matrix

Collaborative filtering

Singular value decomposition

R and Big Data

Predicting recommendations for movies and jokes

Loading and preprocessing the data

Exploring the data

Other approaches to recommendation systems

Summary

Index

Index

Predicting the authenticity of banknotes

In this section, we will study the problem of predicting whether a particular banknote is genuine or whether it has been forged. The banknote authentication data set is hosted at https://archive.ics.uci.edu/ml/datasets/banknote+authentication. The creators of the data set have taken specimens of both genuine and forged banknotes and photographed them with an industrial camera. The resulting grayscale image was processed using a type of time-frequency transformation known as a wavelet transform. Three features of this transform are constructed, and along with the image entropy, they make up the four features in total for this binary classification task.

Column name	Type	Definition
`waveletVar`	Numerical	Variance of the wavelet-transformed image
`waveletSkew`	Numerical	Skewness of the wavelet-transformed image
`waveletCurt`	Numerical	Curtosis of the wavelet-transformed image
`entropy`	Numerical	Entropy of the image
`class`	Binary	Authenticity...

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Mastering Predictive Analytics with R

Search

Your notes and bookmarks