Book Image

Advanced Machine Learning with R

By : Cory Lesmeister, Dr. Sunil Kumar Chinnamgari
Book Image

Advanced Machine Learning with R

By: Cory Lesmeister, Dr. Sunil Kumar Chinnamgari

Overview of this book

R is one of the most popular languages when it comes to exploring the mathematical side of machine learning and easily performing computational statistics. This Learning Path shows you how to leverage the R ecosystem to build efficient machine learning applications that carry out intelligent tasks within your organization. You’ll work through realistic projects such as building powerful machine learning models with ensembles to predict employee attrition. Next, you’ll explore different clustering techniques to segment customers using wholesale data and even apply TensorFlow and Keras-R for performing advanced computations. Each chapter will help you implement advanced machine learning algorithms using real-world examples. You’ll also be introduced to reinforcement learning along with its use cases and models. Finally, this Learning Path will provide you with a glimpse into how some of these black box models can be diagnosed and understood. By the end of this Learning Path, you’ll be equipped with the skills you need to deploy machine learning techniques in your own projects.

Related Content you might be interested in

Current Title:

Small book image
Advanced Machine Learning with R
Cory Lesmeister | Dr. Sunil Kumar Chinnamgari
May, 2019 | 11 hours 4 minutes
No titles found
Table of Contents (30 chapters)
Title Page
Title Page
Copyright and Credits
Copyright and Credits
About Packt
About Packt
Contributors
Contributors
Preface
Preface
Free Chapter
1
Preparing and Understanding Data
Preparing and Understanding Data
Overview
Reading the data
Handling duplicate observations
Handling missing values
Zero and near-zero variance features
Treating the data
Summary
2
Linear Regression
Linear Regression
Univariate linear regression
Multivariate linear regression
Summary
3
Logistic Regression
Logistic Regression
Classification methods and linear regression
Logistic regression
Model training and evaluation
Summary
4
Advanced Feature Selection in Linear Models
Advanced Feature Selection in Linear Models
Regularization overview
Data creation
Modeling and evaluation
Summary
5
K-Nearest Neighbors and Support Vector Machines
K-Nearest Neighbors and Support Vector Machines
K-nearest neighbors
Support vector machines
Manipulating data
Modeling and evaluation
Summary
6
Tree-Based Classification
Tree-Based Classification
An overview of the techniques
Datasets and modeling
Summary
7
Neural Networks and Deep Learning
Neural Networks and Deep Learning
Introduction to neural networks
Deep learning – a not-so-deep overview
Creating a simple neural network
An example of deep learning
Summary
8
Creating Ensembles and Multiclass Methods
Creating Ensembles and Multiclass Methods
Ensembles
Data understanding
Modeling and evaluation
Summary
9
Cluster Analysis
Cluster Analysis
Hierarchical clustering
K-means clustering
Gower and PAM
Random forest
Dataset background
Data understanding and preparation
Modeling 
Summary
10
Principal Component Analysis
Principal Component Analysis
An overview of the principal components
Data
PCA modeling
Summary
11
Association Analysis
Association Analysis
An overview of association analysis
Data understanding
Data preparation
Modeling and evaluation
Summary
12
Time Series and Causality
Time Series and Causality
Univariate time series analysis
Time series data
Modeling and evaluation
Summary
13
Text Mining
Text Mining
Text mining framework and methods
Data overview
Word frequency
Sentiment analysis
N-grams
Topic models
Classifying text
Additional quantitative analysis
Summary
14
Exploring the Machine Learning Landscape
Exploring the Machine Learning Landscape
ML versus software engineering
Types of ML methods
ML terminology – a quick review
ML project pipeline
Learning paradigm
Datasets
Summary
15
Predicting Employee Attrition Using Ensemble Models
Predicting Employee Attrition Using Ensemble Models
Philosophy behind ensembling 
Getting started
Understanding the attrition problem and the dataset 
K-nearest neighbors model for benchmarking the performance
Bagging
Randomization with random forests
Boosting 
Stacking 
Summary
16
Implementing a Jokes Recommendation Engine
Implementing a Jokes Recommendation Engine
Fundamental aspects of recommendation engines
Getting started
Understanding the Jokes recommendation problem and the dataset
Building a recommendation system with an item-based collaborative filtering technique
Building a recommendation system with a user-based collaborative filtering technique
Building a recommendation system based on an association-rule mining technique
Content-based recommendation engine
Building a hybrid recommendation system for Jokes recommendations
Summary
References
17
Sentiment Analysis of Amazon Reviews with NLP
Sentiment Analysis of Amazon Reviews with NLP
The sentiment analysis problem
Getting started
Understanding the Amazon reviews dataset
Building a text sentiment classifier with the BoW approach
Understanding word embedding
Building a text sentiment classifier with pretrained word2vec word embedding based on Reuters news corpus
Building a text sentiment classifier with GloVe word embedding
Building a text sentiment classifier with fastText
Summary
18
Customer Segmentation Using Wholesale Data
Customer Segmentation Using Wholesale Data
Understanding customer segmentation
Understanding the wholesale customer dataset and the segmentation problem
Identifying the customer segments in wholesale customer data using k-means clustering
Identifying the customer segments in the wholesale customer data using DIANA
Identifying the customer segments in the wholesale customers data using AGNES
Summary
19
Image Recognition Using Deep Neural Networks
Image Recognition Using Deep Neural Networks
Technical requirements
Understanding computer vision
Achieving computer vision with deep learning
Introduction to the MXNet framework
Understanding the MNIST dataset
Implementing a deep learning network for handwritten digit recognition
Implementing computer vision with pretrained models
Summary
20
Credit Card Fraud Detection Using Autoencoders
Credit Card Fraud Detection Using Autoencoders
Machine learning in credit card fraud detection
Autoencoders explained
The credit card fraud dataset
Building AEs with the H2O library in R
Summary
21
Automatic Prose Generation with Recurrent Neural Networks
Automatic Prose Generation with Recurrent Neural Networks
Understanding language models
Exploring recurrent neural networks
Backpropagation through time
Problems and solutions to gradients in RNN
Building an automated prose generator with an RNN
Summary
22
Winning the Casino Slot Machines with Reinforcement Learning
Winning the Casino Slot Machines with Reinforcement Learning
Understanding RL
Multi-arm bandit – real-world use cases
Solving the MABP with UCB and Thompson sampling algorithms
Summary
Creating a Package
Creating a Package
Creating a new package
Summary
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think
Index
Index

PCA modeling

For the modeling process, we will use the following steps:

  1. Extract the components and determine the number to retain
  2. Rotate the retained components
  3. Interpret the rotated solution
  4. Create scores from the non-rotated components
  5. Use the scores as input variables for regression analysis with MARS and evaluate the performance on the test data

There are many different ways and packages used to conduct PCA in R, including what seems to be the most commonly used prcomp() and princomp() functions in base R. However, for my money, it seems that the psych package is the most flexible with the best options.

Component extraction

To extract the components with the psych package, you will use the principal() function. The syntax will include the data and whether or not we want to rotate the components at this time:

> pca <- principal(train_scale, rotate = "none")

You can examine the components by calling the pca object that we created. However, my primary intent is to determine what should be the...

Previous Section
End of Section 4
Next Section