Book Image

R Deep Learning Essentials

By : Joshua F. Wiley
Book Image

R Deep Learning Essentials

By: Joshua F. Wiley

Overview of this book

<p>Deep learning is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using model architectures. With the superb memory management and the full integration with multi-node big data platforms, the H2O engine has become more and more popular among data scientists in the field of deep learning.</p> <p>This book will introduce you to the deep learning package H2O with R and help you understand the concepts of deep learning. We will start by setting up important deep learning packages available in R and then move towards building models related to neural networks, prediction, and deep prediction, all of this with the help of real-life examples.</p> <p>After installing the H2O package, you will learn about prediction algorithms. Moving ahead, concepts such as overfitting data, anomalous data, and deep prediction models are explained. Finally, the book will cover concepts relating to tuning and optimizing models.</p>

Related Content you might be interested in

Current Title:

Small book image
R Deep Learning Essentials
Joshua F. Wiley
Mar, 2016 | 170 pages
No titles found
Table of Contents (14 chapters)
R Deep Learning Essentials
R Deep Learning Essentials
Credits
Credits
About the Author
About the Author
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Getting Started with Deep Learning
Getting Started with Deep Learning
What is deep learning?
R packages for deep learning
Connecting R and H2O
Summary
2
Training a Prediction Model
Training a Prediction Model
Neural networks in R
The problem of overfitting data – the consequences explained
Use case – build and apply a neural network
Summary
3
Preventing Overfitting
Preventing Overfitting
L1 penalty
L2 penalty
Ensembles and model averaging
Use case – improving out-of-sample model performance using dropout
Summary
4
Identifying Anomalous Data
Identifying Anomalous Data
Getting started with unsupervised learning
How do auto-encoders work?
Training an auto-encoder in R
Use case – building and applying an auto-encoder model
Fine-tuning auto-encoder models
Summary
5
Training Deep Prediction Models
Training Deep Prediction Models
Getting started with deep feedforward neural networks
Common activation functions – rectifiers, hyperbolic tangent, and maxout
Picking hyperparameters
Training and predicting new data from a deep neural network
Use case – training a deep neural network for automatic classification
Summary
6
Tuning and Optimizing Models
Tuning and Optimizing Models
Dealing with missing data
Solutions for models with low accuracy
Summary
Bibliography
Bibliography
Index
Index

Chapter 6. Tuning and Optimizing Models

In this final chapter, we will discuss a few approaches to tuning models. We will cover ways of addressing missing data. Although we have used example datasets without any missing data, in the real world missing data is a common occurrence. We will also discuss what can be done when a model is performing poorly, including a detailed examination of how to search for and optimize model hyperparameters.

This chapter will cover the following topics:

  • Dealing with missing data

  • Solutions for models with low accuracy

In this chapter, we make use of two new packages: the gridExtra package for graphics and the mgcv package for fitting generalized additive models at the end. These new packages should be added to the checkpoint.R file, and the file should be sourced to set up the R environment for the rest of the code shown. R can be set up and an H2O cluster initialized using the following code:

source("checkpoint.R")
options(width = 70, digits = 2)

cl <- h2o...
Previous Section
End of Section 1
Next Section