Book Image

R Deep Learning Essentials

By : Joshua F. Wiley
Book Image

R Deep Learning Essentials

By: Joshua F. Wiley

Overview of this book

<p>Deep learning is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using model architectures. With the superb memory management and the full integration with multi-node big data platforms, the H2O engine has become more and more popular among data scientists in the field of deep learning.</p> <p>This book will introduce you to the deep learning package H2O with R and help you understand the concepts of deep learning. We will start by setting up important deep learning packages available in R and then move towards building models related to neural networks, prediction, and deep prediction, all of this with the help of real-life examples.</p> <p>After installing the H2O package, you will learn about prediction algorithms. Moving ahead, concepts such as overfitting data, anomalous data, and deep prediction models are explained. Finally, the book will cover concepts relating to tuning and optimizing models.</p>

Related Content you might be interested in

Current Title:

Small book image
R Deep Learning Essentials
Joshua F. Wiley
Mar, 2016 | 170 pages
No titles found
Table of Contents (14 chapters)
R Deep Learning Essentials
R Deep Learning Essentials
Credits
Credits
About the Author
About the Author
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Getting Started with Deep Learning
Getting Started with Deep Learning
What is deep learning?
R packages for deep learning
Connecting R and H2O
Summary
2
Training a Prediction Model
Training a Prediction Model
Neural networks in R
The problem of overfitting data – the consequences explained
Use case – build and apply a neural network
Summary
3
Preventing Overfitting
Preventing Overfitting
L1 penalty
L2 penalty
Ensembles and model averaging
Use case – improving out-of-sample model performance using dropout
Summary
4
Identifying Anomalous Data
Identifying Anomalous Data
Getting started with unsupervised learning
How do auto-encoders work?
Training an auto-encoder in R
Use case – building and applying an auto-encoder model
Fine-tuning auto-encoder models
Summary
5
Training Deep Prediction Models
Training Deep Prediction Models
Getting started with deep feedforward neural networks
Common activation functions – rectifiers, hyperbolic tangent, and maxout
Picking hyperparameters
Training and predicting new data from a deep neural network
Use case – training a deep neural network for automatic classification
Summary
6
Tuning and Optimizing Models
Tuning and Optimizing Models
Dealing with missing data
Solutions for models with low accuracy
Summary
Bibliography
Bibliography
Index
Index

Chapter 5. Training Deep Prediction Models

In this chapter we will explore how to train and build deep prediction models. We will focus on feedforward neural networks, which are perhaps the most common type and a good starting point.

This chapter will cover the following topics:

  • Getting started with deep feedforward neural networks

  • Common activation functions: rectifiers, hyperbolic tangent, and maxout

  • Picking hyperparameters

  • Training and predicting new data from a deep neural network

  • Use case – training a deep neural network for automatic classification

In this chapter, we will not use any new packages. The only requirements are to source the checkpoint.R file to set up the R environment for the rest of the code shown and to initialize the H2O cluster. Both can be done using the following code:

source("checkpoint.R")
options(width = 70, digits = 2)

cl <- h2o.init(
  max_mem_size = "12G",
  nthreads = 4)
Previous Section
End of Section 1
Next Section