Book Image

Hands-On Deep Learning with R

By : Michael Pawlus, Rodger Devine
Book Image

Hands-On Deep Learning with R

By: Michael Pawlus, Rodger Devine

Overview of this book

Deep learning enables efficient and accurate learning from a massive amount of data. This book will help you overcome a number of challenges using various deep learning algorithms and architectures with R programming. This book starts with a brief overview of machine learning and deep learning and how to build your first neural network. You’ll understand the architecture of various deep learning algorithms and their applicable fields, learn how to build deep learning models, optimize hyperparameters, and evaluate model performance. Various deep learning applications in image processing, natural language processing (NLP), recommendation systems, and predictive analytics will also be covered. Later chapters will show you how to tackle recognition problems such as image recognition and signal detection, programmatically summarize documents, conduct topic modeling, and forecast stock market prices. Toward the end of the book, you will learn the common applications of GANs and how to build a face generation model using them. Finally, you’ll get to grips with using reinforcement learning and deep reinforcement learning to solve various real-world problems. By the end of this deep learning book, you will be able to build and deploy your own deep learning applications using appropriate frameworks and algorithms.

Related Content you might be interested in

Current Title:

Small book image
Hands-On Deep Learning with R
Michael Pawlus | Rodger Devine
Apr, 2020 | 330 pages
Small book image
Deep Learning with R Cookbook
Swarna Gupta | Rehan Ali Ansari | Dipayan Sarkar
Feb, 2020 | 328 pages
Small book image
R Deep Learning Essentials
Mark Hodnett | Joshua F Wiley
Aug, 2018 | 378 pages
Small book image
Advanced Deep Learning with R
Bharatendra Rai
Dec, 2019 | 352 pages
Table of Contents (16 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
1
Section 1: Deep Learning Basics
Section 1: Deep Learning Basics
Free Chapter
2
Machine Learning Basics
Machine Learning Basics
An overview of machine learning
Preparing data for modeling
Training a model on prepared data
Evaluating model results
Improving model results
Reviewing different algorithms
Summary
3
Setting Up R for Deep Learning
Setting Up R for Deep Learning
Technical requirements
Installing the packages
Preparing a sample dataset
Exploring Keras
Exploring MXNet
Exploring H2O
Exploring ReinforcementLearning and RBM
Comparing the deep learning libraries
Summary
4
Artificial Neural Networks
Artificial Neural Networks
Technical requirements
Contrasting deep learning with machine learning
Comparing neural networks and the human brain
Utilizing bias and activation functions within hidden layers
Surveying activation functions
Creating a feedforward network
Augmenting our neural network with backpropagation
Summary
5
Section 2: Deep Learning Applications
Section 2: Deep Learning Applications
6
CNNs for Image Recognition
CNNs for Image Recognition
Technical requirements
Image recognition with shallow nets
Image recognition with convolutional neural networks
Enhancing the model with additional layers
Choosing the most appropriate activation function
Selecting optimal epochs using dropout and early stopping
Summary
7
Multilayer Perceptron for Signal Detection
Multilayer Perceptron for Signal Detection
Technical requirements
Understanding multilayer perceptrons
Preparing and preprocessing data
Deciding on the hidden layers and neurons
Training and evaluating the model
Summary
8
Neural Collaborative Filtering Using Embeddings
Neural Collaborative Filtering Using Embeddings
Technical requirements
Introducing recommender systems
Collaborative filtering with neural networks
Exploring embeddings
Preparing, preprocessing, and exploring data
Performing exploratory data analysis
Creating user and item embeddings
Building and training a neural recommender system
Evaluating results and tuning hyperparameters
Summary
9
Deep Learning for Natural Language Processing
Deep Learning for Natural Language Processing
Formatting data using tokenization
Cleaning text to remove noise
Applying word embeddings to increase usable data
Clustering data into topic groups
Summarizing documents using model results
Creating an RBM
Defining the Gibbs sampling rate
Speeding up sampling with contrastive divergence
Computing free energy for model evaluation
Stacking RBMs to create a deep belief network
Summary
10
Long Short-Term Memory Networks for Stock Forecasting
Long Short-Term Memory Networks for Stock Forecasting
Technical requirements
Understanding common methods for stock market prediction
Preparing and preprocessing data
Configuring a data generator
Training and evaluating the model
Tuning hyperparameters to improve performance
Summary
11
Generative Adversarial Networks for Faces
Generative Adversarial Networks for Faces
Technical requirements
An overview of GANs
Defining the generator model
Defining the discriminator model
Preparing and preprocessing a dataset
Training and evaluating the model
Summary
12
Section 3: Reinforcement Learning
Section 3: Reinforcement Learning
13
Reinforcement Learning for Gaming
Reinforcement Learning for Gaming
Technical requirements
Understanding the concept of reinforcement learning
Preparing and processing data
Configuring the reinforcement agent
Tuning hyperparameters
Summary
14
Deep Q-Learning for Maze Solving
Deep Q-Learning for Maze Solving
Technical requirements
Creating an environment for reinforcement learning
Defining an agent to perform actions
Building a deep Q-learning model 
Running the experiment
Improving performance with policy functions
Summary
15
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Deep Q-Learning for Maze Solving

In this chapter, you will learn how to use R to implement reinforcement learning techniques within a maze environment. In particular, we will create an agent to solve a maze by training the agent to perform actions and learn from failed attempts. We will learn how to define the maze environment and configure the agent to travel through it. We will also be adding neural networks to Q-learning. This provides us with an alternative way of getting the value for all the state-action pairs. We are going to iterate over our model numerous times to create the policy to get through the maze.

This chapter will cover the following topics:

  • Creating an environment for reinforcement learning
  • Defining an agent to perform actions 
  • Building a deep Q-learning model
  • Running the experiment
  • Improving performance with policy functions
...
Previous Section
End of Section 1
Next Section