R Deep Learning Cookbook

R Deep Learning Cookbook

By : PKS Prakash, Achyutuni Sri Krishna Rao

Buy this Book

R Deep Learning Cookbook

By: PKS Prakash, Achyutuni Sri Krishna Rao

Buy this Book

Overview of this book

Deep Learning is the next big thing. It is a part of machine learning. It's favorable results in applications with huge and complex data is remarkable. Simultaneously, R programming language is very popular amongst the data miners and statisticians. This book will help you to get through the problems that you face during the execution of different tasks and Understand hacks in deep learning, neural networks, and advanced machine learning techniques. It will also take you through complex deep learning algorithms and various deep learning packages and libraries in R. It will be starting with different packages in Deep Learning to neural networks and structures. You will also encounter the applications in text mining and processing along with a comparison between CPU and GPU performance. By the end of the book, you will have a logical understanding of Deep learning and different deep learning packages to have the most appropriate solutions for your problems.

Title Page

Credits

About the Authors

About the Reviewer

www.PacktPub.com

Customer Feedback

Preface

Free Chapter

Getting Started

Introduction

Installing R with an IDE

Installing a Jupyter Notebook application

Starting with the basics of machine learning in R

Setting up deep learning tools/packages in R

Installing MXNet in R

Installing TensorFlow in R

Installing H2O in R

Installing all three packages at once using Docker

Deep Learning with R

Starting with logistic regression

Introducing the dataset

Performing logistic regression using H2O

Performing logistic regression using TensorFlow

Visualizing TensorFlow graphs

Starting with multilayer perceptrons

Setting up a neural network using H2O

Tuning hyper-parameters using grid searches in H2O

Setting up a neural network using MXNet

Setting up a neural network using TensorFlow

Convolution Neural Network

Introduction

Downloading and configuring an image dataset

Learning the architecture of a CNN classifier

Using functions to initialize weights and biases

Using functions to create a new convolution layer

Using functions to flatten the densely connected layer

Defining placeholder variables

Creating the first convolution layer

Creating the second convolution layer

Flattening the second convolution layer

Creating the first fully connected layer

Applying dropout to the first fully connected layer

Creating the second fully connected layer with dropout

Applying softmax activation to obtain a predicted class

Defining the cost function used for optimization

Performing gradient descent cost optimization

Executing the graph in a TensorFlow session

Evaluating the performance on test data

Data Representation Using Autoencoders

Introduction

Setting up autoencoders

Data normalization

Setting up a regularized autoencoder

Fine-tuning the parameters of the autoencoder

Setting up stacked autoencoders

Setting up denoising autoencoders

Building and comparing stochastic encoders and decoders

Learning manifolds from autoencoders

Evaluating the sparse decomposition

Generative Models in Deep Learning

Comparing principal component analysis with the Restricted Boltzmann machine

Setting up a Restricted Boltzmann machine for Bernoulli distribution input

Training a Restricted Boltzmann machine

Backward or reconstruction phase of RBM

Understanding the contrastive divergence of the reconstruction

Initializing and starting a new TensorFlow session

Evaluating the output from an RBM

Setting up a Restricted Boltzmann machine for Collaborative Filtering

Performing a full run of training an RBM

Setting up a Deep Belief Network

Implementing a feed-forward backpropagation Neural Network

Setting up a Deep Restricted Boltzmann Machine

Recurrent Neural Networks

Setting up a basic Recurrent Neural Network

Setting up a bidirectional RNN model

Setting up a deep RNN model

Setting up a Long short-term memory based sequence model

Reinforcement Learning

Introduction

Setting up a Markov Decision Process

Performing model-based learning

Performing model-free learning

Application of Deep Learning in Text Mining

Performing preprocessing of textual data and extraction of sentiments

Analyzing documents using tf-idf

Performing sentiment prediction using LSTM network

Application using text2vec examples

Application of Deep Learning to Signal processing

Introducing and preprocessing music MIDI files

Building an RBM model

Generating new music notes

Transfer Learning

Introduction

Illustrating the use of a pretrained model

Setting up the Transfer Learning model

Building an image classification model

Training a deep learning model on a GPU

Comparing performance using CPU and GPU

Customer Reviews

5 star

4 star

3 star

2 star

1 star

Installing MXNet in R

This section will cover the installation of MXNet in R.

Getting ready

The MXNet package is a lightweight deep learning architecture supporting multiple programming languages such as R, Python, and Julia. From a programming perspective, it is a combination of symbolic and imperative programming with support for CPU and GPU.

The CPU-based MXNet in R can be installed using the prebuilt binary package or the source code where the libraries need to be built. In Windows/mac, prebuilt binary packages can be download and installed directly from the R console. MXNet requires the R version to be 3.2.0 and higher. The installation requires the drat package from CRAN. The drat package helps maintain R repositories and can be installed using the install.packages() command.

To install MXNet on Linux (13.10 or later), the following are some dependencies:

Git (to get the code from GitHub)
libatlas-base-dev (to perform linear algebraic operations)
libopencv-dev (to perform computer vision operations)

To install MXNet with a GPU processor, the following are some dependencies:

Microsoft Visual Studio 2013
The NVIDIA CUDA Toolkit
The MXNet package
cuDNN (to provide a deep neural network library)

Another quick way to install mxnet with all the dependencies is to use the prebuilt Docker image from the chstone repository. The chstone/mxnet-gpu Docker image will be installed using the following tools:

MXNet for R and Python
Ubuntu 16.04
CUDA (Optional for GPU)
cuDNN (Optional for GPU)

How to do it...

The following R command installs MXNet using prebuilt binary packages, and is hassle-free. The drat package is then used to add the dlmc repository from git followed by the mxnet installation:

install.packages("drat", repos="https://cran.rstudio.com")
drat:::addRepo("dmlc")
install.packages("mxnet")

2. The following code helps install MXNet in Ubuntu (V16.04). The first two lines are used to install dependencies and the remaining lines are used to install MXNet, subject to the satisfaction of all the dependencies:

sudo apt-get update
sudo apt-get install -y build-essential git libatlas-base-dev
libopencv-dev
git clone https://github.com/dmlc/mxnet.git ~/mxnet --recursive
cd ~/mxnet
cp make/config.mk .
echo "USE_BLAS=openblas" >>config.mk
make -j$(nproc)

3. If MXNet is to be built for GPU, the following config needs to be updated before the make command:

echo "USE_CUDA=1" >>config.mk
echo "USE_CUDA_PATH=/usr/local/cuda" >>config.mk
echo "USE_CUDNN=1" >>config.mk

Note

A detailed installation of MXNet for other operating systems can be found at http://mxnet.io/get_started/setup.html.

4. The following command is used to install MXNet (GPU-based) using Docker with all the dependencies:

docker pull chstone/mxnet-gpu

R Deep Learning Cookbook

By : PKS Prakash, Achyutuni Sri Krishna Rao

R Deep Learning Cookbook

By: PKS Prakash, Achyutuni Sri Krishna Rao

Overview of this book

Related Content you might be interested in

Current Title:

R Deep Learning Cookbook

Practical Convolutional Neural Networks

Neural Network Programming with Tensorflow

Deep Learning with R Cookbook

Installing MXNet in R

Getting ready

How to do it...

Note