Generative Models in Deep Learning | R Deep Learning Cookbook

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

R Deep Learning Cookbook

By : PKS Prakash, Sri Krishna Rao

1 (1)

R Deep Learning Cookbook

1 (1)

By: PKS Prakash, Sri Krishna Rao

Overview of this book

Deep Learning is the next big thing. It is a part of machine learning. It's favorable results in applications with huge and complex data is remarkable. Simultaneously, R programming language is very popular amongst the data miners and statisticians. This book will help you to get through the problems that you face during the execution of different tasks and Understand hacks in deep learning, neural networks, and advanced machine learning techniques. It will also take you through complex deep learning algorithms and various deep learning packages and libraries in R. It will be starting with different packages in Deep Learning to neural networks and structures. You will also encounter the applications in text mining and processing along with a comparison between CPU and GPU performance. By the end of the book, you will have a logical understanding of Deep learning and different deep learning packages to have the most appropriate solutions for your problems.

Preface

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Free Chapter

Getting Started

Getting Started

Introduction

Installing R with an IDE

Installing a Jupyter Notebook application

Starting with the basics of machine learning in R

Setting up deep learning tools/packages in R

Installing MXNet in R

Installing TensorFlow in R

Installing H2O in R

Installing all three packages at once using Docker

Deep Learning with R

Deep Learning with R

Starting with logistic regression

Introducing the dataset

Performing logistic regression using H2O

Performing logistic regression using TensorFlow

Visualizing TensorFlow graphs

Starting with multilayer perceptrons

Setting up a neural network using H2O

Tuning hyper-parameters using grid searches in H2O

Setting up a neural network using MXNet

Setting up a neural network using TensorFlow

Convolution Neural Network

Convolution Neural Network

Introduction

Downloading and configuring an image dataset

Learning the architecture of a CNN classifier

Using functions to initialize weights and biases

Using functions to create a new convolution layer

Using functions to create a new convolution layer

Using functions to flatten the densely connected layer

Defining placeholder variables

Creating the first convolution layer

Creating the second convolution layer

Flattening the second convolution layer

Creating the first fully connected layer

Applying dropout to the first fully connected layer

Creating the second fully connected layer with dropout

Applying softmax activation to obtain a predicted class

Defining the cost function used for optimization

Performing gradient descent cost optimization

Executing the graph in a TensorFlow session

Evaluating the performance on test data

Data Representation Using Autoencoders

Data Representation Using Autoencoders

Introduction

Setting up autoencoders

Data normalization

Setting up a regularized autoencoder

Fine-tuning the parameters of the autoencoder

Setting up stacked autoencoders

Setting up denoising autoencoders

Building and comparing stochastic encoders and decoders

Learning manifolds from autoencoders

Evaluating the sparse decomposition

Generative Models in Deep Learning

Generative Models in Deep Learning

Comparing principal component analysis with the Restricted Boltzmann machine

Setting up a Restricted Boltzmann machine for Bernoulli distribution input

Training a Restricted Boltzmann machine

Backward or reconstruction phase of RBM

Understanding the contrastive divergence of the reconstruction

Initializing and starting a new TensorFlow session

Evaluating the output from an RBM

Setting up a Restricted Boltzmann machine for Collaborative Filtering

Performing a full run of training an RBM

Setting up a Deep Belief Network

Implementing a feed-forward backpropagation Neural Network

Setting up a Deep Restricted Boltzmann Machine

Recurrent Neural Networks

Recurrent Neural Networks

Setting up a basic Recurrent Neural Network

Setting up a bidirectional RNN model

Setting up a deep RNN model

Setting up a Long short-term memory based sequence model

Reinforcement Learning

Reinforcement Learning

Introduction

Setting up a Markov Decision Process

Performing model-based learning

Performing model-free learning

Application of Deep Learning in Text Mining

Application of Deep Learning in Text Mining

Performing preprocessing of textual data and extraction of sentiments

Analyzing documents using tf-idf

Performing sentiment prediction using LSTM network

Application using text2vec examples

Application of Deep Learning to Signal processing

Application of Deep Learning to Signal processing

Introducing and preprocessing music MIDI files

Building an RBM model

Generating new music notes

Transfer Learning

Transfer Learning

Introduction

Illustrating the use of a pretrained model

Setting up the Transfer Learning model

Building an image classification model

Training a deep learning model on a GPU

Comparing performance using CPU and GPU

Backward or reconstruction phase of RBM

In the reconstruction phase, the data from the hidden layer is passed back to the visible layer. The hidden layer vector of probabilities h0 is multiplied by the transpose of the weight matrix W and added to a visible layer bias vb, which is then passed through a sigmoid function to generate a reconstructed input vector prob_v1.

A sample input vector is created using the reconstructed input vector, which is then multiplied by the weight matrix W and added to the hidden bias vector hb to generate an updated hidden vector of probabilities h1.

This is also called Gibbs sampling. In some scenarios, the sample input vector is not generated and the reconstructed input vector prob_v1 is directly used to update the hi

Getting ready

This section provides the requirements for image reconstruction using the input probability vector.

mnist data is loaded in the environment
The RBM model is trained using the recipe Training a Restricted Boltzmann machine

How to do it...

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

R Deep Learning Cookbook

Search

Your notes and bookmarks