Book Image

Keras Deep Learning Cookbook

By : Rajdeep Dua, Sujit Pal, Manpreet Singh Ghotra
Book Image

Keras Deep Learning Cookbook

By: Rajdeep Dua, Sujit Pal, Manpreet Singh Ghotra

Overview of this book

Keras has quickly emerged as a popular deep learning library. Written in Python, it allows you to train convolutional as well as recurrent neural networks with speed and accuracy. The Keras Deep Learning Cookbook shows you how to tackle different problems encountered while training efficient deep learning models, with the help of the popular Keras library. Starting with installing and setting up Keras, the book demonstrates how you can perform deep learning with Keras in the TensorFlow. From loading data to fitting and evaluating your model for optimal performance, you will work through a step-by-step process to tackle every possible problem faced while training deep models. You will implement convolutional and recurrent neural networks, adversarial networks, and more with the help of this handy guide. In addition to this, you will learn how to train these models for real-world image and language processing tasks. By the end of this book, you will have a practical, hands-on understanding of how you can leverage the power of Python and Keras to perform effective deep learning

Related Content you might be interested in

Current Title:

Small book image
Keras Deep Learning Cookbook
Rajdeep Dua | Sujit Pal | Manpreet Singh Ghotra
Oct, 2018 | 252 pages
Small book image
Deep Learning with Keras
Sujit Pal | Antonio Gulli
Apr, 2017 | 318 pages
Small book image
Deep Learning Quick Reference
Michael Bernico
Mar, 2018 | 272 pages
Small book image
Generative Adversarial Networks Cookbook
Josh Kalin
Dec, 2018 | 268 pages
Table of Contents (17 chapters)
Title Page
Title Page
Copyright and Credits
Copyright and Credits
Packt Upsell
Packt Upsell
Contributors
Contributors
Preface
Preface
Free Chapter
1
Keras Installation
Keras Installation
Introduction
Installing Keras on Ubuntu 16.04
Installing Keras with Jupyter Notebook in a Docker image
Installing Keras on Ubuntu 16.04 with GPU enabled
2
Working with Keras Datasets and Models
Working with Keras Datasets and Models
Introduction
CIFAR-10 dataset
CIFAR-100 dataset
MNIST dataset
Load data from a CSV file
Models in Keras – getting started
Sequential models
Shared layer models
Keras functional APIs
Keras functional APIs – linking the layers
Image classification using Keras functional APIs
3
Data Preprocessing, Optimization, and Visualization
Data Preprocessing, Optimization, and Visualization
Feature standardization of image data
Sequence padding
Model visualization
Optimization 
Common code for samples
Optimization with stochastic gradient descent
Optimization with Adam
Optimization with AdaDelta
Optimization with RMSProp
4
Classification Using Different Keras Layers
Classification Using Different Keras Layers
Introduction
Classification for breast cancer
Classification for spam detection
5
Implementing Convolutional Neural Networks
Implementing Convolutional Neural Networks
Introduction
Cervical cancer classification
Digit recognition
6
Generative Adversarial Networks
Generative Adversarial Networks
Introduction
Basic GAN
Boundary seeking GAN
DCGAN
7
Recurrent Neural Networks
Recurrent Neural Networks
Introduction
Simple RNNs for time series data
LSTM networks for time series data
Time series forecasting with LSTM
Sequence to sequence learning for the same length output with LSTM
8
Natural Language Processing Using Keras Models
Natural Language Processing Using Keras Models
Introduction
Word embedding
Sentiment analysis
9
Text Summarization Using Keras Models
Text Summarization Using Keras Models
Introduction
Text summarization for reviews
10
Reinforcement Learning
Reinforcement Learning
Introduction
The CartPole game with Keras
Dueling DQN to play Cartpole 
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think
Index
Index

Optimization with RMSProp

In this recipe, we look at the code sample on how to optimize with RMSProp.

RMSprop is an (unpublished) adaptive learning rate method proposed by Geoff Hinton. RMSprop and AdaDelta were both developed independently around the same time, stemming from the need to resolve AdaGrad's radically diminishing learning rates. RMSprop is identical to the first update vector of AdaDelta that we derived earlier:

RMSprop divides the learning rate by an exponentially decaying average of squared gradients. It is suggested that γ to be set to 0.9, while a good default value for the learning rate is η is 0.001.

Getting ready

Import the relevant classes, methods, and so on, as specified in the preceding common code section.

How to do it...

Create a sequential model with the appropriate share:

from keras.optimizers import RMSprop
model = Sequential()
model.add(Dense(512, activation='relu', input_shape=(784,)))
model.add(Dropout(0.2))
model.add(Dense(512, activation='relu'))
model.add(Dropout...
Previous Section
End of Chapter 3
Next Chapter