Book Image

Deep Learning with Keras

By : Antonio Gulli, Sujit Pal
Book Image

Deep Learning with Keras

By: Antonio Gulli, Sujit Pal

Overview of this book

This book starts by introducing you to supervised learning algorithms such as simple linear regression, the classical multilayer perceptron and more sophisticated deep convolutional networks. You will also explore image processing with recognition of handwritten digit images, classification of images into different categories, and advanced objects recognition with related image annotations. An example of identification of salient points for face detection is also provided. Next you will be introduced to Recurrent Networks, which are optimized for processing sequence data such as text, audio or time series. Following that, you will learn about unsupervised learning algorithms such as Autoencoders and the very popular Generative Adversarial Networks (GANs). You will also explore non-traditional uses of neural networks as Style Transfer. Finally, you will look at reinforcement learning and its application to AI game playing, another popular direction of research and application of neural networks.

Related Content you might be interested in

Current Title:

Small book image
Deep Learning with Keras
Antonio Gulli | Sujit Pal
Apr, 2017 | 318 pages
Small book image
Deep Learning with TensorFlow 2 and Keras
Sujit Pal | Amita Kapoor | Antonio Gulli
Dec, 2019 | 646 pages
Small book image
Deep Learning with TensorFlow and Keras
Sujit Pal | Amita Kapoor | Antonio Gulli
Oct, 2022 | 698 pages
Small book image
TensorFlow 1.x Deep Learning Cookbook
Amita Kapoor | Antonio Gulli
Dec, 2017 | 536 pages
Table of Contents (16 chapters)
Title Page
Title Page
Credits
Credits
About the Authors
About the Authors
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Customer Feedback
Customer Feedback
Preface
Preface
Free Chapter
1
Neural Networks Foundations
Neural Networks Foundations
Perceptron
Multilayer perceptron — the first example of a network
A real example — recognizing handwritten digits
A practical overview of backpropagation
Towards a deep learning approach
Summary
2
Keras Installation and API
Keras Installation and API
Installing Keras
Configuring Keras
Installing Keras on Docker
Installing Keras on Google Cloud ML
Installing Keras on Amazon AWS
Installing Keras on Microsoft Azure
Keras API
Callbacks for customizing the training process
Summary
3
Deep Learning with ConvNets
Deep Learning with ConvNets
Deep convolutional neural network — DCNN
An example of DCNN — LeNet
Recognizing CIFAR-10 images with deep learning
Very deep convolutional networks for large-scale image recognition
Summary
4
Generative Adversarial Networks and WaveNet
Generative Adversarial Networks and WaveNet
What is a GAN?
Deep convolutional generative adversarial networks
Keras adversarial GANs for forging MNIST
Keras adversarial GANs for forging CIFAR
WaveNet — a generative model for learning how to produce audio
Summary
5
Word Embeddings
Word Embeddings
Distributed representations
word2vec
Exploring GloVe
Using pre-trained embeddings
Summary
6
Recurrent Neural Network — RNN
Recurrent Neural Network — RNN
SimpleRNN cells
RNN topologies
Vanishing and exploding gradients
Long short term memory — LSTM
Gated recurrent unit — GRU
Bidirectional RNNs
Stateful RNNs
Other RNN variants
Summary
7
Additional Deep Learning Models
Additional Deep Learning Models
Keras functional API
Regression networks
Unsupervised learning — autoencoders
Composing deep networks
Customizing Keras
Generative models
Summary
8
AI Game Playing
AI Game Playing
Reinforcement learning
Example - Keras deep Q-network for catch
The road ahead
Summary
9
Conclusion
Conclusion
Keras 2.0 — what is new

Recognizing CIFAR-10 images with deep learning

The CIFAR-10 dataset contains 60,000 color images of 32 x 32 pixels in 3 channels divided into 10 classes. Each class contains 6,000 images. The training set contains 50,000 images, while the test sets provides 10,000 images. This image taken from the CIFAR repository (https://www.cs.toronto.edu/~kriz/cifar.html) describes a few random examples from the 10 classes:

The goal is to recognize previously unseen images and assign them to one of the 10 classes. Let us define a suitable deep net.

First of all we import a number of useful modules, define a few constants, and load the dataset:

from keras.datasets import cifar10
from keras.utils import np_utils
from keras.models import Sequential
from keras.layers.core import Dense, Dropout, Activation, Flatten
from keras.layers.convolutional import Conv2D, MaxPooling2D
from keras.optimizers import SGD, Adam, RMSprop
import matplotlib.pyplot as plt

# CIFAR_10 is a set of 60K images 32x32 pixels on 3 channels...
Previous Section
End of Section 4
Next Section