Book Image

Neural Networks with Keras Cookbook

By : V Kishore Ayyadevara

Book Image

Neural Networks with Keras Cookbook

By: V Kishore Ayyadevara

Overview of this book

This book will take you from the basics of neural networks to advanced implementations of architectures using a recipe-based approach. We will learn about how neural networks work and the impact of various hyper parameters on a network's accuracy along with leveraging neural networks for structured and unstructured data. Later, we will learn how to classify and detect objects in images. We will also learn to use transfer learning for multiple applications, including a self-driving car using Convolutional Neural Networks. We will generate images while leveraging GANs and also by performing image encoding. Additionally, we will perform text analysis using word vector based techniques. Later, we will use Recurrent Neural Networks and LSTM to implement chatbot and Machine Translation systems. Finally, you will learn about transcribing images, audio, and generating captions and also use Deep Q-learning to build an agent that plays Space Invaders game. By the end of this book, you will have developed the skills to choose and customize multiple neural network architectures for various deep learning problems you might encounter.

Preface

Who this book is for

What this book covers

To get the most out of this book

Free Chapter

Building a Feedforward Neural Network

Building a Feedforward Neural Network

Architecture of a simple neural network

Applications of a neural network

Feed-forward propagation from scratch in Python

Building back-propagation from scratch in Python

Building a neural network in Keras

Building a Deep Feedforward Neural Network

Building a Deep Feedforward Neural Network

Training a vanilla neural network

Scaling the input dataset

Impact on training when the majority of inputs are greater than zero

Impact of batch size on model accuracy

Building a deep neural network to improve network accuracy

Varying the learning rate to improve network accuracy

Varying the loss optimizer to improve network accuracy

Understanding the scenario of overfitting

Speeding up the training process using batch normalization

Applications of Deep Feedforward Neural Networks

Applications of Deep Feedforward Neural Networks

Predicting credit default

Assigning weights for classes

Predicting house prices

Categorizing news articles into topics

Classifying common audio

Stock price prediction

Leveraging a functional API

Defining weights for rows

Building a Deep Convolutional Neural Network

Building a Deep Convolutional Neural Network

Inaccuracy of traditional neural networks when images are translated

Building a CNN from scratch using Python

CNNs to improve accuracy in the case of image translation

Gender classification using CNNs

Data augmentation to improve network accuracy

Transfer Learning

Transfer Learning

Gender classification of the person in an image using CNNs

Gender classification of the person in image using the VGG16 architecture-based model

Visualizing the output of the intermediate layers of a neural network

Gender classification of the person in image using the VGG19 architecture-based model

Gender classification using the Inception v3 architecture-based model

Gender classification of the person in image using the ResNet 50 architecture-based model

Detecting the key points within image of a face

Detecting and Localizing Objects in Images

Detecting and Localizing Objects in Images

Creating the dataset for a bounding box

Generating region proposals within an image, using selective search

Calculating an intersection over a union between two images

Detecting objects, using region proposal-based CNN

Performing non-max suppression

Detecting a person using an anchor box-based algorithm

Image Analysis Applications in Self-Driving Cars

Image Analysis Applications in Self-Driving Cars

Traffic sign identification

Predicting the angle within which a car needs to be turned

Instance segmentation using the U-net architecture

Semantic segmentation of objects in an image

Image Generation

Image Generation

Generating images that can fool a neural network using adversarial attack

DeepDream algorithm to generate images

Neural style transfer between images

Generating images of digits using Generative Adversarial Networks

Generating images using a Deep Convolutional GAN

Face generation using a Deep Convolutional GAN

Face transition from one to another

Performing vector arithmetic on generated images

Encoding Inputs

Encoding Inputs

Need for encoding

Encoding an image

Encoding for recommender systems

Text Analysis Using Word Vectors

Text Analysis Using Word Vectors

Building a word vector from scratch in Python

Building a word vector using the skip-gram and CBOW models

Performing vector arithmetic using pre-trained word vectors

Creating a document vector

Building word vectors using fastText

Building word vectors using GloVe

Building sentiment classification using word vectors

Building a Recurrent Neural Network

Building a Recurrent Neural Network

Building an RNN from scratch in Python

Implementing RNN for sentiment classification

Building a LSTM Network from scratch in Python

Implementing LSTM for sentiment classification

Implementing stacked LSTM for sentiment classification

Applications of a Many-to-One Architecture RNN

Applications of a Many-to-One Architecture RNN

Generating text

Movie recommendations

Topic-modeling, using embeddings

Forecasting the value of a stock's price

Sequence-to-Sequence Learning

Sequence-to-Sequence Learning

Returning sequences of outputs from a network

Building a chatbot

Machine translation

Encoder decoder architecture for machine translation

Encoder decoder architecture with attention for machine translation

End-to-End Learning

End-to-End Learning

Connectionist temporal classification (CTC)

Handwritten-text recognition

Image caption generation

Generating captions, using beam search

Audio Analysis

Classifying a song by genre

Generating music using deep learning

Transcribing audio into text

Reinforcement Learning

Reinforcement Learning

The optimal action to take in a simulated game with a non-negative reward

The optimal action to take in a state in a simulated game

Q-learning to maximize rewards when playing Frozen Lake

Deep Q-learning to balance a cart pole

Deep Q-learning to play Space Invaders game

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

5 star

0

4 star

0

3 star

0

2 star

0

1 star

0

Applications of a neural network

Recently, we have seen a huge adoption of neural networks in a variety of applications. In this section, let's try to understand the reason why adoption might have increased considerably. Neural networks can be architected in multiple ways. Here are some of the possible ways:

The box at the bottom is the input, followed by the hidden layer (the middle box), and the box at the top is the output layer. The one-to-one architecture is a typical neural network with a hidden layer between the input and output layer. Examples of different architectures are as follows:

Architecture	Example
One-to-many	The input is an image and the output is a caption for the image
Many-to-one	The input is a movie review (multiple words) and the output is the sentiment associated with the review
Many-to-many	Machine translation of a sentence in one language to a sentence in another language

Apart from the preceding points, neural networks are also in a position to understand the content in an image and detect the position where the content is located using an architecture named Convolutional Neural Network (CNN), which looks as follows:

Here, we saw examples of recommender systems, image analysis, text analysis, and audio analysis, and we can see that neural networks give us the flexibility to solve a problem using multiple architectures, resulting in increased adoption as the number of applications increases.