Book Image

Hands-On Deep Learning Algorithms with Python

By : Sudharsan Ravichandiran
Book Image

Hands-On Deep Learning Algorithms with Python

By: Sudharsan Ravichandiran

Overview of this book

Deep learning is one of the most popular domains in the AI space that allows you to develop multi-layered models of varying complexities. This book introduces you to popular deep learning algorithms—from basic to advanced—and shows you how to implement them from scratch using TensorFlow. Throughout the book, you will gain insights into each algorithm, the mathematical principles involved, and how to implement it in the best possible manner. The book starts by explaining how you can build your own neural networks, followed by introducing you to TensorFlow, the powerful Python-based library for machine learning and deep learning. Moving on, you will get up to speed with gradient descent variants, such as NAG, AMSGrad, AdaDelta, Adam, and Nadam. The book will then provide you with insights into recurrent neural networks (RNNs) and LSTM and how to generate song lyrics with RNN. Next, you will master the math necessary to work with convolutional and capsule networks, widely used for image recognition tasks. You will also learn how machines understand the semantics of words and documents using CBOW, skip-gram, and PV-DM. Finally, you will explore GANs, including InfoGAN and LSGAN, and autoencoders, such as contractive autoencoders and VAE. By the end of this book, you will be equipped with all the skills you need to implement deep learning in your own projects.

Related Content you might be interested in

Current Title:

Small book image
Hands-On Deep Learning Algorithms with Python
Sudharsan Ravichandiran
Jul, 2019 | 512 pages
Small book image
Deep Reinforcement Learning with Python
Sudharsan Ravichandiran
Sep, 2020 | 760 pages
Small book image
Hands-On Meta Learning with Python
Sudharsan Ravichandiran
Dec, 2018 | 226 pages
Small book image
Hands-On Reinforcement Learning with Python
Sudharsan Ravichandiran
Jun, 2018 | 318 pages
Table of Contents (17 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Section 1: Getting Started with Deep Learning
Section 1: Getting Started with Deep Learning
2
Introduction to Deep Learning
Introduction to Deep Learning
What is deep learning?
Biological and artificial neurons
ANN and its layers
Exploring activation functions
Forward propagation in ANN
How does ANN learn?
Debugging gradient descent with gradient checking
Putting it all together
Summary
Questions
Further reading
3
Getting to Know TensorFlow
Getting to Know TensorFlow
What is TensorFlow?
Understanding computational graphs and sessions
Variables, constants, and placeholders
Introducing TensorBoard
Handwritten digit classification using TensorFlow
Introducing eager execution
Math operations in TensorFlow
TensorFlow 2.0 and Keras
Should we use Keras or TensorFlow?
Summary
Questions
Further reading
4
Section 2: Fundamental Deep Learning Algorithms
Section 2: Fundamental Deep Learning Algorithms
5
Gradient Descent and Its Variants
Gradient Descent and Its Variants
Demystifying gradient descent
Gradient descent versus stochastic gradient descent
Momentum-based gradient descent
Adaptive methods of gradient descent
Summary
Questions
Further reading
6
Generating Song Lyrics Using RNN
Generating Song Lyrics Using RNN
Introducing RNNs
Generating song lyrics using RNNs
Different types of RNN architectures
Summary
Questions
Further reading
7
Improvements to the RNN
Improvements to the RNN
LSTM to the rescue
Gated recurrent units
Bidirectional RNN
Going deep with deep RNN
Language translation using the seq2seq model
Summary
Questions
Further reading
8
Demystifying Convolutional Networks
Demystifying Convolutional Networks
What are CNNs?
The architecture of CNNs
The math behind CNNs
Implementing a CNN in TensorFlow
CNN architectures
Capsule networks
Building Capsule networks in TensorFlow
Summary
Questions
Further reading
9
Learning Text Representations
Learning Text Representations
Understanding the word2vec model
Building the word2vec model using gensim
Visualizing word embeddings in TensorBoard
Doc2vec
Understanding skip-thoughts algorithm
Quick-thoughts for sentence embeddings
Summary
Questions
Further reading
10
Section 3: Advanced Deep Learning Algorithms
Section 3: Advanced Deep Learning Algorithms
11
Generating Images Using GANs
Generating Images Using GANs
Differences between discriminative and generative models
Say hello to GANs!
DCGAN – Adding convolution to a GAN
Least squares GAN
GANs with Wasserstein distance
Summary
Questions
Further reading
12
Learning More about GANs
Learning More about GANs
Conditional GANs
Understanding InfoGAN
Translating images using a CycleGAN
StackGAN
Summary
Questions
Further reading
13
Reconstructing Inputs Using Autoencoders
Reconstructing Inputs Using Autoencoders
What is an autoencoder?
Autoencoders with convolutions
Exploring denoising autoencoders
Understanding sparse autoencoders
Learning to use contractive autoencoders
Dissecting variational autoencoders
Summary
Questions
Further reading
14
Exploring Few-Shot Learning Algorithms
Exploring Few-Shot Learning Algorithms
What is few-shot learning?
Siamese networks
Architecture of siamese networks
Prototypical networks
Relation networks
Matching networks
Summary
Questions
Further reading
15
Assessments
Assessments
Chapter 1 - Introduction to Deep Learning
Chapter 2 - Getting to Know TensorFlow
Chapter 3 - Gradient Descent and Its Variants
Chapter 4 - Generating Song Lyrics Using an RNN
Chapter 5 - Improvements to the RNN
Chapter 6 - Demystifying Convolutional Networks
Chapter 7 - Learning Text Representations
Chapter 8 - Generating Images Using GANs
Chapter 9 - Learning More about GANs
Chapter 10 - Reconstructing Inputs Using Autoencoders
Chapter 11 - Exploring Few-Shot Learning Algorithms
16
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

To get the most out of this book

Those who are completely new to deep learning, but who have some experience in machine learning and Python programming, will find this book helpful.

Download the example code files

You can download the example code files for this book from your account at www.packt.com. If you purchased this book elsewhere, you can visit www.packt.com/support and register to have the files emailed directly to you.

You can download the code files by following these steps:

  1. Log in or register at www.packt.com.
  2. Select the SUPPORT tab.
  3. Click on Code Downloads & Errata.
  4. Enter the name of the book in the Search box and follow the onscreen instructions.

Once the file is downloaded, please make sure that you unzip or extract the folder using the latest version of:

  • WinRAR/7-Zip for Windows
  • Zipeg/iZip/UnRarX for Mac
  • 7-Zip/PeaZip for Linux

The code bundle for the book is also hosted on GitHub at https://github.com/PacktPublishing/Hands-On-Deep-Learning-Algorithms-with-Python. In case there's an update to the code, it will be updated on the existing GitHub repository.

We also have other code bundles from our rich catalog of books and videos available at https://github.com/PacktPublishing/. Check them out!

Download the color images

Conventions used

There are a number of text conventions used throughout this book.

CodeInText: Indicates code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles. Here is an example: "Compute J_plus and J_minus."

A block of code is set as follows:

J_plus = forward_prop(x, weights_plus) 
J_minus = forward_prop(x, weights_minus)

Any command-line input or output is written as follows:

tensorboard --logdir=graphs --port=8000

Bold: Indicates a new term, an important word, or words that you see on screen. For example, words in menus or dialog boxes appear in the text like this. Here is an example: "Any layer between the input layer and the output layer is called a hidden layer."

Warnings or important notes appear like this.
Tips and tricks appear like this.

Previous Section
Next Section