Book Image

Python Deep Learning - Second Edition

By : Ivan Vasilev, Daniel Slater, Gianmario Spacagna, Peter Roelants, Valentino Zocca
Book Image

Python Deep Learning - Second Edition

By: Ivan Vasilev, Daniel Slater, Gianmario Spacagna, Peter Roelants, Valentino Zocca

Overview of this book

With the surge in artificial intelligence in applications catering to both business and consumer needs, deep learning is more important than ever for meeting current and future market demands. With this book, you’ll explore deep learning, and learn how to put machine learning to use in your projects. This second edition of Python Deep Learning will get you up to speed with deep learning, deep neural networks, and how to train them with high-performance algorithms and popular Python frameworks. You’ll uncover different neural network architectures, such as convolutional networks, recurrent neural networks, long short-term memory (LSTM) networks, and capsule networks. You’ll also learn how to solve problems in the fields of computer vision, natural language processing (NLP), and speech recognition. You'll study generative model approaches such as variational autoencoders and Generative Adversarial Networks (GANs) to generate images. As you delve into newly evolved areas of reinforcement learning, you’ll gain an understanding of state-of-the-art algorithms that are the main components behind popular games Go, Atari, and Dota. By the end of the book, you will be well-versed with the theory of deep learning along with its real-world applications.

Related Content you might be interested in

Current Title:

Small book image
Python Deep Learning - Second Edition
Ivan Vasilev | Daniel Slater | Gianmario Spacagna | Peter Roelants | Valentino Zocca
Jan, 2019 | 386 pages
No titles found
Table of Contents (12 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Machine Learning - an Introduction
Machine Learning - an Introduction
Introduction to machine learning
Different machine learning approaches
Neural networks
Summary
2
Neural Networks
Neural Networks
The need for neural networks
An introduction to neural networks
Training neural networks
Summary
3
Deep Learning Fundamentals
Deep Learning Fundamentals
Introduction to deep learning
Fundamental deep learning concepts
Deep learning algorithms
Applications of deep learning
The reasons for deep learning's popularity
Introducing popular open source libraries
Summary
4
Computer Vision with Convolutional Networks
Computer Vision with Convolutional Networks
Intuition and justification for CNN
Convolutional layers
Stride and padding in convolutional layers
Pooling layers
The structure of a convolutional network
Improving the performance of CNNs
A CNN example with Keras and CIFAR-10
Summary
5
Advanced Computer Vision
Advanced Computer Vision
Transfer learning
Advanced network architectures
Capsule networks
Advanced computer vision tasks
Artistic style transfer
Summary
6
Generating Images with GANs and VAEs
Generating Images with GANs and VAEs
Intuition and justification of generative models
Variational autoencoders
Generative Adversarial networks
Summary
7
Recurrent Neural Networks and Language Models
Recurrent Neural Networks and Language Models
Recurrent neural networks
Language modeling
Sequence to sequence learning
Speech recognition
Summary
8
Reinforcement Learning Theory
Reinforcement Learning Theory
RL paradigms
RL as a Markov decision process
Finding optimal policies with Dynamic Programming
Monte Carlo methods
Temporal difference methods
Value function approximations
Experience replay
Q-learning in action
Summary
9
Deep Reinforcement Learning for Games
Deep Reinforcement Learning for Games
Introduction to genetic algorithms playing games
Deep Q-learning
Policy gradient methods
Model-based methods
Summary
10
Deep Learning in Autonomous Vehicles
Deep Learning in Autonomous Vehicles
Brief history of AV research
AV introduction
Imitiation driving policy
Driving policy with ChauffeurNet
DL in the Cloud
Summary
11
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Imitiation driving policy

In the section Components of an AV system we outlined several modules, necessary for a self-driving system. In this section we'll discuss how to implement one of them - the driving policy - with the help of DL. One way to do this is with RL, where the car is the agent and the environment is, well, the environment. Another popular approach is imitation learning, where the model (network) learns to imitate the actions of an expert (human). Let's see the properties of imitation learning in the AV scenario:

  • We'll use a type of imitation learning, known as behavioral cloning. This simply means that we'll train our network in a supervised way. Alternatively, we have imitation learning in RL scenario, which is known as Inverse RL.
  • The output of the network is the driving policy, represented by desired steering angle and/or acceleration...
Previous Section
End of Section 4
Next Section