Book Image

Advanced Deep Learning with TensorFlow 2 and Keras - Second Edition

By : Rowel Atienza
Book Image

Advanced Deep Learning with TensorFlow 2 and Keras - Second Edition

By: Rowel Atienza

Overview of this book

Advanced Deep Learning with TensorFlow 2 and Keras, Second Edition is a completely updated edition of the bestselling guide to the advanced deep learning techniques available today. Revised for TensorFlow 2.x, this edition introduces you to the practical side of deep learning with new chapters on unsupervised learning using mutual information, object detection (SSD), and semantic segmentation (FCN and PSPNet), further allowing you to create your own cutting-edge AI projects. Using Keras as an open-source deep learning library, the book features hands-on projects that show you how to create more effective AI with the most up-to-date techniques. Starting with an overview of multi-layer perceptrons (MLPs), convolutional neural networks (CNNs), and recurrent neural networks (RNNs), the book then introduces more cutting-edge techniques as you explore deep neural network architectures, including ResNet and DenseNet, and how to create autoencoders. You will then learn about GANs, and how they can unlock new levels of AI performance. Next, you’ll discover how a variational autoencoder (VAE) is implemented, and how GANs and VAEs have the generative power to synthesize data that can be extremely convincing to humans. You'll also learn to implement DRL such as Deep Q-Learning and Policy Gradient Methods, which are critical to many modern results in AI.

Related Content you might be interested in

Current Title:

Small book image
Advanced Deep Learning with TensorFlow 2 and Keras - Second Edition
Rowel Atienza
Feb, 2020 | 512 pages
Small book image
Hands-On Image Generation with TensorFlow
Soon Yau Cheong
Dec, 2020 | 306 pages
Small book image
Hands-On Generative Adversarial Networks with Keras
Rafael Valle
May, 2019 | 272 pages
Small book image
Advanced Deep Learning with Python
Ivan Vasilev
Dec, 2019 | 468 pages
Table of Contents (16 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
1
Introducing Advanced Deep Learning with Keras
Introducing Advanced Deep Learning with Keras
1. Why is Keras the perfect deep learning library?
2. MLP, CNN, and RNN
3. Multilayer Perceptron (MLP)
4. Convolutional Neural Network (CNN)
5. Recurrent Neural Network (RNN)
6. Conclusion
7. References
Free Chapter
2
Deep Neural Networks
Deep Neural Networks
1. Functional API
2. Deep Residual Network (ResNet)
3. ResNet v2
4. Densely Connected Convolutional Network (DenseNet)
5. Conclusion
6. References
3
Autoencoders
Autoencoders
1. Principles of autoencoders
2. Building an autoencoder using Keras
3. Denoising autoencoders (DAEs)
4. Automatic colorization autoencoder
5. Conclusion
6. References
4
Generative Adversarial Networks (GANs)
Generative Adversarial Networks (GANs)
1. An Overview of GANs
2. Implementing DCGAN in Keras
3. Conditional GAN
4. Conclusion
5. References
5
Improved GANs
Improved GANs
1. Wasserstein GAN
2. Least-squares GAN (LSGAN)
3. Auxiliary Classifier GAN (ACGAN)
4. Conclusion
5. References
6
Disentangled Representation GANs
Disentangled Representation GANs
1. Disentangled representations
2. StackedGAN
4. Conclusion
5. References
7
Cross-Domain GANs
Cross-Domain GANs
1. Principles of CycleGAN
2. Conclusion
3. References
8
Variational Autoencoders (VAEs)
Variational Autoencoders (VAEs)
1. Principles of VAE
2. Conditional VAE (CVAE)
3. 𝛽-VAE – VAE with disentangled latent representations
4. Conclusion
5. References
9
Deep Reinforcement Learning
Deep Reinforcement Learning
1. Principles of Reinforcement Learning (RL)
2. The Q value
3. Q-learning example
4. Nondeterministic environment
5. Temporal-difference learning
6. Deep Q-Network (DQN)
7. Conclusion
8. References
10
Policy Gradient Methods
Policy Gradient Methods
1. Policy gradient theorem
2. Monte Carlo policy gradient (REINFORCE) method
3. REINFORCE with baseline method
4. Actor-Critic method
5. Advantage Actor-Critic (A2C) method
6. Policy Gradient methods using Keras
7. Performance evaluation of policy gradient methods
8. Conclusion
9. References
11
Object Detection
Object Detection
1. Object detection
2. Anchor boxes
3. Ground truth anchor boxes
4. Loss functions
5. SSD model architecture
6. SSD model architecture in Keras
7. SSD objects in Keras
8. SSD model in Keras
9. Data generator model in Keras
10. Example dataset
11. SSD model training
12. Non-Maximum Suppression (NMS) algorithm
13. SSD model validation
14. Conclusion
15. References
12
Semantic Segmentation
Semantic Segmentation
1. Segmentation
2. Semantic segmentation network
3. Semantic segmentation network in Keras
4. Example dataset
5. Semantic segmentation validation
6. Conclusion
7. References
13
Unsupervised Learning Using Mutual Information
Unsupervised Learning Using Mutual Information
1. Mutual Information
2. Mutual Information and Entropy
3. Unsupervised learning by maximizing the Mutual Information of discrete random variables
4. Encoder network for unsupervised clustering
5. Unsupervised clustering implementation in Keras
6. Validation using MNIST
7. Unsupervised learning by maximizing the Mutual Information of continuous random variables
8. Estimating the Mutual Information of a bivariate Gaussian
9. Unsupervised clustering using continuous random variables in Keras
10. Conclusion
11. References
14
Other Books You May Enjoy
Other Books You May Enjoy
15
Index
Index

Preface

In recent years, Deep Learning has made unprecedented success stories in difficult problems in vision, speech, natural language processing and understanding, and all other areas with abundance of data. The interest in this field from companies, universities, governments, and research organizations has accelerated the advances in the field. This book covers select important topics in Deep Learning with three new chapters, Object Detection, Semantic Segmentation, and Unsupervised Learning using Mutual Information. The advanced theories are explained by giving a background of the principles, digging into the intuition behind the concepts, implementing the equations and algorithms using Keras, and examining the results.

Artificial Intelligence (AI), as it stands today, is still far from being a well-understood field. Deep Learning (DL), as a sub field of AI, is in the same position. While it is far from being a mature field, many real-world applications such as vision-based detection and recognition, autonomous navigation, product recommendation, speech recognition and synthesis, energy conservation, drug discovery, finance, and marketing are already using DL algorithms. Many more applications will be discovered and built. The aim of this book is to explain advanced concepts, give sample implementations, and let the readers as experts in their field identify the target applications.

A field that is not completely mature is a double-edged sword. On one edge, it offers a lot of opportunities for discovery and exploitation. There are many unsolved problems in deep learning. This translates into opportunities to be the first to market – be that in product development, publication, or recognition. The other edge is it would be difficult to trust a not-fully-understood field in a mission-critical environment. We can safely say that if asked, very few machine learning engineers will ride an auto-pilot plane controlled by a deep learning system. There is a lot of work to be done to gain this level of trust. The advanced concepts that are discussed in this book have a high chance of playing a major role as the foundation in gaining this level of trust.

No DL book will be able to completely cover the whole field. This book is not an exception. Given time and space, we could have touched interesting areas like natural language processing and understanding, speech synthesis, automated machine learning (AutoML), graph neural networks (GNNs), Bayesian deep learning, and many others. However, this book believes in choosing and explaining select areas so that readers can take up other fields that are not covered.

As the reader who is about to embark upon reading this book, keep in mind that you chose an area that is exciting and can have a huge impact on society. We are fortunate to have a job that we look forward to working on as we wake up in the morning.

Previous Section
Next Section