Book Image

Hands-On Generative Adversarial Networks with Keras

By : Rafael Valle
Book Image

Hands-On Generative Adversarial Networks with Keras

By: Rafael Valle

Overview of this book

Generative Adversarial Networks (GANs) have revolutionized the fields of machine learning and deep learning. This book will be your first step toward understanding GAN architectures and tackling the challenges involved in training them. This book opens with an introduction to deep learning and generative models and their applications in artificial intelligence (AI). You will then learn how to build, evaluate, and improve your first GAN with the help of easy-to-follow examples. The next few chapters will guide you through training a GAN model to produce and improve high-resolution images. You will also learn how to implement conditional GANs that enable you to control characteristics of GAN output. You will build on your knowledge further by exploring a new training methodology for progressive growing of GANs. Moving on, you'll gain insights into state-of-the-art models in image synthesis, speech enhancement, and natural language generation using GANs. In addition to this, you'll be able to identify GAN samples with TequilaGAN. By the end of this book, you will be well-versed with the latest advancements in the GAN framework using various examples and datasets, and you will have developed the skills you need to implement GAN architectures for several tasks and domains, including computer vision, natural language processing (NLP), and audio processing. Foreword by Ting-Chun Wang, Senior Research Scientist, NVIDIA

Related Content you might be interested in

Current Title:

Small book image
Hands-On Generative Adversarial Networks with Keras
Rafael Valle
May, 2019 | 272 pages
Small book image
Hands-On Image Generation with TensorFlow
Soon Yau Cheong
Dec, 2020 | 306 pages
Small book image
Hands-On Generative Adversarial Networks with PyTorch 1.x
Greg Walters | John Hany
Dec, 2019 | 312 pages
Small book image
Generative Adversarial Networks Projects
Kailash Ahirwar
Jan, 2019 | 316 pages
Table of Contents (14 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Section 1: Introduction and Environment Setup
Section 1: Introduction and Environment Setup
2
Deep Learning Basics and Environment Setup
Deep Learning Basics and Environment Setup
Deep learning basics
Deep learning environment setup
The deep learning environment test
Summary
3
Introduction to Generative Models
Introduction to Generative Models
Discriminative and generative models compared
Generative models
GANs – building blocks
GANs – strengths and weaknesses
Summary
4
Section 2: Training GANs
Section 2: Training GANs
5
Implementing Your First GAN
Implementing Your First GAN
Technical requirements
Imports
Implementing a Generator and Discriminator
Auxiliary functions
Training your GAN
Summary
Further reading
6
Evaluating Your First GAN
Evaluating Your First GAN
The evaluation of GANs
Qualitative methods
Quantitative methods
GANs and the birthday paradox
Summary
7
Improving Your First GAN
Improving Your First GAN
Technical requirements
Challenges in training GANs
Tricks of the trade
GAN model architectures
GAN algorithms and loss functions
Summary
8
Section 3: Application of GANs in Computer Vision, Natural Language Processing, and Audio
Section 3: Application of GANs in Computer Vision, Natural Language Processing, and Audio
9
Progressive Growing of GANs
Progressive Growing of GANs
Technical requirements
Progressive Growing of GANs
Experimental setup
Model implementation
Summary
10
Generation of Discrete Sequences Using GANs
Generation of Discrete Sequences Using GANs
Technical requirements
Natural language generation with GANs
Experimental setup
Model implementation
Inference
Summary
11
Text-to-Image Synthesis with GANs
Text-to-Image Synthesis with GANs
Technical Requirements
Text-to-image synthesis
Experimental setup
Model implementation
Improving the baseline model
Inference
Summary
12
TequilaGAN - Identifying GAN Samples
TequilaGAN - Identifying GAN Samples
Technical requirements
Identifying GAN samples
Feature extraction
Metrics
Experiments
Summary
References
13
Whats next in GANs
Whats next in GANs
What we've GANed so far
Unanswered questions in GANs
Artistic GANs
Recent and yet-to-be-explored GAN topics
Summary
Closing remarks
Further reading

GANs and the birthday paradox

One of the biggest challenges in evaluating GANs samples is to understand how much of the real distribution the generator has learned. For example, let's consider the size of the support for the set of all the possible images of dogs. Naturally, this set must include millions of dog images that portray combinations of all dog features, including size, breed, hair color, pose, and more.

Assuming there are millions of dogs in real life that we humans perceive as unique, a GAN that has truly learned the distribution of dogs must be able to produce a similar number of unique dog images. Estimating the number of unique images of dogs a GAN is able to produce might seem like a daunting task at first, but researchers have found a brilliant crude estimate of this by using the birthday paradox.

The birthday paradox is commonly addressed in undergraduate...

Previous Section
End of Section 5
Next Section