Book Image

Hands-On Generative Adversarial Networks with Keras

By : Rafael Valle
Book Image

Hands-On Generative Adversarial Networks with Keras

By: Rafael Valle

Overview of this book

Generative Adversarial Networks (GANs) have revolutionized the fields of machine learning and deep learning. This book will be your first step toward understanding GAN architectures and tackling the challenges involved in training them. This book opens with an introduction to deep learning and generative models and their applications in artificial intelligence (AI). You will then learn how to build, evaluate, and improve your first GAN with the help of easy-to-follow examples. The next few chapters will guide you through training a GAN model to produce and improve high-resolution images. You will also learn how to implement conditional GANs that enable you to control characteristics of GAN output. You will build on your knowledge further by exploring a new training methodology for progressive growing of GANs. Moving on, you'll gain insights into state-of-the-art models in image synthesis, speech enhancement, and natural language generation using GANs. In addition to this, you'll be able to identify GAN samples with TequilaGAN. By the end of this book, you will be well-versed with the latest advancements in the GAN framework using various examples and datasets, and you will have developed the skills you need to implement GAN architectures for several tasks and domains, including computer vision, natural language processing (NLP), and audio processing. Foreword by Ting-Chun Wang, Senior Research Scientist, NVIDIA

Related Content you might be interested in

Current Title:

Small book image
Hands-On Generative Adversarial Networks with Keras
Rafael Valle
May, 2019 | 272 pages
Small book image
Hands-On Image Generation with TensorFlow
Soon Yau Cheong
Dec, 2020 | 306 pages
Small book image
Hands-On Generative Adversarial Networks with PyTorch 1.x
Greg Walters | John Hany
Dec, 2019 | 312 pages
Small book image
Generative Adversarial Networks Projects
Kailash Ahirwar
Jan, 2019 | 316 pages
Table of Contents (14 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Section 1: Introduction and Environment Setup
Section 1: Introduction and Environment Setup
2
Deep Learning Basics and Environment Setup
Deep Learning Basics and Environment Setup
Deep learning basics
Deep learning environment setup
The deep learning environment test
Summary
3
Introduction to Generative Models
Introduction to Generative Models
Discriminative and generative models compared
Generative models
GANs – building blocks
GANs – strengths and weaknesses
Summary
4
Section 2: Training GANs
Section 2: Training GANs
5
Implementing Your First GAN
Implementing Your First GAN
Technical requirements
Imports
Implementing a Generator and Discriminator
Auxiliary functions
Training your GAN
Summary
Further reading
6
Evaluating Your First GAN
Evaluating Your First GAN
The evaluation of GANs
Qualitative methods
Quantitative methods
GANs and the birthday paradox
Summary
7
Improving Your First GAN
Improving Your First GAN
Technical requirements
Challenges in training GANs
Tricks of the trade
GAN model architectures
GAN algorithms and loss functions
Summary
8
Section 3: Application of GANs in Computer Vision, Natural Language Processing, and Audio
Section 3: Application of GANs in Computer Vision, Natural Language Processing, and Audio
9
Progressive Growing of GANs
Progressive Growing of GANs
Technical requirements
Progressive Growing of GANs
Experimental setup
Model implementation
Summary
10
Generation of Discrete Sequences Using GANs
Generation of Discrete Sequences Using GANs
Technical requirements
Natural language generation with GANs
Experimental setup
Model implementation
Inference
Summary
11
Text-to-Image Synthesis with GANs
Text-to-Image Synthesis with GANs
Technical Requirements
Text-to-image synthesis
Experimental setup
Model implementation
Improving the baseline model
Inference
Summary
12
TequilaGAN - Identifying GAN Samples
TequilaGAN - Identifying GAN Samples
Technical requirements
Identifying GAN samples
Feature extraction
Metrics
Experiments
Summary
References
13
Whats next in GANs
Whats next in GANs
What we've GANed so far
Unanswered questions in GANs
Artistic GANs
Recent and yet-to-be-explored GAN topics
Summary
Closing remarks
Further reading

Text-to-image synthesis

Text-to-image synthesis consists of synthesizing an image that satisfies specifications described in a text sentence. Text-to-image synthesis can be interpreted as a translation problem where the domain of the source and the target are not the same.

In this approach, the problem of text-to-image synthesis is tackled by solving two sub-problems. The first relates to learning a representation of text that encodes the visual specifications described with the text, and the second learning a model that is capable of using the text representation learned to synthesize images that satisfy the specifications described in the text.

For example, consider this text description: the petals on this flower are white with a yellow center.

Although broad and not defining many aspects of the target flower, this description provides a few hard specifications about the flower...

Previous Section
End of Section 3
Next Section