Book Image

Hands-On Generative Adversarial Networks with PyTorch 1.x

By : John Hany, Greg Walters
Book Image

Hands-On Generative Adversarial Networks with PyTorch 1.x

By: John Hany, Greg Walters

Overview of this book

With continuously evolving research and development, Generative Adversarial Networks (GANs) are the next big thing in the field of deep learning. This book highlights the key improvements in GANs over generative models and guides in making the best out of GANs with the help of hands-on examples. This book starts by taking you through the core concepts necessary to understand how each component of a GAN model works. You'll build your first GAN model to understand how generator and discriminator networks function. As you advance, you'll delve into a range of examples and datasets to build a variety of GAN networks using PyTorch functionalities and services, and become well-versed with architectures, training strategies, and evaluation methods for image generation, translation, and restoration. You'll even learn how to apply GAN models to solve problems in areas such as computer vision, multimedia, 3D models, and natural language processing (NLP). The book covers how to overcome the challenges faced while building generative models from scratch. Finally, you'll also discover how to train your GAN models to generate adversarial examples to attack other CNN and GAN models. By the end of this book, you will have learned how to build, train, and optimize next-generation GAN models and use them to solve a variety of real-world problems.
Table of Contents (15 chapters)
Free Chapter
1
Section 1: Introduction to GANs and PyTorch
5
Section 2: Typical GAN Models for Image Synthesis

Text generation via SeqGAN – teaching GANs how to tell jokes

In the previous chapter, we learned how to generate high-quality images based on description text with GANs. Now, we will move on and look at sequential data synthesis, such as text and audio, using various GAN models.

When it comes to the generation of text, the biggest difference in terms of image generation is that text data is discrete while image pixel values are more continuous, though digital images and text are both essentially discrete. A pixel typically has 256 values and slight changes in the pixels won't necessarily affect the image's meaning to us. However, a slight change in the sentence even a single letter (for example, turning we into he) may change the whole meaning of the sentence. Also, we tend to have a higher tolerance bar for synthesized images compared to text...