Book Image

Hands-On Generative Adversarial Networks with PyTorch 1.x

By : John Hany, Greg Walters
Book Image

Hands-On Generative Adversarial Networks with PyTorch 1.x

By: John Hany, Greg Walters

Overview of this book

With continuously evolving research and development, Generative Adversarial Networks (GANs) are the next big thing in the field of deep learning. This book highlights the key improvements in GANs over generative models and guides in making the best out of GANs with the help of hands-on examples. This book starts by taking you through the core concepts necessary to understand how each component of a GAN model works. You'll build your first GAN model to understand how generator and discriminator networks function. As you advance, you'll delve into a range of examples and datasets to build a variety of GAN networks using PyTorch functionalities and services, and become well-versed with architectures, training strategies, and evaluation methods for image generation, translation, and restoration. You'll even learn how to apply GAN models to solve problems in areas such as computer vision, multimedia, 3D models, and natural language processing (NLP). The book covers how to overcome the challenges faced while building generative models from scratch. Finally, you'll also discover how to train your GAN models to generate adversarial examples to attack other CNN and GAN models. By the end of this book, you will have learned how to build, train, and optimize next-generation GAN models and use them to solve a variety of real-world problems.
Table of Contents (15 chapters)
Free Chapter
1
Section 1: Introduction to GANs and PyTorch
5
Section 2: Typical GAN Models for Image Synthesis

Designing GANs for 3D data synthesis

3D-GAN, which was proposed by Jiajun Wu, Chengkai Zhang, and Tianfan Xue, et. al. in their paper, Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling, was designed to generate a 3D point cloud of certain types of objects. The design and training process of 3D-GAN is very similar to the vanilla GAN, except that the input and output tensors of the 3D-GAN are five-dimensional, rather than four-dimensional.

Generators and discriminators in 3D-GAN

The architecture of the generator network of 3D-GAN is as follows:

Architecture of the generator network in 3D-GAN

The generator network consists of five transposed convolution layers (nn.ConvTranspose3d)...