Book Image

Generative Adversarial Networks Cookbook

By : Josh Kalin
Book Image

Generative Adversarial Networks Cookbook

By: Josh Kalin

Overview of this book

Developing Generative Adversarial Networks (GANs) is a complex task, and it is often hard to find code that is easy to understand. This book leads you through eight different examples of modern GAN implementations, including CycleGAN, simGAN, DCGAN, and 2D image to 3D model generation. Each chapter contains useful recipes to build on a common architecture in Python, TensorFlow and Keras to explore increasingly difficult GAN architectures in an easy-to-read format. The book starts by covering the different types of GAN architecture to help you understand how the model works. This book also contains intuitive recipes to help you work with use cases involving DCGAN, Pix2Pix, and so on. To understand these complex applications, you will take different real-world data sets and put them to use. By the end of this book, you will be equipped to deal with the challenges and issues that you may face while working with GAN models, thanks to easy-to-follow code solutions that you can implement right away.

Related Content you might be interested in

Current Title:

Small book image
Generative Adversarial Networks Cookbook
Josh Kalin
Dec, 2018 | 268 pages
Small book image
Generative Adversarial Networks Projects
Kailash Ahirwar
Jan, 2019 | 316 pages
Small book image
Keras Deep Learning Cookbook
Manpreet Singh Ghotra | Rajdeep Dua
Oct, 2018 | 252 pages
Small book image
Hands-On Generative Adversarial Networks with Keras
Rafael Valle
May, 2019 | 272 pages
Table of Contents (17 chapters)
Title Page
Title Page
Copyright and Credits
Copyright and Credits
About Packt
About Packt
Dedication
Dedication
Contributors
Contributors
Preface
Preface
Dedication2
Dedication2
Free Chapter
1
What Is a Generative Adversarial Network?
What Is a Generative Adversarial Network?
Introduction
Generative and discriminative models
A neural network love story
Deep neural networks
Architecture structure basics
Basic building block – generator
Basic building block – discriminator
Basic building block – loss functions
Training
GAN pieces come together in different ways
What does a GAN output?
Understanding the benefits of a GAN structure
Exercise
2
Data First, Easy Environment, and Data Prep
Data First, Easy Environment, and Data Prep
Introduction
Is data that important?
But first, set up your development environment
Data types
Data preprocessing
Anomalous data
Balancing data
Data augmentation
Exercise
3
My First GAN in Under 100 Lines
My First GAN in Under 100 Lines
Introduction
From theory to code – a simple example
Building a neural network in Keras and TensorFlow
Explaining your first GAN component – discriminator
Explaining your second GAN component – generator
Putting all the GAN pieces together
Training your first GAN
Training the model and understanding the GAN output
Exercise
4
Dreaming of New Outdoor Structures Using DCGAN
Dreaming of New Outdoor Structures Using DCGAN
Introduction
What is DCGAN? A simple pseudocode example
Tools – do I need any unique tools?
Parsing the data – is our data unique?
Code implementation – generator
Code implementation – discriminator
Training
Evaluation – how do we know it worked?
Adjusting parameters for better performance
Exercise
5
Pix2Pix Image-to-Image Translation
Pix2Pix Image-to-Image Translation
Introduction
Introducing Pix2Pix with pseudocode
Parsing our dataset
Code implementation – generator
Code – the GAN network
Code implementation – discriminator
Training
Exercise
6
Style Transfering Your Image Using CycleGAN
Style Transfering Your Image Using CycleGAN
Introduction
Pseudocode – how does it work?
Parsing the CycleGAN dataset
Code implementation – generator
Code implementation – discriminator
Code implementation – GAN
On to training
Exercise
7
Using Simulated Images To Create Photo-Realistic Eyeballs with SimGAN
Using Simulated Images To Create Photo-Realistic Eyeballs with SimGAN
Introduction
How SimGAN architecture works
Pseudocode – how does it work?
How to work with training data
Code implementation – loss functions
Code implementation – generator
Code implementation – discriminator
Code implementation – GAN
Training the simGAN network
Exercise
8
From Image to 3D Models Using GANs
From Image to 3D Models Using GANs
Introduction
Introduction to using GANs in order to produce 3D models
Environment preparation
Encoding 2D data and matching to 3D objects
Code implementation – generator
Code implementation – discriminator
Code implementation – GAN
Training this model
Exercise
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think
Index
Index

How SimGAN architecture works

Apple previously released a paper titled Learning from Simulated and Unsupervised Images through Adversarial Training (https://arxiv.org/pdf/1612.07828.pdf), in which authors coined the architecture type SimGAN. As set out in the paper, SimGAN allows users to refine simulated data to make it look more realistic. In this section, we'll discuss how SimGAN architecture works.

Getting ready

The only thing you'll need in this section is the paper previously mentioned, which can be downloaded and read at: https://arxiv.org/pdf/1612.07828.pdf titled Learning from Simulated and Unsupervised Images through Adversarial Training.

How to do it...

In the SimGAN paper, authors set out to create a refiner network that can accurately improve the realism of synthetic images in an unsupervised manner. In the past, it has been quite hard to find matched simulation and real data for training such networks, but SimGAN has changed the existing landscape thanks to its focus on a simulated...

Previous Section
End of Section 3
Next Section