Book Image

Exploring Deepfakes

By : Bryan Lyon, Matt Tora
Book Image

Exploring Deepfakes

By: Bryan Lyon, Matt Tora

Overview of this book

Applying Deepfakes will allow you to tackle a wide range of scenarios creatively. Learning from experienced authors will help you to intuitively understand what is going on inside the model. You’ll learn what deepfakes are and what makes them different from other machine learning techniques, and understand the entire process from beginning to end, from finding faces to preparing them, training the model, and performing the final swap. We’ll discuss various uses for face replacement before we begin building our own pipeline. Spending some extra time thinking about how you collect your input data can make a huge difference to the quality of the final video. We look at the importance of this data and guide you with simple concepts to understand what your data needs to really be successful. No discussion of deepfakes can avoid discussing the controversial, unethical uses for which the technology initially became known. We’ll go over some potential issues, and talk about the value that deepfakes can bring to a variety of educational and artistic use cases, from video game avatars to filmmaking. By the end of the book, you’ll understand what deepfakes are, how they work at a fundamental level, and how to apply those techniques to your own needs.
Table of Contents (15 chapters)
1
Part 1: Understanding Deepfakes
6
Part 2: Getting Hands-On with the Deepfake Process
10
Part 3: Where to Now?

What this book covers

Chapter 1, Surveying Deepfakes, provides a look into the past and present of deepfakes with a description of how they work and are used.

Chapter 2, Examining Deepfake Ethics and Dangers, provides a look at the sordid history of deepfakes and guidelines on creating ethical deepfakes.

Chapter 3, Mastering Data, teaches you how to get the most from your data, whether you make it yourself or have to find it.

Chapter 4, The Deepfake Workflow, provides a step-by-step walk-through of using Faceswap from the installation to the final output.

Chapter 5, Extracting Faces, is where we begin our hands-on dive into the code of a deepfake by learning how we detect, align, and mask faces for deepfakes.

Chapter 6, Training a Deepfake Model, is where we continue exploring the code as we train a model from scratch, including defining the layers of the model, feeding it images, and updating the model weights.

Chapter 7, Swapping the Face Back into the Video, is where we complete the code analysis with conversion, the process that puts the swapped face back into the original video.

Chapter 8, Applying the Lessons of Deepfakes, teaches you the process of solving hypothetical problems using deepfake techniques.

Chapter 9, The Future of Generative AI, examines where generative AI will move in the future and what limitations they need to overcome.