Book Image

Exploring Deepfakes

By : Bryan Lyon, Matt Tora
Book Image

Exploring Deepfakes

By: Bryan Lyon, Matt Tora

Overview of this book

Applying Deepfakes will allow you to tackle a wide range of scenarios creatively. Learning from experienced authors will help you to intuitively understand what is going on inside the model. You’ll learn what deepfakes are and what makes them different from other machine learning techniques, and understand the entire process from beginning to end, from finding faces to preparing them, training the model, and performing the final swap. We’ll discuss various uses for face replacement before we begin building our own pipeline. Spending some extra time thinking about how you collect your input data can make a huge difference to the quality of the final video. We look at the importance of this data and guide you with simple concepts to understand what your data needs to really be successful. No discussion of deepfakes can avoid discussing the controversial, unethical uses for which the technology initially became known. We’ll go over some potential issues, and talk about the value that deepfakes can bring to a variety of educational and artistic use cases, from video game avatars to filmmaking. By the end of the book, you’ll understand what deepfakes are, how they work at a fundamental level, and how to apply those techniques to your own needs.
Table of Contents (15 chapters)
1
Part 1: Understanding Deepfakes
6
Part 2: Getting Hands-On with the Deepfake Process
10
Part 3: Where to Now?

Creating the video from images

The conversion code included produces swapped images, but if we want to create a video, we’ll need to combine the output into a video file. There are multiple options here, depending on what you want to include:

  • The following is for including just the images:
    ffmpeg -i {path_to_convert}\%05d.png Output.mp4

This command line will convert all the frames into a video with some default options. The Output.mp4 file will include the frames but won’t include any audio and will be at a default frame rate of 25 frames per second. This will be close enough to accurate for videos that came from film sources, such as Blu-rays or DVDs. If the video looks too fast or too slow, then your frame rate is incorrect, and you should look at the next option instead to match the correct frame rate.

  • Including the images at a specific frame rate:
    ffmpeg -framerate {framerate} -i {path_to_convert}\%05d.png
      Output.mp4

This command...