Book Image

Exploring Deepfakes

By : Bryan Lyon, Matt Tora
Book Image

Exploring Deepfakes

By: Bryan Lyon, Matt Tora

Overview of this book

Applying Deepfakes will allow you to tackle a wide range of scenarios creatively. Learning from experienced authors will help you to intuitively understand what is going on inside the model. You’ll learn what deepfakes are and what makes them different from other machine learning techniques, and understand the entire process from beginning to end, from finding faces to preparing them, training the model, and performing the final swap. We’ll discuss various uses for face replacement before we begin building our own pipeline. Spending some extra time thinking about how you collect your input data can make a huge difference to the quality of the final video. We look at the importance of this data and guide you with simple concepts to understand what your data needs to really be successful. No discussion of deepfakes can avoid discussing the controversial, unethical uses for which the technology initially became known. We’ll go over some potential issues, and talk about the value that deepfakes can bring to a variety of educational and artistic use cases, from video game avatars to filmmaking. By the end of the book, you’ll understand what deepfakes are, how they work at a fundamental level, and how to apply those techniques to your own needs.
Table of Contents (15 chapters)
1
Part 1: Understanding Deepfakes
6
Part 2: Getting Hands-On with the Deepfake Process
10
Part 3: Where to Now?

Deepfakes

Of course, this whole book has been about the past and present of deepfakes, so it makes sense to circle back to their future at the end. There is a lot we can learn about the future of deepfakes from the other AI mentioned in this chapter. This is because, sneakily, all the parts of this chapter have been building up to this section. Deepfakes are, after all, an image generation AI that works on domain-specific images with a shared embedding.

Every area that we’ve explored in this chapter can be used to improve deepfakes, so let’s approach them one at a time.

Sound generation

This one is quite simple and obvious. The next step after swapping a face would be to swap the voice too. If we could get a solid voice swap, then deepfakes would be taken to a whole new capability. Making music or other effects could also be useful if you were making a movie without any other people helping, but their utility would be otherwise limited (in deepfakes, other industries...