-
Book Overview & Buying
-
Table Of Contents
Deep Learning with C++
By :
This chapter explored three major generative AI paradigms, building on the previous chapters on CNNs and temporal neural networks like RNN and LSTMs. Although the neural networks presented in this chapter might be outdated by today’s standards on transformers, these neural networks are historically significant to truly appreciate the transformers and LLMs we will discuss in the upcoming chapter.
We went through three major generative AI paradigms: autoencoders, VAEs and GANs. Autoencoders compress and reconstruct data through encoder-decoder frameworks. They can be viewed as data compression mechanisms where a latent vector at the bottleneck layer has enough information to reconstruct the whole data (image). We then looked at a variant of autoencoders called VAEs which can be used to generate new datapoints from the probability distribution of the input data. Then we studied GANs. They use adversarial training where generators create synthetic data while discriminators...