ELMo, BERT, and GPT
In this section, we will explain several classic NLP models used nowadays, namely ELMo, BERT, and GPT.
Before we dive into these complicated model structures, we will first illustrate the basic concept of a Recurrent Neural Network (RNN) and how it works. Then, we will move on to the transformers. This section will cover the following topics:
- Basic concepts
We will start with introducing RNNs.
We will illustrate what we mean with the following examples: