Chapter 1
LLMs Under the Hood
Section 2
Architecting LLMs - Text Generation, Code Interpretation, and More
When developing generative AI applications, the choice of the right language model is nothing short of pivotal. You're presented with two distinct paths: harnessing an existing model or embarking on the journey to train a new one from the ground up. Yet, for seasoned professionals or for beginners, mastering the inner workings of LLMs is paramount before you take that all-important step. In this tech session, Denis Rothman (AI ethicist and innovator) will be your guide to cutting through the noise and diving headfirst into the world of LLMs. DALL-E 2 API Example: https://colab.research.google.com/github/Denis2054/Transformers-for-NLP-2nd-Edition/blob/main/Chapter17/Getting_Started_with_the_DALL_E_2_API.ipynb. Visualize Self Attention: https://colab.research.google.com/github/Denis2054/Transformers-for-NLP-2nd-Edition/blob/main/Chapter14/BertViz.ipynb. The Math Behind: https://colab.research.google.com/github/Denis2054/Transformers-for-NLP-2nd-Edition/blob/main/Chapter02/Multi_Head_Attention_Sub_Layer.ipynb. State of the art LLMs: https://colab.research.google.com/github/Denis2054/Transformers-for-NLP-2nd-Edition/blob/main/Chapter17/Getting_Started_OpenAI_GPT_4.ipynb. Summarize Text with T5: https://colab.research.google.com/github/Denis2054/Transformers-for-NLP-2nd-Edition/blob/main/Chapter08/Summarizing_Text_with_T5.ipynb. Summarize with ChatGPT: https://colab.research.google.com/github/Denis2054/Transformers-for-NLP-2nd-Edition/blob/main/Chapter09/Summarizing_with_ChatGPT.ipynb. Denis' book URL: https://www.amazon.com/dp/1803247339/. Link to the deck: https://packt.link/eDwvj.