Chapter 1
LLMs Under the Hood
Section 3
Modeling LLMs: Input Data, Pre-Training, Fine-Tuning, and Model Evaluation
It's easy to make something cool with LLMs, but very hard to make something production-ready with them. In the next two sessions, Abi Aryan (ML engineer) and Denis Rothman (AI ethicist and innovator) will demonstrate every step of modelling LLMs and take you from concepts to production-ready LLMs. HuggingFace Hub: https://huggingface.co/docs/hub/index#:~:text=Machine%20Learning%20%F0%9F%94%A5.-,The%20Hugging%20Face%20Hub%20is%20a%20platform%20with%20over%20120k,with%20open%2Dsource%20Machine%20Learning. OpenAI Privacy Policy: https://openai.com/policies/privacy-policy. OpenAI's GPT-3: https://lambdalabs.com/blog/demystifying-gpt-3. HuggingFace: https://huggingface.co/autotrain. Finetuning BERT Variant: https://github.com/Denis2054/Transformers-for-NLP-2nd-Edition/blob/main/Bonus/BERT_Fine_Tuning_Sentence_Classification_GPU_Session_2.ipynb. Training BERT Variant: https://github.com/Denis2054/Transformers-for-NLP-2nd-Edition/blob/main/Bonus/Customer_Support_for_X_Session_2.ipynb. Denis' book URL: https://www.amazon.com/dp/1803247339/. Link to the deck: https://packt.link/UamVS.