-
Book Overview & Buying
-
Table Of Contents
Supercharged Coding with GenAI
By :
Launched by OpenAI in November 2022, ChatGPT was developed on the GPT-3.5 model. It became a focal point of the AI growth since it worked through a conversational interface, unlike the programming interface of other LLMs. The dialog-driven interface requires it to track the history of the conversation, even across sessions. ChatGPT is a specialization of the LLM with improved conversational capability.
One of the key technology improvements was the use of reinforcement learning from human feedback (RLHF), which improved the dialog capability through training and feedback to give better responses. As discussed earlier, fine-tuning can improve the LLM’s performance for specific tasks. RLHF goes one step further and incorporates feedback from users to adjust the weights. As a result, it delivers results that incorporate human preferences and even reasoning capabilities in terms of responses and answers to questions.
ChatGPT continues to be a leader in the growth...