Chapter 5: GPT-3 as the Next Step in Corporate Innovation
When a new innovation or technical shift happens, big corporations are usually the last to adopt it. Their hierarchical structures are composed of various authoritarian levels, and standard processes of legal approvals and paperwork often limit freedom to experiment, making it difficult for enterprises to be early adopters. But this doesn’t seem to be the case with GPT-3. As soon as the API was released, corporations started experimenting with it. However, they ran into a significant barrier: data privacy.
In its simplest form, all a language model does is to predict the next word given a series of previous words. As you learned in Chapter 2, OpenAI has devised several techniques to transform the functioning of language models like GPT-3 from simple next-word prediction to more useful NLP tasks such as answering questions, summarizing documents, and generating context-specific text. Typically, the best results are achieved...