-
Book Overview & Buying
-
Table Of Contents
Supercharged Coding with GenAI
By :
In our current technology cycle, most companies are leveraging big data and artificial intelligence to improve their businesses. For example, videos on the YouTube and TikTok platforms are viewed over a billion times per day which generates recommendations and advertising value. In these cases, even 1% gains in efficiency for storage or computation may save millions of dollars.
According to Lambda Labs, training the generative pre-trained transformer model GPT-3 involved about 700 gigabytes of Random Access Memory (RAM) and thousands of powerful Nvidia GPUs operating in parallel, with a cumulative compute time equivalent to 355 years. Even a minor inefficiency in implementing these models could lead to substantial costs or, in the worst case, create a bottleneck that would prevent the model from running effectively.
The runtime of a program refers to the time it takes to execute the tasks defined in the source...