-
Book Overview & Buying
-
Table Of Contents
Mastering Docker on Windows
By :
There was a point recently when I was experimenting with a handful of GenAI models locally. I had a summarizer in one container, an embedding model in another, and a tiny vector store in yet another. Now, it sounds like chaos, but initially, it all felt streamlined and elegant. But as soon as I hooked in a chatbot frontend and scaled a second summarizer container, things began to fall apart. Containers were talking past one another, performance fluctuated, and data consistency became a nightmare. So, I did what most senior engineers would do in that situation: I went for a walk to clear my head. After a while, I realized that deploying GenAI locally isn't just about spinning up a single model; it's about managing a stack. I was thinking about it as a shiny new toy to play with instead of a stack of software like I'd deployed hundreds of times before. And that's precisely what we'll tackle in this part of the book: understanding...