-
Book Overview & Buying
-
Table Of Contents
Building Natural Language and LLM Pipelines
By :
We’ve reached the finish line of our engineering journey! We learned how to transform RAG of various formats (text, multimodal, with a vector database, with agents, with persistence) into a cohesive, production-grade architecture. Throughout this book, we examined different ways to test our RAG systems: through knowledge graphs, unit testing, token cost, and integrity testing. In doing so, we built scaffolding that will enable us to build LLM and agentic applications that can be reliable when deployed to production.
We learned how to implement four core strategies: write, select, compress, and isolate, to iterate agentic architecture. Using these strategies provides significant gains, such as token reduction, context rot reduction, and system integrity. By intentionally turning off our tools in a controlled environment, we saw firsthand that reliability is not a property of the model’s intelligence, but a result of the system’s architecture.
This...