-
Book Overview & Buying
-
Table Of Contents
Building Natural Language and LLM Pipelines
By :
In the previous chapter, we provided an overview of state-of-the-art patterns in the LLM landscape, from prompt engineering to context engineering, the evolution of LLMs to small and reasoning models, and proposed a hybrid architecture that leverages the strengths of two key open source players in the ever-evolving AI landscape: Haystack by deepset and LangGraph by LangChain. We mapped each of their strengths through a proposed hybrid architecture: a stateful orchestration layer (LangGraph) that directs a set of reliable, auditable tool layers (Haystack). This separation of concerns is the key to building complex, production-ready AI.
This chapter begins our deep dive into constructing that tool layer using Haystack 2.0. While Haystack offers its own agentic capabilities, which we will outline to demonstrate where that approach is sufficient, our primary focus for this framework is its role as a pipeline-first engine. Its true strength...