Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Building Natural Language and LLM Pipelines
  • Table Of Contents Toc
Building Natural Language and LLM Pipelines

Building Natural Language and LLM Pipelines

By : Laura Funderburk
close
close
Building Natural Language and LLM Pipelines

Building Natural Language and LLM Pipelines

By: Laura Funderburk

Overview of this book

Modern LLM applications often break in production due to brittle pipelines, loose tool definitions, and noisy context. This book shows you how to build production-ready, context-aware systems using Haystack and LangGraph. You’ll learn to design deterministic pipelines with strict tool contracts and deploy them as microservices. Through structured context engineering, you’ll orchestrate reliable agent workflows and move beyond simple prompt-based interactions. You'll start by understanding LLM behavior—tokens, embeddings, and transformer models—and see how prompt engineering has evolved into a full context engineering discipline. Then, you'll build retrieval-augmented generation (RAG) pipelines with retrievers, rankers, and custom components using Haystack’s graph-based architecture. You’ll also create knowledge graphs, synthesize unstructured data, and evaluate system behavior using Ragas and Weights & Biases. In LangGraph, you’ll orchestrate agents with supervisor-worker patterns, typed state machines, retries, fallbacks, and safety guardrails. By the end of the book, you’ll have the skills to design scalable, testable LLM pipelines and multi-agent systems that remain robust as the AI ecosystem evolves. *Email sign-up and proof of purchase required
Table of Contents (18 chapters)
close
close
Lock Free Chapter
1
Part 1: The Foundation of Reliable AI
4
Part 2: Building The Tool Layer with Haystack
9
Part 3: Deployment and Agentic Orchestration
12
Part 4: The Future of Agentic AI
16
Other Books You May Enjoy
17
Index

Summary

Data pipelines consist of a series of systematic steps that process data from a raw format into a format that can be used and consumed by a variety of users. In the modern era, these pipelines are evolving from simple, linear flows for human-readable analytics into the foundational reliability layer for sophisticated AI agents.

We explored the evolutionary path of these systems: from general data pipelines and classic NLP pipelines to modern LLM-augmented pipelines. A common denominator in all these cases is the presence of rigorous data source identification, cleaning, and preprocessing. For NLP and LLM pipelines, crucial steps include tokenization (breaking down words) and embeddings (constructing numerical representations).

As we move into 2026, the design of these pipelines is shifting to solve new, complex challenges. We must now account for reliability, scalability, cost-effectiveness, and security in a world of interoperable, autonomous agents.

This book will guide you...

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Building Natural Language and LLM Pipelines
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon