-
Book Overview & Buying
-
Table Of Contents
Data Engineering with Azure Databricks
By :
Databricks is not just a data platform. It is also a complete environment for machine learning and AI. In this chapter, you will learn how to track experiments, build models, and deploy them to production without leaving the platform.
We will start with the traditional machine learning tools: MLflow for experiment tracking, Feature Store for reusable features, and AutoML for building models with minimal code. Then we will look at Genie, which lets business users ask questions in plain English.
In the second half, we will explore generative AI. You will learn how to search documents by meaning with Vector Search, build a RAG chatbot that answers from your company's data, and control LLM costs with AI Gateway. By the end, you will understand when to use each tool and how they fit together.
In this chapter, we will cover the following topics: