-
Book Overview & Buying
-
Table Of Contents
Machine Learning Engineering on AWS - Second Edition
By :
An automated pipeline is simply a sequence of connected steps that runs tasks in a defined order with minimal manual intervention. When you execute a pipeline, each step runs according to the dependencies and workflow logic defined within it. Before teams implement automated pipelines, workflows are often run manually using individual steps such as training, evaluation, and deployment. This works well for early experimentation, but it becomes harder to manage as the process grows and is repeated over time. You need to track dependencies between steps, manage inputs and outputs, and ensure consistent execution. Over time, this manual approach becomes less reliable and more difficult to maintain.
In this chapter, you will use SageMaker Pipelines to incrementally address these challenges by applying core pipeline design principles. You will start with simple, single-step pipelines focused on fine-tuning and evaluation. From there, you...