Summary
In this chapter, you learned how to use and configure Azure Machine Learning pipelines for splitting an ML workflow into multiple steps using pipeline and pipeline steps for estimators, Python execution, and parallel execution. You configured pipeline input and output using Dataset
and PipelineData
and managed to control the execution flow of the pipeline.
As another milestone, you deployed the pipeline as PublishedPipeline
to an HTTP endpoint. This lets you configure and trigger the pipeline execution with a simple HTTP call. Next, you implemented automatic scheduling based on a time frequency, as well as a reactive schedule based on changes in the underlying dataset. Now, the pipeline can rerun your workflow when the input data changes without any manual interaction.
Finally, we also modularized and versioned a pipeline step so that it can be reused in other projects. We used InputPortDef
and OutputPortDef
to create virtual bindings for data sources and sinks. In the...