-
Book Overview & Buying
-
Table Of Contents
Machine Learning Engineering on AWS - Second Edition
By :
In the previous two sections, you explored real-time and serverless inference endpoints for handling individual requests or unpredictable traffic patterns. In this section, you'll use batch transform to perform inference on large datasets without deploying a real-time endpoint, making it ideal for asynchronous or bulk data processing. When running batch inference with batch transform, SageMaker AI launches a managed ML instance, loads the specified model and input data, performs inference, writes the results to S3, and then terminates the instance automatically, providing a fully managed, scalable workflow similar to SageMaker Processing.
In this section, you'll continue using the deployment_options.ipynb notebook. The upcoming steps and code will all be run in this notebook.
Let's walk through the steps to run batch inference using batch transform:
download_file() function to download the CSV file containing the data...