Book Image

Machine Learning with Amazon SageMaker Cookbook

By : Joshua Arvin Lat
Book Image

Machine Learning with Amazon SageMaker Cookbook

By: Joshua Arvin Lat

Overview of this book

Amazon SageMaker is a fully managed machine learning (ML) service that helps data scientists and ML practitioners manage ML experiments. In this book, you'll use the different capabilities and features of Amazon SageMaker to solve relevant data science and ML problems. This step-by-step guide features 80 proven recipes designed to give you the hands-on machine learning experience needed to contribute to real-world experiments and projects. You'll cover the algorithms and techniques that are commonly used when training and deploying NLP, time series forecasting, and computer vision models to solve ML problems. You'll explore various solutions for working with deep learning libraries and frameworks such as TensorFlow, PyTorch, and Hugging Face Transformers in Amazon SageMaker. You'll also learn how to use SageMaker Clarify, SageMaker Model Monitor, SageMaker Debugger, and SageMaker Experiments to debug, manage, and monitor multiple ML experiments and deployments. Moreover, you'll have a better understanding of how SageMaker Feature Store, Autopilot, and Pipelines can meet the specific needs of data science teams. By the end of this book, you'll be able to combine the different solutions you've learned as building blocks to solve real-world ML problems.
Table of Contents (11 chapters)

Preparing the test dataset for batch transform inference jobs

In this recipe, we will prepare the test dataset that will be used in the recipe Using batch transform for inference, which makes use of the Batch Transform capability of SageMaker. With Batch Transform, we can perform inference on multiple records all at the same time without having a persistent endpoint running.

Figure 8.9 – Text file containing the test data in JSON lines format

Note that when using Batch Transform with a BlazingText model, it is important that the input test dataset is in jsonlines format. As we have in Figure 8.9, each line in the file is a valid JSON value.

Getting ready

Here are the prerequisites for this recipe:

  • This recipe continues from Generating a synthetic dataset for text classification problems.
  • A SageMaker Studio notebook running the Python 3 (Data Science) kernel.

How to do it…

The steps in this recipe focus on converting...