Book Image

Amazon SageMaker Best Practices

By : Sireesha Muppala, Randy DeFauw, Shelbee Eigenbrode
Book Image

Amazon SageMaker Best Practices

By: Sireesha Muppala, Randy DeFauw, Shelbee Eigenbrode

Overview of this book

Amazon SageMaker is a fully managed AWS service that provides the ability to build, train, deploy, and monitor machine learning models. The book begins with a high-level overview of Amazon SageMaker capabilities that map to the various phases of the machine learning process to help set the right foundation. You'll learn efficient tactics to address data science challenges such as processing data at scale, data preparation, connecting to big data pipelines, identifying data bias, running A/B tests, and model explainability using Amazon SageMaker. As you advance, you'll understand how you can tackle the challenge of training at scale, including how to use large data sets while saving costs, monitoring training resources to identify bottlenecks, speeding up long training jobs, and tracking multiple models trained for a common goal. Moving ahead, you'll find out how you can integrate Amazon SageMaker with other AWS to build reliable, cost-optimized, and automated machine learning applications. In addition to this, you'll build ML pipelines integrated with MLOps principles and apply best practices to build secure and performant solutions. By the end of the book, you'll confidently be able to apply Amazon SageMaker's wide range of capabilities to the full spectrum of machine learning workflows.

Related Content you might be interested in

Current Title:

Small book image
Amazon SageMaker Best Practices
Sireesha Muppala | Randy DeFauw | Shelbee Eigenbrode
Sep, 2021 | 348 pages
Small book image
Getting Started with Amazon SageMaker Studio
Michael Hsieh
Mar, 2022 | 326 pages
Small book image
Accelerate Deep Learning Workloads with Amazon SageMaker
Vadim Dabravolski
Oct, 2022 | 278 pages
Small book image
Learn Amazon SageMaker
Julien Simon
Nov, 2021 | 554 pages
Table of Contents (20 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Download the example code files
Download the color images
Conventions used
Get in touch
Share your thoughts
1
Section 1: Processing Data at Scale
Section 1: Processing Data at Scale
Free Chapter
2
Chapter 1: Amazon SageMaker Overview
Chapter 1: Amazon SageMaker Overview
Technical requirements
Preparing, building, training and tuning, deploying, and managing ML models
Discussion of data preparation capabilities
Feature tour of model-building capabilities
Feature tour of training and tuning capabilities
Feature tour of model management and deployment capabilities
Summary
3
Chapter 2: Data Science Environments
Chapter 2: Data Science Environments
Technical requirements
Machine learning use case and dataset
Creating data science environment
Summary
References
4
Chapter 3: Data Labeling with Amazon SageMaker Ground Truth
Chapter 3: Data Labeling with Amazon SageMaker Ground Truth
Technical requirements
Challenges with labeling data at scale
Addressing unique labeling requirements with custom labeling workflows
Improving labeling quality using multiple workers
Using active learning to reduce labeling time
Security and permissions
Summary
5
Chapter 4: Data Preparation at Scale Using Amazon SageMaker Data Wrangler and Processing
Chapter 4: Data Preparation at Scale Using Amazon SageMaker Data Wrangler and Processing
Technical requirements
Visual data preparation with Data Wrangler
Bias detection and explainability with Data Wrangler and Clarify
Data preparation at scale with SageMaker Processing
Summary
6
Chapter 5: Centralized Feature Repository with Amazon SageMaker Feature Store
Chapter 5: Centralized Feature Repository with Amazon SageMaker Feature Store
Technical requirements
Amazon SageMaker Feature Store essentials
Creating feature groups
Populating feature groups
Retrieving features from feature groups
Creating reusable features to reduce feature inconsistencies and inference latency
Designing solutions for near real-time ML predictions
Summary
References
7
Section 2: Model Training Challenges
Section 2: Model Training Challenges
8
Chapter 6: Training and Tuning at Scale
Chapter 6: Training and Tuning at Scale
Technical requirements
ML training at scale with SageMaker distributed libraries
Automated model tuning with SageMaker hyperparameter tuning
Organizing and tracking training jobs with SageMaker Experiments
Summary
References
9
Chapter 7: Profile Training Jobs with Amazon SageMaker Debugger
Chapter 7: Profile Training Jobs with Amazon SageMaker Debugger
Technical requirements
Amazon SageMaker Debugger essentials
Real-time monitoring of training jobs using built-in and custom rules
Gaining insight into the training infrastructure and training framework
Summary
Further reading
10
Section 3: Manage and Monitor Models
Section 3: Manage and Monitor Models
11
Chapter 8: Managing Models at Scale Using a Model Registry
Chapter 8: Managing Models at Scale Using a Model Registry
Technical requirements
Using a model registry
Choosing a model registry solution
Managing models using the Amazon SageMaker model registry
Summary
12
Chapter 9: Updating Production Models Using Amazon SageMaker Endpoint Production Variants
Chapter 9: Updating Production Models Using Amazon SageMaker Endpoint Production Variants
Technical requirements
Basic concepts of Amazon SageMaker Endpoint Production Variants
Deployment strategies for updating ML models with SageMaker Endpoint Production Variants
Selecting an appropriate deployment strategy
Summary
13
Chapter 10: Optimizing Model Hosting and Inference Costs
Chapter 10: Optimizing Model Hosting and Inference Costs
Technical requirements
Real-time inference versus batch inference
Deploying multiple models behind a single inference endpoint
Scaling inference endpoints to meet inference traffic demands
Using Elastic Inference for deep learning models
Optimizing models with SageMaker Neo
Summary
14
Chapter 11: Monitoring Production Models with Amazon SageMaker Model Monitor and Clarify
Chapter 11: Monitoring Production Models with Amazon SageMaker Model Monitor and Clarify
Technical requirements
Basic concepts of Amazon SageMaker Model Monitor and Amazon SageMaker Clarify
End-to-end architectures for monitoring ML models
Best practices for monitoring ML models
Summary
References
15
Section 4: Automate and Operationalize Machine Learning
Section 4: Automate and Operationalize Machine Learning
16
Chapter 12: Machine Learning Automated Workflows
Chapter 12: Machine Learning Automated Workflows
Considerations for automating your SageMaker ML workflows
Building ML workflows with Amazon SageMaker Pipelines
Creating CI/CD pipelines using Amazon SageMaker Projects
Summary
17
Chapter 13:Well-Architected Machine Learning with Amazon SageMaker
Chapter 13:Well-Architected Machine Learning with Amazon SageMaker
Best practices for operationalizing ML workloads
Best practices for securing ML workloads
Best practices for reliable ML workloads
Best practices for building performant ML workloads
Best practices for cost-optimized ML workloads
Summary
18
Chapter 14: Managing SageMaker Features across Accounts
Chapter 14: Managing SageMaker Features across Accounts
Examining an overview of the AWS multi-account environment
Understanding the benefits of using multiple AWS accounts with Amazon SageMaker
Examining multi-account considerations with Amazon SageMaker
Summary
References
Why subscribe?
19
Other Books You May Enjoy
Other Books You May Enjoy
Packt is searching for authors like you
Share your thoughts

Preparing, building, training and tuning, deploying, and managing ML models

First, let's review the ML life cycle. By the end of this section, you should understand how SageMaker's capabilities map to the key phases of the ML life cycle. The following diagram shows you what the ML life cycle looks like:

Figure 1.1 – Machine learning life cycle

Figure 1.1 – Machine learning life cycle

As you can see, there are three phases of the ML life cycle at a high level:

  • In the Data Preparation phase, you collect and explore data, label a ground truth dataset, and prepare your features. Feature engineering, in turn, has several steps, including data normalization, encoding, and calculating embeddings, depending on the ML algorithm you choose.
  • In the Model Training phase, you build your model and tune it until you achieve a reasonable validation score that aligns with your business objective.
  • In the Operations phase, you test how well your model performs against real-world data, deploy it, and monitor how well it performs. We will cover model monitoring in more detail in Chapter 11, Monitoring Production Models with Amazon SageMaker Model Monitor and Clarify.

This diagram is purposely simplified; in reality, each phase may have multiple smaller steps, and the whole life cycle is iterative. You're never really done with ML; as you gather data on how your model performs in production, you'll likely try to improve it by collecting more data, changing your features, or tuning the model.

So how do SageMaker capabilities map to the ML life cycle? Before we answer that question, let's take a look at the SageMaker console (Figure 1.2):

Figure 1.2 – Navigation pane in the SageMaker console

Figure 1.2 – Navigation pane in the SageMaker console

The appearance of the console changes frequently and the preceding screenshot shows the current appearance of the console at the time of writing.

These capability groups align to the ML life cycle, shown as follows:

Figure 1.3 – Mapping of SageMaker capabilities to the ML life cycle

Figure 1.3 – Mapping of SageMaker capabilities to the ML life cycle

SageMaker Studio is not shown here, as it is an integrated workbench that provides a user interface for many SageMaker capabilities. The marketplace provides both data and algorithms that can be used across the life cycle.

Now that we have had a look at the console, let's dive deeper into the individual capabilities of SageMaker in each life cycle phase.

Previous Section
End of Section 3
Next Section