Book Image

Machine Learning with Amazon SageMaker Cookbook

By : Joshua Arvin Lat
Book Image

Machine Learning with Amazon SageMaker Cookbook

By: Joshua Arvin Lat

Overview of this book

Amazon SageMaker is a fully managed machine learning (ML) service that helps data scientists and ML practitioners manage ML experiments. In this book, you'll use the different capabilities and features of Amazon SageMaker to solve relevant data science and ML problems. This step-by-step guide features 80 proven recipes designed to give you the hands-on machine learning experience needed to contribute to real-world experiments and projects. You'll cover the algorithms and techniques that are commonly used when training and deploying NLP, time series forecasting, and computer vision models to solve ML problems. You'll explore various solutions for working with deep learning libraries and frameworks such as TensorFlow, PyTorch, and Hugging Face Transformers in Amazon SageMaker. You'll also learn how to use SageMaker Clarify, SageMaker Model Monitor, SageMaker Debugger, and SageMaker Experiments to debug, manage, and monitor multiple ML experiments and deployments. Moreover, you'll have a better understanding of how SageMaker Feature Store, Autopilot, and Pipelines can meet the specific needs of data science teams. By the end of this book, you'll be able to combine the different solutions you've learned as building blocks to solve real-world ML problems.
Table of Contents (11 chapters)

Enabling ML explainability with SageMaker Clarify

In the previous two recipes, we used SageMaker Clarify to detect pre-training and post-training bias. In this recipe, we will take a closer look at ML explainability and how we can use SageMaker Clarify to generate an ML explainability report.

We will see the importance of ML explainability as we deal with ethical and legal concerns. For example, customers will want a better idea of how their information is used by a machine learning system to perform recommendations or predictions. In addition to this, ML explainability empowers data scientists and machine learning practitioners to make more accurate and fair models.

Note

It is important to distinguish model interpretability from model explainability. Model interpretability focuses on understanding what a machine learning model is doing internally. On the other hand, model explainability involves understanding how a machine learning model performed a prediction using certain...