Book Image

Accelerate Deep Learning Workloads with Amazon SageMaker

By : Vadim Dabravolski
Book Image

Accelerate Deep Learning Workloads with Amazon SageMaker

By: Vadim Dabravolski

Overview of this book

Over the past 10 years, deep learning has grown from being an academic research field to seeing wide-scale adoption across multiple industries. Deep learning models demonstrate excellent results on a wide range of practical tasks, underpinning emerging fields such as virtual assistants, autonomous driving, and robotics. In this book, you will learn about the practical aspects of designing, building, and optimizing deep learning workloads on Amazon SageMaker. The book also provides end-to-end implementation examples for popular deep-learning tasks, such as computer vision and natural language processing. You will begin by exploring key Amazon SageMaker capabilities in the context of deep learning. Then, you will explore in detail the theoretical and practical aspects of training and hosting your deep learning models on Amazon SageMaker. You will learn how to train and serve deep learning models using popular open-source frameworks and understand the hardware and software options available for you on Amazon SageMaker. The book also covers various optimizations technique to improve the performance and cost characteristics of your deep learning workloads. By the end of this book, you will be fluent in the software and hardware aspects of running deep learning workloads using Amazon SageMaker.
Table of Contents (16 chapters)
1
Part 1: Introduction to Deep Learning on Amazon SageMaker
6
Part 2: Building and Training Deep Learning Models
10
Part 3: Serving Deep Learning Models

Index

As this ebook edition doesn't have fixed pagination, the page numbers below are hyperlinked for reference only, based on the printed edition of this book.

A

A/B testing

production variants, using for 228, 229

Accelerated Linear Algebra (XLA) 105

activation checkpointing 134

activation offloading 134

advanced model deployment patterns, Sagemaker endpoint

inference pipeline 22

multi-container endpoint 22

multi-model endpoint 23

advanced techniques, model deployment options

about 232

blue/green deployment patterns, using 236, 237

endpoints, autoscaling 232

algorithm hyperparameters

selecting 12

Allreduce coordination pattern

about 112

versus Parameter Server coordination pattern 112, 113

Amazon API Gateway 27

Amazon CloudTrail 28

Amazon CloudWatch 28

using 237, 238

Amazon EBS

high-performance block storage 65

Amazon EC2 Spot Instances 9

Amazon Elastic Container Registry (ECR) 35...