Book Image

Applied Machine Learning and High-Performance Computing on AWS

By : Mani Khanuja, Farooq Sabir, Shreyas Subramanian, Trenton Potgieter
Book Image

Applied Machine Learning and High-Performance Computing on AWS

By: Mani Khanuja, Farooq Sabir, Shreyas Subramanian, Trenton Potgieter

Overview of this book

Machine learning (ML) and high-performance computing (HPC) on AWS run compute-intensive workloads across industries and emerging applications. Its use cases can be linked to various verticals, such as computational fluid dynamics (CFD), genomics, and autonomous vehicles. This book provides end-to-end guidance, starting with HPC concepts for storage and networking. It then progresses to working examples on how to process large datasets using SageMaker Studio and EMR. Next, you’ll learn how to build, train, and deploy large models using distributed training. Later chapters also guide you through deploying models to edge devices using SageMaker and IoT Greengrass, and performance optimization of ML models, for low latency use cases. By the end of this book, you’ll be able to build, train, and deploy your own large-scale ML application, using HPC on AWS, following industry best practices and addressing the key pain points encountered in the application life cycle.
Table of Contents (20 chapters)
1
Part 1: Introducing High-Performance Computing
6
Part 2: Applied Modeling
13
Part 3: Driving Innovation Across Industries

Index

As this ebook edition doesn't have fixed pagination, the page numbers below are hyperlinked for reference only, based on the printed edition of this book.

A

accelerated compute instances 40

activation checkpointing 280

activation offloading 280

activations 280

Advanced RISC Machine (ARM) 39

AllReduce algorithm 134

AllReduce optimization algorithm 135

Amazon Athena 58

reference link 100

reviewing 100

Amazon CloudWatch 212

Amazon Direct Connect 292

Amazon EC2, instances

accelerated compute instances 40

compute optimized instances 40

general purpose instances 39

memory optimized instances 43, 44

storage optimized instances 44

types 38

Amazon ECR 55

Amazon EFS One Zone Access classes 90

Amazon EFS One Zone-Infrequent Access classes 90

Amazon EFS Standard Access classes 90

Amazon EFS Standard-Infrequent Access classes 90

Amazon EFS storage classes 90

Amazon EFS One Zone Access...