Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Machine Learning Engineering on AWS
  • Table Of Contents Toc
Machine Learning Engineering on AWS

Machine Learning Engineering on AWS - Second Edition

By : Joshua Arvin Lat
4 (1)
close
close
Machine Learning Engineering on AWS

Machine Learning Engineering on AWS

4 (1)
By: Joshua Arvin Lat

Overview of this book

Modern AI systems increasingly leverage large language models, retrieval-augmented generation, and AI agents to power generative AI applications in the cloud. As organizations operationalize these systems at scale, there is a growing need for engineers with strong machine learning engineering expertise. To stay ahead in this rapidly evolving field, you need a deep understanding of AI and ML concepts as well as, practical, hands-on experience with the platforms and tools used to build and operate production-grade AI systems. Machine Learning Engineering on AWS is a practical guide that shows you how to use AWS services such as Amazon Bedrock and Amazon SageMaker AI to fine-tune, evaluate, and deploy LLMs and generative AI systems. You'll learn how to develop RAG-powered systems, build and deploy AI agents using Bedrock AgentCore and Strands Agents, evaluate models using LLM-as-a-judge techniques, and automate LLMOps pipelines using SageMaker Pipelines. The book also covers best practices for building scalable, secure, and production-ready GenAI systems. AWS AI hero Joshua Arvin Lat equips you with the skills and practical knowledge to handle a wide variety of ML engineering requirements, helping you design, operationalize, and secure generative AI systems and AI agents on AWS with confidence. *Email sign-up and proof of purchase required"
Table of Contents (12 chapters)
close
close
10
Other Books You May Enjoy
11
Index

Running batch inference with batch transform

In the previous two sections, you explored real-time and serverless inference endpoints for handling individual requests or unpredictable traffic patterns. In this section, you'll use batch transform to perform inference on large datasets without deploying a real-time endpoint, making it ideal for asynchronous or bulk data processing. When running batch inference with batch transform, SageMaker AI launches a managed ML instance, loads the specified model and input data, performs inference, writes the results to S3, and then terminates the instance automatically, providing a fully managed, scalable workflow similar to SageMaker Processing.

In this section, you'll continue using the deployment_options.ipynb notebook. The upcoming steps and code will all be run in this notebook.

Let's walk through the steps to run batch inference using batch transform:

  1. Use the download_file() function to download the CSV file containing the data...
CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Machine Learning Engineering on AWS
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon