Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Machine Learning Engineering on AWS
  • Table Of Contents Toc
Machine Learning Engineering on AWS

Machine Learning Engineering on AWS - Second Edition

By : Joshua Arvin Lat
4 (1)
close
close
Machine Learning Engineering on AWS

Machine Learning Engineering on AWS

4 (1)
By: Joshua Arvin Lat

Overview of this book

Modern AI systems increasingly leverage large language models, retrieval-augmented generation, and AI agents to power generative AI applications in the cloud. As organizations operationalize these systems at scale, there is a growing need for engineers with strong machine learning engineering expertise. To stay ahead in this rapidly evolving field, you need a deep understanding of AI and ML concepts as well as, practical, hands-on experience with the platforms and tools used to build and operate production-grade AI systems. Machine Learning Engineering on AWS is a practical guide that shows you how to use AWS services such as Amazon Bedrock and Amazon SageMaker AI to fine-tune, evaluate, and deploy LLMs and generative AI systems. You'll learn how to develop RAG-powered systems, build and deploy AI agents using Bedrock AgentCore and Strands Agents, evaluate models using LLM-as-a-judge techniques, and automate LLMOps pipelines using SageMaker Pipelines. The book also covers best practices for building scalable, secure, and production-ready GenAI systems. AWS AI hero Joshua Arvin Lat equips you with the skills and practical knowledge to handle a wide variety of ML engineering requirements, helping you design, operationalize, and secure generative AI systems and AI agents on AWS with confidence. *Email sign-up and proof of purchase required"
Table of Contents (12 chapters)
close
close
10
Other Books You May Enjoy
11
Index

Summary

In this chapter, we explored different options and strategies for deploying models in SageMaker AI. You worked with a pretrained model and deployed it using a real-time endpoint, a serverless endpoint, an asynchronous inference endpoint, and a batch transform job. You also practiced advanced techniques like shadow testing to validate a new model without affecting live traffic, and canary traffic shifting to gradually route a portion of production requests to a new model. Along the way, you learned how to configure data capture to record inference requests and responses for monitoring and evaluation.

In the next chapter, you'll dive into building end-to-end ML pipelines and applying MLOps principles to automate workflows, track model performance, and keep your ML systems running smoothly. You'll also explore other relevant ML Engineering topics, including integrating security best practices and managing costs, giving you a well-rounded view of designing, deploying, and...

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Machine Learning Engineering on AWS
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon