Book Image

Machine Learning Engineering with Python - Second Edition

By : Andrew P. McMahon
1 (1)
Book Image

Machine Learning Engineering with Python - Second Edition

1 (1)
By: Andrew P. McMahon

Overview of this book

The Second Edition of Machine Learning Engineering with Python is the practical guide that MLOps and ML engineers need to build solutions to real-world problems. It will provide you with the skills you need to stay ahead in this rapidly evolving field. The book takes an examples-based approach to help you develop your skills and covers the technical concepts, implementation patterns, and development methodologies you need. You'll explore the key steps of the ML development lifecycle and create your own standardized "model factory" for training and retraining of models. You'll learn to employ concepts like CI/CD and how to detect different types of drift. Get hands-on with the latest in deployment architectures and discover methods for scaling up your solutions. This edition goes deeper in all aspects of ML engineering and MLOps, with emphasis on the latest open-source and cloud-based technologies. This includes a completely revamped approach to advanced pipelining and orchestration techniques. With a new chapter on deep learning, generative AI, and LLMOps, you will learn to use tools like LangChain, PyTorch, and Hugging Face to leverage LLMs for supercharged analysis. You will explore AI assistants like GitHub Copilot to become more productive, then dive deep into the engineering considerations of working with deep learning.

Related Content you might be interested in

Small book image
Machine Learning Engineering w...
Natu Lauchande
Aug, 2021 | 248 pages
Small book image
Pretrain Vision and Large Lang...
Emily Webber
May, 2023 | 258 pages
Small book image
Machine Learning with LightGBM...
Andrich van Wyk
Sep, 2023 | 252 pages
Table of Contents (12 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
1
Introduction to ML Engineering
Introduction to ML Engineering
Technical requirements
Defining a taxonomy of data disciplines
Working as an effective team
ML engineering in the real world
What does an ML solution look like?
High-level ML system design
Summary
Free Chapter
2
The Machine Learning Development Process
The Machine Learning Development Process
Technical requirements
Setting up our tools
Concept to solution in four steps
Summary
3
From Model to Model Factory
From Model to Model Factory
Technical requirements
Defining the model factory
Learning about learning
Engineering features for machine learning
Designing your training system
Retraining required
Persisting your models
Building the model factory with pipelines
Summary
4
Packaging Up
Packaging Up
Technical requirements
Writing good Python
Choosing a style
Packaging your code
Building your package
Testing, logging, securing, and error handling
Not reinventing the wheel
Summary
5
Deployment Patterns and Tools
Deployment Patterns and Tools
Technical requirements
Architecting systems
Exploring some standard ML patterns
Containerizing
Hosting your own microservice on AWS
Building general pipelines with Airflow
Building advanced ML pipelines
Selecting your deployment strategy
Summary
6
Scaling Up
Scaling Up
Technical requirements
Scaling with Spark
Spinning up serverless infrastructure
Containerizing at scale with Kubernetes
Scaling with Ray
Designing systems at scale
Summary
7
Deep Learning, Generative AI, and LLMOps
Deep Learning, Generative AI, and LLMOps
Going deep with deep learning
Living it large with LLMs
Building the future with LLMOps
Summary
8
Building an Example ML Microservice
Building an Example ML Microservice
Technical requirements
Understanding the forecasting problem
Designing our forecasting service
Selecting the tools
Training at scale
Serving the models with FastAPI
Containerizing and deploying to Kubernetes
Summary
9
Building an Extract, Transform, Machine Learning Use Case
Building an Extract, Transform, Machine Learning Use Case
Technical requirements
Understanding the batch processing problem
Designing an ETML solution
Selecting the tools
Executing the build
Summary
10
Other Books You May Enjoy
Other Books You May Enjoy
11
Index
Index

Technical requirements

As in Chapter 1, Introduction to ML Engineering if you want to run the examples provided here, you can create a Conda environment using the environment YAML file provided in the Chapter02 folder of the book’s GitHub repository:

conda env create –f mlewp-chapter02.yml

On top of this, many of the examples in this chapter will require the use of the following software and packages. These will also stand you in good stead for following the examples in the rest of the book:

  • Anaconda
  • PyCharm Community Edition, VS Code, or another Python-compatible IDE
  • Git

You will also need the following:

  • An Atlassian Jira account. We will discuss this more later in the chapter, but you can sign up for one for free at https://www.atlassian.com/software/jira/free.
  • An AWS account. This will also be covered in the chapter, but you can sign up for an account at https://aws.amazon.com/. You will need to add payment details to sign up for AWS, but everything we do in this book will only require the free tier solutions.

The technical steps in this chapter were all tested on both a Linux machine running Ubuntu 22.04 LTS with a user profile that had admin rights and on a Macbook Pro M2 with the setup described in Chapter 1, Introduction to ML Engineering. If you are running the steps on a different system, then you may have to consult the documentation for that specific tool if the steps do not work as planned. Even if this is the case, most of the steps will be the same, or very similar, for most systems. You can also check out all of the code for this chapter in the book’s repository at https://github.com/PacktPublishing/Machine-Learning-Engineering-with-Python-Second-Edition/tree/main/Chapter02. The repo will also contain further resources for getting the code examples up and running.

Previous Section
End of Section 2
Next Section