Book Image

Machine Learning Engineering with Python

By : Andrew P. McMahon
Book Image

Machine Learning Engineering with Python

By: Andrew P. McMahon

Overview of this book

Machine learning engineering is a thriving discipline at the interface of software development and machine learning. This book will help developers working with machine learning and Python to put their knowledge to work and create high-quality machine learning products and services. Machine Learning Engineering with Python takes a hands-on approach to help you get to grips with essential technical concepts, implementation patterns, and development methodologies to have you up and running in no time. You'll begin by understanding key steps of the machine learning development life cycle before moving on to practical illustrations and getting to grips with building and deploying robust machine learning solutions. As you advance, you'll explore how to create your own toolsets for training and deployment across all your projects in a consistent way. The book will also help you get hands-on with deployment architectures and discover methods for scaling up your solutions while building a solid understanding of how to use cloud-based tools effectively. Finally, you'll work through examples to help you solve typical business problems. By the end of this book, you'll be able to build end-to-end machine learning services using a variety of techniques and design your own processes for consistently performant machine learning engineering.

Related Content you might be interested in

Current Title:

Small book image
Machine Learning Engineering with Python
Andrew P. McMahon
Nov, 2021 | 276 pages
Small book image
Machine Learning Engineering with MLflow.
Natu Lauchande
Aug, 2021 | 248 pages
Small book image
Practical Machine Learning on Databricks
Debu Sinha
Nov, 2023 | 244 pages
Small book image
Automated Machine Learning on AWS
Trenton Potgieter
Apr, 2022 | 420 pages
Table of Contents (13 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Download the example code files
Download the color images
Conventions used
Get in touch
Share Your Thoughts
1
Section 1: What Is ML Engineering?
Section 1: What Is ML Engineering?
Free Chapter
2
Chapter 1: Introduction to ML Engineering
Chapter 1: Introduction to ML Engineering
Technical requirements
Defining a taxonomy of data disciplines
Assembling your team
ML engineering in the real world
What does an ML solution look like?
High-level ML system design
Summary
3
Chapter 2: The Machine Learning Development Process
Chapter 2: The Machine Learning Development Process
Technical requirements
Setting up our tools
Concept to solution in four steps
Summary
4
Section 2: ML Development and Deployment
Section 2: ML Development and Deployment
5
Chapter 3: From Model to Model Factory
Chapter 3: From Model to Model Factory
Technical requirements
Defining the model factory
Designing your training system
Retraining required
Learning about learning
Persisting your models
Building the model factory with pipelines
Summary
6
Chapter 4: Packaging Up
Chapter 4: Packaging Up
Technical requirements
Writing good Python
Choosing a style
Packaging your code
Building your package
Testing, logging, and error handling
Not reinventing the wheel
Summary
7
Chapter 5: Deployment Patterns and Tools
Chapter 5: Deployment Patterns and Tools
Technical requirements
Architecting systems
Exploring the unreasonable effectiveness of patterns
Containerizing
Hosting your own microservice on AWS
Pipelining 2.0
Summary
8
Chapter 6: Scaling Up
Chapter 6: Scaling Up
Technical requirements
Scaling with Spark
Spinning up serverless infrastructure
Containerizing at scale with Kubernetes
Summary
9
Section 3: End-to-End Examples
Section 3: End-to-End Examples
10
Chapter 7: Building an Example ML Microservice
Chapter 7: Building an Example ML Microservice
Technical requirements
Understanding the forecasting problem
Designing our forecasting service
Selecting the tools
Executing the build
Summary
11
Chapter 8: Building an Extract Transform Machine Learning Use Case
Chapter 8: Building an Extract Transform Machine Learning Use Case
Technical requirements
Understanding the batch processing problem
Designing an ETML solution
Selecting the tools
Executing the build
Why subscribe?
12
Other Books You May Enjoy
Other Books You May Enjoy
Packt is searching for authors like you
Share Your Thoughts

Learning about learning

At their heart, ML algorithms all contain one key feature: an optimization of some kind. The fact that these algorithms learn (meaning that they iteratively improve their performance concerning an appropriate metric upon exposure to more observations) is what makes them so powerful and exciting. This process of learning is what we refer to when we say training.

In this section, we will cover the key concepts underpinning training, the options we can select in our code, and what these mean for the potential performance and capabilities of our training system.

Defining the target

We have just stated that training is an optimization, but what exactly are we optimizing? Let's consider supervised learning. In training, we provide the labels or values that we would want to predict for the given feature so that the algorithms can learn the relationship between the features and the target. To optimize the internal parameters of the algorithm during training...

Previous Section
End of Section 6
Next Section