Book Image

Practical Deep Learning at Scale with MLflow

By : Yong Liu
5 (1)
Book Image

Practical Deep Learning at Scale with MLflow

5 (1)
By: Yong Liu

Overview of this book

The book starts with an overview of the deep learning (DL) life cycle and the emerging Machine Learning Ops (MLOps) field, providing a clear picture of the four pillars of deep learning: data, model, code, and explainability and the role of MLflow in these areas. From there onward, it guides you step by step in understanding the concept of MLflow experiments and usage patterns, using MLflow as a unified framework to track DL data, code and pipelines, models, parameters, and metrics at scale. You’ll also tackle running DL pipelines in a distributed execution environment with reproducibility and provenance tracking, and tuning DL models through hyperparameter optimization (HPO) with Ray Tune, Optuna, and HyperBand. As you progress, you’ll learn how to build a multi-step DL inference pipeline with preprocessing and postprocessing steps, deploy a DL inference pipeline for production using Ray Serve and AWS SageMaker, and finally create a DL explanation as a service (EaaS) using the popular Shapley Additive Explanations (SHAP) toolbox. By the end of this book, you’ll have built the foundation and gained the hands-on experience you need to develop a DL pipeline solution from initial offline experimentation to final deployment and production, all within a reproducible and open source framework.

Related Content you might be interested in

Current Title:

Small book image
Practical Deep Learning at Scale with MLflow
Yong Liu
Jul, 2022 | 288 pages
Small book image
Machine Learning Engineering with MLflow.
Natu Lauchande
Aug, 2021 | 248 pages
Small book image
Practical Machine Learning on Databricks
Debu Sinha
Nov, 2023 | 244 pages
Small book image
Distributed Data Systems with Azure Databricks
Alan Bernardo Palacio
May, 2021 | 414 pages
Table of Contents (17 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Download the example code files
Download the color images
Conventions used
Get in touch
Share Your Thoughts
1
Section 1 - Deep Learning Challenges and MLflow Prime
Section 1 - Deep Learning Challenges and MLflow Prime
Free Chapter
2
Chapter 1: Deep Learning Life Cycle and MLOps Challenges
Chapter 1: Deep Learning Life Cycle and MLOps Challenges
Technical requirements
Understanding the DL life cycle and MLOps challenges
Understanding DL data challenges
Understanding DL model challenges
Understanding DL code challenges
Understanding DL explainability challenges
Summary
Further reading
3
Chapter 2: Getting Started with MLflow for Deep Learning
Chapter 2: Getting Started with MLflow for Deep Learning
Technical requirements
Setting up MLflow
Implementing our first DL experiment with MLflow autologging
Exploring MLflow's components and usage patterns
Summary
Further reading
4
Section 2 –
Tracking a Deep Learning Pipeline at Scale
Section 2 –
Tracking a Deep Learning Pipeline at Scale
5
Chapter 3: Tracking Models, Parameters, and Metrics
Chapter 3: Tracking Models, Parameters, and Metrics
Technical requirements
Setting up a full-fledged local MLflow tracking server
Tracking model provenance
Tracking model metrics
Tracking model parameters
Summary
Further reading
6
Chapter 4: Tracking Code and Data Versioning
Chapter 4: Tracking Code and Data Versioning
Technical requirements
Tracking notebook and pipeline versioning
Tracking locally, privately built Python libraries
Tracking data versioning in Delta Lake
Summary
Further reading
7
Section 3 –
Running Deep Learning Pipelines at Scale
Section 3 –
Running Deep Learning Pipelines at Scale
8
Chapter 5: Running DL Pipelines in Different Environments
Chapter 5: Running DL Pipelines in Different Environments
Technical requirements
An overview of different execution scenarios and environments
Running locally with local code
Running remote code in GitHub locally
Running local code remotely in the cloud
Running remotely in the cloud with remote code in GitHub
Summary
Further reading
9
Chapter 6: Running Hyperparameter Tuning at Scale
Chapter 6: Running Hyperparameter Tuning at Scale
Technical requirements
Understanding automatic HPO for DL pipelines
Creating HPO-ready DL models with Ray Tune and MLflow
Running the first Ray Tune HPO experiment with MLflow
Running HPO with Ray Tune using Optuna and HyperBand
Summary
Further reading
10
Section 4 –
Deploying a Deep Learning Pipeline at Scale
Section 4 –
Deploying a Deep Learning Pipeline at Scale
11
Chapter 7: Multi-Step Deep Learning Inference Pipeline
Chapter 7: Multi-Step Deep Learning Inference Pipeline
Technical requirements
Understanding patterns of DL inference pipelines
Implementing a custom MLflow Python model
Implementing preprocessing and postprocessing steps in a DL inference pipeline
Implementing an inference pipeline as a new entry point in the main MLproject
Summary
Further reading
12
Chapter 8: Deploying a DL Inference Pipeline at Scale
Chapter 8: Deploying a DL Inference Pipeline at Scale
Technical requirements
Understanding different deployment tools and host environments
Deploying locally for batch and web service inference
Deploying using Ray Serve and MLflow deployment plugins
Deploying to AWS SageMaker – a complete end-to-end guide
Summary
Further reading
13
Section 5 – Deep Learning Model Explainability at Scale
Section 5 – Deep Learning Model Explainability at Scale
14
Chapter 9: Fundamentals of Deep Learning Explainability
Chapter 9: Fundamentals of Deep Learning Explainability
Technical requirements
Understanding the categories and audience of explainability
Exploring the SHAP Explainability toolbox
Exploring the Transformers Interpret toolbox
Summary
Further reading
15
Chapter 10: Implementing DL Explainability with MLflow
Chapter 10: Implementing DL Explainability with MLflow
Technical requirements
Understanding current MLflow explainability integration
Implementing a SHAP explanation using the MLflow artifact logging API
Implementing a SHAP explainer using the MLflow pyfunc API
Summary
Further reading
Why subscribe?
16
Other Books You May Enjoy
Other Books You May Enjoy
Packt is searching for authors like you
Share Your Thoughts

To get the most out of this book

The majority of the code in this book can be implemented and executed using the open source MLflow tool, with a few exceptions where a 14-day full Databricks trial is needed (sign up at https://databricks.com/try-databricks) along with an AWS Free Tier account (sign up at https://aws.amazon.com/free/). The following lists some major software packages covered in this book:

  • MLflow 1.20.2 and above
  • Python 3.8.10
  • Lightning-flash 0.5.0
  • Transformers 4.9.2
  • SHAP 0.40.0
  • PySpark 3.2.1
  • Ray[tune] 1.9.2
  • Optuna 2.10.0

The complete package dependencies are listed in each chapter's requirements.txt file or the conda.yaml file in this book's GitHub repository. All code has been tested to run successfully in a macOS or Linux environment. If you are a Microsoft Windows user, it is recommended to install WSL2 to run the bash scripts provided in this book: https://www.windowscentral.com/how-install-wsl2-windows-10. It is a known issue that the MLflow CLI does not work properly in the Microsoft Windows command line.

Starting from Chapter 3, Tracking Models, Parameters, and Metrics of this book, you will also need to have Docker Desktop (https://www.docker.com/products/docker-desktop/) installed to set up a fully-fledged local MLflow tracking server for executing the code in this book. AWS SageMaker is needed in Chapter 8, Deploying a DL Inference Pipeline at Scale, for the cloud deployment example. VS Code version 1.60 or above (https://code.visualstudio.com/updates/v1_60) is used as the integrated development environment (IDE) in this book. Miniconda version 4.10.3 or above (https://docs.conda.io/en/latest/miniconda.html) is used throughout this book for creating and activating virtual environments.

If you are using the digital version of this book, we advise you to type the code yourself or access the code from the book's GitHub repository (a link is available in the next section). Doing so will help you avoid any potential errors related to the copying and pasting of code.

Finally, to get the most out of this book, you should have experience in programming in Python and have a basic understanding of popular ML and data manipulation libraries such as pandas and PySpark.

Previous Section
Next Section