Book Image

MLOps with Red Hat OpenShift

By : Ross Brigoli, Faisal Masood
Book Image

MLOps with Red Hat OpenShift

By: Ross Brigoli, Faisal Masood

Overview of this book

MLOps with OpenShift offers practical insights for implementing MLOps workflows on the dynamic OpenShift platform. As organizations worldwide seek to harness the power of machine learning operations, this book lays the foundation for your MLOps success. Starting with an exploration of key MLOps concepts, including data preparation, model training, and deployment, you’ll prepare to unleash OpenShift capabilities, kicking off with a primer on containers, pods, operators, and more. With the groundwork in place, you’ll be guided to MLOps workflows, uncovering the applications of popular machine learning frameworks for training and testing models on the platform. As you advance through the chapters, you’ll focus on the open-source data science and machine learning platform, Red Hat OpenShift Data Science, and its partner components, such as Pachyderm and Intel OpenVino, to understand their role in building and managing data pipelines, as well as deploying and monitoring machine learning models. Armed with this comprehensive knowledge, you’ll be able to implement MLOps workflows on the OpenShift platform proficiently.
Table of Contents (13 chapters)
Free Chapter
1
Part 1: Introduction
3
Part 2: Provisioning and Configuration
6
Part 3: Operating ML Workloads

Operating ML Workloads

In the previous chapter, you learned how to automate model deployments through OpenShift Data Science (ODS) pipelines. This chapter will focus on the operational tasks of MLOps. This includes monitoring and logging, using the in-built tools of Red Hat OpenShift Data Science. We will not cover the common OpenShift operation and administration tasks in this chapter as that is beyond the scope of this book. However, we will talk about some of the OpenShift concepts you need to know to understand the topics in this chapter.

The exercises in this chapter require a basic understanding of OpenShift and/or Kubernetes as well as basic knowledge of Prometheus time-series databases and Grafana visualization dashboards. The following topics will be covered in this chapter:

  • Monitoring ML models
  • Logging model inference
  • Cost optimization

The materials required for this chapter can be found in the GitHub repository of this book. The files that you will...