Book Image

MLOps with Red Hat OpenShift

By : Ross Brigoli, Faisal Masood
Book Image

MLOps with Red Hat OpenShift

By: Ross Brigoli, Faisal Masood

Overview of this book

MLOps with OpenShift offers practical insights for implementing MLOps workflows on the dynamic OpenShift platform. As organizations worldwide seek to harness the power of machine learning operations, this book lays the foundation for your MLOps success. Starting with an exploration of key MLOps concepts, including data preparation, model training, and deployment, you’ll prepare to unleash OpenShift capabilities, kicking off with a primer on containers, pods, operators, and more. With the groundwork in place, you’ll be guided to MLOps workflows, uncovering the applications of popular machine learning frameworks for training and testing models on the platform. As you advance through the chapters, you’ll focus on the open-source data science and machine learning platform, Red Hat OpenShift Data Science, and its partner components, such as Pachyderm and Intel OpenVino, to understand their role in building and managing data pipelines, as well as deploying and monitoring machine learning models. Armed with this comprehensive knowledge, you’ll be able to implement MLOps workflows on the OpenShift platform proficiently.
Table of Contents (13 chapters)
Free Chapter
1
Part 1: Introduction
3
Part 2: Provisioning and Configuration
6
Part 3: Operating ML Workloads

Enabling GPU support

First, you need to start provisioning nodes with a GPU. Like MinIO, this is a one-time activity that will be executed by the platform engineering team. The entire process of enabling the GPU can be automated for your OpenShift clusters. Let’s learn how to provision the machines with a GPU in our cluster.

OpenShift enables you to use machine sets to provision nodes – nodes where your container images would run. To enable GPU support for the Jupyter environment that you created earlier, you need to provision nodes with a GPU. Once the nodes with the GPU have been provisioned, RHODS will automatically detect them and allow you to use the Jupyter environment with GPU support.

For the ROSA cluster, you can use the Red Hat cloud console to provision new machines. OpenShift can scale out machines so that it provisions the hardware as needed. You can also choose to use the machine on spot instances to further reduce your bill. Let’s see how to...