Book Image

MLOps with Red Hat OpenShift

By : Ross Brigoli, Faisal Masood
Book Image

MLOps with Red Hat OpenShift

By: Ross Brigoli, Faisal Masood

Overview of this book

MLOps with OpenShift offers practical insights for implementing MLOps workflows on the dynamic OpenShift platform. As organizations worldwide seek to harness the power of machine learning operations, this book lays the foundation for your MLOps success. Starting with an exploration of key MLOps concepts, including data preparation, model training, and deployment, you’ll prepare to unleash OpenShift capabilities, kicking off with a primer on containers, pods, operators, and more. With the groundwork in place, you’ll be guided to MLOps workflows, uncovering the applications of popular machine learning frameworks for training and testing models on the platform. As you advance through the chapters, you’ll focus on the open-source data science and machine learning platform, Red Hat OpenShift Data Science, and its partner components, such as Pachyderm and Intel OpenVino, to understand their role in building and managing data pipelines, as well as deploying and monitoring machine learning models. Armed with this comprehensive knowledge, you’ll be able to implement MLOps workflows on the OpenShift platform proficiently.
Table of Contents (13 chapters)
Free Chapter
1
Part 1: Introduction
3
Part 2: Provisioning and Configuration
6
Part 3: Operating ML Workloads

Installing and configuring Prometheus and Grafana

To get started with implementing monitoring, we need Prometheus and Grafana. The OpenShift Data Science operator comes with an in-built Prometheus cluster and the model-serving component of ODS is already exposing metrics information by default. This comes pre-installed and pre-configured in your OpenShift cluster when you install the ODS operator. For Grafana, we will install it from OperatorHub.

The following steps will guide you through the process of installing and configuring Prometheus and Grafana for your Red Hat OpenShift Data Science cluster:

  1. Verify that the Prometheus cluster is installed and is running on your cluster. In your OpenShift web console, navigate to Workloads | Pods.
  2. Select the redhat-ods-monitoring project. You should see that the Prometheus Pods have a Running status. If you do not see this, you may need to re-install the Red Hat OpenShift Data Science operator.
  3. Navigate to Networking | Routes...