Book Image

MLOps with Red Hat OpenShift

By : Ross Brigoli, Faisal Masood
Book Image

MLOps with Red Hat OpenShift

By: Ross Brigoli, Faisal Masood

Overview of this book

MLOps with OpenShift offers practical insights for implementing MLOps workflows on the dynamic OpenShift platform. As organizations worldwide seek to harness the power of machine learning operations, this book lays the foundation for your MLOps success. Starting with an exploration of key MLOps concepts, including data preparation, model training, and deployment, you’ll prepare to unleash OpenShift capabilities, kicking off with a primer on containers, pods, operators, and more. With the groundwork in place, you’ll be guided to MLOps workflows, uncovering the applications of popular machine learning frameworks for training and testing models on the platform. As you advance through the chapters, you’ll focus on the open-source data science and machine learning platform, Red Hat OpenShift Data Science, and its partner components, such as Pachyderm and Intel OpenVino, to understand their role in building and managing data pipelines, as well as deploying and monitoring machine learning models. Armed with this comprehensive knowledge, you’ll be able to implement MLOps workflows on the OpenShift platform proficiently.
Table of Contents (13 chapters)
Free Chapter
1
Part 1: Introduction
3
Part 2: Provisioning and Configuration
6
Part 3: Operating ML Workloads

Building and deploying the inferencing application

Before we dive deep into the inferencing application, let’s understand the application components. Our aim is to collect information from a camera, such as the video camera on your laptop, and then send it to the application, where the application will make a call to your model and see whether a face has been detected.

The video-capturing application (we call it the frontend) will capture the video and send every tenth frame as an array of 256-by-256 image to the server via HTTP. The server (or the backend application) will receive the frame or image and make an inference call to the model. The backend service will also keep a Redis-based counter, and when a face is detected, the application will increment the face counter in the Redis database. The backend service will also expose another HTTP service to read the value of the counter, which will then be displayed in the frontend service. Conceptually, it looks as in the...