Book Image

Azure Machine Learning Engineering

By : Sina Fakhraee, Balamurugan Balakreshnan, Megan Masanz
Book Image

Azure Machine Learning Engineering

By: Sina Fakhraee, Balamurugan Balakreshnan, Megan Masanz

Overview of this book

Data scientists working on productionizing machine learning (ML) workloads face a breadth of challenges at every step owing to the countless factors involved in getting ML models deployed and running. This book offers solutions to common issues, detailed explanations of essential concepts, and step-by-step instructions to productionize ML workloads using the Azure Machine Learning service. You’ll see how data scientists and ML engineers working with Microsoft Azure can train and deploy ML models at scale by putting their knowledge to work with this practical guide. Throughout the book, you’ll learn how to train, register, and productionize ML models by making use of the power of the Azure Machine Learning service. You’ll get to grips with scoring models in real time and batch, explaining models to earn business trust, mitigating model bias, and developing solutions using an MLOps framework. By the end of this Azure Machine Learning book, you’ll be ready to build and deploy end-to-end ML solutions into a production system using the Azure Machine Learning service for real-time scenarios.
Table of Contents (17 chapters)
1
Part 1: Training and Tuning Models with the Azure Machine Learning Service
7
Part 2: Deploying and Explaining Models in AMLS
12
Part 3: Productionizing Your Workload with MLOps

Distributed training code

In this section, we will learn how to write code to perform distributed training using the PyTorch framework for vision-based deep learning algorithms. We will be using Python code to create the model and then train it with a compute cluster. All the code is available in this book’s GitHub repository for learning and execution purposes.

Creating a training job Python file to process

Follow these steps to create a dataset while leveraging the user interface:

  1. Go to https://ml.azure.com and select your workspace.
  2. Go to Compute and click Start to start the compute instance.
  3. Wait for the compute instance to start; then, click Jupyter to start coding.
  4. If you don’t have a compute cluster, please follow the instructions in the previous chapters to create a new one. A compute instance with a CPU is good for development; we will use GPU-based content for model training.
  5. If you don’t have enough quotas for your GPU,...