Book Image

Azure Machine Learning Engineering

By : Sina Fakhraee, Balamurugan Balakreshnan, Megan Masanz
Book Image

Azure Machine Learning Engineering

By: Sina Fakhraee, Balamurugan Balakreshnan, Megan Masanz

Overview of this book

Data scientists working on productionizing machine learning (ML) workloads face a breadth of challenges at every step owing to the countless factors involved in getting ML models deployed and running. This book offers solutions to common issues, detailed explanations of essential concepts, and step-by-step instructions to productionize ML workloads using the Azure Machine Learning service. You’ll see how data scientists and ML engineers working with Microsoft Azure can train and deploy ML models at scale by putting their knowledge to work with this practical guide. Throughout the book, you’ll learn how to train, register, and productionize ML models by making use of the power of the Azure Machine Learning service. You’ll get to grips with scoring models in real time and batch, explaining models to earn business trust, mitigating model bias, and developing solutions using an MLOps framework. By the end of this Azure Machine Learning book, you’ll be ready to build and deploy end-to-end ML solutions into a production system using the Azure Machine Learning service for real-time scenarios.
Table of Contents (17 chapters)
1
Part 1: Training and Tuning Models with the Azure Machine Learning Service
7
Part 2: Deploying and Explaining Models in AMLS
12
Part 3: Productionizing Your Workload with MLOps

Model parallelism

Model parallelism is another way to scale the model training in deep learning modeling. Model parallelism is heavily compute-based and, in most cases, GPU-based computing is needed to get better performance and time. Let’s look at some distributed training libraries available for us to use in the Azure Machine Learning service.

In Azure Machine Learning, we can perform distributed learning in various ways:

  • Distributed training with PyTorch: PyTorch is one of the most well-known and widely used machine learning libraries for large-scale vision, text, and other unstructured data machine learning. It uses deep learning, such as convolutional neural network or recurrent neural network-based development. PyTorch is a deep learning framework developed by Meta (Facebook).

PyTorch implementations are very simple and easy to use and tend to eliminate the complications of other libraries in the marketplace.

  • Distributed training with TensorFlow...