Book Image

Machine Learning with Amazon SageMaker Cookbook

By : Joshua Arvin Lat
Book Image

Machine Learning with Amazon SageMaker Cookbook

By: Joshua Arvin Lat

Overview of this book

Amazon SageMaker is a fully managed machine learning (ML) service that helps data scientists and ML practitioners manage ML experiments. In this book, you'll use the different capabilities and features of Amazon SageMaker to solve relevant data science and ML problems. This step-by-step guide features 80 proven recipes designed to give you the hands-on machine learning experience needed to contribute to real-world experiments and projects. You'll cover the algorithms and techniques that are commonly used when training and deploying NLP, time series forecasting, and computer vision models to solve ML problems. You'll explore various solutions for working with deep learning libraries and frameworks such as TensorFlow, PyTorch, and Hugging Face Transformers in Amazon SageMaker. You'll also learn how to use SageMaker Clarify, SageMaker Model Monitor, SageMaker Debugger, and SageMaker Experiments to debug, manage, and monitor multiple ML experiments and deployments. Moreover, you'll have a better understanding of how SageMaker Feature Store, Autopilot, and Pipelines can meet the specific needs of data science teams. By the end of this book, you'll be able to combine the different solutions you've learned as building blocks to solve real-world ML problems.
Table of Contents (11 chapters)

Generating a synthetic dataset for deep learning experiments

Synthetic data generation is the process of programmatically generating artificial data with the purpose of helping data scientists and machine learning engineers test different algorithms and perform machine learning experiments without using real collected data. As we will work with neural networks and deep learning frameworks, we will need an acceptably large dataset. The dataset we have in Chapter 1, Getting Started with Machine Learning Using Amazon SageMaker, has only 20 records and will definitely not be a good fit for the recipes in this chapter. In this recipe, we will generate training, validation, and test dummy data using a custom synthetic data generator and store these datasets in Amazon S3.

Important note

Why generate and use synthetic datasets? Working with synthetic datasets will allow us to focus more on the tasks that we are working on as we can simply generate a bare-minimum synthetic dataset to...