Book Image

Time Series Analysis on AWS

By : Michaël Hoarau
Book Image

Time Series Analysis on AWS

By: Michaël Hoarau

Overview of this book

Being a business analyst and data scientist, you have to use many algorithms and approaches to prepare, process, and build ML-based applications by leveraging time series data, but you face common problems, such as not knowing which algorithm to choose or how to combine and interpret them. Amazon Web Services (AWS) provides numerous services to help you build applications fueled by artificial intelligence (AI) capabilities. This book helps you get to grips with three AWS AI/ML-managed services to enable you to deliver your desired business outcomes. The book begins with Amazon Forecast, where you’ll discover how to use time series forecasting, leveraging sophisticated statistical and machine learning algorithms to deliver business outcomes accurately. You’ll then learn to use Amazon Lookout for Equipment to build multivariate time series anomaly detection models geared toward industrial equipment and understand how it provides valuable insights to reinforce teams focused on predictive maintenance and predictive quality use cases. In the last chapters, you’ll explore Amazon Lookout for Metrics, and automatically detect and diagnose outliers in your business and operational data. By the end of this AWS book, you’ll have understood how to use the three AWS AI services effectively to perform time series analysis.
Table of Contents (20 chapters)
1
Section 1: Analyzing Time Series and Delivering Highly Accurate Forecasts with Amazon Forecast
9
Section 2: Detecting Abnormal Behavior in Multivariate Time Series with Amazon Lookout for Equipment
15
Section 3: Detecting Anomalies in Business Metrics with Amazon Lookout for Metrics

What this book covers

Chapter 1, An Overview of Time Series Analysis, will establish how time series data is different from regular tabular data and will hint at why we need different approaches to process them. You will also learn about the different types of time series you may encounter and gain an understanding of the kind of predictive power your time series data contains.

Chapter 2, An Overview of Amazon Forecast, will teach you about what Amazon Forecast is designed for, how it works, and the kinds of situations it is suited for. By the end of the chapter, you will also have a good command of the underlying concepts of Amazon Forecast, such as dataset groups, datasets, predictors, and forecasts.

Chapter 3, Creating a Project and Ingesting Your Data, will describe how to create and organize multiple datasets within the dataset group construct, how to configure datasets, and how to ingest CSV data. You will also gain a high-level understanding of all the heavy lifting Amazon Forecast performs on your behalf to save as much data preparation effort as possible.

Chapter 4, Training a Predictor with AutoML, will use the datasets prepared and ingested previously to train a forecasting model. You will learn how to configure training and discover what impact each feature can have on the training duration and outputs. The evaluation dashboard will be described in depth.

Chapter 5, Customizing Your Predictor Training, will go deeper into the different possible configurations that Amazon Forecast has to offer, after you have trained your first predictor using the automated features provided by AWS. From choosing the right algorithm for a given problem to leveraging supplementary features such as weather data, you will learn how you can increase the accuracy of your forecasts while optimizing your training time.

Chapter 6, Generating New Forecasts, will help you generate new forecasts and get new insights to support your daily business decisions, by leveraging the predictors you trained previously. This chapter will help you actually generate forecasts, download the results, and visualize them using your favorite spreadsheet software.

Chapter 7, Improving and Scaling Your Forecast Strategy, will help you get the most from Amazon Forecast. This chapter will point you in the right direction to monitor your models and compare predictions to real-life data, a crucial task to detect any drift in performance, which could trigger retraining. Last but not least, you will also leverage a sample from the AWS Solutions Library to automate your predictor training, forecast generation, and dashboard visualization.

Chapter 8, An Overview of Amazon Lookout for Equipment, will describe what Amazon Lookout for Equipment can do, how it works, and the kind of applications it's suited for. You will understand at a high level how to prepare your dataset and how you can integrate service results into your business processes.

Chapter 9, Creating a Dataset and Ingesting Your Data, will teach you how to create and organize multiple datasets and how to perform dataset ingestion. You will also gain a high-level understanding of all the heavy lifting AWS performs on your behalf to save as much data preparation effort as possible (in terms of imputation, time series alignment, resampling, and so on).

Chapter 10, Training and Evaluating a Model, will have you use the datasets prepared and ingested previously to train a multivariate anomaly detection model. You will learn about how to configure training and what impact each feature can have on the training output and the training duration. The evaluation and diagnostics dashboard will be described in depth to help you get a good view of the quality of the output.

Chapter 11, Scheduling Regular Inferences, will show you how to configure and run an inference scheduler that will run your data against your trained model. In this chapter, you will learn how to manage such schedulers and how to use the predictions obtained.

Chapter 12, Reducing Time to Insights for Anomaly Detections, will help you improve your model performance and go further in results post-processing. This chapter will also point you in the right direction when it comes to monitoring your models and detecting any drift, which would trigger either retraining or further investigation.

Chapter 13, An Overview of Amazon Lookout for Metrics, will explain what Amazon Lookout for Metrics is designed for, how it works, and the kind of situations it is suited for. By the end of this chapter, you will also have a good command of the underlying concepts of Amazon Lookout for Metrics (datasources, datasets, detectors, alerts, and anomalies).

Chapter 14, Creating and Activating a Detector, will describe the process of creating and activating a detector. You will also learn about the different integration paths that are available to connect Amazon Lookout for Metrics to various data sources and alerts.

Chapter 15, Viewing Anomalies and Providing Feedback, starts with a trained detector and shows you how to dive into detected anomalies and review them, as well as covering other key concepts, such as severity thresholds, how to leverage the impact analysis dashboard to perform root cause analysis, and how to provide feedback to the service.