Book Image

Infrastructure Monitoring with Amazon CloudWatch

By : Ewere Diagboya
Book Image

Infrastructure Monitoring with Amazon CloudWatch

By: Ewere Diagboya

Overview of this book

CloudWatch is Amazon’s monitoring and observability service, designed to help those in the IT industry who are interested in optimizing resource utilization, visualizing operational health, and eventually increasing infrastructure performance. This book helps IT administrators, DevOps engineers, network engineers, and solutions architects to make optimum use of this cloud service for effective infrastructure productivity. You’ll start with a brief introduction to monitoring and Amazon CloudWatch and its core functionalities. Next, you’ll get to grips with CloudWatch features and their usability. Once the book has helped you develop your foundational knowledge of CloudWatch, you’ll be able to build your practical skills in monitoring and alerting various Amazon Web Services, such as EC2, EBS, RDS, ECS, EKS, DynamoDB, AWS Lambda, and ELB, with the help of real-world use cases. As you progress, you'll also learn how to use CloudWatch to detect anomalous behavior, set alarms, visualize logs and metrics, define automated actions, and rapidly troubleshoot issues. Finally, the book will take you through monitoring AWS billing and costs. By the end of this book, you'll be capable of making decisions that enhance your infrastructure performance and maintain it at its peak.
Table of Contents (16 chapters)
Section 1: Introduction to Monitoring and Amazon CloudWatch
Section 2: AWS Services and Amazon CloudWatch

Monitoring AWS Glue jobs with CloudWatch alarms

AWS Glue is a serverless service used to perform ETL operations in AWS. Glue connects to multiple data sources to retrieve and transform data into different structures and formats. AWS Glue is easy to use and makes it faster to perform a transformation using Python or Scala, which are the two main options within Glue. Glue also has a very deep integration with Athena. The tables in Athena can be read within Glue and used for further ETL processes.

We shall do a simple example of transforming the data we queried previously in Athena: using a CloudTrail trail. We will create a Glue job that transforms the original data, compresses it to a different data format (Parquet), and writes it to another S3 bucket. Then, we can see the logs and activities and the different metrics used to measure the success or failure of a Glue job. These are the steps to create a Glue job:

  1. Navigate to Services | Glue in the AWS management console.
  2. ...