Book Image

AWS Observability Handbook

By : Phani Kumar Lingamallu, Fabio Braga de Oliveira
Book Image

AWS Observability Handbook

By: Phani Kumar Lingamallu, Fabio Braga de Oliveira

Overview of this book

As modern application architecture grows increasingly complex, identifying potential points of failure and measuring end user satisfaction, in addition to monitoring application availability, is key. This book helps you explore AWS observability tools that provide end-to-end visibility, enabling quick identification of performance bottlenecks in distributed applications. You’ll gain a holistic view of monitoring and observability on AWS, starting from observability basics using Amazon CloudWatch and AWS X-Ray to advanced ML-powered tools such as AWS DevOps Guru. As you progress, you'll learn about AWS-managed open source services such as AWS Distro for OpenTelemetry (ADOT) and AWS managed Prometheus, Grafana, and the ELK Stack. You’ll implement observability in EC2 instances, containers, Kubernetes, and serverless apps and grasp UX monitoring. With a fair mix of concepts and examples, this book helps you gain hands-on experience in implementing end-to-end AWS observability in your applications and navigating and troubleshooting performance issues with the help of use cases. You'll also learn best practices and guidelines, such as how observability relates to the Well-Architected Framework. By the end of this AWS book, you’ll be able to implement observability and monitoring in your apps using AWS’ native and managed open source tools in real-world scenarios.
Table of Contents (22 chapters)
1
Part 1: Getting Started with Observability on AWS
6
Part 2: Automated and Machine Learning-Powered Observability on AWS
11
Part 3: Open Source Managed Services on AWS
15
Part 4: Scaled Observability and Beyond

Ingesting telemetry data

Now that we have the environment set up, it’s time to set up the data ingestion software and permissions. We will see two ways to ingest data into AMP:

  • Ingestion from a new Prometheus server
  • Ingestion using AWS Distro for OpenTelemetry

Ingestion from a new Prometheus server

Let’s configure the data ingestion using a Prometheus server deployed in our EKS cluster:

  1. First, let’s create a Prometheus namespace with the following command:
    kubectl create namespace prometheus
  2. Now, let’s execute the following command to install Prometheus:
    curl -sSL https://insiders-guide-observability-on-aws-book.s3.amazonaws.com/chapter-10/install-prometheus-eks.sh | bash
  3. Now, let’s go back and configure the AMP data source on Grafana. Access the Grafana dashboard and click on the AWS icon on the menu at the left. Select the AWS services option. Check the following figure:

Figure 10.20...