Book Image

AWS for System Administrators

By : Prashant Lakhera
Book Image

AWS for System Administrators

By: Prashant Lakhera

Overview of this book

Amazon Web Services (AWS) is one of the most popular and efficient cloud platforms for administering and deploying your applications to make them resilient and robust. AWS for System Administrators will help you to learn several advanced cloud administration concepts for deploying, managing, and operating highly available systems on AWS. Starting with the fundamentals of identity and access management (IAM) for securing your environment, this book will gradually take you through AWS networking and monitoring tools. As you make your way through the chapters, you’ll get to grips with VPC, EC2, load balancer, Auto Scaling, RDS database, and data management. The book will also show you how to initiate AWS automated backups and store and keep track of log files. Later, you’ll work with AWS APIs and understand how to use them along with CloudFormation, Python Boto3 Script, and Terraform to automate infrastructure. By the end of this AWS book, you’ll be ready to build your two-tier startup with all the necessary infrastructure, monitoring, and logging components in place.
Table of Contents (18 chapters)
1
Section 1: AWS Services and Tools
4
Section 2: Building the Infrastructure
7
Section 3: Adding Scalability and Elasticity to the Infrastructure
11
Section 4: The Monitoring, Metrics, and Backup Layers

Setting up the CloudWatch agent

In Chapter 8, Monitoring AWS Services Using CloudWatch and SNS, we learned how to set up the CloudWatch agent to push custom metrics—for example, memory and disk statistics—to CloudWatch. In this chapter, we will extend this concept further and use the CloudWatch agent to push system logs—for example /var/log/messages and /var/log/secure—to CloudWatch Logs.

Before setting up the CloudWatch agent, we need to understand what a CloudWatch log is. If you want all your logs at one centralized place, then you need to enable CloudWatch Logs. CloudWatch Logs enables you to store and access your log files from EC2, Route53, CloudTrail, and other sources at one centralized location. You can use them to search for a specific code, filter them based on specific fields, and archive them for future analysis. Before setting up the CloudWatch agent, we first need to set up CloudWatch Logs. These are the steps we need to follow:

    ...