AWS Automation Cookbook

By : Nikit Swaraj

5 (1)

Buy this Book

AWS Automation Cookbook

5 (1)

By: Nikit Swaraj

Buy this Book

Overview of this book

AWS CodeDeploy, AWS CodeBuild, and CodePipeline are scalable services offered by AWS that automate an application's build and deployment pipeline. In order to deliver tremendous speed and agility, every organization is moving toward automating their entire application pipeline. This book will cover all the AWS services required to automate your deployment to your instances. You'll begin by setting up and using one of the AWS services for automation –CodeCommit. Next, you'll learn how to build a sample Maven and NodeJS application using CodeBuild. After you've built the application, you'll see how to use CodeDeploy to deploy the application in EC2/Auto Scaling. You'll also build a highly scalable and fault tolerant Continuous Integration (CI)/Continuous Deployment (CD) pipeline using some easy-to-follow recipes. Following this, you'll achieve CI/CD for a microservice application and reduce the risk within your software development life cycle globally. You'll also learn to set up an infrastructure using CloudFormation templates and Ansible, and see how to automate AWS resources using AWS Lambda. Finally, you'll learn to automate instances in AWS and automate the deployment lifecycle of applications. By the end of this book, you'll be able to minimize application downtime and implement CI/CD, gaining total control over your software development lifecycle.

Preface

What this book covers

What you need for this book

Free Chapter

Using AWS CodeCommit

Introduction

Introducing VCS and Git

Introducing AWS CodeCommit - Amazon managed SaaS Git

Getting started with CodeCommit for HTTP users

Setting up CodeCommit for SSH users using AWS CLI

Applying security and restrictions

Migrating a Git repository to AWS CodeCommit

Building an Application using CodeBuild

Introduction

Introducing AWS CodeBuild

Building a Java application using Maven

Building a NodeJS application using yarn

Building a Maven application using AWS CodeBuild console

Building a sample NodeJS application using AWS CodeBuild via Buildspec.yml

Deploying Application using CodeDeploy & CodePipeline

Introduction

The Deployment strategy in AWS CodeDeploy

Writing an application-specific file

Deploying a static application in an EC2 instance from the S3 Bucket using AWS CodeDeploy

Introducing AWS CodePipeline and its working

Continuous Deployment of static application to AWS S3 using AWS CodePipeline

Building Scalable and Fault-Tolerant CI/CD Pipeline

Introduction

CI/CD pipeline workflow

Setting up AWS CodeCommit

Creating the S3 bucket and enabling versioning

Creating the launch configuration and Auto Scaling group

Creating AWS CodeDeploy application using the Auto Scaling group

Setting up the Jenkins Server and installing the required plugins

Integrating Jenkins with all of the AWS developers tools

Understanding Microservices and ECS

Introduction

Understanding microservices and their deployment

Playing around with Docker containers

Setting up AWS ECR and pushing an image into it

Understanding ECS and writing task definitions and services

Continuous Deployment to ECS Using Developer Tools and CloudFormation

Introduction

Understanding the architecture and workflow

Setting up the infrastructure to host the application

Setting Up CodeCommit for our application source

Creating a CodeBuild project for the build stage

Understanding the inside content of helper files (BuildSpec.yml, Dockerfile, and CF template)

Creating a CodePipeline using CodeCommit, CodeBuild, and CloudFormation

IaC Using CloudFormation and Ansible

Introduction

AWS CloudFormation and writing the CloudFormation template

Creating a production-ready web application infrastructure using CloudFormation

Automation with Ansible

Creating an AWS infrastructure using the Ansible EC2 dynamic inventory

Automating AWS Resource Control Using AWS Lambda

Introduction

Creating an AMIs of the EC2 instance using AWS lambda and CloudWatch

Sending notifications through SNS using Config and Lambda

Streaming and visualizing AWS CloudTrail logs in real time using Lambda with Kibana

Microservice Applications in Kubernetes Using Jenkins Pipeline 2.0

Introduction

Deploying multinode clusters on AWS using the Ansible playbook

Deploying a multinode production-ready cluster on AWS using Kops

Deploying a sample application on Kubernetes

Working with Kubernetes on AWS using AWS resources

Jenkins pipeline 2.0 (Pipeline as Code) using Jenkinsfile

Application deployment using Jenkinsfile

Deploying microservices applications in Kubernetes using Jenkinsfile

Best Practices and Troubleshooting Tips

Best practices with AWS CodeCommit

Troubleshooting with CodeCommit

Troubleshooting with CodeBuild

Customer Reviews

5 (1)

5 star

100%

4 star

3 star

2 star

1 star

Migrating a Git repository to AWS CodeCommit

As a developer, it's highly possible that we have our code in a GitHub account. So, we will see the migration of a GitHub repository to AWS CodeCommit. Customers often need to replicate commits from one repository to another to support disaster recovery or cross-region CI/CD pipelines. AWS CodeCommit has lots of flexibility when it comes to AWS developer services, such as CodeBuild, CodeDeploy, and CodeStar. Most companies nowadays will think to migrate from those repositories to AWS CodeCommit:

How to do it...

The following are the steps for migrating a project or repository hosted on another Git repository to AWS CodeCommit:

Firstly, we have to create a CodeCommit repository named HelloWorld (refer to the previous CodeCommit repository either using HTTPS or SSH).

After creating a CodeCommit repository, clone it to the local machine. Since we are cloning the repository using an HTTPS connection, then we need to give the HTTPS credentials of username and password (you can refer to the previous recipe):

    root@awsstar:~# git clone https://git-codecommit.us-east-    1.amazonaws.com/v1/repos/HelloWorld
     Cloning into 'HelloWorld'...
     Username for 'https://git-codecommit.us-east-1.amazonaws.com':     awsccuser-at-1xxxxxxxx39
     Password for 'https://[email protected]    east-1.amazonaws.com':
     warning: You appear to have cloned an empty repository.
     Checking connectivity... done.

3. Now, clone a GitHub repository using --mirror into another new folder. Here we have a GitHub repository whose name is Docker-Compose-CI-CD, which will be cloned into a pre-existing empty folder precommit:

     root@awsstar:~# mkdir precommit
     root@awsstar:~# git clone --mirror      https://github.com/awsstar/Docker-Compose-CI-CD.git precommit
     Cloning into bare repository 'precommit'...
     remote: Counting objects: 36, done.
     remote: Total 36 (delta 0), reused 0 (delta 0), pack-reused 36
     Unpacking objects: 100% (36/36), done.
     Checking connectivity... done.

Go to the directory where you made the clone:

    root@awsstar:~# cd precommit/

Run the git push command, specifying the URL and name of the destination AWS CodeCommit repository and the --all option:

    root@awsstar:~/precommit# git push https://git-codecommit.us-east-    1.amazonaws.com/v1/repos/HelloWorld --all
     Username for 'https://git-codecommit.us-east-1.amazonaws.com':     awsccuser-at-160384169139
     Password for 'https://awsccuser-at-160384169139@git-    codecommit.us-    east-1.amazonaws.com':
 Counting objects: 36, done.
     Delta compression using up to 4 threads.
     Compressing objects: 100% (33/33), done.
     Writing objects: 100% (36/36), 3.73 KiB | 0 bytes/s, done.
     Total 36 (delta 17), reused 0 (delta 0)
     To https://git-codecommit.us-east-    1.amazonaws.com/v1/repos/HelloWorld
     * [new branch] master -> master

Now, let's view the migrated files in AWS CodeCommit:

Here, we can see how easily we have migrated the project from GitHub to AWS CodeCommit.

AWS Automation Cookbook

By : Nikit Swaraj

AWS Automation Cookbook

By: Nikit Swaraj

Overview of this book

Related Content you might be interested in

Current Title:

AWS Automation Cookbook

Expert AWS Development

Building and Delivering Microservices on AWS

Accelerating DevSecOps on AWS