Book Image

Hands-On Enterprise Automation with Python

By : Bassem Aly

Book Image

Hands-On Enterprise Automation with Python

By: Bassem Aly

Overview of this book

Hands-On Enterprise Automation with Python starts by covering the set up of a Python environment to perform automation tasks, as well as the modules, libraries, and tools you will be using. We’ll explore examples of network automation tasks using simple Python programs and Ansible. Next, we will walk you through automating administration tasks with Python Fabric, where you will learn to perform server configuration and administration, along with system administration tasks such as user management, database management, and process management. As you progress through this book, you’ll automate several testing services with Python scripts and perform automation tasks on virtual machines and cloud infrastructure with Python. In the concluding chapters, you will cover Python-based offensive security tools and learn how to automate your security tasks. By the end of this book, you will have mastered the skills of automating several system administration tasks with Python.

Preface

Who this book is for

What this book covers

To get the most out of this book

Free Chapter

Setting Up Our Python Environment

Setting Up Our Python Environment

An introduction to Python

Installing the PyCharm IDE

Exploring some nifty PyCharm features

Common Libraries Used in Automation

Common Libraries Used in Automation

Understanding Python packages

Common Python libraries

Accessing module source code

Setting Up the Network Lab Environment

Setting Up the Network Lab Environment

Technical requirements

When and why to automate the network

Screen scraping versus API automation

Why use Python for network automation?

The future of network automation

Network lab setup

Getting ready – installing EVE-NG

Building an enterprise network topology

Using Python to Manage Network Devices

Using Python to Manage Network Devices

Technical requirements

Using the telnet protocol in Python

Handling IP addresses and networks with netaddr

Sample use cases

Extracting Useful Data from Network Devices

Extracting Useful Data from Network Devices

Technical requirements

Understanding parsers

Introduction to regular expressions

Configuration auditing using CiscoConfParse

Visualizing returned data with matplotLib

Configuration Generator with Python and Jinja2

Configuration Generator with Python and Jinja2

Building a golden configuration with Jinja2

Parallel Execution of Python Script

Parallel Execution of Python Script

How a computer executes your Python script

Python multiprocessing library

Preparing a Lab Environment

Preparing a Lab Environment

Getting the Linux operating system

Creating an automation machine on a hypervisor

Getting started with Cobbler

Using the Subprocess Module

Using the Subprocess Module

The popen() subprocess

Reading stdin, stdout, and stderr

The subprocess call suite

Running System Administration Tasks with Fabric

Running System Administration Tasks with Fabric

Technical requirements

What is Fabric?

Executing your first Fabric file

Other useful features in Fabric

Generating System Reports and System Monitoring

Generating System Reports and System Monitoring

Collecting data from Linux

Managing users in Ansible

Interacting with the Database

Interacting with the Database

Installing MySQL on an automation server

Accessing the MySQL database from Python

Ansible for System Administration

Ansible for System Administration

Ansible terminology

Installing Ansible on Linux

Using Ansible in ad hoc mode

Creating your first playbook

Understanding Ansible conditions, handlers, and loops

Working with Ansible facts

Working with the Ansible template

Creating and Managing VMware Virtual Machines

Creating and Managing VMware Virtual Machines

Setting up the environment

Generating a VMX file using Jinja2

VMware Python clients

Using Ansible playbook to manage instances

Interacting with the OpenStack API

Interacting with the OpenStack API

Understanding RESTful web services

Setting up the environment

Sending requests to the OpenStack keystone

Creating instances from Python

Managing OpenStack instances from Ansible

Automating AWS with Boto3

Automating AWS with Boto3

AWS Python modules

Managing AWS instances

Automating AWS S3 services

Using the Scapy Framework

Using the Scapy Framework

Understanding Scapy

Installing Scapy

Generating packets and network streams using Scapy

Capturing and replaying packets

Building a Network Scanner Using Python

Building a Network Scanner Using Python

Understanding the network scanner

Building a network scanner with Python

Sharing your code on GitHub

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

5 star

0

4 star

0

3 star

0

2 star

0

1 star

0

Setting up the environment

OpenStack is a free and open source project, used with Infrastructure as a Service (IaaS), that can control your hardware resources in terms of CPU, memory, and storage and provide an open framework for many vendors to build and integrate plugins.

To set up our lab, I will use the latest OpenStack-rdo release (at the time of writing), Queens, and install it onto CentOS 7.4.1708. The installation steps are pretty straightforward, and can be found at https://www.rdoproject.org/install/packstack/.

Our environment consists of a machine that has 100 GB storage, 12 vCPU, and 32 GB of RAM, This server will contains the OpenStack controller, the compute and neutron roles on the same server. The OpenStack server is connected to the same switch that has our automation server and in same subnet. Note that this is not always the case in a production environment...