Bash Cookbook

Book Image

Bash Cookbook

By : Ron Brash, Ganesh Sanjiv Naik

Book Image

Bash Cookbook

By: Ron Brash, Ganesh Sanjiv Naik

Overview of this book

In Linux, one of the most commonly used and most powerful tools is the Bash shell. With its collection of engaging recipes, Bash Cookbook takes you through a series of exercises designed to teach you how to effectively use the Bash shell in order to create and execute your own scripts. The book starts by introducing you to the basics of using the Bash shell, also teaching you the fundamentals of generating any input from a command. With the help of a number of exercises, you will get to grips with the automation of daily tasks for sysadmins and power users. Once you have a hands-on understanding of the subject, you will move on to exploring more advanced projects that can solve real-world problems comprehensively on a Linux system. In addition to this, you will discover projects such as creating an application with a menu, beginning scripts on startup, parsing and displaying human-readable information, and executing remote commands with authentication using self-generated Secure Shell (SSH) keys. By the end of this book, you will have gained significant experience of solving real-world problems, from automating routine tasks to managing your systems and creating your own scripts.

Title Page

Copyright and Credits

Copyright and Credits

Packt Upsell

Contributors

Preface

Free Chapter

Crash Course in Bash

Crash Course in Bash

Getting started with Bash and CLI fundamentals

Creating and using basic variables

Hidden Bash variables and reserved words

Conditional logic using if, else, and elseif

Case/switch statements and loop constructs

Using functions and parameters

Including source files

Retrieving return codes and output

Linking commands, pipes, and input/output

Getting program input parameters

Getting additional information about commands

Acting Like a Typewriter and File Explorer

Acting Like a Typewriter and File Explorer

Basic searching for strings and files

Using wildcards and regexes

Math and calculations in script

Striping/altering/sorting/deleting/searching strings with Bash only

Using SED and AWK to remove/replace substrings

Formatting your data/output using echo and printf

Readying your script for different languages with internationalization

Calculating statistics and reducing duplicates based on file contents

Using file attributes with conditional logic

Reading delimited data and altered output format

Understanding and Gaining File System Mastery

Understanding and Gaining File System Mastery

Viewing files from various angles – head, tail, less, and more

Searching for files by name and/or extension

Creating a diff of two files and patching

Creating symbolic links and using them effectively

Crawling filesystem directories and printing a tree

Finding and deleting duplicate files or directories

Joining and splitting files at arbitrary positions

Generating datasets and random files of various size

Making a Script Behave Like a Daemon

Making a Script Behave Like a Daemon

Running a program continuously (forever) using looping constructs or recursion

Keeping programs/scripts running after logoff

Invoking commands when they require permissions

Sanitizing user input and for repeatable results

Making a simple multi-level user menu using select

Generating and trapping signals for cleanup

Using temporary files and lock files in your program

Leveraging timeout when waiting for command completion

Creating a file-in-file-out program and running processes in parallel

Executing your script on startup

Scripts for System Administration Tasks

Scripts for System Administration Tasks

Gathering and aggregating system information

Gathering network information and connectivity diagnostics

Configuring basic network connectivity

Monitoring directories and files

Compressing and archiving files

Rotating files from RAM to storage for log rotation

Using Linux iptables for a firewall

Accessing SQL databases remotely or locally

Creating SSH keys for password less remote access

Creating and configuring cron Jobs for task scheduling

Creating users and groups systematically

Scripts for Power Users

Scripts for Power Users

Creating Syslog entries and generating an alarm

Backing up and erasing media, disks, and partitions with DD

Creating graphics and presentations on the CLI

Checking for file integrity and tampering

Mounting network file systems and retrieving files

Browsing the web from the CLI

Capturing network traffic headlessly

Finding binary dependencies

Fetching time from different locations

Encrypting/decrypting files from a script

Writing Bash to Win and Profit

Writing Bash to Win and Profit

Creating a lame utility HTTP server

Parsing RSS feeds and output HTML

Scraping the web and collecting files

Making a simple IRC chat bot logger

Blocking IP addresses from failed SSH attempts

Playing and managing audio from Bash

Creating a simple NAT and DMZ firewall

Parsing a GitHub project and generate a report

Creating a poor man's incremental remote backup

Using Bash scripts to monitor udev input

Using Bash to monitor battery life and optimize it

Using chroot and restricted Bash shells to secure scripts

Advanced Scripting Techniques

Advanced Scripting Techniques

Calculating and reducing the runtime of a script

Writing one-line conditional statements and loops

Avoiding command not found warnings/errors and improving portability

Creating a config file and using it in tandem with your scripts

Improving your shell – GCC and command line colors

Adding aliases, and altering user paths/variables

Echoing output to raw terminal devices

Creating simple frontend GUIs for Bash scripts

Compiling and installing your own Bash shell

Recording terminal sessions for automation

Writing high-quality scripts by example

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Index

Customer Reviews

5 star

0

4 star

0

3 star

0

2 star

0

1 star

0

Creating a poor man's incremental remote backup

In this recipe, we will learn about creating backups and incremental backups. We will write a script to get incremental backups.

Getting ready

Besides having a Terminal open, we need to remember a few concepts:

Basic knowledge of the tar, gunzip, and gzip commands.
Ensure that you have the necessary directories present in your system.

How to do it…

First, select a directory whose backup you want to take. We will use the tar command. Let's assume that you want to take backup of your /work directory:

$ tar cvfz work.tar.gz /work

Now, we will write a script to take an incremental backup. Create a incr_backup.shscript and write the following code in it:

#!/bin/bash
gunzip /work/tar.gz
tar uvf /work.tar /work/
gzip /work.tar

How it works…

Now, we will learn about the options used in the preceding command as well as the script:

In the command, the options we have used are these:
1. c: This option will create an archive
2. v: This option is for verbose mode. We...