Book Image

Mastering Linux Shell Scripting - Second Edition

By : Mokhtar Ebrahim, Andrew Mallett

5 (1)

Book Image

Mastering Linux Shell Scripting - Second Edition

5 (1)

By: Mokhtar Ebrahim, Andrew Mallett

Overview of this book

In this book, you’ll discover everything you need to know to master shell scripting and make informed choices about the elements you employ. Grab your favorite editor and start writing your best Bash scripts step by step. Get to grips with the fundamentals of creating and running a script in normal mode, and in debug mode. Learn about various conditional statements' code snippets, and realize the power of repetition and loops in your shell script. You will also learn to write complex shell scripts. This book will also deep dive into file system administration, directories, and system administration like networking, process management, user authentications, and package installation and regular expressions. Towards the end of the book, you will learn how to use Python as a BASH Scripting alternative. By the end of this book, you will know shell scripts at the snap of your fingers and will be able to automate and communicate with your system with keyboard expressions.

Preface

Who this book is for

What this book covers

To get the most out of this book

Free Chapter

The What and Why of Scripting with Bash

The What and Why of Scripting with Bash

Technical requirements

Types of Linux shells

What is bash scripting?

The bash command hierarchy

Preparing text editors for scripting

Creating and executing scripts

Declaring variables

Command substitution

Debugging your scripts

Further reading

Creating Interactive Scripts

Creating Interactive Scripts

Technical requirements

Using echo with options

Basic script using read

Script comments

Enhancing scripts with read prompts

Limiting the number of entered characters

Controlling the visibility of the entered text

Passing options

Try to be standard

Enhancing learning with simple scripts

Further reading

Conditions Attached

Conditions Attached

Technical requirements

Simple decision paths using command-line lists

Verifying user input with lists

Using the test shell built-in

Creating conditional statements using if

Extending if with else

Test command with the if command

More conditions with elif

Using case statements

Recipe – building a frontend with grep

Further reading

Creating Code Snippets

Creating Code Snippets

Technical requirements

Using code snippets

Creating snippets using VS Code

Further reading

Alternative Syntax

Alternative Syntax

Technical requirement

Recapping the test command

Providing parameter defaults

When in doubt – quote!

Advanced tests using [[

Arithmetic operations using ((

Further reading

Iterating with Loops

Iterating with Loops

Technical requirement

Advanced for loops

Counting directories and files

C-style for loops

Redirecting loop output

while loops and until loops

Reading input from files

Creating operator menus

Further reading

Creating Building Blocks with Functions

Creating Building Blocks with Functions

Technical requirements

Introducing functions

Passing parameters to functions

Returning values from functions

Recursive functions

Using functions in menus

Further reading

Introducing the Stream Editor

Introducing the Stream Editor

Technical requirements

Using grep to display text

Understanding the basics of sed

Other sed commands

Multiple sed commands

Further reading

Automating Apache Virtual Hosts

Automating Apache Virtual Hosts

Technical requirements

Apache name-based Virtual Hosts

Automating virtual host creation

Further reading

AWK Fundamentals

AWK Fundamentals

Technical requirements

The history behind AWK

Displaying and filtering content from files

Conditional statements

Formatting output

Further filtering to display users by UID

AWK control files

Further reading

Regular Expressions

Regular Expressions

Technical requirements

Regular expression engines

Defining BRE patterns

Defining ERE patterns

Further reading

Summarizing Logs with AWK

Summarizing Logs with AWK

Technical requirements

The HTTPD log file format

Displaying data from web logs

Displaying the highest ranking IP address

Displaying the browser data

Working with email logs

Further reading

A Better lastlog with AWK

A Better lastlog with AWK

Technical requirements

Using AWK ranges to exclude data

Conditions based on the number of fields

Manipulating the AWK record separator to report on XML data

Further reading

Using Python as a Bash Scripting Alternative

Using Python as a Bash Scripting Alternative

Technical requirements

What is Python?

Saying Hello World the Python way

Pythonic arguments

Supplying arguments

Counting arguments

Significant whitespace

Reading user input

Using Python to write to files

String manipulation

Further reading

Assessments

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

5 (1)

5 star

100%

4 star

0

3 star

0

2 star

0

1 star

0

Displaying data from web logs

We have already had a preview of how we can use AWK to view the log files from the Apache web server; however, we will now move onto our demonstration file that has greater and more varied content.

Selecting entries by date

Having seen how we can display the date, we should perhaps look at how we print entries from just one day. To do this, we can use the match operator in awk. This is denoted by the tilde or squiggly line, if you prefer. As we only need the date element, there is no need for us to use both the date and time zone field. The following command shows how to print entries from September 10, 2014:

$ awk ' ( $4 ~ /10\/Sep\/2014/ ) ' access.log

For completeness, this command...