In this chapter, we used cut, grep, awk, and sort to deeply inspect our data, as one would in a more traditional database. We then saw how sqlite can provide a lightweight alternative to other databases. Using these tools together, we were able to mine useful knowledge from our raw files.
We also saw how the command line offers several options for doing arithmetic and other mathematical operations. Simple arithmetic and grouped tallies can be performed using bash itself or awk. More complex mathematics can be done using a scripting language, such as bc or python, and be called like other command-line workflow tools.
Finally, we used many of the tools we discussed to produce a useful and interesting result from publicly-available data.
We hope that this book broadens your understanding of just how powerful the command line actually is, especially for data science. However...