Book Image

The Data Analysis Workshop

By : Gururajan Govindan, Shubhangi Hora, Konstantin Palagachev
Book Image

The Data Analysis Workshop

By: Gururajan Govindan, Shubhangi Hora, Konstantin Palagachev

Overview of this book

Businesses today operate online and generate data almost continuously. While not all data in its raw form may seem useful, if processed and analyzed correctly, it can provide you with valuable hidden insights. The Data Analysis Workshop will help you learn how to discover these hidden patterns in your data, to analyze them, and leverage the results to help transform your business. The book begins by taking you through the use case of a bike rental shop. You'll be shown how to correlate data, plot histograms, and analyze temporal features. As you progress, you’ll learn how to plot data for a hydraulic system using the Seaborn and Matplotlib libraries, and explore a variety of use cases that show you how to join and merge databases, prepare data for analysis, and handle imbalanced data. By the end of the book, you'll have learned different data analysis techniques, including hypothesis testing, correlation, and null-value imputation, and will have become a confident data analyst.
Table of Contents (12 chapters)
Preface
7
7. Analyzing the Heart Disease Dataset
9
9. Analysis of the Energy Consumed by Appliances

Data Preparation and Feature Engineering

Once you have loaded and cleaned your data, you need to prepare it so that it's in a format that you can use to perform data analysis. Along with this, you need to identify features that will help you understand your data better and provide significant insights. These processes involve modifying already existing features and transforming them into new features.

For example, in the previous exercise, we saw that the dataset contains a date column consisting of day, month, and year. We can use this information to determine which months of the year were most popular for the online retail store. In order to do this, we need to modify the date column by breaking it down into columns such as day, month, year, and so on.

When preparing data for machine learning models, categorical features must be transformed into a numerical format so that the models can learn from them. However, since we are just going to be analyzing the data, we can...