Book Image

The Applied Data Science Workshop - Second Edition

By : Alex Galea
Book Image

The Applied Data Science Workshop - Second Edition

By: Alex Galea

Overview of this book

From banking and manufacturing through to education and entertainment, using data science for business has revolutionized almost every sector in the modern world. It has an important role to play in everything from app development to network security. Taking an interactive approach to learning the fundamentals, this book is ideal for beginners. You’ll learn all the best practices and techniques for applying data science in the context of real-world scenarios and examples. Starting with an introduction to data science and machine learning, you’ll start by getting to grips with Jupyter functionality and features. You’ll use Python libraries like sci-kit learn, pandas, Matplotlib, and Seaborn to perform data analysis and data preprocessing on real-world datasets from within your own Jupyter environment. Progressing through the chapters, you’ll train classification models using sci-kit learn, and assess model performance using advanced validation techniques. Towards the end, you’ll use Jupyter Notebooks to document your research, build stakeholder reports, and even analyze web performance data. By the end of The Applied Data Science Workshop, you’ll be prepared to progress from being a beginner to taking your skills to the next level by confidently applying data science techniques and tools to real-world projects.
Table of Contents (8 chapters)

Introduction

Having gone through a fairly involved analysis in the previous chapter, you should now be feeling comfortable using Jupyter Notebooks to work with data. In addition to data exploration and visualization, our analysis included a couple of relatively simple modeling problems, where we trained linear regression models. These lines of best fit were very easy to create because only two dimensions were involved and the data was very clean.

As we will see in later chapters, training more advanced models (such as decision trees) can be just as easy because of the simplicity of open source software such as scikit-learn. The work involved in preparing data, however, can be significantly more difficult, depending on the details of the relevant datasets.

The quality of training data is very important for creating a model that will generalize well to future samples. For example, errors in your training dataset will cause the model to learn patterns that don't reflect the...