Book Image

Data Science Projects with Python - Second Edition

By : Stephen Klosterman
Book Image

Data Science Projects with Python - Second Edition

By: Stephen Klosterman

Overview of this book

If data is the new oil, then machine learning is the drill. As companies gain access to ever-increasing quantities of raw data, the ability to deliver state-of-the-art predictive models that support business decision-making becomes more and more valuable. In this book, you’ll work on an end-to-end project based around a realistic data set and split up into bite-sized practical exercises. This creates a case-study approach that simulates the working conditions you’ll experience in real-world data science projects. You’ll learn how to use key Python packages, including pandas, Matplotlib, and scikit-learn, and master the process of data exploration and data processing, before moving on to fitting, evaluating, and tuning algorithms such as regularized logistic regression and random forest. Now in its second edition, this book will take you through the end-to-end process of exploring data and delivering machine learning models. Updated for 2021, this edition includes brand new content on XGBoost, SHAP values, algorithmic fairness, and the ethical concerns of deploying a model in the real world. By the end of this data science book, you’ll have the skills, understanding, and confidence to build your own machine learning models and gain insights from real data.

Related Content you might be interested in

Current Title:

Small book image
Data Science Projects with Python - Second Edition
Stephen Klosterman
Jul, 2021 | 432 pages
Small book image
Hands-On Predictive Analytics with Python
Alvaro Fuentes
Dec, 2018 | 330 pages
Small book image
Hands-On Gradient Boosting with XGBoost and scikit-learn
Corey Wade
Oct, 2020 | 310 pages
Small book image
The Supervised Learning Workshop
Blaine Bateman | Ashish Ranjan Jha | Benjamin Johnston | Ishita Mathur
Feb, 2020 | 532 pages
Table of Contents (9 chapters)
Preface
About the Book
1
1. Data Exploration and Cleaning
1. Data Exploration and Cleaning
Introduction
Python and the Anaconda Package Management System
Different Types of Data Science Problems
Loading the Case Study Data with Jupyter and pandas
Data Quality Assurance and Exploration
Exploring the Financial History Features in the Dataset
Summary
Free Chapter
2
2. Introduction to Scikit-Learn and Model Evaluation
2. Introduction to Scikit-Learn and Model Evaluation
Introduction
Exploring the Response Variable and Concluding the Initial Exploration
Introduction to Scikit-Learn
Model Performance Metrics for Binary Classification
Summary
3
3. Details of Logistic Regression and Feature Exploration
3. Details of Logistic Regression and Feature Exploration
Introduction
Examining the Relationships Between Features and the Response Variable
Univariate Feature Selection: What it Does and Doesn't Do
Summary
4
4. The Bias-Variance Trade-Off
4. The Bias-Variance Trade-Off
Introduction
Estimating the Coefficients and Intercepts of Logistic Regression
Cross-Validation: Choosing the Regularization Parameter
Summary
5
5. Decision Trees and Random Forests
5. Decision Trees and Random Forests
Introduction
Decision Trees
Random Forests: Ensembles of Decision Trees
Summary
6
6. Gradient Boosting, XGBoost, and SHAP Values
6. Gradient Boosting, XGBoost, and SHAP Values
Introduction
Gradient Boosting and XGBoost
XGBoost Hyperparameters
Another Way of Growing Trees: XGBoost's grow_policy
Explaining Model Predictions with SHAP Values
Missing Data
Summary
7
7. Test Set Analysis, Financial Insights, and Delivery to the Client
7. Test Set Analysis, Financial Insights, and Delivery to the Client
Introduction
Review of Modeling Results
Model Performance on the Test Set
Financial Analysis
Final Thoughts on Delivering a Predictive Model to the Client
Summary
Appendix
1. Data Exploration and Cleaning
2. Introduction to Scikit-Learn and Model Evaluation
3. Details of Logistic Regression and Feature Exploration
4. The Bias-Variance Trade-Off
5. Decision Trees and Random Forests
6. Gradient Boosting, XGBoost, and SHAP Values
7. Test Set Analysis, Financial Insights, and Delivery to the Client

4. The Bias-Variance Trade-Off

Overview

In this chapter, we'll cover the remaining elements of logistic regression, including what happens when you call .fit to train the model, and the statistical assumptions you should be aware of when using this modeling technique. You will learn how to use L1 and L2 regularization with logistic regression to prevent overfitting and how to use the practice of cross-validation to decide the regularization strength. After reading this chapter, you will be able to use logistic regression in your work and employ regularization in the model fitting process to take advantage of the bias-variance trade-off and improve model performance on unseen data.

Previous Section
End of Section 1
Next Section