Book Image

Data Science Projects with Python

By : Stephen Klosterman
Book Image

Data Science Projects with Python

By: Stephen Klosterman

Overview of this book

Data Science Projects with Python is designed to give you practical guidance on industry-standard data analysis and machine learning tools, by applying them to realistic data problems. You will learn how to use pandas and Matplotlib to critically examine datasets with summary statistics and graphs, and extract the insights you seek to derive. You will build your knowledge as you prepare data using the scikit-learn package and feed it to machine learning algorithms such as regularized logistic regression and random forest. You’ll discover how to tune algorithms to provide the most accurate predictions on new and unseen data. As you progress, you’ll gain insights into the working and output of these algorithms, building your understanding of both the predictive capabilities of the models and why they make these predictions. By then end of this book, you will have the necessary skills to confidently use machine learning algorithms to perform detailed data analysis and extract meaningful insights from unstructured data.

Related Content you might be interested in

Current Title:

Small book image
Data Science Projects with Python
Stephen Klosterman
Apr, 2019 | 374 pages
Small book image
Hands-On Predictive Analytics with Python
Alvaro Fuentes
Dec, 2018 | 330 pages
Small book image
Applied Supervised Learning with Python
Benjamin Johnston | Ishita Mathur
Apr, 2019 | 404 pages
Small book image
Data Cleaning and Exploration with Machine Learning
Michael Walker
Aug, 2022 | 542 pages
Table of Contents (9 chapters)
Data Science Projects with Python
Data Science Projects with Python
Preface
Preface
Free Chapter
1
Data Exploration and Cleaning
Data Exploration and Cleaning
Introduction
Python and the Anaconda Package Management System
Different Types of Data Science Problems
Loading the Case Study Data with Jupyter and pandas
Data Quality Assurance and Exploration
Exploring the Financial History Features in the Dataset
Summary
2
Introduction toScikit-Learn and Model Evaluation
Introduction toScikit-Learn and Model Evaluation
Introduction
Exploring the Response Variable and Concluding the Initial Exploration
Introduction to Scikit-Learn
Model Performance Metrics for Binary Classification
Summary
3
Details of Logistic Regression and Feature Exploration
Details of Logistic Regression and Feature Exploration
Introduction
Examining the Relationships between Features and the Response
Univariate Feature Selection: What It Does and Doesn't Do
Summary
4
The Bias-Variance Trade-off
The Bias-Variance Trade-off
Introduction
Estimating the Coefficients and Intercepts of Logistic Regression
Cross Validation: Choosing the Regularization Parameter and Other Hyperparameters
Summary
5
Decision Trees and Random Forests
Decision Trees and Random Forests
Introduction
Decision trees
Random Forests: Ensembles of Decision Trees
Summary
6
Imputation of Missing Data, Financial Analysis, and Delivery to Client
Imputation of Missing Data, Financial Analysis, and Delivery to Client
Introduction
Review of Modeling Results
Dealing with Missing Data: Imputation Strategies
Final Thoughts on Delivering the Predictive Model to the Client
Summary
Appendix
Appendix
Chapter 1: Data Exploration and Cleaning
Chapter 2: Introduction to Scikit-Learn and Model Evaluation
Chapter 3: Details of Logistic Regression and Feature Exploration
Chapter 4: The Bias-Variance Trade-off
Chapter 5: Decision Trees and Random Forests
Chapter 6: Imputation of Missing Data, Financial Analysis, and Delivery to Client

Summary

In this chapter, you learned the core data science skill of imputation. Imputation allows the replacement of missing values for features with educated guesses as to what the real values are. Imputation is necessary to provide predictions for all samples, including those with missing feature values. This is because many machine learning algorithms, including those we've worked with in this book, cannot take input which includes missing values. Imputation methods range from simple ones, such as imputing with the mean, median, or mode of non-missing values, to more complex methods, including creating a predictive model for the feature that has missing values.

After ensuring that the model we deliver can provide predictions for all samples, via imputation, we conducted a financial analysis. While we left this to the end of the book, an understanding of the costs and savings going along with the decisions to be guided by the model should be understood from the beginning of a typical project...

Previous Section
End of Chapter 6
Next Chapter