Book Image

Data Science Projects with Python

By : Stephen Klosterman
Book Image

Data Science Projects with Python

By: Stephen Klosterman

Overview of this book

Data Science Projects with Python is designed to give you practical guidance on industry-standard data analysis and machine learning tools, by applying them to realistic data problems. You will learn how to use pandas and Matplotlib to critically examine datasets with summary statistics and graphs, and extract the insights you seek to derive. You will build your knowledge as you prepare data using the scikit-learn package and feed it to machine learning algorithms such as regularized logistic regression and random forest. You’ll discover how to tune algorithms to provide the most accurate predictions on new and unseen data. As you progress, you’ll gain insights into the working and output of these algorithms, building your understanding of both the predictive capabilities of the models and why they make these predictions. By then end of this book, you will have the necessary skills to confidently use machine learning algorithms to perform detailed data analysis and extract meaningful insights from unstructured data.

Related Content you might be interested in

Current Title:

Small book image
Data Science Projects with Python
Stephen Klosterman
Apr, 2019 | 374 pages
Small book image
Hands-On Predictive Analytics with Python
Alvaro Fuentes
Dec, 2018 | 330 pages
Small book image
Applied Supervised Learning with Python
Benjamin Johnston | Ishita Mathur
Apr, 2019 | 404 pages
Small book image
Data Cleaning and Exploration with Machine Learning
Michael Walker
Aug, 2022 | 542 pages
Table of Contents (9 chapters)
Data Science Projects with Python
Data Science Projects with Python
Preface
Preface
Free Chapter
1
Data Exploration and Cleaning
Data Exploration and Cleaning
Introduction
Python and the Anaconda Package Management System
Different Types of Data Science Problems
Loading the Case Study Data with Jupyter and pandas
Data Quality Assurance and Exploration
Exploring the Financial History Features in the Dataset
Summary
2
Introduction toScikit-Learn and Model Evaluation
Introduction toScikit-Learn and Model Evaluation
Introduction
Exploring the Response Variable and Concluding the Initial Exploration
Introduction to Scikit-Learn
Model Performance Metrics for Binary Classification
Summary
3
Details of Logistic Regression and Feature Exploration
Details of Logistic Regression and Feature Exploration
Introduction
Examining the Relationships between Features and the Response
Univariate Feature Selection: What It Does and Doesn't Do
Summary
4
The Bias-Variance Trade-off
The Bias-Variance Trade-off
Introduction
Estimating the Coefficients and Intercepts of Logistic Regression
Cross Validation: Choosing the Regularization Parameter and Other Hyperparameters
Summary
5
Decision Trees and Random Forests
Decision Trees and Random Forests
Introduction
Decision trees
Random Forests: Ensembles of Decision Trees
Summary
6
Imputation of Missing Data, Financial Analysis, and Delivery to Client
Imputation of Missing Data, Financial Analysis, and Delivery to Client
Introduction
Review of Modeling Results
Dealing with Missing Data: Imputation Strategies
Final Thoughts on Delivering the Predictive Model to the Client
Summary
Appendix
Appendix
Chapter 1: Data Exploration and Cleaning
Chapter 2: Introduction to Scikit-Learn and Model Evaluation
Chapter 3: Details of Logistic Regression and Feature Exploration
Chapter 4: The Bias-Variance Trade-off
Chapter 5: Decision Trees and Random Forests
Chapter 6: Imputation of Missing Data, Financial Analysis, and Delivery to Client

Introduction to Scikit-Learn

While pandas will save you a lot of time in loading, examining, and cleaning data, the machine learning algorithms that will enable you to do predictive modeling are located in other packages. We consider scikit-learn to be the premier machine learning package for Python, outside of deep learning. While it's impossible for any one package to offer "everything," scikit-learn comes pretty close in terms of accommodating a wide range of approaches for classification and regression, and unsupervised learning. That being said, a few other packages you should also be aware of are as follows:

SciPy:

  • Most of the packages we've used so far are actually part of the SciPy ecosystem.

  • SciPy itself offers lightweight functions for classical approaches such as linear regression and linear programming.

StatsModels:

  • More oriented toward statistics and more comfortable for users familiar with R

  • Can get p-values and confidence intervals on regression coefficients

  • Capability for time series...

Previous Section
End of Section 4
Next Section