Book Image

Training Systems using Python Statistical Modeling

By : Curtis Miller
Book Image

Training Systems using Python Statistical Modeling

By: Curtis Miller

Overview of this book

Python's ease-of-use and multi-purpose nature has made it one of the most popular tools for data scientists and machine learning developers. Its rich libraries are widely used for data analysis, and more importantly, for building state-of-the-art predictive models. This book is designed to guide you through using these libraries to implement effective statistical models for predictive analytics. You’ll start by delving into classical statistical analysis, where you will learn to compute descriptive statistics using pandas. You will focus on supervised learning, which will help you explore the principles of machine learning and train different machine learning models from scratch. Next, you will work with binary prediction models, such as data classification using k-nearest neighbors, decision trees, and random forests. The book will also cover algorithms for regression analysis, such as ridge and lasso regression, and their implementation in Python. In later chapters, you will learn how neural networks can be trained and deployed for more accurate predictions, and understand which Python libraries can be used to implement them. By the end of this book, you will have the knowledge you need to design, build, and deploy enterprise-grade statistical models for machine learning using Python and its rich ecosystem of libraries for predictive analytics.
Table of Contents (9 chapters)

Evaluating models

In this section, we will look at metrics for evaluating how well a model is performing. This section focuses on metrics to use to evaluate how well a model predicts a target variable in binary classification. We will discuss how to compute accuracy, precision, recall, the F1 score, and the Bayes factor, along with how to interpret each of these metrics.

Accuracy

Accuracy measures how frequently an algorithm predicted the correct label. On the surface, this looks like a good enough metric, but accuracy alone does not convey the quality of an algorithm. A problem could have an algorithm that is very accurate, but only because the learning problem is, in some sense, easy, such as predicting on any particular...