Book Image

Training Systems using Python Statistical Modeling

By : Curtis Miller
Book Image

Training Systems using Python Statistical Modeling

By: Curtis Miller

Overview of this book

Python's ease-of-use and multi-purpose nature has made it one of the most popular tools for data scientists and machine learning developers. Its rich libraries are widely used for data analysis, and more importantly, for building state-of-the-art predictive models. This book is designed to guide you through using these libraries to implement effective statistical models for predictive analytics. You’ll start by delving into classical statistical analysis, where you will learn to compute descriptive statistics using pandas. You will focus on supervised learning, which will help you explore the principles of machine learning and train different machine learning models from scratch. Next, you will work with binary prediction models, such as data classification using k-nearest neighbors, decision trees, and random forests. The book will also cover algorithms for regression analysis, such as ridge and lasso regression, and their implementation in Python. In later chapters, you will learn how neural networks can be trained and deployed for more accurate predictions, and understand which Python libraries can be used to implement them. By the end of this book, you will have the knowledge you need to design, build, and deploy enterprise-grade statistical models for machine learning using Python and its rich ecosystem of libraries for predictive analytics.

Related Content you might be interested in

Current Title:

Small book image
Training Systems using Python Statistical Modeling
Curtis Miller
May, 2019 | 290 pages
Small book image
Hands-On Data Analysis with NumPy and pandas
Curtis Miller
Jun, 2018 | 168 pages
Small book image
Bayesian Analysis with Python
Osvaldo Martin
Jan, 2024 | 394 pages
Small book image
Mastering Predictive Analytics with R, Second Edition
Rui Miguel Forte | James D Miller
Aug, 2017 | 448 pages
Table of Contents (9 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Classical Statistical Analysis
Classical Statistical Analysis
Technical requirements
Computing descriptive statistics
Classical inference for proportions
Classical inference for means
Diving into Bayesian analysis
Bayesian analysis for proportions
Bayesian analysis for means
Finding correlations
Summary
2
Introduction to Supervised Learning
Introduction to Supervised Learning
Principles of machine learning
Training models
Evaluating models
Summary
3
Binary Prediction Models
Binary Prediction Models
K-nearest neighbors classifier
Decision trees
Random forests
Naive Bayes classifier
Support vector machines
Logistic regression
Extending beyond binary classifiers
Summary
4
Regression Analysis and How to Use It
Regression Analysis and How to Use It
Linear models
Evaluating linear models
Bayesian linear models
Ridge regression
LASSO regression
Spline interpolation
Summary
5
Neural Networks
Neural Networks
An introduction to perceptrons
Neural networks
MLPs for classification
MLP for regression
Summary
6
Clustering Techniques
Clustering Techniques
Introduction to clustering
Exploring the k-means algorithm
Evaluating clusters
Hierarchical clustering
Spectral clustering
Summary
7
Dimensionality Reduction
Dimensionality Reduction
Introducing dimensionality reduction
Principal component analysis
Singular value decomposition
Low-dimensional representation
Summary
8
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Spectral clustering

The final clustering method we will look at is spectral clustering. In this section, we will learn what spectral clustering is and demonstrate how to perform it.

Of all the clustering methods mentioned in this chapter, spectral clustering may be the most opaque. Nevertheless, I will attempt to explain it. We start with a dataset, as shown in the following diagram:

Next, we compute the similarity between the points in the dataset, as seen here:

If the points are highly similar, we can infer that those points are connected:

These connections form something similar to a graph. Once we have the graph, we find connections to cut. Then, nodes that are connected belong to the same cluster. So, let's go ahead and see what spectral clustering does with the iris dataset.

We will import the SpectralClustering class and perform spectral clustering for this dataset...

Previous Section
End of Section 6
Next Section