Book Image

Training Systems using Python Statistical Modeling

By : Curtis Miller
Book Image

Training Systems using Python Statistical Modeling

By: Curtis Miller

Overview of this book

Python's ease-of-use and multi-purpose nature has made it one of the most popular tools for data scientists and machine learning developers. Its rich libraries are widely used for data analysis, and more importantly, for building state-of-the-art predictive models. This book is designed to guide you through using these libraries to implement effective statistical models for predictive analytics. You’ll start by delving into classical statistical analysis, where you will learn to compute descriptive statistics using pandas. You will focus on supervised learning, which will help you explore the principles of machine learning and train different machine learning models from scratch. Next, you will work with binary prediction models, such as data classification using k-nearest neighbors, decision trees, and random forests. The book will also cover algorithms for regression analysis, such as ridge and lasso regression, and their implementation in Python. In later chapters, you will learn how neural networks can be trained and deployed for more accurate predictions, and understand which Python libraries can be used to implement them. By the end of this book, you will have the knowledge you need to design, build, and deploy enterprise-grade statistical models for machine learning using Python and its rich ecosystem of libraries for predictive analytics.
Table of Contents (9 chapters)

Introducing dimensionality reduction

Now, let's start by talking about what we're doing with dimensionality reduction. In this section, I will introduce dimensionality reduction techniques as an unsupervised learning method, and discuss what the objectives of dimensionality reduction are and what it is used for.

Dimensionality reduction is considered an unsupervised learning method, since there is no target variable that we are trying to predict. The other unsupervised learning method we looked at was clustering, which was unsupervised learning's analogy to classification.

Dimensionality reduction is the unsupervised learning analogy to regression. We are trying to discover features, often in Euclidean space, that we do not directly observe in data, yet we believe influence patterns seen in it. Perhaps you may recall the curse of dimensionality. This is a phenomenon...