Book Image

Training Systems using Python Statistical Modeling

By : Curtis Miller
Book Image

Training Systems using Python Statistical Modeling

By: Curtis Miller

Overview of this book

Python's ease-of-use and multi-purpose nature has made it one of the most popular tools for data scientists and machine learning developers. Its rich libraries are widely used for data analysis, and more importantly, for building state-of-the-art predictive models. This book is designed to guide you through using these libraries to implement effective statistical models for predictive analytics. You’ll start by delving into classical statistical analysis, where you will learn to compute descriptive statistics using pandas. You will focus on supervised learning, which will help you explore the principles of machine learning and train different machine learning models from scratch. Next, you will work with binary prediction models, such as data classification using k-nearest neighbors, decision trees, and random forests. The book will also cover algorithms for regression analysis, such as ridge and lasso regression, and their implementation in Python. In later chapters, you will learn how neural networks can be trained and deployed for more accurate predictions, and understand which Python libraries can be used to implement them. By the end of this book, you will have the knowledge you need to design, build, and deploy enterprise-grade statistical models for machine learning using Python and its rich ecosystem of libraries for predictive analytics.
Table of Contents (9 chapters)

MLPs for classification

In this section, we will train an MLP for classification by discussing the required hyperparameters. Additionally, we will explore the various issues in optimization.

All MLPs are required to have their shape specified. This includes the number of hidden layers and how many neurons each layer has. Each neuron, which is a perceptron, has an activation function whose value will need to be passed to later neurons in the network. Here, the activation function needs to be selected.

Finally, to control overfitting, a regularization parameter can be specified to help weed out unhelpful neurons in the network, giving them little to no weight.

Optimization techniques

We will briefly discuss optimization procedures...