Book Image

Data Science Projects with Python

By : Barbora stetinova
Book Image

Data Science Projects with Python

By: Barbora stetinova

Overview of this book

Data Science Projects with Python is designed to give you practical guidance on industry-standard data analysis and machine learning tools in Python, with the help of realistic data. The course will help you understand how you can use pandas and Matplotlib to critically examine a dataset with summary statistics and graphs and extract the insights you seek to derive. You will continue to build on your knowledge as you learn how to prepare data and feed it to machine learning algorithms, such as regularized logistic regression and random forest, using the scikit-learn package. You’ll discover how to tune the algorithms to provide the best predictions on new and, unseen data. As you delve into later chapters, you’ll be able to understand the working and output of these algorithms and gain insight into not only the predictive capabilities of the models but also their reasons for making these predictions. The codes for this course can be downloaded from https://github.com/TrainingByPackt/Data-Science-Projects-with-Python-eLearning.
Table of Contents (6 chapters)
Chapter 4
The Bias-Variance Trade-off
Content Locked
Section 6
Cross Validation: Choosing the Regularization Parameter and Other Hyperparameters
By now, you should be interested in using regularization in order to decrease the overfitting we observed when we tried to model the synthetic data. The question is, how do we choose the regularization parameter, C? C is an example of a model hyperparameter. Hyperparameters are different from the parameters that are estimated when a model is trained, such as the coefficients and the intercept of a logistic regression. Rather than being estimated by an automated procedure like the parameters are, hyperparameters are input directly by the user as keyword arguments, typically when instantiating the model class. So, how do we know what values to choose? Here are the topics that we will cover now: