Book Image

Practical Data Science Cookbook, Second Edition - Second Edition

By : Prabhanjan Narayanachar Tattar, Bhushan Purushottam Joshi, Sean Patrick Murphy, ABHIJIT DASGUPTA, Anthony Ojeda
Book Image

Practical Data Science Cookbook, Second Edition - Second Edition

By: Prabhanjan Narayanachar Tattar, Bhushan Purushottam Joshi, Sean Patrick Murphy, ABHIJIT DASGUPTA, Anthony Ojeda

Overview of this book

As increasing amounts of data are generated each year, the need to analyze and create value out of it is more important than ever. Companies that know what to do with their data and how to do it well will have a competitive advantage over companies that don’t. Because of this, there will be an increasing demand for people that possess both the analytical and technical abilities to extract valuable insights from data and create valuable solutions that put those insights to use. Starting with the basics, this book covers how to set up your numerical programming environment, introduces you to the data science pipeline, and guides you through several data projects in a step-by-step format. By sequentially working through the steps in each chapter, you will quickly familiarize yourself with the process and learn how to apply it to a variety of situations with examples using the two most popular programming languages for data analysis—R and Python.
Table of Contents (17 chapters)
Title Page
Credits
About the Authors
About the Reviewer
www.PacktPub.com
Preface

Fitting the logistic regression model


The discriminant analysis technique works well only when the set of independent variables/covariates follows multivariate normal distribution. At the starting point, it does not show flexibility by ruling out categorical variables. Many economic variables, such as salary, savings, and so on, are known not to follow normal distribution and are also skewed in general. Thus, the assumption of multivariate normal distribution is rather restrictive and we need a general framework for the classification problem. A very important class of model is provided by the logistic regression model. In fact, it is known to have very nice theoretical properties. For example, it is theoretically known that the logistic regression model provides as much accuracy as the discriminant analysis in the case of the independent variable following the multivariate normal distribution. The logistic regression model is a member of the important exponential family, and it belongs...