Logistic regression is one of the most commonly used linear classification models. Although it was developed a long time ago, it is still widely used in the practical field of industries. It is not only powerful but also simple enough that it can be a good resource when it comes to understanding the classification problem of machine learning.
This classification problem is categorized as a supervised learning-type problem and it is the most common setting in the machine learning field. It aims to attach the label to a new incoming instance by using information from past observations. These labels can be interpreted as non-ordered discrete values, unlike continuous values, which we learned about in the previous chapter. In this chapter, we are going to learn about a powerful traditional algorithm called logistic regression by trying to solve...