In the previous chapter, we went over the basics of probability and how we can apply simple theorems to complex tasks. To briefly summarize, probability is the mathematics of modeling events that may or may not occur. We use formulas in order to describe these events and even look at how multiple events can behave together.
In this chapter, we will explore more complicated theorems of probability and how we can use them in a predictive capacity.
Advanced topics, such as Bayes theorem and random variables, give rise to common machine learning algorithms, such as the Naïve Bayes algorithm (also covered in this book). This chapter will focus on some of the more advanced topics in probability theory, including the following topics:
Exhaustive events
Bayes theorem
Basic prediction rules
Random variables
We have one more definition to look at before we get started (the last one before the fun stuff, I promise). We have to look at collectively exhaustive events.