Summary
In this chapter, we discussed the second out of four groups of hyperparameter tuning methods, called the BO group. We not only discussed BO in general but also several of its variants, including BOGP, SMAC, TPE, and Metis. We saw what makes each of the variants differ from each other, along with the pros and cons of each. At this point, you should be able to explain BO with confidence when someone asks you and apply hyperparameter tuning methods in this group with ease.
In the next chapter, we will start discussing heuristic search, the third group of hyperparameter tuning methods. The goal of the next chapter is similar to this chapter: to provide a better understanding of the methods that belong to the heuristic search group.