Summary
In this chapter, we have learned all we need to know about hyperparameter tuning, starting from what it is, what is its goal, and when we should perform hyperparameter tuning. We have also discussed the difference between hyperparameters and parameters, the concept of hyperparameter space, and the concept of hyperparameter distributions. Having a clear picture of the concept of hyperparameter tuning and hyperparameters themselves will help you a lot in the following chapters.
As stated previously, we will discuss all of the four categories of hyperparameter-tuning methods in this book. In Chapter 3, Exploring Exhaustive Search, we will start discussing the first group and the most widely used hyperparameter-tuning methods in practice. There will be both high-level and detailed explanations to help you understand each of the methods more easily.