Chapter 9: Hyperparameter Tuning via Optuna
Optuna is a Python package that provides various implementations of hyperparameter tuning methods, including but not limited to Grid Search, Random Search, and Tree-Structured Parzen Estimators (TPE). This package also enables us to create our own hyperparameter tuning method class and integrate it with other popular hyperparameter tuning packages, such as scikit-optimize
.
In this chapter, you’ll be introduced to the Optuna
package, starting with its numerous features, how to utilize it to perform hyperparameter tuning, and all of the other important things you need to know about Optuna
. We’ll not only learn how to utilize Optuna
to perform hyperparameter tuning with their default configurations but also discuss the available configurations along with their usage. Moreover, we’ll also discuss how the implementation of the hyperparameter tuning methods is related to the theory that we have learned in previous chapters...