Exploring Microsoft NNI
Neural Network Intelligence (NNI) is a package that is developed by Microsoft and can be utilized not only for hyperparameter tuning tasks but also for neural architecture search, model compression, and feature engineering. We discussed how to utilize NNI to conduct hyperparameter tuning experiments in Chapter 10, Advanced Hyperparameter Tuning with DEAP and Microsoft NNI.
In this section, we will discuss how to utilize this package to track those experiments. All of the experiment tracking modules provided by NNI are located in the web portal. You learned about the web portal in Chapter 10, Advanced Hyperparameter Tuning with DEAP and Microsoft NNI. However, we haven’t discussed it in depth and there are many useful features you should know about.
The web portal can be utilized to visualize all of the hyperparameter tuning experiment’s metadata, including (but not limited to) tuning and training progress, evaluation metrics, and error...