Book Image

Enhancing Deep Learning with Bayesian Inference

By : Matt Benatan, Jochem Gietema, Marian Schneider
Book Image

Enhancing Deep Learning with Bayesian Inference

By: Matt Benatan, Jochem Gietema, Marian Schneider

Overview of this book

Deep learning has an increasingly significant impact on our lives, from suggesting content to playing a key role in mission- and safety-critical applications. As the influence of these algorithms grows, so does the concern for the safety and robustness of the systems which rely on them. Simply put, typical deep learning methods do not know when they don’t know. The field of Bayesian Deep Learning contains a range of methods for approximate Bayesian inference with deep networks. These methods help to improve the robustness of deep learning systems as they tell us how confident they are in their predictions, allowing us to take more in how we incorporate model predictions within our applications. Through this book, you will be introduced to the rapidly growing field of uncertainty-aware deep learning, developing an understanding of the importance of uncertainty estimation in robust machine learning systems. You will learn about a variety of popular Bayesian Deep Learning methods, and how to implement these through practical Python examples covering a range of application scenarios. By the end of the book, you will have a good understanding of Bayesian Deep Learning and its advantages, and you will be able to develop Bayesian Deep Learning models for safer, more robust deep learning systems.
Table of Contents (11 chapters)

3.6 Further reading

There are a lot of great resources to learn more about the essential building blocks of deep learning. Here are just a few popular resources that are a great start:

  • Nielsen, M.A., 2015. Neural networks and deep learning (Vol. 25). San Francisco, CA, USA: Determination press., http://neuralnetworksanddeeplearning.com/.

  • Chollet, F., 2021. Deep learning with Python. Simon and Schuster.

  • Raschka, S., 2015. Python Machine Learning. Packt Publishing Ltd.

  • Ng, Andrew, 2022, Deep Learning Specialization. Coursera.

  • Johnson, Justin, 2019. EECS 498-007 / 598-005, Deep Learning for Computer Vision. University of Michigan.

To learn more about the problems of deep learning models, you can read some of the following resources:

  • Overconfidence and calibration:

    • Guo, C., Pleiss, G., Sun, Y. and Weinberger, K.Q., 2017, July. On calibration of modern neural networks. In International conference on machine learning (pp. 1321-1330). PMLR.

    • Ovadia, Y., Fertig, E., Ren, J., Nado, Z., Sculley...