A Review of Uncertainty Representation and Quantification in Neural Networks.
Journal:
IEEE transactions on pattern analysis and machine intelligence
Published Date:
Mar 1, 2026
Abstract
Effectively estimating the uncertainty attached to neural network predictions thus becomes essential to improve robustness, reliability, and trustworthiness. This paper provides an overview of various methodologies for representing, quantifying, and distinguishing two major types of uncertainties (namely, 'aleatoric' and 'epistemic' uncertainty) in neural networks. The review covers classical probabilistic techniques such as Bayesian neural networks and deep ensembles, methods from generalized probability that leverage uncertainty representations such as Dirichlet distributions, belief functions, random sets, probability intervals, and credal sets, among others. Additionally, interval-based approaches employing interval models are also examined. We discuss the strengths and limitations of various methodologies and identify promising research directions for potential future exploration.
Authors
Keywords
No keywords available for this article.
