A primer on variational inference for physics-informed deep generative modelling.

Journal: Philosophical transactions. Series A, Mathematical, physical, and engineering sciences
Published Date:

Abstract

Variational inference (VI) is a computationally efficient and scalable methodology for approximate Bayesian inference. It strikes a balance between accuracy of uncertainty quantification and practical tractability. It excels at generative modelling and inversion tasks due to its built-in Bayesian regularization and flexibility, essential qualities for physics-related problems. For such problems, the underlying physical model determines the dependence between variables of interest, which in turn will require a tailored derivation for the central VI learning objective. Furthermore, in many physical inference applications, this structure has rich meaning and is essential for accurately capturing the dynamics of interest. In this paper, we provide an accessible and thorough technical introduction to VI for forward and inverse problems, guiding the reader through standard derivations of the VI framework and how it can best be realized through deep learning. We then review and unify recent literature exemplifying the flexibility allowed by VI. This paper is designed for a general scientific audience looking to solve physics-based problems with an emphasis on uncertainty quantification.This article is part of the theme issue 'Generative modelling meets Bayesian inference: a new paradigm for inverse problems'.

Authors

  • Alex Glyn-Davies
    Department of Engineering, University of Cambridge, Cambridge, Cambridgeshire, UK.
  • Arnaud Vadeboncoeur
    Department of Engineering, University of Cambridge, Cambridge, Cambridgeshire, UK.
  • O Deniz Akyildiz
    Department of Mathematics, Imperial College London, London, UK.
  • Ieva Kazlauskaite
    Department of Statistics, The London School of Economics and Political Science, London, UK.
  • Mark Girolami
    Department of Statistics, University of Warwick, UK.

Keywords

No keywords available for this article.