# American Institute of Mathematical Sciences

• Previous Article
Geometry of the Kahan discretizations of planar quadratic Hamiltonian systems. Ⅱ. Systems with a linear Poisson tensor
• JCD Home
• This Issue
• Next Article
A structure-preserving Fourier pseudo-spectral linearly implicit scheme for the space-fractional nonlinear Schrödinger equation
December  2019, 6(2): 385-400. doi: 10.3934/jcd.2019019

## Discrete gradients for computational Bayesian inference

 University of Potsdam, Institute of Mathematics, Karl-Liebknecht-Str. 24/25, Potsdam, D-14476, Germany

Received  March 2019 Revised  July 2019 Published  November 2019

Fund Project: This research has been partially funded by Deutsche Forschungsgemeinschaft (DFG) through grant CRC 1294 'Data Assimilation' (projects A02 and B04).

In this paper, we exploit the gradient flow structure of continuous-time formulations of Bayesian inference in terms of their numerical time-stepping. We focus on two particular examples, namely, the continuous-time ensemble Kalman–Bucy filter and a particle discretisation of the Fokker–Planck equation associated to Brownian dynamics. Both formulations can lead to stiff differential equations which require special numerical methods for their efficient numerical implementation. We compare discrete gradient methods to alternative semi-implicit and other iterative implementations of the underlying Bayesian inference problems.

Citation: Sahani Pathiraja, Sebastian Reich. Discrete gradients for computational Bayesian inference. Journal of Computational Dynamics, 2019, 6 (2) : 385-400. doi: 10.3934/jcd.2019019
##### References:

show all references

##### References:
Exact solution and numerical approximations to the mean $m_\tau$ and variance $\sigma_\tau$ estimated by the EnKBF using the discrete gradient (DG) method with $\theta = 1$ and the semi-implicit (SI) Euler method with step-sizes (a) $\Delta \tau = 0.1$, (b) $\Delta \tau = 0.2$, (c) $\Delta \tau = 0.5$, (d) $\Delta \tau = 1.0$
Exact final values and numerical approximations to the mean $m_\tau$ and variance $\sigma_\tau$ estimated by the EnKBF using the discrete gradient (DG) with $\theta = 1$, the semi-implicit (SI) Euler, and the gradient-free, explicit (IEnKF) method with step-sizes (a) $\Delta \tau = 0.01$, (b) $\Delta \tau = 0.1$, (c) $\Delta \tau = 0.2$, (d) $\Delta \tau = 0.5$. The reference time evolution of the mean and variance is given by the explicit Euler method with step-size $\Delta \tau = 0.00025$
Exact final values and numerical approximations to the mean $m_t$ and variance $\sigma_t$ for the linear problem. Posterior is estimated by the Fokker-Planck dynamics with $M = 10$ particles using the discrete gradient (DG) method with $\theta = 1$ and the semi-implicit (SI) Euler method with step-sizes (a) $\Delta \tau = 0.004$, (b) $\Delta \tau = 0.01$, (c) $\Delta \tau = 0.04$, (d) $\Delta \tau = 0.1$. The reference time evolution of the mean and variance is given by the Explicit Euler (EE) method with step-size $\Delta \tau = 2 \times 10^{-4}$
Exact final values and numerical approximations to the mean $m_t$ and variance $\sigma_t$ for the non-linear problem. Posterior is estimated by the Fokker-Planck dynamics using the discrete gradient (DG) method with $\theta = 1$ and the semi-implicit (SI) Euler method with step-sizes (a) $\Delta \tau = 0.002$, (b) $\Delta \tau = 0.005$, (c) $\Delta \tau = 0.02$, (d) $\Delta \tau = 0.05$. The reference time evolution of the mean and variance is given by the Explicit Euler (EE) method with step-size $\Delta \tau = 2.5 \times 10^{-6}$
RMSE for sequential data assimilation applied to the Lorenz-63 model. The parameter $\alpha = 1$ corresponds to a standard square root ensemble Kalman filter, while $\alpha<1$ results in a Gaussian mixture approximation to the prior and posterior distributions. Small improvements over the ensemble Kaman filter can be found for ensemble sizes $M\ge 35$
 $\alpha\backslash M$ $15$ $20$ $25$ $30$ $35$ $40$ $45$ $50$ $0.8$ $2.5145$ $2.4726$ $2.4471$ $2.4406$ $2.4221$ $2.4173$ $2.4162$ $2.4112$ $0.85$ $2.5048$ $2.4585$ $2.4357$ $2.4330$ $2.4186$ $2.4161$ $2.4020$ $2.4026$ $0.9$ $2.4989$ $2.4493$ $2.4396$ $2.4259$ $2.4177$ $2.4103$ $2.4106$ $2.4075$ $0.95$ $2.4998$ $2.4605$ $2.4399$ $2.4327$ $2.4242$ $2.4132$ $2.4162$ $2.4131$ $1.0$ $2.4804$ $2.4597$ $2.4518$ $2.4354$ $2.4334$ $2.4247$ $2.4244$ $2.4203$
 $\alpha\backslash M$ $15$ $20$ $25$ $30$ $35$ $40$ $45$ $50$ $0.8$ $2.5145$ $2.4726$ $2.4471$ $2.4406$ $2.4221$ $2.4173$ $2.4162$ $2.4112$ $0.85$ $2.5048$ $2.4585$ $2.4357$ $2.4330$ $2.4186$ $2.4161$ $2.4020$ $2.4026$ $0.9$ $2.4989$ $2.4493$ $2.4396$ $2.4259$ $2.4177$ $2.4103$ $2.4106$ $2.4075$ $0.95$ $2.4998$ $2.4605$ $2.4399$ $2.4327$ $2.4242$ $2.4132$ $2.4162$ $2.4131$ $1.0$ $2.4804$ $2.4597$ $2.4518$ $2.4354$ $2.4334$ $2.4247$ $2.4244$ $2.4203$
 [1] Qian Liu, Shuang Liu, King-Yeung Lam. Asymptotic spreading of interacting species with multiple fronts Ⅰ: A geometric optics approach. Discrete & Continuous Dynamical Systems - A, 2020, 40 (6) : 3683-3714. doi: 10.3934/dcds.2020050 [2] Predrag S. Stanimirović, Branislav Ivanov, Haifeng Ma, Dijana Mosić. A survey of gradient methods for solving nonlinear optimization. Electronic Research Archive, 2020, 28 (4) : 1573-1624. doi: 10.3934/era.2020115 [3] Gabrielle Nornberg, Delia Schiera, Boyan Sirakov. A priori estimates and multiplicity for systems of elliptic PDE with natural gradient growth. Discrete & Continuous Dynamical Systems - A, 2020, 40 (6) : 3857-3881. doi: 10.3934/dcds.2020128 [4] Shin-Ichiro Ei, Hiroshi Ishii. The motion of weakly interacting localized patterns for reaction-diffusion systems with nonlocal effect. Discrete & Continuous Dynamical Systems - B, 2021, 26 (1) : 173-190. doi: 10.3934/dcdsb.2020329 [5] Thomas Frenzel, Matthias Liero. Effective diffusion in thin structures via generalized gradient systems and EDP-convergence. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 395-425. doi: 10.3934/dcdss.2020345 [6] Hua Shi, Xiang Zhang, Yuyan Zhang. Complex planar Hamiltonian systems: Linearization and dynamics. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020406 [7] Lei Yang, Lianzhang Bao. Numerical study of vanishing and spreading dynamics of chemotaxis systems with logistic source and a free boundary. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 1083-1109. doi: 10.3934/dcdsb.2020154 [8] Michel Chipot, Mingmin Zhang. On some model problem for the propagation of interacting species in a special environment. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020401 [9] Philippe G. Ciarlet, Liliana Gratie, Cristinel Mardare. Intrinsic methods in elasticity: a mathematical survey. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 133-164. doi: 10.3934/dcds.2009.23.133 [10] Martin Heida, Stefan Neukamm, Mario Varga. Stochastic homogenization of $\Lambda$-convex gradient flows. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 427-453. doi: 10.3934/dcdss.2020328 [11] Meng Chen, Yong Hu, Matteo Penegini. On projective threefolds of general type with small positive geometric genus. Electronic Research Archive, , () : -. doi: 10.3934/era.2020117 [12] Feifei Cheng, Ji Li. Geometric singular perturbation analysis of Degasperis-Procesi equation with distributed delay. Discrete & Continuous Dynamical Systems - A, 2021, 41 (2) : 967-985. doi: 10.3934/dcds.2020305 [13] João Vitor da Silva, Hernán Vivas. Sharp regularity for degenerate obstacle type problems: A geometric approach. Discrete & Continuous Dynamical Systems - A, 2021, 41 (3) : 1359-1385. doi: 10.3934/dcds.2020321 [14] Lekbir Afraites, Chorouk Masnaoui, Mourad Nachaoui. Shape optimization method for an inverse geometric source problem and stability at critical shape. Discrete & Continuous Dynamical Systems - S, 2021  doi: 10.3934/dcdss.2021006 [15] Xing-Bin Pan. Variational and operator methods for Maxwell-Stokes system. Discrete & Continuous Dynamical Systems - A, 2020, 40 (6) : 3909-3955. doi: 10.3934/dcds.2020036 [16] Elena Nozdrinova, Olga Pochinka. Solution of the 33rd Palis-Pugh problem for gradient-like diffeomorphisms of a two-dimensional sphere. Discrete & Continuous Dynamical Systems - A, 2021, 41 (3) : 1101-1131. doi: 10.3934/dcds.2020311 [17] Peter Frolkovič, Karol Mikula, Jooyoung Hahn, Dirk Martin, Branislav Basara. Flux balanced approximation with least-squares gradient for diffusion equation on polyhedral mesh. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 865-879. doi: 10.3934/dcdss.2020350 [18] Xuefei He, Kun Wang, Liwei Xu. Efficient finite difference methods for the nonlinear Helmholtz equation in Kerr medium. Electronic Research Archive, 2020, 28 (4) : 1503-1528. doi: 10.3934/era.2020079 [19] Xin Guo, Lei Shi. Preface of the special issue on analysis in data science: Methods and applications. Mathematical Foundations of Computing, 2020, 3 (4) : i-ii. doi: 10.3934/mfc.2020026 [20] Shun Zhang, Jianlin Jiang, Su Zhang, Yibing Lv, Yuzhen Guo. ADMM-type methods for generalized multi-facility Weber problem. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020171

Impact Factor: