Hierarchical Bayesian inference for Ill-posed problems via variational method

Journal of Computational Physics

Volumn 229, Issue 19, 2010, Pages 7317-7343

  Jin, Bangti ^a   Zou, Jun ^b  

^a UNIVERSITY OF BREMEN   (Germany)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Cauchy problem; Hierarchical Bayesian inference; Inverse problem; Uncertainty quantification; Variational method

Indexed keywords

BAYESIAN NETWORKS; HEAT CONDUCTION; INFERENCE ENGINES; MARKOV PROCESSES; MONTE CARLO METHODS; NUMERICAL METHODS; ORDINARY DIFFERENTIAL EQUATIONS; PARAMETERIZATION; PROBABILITY DISTRIBUTIONS; PROBLEM SOLVING;

APPROXIMATE BAYESIAN INFERENCE; BAYESIAN INFERENCE; CAUCHY PROBLEMS; HIERARCHICAL BAYESIAN; HIERARCHICAL BAYESIAN INFERENCE; ILL POSED PROBLEM; INVERSE SOLUTION; REGULARIZATION PARAMETERS; UNCERTAINTY QUANTIFICATIONS; VARIATIONAL METHODS;

INVERSE PROBLEMS;

EID: 77955271863     PISSN: 00219991     EISSN: 10902716     Source Type: Journal    
DOI: 10.1016/j.jcp.2010.06.016     Document Type: Article

References (37)

1. Beck J.V., Blackwell B., St Clair C.R. Inverse Heat Conduction: Ill-Posed Problems 1985, Wiley, New York.
2. Tarantola A. Inverse Problem Theory and Methods for Model Parameter Estimation 2005, SIAM, Philadelphia.
3. Malinverno A., Briggs V.A. Expanded uncertainty quantification in inverse problems: hierarchical Bayes and empirical Bayes. Geophysics 2004, 69:1005-1016.
4. Kaipio J., Somersalo E. Statistical and Computational Inverse Problems 2005, Springer, New York.
5. Wang J., Zabaras N. A Bayesian inference approach to the inverse heat conduction problem. Int. J. Heat Mass Transfer 2004, 47:3927-3941.
6. Wang J., Zabaras N. Hierarchical Bayesian models for inverse problems in heat conduction. Inverse Probl. 2005, 21:183-206.
7. Emery A.F., Valenti E., Bardot D. Using Bayesian inference for parameter estimation when the system response and experimental conditions are measured with error and some variables are considered as nuisance variables. Meas. Sci. Technol. 2007, 18:19-29.
8. Jin B., Zou J. A Bayesian inference approach to the ill-posed Cauchy problem of steady-state heat conduction. Int. J. Numer. Methods Eng. 2008, 76:521-544.
9. Jin B., Zou J. Augmented Tikhonov regularization. Inverse Probl. 2009, 25:025001.
10. Jordan M.I., Ghahramani Z., Jaakkola T.S., Saul L.K. An introduction to variational methods for graphical models. Mach. Learn. 1999, 37:183-233.
11. Attias H. A variational Bayesian framework for graphical models. Advances in Neural Information Processing Systems 2000, vol. 12:209-215. MIT Press, Cambridge.
12. M.J. Beal, Variational Algorithms for Approximate Bayesian Inference, Ph.D. Dissertation, University College London, London, UK, 2003.
13. Eberly L.E., Casella G. Estimating Bayesian credible intervals. J. Stat. Plan. Infer. 2003, 112:115-132.
14. Gilks W.R., Richardson S., Spiegelhalter D.J. Markov Chain Monte Carlo in Practice 1996, Chapman & Hall.
15. Liu J.S. Monte Carlo Strategies in Scientific Computing 2008, Springer.
16. Sato M., Yoshioka T., Kajihara S., Toyama K., Goda N., Doya K., Kawato M. Hierarchical Bayesian estimation for MEG inverse problem. NeuroImage 2004, 23:806-826.
17. Babacan S.D., Molina R., Katsaggelos A.K. Parameter estimation in TV image restoration using variational distribution approximation. IEEE Trans. Image Proc. 2008, 17:326-339.
18. Quinn A., Šmídl V V. The Variational Bayes Method in Signal Processing 2005, Springer, Berlin.
19. Gibbs A.L., Su F.E. On choosing and bounding probability metrics. Int. Stat. Rev. 2002, 70:419-435.
20. Resmerita E., Anderssen R.S. Joint additive Kullback-Leibler residual minimization and regularization for linear inverse problems. Math. Methods Appl. Sci. 2007, 30:1527-1544.
21. Eggermont P.P.B. Maximum entropy regularization for Fredholm integral equations of the first kind. SIAM J. Math. Anal. 1993, 24:1557-1576.
22. Hansen P.C. Rank-Deficient and Discrete Ill-Posed Problems 1998, SIAM, Philadelphia.
23. Engl H.W., Hanke M., Neubauer A. Regularization of Inverse Problems 1996, Kluwer, Dordrecht.
24. K. Ito, B. Jin, J. Zou, A new choice rule for regularization parameters in Tikhonov regularization, Tech. Report 2008-2007(362), Department of Mathematics, Chinese University of Hong Kong, 2008.
25. Daubechies I., Dfriese M., De Mol C. An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Commun. Pure Appl. Math. 2004, 57:1413-1457.
26. S.D. Babacan, L. Mancera, R. Molina, A.K. Katsaggelos, Nonconvex priors in Bayesian compressed sensing, in: 17th European Signal Processing Conference (EUSIPCO 2009), Glasgow, Scotland, August 24-28, 2009.
27. Chappell M.A., Groves A.R., Whitcher B., Woolrich M.W. Variational Bayesian inference for a nonlinear forward model. IEEE Trans. Signal Proc. 2009, 57:223-236.
28. Jin B., Marin L. The plane wave method for some inverse problems associated with Helmholtz-type equations. Eng. Anal. Bound. Elem. 2008, 32:223-240.
29. Osman A.M., Beck J.V. Nonlinear inverse problem for the estimation of time-and-space dependent heat transfer coefficients. J. Thermophys. 1988, 3:146-152.
30. B. Jin, J. Zou, Numerical estimation of the Robin coefficient in a stationary diffusion equation, IMA J. Numer. Anal., in press, doi:10.1093/imanum/drn066.
31. Hon Y.C., Wei T. Backus-Gilbert algorithm for the Cauchy problem of the Laplace equation. Inverse Probl. 2001, 17:261-271.
32. Jin B. Fast Bayesian approach for parameter estimation. Int. J. Numer. Methods Eng. 2008, 76:230-252.
33. Isakov V. Inverse Problems for Partial Differential Equations 2006, Springer, New York. second ed.
34. B. Wang, M. Titterington, Inadequacy of interval estimates corresponding to variational Bayesian approximations, in: R. Cowell, Z. Ghahramani (Eds.), Proceedings of the Tenth International workshop on Artificial Intelligence and Statistics (6-8, January 2005, Barbados), pp. 373-380.
35. Lee H.K.H., Higdon D.M., Bi Z., Ferreira M.A.R., West M. Markov random field models for high-dimensional parameters in simulation of fluid flow in porous media. Technometrics 2002, 44:230-241.
36. Haario H., Laine M., Mira A., Saksman E. DRAM: efficient adaptive MCMC. Stat. Comput. 2006, 16:339-354.
37. Bazaraa M., Sherali H., Shetty C. Nonlinear Programming: Theory and Algorithms 1993, Wiley, New York.