Parameter and state model reduction for large-scale statistical inverse problems

SIAM Journal on Scientific Computing

Volumn 32, Issue 5, 2010, Pages 2523-2542

  Lieberman, Chad ^a   Willcox, Karen ^a   Ghattas, Omar ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Markov chain Monte Carlo; Model reduction; Optimization; Statistical inverse problems

Indexed keywords

DIFFERENTIAL EQUATIONS; GROUNDWATER; MARKOV PROCESSES; PARAMETER ESTIMATION;

GREEDY ALGORITHMS; LARGE-SCALES; MARKOV CHAIN MONTE CARLO; MARKOV CHAIN MONTE-CARLO; MODEL REDUCTION; OPTIMISATIONS; PARAMETER MODEL; REDUCED MODEL; STATE MODELS; STATISTICAL INVERSE PROBLEMS;

INVERSE PROBLEMS;

EID: 78149315678     PISSN: 10648275     EISSN: None     Source Type: Journal    
DOI: 10.1137/090775622     Document Type: Article

References (37)

1. V. Akcelik, G. Biros, O. Ghattas, J. Hill, D. Keyes, and B. van Bloeman Waanders, Parallel PDE constrained optimization, in Parallel Processing for Scientific Computing, M. Heroux, P. Raghaven, and H. Simon, eds., SIAM, Philadelphia, 2006.
2. S. Arridge, J. Kaipio, V. Kolehmainen, M. Schweiger, E. Somersalo, T. Tarvainen, and M. Vauhkonen, Approximation errors and model reduction with an application in optical diffusion tomography, Inverse Problems, 22 (2006), pp. 175-195.
3. U. Ascher and E. Haber, Grid refinement and scaling for distributed parameter estimation problems, Inverse Problems, 17 (2001), pp. 571-590.
4. I. Babuska, F. Nobile, and R. Tempone, A stochastic collocation method for elliptic partial differential equations with random input data, SIAM J. Numer. Anal., 45 (2007), pp. 1005- 1034.
5. T. Bui-Thanh, K. Willcox, and O. Ghattas, Model reduction for large-scale systems with high-dimensional parametric input space, SIAM J. Sci. Comput., 30 (2008), pp. 3270-3288.
6. D. Calvetti and E. Somersalo, Introduction to Bayesian Scientific Computing: Ten Lectures on Subjective Computing, Surv. Tutor. Appl. Math. Sci. (2), Springer, New York, 2007.
7. J. Christen and C. Fox, A general-purpose sampling algorithm for continuous distributions (the t-walk), Bayesian Analysis, 5 (2010), pp. 263-282.
8. T. Coleman and Y. Li, On the convergence of reflective Newton methods for large-scale nonlinear minimization subject to bounds, Math. Program., 67 (1994), pp. 189-224.
9. T. Coleman and Y. Li, An interior trust region approach for nonlinear minimization subject to bounds, SIAM J. Optim., 6 (1996), pp. 418-445.
10. Y. Efendiev, T. Hou, and W. Luo, Preconditioning Markov chain Monte Carlo simulations using coarse-scale models, SIAM J. Sci. Comput., 28 (2006), pp. 776-803.
11. J. Eidsvik and H. Tjelmeland, On Directional Metropolis-Hastings Algorithms, Statist. Comput. 16, Springer, New York, 2006, pp. 93-106.
12. P. Feldmann and R. Freund, Efficient linear circuit analysis by Padé approximation via the Lanczos process, IEEE Trans. Computer-Aided Des. Integr. Circuits Syst., 14 (1995), pp. 639-649.
13. K. Gallivan, E. Grimme, and P. V. Dooren, Padé approximation of large-scale dynamic systems with Lanczos methods, in Proceedings of the 33rd IEEE Conference on Decision and Control, 1994.
14. A. Gelfand and A. Smith, Sampling-based approaches to calculating marginal densities, J. Amer. Statist. Assoc., 85 (1990), pp. 398-409.
15. A. Gelman, Prior distributions for variance parameters in hierarchical models, Bayesian Anal., 1 (2006), pp. 515-533.
16. M. Grepl, Y. Maday, N. Nguyen, and A. Patera, Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations, M2AN Math. Model., 41 (2007), pp. 575-605.
17. H. Haario, M. Laine, A. Mira, and E. Saksman, DRAM: Efficient Adaptive MCMC, Statist. Comput. 16, Springer, New York, 2006, pp. 339-354.
18. H. Haario, E. Saksman, and J. Tamminen, Componentwise adaptation for high dimensional MCMC, Comput. Statist., 20 (2005), pp. 265-273.
19. W. Hastings, Monte Carlo sampling methods using Markov chains and their applications, Biometrika, 57 (1970), pp. 97-109.
20. M. Hinze, R. Pinnau, M. Ulbrich, and S. Ulbrich, Optimization with PDE Constraints, Springer, New York, 2009.
21. M. Hinze and S. Volkwein, Proper orthogonal decomposition surrogate models for nonlinear dynamical systems: Error estimates and suboptimal control, in Dimension Reduction of Large-Scale Systems, Vol.45, P. Benner, D. Sorensen, and V. Mehrmann, eds., Springer, New York, 2005, pp. 261-306.
22. P. Holmes, J. Lumley, and G. Berkooz, Turbulence, Coherent Structures, and Dynamical Systems and Symmetry, Cambridge University Press, London, 1996.
23. K. Ito and K. Kunisch, Lagrange Multiplier Approach to Variational Problems and Applications, Adv. Des. Control 15, SIAM, Philadelphia, 2008.
24. E. Jaynes, On the rationale of maximum-entropy methods, Proceedings of the IEEE, 70 (2006), pp. 939-952.
25. J. Kaipio and E. Somersalo, Statistical and Computational Inverse Problems, Appl. Math. Sci. 160, Springer, New York, 2005.
26. C. Lieberman, Parameter and State Model Reduction for Bayesian Statistical Inverse Problems, Master's thesis, Massachusetts Institute of Technology, School of Engineering, Cambridge, MA, 2009.
27. J. Liu, W. Wong, and A. Kong, Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes, Biometrika, 81 (1994), pp. 27-40.
28. Y. Marzouk, H. Najm, and L. Rahn, Stochastic spectral methods for efficient Bayesian solution of inverse problems, J. Comput. Phys., 224 (2007), pp. 560-586.
29. Y. Marzouk and H. Najm, Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems, J. Comput. Phys., 228 (2009), pp. 1862-1902.
30. N. Metropolis, A. Rosenbluth, M. Rosenbluth, A. Teller, and E. Teller, Equations of state calculations by fast computing machines, J. Chem. Phys., 21 (1953), pp. 1087-1092.
31. N. Nguyen, G. Rozza, D. Huynh, and A. Patera, Reduced basis approximation and a posteriori error estimation for parametrized parabolic PDEs; Application to real-time Bayesian parameter estimation, in Computational Methods for Large-Scale Inverse Problems and Quantification of Uncertainty, L. Biegler, G. Biros, O. Ghattas, M. Heinkenschloss, D. Keyes, B. Mallick, Y. Marzouk, L. Tenorio, B. van Bloemen Waanders, and K. Willcox, eds., Wiley, New York, 2010.
32. A. Noor, C. Andersen, and J. Peters, Reduced basis technique for collapse analysis of shells, AIAA J., 19 (1981), pp. 393-397.
33. G. Roberts and J. Rosenthal, Optimal scaling for various Metropolis-Hastings algorithms, Statist. Sci., 16 (2001), pp. 351-367.
34. L. Sirovich, Turbulence and the dynamics of coherent structures. Part 1: Coherent structures, Quart. Appl. Math., 45 (1987), pp. 561-571.
35. A. Tarantola, Inverse Problem Theory and Methods for Model Parameter Estimation, SIAM, Philadelphia, 2005.
36. K. Veroy, C. Prud'homme, D. Rovas, and A. Patera, A posteriori error bounds for reducedbasis approximation of parametrized noncoercive and nonlinear elliptic partial differential equations, in Proceedings of the 16th AIAA Computational Fluid Dynamics Conference, Orlando, FL, 2003.
37. J. Wang and N. Zabaras, Using Bayesian statistics in the estimation of heat source in radiation, Internat. J. Heat Mass Transfer, 48 (2004), pp. 15-29.