Π4U: A high performance computing framework for Bayesian uncertainty quantification of complex models

Journal of Computational Physics

Volumn 284, Issue , 2015, Pages 1-21

  Hadjidoukas, P E ^a   Angelikopoulos, P ^a   Papadimitriou, C ^b   Koumoutsakos, P ^a  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY OF THESSALY   (Greece)

Author keywords

Bayesian inference; Distributed computing; Parallel computing; Reliability; Uncertainty quantification

Indexed keywords

APPROXIMATION ALGORITHMS; BAYESIAN NETWORKS; CLUSTERING ALGORITHMS; COMPUTER ARCHITECTURE; COMPUTER PROGRAMMING; COVARIANCE MATRIX; DISTRIBUTED COMPUTER SYSTEMS; EVOLUTIONARY ALGORITHMS; MARKOV PROCESSES; MOLECULAR DYNAMICS; OPTIMIZATION; STOCHASTIC SYSTEMS; STRUCTURAL DYNAMICS; UNCERTAINTY ANALYSIS;

ASYMPTOTIC APPROXIMATION; BAYESIAN; BAYESIAN INFERENCE; COMPLEX MODEL; COMPUTING FRAMEWORKS; EXTENSIBLE FRAMEWORK; PARALLEL COM- PUTING; PERFORMANCE COMPUTING; PHYSICAL MODELLING; UNCERTAINTY QUANTIFICATIONS;

INFERENCE ENGINES;

EID: 84920129689     PISSN: 00219991     EISSN: 10902716     Source Type: Journal    
DOI: 10.1016/j.jcp.2014.12.006     Document Type: Article

References (68)

1. Karniadakis G., Glimm J. Uncertainty quantification in simulation science. J. Comput. Phys. 2006, 217(1):1-4.
2. Najm H.N. Uncertainty quantification and polynomial chaos techniques in computational fluid dynamics. Annu. Rev. Fluid Mech. 2008, 41(1):35-52.
3. Owhadi H., Scovel C., Sullivan T., McKerns M., Ortiz M. Optimal uncertainty quantification. SIAM Rev. 2013, 55(2):271-345.
4. Beck J.L., Yuen K.V. Model selection using response measurements: Bayesian probabilistic approach. J. Eng. Mech. 2004, 130(2):192-203.
5. Angelikopoulos P., Papadimitriou C., Koumoutsakos P. Bayesian uncertainty quantification and propagation in molecular dynamics simulations: a high performance computing framework. J. Chem. Phys. 2012, 137(14):144103. (19 pp.).
6. Papadimitriou C., Beck J.L., Katafygiotis L.S. Asymptotic expansions for reliability and moments of uncertain systems. J. Eng. Mech. 1997, 123(12):1219-1229.
7. Stenger F. Asymptotic approximation of certain integrals. Not. Am. Math. Soc. 1969, 16(1):95.
8. Haario H., Laine M., Mira A., Saksman E. Dram: efficient adaptive MCMC. Stat. Comput. 2006, 16:339-354.
9. Ching J.Y., Chen Y.C. Transitional Markov chain Monte Carlo method for Bayesian model updating, model class selection, and model averaging. J. Eng. Mech. 2007, 133(7):816-832.
10. Cheng M.H., Wu S., Heaton T.H., Beck J.L. Earthquake early warning application to buildings. Eng. Struct. 2014, 60:155-164.
11. Adams B., Bohnhoff W., Dalbey K., Eddy J., Eldred M., Gay D., Haskell K., Hough P., Swiler L. DAKOTA, a multilevel parallel object-oriented framework for design optimization, parameter estimation, uncertainty quantification, and sensitivity analysis: Version 5.3, User's Manual SAND2010-2183 May 2013, Sandia technical report.
12. Lawrence Livermore National Laboratory. The PSUADE uncertainty quantification project, [online]. http://computation.llnl.gov/casc/uncertainty_quantification/.
13. McKerns M., Strand L., Sullivan T., Fang A., Aivazis M. Building a framework for predictive science. The 10th Python in Science Conference 2011, 1-12.
14. Prudencio E.E., Schulz K.W. The Parallel C++ Statistical Library 'QUESO': quantification of uncertainty for estimation, simulation and optimization. Lect. Notes Comput. Sci. 2012, vol. 7155:398-407. Springer, Berlin, Heidelberg.
15. Prudencio E., Cheung S.H. Parallel adaptive multilevel sampling algorithms for the Bayesian analysis of mathematical models. Int. J. Uncertain. Quantificat. 2012, 2(3):215-237.
16. Sukys J. Adaptive load balancing for massively parallel multi-level Monte Carlo solvers. Parallel Processing and Applied Mathematics - 10th International Conference, Revised Selected Papers, Part I 2013, 47-56.
17. Hadjidoukas P.E., Lappas E., Dimakopoulos V.V. A runtime library for platform-independent task parallelism. 20th International Conference on Parallel, Distributed and Network-Based Processing (PDP), Euromicro 2012, 229-236.
18. Galbally D., Fidkowski K., Willcox K., Ghattas O. Non-linear model reduction for uncertainty quantification in large-scale inverse problems. Int. J. Numer. Methods Eng. 2010, 81(12):1581-1608.
19. Hansen N., Muller S.D., Koumoutsakos P. Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evol. Comput. 2003, 11(1):1-18.
20. Au S., Beck J. Estimation of small failure probabilities in high dimensions by subset simulation. Probab. Eng. Mech. 2001, 16:263-277.
21. Beck J.L., Katafygiotis L.S. Updating models and their uncertainties. I: Bayesian statistical framework. J. Eng. Mech. 1998, 124(4):455-461.
22. Katafygiotis L.S., Beck J.L. Updating models and their uncertainties. II: Model identifiability. J. Eng. Mech. 1998, 124(4):463-467.
23. Beck J.L. Bayesian system identification based on probability logic. Struct. Control Health Monit. 2010, 17(7):825-847.
24. Yuen K.-V. Bayesian Methods for Structural Dynamics and Civil Engineering 2010, Wiley-Vch Verlag. 1st edition.
25. Vanik M.W., Beck J.L., Au S.K. Bayesian probabilistic approach to structural health monitoring. J. Eng. Mech. 2000, 126(7):738-745.
26. Hastings W.K. Monte Carlo sampling methods using Markov chains and their applications. Biometrika 1970, 57(1):97-109.
27. Girolami M., Calderhead B. Riemann manifold Langevin and Hamiltonian Monte Carlo methods. J. R. Stat. Soc., Ser. B, Stat. Methodol. 2011, 73:123-214.
28. Green P.J. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 1995, 82(4):711-732.
29. Ter Braak C.J., Vrugt J.A. Differential evolution Markov chain with snooker updater and fewer chains. Stat. Comput. 2008, 18(4):435-446.
30. Katafygiotis L., Lam H.-F., Papadimitriou C. Treatment of unidentifiability in structural model updating. Adv. Struct. Eng. 2000, 3(1):19-39.
31. Chib S. Marginal likelihood from the Gibbs output. J. Am. Stat. Assoc. 1995, 90(432):1313-1321.
32. Friel N., Pettitt A.N. Marginal likelihood estimation via power posteriors. J. R. Stat. Soc., Ser. B, Stat. Methodol. 2008, 70:589-607.
33. Doucet A., De Freitas N., Gordon N. Sequential Monte Carlo Methods in Practice 2001, Springer-Verlag.
34. Papadimitriou C., Katafygiotis L. A Bayesian methodology for structural integrity and reliability assessment. Int. J. Adv. Manuf. Syst. 2001, 4(1):93-100.
35. Papadimitriou C., Beck J.L., Katafygiotis L.S. Updating robust reliability using structural test data. Probab. Eng. Mech. 2001, 16(2):103-113.
36. Beck J.L., Taflanidis A.A. Prior and posterior robust stochastic predictions for dynamical systems using probability logic. Int. J. Uncertain. Quantificat. 2013, 3(4):271-288.
37. Jensen H., Vergara C., Papadimitriou C., Millas E. The use of updated robust reliability measures in stochastic dynamical systems. Comput. Methods Appl. Mech. Eng. 2013, 267:293-317.
38. Ntotsios E., Papadimitriou C. Multi-objective optimization algorithms for finite element model updating. ISMA2008 International Conference on Noise and Vibration Engineering 2008, 1895-1909.
39. Papadimitriou D.I., Papadimitriou C. Optimal sensor location for model parameter estimation in CFD. 21st AIAA Computational Fluid Dynamics Conference 2013, 1-10. American Institute of Aeronautics and Astronautics.
40. Flath H.P., Wilcox L.C., Akcelik V., Hill J., Waanders B.V., Ghattas O. Fast algorithms for Bayesian uncertainty quantification in large-scale linear inverse problems based on low-rank partial Hessian approximations. SIAM J. Sci. Comput. 2011, 33(1):407-432.
41. Asselmeyer T., Ebeling W., Rose H. Evolutionary strategies of optimization. Phys. Rev. E 1997, 56(1):1171-1180.
42. Barnes B.C., Gelb L.D. Meta-optimization of evolutionary strategies for empirical potential development: application to aqueous silicate systems. J. Chem. Theory Comput. 2007, 3(5):1749-1764.
43. Zhao J., Han C.Z., Wei B. Binary particle swarm optimization with multiple evolutionary strategies. Sci. China, Inf. Sci. 2012, 55(11):2485-2494.
44. Hadjidoukas P.E., Angelikopoulos P., Voglis C., Papageorgiou D.G., Lagaris I.E. NDL-v2.0: a new version of the numerical differentiation library for parallel architectures. Comput. Phys. Commun. 2014, 185(7):2217-2219.
45. Beck J.L., Au S.K. Bayesian updating of structural models and reliability using Markov chain Monte Carlo simulation. J. Eng. Mech. 2002, 128(4):380-391.
46. Hadjidoukas P., Voglis C., Dimakopoulos V., Lagaris I., Papageorgiou D. Supporting adaptive and irregular parallelism for non-linear numerical optimization. Appl. Math. Comput. 2014, 231:544-559.
47. Kincaid D., Cheney W. Mathematics of Scientific Computing 1996, Brooks/Cole, Pacific Grove, CA.
48. Rick S. A reoptimization of the five-site water potential (TIP5P) for use with Ewald sums. J. Chem. Phys. 2004, 120:6085-6093.
49. Iordanov T.D., Schenter G.K., Garrett B.C. Sensitivity analysis of thermodynamic properties of liquid water: a general approach to improve empirical potentials. J. Phys. Chem. A 2005, 110(2):762-771.
50. Jorgensen W.L., Jenson C., Mahoney M.W. Liquid water models: beyond TIP4P and the density (t) problem. Abstr. Pap., Am. Chem. Soc. 1999, 218:U314.
51. Cailliez F., Bourasseau A., Pernot P. Calibration of forcefields for molecular simulation: sequential design of computer experiments for building cost-efficient kriging metamodels. J. Comput. Chem. 2014, 35(2):130-149.
52. Rizzi F., Najm H., Debusschere B., Sargsyan K., Salloum M., Adalsteinsson H., Knio O. Uncertainty quantification in MD simulations. Part II: Bayesian inference of force-field parameters. Multiscale Model. Simul. 2012, 10(4):1460-1492.
53. Angelikopoulos P., Papadimitriou C., Koumoutsakos P. Data driven, predictive molecular dynamics for nanoscale flow simulations under uncertainty. J. Phys. Chem. B 2013, 117(47):14808-14816.
54. Soper A.K. The radial distribution functions of water as derived from radiation total scattering experiments: is there anything we can say for sure?. ISRN Phys. Chem. 2013, 279463.
55. Pronk S., Páll S., Schulz R., Larsson P., Bjelkmar P., Apostolov R., Shirts M.R., Smith J.C., Kasson P.M., van der Spoel D., Hess B., Lindahl E. Gromacs 4.5: a high-throughput and highly parallel open source molecular simulation toolkit. Bioinformatics 2013, 29(7):845-854.
56. Simoen E., Papadimitriou C., Lombaert G. On prediction error correlation in Bayesian model updating. J. Sound Vib. 2013, 332(18):4136-4152.
57. Mahoney M., Jorgensen W. A five-site model for liquid water and the reproduction of the density anomaly by rigid, nonpolarizable potential functions. J. Chem. Phys. 2000, 112:8910-8922.
58. Papadimitriou C., Papadioti D.-C. Component mode synthesis techniques for finite element model updating. Comput. Struct. 2013, 126:15-28.
59. Craig R.R., Bampton M.C.C. Coupling of substructures for dynamic analyses. AIAA J. 1968, 6(7):1313-1323.
60. Tsuji Y., Tanaka T., Ishida T. Lagrangian numerical simulation of plug flow of cohesionless particles in a horizontal pipe. Powder Technol. 1992, 71(3):239-250.
61. Pöschel T., Schwager T. Computational Granular Dynamics - Models and Algorithms, vol. 8 2006, Springer-Verlag.
62. Kruggel-Emden H., Wirtz S., Scherer V. A study on tangential force laws applicable to the discrete element method (DEM) for materials with viscoelastic or plastic behavior. Chem. Eng. Sci. 2008, 63(6):1523-1541.
63. Brendel L., Dippel S. Lasting contacts in molecular dynamics simulations. Physics of Dry Granular Media 1998, 3-31. Kluwer Academic Publishers.
64. Hirshfeld D., Rapaport D. Granular flow from a silo: discrete-particle simulations in three dimensions. Eur. Phys. J. E, Soft Matter Biol. Phys. 2001, 4(2):193-199.
65. Hadjidoukas P.E., Angelikopoulos P., Rossinelli D., Alexeev D., Papadimitriou C., Koumoutsakos P. Bayesian uncertainty quantification and propagation for discrete element simulations of granular materials. Comput. Methods Appl. Mech. Eng. 2014, 282:218-238.
66. Schwager T., Becker V., Pöschel T. Coefficient of tangential restitution for viscoelastic spheres. Eur. Phys. J. E 2008, 27(1):107-114.
67. Dong H., Moys M.H. Experimental study of oblique impacts with initial spin. Powder Technol. 2006, 161(1):22-31.
68. Chiachio M., Beck J., Chiachio J., Rus G. Approximate Bayesian computation by subset simulation. SIAM J. Sci. Comput. 2014, 36(3):A1339-A1358.