On the brittleness of Bayesian inference

SIAM Review

Volumn 57, Issue 4, 2015, Pages 566-582

  Owhadi, Houman ^a   Scovel, Clint ^a   Sullivan, Tim ^b  

^a California Institute of Technology   (United States)

^b UNIVERSITY OF WARWICK   (United Kingdom)

Author keywords

Bayesian inference; Bayesian sensitivity analysis; Misspecification; Optimal uncertainty quantification; Robustness; Uncertainty quantification

Indexed keywords

BAYESIAN NETWORKS; BRITTLENESS; FRACTURE MECHANICS; INFERENCE ENGINES; PLASTICITY; ROBUSTNESS (CONTROL SYSTEMS); SENSITIVITY ANALYSIS;

ANTAGONISTIC REQUIREMENTS; BAYESIAN INFERENCE; BAYESIAN SENSITIVITY ANALYSIS; GENERALIZED MOMENTS; HIGH PERFORMANCE COMPUTING; MISSPECIFICATION; STABILITY CONDITION; UNCERTAINTY QUANTIFICATIONS;

UNCERTAINTY ANALYSIS;

EID: 84947902805     PISSN: 00361445     EISSN: None     Source Type: Journal    
DOI: 10.1137/130938633     Document Type: Article

References (61)

1. S. Arnborg and G. Sjödin, On the foundations of Bayesianism, in Bayesian Inference and Maximum Entropy Methods in Science and Engineering (Gif-sur-Yvette, 2000), AIP Conf. Proc. 568, Amer. Inst. Phys., Melville, NY, 2001, pp. 61-71.
2. R. R. Bahadur and L. J. Savage, The nonexistence of certain statistical procedures in non-parametric problems, Ann. Math. Statist., 27 (1956), pp. 1115-1122.
3. G. Belot, Bayesian orgulity, Philos. Sci., 80 (2013), pp. 483-503.
4. J. O. Berger, The robust Bayesian viewpoint, in Robustness of Bayesian Analyses, Stud. Bayesian Econometrics 4, North-Holland, Amsterdam, 1984, pp. 63-144.
5. J. O. Berger, Statistical Decision Theory and Bayesian Analysis, 2nd ed., Springer-Verlag, New York, 1985.
6. J. O. Berger, An overview of robust Bayesian analysis, Test, 3 (1994), pp. 5-124.
7. R. H. Berk, Limiting behavior of posterior distributions when the model is incorrect, Ann. Math. Statist., 37 (1966), pp. 51-58; correction, 37 (1966), pp. 745-746.
8. S. N. BernšteѤn, Sobranie sochinenii. Tom IV: Teoriya veroyatnostei. Matematicheskaya statistika. 1911-1946, Izdat. "Nauka", Moscow, 1964.
9. P. Billingsley, Convergence of Probability Measures, 2nd ed., Wiley, New York, 1999.
10. D. Blackwell and L. Dubins, Merging of opinions with increasing information, Ann. Math. Statist., 33 (1962), pp. 882-886.
11. G. E. P. Box, Non-normality and tests on variances, Biometrika, 40 (1953), pp. 318-335.
12. G. E. P. Box and N. R. Draper, Empirical Model-Building and Response Surfaces, Wiley Series in Probability and Mathematical Statistics: Applied Probability and Statistics, Wiley, New York, 1987.
13. I. Castillo and R. Nickl, Nonparametric Bernstein-von Mises theorems in Gaussian white noise, Ann. Statist., 41 (2013), pp. 1999-2028.
14. I. Castillo and R. Nickl, On the Bernstein-von Mises phenomenon for nonparametric Bayes procedures, Ann. Statist., 42 (2014), pp. 1941-1969.
15. R. T. Cox, Probability, frequency and reasonable expectation, Amer. J. Phys., 14 (1946), pp. 1-13.
16. A. Cuevas, Qualitative robustness in abstract inference, J. Statist. Plann. Inference, 18 (1988), pp. 277-289.
17. P. Diaconis and D. A. Freedman, On the consistency of Bayes estimates, Ann. Statist., 14 (1986), pp. 1-67.
18. D. L. Donoho, One-sided inference about functionals of a density, Ann. Statist., 16 (1988), pp. 1390-1420.
19. J. L. Doob, Application of the theory of martingales, in Le Calcul des Probabilités et ses Applications, Colloq. Internat. CNRS 13, Centre National de la Recherche Scientifique, Paris, 1949, pp. 23-27.
20. M. J. Dupré and F. J. Tipler, New axioms for rigorous Bayesian probability, Bayesian Anal., 4 (2009), pp. 599-606.
21. B. Efron, Bayes' theorem in the 21st century, Science, 340 (2013), pp. 1177-1178.
22. T. S. Ferguson, Mathematical Statistics: A Decision Theoretic Approach, Probab. Math. Statist. 1, Academic Press, New York, London, 1967.
23. D. A. Freedman, On the asymptotic behavior of Bayes' estimates in the discrete case, Ann. Math. Statist., 34 (1963), pp. 1386-1403.
24. D. A. Freedman, On the Bernstein-von Mises theorem with infinite-dimensional parameters, Ann. Statist., 27 (1999), pp. 1119-1140.
25. A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin, Bayesian Data Analysis, 2nd ed., Texts in Statistical Science Series, Chapman & Hall/CRC, Boca Raton, FL, 2004.
26. A. Gelman, X.-L. Meng, and H. Stern, Posterior predictive assessment of model fitness via realized discrepancies, Statist. Sinica, 6 (1996), pp. 733-807.
27. P. Gustafson and L. Wasserman, Local sensitivity diagnostics for Bayesian inference, Ann. Statist., 23 (1995), pp. 2153-2167.
28. J. Y. Halpern, A counterexample to theorems of Cox and Fine, J. Artificial Intelligence Res., 10 (1999), pp. 67-85.
29. J. Y. Halpern, Cox's theorem revisited. Technical addendum to: "A counterexample to theorems of Cox and Fine" [J. Artificial Intelligence Res., 10 (1999), pp. 67-85], J. Artificial Intelligence Res., 11 (1999), pp. 429-435.
30. F. R. Hampel, A general qualitative definition of robustness, Ann. Math. Statist., 42 (1971), pp. 1887-1896.
31. M. Hardy, Scaled Boolean algebras, Adv. in Appl. Math., 29 (2002), pp. 243-292.
32. J. A. Hausman and W. E. Taylor, A generalized specification test, Econom. Lett., 8 (1981), pp. 239-245.
33. P. J. Huber and E. M. Ronchetti, Robust Statistics, 2nd ed., Wiley Series in Probability and Statistics, Wiley, Hoboken, NJ, 2009.
34. E. T. Jaynes, Probability Theory: The Logic of Science, Cambridge University Press, Cambridge, UK, 2003.
35. I. M. Johnstone, High dimensional Bernstein-von Mises: Simple examples, in Borrowing Strength: Theory Powering Applications: A Festschrift for Lawrence D. Brown, Inst. Math. Stat. Collect. 6, Inst. Math. Statist., Beachwood, OH, 2010, pp. 87-98.
36. B. J. K. Kleijn and A. W. van der Vaart, Misspecification in infinite-dimensional Bayesian statistics, Ann. Statist., 34 (2006), pp. 837-877.
37. B. J. K. Kleijn and A. W. van der Vaart, The Bernstein-Von-Mises theorem under mis-specification, Electron. J. Stat., 6 (2012), pp. 354-381.
38. L. Le Cam, On some asymptotic properties of maximum likelihood estimates and related Bayes' estimates, Univ. California Publ. Statist., 1 (1953), pp. 277-329.
39. L. Le Cam and L. Schwartz, A necessary and sufficient condition for the existence of consistent estimates, Ann. Math. Statist., 31 (1960), pp. 140-150.
40. H. Leahu, On the Bernstein-von Mises phenomenon in the Gaussian white noise model, Electron. J. Stat., 5 (2011), pp. 373-404.
41. D. V. Lindley, Making Decisions, 2nd ed., Wiley, London, 1985.
42. D. G. Mayo, How can we cultivate Senn's ability?, Rationality Markets Morals, 3 (2012), pp. 14-18.
43. D. G. Mayo and A. Spanos, Methodology in practice: Statistical misspecification testing, Philos. Sci., 71 (2004), pp. 1007-1025.
44. I. Mizera, Qualitative robustness and weak continuity: The extreme unction, in Nonparametrics and Robustness in Modern Statistical Inference and Time Series Analysis: A Festschrift in Honor of Professor Jana Jurecková, Inst. Math. Stat. Collect. 7, Inst. Math. Statist., Beachwood, OH, 2010, pp. 169-181.
45. H. Owhadi and C. Scovel, Qualitative Robustness in Bayesian Inference, preprint, arXiv: 1411.3984, 2014.
46. H. Owhadi and C. Scovel, Brittleness of Bayesian inference and new Selberg formulas, Commun. Math. Sci., to appear (2015); arXiv:1304.7046.
47. H. Owhadi, C. Scovel, and T. J. Sullivan, Brittleness of Bayesian inference under finite information in a continuous world, Electron. J. Stat., 9 (2015), pp. 1-79.
48. H. Owhadi, C. Scovel, T. J. Sullivan, M. McKerns, and M. Ortiz, Optimal uncertainty quantification, SIAM Rev., 55 (2013), pp. 271-345.
49. S. T. Rachev, Probability Metrics and the Stability of Stochastic Models, Wiley, Chichester, UK, 1991.
50. L. Schwartz, On Bayes procedures, Z. Wahrscheinlichkeitstheorie und Verw. Gebiete, 4 (1965), pp. 10-26.
51. S. Senn, You may believe you are a Bayesian but you are probably wrong, Rationality Markets Morals, 2 (2011), pp. 48-66.
52. C. R. Shalizi, Dynamics of Bayesian updating with dependent data and misspecified models, Electron. J. Stat., 3 (2009), pp. 1039-1074.
53. A. M. Stuart, Inverse problems: A Bayesian perspective, Acta Numer., 19 (2010), pp. 451-559.
54. R. Tibshirani and L. A. Wasserman, Sensitive parameters, Canad. J. Statist., 16 (1988), pp. 185-192.
55. A. W. van der Vaart and J. H. van Zanten, Rates of contraction of posterior distributions based on Gaussian process priors, Ann. Statist., 36 (2008), pp. 1435-1463.
56. R. von Mises, Mathematical Theory of Probability and Statistics, H. Geiringer, ed., Academic Press, New York, 1964.
57. A. Wald, Statistical Decision Functions, Wiley, New York, 1950.
58. L. Wasserman, M. Lavine, and R. L. Wolpert, Linearization of Bayesian robustness problems, J. Statist. Plann. Inference, 37 (1993), pp. 307-316.
59. L. Wasserman and T. Seidenfeld, The dilation phenomenon in robust Bayesian inference, J. Statist. Plann. Inference, 40 (1994), pp. 345-356.
60. L. A. Wasserman, Prior envelopes based on belief functions, Ann. Statist., 18 (1990), pp. 454-464.
61. H. White, Maximum likelihood estimation of misspecified models, Econometrica, 50 (1982), pp. 1-25.