The Bernstein-von Mises theorem and nonregular models

Annals of Statistics

Volumn 42, Issue 5, 2014, Pages 1850-1878

  Bochkina, Natalia A ^a,b   Green, Peter J ^c,d  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b MAXWELL INSTITUTE FOR MATHEMATICAL SCIENCES   (United Kingdom)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Approximate posterior; Bayesian inference; Bernstein von Mises theorem; Boundary; Nonregular; Posterior concentration; Spect; Tomography; Total variation distance; Variance estimation in mixed models

Indexed keywords

EID: 84908258625     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/14-AOS1239     Document Type: Article

References (28)

1. Barron, A., Schervish, M. J. and Wasserman, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536-561. MR1714718
2. Bertsekas, D. P. (2003). Convex Analysis and Optimization. Athena Scientific and Tsinghua Univ. Press, Belmont, MA.
3. Besag, J. (1986). On the statistical analysis of dirty pictures. J. Roy. Statist. Soc. Ser. B 48 259-302. MR0876840
4. Bochkina, N. (2013). Consistency of the posterior distribution in generalized linear inverse problems. Inverse Problems 29 095010, 43. MR3094485
5. Chernozhukov, V. and Hong, H. (2004). Likelihood estimation and inference in a class of nonregular econometric models. Econometrica 72 1445-1480. MR2077489
6. Douc, R., Moulines, E., Olsson, J. and van Handel, R. (2011). Consistency of the maximum likelihood estimator for general hidden Markov models. Ann. Statist. 39 474-513. MR2797854
7. Dudley, R. M. and Haughton, D. (2002). Asymptotic normality with small relative errors of posterior probabilities of half-spaces. Ann. Statist. 30 1311-1344. MR1936321
8. Erkanli, A. (1994). Laplace approximations for posterior expectations when the mode occurs at the boundary of the parameter space. J. Amer. Statist. Assoc. 89 250-258. MR1266297
9. Geman, S. and Geman, D. (1984). Stochastic relaxation, gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6 721-741.
10. Ghosal, S., Ghosh, J. K. and Samanta, T. (1995). On convergence of posterior distributions. Ann. Statist. 23 2145-2152. MR1389869
11. Ghosal, S. and Samanta, T. (1995). Asymptotic behaviour of Bayes estimates and posterior distributions in multiparameter nonregular cases. Math. Methods Statist. 4 361-388. MR1372011
12. Ghosh, J. K., Ghosal, S. and Samanta, T. (1994). Stability and convergence of the posterior in non-regular problems. In Statistical Decision Theory and Related Topics, V (West Lafayette, IN, 1992) (S. S. Gupta and J. O. Berger, eds.) 183-199. Springer, New York. MR1286304
13. Green, P. J. (1990). Bayesian reconstructions from emission tomography data using a modified EM algorithm. IEEE Trans. Med. Imag. 9 84-93.
14. Hirano, K. and Porter, J. R. (2003). Asymptotic efficiency in parametric structural models with parameter-dependent support. Econometrica 71 1307-1338. MR2000249
15. Ibragimov, I. A. and Has'minskiѤ R. Z. (1981). Statistical Estimation: Asymptotic Theory. Springer, New York. MR0620321
16. Johnstone, I. M. and Silverman, B. W. (1990). Speed of estimation in positron emission tomography and related inverse problems. Ann. Statist. 18 251-280. MR1041393
17. Le Cam, L. (1953). On some asymptotic properties of maximum likelihood estimates and related Bayes' estimates. Univ. California Publ. Statist. 1 277-329. MR0054913
18. Le Cam, L. and Yang, G. L. (1990). Asymptotics in Statistics: Some Basic Concepts. Springer, New York. MR1066869
19. Moran, P. A. P. (1971). Maximum-likelihood estimation in non-standard conditions. Proc. Cambridge Philos. Soc. 70 441-450. MR0290493
20. Nelder, J. A. and Wedderburn, R. W. M. (1972). Generalized linear models. J. R. Stat. Soc. A, General 135 370-384.
21. Petrone, S., Rousseau, J. and Scricciolo, C. (2012). Bayes and empirical Bayes: Do they merge? Biometrika 99 1-21.
22. Polyak, B. T. (1983). Introduction to Optimization (Vvedenie v Optimizatsiyu, in Russian). Nauka, Moscow. MR0719196
23. Self, S. G. and Liang, K.-Y. (1987). Asymptotic properties of maximum likelihood estimators and likelihood ratio tests under nonstandard conditions. J. Amer. Statist. Assoc. 82 605-610. MR0898365
24. Shapiro, A. (2000). On the asymptotics of constrained local M-estimators. Ann. Statist. 28 948-960. MR1792795
25. Spokoiny, V. (2012). Parametric estimation. Finite sample theory. Ann. Statist. 40 2877-2909. MR3097963
26. van der Vaart, A. W. (1998). Asymptotic Statistics. Cambridge Univ. Press, Cambridge. MR1652247
27. Vu, H. T. V. and Zhou, S. (1997). Generalization of likelihood ratio tests under nonstandard conditions. Ann. Statist. 25 897-916. MR1439327
28. Weir, I. S. (1997). Fully Bayesian reconstructions from single-photon emission computed tomography data. J. Amer. Statist. Assoc. 92 49-60.