The semiparametric Bernstein-von Mises theorem

Annals of Statistics

Volumn 40, Issue 1, 2012, Pages 206-237

  Bickel, P J ^a   Kleijn, B J K ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Asymptotic posterior normality; Bernstein von Mises; Efficiency; Local asymptotic normality; Model differentiability; Posterior limit distribution; Regular estimation; Semiparametric statistics

Indexed keywords

EID: 84871232166     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/11-AOS921     Document Type: Article

References (46)

1. BICKEL, P. J., KLAASSEN, C. A. J., RITOV, Y. and WELLNER, J. A. (1998). Efficient and Adaptive Estimation for Semiparametric Models, 2nd ed. Springer, New York. MR16235599
2. BIRGÉ, L. (1983). Approximation dans les espaces métriques et théorie de l'estimation. Z. Wahrsch. Verw. Gebiete 65 181-237. MR07221299
3. BIRGÉ, L. (1984). Sur un théorème de minimax et son application aux tests. Probab. Math. Statist. 3 259-282. MR07641500
4. BOUCHERON, S. and GASSIAT, E. (2009). A Bernstein-von Mises theorem for discrete probability distributions. Electron. J. Stat. 3 114-148. MR24715888
5. CASTILLO, I. (2011). Semiparametric Bernstein-von Mises theorem and bias, illustrated with Gaussian process priors. Preprint, CNRS.
6. CASTILLO, I. (2012). A semiparametric Bernstein-von Mises theorem for Gaussian process priors. Probab. Theory Related Fields 152 53-99.
7. CHEN, H. and SHIAU, J. J. H. (1991). A two-stage spline smoothing method for partially linear models. J. Statist. Plann. Inference 27 187-201. MR10966788
8. CHENG, G. and KOSOROK, M. R. (2008). General frequentist properties of the posterior profile distribution. Ann. Statist. 36 1819-1853. MR24354577
9. COX, D. D. (1993). An analysis of Bayesian inference for nonparametric regression. Ann. Statist. 21 903-923. MR12325255
10. CRAMÉR, H. (1946). Mathematical Methods of Statistics. Princeton Mathematical Series 9. Princeton Univ. Press, Princeton, NJ. MR00165888
11. DIACONIS, P. and FREEDMAN, D. (1986). On the consistency of Bayes estimates. Ann. Statist. 14 1-26.
12. DIACONIS, P. W. and FREEDMAN, D. (1998). Consistency of Bayes estimates for nonparametric regression: Normal theory. Bernoulli 4 411-444. MR16797911
13. FISHER, R. A. (1959). Statistical Methods and Scientific Inference, 2nd ed. Oliver and Boyd, London.
14. FREEDMAN, D. (1999). On the Bernstein-von Mises theorem with infinite-dimensional parameters. Ann. Statist. 27 1119-1140. MR17401199
15. FREEDMAN, D. A. (1963). On the asymptotic behavior of Bayes' estimates in the discrete case. Ann. Math. Statist. 34 1386-1403. MR01584833
16. GHOSAL, S., GHOSH, J. K. and VAN DER VAART, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500-531. MR17900077
17. HÁJEK, J. (1970). A characterization of limiting distributions of regular estimates. Z. Wahrsch. Verw. Gebiete 14 323-330. MR02839111
18. HÁJEK, J. (1972). Local asymptotic minimax and admissibility in estimation. In Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability (Univ. California, Berkeley, Calif., 1970/1971), Vol. I: Theory of Statistics 175-194. Univ. California Press, Berkeley, CA. MR04005133
19. IBRAGIMOV, I. A. and HAS'MINSKIǏ , R. Z. (1981). Statistical Estimation: Asymptotic Theory. Applications of Mathematics 16. Springer, New York. MR06203211
20. JOHNSTONE, I. (2010). High dimensional Bernstein-von Mises: Simple examples. In Borrowing Strength: Theory Powering Applications - A Festschrift for Lawrence D. Brown (J. Berger, T. Cai and I. Johnstone, eds.) 87-98. IMS, Beachwood, OH.
21. KIM, Y. (2006). The Bernstein-von Mises theorem for the proportional hazard model. Ann. Statist. 34 1678-1700. MR22837133
22. KIM, Y. and LEE, J. (2004). A Bernstein-von Mises theorem in the nonparametric rightcensoring model. Ann. Statist. 32 1492-1512. MR20891311
23. KIMELDORF, G. S. and WAHBA, G. (1970). A correspondence between Bayesian estimation on stochastic processes and smoothing by splines. Ann. Math. Statist. 41 495-502. MR02549999
24. KLEIJN, B. (2003). Bayesian asymptotics under misspecification. Ph.D. thesis, Free Univ. Amsterdam.
25. KLEIJN, B. and KNAPIK, B. (2012). Semiparametric posterior limits under local asymptotic exponentiality. Preprint, Korteweg-de Vries Institute, Amsterdam.
26. KLEIJN, B. and VAN DER VAART, A. (2008). The Bernstein-von Mises theorem under misspecification. Preprint.
27. KLEIJN, B. J. K. and VAN DER VAART, A. W. (2006).Misspecification in infinite-dimensional Bayesian statistics. Ann. Statist. 34 837-877. MR22833955
28. LE CAM, L. (1953). On some asymptotic properties of maximum likelihood estimates and related Bayes' estimates. Univ. California Publ. Statist. 1 277-329. MR00549133
29. LE CAM, L. (1972). Limits of experiments. In Proceedings of the Sixth Berkeley Symposium on Mathematical Statistics and Probability (Univ. California, Berkeley, Calif., 1970/1971), Vol. I: Theory of Statistics 245-261. Univ. California Press, Berkeley, CA. MR04158199
30. LE CAM, L. (1986). Asymptotic Methods in Statistical Decision Theory. Springer, New York. MR08564111
31. LE CAM, L. and YANG, G. L. (1990). Asymptotics in Statistics: Some Basic Concepts. Springer, New York. MR10668699
32. LEHMANN, E. L. and CASELLA, G. (1998). Theory of Point Estimation, 2nd ed. Springer, New York. MR16398755
33. MAMMEN, E. and VAN DE GEER, S. (1997). Penalized quasi-likelihood estimation in partial linear models. Ann. Statist. 25 1014-1035. MR14477399
34. MURPHY, S. A. and VAN DER VAART, A. W. (2000). On profile likelihood. J. Amer. Statist. Assoc. 95 449-485. MR18031688
35. RIVOIRARD, V. and ROUSSEAU, J. (2009). Bernstein-von Mises theorem for linear functionals of the density. Preprint. Available at arXiv:0908.4167v1.
36. ROBERT, C. P. (2001). The Bayesian Choice: From Decision-Theoretic Foundations to Computational Implementation, 2nd ed. Springer, New York. MR18358855
37. SCHWARTZ, L. (1965). On Bayes procedures. Z.Wahrsch. Verw. Gebiete 4 10-26. MR01843788
38. SEVERINI, T. A. and WONG, W. H. (1992). Profile likelihood and conditionally parametric models. Ann. Statist. 20 1768-1802. MR11933122
39. SHEN, X. (2002). Asymptotic normality of semiparametric and nonparametric posterior distributions. J. Amer. Statist. Assoc. 97 222-235. MR19472822
40. SHEN, X. and WASSERMAN, L. (2001). Rates of convergence of posterior distributions. Ann. Statist. 29 687-714. MR18653377
41. SHIVELY, T. S., KOHN, R. and WOOD, S. (1999). Variable selection and function estimation in additive nonparametric regression using a data-based prior. J. Amer. Statist. Assoc. 94 777-804.
42. STEIN, C. (1956). Efficient nonparametric testing and estimation. In Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, 1954-1955, Vol. I 187- 195. Univ. California Press, Berkeley. MR00849211
43. VAN DER VAART, A. W. (1998). Asymptotic Statistics. Cambridge Series in Statistical and Probabilistic Mathematics 3. Cambridge Univ. Press, Cambridge. MR16522477
44. VAN DER VAART, A. W. and VAN ZANTEN, J. H. (2008). Rates of contraction of posterior distributions based on Gaussian process priors. Ann. Statist. 36 1435-1463. MR24186633
45. VAN DER VAART, A. W. and WELLNER, J. A. (1996). Weak Convergence and Empirical Processes. Springer, New York. MR13856711
46. WAHBA, G. (1978). Improper priors, spline smoothing and the problem of guarding against model errors in regression. J. Roy. Statist. Soc. Ser. B 40 364-372. MR05222200