The Bayesian analysis of complex, high-dimensional models: Can it be CODA?

Statistical Science

Volumn 29, Issue 4, 2014, Pages 619-639

  Ritov, Y ^a   Bickel, P J ^b   Gamst, A C ^c   Kleijn, B J K ^d  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Bayesian inference; CODA; Foundations; Functional estimation; Partial linear model; Semiparametrics; Stopping time; White noise models

Indexed keywords

EID: 84921476405     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/14-STS483     Document Type: Article

References (49)

1. BAYARRI, M. J. and BERGER, J. O. (2004). The interplay of Bayesian and frequentist analysis. Statist. Sci. 19 58-80. MR2082147
2. BERGER, J. (2006a). The case for objective Bayesian analysis. Bayesian Anal. 1 385-402. MR2221271
3. BERGER, J. (2006b). Rejoinder. Bayesian Anal. 1 457-464. MR2221281
4. BERGER, J. O. and WOLPERT, R. L. (1988). The Likelihood Principle: A Review, Generalizations, and Statistical Implications, 2nd ed. Lecture Notes-Monograph Series 6. IMS, Hayward, CA.
5. BERRY, S. M., REESE, C. S. and LARKEY, P. D. (1999). Bridging different eras in sports. J. Amer. Statist. Assoc. 84 661-676.
6. BICKEL, P. J. (1981). Minimax estimation of the mean of a normal distribution when the parameter space is restricted. Ann. Statist. 9 1301-1309. MR0630112
7. BICKEL, P. J. and KLEIJN, B. J. K. (2012). The semiparametric Bernstein-von Mises theorem. Ann. Statist. 40 206-237. MR3013185
8. BICKEL, P. J. and RITOV, Y. (1988). Estimating integrated squared density derivatives: Sharp best order of convergence estimates. Sankhya Ser. A 50 381-393. MR1065550
9. BICKEL, P. J. and RITOV, Y. (2003). Nonparametric estimators which can be "plugged-in". Ann. Statist. 31 1033-1053. MR2001641
10. BICKEL, P. J., KLAASSEN, C. A. J., RITOV, Y. and WELLNER, J. A. (1998). Efficient and Adaptive Estimation in Semiparametric Models. Springer, New York.
11. BOCK, M. E. (2004). Conversations with Herman Rubin. In A Festschrift for Herman Rubin. Institute of Mathematical Statistics Lecture Notes-Monograph Series 45 408-417. IMS, Beachwood, OH. MR2126915
12. BROWN, L. D. and LOW, M. G. (1996). Asymptotic equivalence of nonparametric regression and white noise. Ann. Statist. 24 2384-2398. MR1425958
13. CHEN, H. and SHIAU, J. J. H. (1994). Data-driven efficient estimators for a partially linear model. Ann. Statist. 22 211-237. MR1272081
14. COCHRAN, W. G. (1977). Sampling Techniques, 3rd ed. Wiley, New York. MR0474575
15. COX, D. D. (1993). An analysis of Bayesian inference for nonparametric regression. Ann. Statist. 21 903-923. MR1232525
16. DIACONIS, P. and FREEDMAN, D. A. (1993). Nonparametric binary regression: A Bayesian approach. Ann. Statist. 21 2108- 2137. MR1245784
17. DIACONIS, P. W. and FREEDMAN, D. (1998). Consistency of Bayes estimates for nonparametric regression: Normal theory. Bernoulli 4 411-444. MR1679791
18. q -error. Probab. Theory Related Fields 99 277-303. MR1278886
19. DONOHO, D. L. and JOHNSTONE, I. M. (1995). Adapting to unknown smoothness via wavelet shrinkage. J. Amer. Statist. Assoc. 90 1200-1224. MR1379464
20. ENGLE, R. F., GRANGER, C. W. J., RICE, J. and WEISS, A. (1986). Nonparametric estimates of the relation between weather and electricity sales. J. Amer. Statist. Assoc. 81 310- 320.
21. EVERSON, P. J. and MORRIS, C. N. (2000). Inference for multivariate normal hierarchical models. J. R. Stat. Soc. Ser. B Stat. Methodol. 62 399-412. MR1749547
22. FERGUSON, T. S. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist. 1 209-230. MR0350949
23. FREEDMAN, D. A. (1963). On the asymptotic behavior of Bayes' estimates in the discrete case. Ann. Math. Statist. 34 1386-1403. MR0158483
24. FREEDMAN, D. A. (1965). On the asymptotic behavior of Bayes estimates in the discrete case. II. Ann. Math. Statist. 36 454- 456. MR0174146
25. FREEDMAN, D. (1999). On the Bernstein-von Mises theorem with infinite-dimensional parameters. Ann. Statist. 27 1119-1140. MR1740119
26. GHOSAL, S., GHOSH, J. K. and VAN DER VAART, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500-531. MR1790007
27. GOLDSTEIN, M. (2006). Subjective Bayesian analysis: Principles and practice. Bayesian Anal. 1 403-420 (electronic). MR2221272
28. GREENSHTEIN, E., PARK, J. andRITOV, Y. (2008). Estimating the mean of high valued observations in high dimensions. J. Stat. Theory Pract. 2 407-418. MR2528789
29. HARMELING, S. and TOUSSAINT, M. (2007). Bayesian estimators for Robins-Ritov's problem. Technical report, Univ. Edinburgh, School of Informatics Research Report EDI-INF-RR-1189.
30. IBRAGIMOV, I. A. and HASMINSKII, R. Z. (1984). On nonparametric estimation of a linear functional in Gaussian white noise. Theory Probab. Appl. 29 19-32.
31. KLEIJN, B. J. K. and VAN DER VAART, A. W. (2006). Misspecification in infinite-dimensional Bayesian statistics. Ann. Statist. 34 837-877. MR2283395
32. LEHMANN, E. L. and CASELLA, G. (1998). Theory of Point Estimation, 2nd ed. Springer, New York. MR1639875
33. LE CAM, L. and YANG, G. L. (1990). Asymptotics in Statistics: Some Basic Concepts. Springer, New York. MR1066869
34. LI, K. (1999). Testing symmetry and proportionality in ppp. J. Bus. Econom. Statist. 17 409-418.
35. LI, L. (2010). Are Bayesian inferences weak for Wasserman's example? Comm. Statist. Simulation Comput. 39 655-667. MR2784548
36. LINDLEY, D. V. (1953). Statistical inference. J. R. Stat. Soc. Ser. B Stat. Methodol. 15 30-65; discussion 65-76. MR0057522
37. LINDLEY, D. V. and SMITH, A. F. M. (1972). Bayes estimates for the linear model. J. R. Stat. Soc. Ser. B Stat. Methodol. 34 1-41. MR0415861
38. MCSHANE, B. B. andWYNER, A. J. (2011). A statistical analysis of multiple temperature proxies: Are reconstructions of surface temperatures over the last 1000 years reliable? Ann. Appl. Stat. 5 5-44. MR2810377
39. NUSSBAUM, M. (1996). Asymptotic equivalence of density estimation and Gaussian white noise. Ann. Statist. 24 2399-2430. MR1425959
40. ROBINS, J. M. and RITOV, Y. (1997). Toward a curse of dimensionality appropriate (coda) asymptotic theory for semiparametric models. Stat. Med. 17 285-319.
41. ROBINS, J., TCHETGEN, E. T., LI, L. and VAN DER VAART, A. (2009). Semiparametric minimax rates. Electron. J. Stat. 3 1305-1321. MR2566189
42. SAVAGE, L. J. (1961). The foundations of statistics reconsidered. In Proc. 4th Berkeley Sympos. Math. Statist. and Prob., Vol. I 575-586. Univ. California Press, Berkeley, CA. MR0133898
43. SCHICK, A. (1993). On efficient estimation in regression models. Ann. Statist. 21 1486-1521. MR1241276
44. SMITH, A. F. M. (1986). Some Bayesian thoughts on modelling and model choice. J. R. Stat. Soc. Ser. D (The Statistician) 35 97-101.
45. VAN DER PAS, S. L. and KLEIJN, B. J. K. (2014). The horseshoe estimator: Posterior concentration around nearly black vectors. Electron. J. Statist. 8 2585-2618. MR3285877
46. WANG, L., BROWN, L. D. and CAI, T. T. (2011). A difference based approach to the semiparametric partial linear model. Electron. J. Stat. 5 619-641. MR2813557
47. WASSERMAN, L. (2000). Asymptotic inference for mixture models using data-dependent priors. J. R. Stat. Soc. Ser. B Stat. Methodol. 62 159-180. MR1747402
48. WASSERMAN, L. (2004). All of Statistics: A Concise Course in Statistical Inference. Springer, New York. MR2055670
49. ZHAO, L. H. (2000). Bayesian aspects of some nonparametric problems. Ann. Statist. 28 532-552. MR1790008