Consistency of Bayes estimates for nonparametric regression: Normal theory

Bernoulli

Volumn 4, Issue 4, 1998, Pages 411-444

  Diaconis, Persi W ^a   Freedman, David ^b  

^a Department of Obstetrics Gynecology   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bayes estimates; Binary regression; Consistency; Model selection

Indexed keywords

EID: 0001928221     PISSN: 13507265     EISSN: None     Source Type: Journal    
DOI: 10.2307/3318659     Document Type: Article

References (45)

1. Barron, A., Schervish, M.J. and Wasserman, L. (1997) The consistency of posterior distributions in nonparametric problems. Technical report, Statistics Department, Yale University. Bernstein, S. (1934) Theory of Probability. Moscow.
2. Breiman, L. and Freedman, D. (1983) How many variables should be entered in a regression equation? J. Amer. Math. Soc., 78, 131-136.
3. Brown, L. and Low, M. (1996) Asymptotic equivalence of non parametric regression and white noise. Ann. Statist., 24, 2384-2398.
4. Bunke, O. and Milhaud, X. (1994) Asymptotic behavior of Bayes estimates under possibly incorrect models. Discussion Paper 24, Mathematics Institute, Humboldt University, Berlin.
5. Cox, D. (1993) An analysis of Bayesian inference for nonparametric regression. Ann. Statist., 21, 903-923.
6. de Finetti, B. (1959) La probabilità, la statistica, nei rapporti con l'induzione, secondo diversi punti di vista. Centro Internazionale Matematica Estivo Cremonese, Rome. English translation in de Finetti (1972).
7. de Finetti, B. (1972) Probability, Induction, and Statistics. New York: Wiley.
8. Diaconis, P. (1988). Bayesian numerical analysis. In S.S. Gupta and J.O. Berger (eds), Statistical Decision Theory and Related Topics IV, Vol. 1, pp. 163-177.
9. Diaconis, P. and Freedman, D. (1988) On the consistency of Bayes estimates (with discussion). Ann. Statist., 14, 1-67.
10. Diaconis, P. and Freedman, D. (1990) On the uniform consistency of Bayes estimates for multinomial probabilities. Ann. Statist., 18, 1317-1327.
11. Diaconis, P. and Freedman, D. (1993) Nonparametric binary regression: A Bayesian approach. Ann. Statist., 21, 2108-2137.
12. Diaconis, P. and Freedman, D. (1995) Nonparametric binary regression with random covariates. Polish J. Math. Statist., 15, 243-273.
13. Diaconis, P. and Freedman, D. (1997) On the Bernstein-von Mises theorem for infinite dimensional parameters. Technical report no. 492, Department of Statistics, University of California, Berkeley.
14. Donoho, D.L. (1994) Asymptotic minimax risk for sup-norm loss: Solution via optimal recovery. Probab. Theory Related Fields, 99, 145-170.
15. Doss, H. (1984) Bayesian estimation in the symmetric location problem. Z. Wahrscheinlichkeitstheorie, 68, 127-147.
16. Doss, H. (1985a) Bayesian nonparametric estimation of the median: Part I: Computation of the estimates. Ann. Statist., 13, 1432-1444.
17. Doss, H. (1985b) Bayesian nonparametric estimation of the median. Part II: Asymptotic properties of the estimates. Ann. Statist., 13, 1445-1464.
18. Eaton, M.L. (1992) A statistical diptych: Admissible inferences - recurrence of symmetric Markov chains. Ann. Statist., 20, 1147-1179.
19. Ferguson, T. (1974) Prior distributions on spaces of probability measures. Ann. Statist., 2, 615-629.
20. Feller, W. (1968) An Introduction to Probability and Its Applications, Vol. I, 3rd edn. New York: Wiley.
21. Freedman, D. (1963) On the asymptotic behavior of Bayes estimates in the discrete case. Ann. Math. Statist., 34, 1386-1403.
22. Freedman, D. (1965) On the asymptotic behavior of Bayes estimates in the discrete case II. Ann. Math. Statist., 36, 454-456.
23. Geman, S. and Hwang, C.R. (1982) Nonparametric maximum likelihood estimation by the method of sieves. Ann. Statist., 10, 401-414.
24. Ghosal, S., Ghosh, J.K. and Ramamoorthi, R.V. (1997) Consistency issues in Bayesian nonparametrics. Technical Report, Indian Statistical Institute.
25. Ghosh, J.K., Sinha, B.K. and Joshi, S.N. (1982) Expansions for posterior probability and integrated Bayes risk. In S.S. Gupta and J.O. Berger (eds), Statistical Decision Theory and Related Topics III, Vol. 1, pp. 403-465. New York: Academic Press.
26. Johnson, R. (1967) An asymptotic expansion for posterior distributions. Ann. Math. Statist., 38, 1899-1906.
27. Johnson, R. (1970) Asymptotic expansions associated with posterior distributions. Ann. Math. Statist., 41, 851-864.
28. Kimeldorf, G. and Wahba, G. (1970) A correspondence between Bayesian estimation on stochastic processes and smoothing by splines. Ann. Math. Statist., 41, 495-502.
29. Kohn, R. and Ansley, C. (1987) A new algorithm for spline smoothing and interpolation based on smoothing a stochastic process. SIAM J. Sci. Statist. Comput., 8, 33-48.
30. Laplace, P.S. (1774) Memoire sur la probabilité des causes par les évènements. Memoires de mathématique et de physique présentés à l'Académie Royale des Sciences, par divers savants, et lûs dans ses assemblées 6. Reprinted in Laplace's Oeuvres Complétes, Vol. 8, pp. 27-65. English translation by S. Stigler (1986) Statist. Sci., 1, 359-378.
31. LeCam, L. (1953) On some asymptotic properties of the maximum likelihood estimates and related Bayes estimates. Univ. Calif. Publ. Statist., 1, 277-330.
32. LeCam, L. (1982) On the risk of Bayes estimates. In S.S. Gupta and J.O. Berger (eds), Statistical Decision Theory and Related Topics III, Vol. 2, pp. 121-138. New York: Academic Press.
33. LeCam, L. and Yang, G. (1990) Asymptotics in Statistics: Some Basic Concepts. New York: Springer-Verlag.
34. Lindley, D.V. and Smith, A.F.M. (1972) Bayes estimates for the linear model. J. Roy. Statist. Soc. Ser. A/B, 67, 1-19.
35. Poincaré, H. (1896) Calcul des probabiliteÂs. Paris: G. Carré.
36. Pollard, D., Torgersen, E. and Yang, G. (eds) (1997) Festschrift for Lucien LeCam. New York: Springer-Verlag.
37. Schwartz, L. (1965) On Bayes procedures. Z. Wahrscheinlichkeitstheorie verw. gebiete, 4, 10-26.
38. Shen, X. (1996) On the properties of Bayes procedures in general parameter spaces. Technical Report, Statistics Department, Ohio State University.
39. Shibata, R. (1981) An optimal selection of regression variables. Biometrika, 68, 45-54.
40. Shibata, R. (1986) Consistency of model selection and parameter estimation. In J. Gani and M.B. Priestley (eds), Essays in Time Series and Allied Processes. J. Appl. Probab., 23A.
41. Stone, C. (1982) Optimal global rates of convergence for nonparametric regression. Ann. Statist., 10, 1040-1053.
42. Traub, J.F., Wasilkowski, G.W. and Wozniakowski, H. (1988) Information-Based Complexity. Boston: Academic Press.
43. von Mises, R. (1964) Mathematical Theory of Probability and Statistics (ed. H. Geiringer). New York: Academic Press.
44. Wahba, G. (1990) Spline Models for Observational Data. Philadelphia: Society for Industrial and Applied Mathematics.
45. Ylvisaker, D. (1987) Prediction and design. Ann. Statist., 15, 1-19.