The interplay of Bayesian and frequentist analysis

Statistical Science

Volumn 19, Issue 1, 2004, Pages 58-80

  Bayarri, M J ^a   Berger, J O ^b  

^a UNIVERSITY OF VALENCIA   (Spain)

^b DUKE UNIVERSITY   (United States)

Author keywords

Admissibility; Bayesian model checking; Conditional frequentist; Confidence intervals; Consistency; Coverage; Design; Hierarchical models; Nonparametric Bayes; Objective Bayesian methods; P values; Reference priors; Testing

Indexed keywords

EID: 4043150795     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/088342304000000116     Document Type: Article

References (110)

1. BARNETT, V. (1982). Comparative Statistical Inference, 2nd ed. Wiley, New York.
2. BARRON, A. (1999). Information-theoretic characterization of Bayes performance and the choice of priors in parametric and nonparametric problems. In Bayesian Statistics 6 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 27-52. Oxford Univ. Press.
3. BARRON, A., SCHERVISH, M. J. and WASSERMAN, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536-561.
4. BAYARRI, M. J. and BERGER, J. (2000). P-values for composite null models (with discussion). J. Amer. Statist. Assoc. 95 1127-1170.
5. BAYARRI, M. J. and CASTELLANOS, M. E. (2004). Bayesian checking of hierarchical models. Technical report, Univ. Valencia.
6. BELITSER, E. and GHOSAL, S. (2003). Adaptive Bayesian inference on the mean of an infinite-dimensional normal distribution. Ann. Statist. 31 536-559.
7. BERGER, J. (1985a), Statistical Decision Theory and Bayesian Analysis, 2nd ed. Springer, New York.
8. BERGER, J. (1985b). The frequentist viewpoint and conditioning. In Proceedings of the Berkeley Conference in Honor of Jerzy Neyman and Jack Kiefer (L. Le Cam and R. Olshen, eds.) 15-44. Wadsworth, Monterey, CA.
9. BERGER, J. (1994). An overview of robust Bayesian analysis (with discussion), Test 3 5-124.
10. BERGER, J. (2003). Could Fisher, Jeffreys and Neyman have agreed on testing (with discussion)? Statist. Sci. 18 1-32.
11. BERGER, J. and BERNARDO, J. (1992). On the development of reference priors. In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 35-60. Oxford Univ. Press.
12. BERGER, J. and BERRY, D. (1988). The relevance of stopping rules in statistical inference (with discussion). In Statistical Decision Theory and Related Topics IV (S. Gupta and J. Berger, eds.) 129-72. Springer, New York.
13. BERGER, J., BOUKAI, B. and WANG, Y. (1999). Simultaneous Bayesian-frequentist sequential testing of nested hypotheses. Biometrika 86 79-92.
14. BERGER, J., BROWN, L. D. and WOLPERT, R. (1994). A unified conditional frequentist and Bayesian test for fixed and sequential simple hypothesis testing. Ann. Statist. 22 1787-1807.
15. BERGER, J., GHOSH, J. K. and MUKHOPADHYAY, N. (2003). Approximations and consistency of Bayes factors as model dimension grows. J. Statist. Plann. Inference 112 241-258.
16. BERGER, J. and PERICCHI, L. (2001). Objective Bayesian methods for model selection: Introduction and comparison (with discussion). In Model Selection (P. Lahiri, ed.) 135-207. IMS, Beachwood, OH.
17. BERGER, J. and PERICCHI, L. (2004). Training samples in objective Bayesian model selection. Ann. Statist. 32 841-869.
18. BERGER, J., PHILIPPE, A. and ROBERT, C. (1998). Estimation of quadratic functions: Noninformative priors for non-centrality parameters. Statist. Sinica 8 359-376.
19. BERGER, J. and ROBERT, C. (1990). Subjective hierarchical Bayes estimation of a multivariate normal mean: On the frequentist interface. Ann. Statist. 18 617-651.
20. BERGER, J. and STRAWDERMAN, W. (1996). Choice of hierarchical priors: Admissibility in estimation of normal means. Ann. Statist. 24 931-951.
21. BERGER, J. and WOLPERT, R. L. (1988). The Likelihood Principle: A Review, Generalizations, and Statistical Implications, 2nd ed. IMS, Hayward, CA. (With discussion.)
22. BERNARDO, J. M. (1979). Reference posterior distributions for Bayesian inference (with discussion). J. Roy. Statist. Soc. Ser. B 41 113-147.
23. BERNARDO, J. M. and SMITH, A. F. M. (1994). Bayesian Theory. Wiley, New York.
24. Box, G. E. P. (1980). Sampling and Bayes' inference in scientific modeling and robustness (with discussion). J. Roy. Statist. Soc. Ser. A 143 383-430.
25. BROWN, L. D. (1971). Admissible estimators, recurrent diffusions, and insoluble boundary value problems. Ann. Math. Statist. 42 855-903.
26. BROWN, L. D. (1994). Minimaxity, more or less. In Statistical Decision Theory and Related Topics V (S. Gupta and J. Berger, eds.) 1-18. Springer, New York.
27. BROWN, L. D. (2000). An essay on statistical decision theory. J. Amer. Statist. Assoc. 95 1277-1281.
28. BROWN, L. D., CAI, T. T. and DASGUPTA, A. (2001). Interval estimation for a binomial proportion (with discussion). Statist. Sci. 16 101-133.
29. BROWN, L. D., CAI, T. T. and DASGUPTA, A. (2002). Confidence intervals for a binomial proportion and asymptotic expansions. Ann. Statist. 30 160-201.
30. CARLIN, B. P. and Louis, T. A. (2000). Bayes and Empirical Bayes Methods for Data Analysis, 2nd ed. Chapman and Hall, London.
31. CASELLA, G. (1988). Conditionally acceptable frequentist solutions (with discussion). In Statistical Decision Theory and Related Topics IV (S. Gupta and J. Berger, eds.) 1 73-117. Springer, New York.
32. CASTELLANOS, M. E. (2002). Diagnóstico Bayesiano de modelos. Ph.D. dissertation, Univ. Miguel Hernández, Spain.
33. CHALONER, K. and VERDINELLI, I. (1995). Bayesian experimental design: A review. Statist. Sci. 10 273-304.
34. CLYDE, M. and GEORGE, E. (2004). Model uncertainty. Statist. Sci. 19 81-94.
35. DANIELS, M. and POURAHMADI, M. (2002). Bayesian analysis of covariance matrices and dynamic models for longitudinal data. Biometrika 89 553-566.
36. DASS, S. and BERGER, J. (2003). Unified conditional frequentist and Bayesian testing of composite hypotheses. Scand. J. Statist. 30 193-210.
37. DATTA, G. S., MUKERJEE, R., GHOSH, M. and SWEETING, T. J. (2000). Bayesian prediction with approximate frequentist validity. Ann. Statist. 28 1414-1426.
38. DAWID, A. P. and SEBASTIANI, P. (1999). Coherent dispersion criteria for optimal experimental design. Ann. Statist. 27 65-81.
39. DAWID, A. P. and VOVK, V. G. (1999). Prequential probability: Principles and properties. Bernoulli 5 125-162.
40. DE FlNETTI, B. (1970). Teoria delle Probabilità 1, 2. Einaudi, Torino. [English translations published (1974, 1975) as Theory of Probability 1, 2. Wiley, New York.]
41. DE FlNETTI, B. (1970). Teoria delle Probabilità 1, 2. Einaudi, Torino. [English translations published (1974, 1975) as Theory of Probability 1, 2. Wiley, New York.]
42. DELAMPADY, M., DASGUPTA, A., CASELLA, G., RUBIN, H. and STRAWDERMAN, W. E. (2001). A new approach to default priors and robust Bayes methodology. Canad. J. Statist. 29 437-450.
43. DEY, D., MÜLLER, P. and SINHA, D., eds. (1998). Practical Nonparametric and Semiparametric Bayesian Statistics. Lecture Notes in Statist. 133. Springer, New York.
44. DIACONIS, P. (1988a). Bayesian numerical analysis. In Statistical Decision Theory and Related Topics IV (S. Gupta and J. Berger, eds.) 1 163-175. Springer, New York.
45. DIACONIS, P. (1988b). Recent progress on de Finetti's notion of exchangeability. In Bayesian Statistics 3 (J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith, eds.) 111-125, Oxford Univ. Press.
46. DIACONIS, P. and FREEDMAN, D. (1986). On the consistency of Bayes estimates (with discussion). Ann. Statist. 14 1-67.
47. EATON, M. L. (1989). Group Invariance Applications in Statistics. IMS, Hayward, CA.
48. EFRON, B. (1993). Bayes and likelihood calculations from confidence intervals. Biometrika 80 3-26.
49. FRASER, D. A. S., REID, N., WONG, A. and Yi, G. Y. (2003). Direct Bayes for interest parameters. In Bayesian Statistics 7 (J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West, eds.) 529-534. Oxford Univ. Press.
50. FREEDMAN, D. A. (1963). On the asymptotic behavior of Bayes estimates in the discrete case. Ann. Math. Statist. 34 1386-1403.
51. FREEDMAN, D. A. (1999). On the Bernstein-von Mises theorem with infinite-dimensional parameters. Ann. Statist. 27 1119-1140.
52. GART, J. J. and NAM, J. (1988). Approximate interval estimation of the ratio of binomial parameters: A review and corrections for skewness. Biometrics 44 323-338.
53. GELMAN, A., CARLIN, J. B., STERN, H. and RUBIN, D. B. (1995). Bayesian Data Analysis. Chapman and Hall, London.
54. GHOSAL, S., GHOSH, J. K. and VAN DER VAART, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500-531.
55. GHOSH, J. K., ed. (1988). Statistical Information and Likelihood. A Collection of Critical Essays. Lecture Notes in Statist. 45. Springer, New York.
56. GHOSH, J. K., GHOSAL, S. and SAMANTA, T. (1994). Stability and convergence of the posterior in non-regular problems. In Statistical Decision Theory and Related Topics V (S. S. Gupta and J. Berger, eds.) 183-199. Springer, New York.
57. GHOSH, J. K. and RAMAMOORTHI, R. V. (2003). Bayesian Nonparametrics. Springer, New York.
58. GHOSH, M. and KIM, Y.-H. (2001). The Behrens-Fisher problem revisited: A Bayes-frequentist synthesis. Canad. J. Statist. 29 5-17.
59. GOOD, I. J. (1983). Good Thinking: The Foundations of Probability and Its Applications. Univ. Minnesota Press, Minneapolis.
60. GUTTMAN, I. (1967). The use of the concept of a future observation in goodness-of-fit problems. J. Roy. Statist. Soc. Ser. B 29 83-100.
61. HILL, B. (1974). On coherence, inadmissibility and inference about many parameters in the theory of least squares. In Studies in Bayesian Econometrics and Statistics (S. Fienberg and A. Zellner, eds.) 555-584. North-Holland, Amsterdam.
62. HOBERT, J. (2000). Hierarchical models: A current computational perspective. J. Amer. Statist. Assoc. 95 1312-1316.
63. HWANG, J. T., CASELLA, G., ROBERT, C., WELLS, M. T. and FARRELL, R. (1992). Estimation of accuracy in testing. Ann. Statist. 20 490-509.
64. JEFFREYS, H. (1961). Theory of Probability, 3rd ed. Oxford Univ. Press.
65. KIEFER, J. (1977). Conditional confidence statements and confidence estimators (with discussion). J. Amer. Statist. Assoc. 72 789-827.
66. KIM, Y. and LEE, J. (2001). On posterior consistency of survival models. Ann. Statist. 29 666-686.
67. LAD, F. (1996). Operational Subjective Statistical Methods: A Mathematical, Philosophical and Historical Introduction. Wiley, New York.
68. LE CAM, L. (1986). Asymptotic Methods in Statistical Decision Theory. Springer, New York.
69. LEHMANN, E. L. and CASELLA, G. (1998). Theory of Point Estimation, 2nd ed. Springer, New York.
70. MCDONALD, G. C., VANCE, L. C. and GIBBONS, D. I. (1995). Some tests for discriminating between lognormal and Weibull distributions - an application to emissions data. In Recent Advances in Life-Testing and Reliability - A Volume in Honor of Alonzo Clifford Cohen, Jr. (N. Balakrishnan, ed.) Chapter 25. CRC Press, Boca Raton, FL.
71. MENG, X.-L. (1994). Posterior predictive p-values. Ann. Statist. 22 1142-1160.
72. MORRIS, C. (1983). Parametric empirical Bayes inference: Theory and applications (with discussion). J. Amer. Statist. Assoc. 78 47-65.
73. MOSSMAN, D. and BERGER, J. (2001). Intervals for post-test probabilities: A comparison of five methods. Medical Decision Making 21 498-507.
74. NEYMAN, J. (1977). Frequentist probability and frequentist statistics. Synthèse 36 97-131.
75. NEYMAN, J. and SCOTT, E. L. (1948). Consistent estimates based on partially consistent observations. Econometrica 16 1-32.
76. O'HAGAN, A. (1992). Some Bayesian numerical analysis. In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 345-363. Oxford Univ. Press.
77. PAULO, R. (2002). Problems on the Bayesian/frequentist interface. Ph.D. dissertation, Duke Univ.
78. PRATT, J. W. (1965). Bayesian interpretation of standard inference statements (with discussion). J. Roy. Statist. Soc. Ser. B 27 169-203.
79. RAO, J. N. K. (2003). Small Area Estimation. Wiley, New York.
80. REID, N. (2000). Likelihood. J. Amer. Statist. Assoc. 95 1335-1340.
81. RÍOS INSUA, D. and RUGOERI, F., eds. (2000). Robust Bayesian Analysis. Lecture Notes in Statist. 152. Springer, New York.
82. ROBBINS, H. (1955). An empirical Bayes approach to statistics. Proc. Third Berkeley Symp. Math. Statist. Probab. 1 157-164. Univ. California Press, Berkeley.
83. ROBERT, C. P. (2001). The Bayesian Choice, 2nd ed. Springer, New York.
84. ROBERT, C. P. and CASELLA, G. (1999). Monte Carlo Statistical Methods. Springer, New York.
85. ROBINS, J. M. and RITOV, Y. (1997). Toward a curse of dimensionality appropriate (CODA) asymptotic theory for semiparametric models. Statistics in Medicine 16 285-319.
86. ROBINS, J. M., VAN DER VAART, A. and VENTURA, V. (2000), Asymptotic distribution of p-values in composite null models. J. Amer. Statist. Assoc. 95 1143-1156.
87. ROBINS, J. and WASSERMAN, L. (2000). Conditioning, likelihood and coherence: A review of some foundational concepts. J. Amer. Statist. Assoc. 95 1340-1346.
88. ROBINSON, G. K. (1979). Conditional properties of statistical procedures. Ann. Statist. 7 742-755.
89. ROUSSEAU, J. (2000). Coverage properties of one-sided intervals in the discrete case and applications to matching priors. Ann. Inst. Statist. Math. 52 28-42.
90. RUBIN, D. B. (1984). Bayesianly justifiable and relevant frequency calculations for the applied statistician. Ann. Statist. 12 1151-1172.
91. RUBIN, H. (1987). A weak system of axioms for "rational" behavior and the non-separability of utility from prior. Statist. Decisions 5 47-58.
92. SAVAGE, L. J. (1962). The Foundations of Statistical Inference. Methuen, London.
93. SCHERVISH, M. (1995). Theory of Statistics. Springer, New York.
94. SCHWARZ, G. (1978). Estimating the dimension of a model. Ann. Statist. 6 461-464.
95. SELLKE, T., BAYARRI, M. J. and BERGER, J. (2001). Calibration of p-values for testing precise null hypotheses. Amer. Statist. 55 62-71.
96. SOOFI, E. (2000). Principal information theoretic approaches. J. Amer. Statist. Assoc. 95 1349-1353.
97. STEIN, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. Proc. Third Berkeley Symp. Math. Statist. Probab 1 197-206. Univ. California Press, Berkeley.
98. STEIN, C. (1975). Estimation of a covariance matrix. Reitz Lecture, IMS-ASA Annual Meeting. (Also unpublished lecture notes.)
99. STRAWDERMAN, W. (2000), Minimaxity. J Amer. Statist. Assoc. 95 1364-1368.
100. SUN, D. and BERGER, J. (2003). Objective priors under sequential experimentation. Technical report, Univ. Missouri.
101. SWEETING, T. J. (2001). Coverage probability bias, objective Bayes and the likelihood principle. Biometrika 88 657-675.
102. TANG, D. (2001). Choice of priors for hierarchical models: Admissibility and computation. Ph.D. dissertation, Purdue Univ.
103. VIDAKOVIC, B. (2000). Gamma-minimax: A paradigm for conservative robust Bayesians. In Robust Bayesian Analysis. Lecture Notes in Statist. 152 241-259. Springer, New York.
104. WALD, A. (1950). Statistical Decision Functions. Wiley, New York.
105. WELCH, B. and PEERS, H. (1963). On formulae for confidence points based on integrals of weighted likelihoods. J. Roy. Statist. Soc. Ser. B 25 318-329.
106. WOLPERT, R. L. (1996). Testing simple hypotheses. In Data Analysis and Information Systems: Statistical and Conceptual Approaches (H.-H. Bock and W. Polasek, eds.) 289-297. Springer, Berlin.
107. WOODROOFE, M. (1986). Very weak expansions for sequential confidence levels. Ann. Statist. 14 1049-1067.
108. YANG, R. and BERGER, J. (1994). Estimation of a covariance matrix using the reference prior. Ann. Statist. 22 1195-1211.
109. YE, K. (1993). Reference priors when the stopping rule depends on the parameter of interest. J. Amer. Statist: Assoc. 88 360-363.
110. ZHAO, L. (2000). Bayesian aspects of some nonparametric problems. Ann. Statist. 28 532-552.