Could Fisher, Jeffreys and Neyman have agreed on testing?

Statistical Science

Volumn 18, Issue 1, 2003, Pages 1-32

  Berger, James O ^a   Christensen, Ronald ^b  

^a DUKE UNIVERSITY   (United States)

^b UNIVERSITY OF NEW MEXICO   (United States)

Author keywords

Conditional testing; p values; Posterior probabilities of hypotheses; Type I and Type II error probabilities

Indexed keywords

EID: 0347913108     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/ss/1056397485     Document Type: Review

References (113)

1. BARNETT, V. (1999). Comparative Statistical Inference, 3rd ed. Wiley, New York.
2. BASU, D. (1975). Statistical information and likelihood (with discussion). Sankhyā Ser. A 37 1-71.
3. BASU, D. (1977). On the elimination of nuisance parameters. J. Amer. Statist. Assoc. 72 355-366.
4. BAYARRI, M. J. and BERGER, J. (2000). P-values for composite null models (with discussion). J. Amer. Statist. Assoc. 95 1127-1142, 1157-1170.
5. BERGER, J. (1985a). Statistical Decision Theory and Bayesian Analysis, 2nd ed. Springer, New York.
6. BERGER, J. (1985b). The frequentist viewpoint and conditioning. In Proc. Berkeley Conference in Honor of Jack Kiefer and Jerzy Neyman (L. Le Cam and R. Olshen, eds.) 1 15-44. Wadsworth, Belmont, CA.
7. BERGER, J. and BERRY, D. (1988). Statistical analysis and the illusion of objectivity. American Scientist 76 159-165.
8. BERGER, J., BOUKAI, B. and WANG, Y. (1997). Unified frequentist and Bayesian testing of a precise hypothesis (with discussion). Statist. Sci. 12 133-160.
9. BERGER, J., BOUKAI, B. and WANG, Y. (1999). Simultaneous Bayesian-frequentist sequential testing of nested hypotheses. Biometrika 86 79-92.
10. BERGER, J., BROWN, L. and WOLPERT, R. (1994). A unified conditional frequentist and Bayesian test for fixed and sequential simple hypothesis testing. Ann. Statist. 22 1787-1807.
11. BERGER, J. and DELAMPADY, M. (1987). Testing precise hypotheses (with discussion). Statist. Sci. 2 317-352.
12. BERGER, J. and GUGLIELMI, A. (2001). Bayesian and conditional frequentist testing of a parametric model versus nonparametric alternatives. J. Amer. Statist. Assoc. 96 174-184.
13. BERGER, J. and MORTERA, J. (1999). Default Bayes factors for non-nested hypothesis testing. J. Amer. Statist. Assoc. 94 542-554.
14. BERGER, J. and SELLKE, T. (1987). Testing a point null hypothesis: The irreconcilability of p values and evidence (with discussion). J. Amer. Statist. Assoc. 82 112-139.
15. BERGER, J. and WOLPERT, R. L. (1988). The Likelihood Principle, 2nd ed. (with discussion). IMS, Hayward, CA.
16. BIRNBAUM, A. (1961). On the foundations of statistical inference: Binary experiments. Ann. Malli. Statist. 32 414-435.
17. BJØRNSTAD, J. (1996). On the generalization of the likelihood function and the likelihood principle. J. Amer. Statist. Assoc. 91 791-806.
18. BRAITHWAITE, R. B. (1953). Scientific Explanation. Cambridge Univ. Press.
19. BROWN, L. D. (1978). A contribution to Kiefer's theory of conditional confidence procedures. Ann. Statist. 6 59-71.
20. CARLSON, R. (1976). The logic of tests of significance (with discussion). Philos. Sci. 43 116-128.
21. CASELLA, G. and BERGER, R. (1987). Reconciling Bayesian and frequentist evidence in the one-sided testing problem (svith discussion). J. Amer. Statist. Assoc. 82 106-111, 123-139.
22. COX, D. R. (1958). Some problems connected with statistical inference. Ann. Math. Statist. 29 357-372.
23. DASS, S. (2001). Unified Bayesian and conditional frequentist testing for discrete distributions. Sankhyā Ser. B 63 251-269.
24. DASS, S. and BERGER, J. (2003). Unified conditional frequentist and Bayesian testing of composite hypotheses. Scand. J. Statist. 30 193-210.
25. DELAMPADY, M. and BERGER, J. (1990). Lower bounds on Bayes factors for multinomial distributions, with application to chisquared tests of fit. Ann. Statist. 18 1295-1316.
26. EDWARDS, W., LINDMAN, H. and SAVAGE, L. J. (1963). Bayesian statistical inference for psychological research. Psychological Review 70 193-242.
27. EFRON, B. and Gous, A. (2001). Scales of evidence for model selection: Fisher versus Jeffreys (with discussion). In Model Selection (P. Lahiri, ed.) 208-256. IMS, Hayward, CA.
28. FISHER, R. A. (1925). Statistical Methods for Research Workers. Oliver and Boyd, Edinburgh (10th ed., 1946).
29. FISHER, R. A. (1935). The logic of inductive inference (with discussion). J. Roy. Statist. Soc. 98 39-82.
30. FISHER, R. A. (1955). Statistical methods and scientific induction. J. Roy. Statist. Soc. Ser. B 17 69-78.
31. FISHER, R. A. (1973). Statistical Methods and Scientific Inference, 3rd ed. Macmillan, London.
32. GIBBONS, J. and PRATT, J. (1975). P-values: Interpretation and methodology. Amer. Statist. 29 20-25.
33. GOOD, I. J. (1958). Significance tests in parallel and in series. J. Amer. Statist. Assoc. 53 799-813.
34. GOOD, I. J. (1992). The Bayes/non-Bayes compromise: A brief review. J. Amer. Statist. Assoc. 87 597-606.
35. GOODMAN, S. (1992). A comment on replication, p-values and evidence. Statistics in Medicine 11 875-879.
36. GOODMAN, S. (1993). P-values, hypothesis tests, and likelihood: Implications for epidemiology of a neglected historical debate. American Journal of Epidemiology 137 485-496.
37. GOODMAN, S. (1999a). Toward evidence-based medical statistics. 1: The p-value fallacy. Annals of Internal Medicine 130 995-1004.
38. GOODMAN, S. (1999b). Toward evidence-based medical statistics. 2: The Bayes factor. Annals of Internal Medicine 130 1005-1013.
39. HACKING, I. (1965). Logic of Statistical Inference. Cambridge Univ. Press.
40. HALL, P. and SELINGER, B. (1986). Statistical significance: Balancing evidence against doubt. Austral. J. Statist. 28 354-370.
41. HUBBARD, R. (2000). Minding one's p's and α's: Confusion in the reporting and interpretation of results of classical statistical tests in marketing research. Technical Report, College of Business and Public Administration, Drake Univ.
42. JEFFREYS, H. (1961). Theory of Probability, 3rd ed. Oxford Univ. Press.
43. JOHNSTONE, D. J. (1997). Comparative classical and Bayesian interpretations of statistical compliance tests in auditing. Accounting and Business Research 28 53-82.
44. KALBFLEISH, J. D. and SPROTT, D. A. (1973). Marginal and conditional likelihoods. Sankhyā Ser. A 35 311-328.
45. KIEFER, J. (1976). Admissibility of conditional confidence procedures. Ann. Math. Statist. 4 836-865.
46. KIEFER, J. (1977). Conditional confidence statements and confidence estimators (with discussion). J. Amer. Statist. Assoc. 72 789-827.
47. KYBURG, H. E., JR. (1974). The Logical Foundations of Statistical Inference. Reidel, Boston.
48. LAPLACE, P. S. (1812). Théorie Analytique des Probabilités. Courcier, Paris.
49. LEHMANN, E. (1993). The Fisher, Neyman-Pearson theories of testing hypotheses: One theory or two? J. Amer. Statist. Assoc. 88 1242-1249.
50. MATTHEWS, R. (1998). The great health hoax. The Sunday Telegraph, September 13.
51. MORRISON, D. E. and HENKEL, R. E., eds. (1970). The Significance Test Controversy. A Reader. Aldine, Chicago.
52. NEYMAN, J. (1961). Silver jubilee of my dispute with Fisher. J. Operations Res. Soc. Japan 3 145-154.
53. NEYMAN, J. (1977). Frequentist probability and frequentist statistics. Synthese 36 97-131.
54. NEYMAN, J. and PEARSON, E. S. (1933). On the problem of the most efficient tests of statistical hypotheses. Philos. Trans. Roy. Soc. London Ser. A 231 289-337.
55. PAULO, R. (2002a). Unified Bayesian and conditional frequentist testing in the one- and two-sample exponential distribution problem. Technical Report, Duke Univ.
56. PAULO, R. (2002b). Simultaneous Bayesian-frequentist tests for the drift of Brownian motion. Technical Report, Duke Univ.
57. PEARSON, E. S. (1955). Statistical concepts in their relation to reality. J. Roy. Statist. Soc. Ser. B 17 204-207.
58. PEARSON, E. S. (1962). Some thoughts on statistical inference. Ann. Math. Statist. 33 394-403.
59. REID, N. (1995). The roles of conditioning in inference (with discussion). Statist. Sci. 10 138-157, 173-199.
60. ROBINS, J. M., VAN DER VAART, A. and VENTURA, V. (2000). Asymptotic distribution of p values in composite null models (with discussion). J. Amer. Statist. Assoc. 95 1143-1167, 1171-1172.
61. ROYALL, R. M. (1997). Statistical Evidence: A Likelihood Paradigm. Chapman and Hall, New York.
62. SAVAGE, L. J. (1976). On rereading R. A. Fisher (with discussion). Ann. Statist. 4441-500.
63. SEIDENFELD, T. (1979). Philosophical Problems of Statistical Inference. Reidel, Boston.
64. SELLKE, T., BAYARRI, M. J. and BERGER, J. O. (2001). Calibration of p-values for testing precise null hypotheses. Amer. Statist. 55 62-71.
65. SPIELMAN, S. (1974). The logic of tests of significance. Philos. Sci. 41211-226.
66. SPIELMAN, S. (1978). Statistical dogma and the logic of significance testing. Philos. Sci. 45 120-135.
67. STERNE, J. A. C. and DAVEY SMITH, G. (2001). Sifting the evidence - what's wrong with significance tests? British Medical Journal 322 226-231.
68. WELCH, B. and PEERS, H. (1963). On formulae for confidence points based on integrals of weighted likelihoods. J. Roy. Statist. Soc. Ser. B 25 318-329.
69. WOLPERT, R. L. (1996). Testing simple hypotheses. In Data Analysis and Information Systems (H. H. Bock and W. Polasek, eds.) 7 289-297. Springer, Heidelberg.
70. ZABELL, S. (1992). R. A. Fisher and the fiducial argument. Statist. Sci. 7 369-387.
71. BEDRICK, E. J., CHRISTENSEN, R. and JOHNSON, W. O. (1996). A new perspective on priors for generalized linear models. J. Amer. Statist. Assoc. 91 1450-1460.
72. BEDRICK, E. J., CHRISTENSEN, R. and JOHNSON, W. O. (1997). Bayesian binomial regression: Predicting survival at a trauma center. Amer. Statist. 51 211-218.
73. BEDRICK, E. J., CHRISTENSEN, R. and JOHNSON, W. O. (2000). Bayesian accelerated failure time analysis with application to veterinary epidemiology. Statistics in Medicine 19 221-237.
74. BERGER, J. and PERICCHI, L. (2001). Objective Bayesian methods for model selection: Introduction and comparison (with discussion). In Model Selection (P. Lahiri, ed.) 135-207. IMS, Hayward, CA.
75. BERGER, J. O. and WOLPERT, R. (1984). The Likelihood Principle. IMS, Hayward, CA.
76. Box, G. E. P. (1980). Sampling and Bayes' inference in scientific modelling and robustness (with discussion). J. Roy. Statist. Soc. Ser. A 143 383-130.
77. CHRISTENSEN, R. (1995). Comment on Inman (1994). Amer. Statist. 49 400.
78. COX, D. R. and HINKLEY, D. V. (1974). Theoretical Statistics. Chapman and Hall, London.
79. ENØE, C., GEORGIADIS, M. P. and JOHNSON, W. O. (2000). Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown. Preventive Veterinary Medicine 45 61-81.
80. FOSGATE, G. T., ADESIYUN, A. A., HIRD, D. W., JOHN-SON, W. O., HIETALA, S. K., SCHURIG, G. G. and RYAN, J. (2002). Comparison of serologic tests for detection of Brucella infections in cattle and water buffalo (Bubalus bubalis). American Journal of Veterinary Research 63 1598-1605.
81. GABRIEL, K. R. (1969). Simultaneous test procedures-some theory of multiple comparisons. Ann. Math. Statist. 40 224-250.
82. GASTWIRTH, J. L., JOHNSON, W. O. and RENEAU, D. M. (1991). Bayesian analysis of screening data: Application to AIDS in blood donors. Canad. J. Statist. 19 135-150.
83. GEORGIADIS, M. P., JOHNSON, W. O., GARDNER, I. A. and SINGH, R. (2003). Correlation-adjusted estimation of sensitivity and specificity of two diagnostic tests. Applied Statistics 52 63-76.
84. GÖNEN, M., WESTFALL, P. H. and JOHNSON, W. O. (2003). Bayesian multiple testing for two-sample multivariate end-points. Biometrics. To appear.
85. HANSON, T. E., BEDRICK, E. J., JOHNSON, W. O. and THURMOND, M. C. (2003). A mixture model for bovine abortion and fetal survival. Statistics in Medicine 22 1725-1739.
86. HANSON, T., JOHNSON, W. O. and GARDNER, I. A. (2003). Hierarchical models for estimating disease prevalence and test accuracy in the absence of a gold-standard. Journal of Agricultural, Biological and Environmental Statistics. To appear.
87. HANSON, T. E., JOHNSON, W. O., GARDNER, I. A. and GEORGIADIS, M. (2003). Determining the disease status of a herd. Journal of Agricultural, Biological and Environmental Statistics. To appear.
88. JOHNSON, W. O. and GASTWIRTH, J. L. (1991). Bayesian inference for medical screening tests: Approximations useful for the analysis of Acquired Immune Deficiency Syndrome. J. Roy. Statist. Soc. Ser. B 53 427-439.
89. JOHNSON, W. O., GASTWIRTH, J. L. and PEARSON, L. M. (2001). Screening without a gold standard: The Hui-Walter paradigm revisited. American Journal of Epidemiology 153 921-924.
90. JOSEPH, L., GYORKOS, T. W. and COUPAL, L. (1995). Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. American Journal of Epidemiology 141 263-272.
91. LAVINE, M. and SCHERVISH, M. J. (1999). Bayes factors: what they are and what they are not. Amer. Statist. 53 119-122.
92. LELE, S.R. (1998). Evidence functions and the optimality of the likelihood ratio. Paper presented at the Ecological Society of America Symposium on the Nature of Scientific Evidence, August 3, 1998, Baltimore.
93. LIU, Y., JOHNSON, W. O., GOLD, E. B. and LASLEY, B. L. (2003). Bayesian analysis of the effect of risk factors on probabilities of anovulation in cycling women. Unpublished manuscript.
94. MAYO, D. (1983). An objective theory of statistical testing. Synthese 57 297-340.
95. MAYO, D. (1985). Behavioristic, evidentialist, and learning models of statistical testing. Philos. Sci. 52493-516.
96. MAYO, D. (1991). Sociological vs. metascientific theories of risk assessment. In Acceptable Evidence: Science and Values in Risk Management (D. Mayo and R. Hollander, eds.) 249-279. Oxford Univ. Press.
97. MAYO, D. (1992). Did Pearson reject the Neyman-Pearson philosophy of statistics? Synthese 90 233-262.
98. MAYO, D. (1996). Error and the Growth of Experimental Knowledge. Univ. Chicago Press.
99. MAYO, D. (1997). Response to C. Howson and L. Laudan. Philos. Sci. 64 323-333.
100. MAYO, D. and KRUSE, M. (2001). Principles of inference and their consequences. In Foundations of Bayesianism (D. Cor-field and J. Williamson, eds.) 381-403. Kluwer, Dordrecht.
101. MAYO, D. and SPANOS, A. (2002). A severe testing interpretation of Neyman-Pearson tests. Working paper, Virginia Tech.
102. MCINTURFF, P., JOHNSON, W. O., GARDNER, I. A. and COWLING, D. W. (2003). Bayesian modeling of risk based on out-comes that are subject to error. Statistics in Medicine. To appear.
103. NEYMAN, J. (1976). Tests of statistical hypotheses and their use in studies of natural phenomena. Comm. Statist. Theory Methods A5 737-751.
104. PEARSON, E. S. (1966). On questions raised by the combination of tests based on discontinuous distributions. In The Selected Papers of E. S. Pearson 217-232. Cambridge Univ. Press.
105. First published in Biometrika 37 383-398 (1950).
106. ROSENTHAL, R. and RUBIN, D. B. (1994). The counternull value of an effect size: A new statistic. Psychological Science 5 329-334.
107. ROYALL, R. M. (2000). On the probability of observing misleading statistical evidence (with discussion). J. Amer. Statist. Assoc. 95 760-780.
108. SAMANIEGO, F. J. and RENEAU, D. M. (1994). Toward a reconciliation of the Bayesian and frequentist approaches to point estimation. J. Amer. Statist. Assoc. 89 947-957.
109. SCHERVISH, M. J. (1996). P-values: What they are and what they are not. Amer. Statist. 50 203-206.
110. SCHERVISH, M. J., SEIDENFELD, T. and KADANE, J. B. (2003). Measures of incoherence: How not to gamble if you must (with discussion). In Bayesian Statistics 7 (J. M. Bemardo et al., eds.). Oxford Univ. Press.
111. SUESS, E., GARDNER, I. A. and JOHNSON, W. O. (2002). Hierarchical Bayesian model for prevalence inferences and determination of a country's status for an animal pathogen. Preventive Veterinary Medicine 55 155-171.
112. WESTFALL, P. H., JOHNSON, W. O. and UTTS, J. M. (1997). A Bayesian perspective on the Bonferroni adjustment. Biometrika 84 419-427.
113. ZELLNER, A. and SIOW, A. (1980). Posterior odds ratios for selected regression hypotheses. In Bayesian Statistics (J. M. Bernardo et al., eds.) 585-603. Oxford Univ. Press.