Calibration of p values for testing precise null hypotheses

American Statistician

Volumn 55, Issue 1, 2001, Pages 62-71

  Sellke, Thomas ^a   Bayarri, M J ^b   Berger, James O ^c  

^a PURDUE UNIVERSITY   (United States)

^b UNIVERSITY OF VALENCIA   (Spain)

^c DUKE UNIVERSITY   (United States)

Author keywords

Bayes factors; Bayesian robustness; Conditional frequentist error probabilities; Odds

Indexed keywords

EID: 0035630521     PISSN: 00031305     EISSN: None     Source Type: Journal    
DOI: 10.1198/000313001300339950     Document Type: Article

References (28)

1. Bayarri, M. J., and Berger, J. O. (1999), "Quantifying Surprise in the Data and Model Verification," in Bayesian Statistics 6, eds. J. M. Bernardo, J. O. Berger, A.P. Dawid, and A. F. M. Smith, Oxford: Oxford University Press, pp. 53-82.
2. _ (2000), "P-values for Composite Null Models," Journal of the American Statistical Association, 95, 1127-1142.
3. Berger, J., Boukai, B., and Wang, Y. (1997), "Unified Frequentist and Bayesian Testing of a Precise Hypothesis" (with discussion), Statistical Science, 12, 133-160.
4. Berger, J. O., Brown, L. D., and Wolpert, R. L. (1994), "A Unified Conditional Frequentist and Bayesian Test for Fixed and Sequential Simple Hypothesis Testing," The Annals of Statistics, 22, 1787-1807.
5. Berger, J. O., and Delampady, M. (1987). "Testing Precise Hypothesis" (with discussion), Statistical Science, 2, 317-352.
6. Berger, J., and Mortera, J. (1999). "Default Bayes Factors for Non-nested Hypothesis Testing," Journal of the American Statistical Association, 94, 542-554.
7. Berger, J., and Pericchi, L. (1996), "The Intrinsic Bayes Factor for Model Selection and Prediction," Journal of the American Statistical Association, 91, 109-122.
8. _ (1998), "Accurate and Stable Bayesian Model Selection: the Median Intrinsic Bayes Factor," Sankhvā, Ser. B, 60, 1-18.
9. Berger, J. O., and Sellke, T. (1987), "Testing a Point Null Hypothesis: the Irreconcilability of p-Values and Evidence" (with discussion), Journal of the American Statistical Association, 82, 112-122.
10. Birnbaum, A. (1961), "On the Foundation of Statistical Inference: Binary Experiments," Annals of Mathematical Statistics, 32, 414-435.
11. Casella, G., and Berger, R. (1987), "Reconciling Bayesian and Frequentist Evidence in the One-sided Testing Problem" (with discussion), Journal of the American Statistical Association, 82, 106-111.
12. Dass, S. (1998), "Unified Bayesian and Conditional Frequentist Testing Procedures," unpublished Ph.D. Thesis, Purdue University.
13. Dass, S., and Berger, J. (1998), "Unified Bayesian and Conditional Frequentist Testing of Composite Hypotheses," ISDS Discussion paper 98-43, Duke University.
14. Delampady, M., and Berger, J. O., (1990), "Lower Bounds on Bayes Factors for Multinomial Distributions, With Application to Chi-squared Tests of Fit," The Annals of Statistics, 18, 1295-1316.
15. Donahue, R. (1999), "A Note on Information Seldom Reported Via the P Value," The American Statistician, 53, 303-306.
16. Edwards, W., Lindman, H., and Savage, L. J. (1963), "Bayesian Statistical Inference for Psychological Research," Psychological Review, 70, 193-242.
17. Jeffreys, H. (1961), Theory of Probability, London: Oxford University Press.
18. Gibbons, J., and Pratt, J. (1975), "P Values: Interpretation and Methodology," The American Statistician, 29, 20-25.
19. Goodman, S. (1999a), "Toward Evidence-Based Medical Statistics. 1: The P-Value Fallacy," Annals of Internal Medicine, 130, 995-1004.
20. _ (1999b), "Toward Evidence-Based Medical Statistics. 2: The Bayes Factor," Annals of Internal Medicine, 130, 1005-1013.
21. Hodges, J. (1992), "Who Knows What Alternative Lurks in the Heart of Significance Tests?," in Bayesian Statistics 4, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, London: Oxford University Press, pp. 247-266.
22. Kass, R. E., and Raftery, A. (1995), "Bayes Factors," Journal of the American Statistical Association, 90, 773-795.
23. Kiefer, J. (1977), "Conditional Confidence Statements and Confidence Estimators" (with discussion), Journal of the American Statistical Association, 72, 789-827.
24. Matthews, R. (1998), "The Great Health Hoax," in The Sunday Telegraph, September 13, 1998.
25. O'Hagan, A. (1995), "Fractional Bayes Factors for Model Comparisons," Journal of the Royal Statistical Society, Ser. B, 57, 99-138.
26. Sackrowitz, H., and Samuel-Cahn, E. (1999), "P Values as Random Variables - Expected P Values," The American Statistician, 53, 326-331.
27. Schervish, M. (1996), "P Values: What They Are and What They Are Not," The American Statistician, 50, 203-206.
28. Wolpert, R. L. (1995). "Testing Simple Hypotheses," in Studies in Classification, Data Analysis, and Knowledge Organization (vol. 7), eds. H. H. Bock and W. Polasek, Heidelberg: Springer-Verlag, pp. 289-297.