P Values for Composite Null Models

Journal of the American Statistical Association

Volumn 95, Issue 452, 2000, Pages 1127-1142

  Bayarri, M J ^a   Berger, James O ^b  

^a UNIVERSITY OF VALENCIA   (Spain)

^b DUKE UNIVERSITY   (United States)

Author keywords

Bayes factors; Bayesian p values; Conditioning; Model checking; Predictive distributions

Indexed keywords

EID: 85032121470     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2000.10474309     Document Type: Article

References (34)

1. Agresti, A. (1992), “A Survey of Exact Inference for Contingency Tables” (with discussion), Statistical Science, 7, 131-177.
2. Aitkin, M. (1991), “Posterior Bayes Factors” (with discussion), Journal of the Royal Statistical Society, Ser. B, 53, 111-142.
3. Bayarri, M. J., and Berger, J. O. (1997), “Measures of Surprise in Bayesian Analysis,” ISDS Discussion Paper 97-46, Duke University.
4. Bayarri, M. J., and Berger, J. O. (1999), “Quantifying Surprise in the Data and Model Verification,” in Bayesian Statistics 6, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, London: Oxford University Press, pp. 53-82.
5. Berger, J. O., Boukai, B., and Wang, W. (1997), “Unified Frequentist and Bayesian Testing of Précise Hypotheses,” Statistical Science, 12, 133-160.
6. Berger, J. O., Brown, L. D., and Wolpert, R. L. (1994), “A Unified Conditional Frequentist and Bayesian Test for Fixed and Sequential Simple Hypothesis Testing,” The Annals of Statistics, 22, 1787-1807.
7. Berger, J. O., and Delampady, M. (1987), “Testing Precise Hypotheses” (with discussion), Statistical Science, 2, 317-352.
8. Berger, J. O., and Sellke, T. (1987), “Testing a Point Null Hypothesis: The Irreconciability of p Values and Evidence,” Journal of the American Statistical Association, 82, 112-122.
9. Berger, R. L., and Boos, D. D. (1994), “P Values Maximized Over a Confidence Set for the Nuisance Parameter,” Journal of the American Statistical Association, 89, 1012-1016.
10. Blyth, C. R., and Staudte, R. G. (1995), “Estimating Statistical Hypotheses,” Probability and Statistics Letters, 23, 45-52.
11. Box, G. E. P. (1980), “Sampling and Bayes Inference in Scientific Modeling and Robustness,” Journal of the Royal Statistical Society, Ser. A, 143, 383-430.
12. Carlin, B. P. (1999), Discussion of “Quantifying Surprise in the Data and Model Verification,” by M. J. Bayarri and J. O. Berger, in Bayesian Statistics 6, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A.F. M. Smith, London: Oxford University Press, pp. 73-74.
13. De la Horra, J., and Rodriguez-Bernal, M. T. (1997), “Asymptotic Be-haviour of the Posterior Predictive P-Value,” Communications in Statistics, Part A-Theory and Methods, 26, 2689-2699.
14. Delampady, M., and Berger, J. O. (1990), “Lower Bounds on Bayes Factors for Multinomial Distributions, With Applications to Chi-Squared Tests of Fit,” The Annals of Statistics, 18, 1295-1316.
15. Edwards, W., Lindman, H., and Savage, L. J. (1963), “Bayesian Statistical Inference for Psychological Research,” Psychological Review, 70, 193-242.
16. Evans, M. (1997), “Bayesian Inference Procedures Derived via the Concept of Relative Surprise,” Communications in Statistics, Part A-Theory and Methods, 26, 1125-1143.
17. Gelfand, A. E., Dey, D. K., and Chang, H. (1992), “Model Determina-tion Using Predictive Distributions With Implementation via Sampling-Based Methods,” in Bayesian Statistics 4, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, London: Oxford University Press, pp. 147-167.
18. Gelman, A., Carlin, J. B., Stern, H., and Rubin, D. B. (1995), Bayesian Data Analysis, London: Chapman and Hall.
19. Gelman, A., Meng, X. L., and Stern, H. (1996), “Posterior Predictive Assessment of Model Fitness via Realized Discrepancies” (with discussion), Statistica Sinica, 6, 733-807.
20. Guttman, I. (1967), “The Use of the Concept of a Future Observation in Goodness-of-Fit Problems,” Journal of the Royal Statistical Society, Ser. B, 29, 83-100.
21. Hwang, J. T., Casella, G., Robert, C., Wells, M., and Farrell, R. (1992), “Estimation of Accuracy of Testing,” The Annals of Statistics, 20, 490-509.
22. Hwang, J. T., and Pemantle, R. (1997), “Estimating the Truth Indicator Function of a Statistical Hypothesis Under a Class of Proper Loss Functions,” Statistics and Decisions, 15, 103-128.
23. Hwang, J. T., and Yang, M.-C. (1997), “Evaluate the P-Values for Testing the Independence in 2 x 2 Contingency Tables Using the Estimated Truth Approach-One Way to Resolve the Controversy Relating to Fisher’s Exact Test,” technical report, Cornell University, Dept, of Statistical Science.
24. Meng, X. L. (1994), “Posterior Predictive P-Values,” The Annals of Statistics, 22, 1142-1160.
25. Pauler, D. K. (1999), Discussion of “Quantifying Surprise in the Data and Model Verification,” by M. J. Bayarri and I. O. Berger, in Bayesian Statistics 6, eds. J. M. Bernardo, I. O. Berger, A. P. Dawid, and A. F. M. Smith, London: Oxford University Press, pp. 70-72.
26. Robins, J. M. (1999), Discussion of “Quantifying Surprise in the Data and Model Verification,” by M. J. Bayarri and I. O. Berger, in Bayesian Statistics 6, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, London: Oxford University Press, pp. 67-70.
27. Robins, J. M., van der Vaart, A., and Ventura, V. (2000), “The Asymptotic Distribution of p Values in Composite Null Models,” Journal of the American Statistical Association, 95, 1143-1156.
28. Rubin, D. B. (1984), “Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician,” The Annals of Statistics, 12, 1151-1172.
29. Rubin, D. B. (1996), Discussion of “Posterior Predictive Assessment of Model Fitness via Realized Discrepancies,” by A. Gelman, X. Meng, and H. S. Stern, Statistica Sinica, 6, 787-792.
30. Schaafsma, W., Tolboom, J., and Van Der Meulen, E. A. (1989), “Dis-cussing Truth or Falsity by Computing a Q-Value,” in Statistical Data Analysis and Inference, eds. Y. Dodge, Amsterdam: North-Holland, pp. 85-100.
31. Sellke, T., Bayarri, M. J., and Berger, J. O. (1999), “Calibration of P Values for Precise Null Hypotheses,” ISDS Discussion Paper 99-13, Duke University.
32. Suissa, S., and Shuster, J. J. (1985), “Exact Unconditional Sample Sizes for the 2x2 Binomial Trial,” Journal of the Royal Statistical Society, Ser. A, 148, 317-327.
33. Thompson, P. (1997), “Bayes P-Values,” Statistics and Probability Letters, 31, 267-271.
34. Tsui, K.-W., and Weerahandi, S. (1989), “Generalized P Values in Significance Testing of Hypothesis in the Presence of Nuisance Parameters,” Journal of the American Statistical Association, 84, 602-607.