A new calibrated bayesian internal goodness-of-fit method: Sampled posterior p-values as simple and general p-values that allow double use of the data

PLoS ONE

Volumn 6, Issue 3, 2011, Pages

  Gosselin, Frédéric ^a  

^a Cemagref   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BAYES THEOREM; CALIBRATION; CHI SQUARE TEST; CONTROLLED STUDY; DATA ANALYSIS; DATA SYNTHESIS; MATHEMATICAL COMPUTING; PROBABILITY; SAMPLE (STATISTICS); SIMULATION; STATISTICAL DISTRIBUTION; STATISTICAL MODEL; STATISTICAL SIGNIFICANCE; THEORETICAL MODEL;

BAYES THEOREM; CALIBRATION; MODELS, THEORETICAL; PROBABILITY;

EID: 79952804694     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0014770     Document Type: Article

References (37)

1. Pinheiro JC, Bates DM, (2000) Mixed-effects models in S and S-PLUS. New York Springer.
2. Harrell FE, (2001) Regression Modeling Strategies, With Applications to Linear Models, Logistic Regression, and Survival Analysis. New York, USA Springer pp. xxiii + 568.
3. O'Hagan A, (2003) HSSS model criticism. In: Green PJ, Hjort NL, Richardson ST, editors. Highly Structured Stochastic Systems Oxford University Press pp. 423-444.
4. Gelman A, Carlin JB, Stern HS, Rubin DB, (2004) Bayesian Data Analysis. Boca Raton Chapman & Hall.
5. Mentré F, Escolano S, (2006) Prediction discrepancies for the evaluation of nonlinear mixed-effects models. J Pharmacok & Phramacod 33: 345-67.
6. Box GEP, (1980) Sampling and Bayes' inference in scientific modelling and robustness. J R Stat Soc Ser A 143: 383-430.
7. Evans M, (1997) Bayesian inference procedures derived via the concept of relative surprise. Commun Stat- Theory Methods 26: 1125-43.
8. Evans M, (2000) Comments on Asymptotic distribution of P values in composite null models by J. M. Robins, A. van der Vaart and V. Ventura. J Am Stat Assoc 95: 1160-3.
9. Christensen R, (2005) Testing Fisher, Neyman, Pearson, and Bayes. Am Stat 59: 121-6.
10. Little RJ, (2006) Calibrated Bayes: A Bayes/frequentist roadmap. Am Stat 60: 213-23.
11. Guttman I, (1967) The use of the concept of a future observation in goodness-of-fit problems. J R Stat Soc Ser B-Stat Methodol 29: 83-100.
12. Rubin DB, (1984) Bayesianly justifiable and relevant frequency calculations for the applied statistician. Ann Stat 12: 1151-72.
13. Gelman A, Meng XL, Stern H, (1996) Posterior predictive assessment of model fitness via realized discrepancies. Stat Sinica 6: 733-60.
14. Bayarri MJ, Berger JO, (2000) P-values for composite null models. J Am Stat Assoc 95: 1127-42.
15. Robins JM, van der Vaart A, Ventura V, (2000) Asymptotic distribution of P values in composite null models. J Am Stat Assoc 95: 1143-56.
16. Johnson VE, (2004) A Bayesian chi(2) test for goodness-of-fit. Ann Stat 32: 2361-84.
17. Hjort NL, Dahl FA, Hognadottir G, (2006) Post-processing posterior predictive p values. J Am Stat Assoc 101: 1157-74.
18. Johnson VE, (2007) Bayesian Model Assessment Using Pivotal Quantities. Bayesian Anal 2: 719-34.
19. Huber PJ, (2002) Approximate models. In: Huber-Carol C, Balakrishnan N, Nikulin MS, Mesbah M, editors. Goodness-of-fit tests and model validity Boston Birkhäuser pp. 25-41.
20. Anscombe FJ, (1963) Tests of goodness of fit. J R Stat Soc Ser B-Stat Methodol 25: 81-94.
21. Verdinelli I, Wasserman L, (1998) Bayesian goodness-of-fit testing using infinite-dimensional exponential families. Ann Stat 26: 1215-41.
22. Robert CP, Rousseau J, (2002) A Mixture Approach to Bayesian Goodness of Fit. Technical Report 02009, Cahier du CEREMADE, Université Paris Dauphine.
23. McVinish R, Rousseau J, Mengersen K, (2009) Bayesian goodness of fit testing with mixtures of triangular distributions. Scand J Stat 36: 337-54.
24. Cox DR, (2002) Karl Pearson and the Chi-squared test. In: Huber-Carol C, Balakrishnan N, Nikulin MS, Mesbah M, editors. Goodness-of-fit tests and model validity Boston Birkhäuser pp. 3-8.
25. Stephens MA, (1978) On the half-sample method for goodness-of-fit. J R Stat Soc Ser B-Stat Methodol 40: 64-70.
26. Fraser DA, Rousseau J, (2008) Studentization and deriving accurate p-values. Biometrika 95: 1-16.
27. Bayarri MJ, Berger JO, (2004) The interplay of Bayesian and frequentist analysis. Stat Sci 19: 58-80.
28. Durbin J, (1973) Distribution theory for tests based on the sample distribution function. Philadelphia SIAM Publications n°9.
29. R Development Core Team (2005) R: A language and environment for statistical computing. Vienna R Foundation for Statistical Computing.
30. Patil GP, Boswell MT, Joshi SW, Ratnaparkhi MV, (1984) Dictionary and classified bibliography of statistical distributions in scientific work. Volume 1: Discrete models. Mairland, Maryland, USA International Co-operative Publishing House.
31. Walker AM, (1969) On the Asymptotic Behaviour of Posterior Distributions. J R Stat Soc Ser B-Stat Methodol 31: 80-8.
32. Johnson RA, (1970) Asymptotic Expansions Associated with Posterior Distributions. Ann Math Stat 41: 851-64.
33. Shen X, Wasserman L, (2001) Rates of convergence of posterior distributions. Ann Stat 29: 687-714.
34. Gelman A, (2007) Comment: Bayesian checking of the second levels of hierarchical models. Stat Sci 22: 349-52.
35. Piccinato L, (2000) Comments on Asymptotic distribution of P values in composite null models by J. M. Robins, A. van der Vaart and V. Ventura. J Am Stat Assoc 95: 1166-7.
36. Evans M, (2007) Comment: Bayesian checking of the second levels of hierarchical models. Stat Sci 22: 344-8.
37. Zhang J, (2002) Powerful goodness-of-fit tests based on the likelihood ratio. J R Stat Soc Ser B-Stat Methodol 64: 281-94.