The whetstone and the alum block: Balanced objective bayesian comparison of nested models for discrete data

Statistical Science

Volumn 28, Issue 3, 2013, Pages 398-423

  Consonni, Guido ^a   Forster, Jonathan J ^b   Rocca, Luca La ^c  

^a UNIVERSITÀ CATTOLICA DEL SACRO CUORE   (Italy)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^c UNIVERSITY OF MODENA AND REGGIO EMILIA   (Italy)

Author keywords

Bayes factor; Intrinsic prior; Model choice; Moment prior; Nonlocal prior; Ockham's razor; Training sample size.

Indexed keywords

EID: 84885341552     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/13-STS433     Document Type: Article

References (46)

1. ALTOMARE, D., CONSONNI, G. and LA ROCCA, L. (2013). Objective Bayesian search of Gaussian directed acyclic graphical models for ordered variables with non-local priors. Biometrics 69 478-487.
2. BEDRICK, E. J., CHRISTENSEN, R. and JOHNSON, W. (1996). A new perspective on priors for generalized linear models. J. Amer. Statist. Assoc. 91 1450-1460. MR1439085
3. BERGER, J. O. and PERICCHI, L. R. (1996). The intrinsic Bayes factor formodel selection and prediction. J. Amer. Statist. Assoc. 91 109-122. MR1394065
4. BERNARDO, J.-M. and SMITH, A. F. M. (1994). Bayesian Theory. Wiley, Chichester. MR1274699
5. CANO, J. A., SALMERóN, D. and ROBERT, C. P. (2008). Integral equation solutions as prior distributions for Bayesian model selection. TEST 17 493-504. MR2470094
6. CASELLA, G. and MORENO, E. (2005). Intrinsic meta-analysis of contingency tables. Stat. Med. 24 583-604. MR2134527
7. CASELLA, G. and MORENO, E. (2006). Objective Bayesian variable selection. J. Amer. Statist. Assoc. 101 157-167. MR2268035
8. CASELLA, G. and MORENO, E. (2009). Assessing robustness of intrinsic tests of independence in two-way contingency tables. J. Amer. Statist. Assoc. 104 1261-1271. MR2750249
9. CASELLA, G.,GIRóN, F. J.,MARTÍNEZ, M. L. andMORENO, E. (2009). Consistency of Bayesian procedures for variable selection. Ann. Statist. 37 1207-1228. MR2509072
10. CHIB, S. and JELIAZKOV, I. (2001). Marginal likelihood from the Metropolis-Hastings output. J. Amer. Statist. Assoc. 96 270- 281. MR1952737
11. COHEN, J. (1992). A power primer. Psychol. Bull. 112 155-159.
12. CONSONNI, G. and LA ROCCA, L. (2008). Tests based on intrinsic priors for the equality of two correlated proportions. J. Amer. Statist. Assoc. 103 1260-1269. MR2462897
13. CONSONNI, G. and LA ROCCA, L. (2011). On moment priors for Bayesian model choice with applications to directed acyclic graphs. In Bayesian Statistics 9 (J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West, eds.) 119-144. Oxford Univ. Press, Oxford.
14. CONSONNI, G.,MORENO, E. andVENTURINI, S. (2011). Testing Hardy-Weinberg equilibrium: An objective Bayesian analysis. Stat. Med. 30 62-74. MR2758860
15. DAWID, A. P. (2011). Posterior model probabilities. In Philosophy of Statistics (P. S. Bandyopadhyay and M. Forster, eds.) 607- 630. Elsevier, Amsterdam.
16. DELLAPORTAS, P., FORSTER, J. J. and NTZOUFRAS, I. (2002). On Bayesian model and variable selection using MCMC. Statist. Comput. 12 27-36.
17. EFRON, B. (1996). Empirical Bayes methods for combining likelihoods. J. Amer. Statist. Assoc. 91 538-565. MR1395725
18. FERGUSON, T. S. (1996). A Course in Large Sample Theory. Chapman & Hall, London. MR1699953
19. FORSTER, J. J. (2010). Bayesian inference for Poisson and multinomial log-linear models. Stat. Methodol. 7 210-224. MR2643598
20. GEYER, C. J. (2010). mcmc: Markov chain Monte Carlo. R package, Version 0.8.
21. GIRóN, F. J., MORENO, E. and CASELLA, G. (2007). Objective Bayesian analysis of multiple changepoints for linear models. In Bayesian Statistics 8 (J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West, eds.) 227-252. Oxford Univ. Press, Oxford. MR2433195
22. GIRóN, F. J., MARTÍNEZ, M. L., MORENO, E. and TORRES, F. (2006). Objective testing procedures in linear models: Calibration of the p-values. Scand. J. Stat. 33 765-784. MR2300915
23. GOUTIS, C. and ROBERT, C. P. (1998). Model choice in generalised linear models: A Bayesian approach via Kullback- Leibler projections. Biometrika 85 29-37. MR1627250
24. JAYNES, E. T. (1979). Review of "Inference, method and decision: Towards a Bayesian philosophy of science." J. Amer. Statist. Assoc. 74 740-741.
25. JEFFERYS, W. H. andBERGER, J. O. (1992). Ockham's Razor and Bayesian analysis. American Scientist 80 64-72.
26. JEFFREYS, H. (1961). Theory of Probability, 3rd ed. Clarendon, Oxford. MR0187257
27. JOHNSON, V. E. and ROSSELL, D. (2010). On the use of non-local prior densities in Bayesian hypothesis tests. J. R. Stat. Soc. Ser. B Stat. Methodol. 72 143-170. MR2830762
28. JOHNSON, V. E. and ROSSELL, D. (2012). Bayesian model selection in high-dimensional settings. J. Amer. Statist. Assoc. 107 649-660. MR2980074
29. KASS, R. E. and RAFTERY, A. E. (1995). Bayes factors. J. Amer. Statist. Assoc. 90 773-795.
30. LEON-NOVELO, L.,MORENO, E. and CASELLA, G. (2012). Objective Bayes model selection in probit models. Stat. Med. 31 353-365. MR2879809
31. LIANG, F., PAULO, R., MOLINA, G., CLYDE, M. A. and BERGER, J. O. (2008). Mixtures of g priors for Bayesian variable selection. J. Amer. Statist. Assoc. 103 410-423. MR2420243
32. MORENO, E. (1997). Bayes factors for intrinsic and fractional priors in nested models. Bayesian robustness. In L1- statistical Procedures and Related Topics (Neuchâtel, 1997) (Y. Dodge, ed.). Institute of Mathematical Statistics Lecture Notes-Monograph Series 31 257-270. IMS, Hayward, CA. MR1833592
33. MORENO, E., BERTOLINO, F. and RACUGNO, W. (1998). An intrinsic limiting procedure for model selection and hypotheses testing. J. Amer. Statist. Assoc. 93 1451-1460. MR1666640
34. MORENO, E., CASELLA, G. and GARCIA-FERRER, A. (2005). An objective Bayesian analysis of the change point problem. Stoch. Environ. Res. Risk Assess. 19 191-204.
35. MORENO, E.,GIRóN, F. J. andCASELLA, G. (2010). Consistency of objective Bayes factors as the model dimension grows. Ann. Statist. 38 1937-1952. MR2676879
36. MORRIS, C. N. (1987). Comments on "Testing a point null hypothesis: The irreconcilability of P values and evidence." J. Amer. Statist. Assoc. 82 131-133.
37. NEAL, R. M. (2001). Transferring prior information between models using imaginary data. Technical Report 0108, Dept. Statistics, Univ. Toronto.
38. O'HAGAN, A. (1995). Fractional Bayes factors for model comparison. J. R. Stat. Soc. Ser. B Stat. Methodol. 57 99-138. MR1325379
39. O'HAGAN, A. and FORSTER, J. (2004). Kendall's Advanced Theory of Statistics, Vol. 2b: Bayesian Inference, 2nd ed. Arnold, Sevenoaks, UK.
40. PÉREZ, J. M. and BERGER, J. O. (2002). Expected-posterior prior distributions for model selection. Biometrika 89 491-511. MR1929158
41. ROBERT, C. P. (2001). The Bayesian Choice: From Decision- Theoretic Foundations to Computational Implementation, 2nd ed. Springer, New York. MR1835885
42. ROBERT, C. P. and CASELLA, G. (1994). Distance weighted losses for testing and confidence set evaluation. Test 3 163-182. MR1293113
43. ROBERT, C. P., CHOPIN, N. and ROUSSEAU, J. (2009). Harold Jeffreys's theory of probability revisited. Statist. Sci. 24 141- 172. MR2655841
44. RUBIN, H. (1987). A weak system of axioms for "rational" behavior and the nonseparability of utility from prior. Statist. Decisions 5 47-58. MR0886877
45. SENN, S. (2009). Comment: Harold Jeffreys's theory of probability revisited. Statist. Sci. 24 185-186. MR2655846
46. SMITH, A. F. M. and SPIEGELHALTER, D. J. (1980). Bayes factors and choice criteria for linear models. J. R. Stat. Soc. Ser. B Stat. Methodol. 42 213-220. MR0583359