Approximate Bayesian model selection with the deviance statistic

Statistical Science

Volumn 30, Issue 2, 2015, Pages 242-257

  Held, Leonhard ^a   Bové, Daniel Sabanés ^b   Gravestock, Isaac ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b F HOFFMANN LA ROCHE LTD   (Switzerland)

Author keywords

Bayes factor; Deviance; G prior; Generalized linear model; Model selection; Shrinkage

Indexed keywords

EID: 84930895045     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/14-STS510     Document Type: Article

References (42)

1. BARBIERI, M. M. and BERGER, J. O. (2004). Optimal predictive model selection. Ann. Statist. 32 870-897.
2. BAYARRI, M. J., BERGER, J. O., FORTE, A. and GARCÍADONATO, G. (2012). Criteria for Bayesian model choice with application to variable selection. Ann. Statist. 40 1550-1577.
3. BERGER, J. O. and PERICCHI, L. R. (2001). Objective Bayesian methods for model selection: Introduction and comparison. In Model Selection (P. Lahiri, eds.). Institute of Mathematical Statistics Lecture Notes-Monograph Series 38 135-207. IMS, Beachwood, OH.
4. BERGER, J. O. and SELLKE, T. (1987). Testing a point null hypothesis: Irreconcilability of p-values and evidence. J. Amer. Statist. Assoc. 82 112-139.
5. CLAESKENS, G. and HJORT, N. L. (2008). Model Selection and Model Averaging. Cambridge Univ. Press, Cambridge.
6. COPAS, J. B. (1983). Regression, prediction and shrinkage. J. R. Stat. Soc. Ser. B. Stat. Methodol. 45 311-354.
7. COPAS, J. B. (1997). Using regression models for prediction: Shrinkage and regression to the mean. Stat. Methods Med. Res. 6 167-183.
8. COX, D. R. (1958). Two further applications of a model for binary regression. Biometrika 45 562-565.
9. CUI, W. and GEORGE, E. I. (2008). Empirical Bayes vs. fully Bayes variable selection. J. Statist. Plann. Inference 138 888-900.
10. DAVIDSON, R. R. and LEVER, W. E. (1970). The limiting distribution of the likelihood ratio statistic under a class of local alternatives. Sankhy-a Ser. A 32 209-224.
11. EDWARDS, W., LINDMAN, H. and SAVAGE, L. J. (1963). Bayesian statistical inference for psychological research. Psychological Review 70 193-242.
12. FERNÁNDEZ, C., LEY, E. and STEEL, M. F. J. (2001). Benchmark priors for Bayesian model averaging. J. Econometrics 100 381-427.
13. FOSTER, D. P. and GEORGE, E. I. (1994). The risk inflation criterion for multiple regression. Ann. Statist. 22 1947-1975.
14. GEISSER, S. (1984). On prior distributions for binary trials. Amer. Statist. 38 244-251.
15. GEORGE, E. I. and FOSTER, D. P. (2000). Calibration and empirical Bayes variable selection. Biometrika 87 731-747.
16. GNEITING, T. and RAFTERY, A. E. (2007). Strictly proper scoring rules, prediction, and estimation. J. Amer. Statist. Assoc. 102 359-378.
17. GOODMAN, S. N. (1999a). Toward evidence-based medical statistics. 1: The P -value fallacy. Annals of Internal Medicine 130 995-1004.
18. GOODMAN, S. N. (1999b). Toward evidence-based medical statistics. 2: The Bayes factor. Annals of Internal Medicine 130 1005-1013.
19. GRAVESTOCK, I. (2014). Bayesian tree models priors and posterior approximations. Master's thesis, Univ. Zurich.
20. HELD, L. (2010). A nomogram for P -values. BMC Medical Research Methodology 10 21.
21. HJORT, N. L. and CLAESKENS, G. (2003). Frequentist model average estimators. J. Amer. Statist. Assoc. 98 879-899.
22. HU, J. and JOHNSON, V. E. (2009). Bayesian model selection using test statistics. J. R. Stat. Soc. Ser. B. Stat. Methodol. 71 143-158.
23. JOHNSON, V. E. (2005). Bayes factors based on test statistics. J. R. Stat. Soc. Ser. B. Stat. Methodol. 67 689-701.
24. JOHNSON, V. E. (2008). Properties of Bayes factors based on test statistics. Scand. J. Stat. 35 354-368.
25. KASS, R. E. and WASSERMAN, L. (1995). A reference Bayesian test for nested hypotheses and its relationship to the Schwarz criterion. J. Amer. Statist. Assoc. 90 928-934.
26. LAWLESS, J. F. and SINGHAL, K. (1978). Efficient screening of nonnormal regression models. Biometrics 34 318-327.
27. LEE, K. L., WOODLIEF, L. H., TOPOL, E. J., WEAVER, W. D., BETRIU, A., COL, J., SIMOONS, M., AYLWARD, P., VAN DE WERF, F. andCALIFF, R. M. (1995). Predictors of 30-day mortality in the era of reperfusion for acute myocardial infarction: Results from an international trial of 41,021 patients. Circulation 91 1659-1668.
28. LIANG, F., PAULO, R., MOLINA, G., CLYDE, M. A. and BERGER, J. O. (2008). Mixtures of g priors for Bayesian variable selection. J. Amer. Statist. Assoc. 103 410-423.
29. LINDLEY, D. V. (1957). A statistical paradox. Biometrika 44 187-192.
30. MALAGUERRA, A. (2012). Bayesian variable selection based on test statistics. Master's thesis, Univ. Zurich.
31. MARRA, G. andWOOD, S. N. (2011). Practical variable selection for generalized additive models. Comput. Statist. Data Anal. 55 2372-2387.
32. NELDER, J. A. and WEDDERBURN, R. W. M. (1972). Generalized linear models. J. Roy. Statist. Soc. Ser. A 135 370-384.
33. RUE, H., MARTINO, S. and CHOPIN, N. (2009). Approximate Bayesian inference for latent Gaussian models using integrated nested Laplace approximations (with discussion). J. Roy. Statist. Soc. Ser. B 71 319-392.
34. SABANÉS BOVÉ, D. and HELD, L. (2011a). Hyper-g priors for generalized linear models. Bayesian Anal. 6 387-410.
35. SABANÉS BOVÉ, D. and HELD, L. (2011b). Bayesian fractional polynomials. Stat. Comput. 21 309-324.
36. SABANÉS BOVÉ, D., HELD, L. and KAUERMANN, G. (2014). Mixtures of g-priors for generalised additive model selection with penalised splines. J. Comput. Graph. Statist. DOI: 10.1080/10618600.2014.912136.
37. SCOTT, J. G. and BERGER, J. O. (2010). Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem. Ann. Statist. 38 2587-2619.
38. SELLKE, T., BAYARRI, M. J. and BERGER, J. O. (2001). Calibration of p-values for testing precise null hypotheses. Amer. Statist. 55 62-71.
39. STEYERBERG, E. (2009). Clinical Prediction Models. Springer, New York.
40. VAN HOUWELINGEN, J. C. and LE CESSIE, S. (1990). Predictive value of statistical models. Stat. Med. 9 1303-1325.
41. ZELLNER, A. (1986). On assessing prior distributions and Bayesian regression analysis with g-prior distributions. In Bayesian Inference and Decision Techniques (P. K. Goel and A. Zellner, eds.). Stud. Bayesian Econometrics Statist. 6 233-243. North-Holland, Amsterdam.
42. ZELLNER, A. and SIOW, A. (1980). Posterior odds ratios for selected regression hypotheses. In Bayesian Statistics: Proceedings of the First International Meeting Held in Valencia (J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith, eds.) 585-603. Univ. Valencia Press, Valencia.