A guide to Bayesian model selection for ecologists

Ecological Monographs

Volumn 85, Issue 1, 2015, Pages 3-28

  Hooten, M B ^a,b   Hobbs, N T ^b   Ellison, A M ^c  

^a Colorado State University ^*  (United States)

^b Department of Environmental and Radiological Health Sciences   (United States)

^c NONE

Author keywords

Akaike information criterion; Bayes factors; Cross validation; Deviance information criterion; Model averaging; Multi model inference; Regularization; Shrinkage

Indexed keywords

AKAIKE INFORMATION CRITERION; BAYESIAN ANALYSIS; ECOLOGICAL APPROACH; MODEL TEST; MODEL VALIDATION; PHILOSOPHY;

EID: 84926655351     PISSN: 00129615     EISSN: 15577015     Source Type: Journal    
DOI: 10.1890/14-0661.1     Document Type: Article

References (87)

1. Albert, J., and S. Chib. 1990. Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association 88:669-679.
2. Ando, T., and R. Tsay. 2010. Predictive likelihood for Bayesian model selection and averaging. International Journal of Forecasting 26:744-763.
3. Barker, R. J., and W. A. Link. 2013. Bayesian multimodel inference by RJMCMC: A Gibbs sampling approach. American Statistician 67:150-156.
4. Berger, J. O. 2006. Statistical decision theory and Bayesian analysis. Springer, New York, New York, USA.
5. Bernardo, J. M. 1979. Expected information as expected utility. Annals of Statistics 7:686-690.
6. Bernardo, J. M., and A. F. M. Smith. 1994. Bayesian theory. John Wiley, New York, New York, USA.
7. Bolker, B. 2008. Ecological models and data in R. Princeton University Press, Princeton, New Jersey, USA.
8. Bolker, B. 2009. Learning hierarchical models: advice for the rest of us. Ecological Applications 19:588-592.
9. Bondell, H. D., and B. J. Reich. 2012. Consistent highdimensional Bayesian variable selection via penalized credible regions. Journal of the American Statistical Association 107:1610-1624.
10. Burnham, K. P., and D. R. Anderson. 2002. Model selection and multimodel inference. Second edition. Springer-Verlag, Berlin, Germany.
11. Carlin, B. R., and S. Chib. 1995. Bayesian model choice via Markov Chain Monte Carlo methods. Journal of the Royal Statistical Society B 57:473-484.
12. Celeux, G., F. Forbes, C. P. Robert, and D. M. Titterington. 2006. Deviance information criteria for missing data models. Bayesian Analysis 1:651-674.
13. Clark, J. S. 2005. Why environmental scientists are becoming Bayesians. Ecology Letters 8:2-14.
14. Clark, J. S. 2007. Models for ecological data: an introduction. Princeton University Press, Princeton, New Jersey, USA.
15. Clyde, M. A., H. Desimone, and G. Parmigiani. 1996. Prediction via orthogonalized model mixing. Journal of the American Statistical Association 91:1197-1208.
16. Congdon, P. 2006. Bayesian model choice based on Monte Carlo estimates of posterior model probabilities. Computational Statistics and Data Analysis 50:346-357.
17. Cressie, N., C. A. Calder, J. S. Clark, J. M. Ver Hoef, and C. K. Wikle. 2009. Accounting for uncertainty in ecological analysis: the strengths and limitations of hierarchical statistical modeling. Ecological Applications 19:553-570.
18. Czado, C., T. Gneiting, and L. Held. 2009. Predictive model assessment for count data. Biometrics 65:1254-1261.
19. Dahlgren, J. P. 2010. Alternative regression methods are not considered in Murtaugh (2009) or by ecologists in general. Ecology Letters 13:E7-E9.
20. Dellaportas, P., J. J. Forster, and I. Ntzoufras. 1997. On Bayesian model and variable selection using MCMC. Technical report. Department of Statistics, Athens University of Economics and Business, Athens, Greece.
21. Dorazio, R. M., M. Kery, J. A. Royle, and M. Plattner. 2010. Models for inference in dynamic metacommunity systems. Ecology 91:2466-2475.
22. Dorazio, R. M., and D. T. Rodriquez. 2012. A Gibbs sampler for Bayesian analysis of site-occupancy data. Methods in Ecology and Evolution 3:1093-1098.
23. Garrard, G. E., M. A. McCarthy, P. A. Vesk, J. Q. Radford, and A. F. Bennett. 2012. A predictive model of avian natal dispersal distance provides prior information for investigating response to landscape change. Journal of Animal Ecology 81:14-23.
24. Geisser, S. 1993. Predictive inference: an introduction. Chapman and Hall, London, UK.
25. Gelfand, A. E., and S. K. Ghosh. 1998. Model choice: a minimum posterior predictive loss approach. Biometrika 85:1-13.
26. Gelfand, A. E., and A. F. M. Smith. 1990. Sampling-based approaches to calculating marginal densities. Journal of the American Statistical Association 85:398-409.
27. Gelman, A., J. B. Carlin, H. S. Stern, D. B. Dunson, A. Vehtari, and D. B. Rubin. 2014a. Bayesian data analysis. Third edition. Chapman and Hall/CRC, Boca Raton, Florida, USA.
28. Gelman, A., J. Huang, and A. Vehtari. 2014b. Understanding predictive information criteria for Bayesian models. Statistics and Computing. http://dx.doi.org/0.1007/s11222-013-9416-2
29. Gelman, A., and C. R. Shalizi. 2012. Philosophy and the practice of Bayesian statistics. British Journal of Mathematical and Statistical Psychology 66:8-38.
30. George, E. I., and R. E. McCulloch. 1993. Variable selection via Gibbs sampling. Journal of the American Statistical Association 85:398-409.
31. Ghosh, J., and M. A. Clyde. 2011. Rao-Blackwellization for Bayesian variable selection and model averaging in linear and binary regression: a novel data augmentation approach. Journal of the American Statistical Association 106:1041-1052.
32. Gneiting, T. 2011. Making and evaluating point forecasts. Journal of the American Statistical Association 106:746-762.
33. Gneiting, T., and A. E. Raftery. 2007. Strictly proper scoring rules, prediction, and estimation. Journal of the American Statistical Association 102:359-378.
34. Godsill, S. J. 2001. On the relationship between Markov chain Monte Carlo methods for model uncertainty. Journal of Computational and Statistical Graphics 10:230-248.
35. Gotelli, N. J., and A. M. Ellison. 2012. A primer of ecological statistics. Second edition. Sinauer Associates, Sunderland, Massachusetts, USA.
36. Graham, M. H. 2003. Confronting multicollinearity in ecological multiple regression. Ecology 84:2809-2815.
37. Green, P. J. 1995. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82:711-732.
38. Hastie, D. I., and P. J. Green. 2012. Model choice using reversible jump Markov chain Monte Carlo. Statistica Neerlandica 66:309-338.
39. Hastie, T., R. Tibshirani, and J. Friedman. 2009. Elements of statistical learning: data mining, inference, and prediction. Second edition. Springer, New York, New York, USA.
40. Held, L., B. Schrodle, and H. Rue. 2010. Posterior and crossvalidatory predictive checks: a comparison of MCMC and INLA. Pages 91-109 in T. Kneib and G. Tutz, editors. Statistical modelling and regression structures: festschrift in honour of Ludwig Fahrmeir. Springer, New York, New York, USA.
41. Hobbs, N. T. 2009. New tools for insight from ecological models and data. Ecological Applications 19:551-552.
42. Hobbs, N. T., and M. B. Hooten. In press. Bayesian models: a statistical primer for ecologists. Princeton University Press, Princeton, New jersey, USA.
43. Hoeting, J. A., D. Madigan, A. E. Raftery, and C. T. Volinsky. 1999. Bayesian model averaging: a tutorial. Statistical Science 14:382-417.
44. Hooten, M. B., D. R. Larsen, and C. K. Wikle. 2003. Predicting the spatial distribution of ground flora on large domains using a hierarchical Bayesian model. Landscape Ecology 18:487-502.
45. Hooten, M. B., W. B. Leeds, J. Fiechter, and C. K. Wikle. 2011. Assessing first-order emulator inference for physical parameters in nonlinear mechanistic models. Journal of Agricultural, Biological and Environmental Statistics 16:475-494.
46. Jeffreys, H. 1961. Theory of probability. Third edition. Oxford University Press, Oxford, UK.
47. Johnson, D. S., P. B. Conn, M. B. Hooten, J. Ray, and B. Pond. 2013. Spatial occupancy models for large data sets. Ecology 94:801-808.
48. Johnson, D. S., and J. A. Hoeting. 2011. Bayesian multimodel inference for geostatistical regression models. PLoS ONE 6:e25677.
49. Johnson, J. B., and K. S. Omland. 2004. Model selection in ecology and evolution. Trends in Ecology and Evolution 19:101-108.
50. Kass, R. E., and A. E. Raftery. 1995. Bayes factors. Journal of the American Statistical Association 90:773-795.
51. Kery, M. 2010. Introduction to WinBUGS for ecologists. Academic Press, Burlington, Massachusetts, USA.
52. Kery, M., and H. Schmid. 2004. Monitoring programs need to take into account imperfect species detectability. Basic and Applied Ecology 5:65-73.
53. Knaus, J. 2013. snowfall: easier cluster computing (based on snow). R package version 1.84-4. http://cran. r-project.org/package=snowfall
54. Kuo, L., and B. Mallick. 1998. Variable selection for regression models. Sankhya, Series B 60:65-81.
55. Kyung, M., J. Gill, M. Ghosh, and G. Casella. 2010. Penalized regression, standard errors, and Bayesian lassos. Bayesian Analysis 5:369-412.
56. Laud, P., and J. Ibrahim. 1995. Predictive model selection. Journal of the Royal Statistical Society B 57:247-262.
57. Lehmann, E. L., and G. Casella. 1998. Theory of point estimation. Springer, New York, New York, USA.
58. Link, W. A., and R. J. Barker. 2006. Model weights and the foundations of multimodel inference. Ecology 87:2626-2635.
59. Link, W. A., and R. J. Barker. 2010. Bayesian inference: with ecological applications. Academic Press, London, UK.
60. MacKenzie, D. I., J. D. Nichols, J. E. Hines, M. G. Knutson, and A. B. Franklin. 2003. Estimating site occupancy, colonization, and local extinction when a species is detected imperfectly. Ecology 84:2200-2255.
61. MacKenzie, D. I., J. D. Nichols, G. B. Lachman, S. Droege, J. A. Royle, and C. A. Langtimm. 2002. Estimating site occupancy rates when detection probabilities are less than one. Ecology 83:2248-2255.
62. MacKenzie, D. I., J. D. Nichols, J. A. Royle, K. H. Pollock, L. L. Bailey, and J. E. Hines. 2006. Occupancy estimation and modeling. Elsevier, Amsterdam, The Netherlands.
63. Madigan, D., and A. E. Raftery. 1994. Model selection and accounting for model uncertainty in graphical models using Occam's window. Journal of the American Statistical Association 89:1535-1546.
64. Martin, T. G., B. A. Wintle, J. R. Rhodes, P. M. Kuhnert, S. A. Field, S. J. Low-Choy, A. J. Tyre, and H. Possingham. 2005. Zero-tolerance in ecology: improving ecological inference by modelling the source of zero observations. Ecology Letters 8:1235-1246.
65. Miller, A. 2002. Subset selection in regression. Chapman and Hall/CRC, Boca Raton, Florida, USA.
66. Moreno, M., and S. R. Lele. 2010. Improved estimation of site occupancy using penalized likelihood. Ecology 91:341-346.
67. O'Hara, R. B., and M. J. Sillanpaa. 2009. A review of Bayesian variable selection methods: What, how and which. Bayesian Analysis 4:85-118.
68. Omerod, J. T., and M. P. Wand. 2010. Explaining variational approximations. American Statistician 64:140-153.
69. Park, T., and G. Casella. 2008. The Bayesian Lasso. Journal of the American Statistical Association 103:681-686.
70. Pettit, L. I. 1990. The conditional predictive ordinate for the normal distribution. Journal of the American Statistical Association 52:175-184.
71. Plummer, M. 2002. Discussion of the paper by Spiegelhalter et al. Journal of the Royal Statistical Society B 64:620.
72. Plummer, M. 2008. Penalized loss functions for Bayesian model comparison. Biostatistics 9:523-539.
73. R Core Team. 2013. R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. http://www.r-project.org
74. Richardson, S. 2002. Discussion of the paper by Spiegelhalter et al. Journal of the Royal Statistical Society B 64:626-227.
75. Ripley, B. D. 1996. Pattern recognition and neural networks. Cambridge University Press, Cambridge, UK.
76. Royle, J. A., and R. M. Dorazio. 2008. Hierarchical modeling and inference in ecology. Academic Press.
77. Schwarz, G. E. 1978. Estimating the dimension of a model. Annals of Statistics 6:461-464.
78. Seaman, J. W., III, J. W. Seaman, Jr., and J. D. Stamey. 2012. Hidden dangers of specifying noninformative priors. American Statistician 66:77-84.
79. Spiegelhalter, D. J., N. G. Best, B. P. Carlin, and A. Van Der Line. 2002. Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society B 64:583-639.
80. Spiegelhalter, D. J., and A. F. M. Smith. 1982. Bayes factors for linear and log-linear models with vague prior information. Journal of the Royal Statistical Society B 44:377-387.
81. Stone, M. 1977. An asymptotic equivalence of choice of model cross-validation and Akaike's criterion. Journal of the Royal Statistical Society B 36:44-47.
82. Sutter, H. 2005. The free lunch is over: a fundamental turn toward concurrency in software. Dr. Dobbs Report 30 (3).
83. Tanner, M. A. 1996. Tools for statistical inference: methods for the exploration of posterior distributions and likelihood functions. Third edition. Springer, New York, New York, USA.
84. Tibshirani, R. 1996. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society B 58:267-288.
85. Vehtari, A., and J. Ojanen. 2012. A survey of Bayesian predictive methods for model assessment, selection and comparison. Statistics Surveys 6:142-228.
86. Watanabe, S. 2010. Asymptotic equivalence of Bayes crossvalidation and widely applicable information criterion in singular learning theory. Journal of Machine Learning Research 11:3571-3594.
87. Watanabe, S. 2013. A widely applicable Bayesian information criterion. Journal of Machine Learning Research 14:867-897.