Stepwise model fitting and statistical inference: Turning noise into signal pollution

American Naturalist

Volumn 173, Issue 1, 2009, Pages 119-123

  Mundry, Roger ^a   Nunn, Charles L ^a,b,c  

^a MAX PLANCK INSTITUTE FOR EVOLUTIONARY ANTHROPOLOGY   (Germany)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c HARVARD UNIVERSITY   (United States)

Author keywords

Error rate; GLM; Multiple regression; Multiple testing; Statistical inference; Stepwise modeling

Indexed keywords

DATA SET; ERROR ANALYSIS; NUMERICAL MODEL; REGRESSION ANALYSIS; STATISTICAL ANALYSIS;

EID: 58749113262     PISSN: 00030147     EISSN: None     Source Type: Journal    
DOI: 10.1086/593303     Document Type: Article

References (25)

1. Burnham, K. P., and D. R. Anderson. 2002. Model selection and multimodel inference. 2nd ed. Springer, Berlin.
2. Cohen, J., and P. Cohen. 1983. Applied multiple regression/correlation analysis for the behavioral sciences. 2nd ed. Erlbaum, Hillsdale, NJ.
3. Derksen, S., and H. J. Keselman. 1992. Backward, forward and stepwise automated subset selection algorithms: frequency of obtaining authentic and noise variables. British Journal of Mathematical and Statistical Psychology 45:265-282.
4. Dobson, A. J. 2002. An introduction to generalized linear models. Chapman & Hall/CRC, Boca Raton, FL.
5. Faraway, J. J. 2006. Extending linear models with R. Chapman & Hall/CRC, Boca Raton, FL.
6. Field, A. 2005. Discovering statistics using SPSS. Sage, London.
7. James, F. C., and C. E. McCulloch. 1990. Multivariate analysis in ecology and systematics: panacea or Pandora's box? Annual Review of Ecology, Evolution, and Systematics 21:129-166.
8. Johnson, J. B., and K. S. Omland. 2004. Model selection in ecology and evolution. Trends in Ecology & Evolution 19:101-108.
9. Lovell, M. C. 1983. Data mining. Review of Economics and Statistics 65:1-12.
10. Lukacs, P. M., W. L. Thompson, W. L. Kendall, W. R. Gould, P. F. Doherty Jr., K. P. Burnham, and D. R. Anderson. 2007. Concerns regarding a call for pluralism of information theory and hypothesis testing. Journal of Applied Ecology 44:456-460.
11. Miller, A. J. 1984. Selection of subsets of regression variables. Journal of the Royal Statistical Society A 147:389-425.
12. Moran, M. D. 2003. Arguments for rejecting the sequential Bonferroni in ecological studies. Oikos 100:403-405.
13. Mundry, R., and J. Fischer. 1998. Use of statistical programs for nonparametric tests of small samples often leads to incorrect P-values: examples from animal behaviour. Animal Behaviour 56:256-259.
14. Nakagawa, S. 2004. A farewell to Bonferroni: the problems of low statistical power and publication bias. Behavioral Ecology 15:1044-1045.
15. Pope, P. T., and J. T. Webster. 1972. The use of an F-statistic in stepwise regression procedures. Technometrics 14:327-340.
16. Quinn, G. P., and M. J. Keough. 2002. Experimental designs and data analysis for biologists. Cambridge University Press, Cambridge.
17. Sleep, D. J. H., M. C. Drever, and T. D. Nudds. 2007. Statistical versus biological hypothesis testing: response to Steidl. Journal of Wildlife Management 71:2120-2121.
18. Sokal, R. R., and F. J. Rohlf. 1995. Biometry: the principles and practice of statistics in biological research. 3rd ed. Freeman, New York.
19. Steidl, R. J. 2006. Model selection, hypothesis testing, and risks of condemning analytical tools. Journal of Wildlife Management 70:1497-1498.
20. Stephens, P. A., S. W. Buskirk, G. D. Hayward, and C. M. del Rio. 2005. Information theory and hypothesis testing: a call for pluralism. Journal of Applied Ecology 42:4-12.
21. Stephens, P. A., S. W. Buskirk, and C. M. del Rio. 2007. Inference in ecology and evolution. Trends in Ecology & Evolution 22:192-197.
22. Tabachnick, B. G., and L. S. Fidell. 2001. Using multivariate statistics. 4th ed. Allyn & Bacon, Boston.
23. Whittingham, M. J., P. A. Stephens, R. B. Bradbury, and R. P. Freckleton. 2006. Why do we still use stepwise modelling in ecology and behaviour? Journal of Animal Ecology 75:1182-1189.
24. Wilkinson, L. 1979. Tests of significance in stepwise regression. Psychological Bulletin 86:168-174.
25. Zar, J. H. 1999. Biostatistical analysis. 4th ed. Prentice Hall, Upper Saddle River, NJ.