Using commonality analysis in multiple regressions: A tool to decompose regression effects in the face of multicollinearity

Methods in Ecology and Evolution

Volumn 5, Issue 4, 2014, Pages 320-328

  Ray Mukherjee, Jayanti ^a   Nimon, Kim ^b   Mukherjee, Shomen ^a   Morris, Douglas W ^c   Slotow, Rob ^a   Hamer, Michelle ^a,d  

^a UNIVERSITY OF KWAZULU NATAL   (South Africa)

^b UNIVERSITY OF NORTH TEXAS   (United States)

^c LAKEHEAD UNIVERSITY   (Canada)

^d SOUTH AFRICAN NATIONAL BIODIVERSITY INSTITUTE   (South Africa)

Author keywords

Habitat selection; Hierarchical regression; Standardized partial regression coefficient; Stepwise regression; Structure coefficients; Suppressor variable

Indexed keywords

EID: 84898008886     PISSN: None     EISSN: 2041210X     Source Type: Journal    
DOI: 10.1111/2041-210X.12166     Document Type: Article

References (43)

1. Araújo, M.B. & Guisan, A. (2006) Five (or so) challenges for species distribution modeling. Journal of Biogeography, 33, 1677-1688.
2. Beckstead, J.W. (2012) Isolating and examining sources of suppression and multicollinearity in multiple linear regression. Multivariate Behavioral Research, 47, 224-246.
3. Burnham, K.P. & Anderson, D.R. (2002) Model Selection and Multimodel Inference: A Practice Information-Theoretic Approach, 1st edn. Springer-Verlag, New York.
4. Capraro, R.M. & Capraro, M.M. (2001) Commonality analysis: understanding variance contributions to overall canonical correlation effects of attitude toward mathematics on geometry achievement. Multiple Linear Regression Viewpoints, 27, 16-23.
5. Cohen, J. & Cohen, P. (1983) Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 2nd edn. Lawrence Erlbaum Associates, Hillsdale, New Jersey.
6. Conger, A.J. (1974) A revised definition for suppressor variables: a guide to their identification and interpretation. Educational and Psychological Measurement, 34, 35-46.
7. Courville, T. & Thompson, B. (2001) Use of structure coefficients in published multiple regression articles: β is not enough. Educational and Psychological Measurement, 61, 229-248.
8. Graham, M.H. (2003) Multicollinearity in ecological multiple regression. Ecology, 84, 2809-2815.
9. Hale, J.B., Fiorello, C.A., Kavanagh, J.A., Hoeppner, J.B. & Gaither, R.A. (2001) WISC-III predictors of academic achievement for children with learning disabilities: are global and factor scores comparable? School Psychology Quarterly, 16, 31-55.
10. Henderson, H.V. & Velleman, P.F. (1981) Building multiple regression models interactively. Biometrics, 37, 391-411.
11. Kerlinger, F.N. & Pedhazur, E.J. (1973) Multiple Regression in Behavioral Research, 1st edn. Holt, Rinehart and Winston Inc., New York.
12. Kraha, A., Turner, H., Nimon, K., Zientek, L.R. & Henson, R.K. (2012) Interpreting multiple regression in the face of multicollinearity. Frontiers in Psychology, 3, 1-10.
13. LeBreton, J.M., Ployhart, R.E. & Ladd, R.T. (2004) A Monte Carlo comparison of relative importance methodologies. Organizational Research Methods, 7, 258-282.
14. Lewis, M. (2007) Stepwise versus hierarchical regression: pros and cons. Paper presented at the Annual Meeting of the Southwest Educational Research Association, San Antonio, TX.
15. Luo, W. & Azen, R. (2013) Determining predictor importance in hierarchical linear models using dominance analysis. Journal of Educational and Behavioral Statistics, 38, 3-31.
16. MacKinnon, D.P., Krull, J.L. & Lockwood, C.M. (2000) Equivalence of the mediation, confounding, and suppression effect. Prevention Research, 4, 173-185.
17. Mood, A.M. (1969) Macro-analysis of the American educational system. Operations Research, 17, 770-784.
18. Morris, D.W., Dupuch, A. & Halliday, W.D. (2012) Climate-induced habitat selection predicts future evolutionary strategies of lemmings. Evolutionary Ecology Research, 14, 689-705.
19. Morris, D.W. & Mukherjee, S. (2006) Simulated and human metapopulations created by habitat selection. Evolutionary Ecology Research, 8, 1263-1275.
20. Nakagawa, S. & Schielzeth, H. (2013) A general and simple method for obtaining R2 from generalized linear mixed-effects models. Methods in Ecology and Evolution, 4, 133-142.
21. Nathans, L., Oswald, F.L. & Nimon, K. (2012) Interpreting multiple linear regression: a guidebook of variable importance. Practical Assessment Research & Evaluation, 17, 1-19.
22. Newton, R.G. & Spurrell, D. (1967) A development of multiple regression for the analysis of routine data. Applied Statistics, 16, 51-64.
23. Nimon, K. (2010) Regression commonality analysis: demonstration of an SPSS solution. Multiple Linear Regression Viewpoints, 36, 10-17.
24. Nimon, K., Henson, R. & Roberts, K. (2013) Using fit indices to holistically assess forms of predictor importance in multilevel models. Paper presented at the Annual Meeting of the American Psychological Association, Honolulu, HI.
25. Nimon, K. & Oswald, F.L. (2013) Understanding the results of multiple linear regression: beyond standardized regression coefficients. Organizational Research Methods, 16, 650-674.
26. Nimon, K., Oswald, F.L. & Roberts, J.K. (2013) Interpreting regression effects. R package version 2.0-0.URL: http://cran.r-project.org/web/packages/yhat/index.html [accessed on 17th September, 2013].
27. Nimon, K. & Reio, T. (2011) Regression commonality analysis: a technique for quantitative theory building. Human Resource Development, 10, 329-340.
28. Nimon, K., Lewis, M., Kane, R. & Haynes, R.M. (2008) An R package to compute commonality coefficients in multiple regression case: an introduction to the package and a practical example. Behavior Research Methods, 40, 457-466.
29. Pedhazur, E.J. (1997) Multiple Regression in Behavioral Research: Explanation and Prediction, 3rd edn. Harcourt Brace, Orlando, FL.
30. Petrocelli, J.V. (2003) Hierarchical multiple regression in counseling research: common problems and possible remedies. Measurement and Evolution in Counseling and Development, 36, 9-22.
31. R Development Core Team (2013) R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna. URL: http://www.R-project.org.
32. Raffel, T.R., Michael, P.J., Sites, E.W. & Rohr, J.R. (2010) What drives chytrid infections in newt populations? Associations with substrate, temperature, and shade. EcoHealth, 7, 526-536.
33. Schneider, W.J. (2008) Playing statistical Ouija board with commonality analysis: good questions, wrong assumptions. Applied Neuropsychology, 15, 44-53.
34. Siebold, D.R. & McPhee, R.D. (1979) Commonality analysis: a method for decomposing explained variance in multiple regression analysis. Human Communication Research, 5, 355-363.
35. Smith, A.C., Koper, N., Francis, C.M. & Fahrig, L. (2009) Confronting collinearity: comparing methods for disentangling the effects of habitat loss and fragmentation. Landscape Ecology, 24, 1271-1285.
36. Sokal, R.F. & Rohlf, F.J. (1995) Biometry: The Principles and Practice of Statistics in Biological Research, 3rd edn. W.H. Freeman, New York.
37. Sorice, M.G. & Conner, J.R. (2010) Predicting private landowner intensions to enroll in an incentive program to protect endangered species. Human Dimensions of Wildlife, 15, 77-89.
38. Thomas, R.D., Hughes, E. & Zumbo, B.D. (1998) On variable importance in linear regression. Social Indicators Research, 45, 253-275.
39. Thompson, B. (1995) Stepwise regression and stepwise discriminant analysis need not apply here: a guidelines editorial. Educational and Psychological Measurement, 55, 525-534.
40. Thompson, B. (2006) Foundations of Behavioral Statistics: An Insight-Based Approach, 1st edn. The Guilford Press, New York.
41. Tomer, P. (2003) A short history of structural equation models. Structural Equation Modeling: Applications in Ecological and Evolutionary Biology (eds B.H. Pugesek, A. Tomer & A. von Eye), pp. 85-124. Cambridge University Press, New York.
42. Whittingham, M.J., Stephens, P.A., Bradbury, R.B. & Freckleton, R.P. (2006) Why do we still use stepwise modeling in ecology and behaviour? Journal of Animal Ecology, 75, 1182-1189.
43. Zientek, L.R. & Thompson, B. (2006) Commonality analysis: partitioning variance to facilitate better understanding of data. Journal of Early Intervention, 4, 299-307.