Graphical views of suppression and multicollinearity in multiple linear regression

American Statistician

Volumn 59, Issue 2, 2005, Pages 127-136

  Friedman, Lynn ^a   Wall, Melanie ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Collinearity; Enhancement; Multiple regression; Suppression; Variable selection in linear regression

Indexed keywords

EID: 18144399679     PISSN: 00031305     EISSN: None     Source Type: Journal    
DOI: 10.1198/000313005X41337     Document Type: Article

References (27)

1. Bollen, K. A. (1989), Structural Equations with Latent Variables, New York: Wiley.
2. Cohen, J., and Cohen, P. (1975, 1983), Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, New Jersey: Lawrence Erlbaum Associates.
3. Cohen, J., Cohen, P., West, S. G., and Aiken, L. S. (2003), Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (3rd ed.), New Jersey: Lawrence Erlbaum Associates.
4. Conger, A. J. (1974), "A Revised Definition for Suppressor Variables: A Guide to their Identification and Interpretation," Educational and Psychological Measurement, 34, 35-4-6.
5. Currie, I., and Korabinski, A. (1984), "Some Comments on Bivariate Regression," The Statistician, 33, 283-292.
6. Darlington, R. B. (1968), "Multiple Regression in Psychological Research and Practice," Psychological Bulletin, 69, 161-182.
7. _ (1990), Regression and Linear Models, New York: McGraw-Hill.
8. Fox, J. (1997), Applied Regression, Linear Models, and Related Methods, Thousand Oaks, CA: Sage.
9. _ (2003), "Linear Models, Problems," draft, McMaster University.
10. Friedman, L. (2002), Letter to the Editor, Comment on "The Inequality between the Coefficient of Determination and the Sum of Squared Simple Correlation Coefficients" by Shieh, G., The American Statistician, 56, 82.
11. 2: Correlated Variables are not Always Redundant," The American Statistician, 41, 129-132.
12. Harrison, D., and Rubinfeld, D. L. (1978), "Hedonic Prices and the Demand for Clean Air," Journal of Environmental Economics and Management, 5, 81-102. Data retrieved from StatLib at http://www.stat.unipg.it/stat/statlib/datasets/. This is the uncorrected version of the Boston Housing Price Dataset.
13. Horst, P. (1941), "The Prediction of Personal Adjustment," Social Science Research Council Bulletin, No. 48, New York.
14. Howell, D. C. (1997), Statistical Methods for Psychology, Boston: Duxbury Press.
15. Leahy, K. (2000), "Multicollinearity: When the Solution is the Problem" in Data Mining Cookbook, ed. O. P. Rud, New York: Wiley.
16. Lewis, J., and Escobar, L. (1986), "Suppression and Enhancement in Bivariate Regression," The Statistician, 35, 17-26.
17. Lynn, H. S. (2003), "Suppression and Confounding in Action," The American Statistician, 57, 58-61.
18. Maassen, G. H., and Bakker, A. B. (2001), "Suppressor Variables in Path Models: Definitions and Interpretations," Sociological Methods and Research, 30, 241-270.
19. Mitra, S. (1988), "The Relationship Between the Multiple and the Zero-order Correlation Coefficients," The American Statistician, 42, 89.
20. Neill, J. J. (1973), "Tests of the Equality of Two Dependent Correlations," Doctoral dissertation, University of California, Ann Arbor, Ann Arbor, MI: University Microfilms No. 74-7671.
21. Neter, J., Kutner, M., Nachtsheim, C., and Wasserman, W. (1996), Applied Linear Statistical Models (4th ed.), Chicago: Irwin.
22. Sharpe, N., and Roberts, R. (1997), "The Relationship among Sums of Squares, Correlation Coefficients, and Suppression," The American Statistician, 51, 46-48.
23. Shieh, G. (2001), "The Inequality Between the Coefficient of Determination and the Sum of Squared Simple Correlation Coefficients," The American Statistician, 55, 121-124.
24. Tzelgov, J., and Henik, A. (1981), "On the Differences Between Conger's and Velicer's Definitions of Suppressor," Educational Measurement, 41, 1027-1031.
25. _ (1991), "Suppression Situations in Psychological Research: Definitions, Implications and Applications," Psychological Bulletin, 109, 524-536.
26. Tzelgov, J., and Stern, I. (1978), "Relationships between Variables in Three Variable Linear Regression and the Concept of Suppressor," Educational and Psychological Measurement, 38, 325-335.
27. Velicer, W. (1968), "Suppressor Variables and the Semipartial Correlation Coefficient," Educational and Psychological Measurement, 38, 953-958.