Beyond step-down analysis: A new test for decomposing the importance of dependent variables in MANOVA

Journal of Applied Psychology

Volumn 98, Issue 3, 2013, Pages 469-477

  Tonidandel, Scott ^a   LeBreton, James M ^b  

^a DAVIDSON COLLEGE   (United States)

^b PURDUE UNIVERSITY   (United States)

Author keywords

Follow up tests; MANOVA; Relative importance

Indexed keywords

ARTICLE; METHODOLOGY; MULTIVARIATE ANALYSIS; REGRESSION ANALYSIS; STATISTICAL ANALYSIS; STATISTICS;

DATA INTERPRETATION, STATISTICAL; MULTIVARIATE ANALYSIS; REGRESSION ANALYSIS; RESEARCH DESIGN;

EID: 84877831941     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0032001     Document Type: Article

References (42)

1. Azen, R., & Budescu, D. V. (2003). The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods, 8, 129-148.
2. Bray, J. H., & Maxwell, S. E. (1982). Analyzing and interpreting significant MANOVAs. Review of Educational Research, 52, 340-367.
3. Budescu, D. V. (1993). Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114, 542-551.
4. Cortina, J. M., & Landis, R. S. (2009). When small effect sizes tell a big story, and when large effect sizes don't. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity, and fable in the organizational and social sciences (pp. 287-308). New York, NY: Routledge.
5. Darlington (1968). Multiple regression in psychological research and practice. Psychological Bulletin, 69, 161-182.
6. Dillon, W. R., & Goldstein, M. (1984). Multivariate analysis: Methods and applications. New York, NY: Wiley.
7. Ellingson, J. E., Sackett, P. R., & Connelly, B. S. (2007). Personality assessment across selection and development contexts: Insights into response distortion. Journal of Applied Psychology, 92, 386-395.
8. Engelhart, M. D. (1936). The technique of path coefficients. Psychometrika, 1, 287-293.
9. Ferrin, D. L., Kim, P. H., Cooper, C. D., & Dirks, K. T. (2007). Silence speaks volumes: The effectiveness of reticence in comparison to apology and denial for responding to integrity- and competence-based trust violations. Journal of Applied Psychology, 92, 893-908.
10. Finch, W. H. (2007). Performance of the Roy-Bargmann stepdown procedure as a follow up to a significant MANOVA. Multiple Linear Regression Viewpoints, 33, 12-22.
11. Hebl, M. R., King, E. B., Glick, P., Singletary, S. L., & Kazama, S. (2007). Hostile and benevolent reactions toward pregnant women: Complementary interpersonal punishments and rewards that maintain traditional roles. Journal of Applied Psychology, 92, 1499-1511.
12. Heilman, M. E., & Okimoto, T. G. (2007). Why are women penalized for success at male tasks? The implied communality deficit. Journal of Applied Psychology, 92, 81-92.
13. Henson, R. K. (2000). Demystifying parametric analyses: Illustrating canonical correlation analysis as the multivariate general linear model. Multiple Linear Regression Viewpoints, 26, 11-19.
14. Huberty, C. J., & Morris, J. D. (1989). Multivariate analysis versus multiple univariate analyses. Psychological Bulletin, 105, 302-308.
15. Huberty, C. J., & Olejnik, S. (2006). Applied MANOVA and discriminant analysis. Hoboken, NJ: Wiley.
16. Huberty, C. J., & Smith, J. D. (1982). The study of effects in MANOVA. Multivariate Behavioral Research, 17, 417-432.
17. Johnson, J. W. (2000). A heuristic method for estimating the relative weight of predictor variables in multiple regression. Multivariate Behavioral Research, 35, 1-19.
18. Johnson, J. W., & LeBreton, J. M. (2004). History and use of relative importance indices in organizational research. Organizational Research Methods, 7, 238-257.
19. Kachigan, S. K. (1982). Multivariate statistical analysis: A conceptual introduction. New York, NY: Radius Press.
20. LeBreton, J. M., Binning, J. F., Adorno, A. J., & Melcher, K. M. (2004). Importance of personality and job-specific affect for predicting job attitudes and withdrawal behavior. Organizational Research Methods, 7, 300-325.
21. LeBreton, J. M., Hargis, M. B., Griepentrog, B., Oswald, F. L., & Ployhart, R. E. (2007). A multidimensional approach for evaluating variables in organizational research and practice. Personnel Psychology, 60, 475-498.
22. LeBreton, J. M., Ployhart, R. E., & Ladd, R. T. (2004). A Monte Carlo comparison of relative importance methodologies. Organizational Research Methods, 7, 258-282.
23. LeBreton, J. M., & Tonidandel, S. (2008). Multivariate relative importance: Extending relative weight analysis to multivariate criterion spaces. Journal of Applied Psychology, 93, 329-345.
24. LeBreton, J. M., Tonidandel, S., & Krasikova, D. (in press). Residualized relative importance analysis: A technique for the comprehensive decomposition of variance in higher order effects regression models. Organizational Research Methods.
25. Martell, R. F., Lane, D. M., & Emrich, C. (1996). Male-female differences: A computer simulation. American Psychologist, 51, 157-158.
26. McElroy, J. C., & Crant, J. M. (2008). Handicapping: The effects of its source and frequency. Journal of Applied Psychology, 93, 893-900.
27. R Core Team. (2012). R: A language and environment for statistical computing [Computer software]. Vienna, Austria: R Foundation for Statistical Computing.
28. Roy, S. N., & Bargmann, R. E. (1958). Tests of multiple independence and the associated confidence bounds. Annals of Mathematical Statistics, 29, 491-503.
29. Singletary, S. L., & Hebl, M. R. (2009). Compensatory strategies for reducing interpersonal discrimination: The effectiveness of acknowledgment, increased positivity, and individualizing information. Journal of Applied Psychology, 94, 797-805.
30. Stevens, J. (1996). Applied multivariate statistics for the social sciences (3rd ed.). Mahwah, JN: Erlbaum.
31. Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). New York, NY: HarperCollins.
32. Tatsuoka, M. M. (1971). Multivariate analysis: Techniques for educational and psychological research. New York, NY: Wiley.
33. Toh, S. M., Morgeson, F. P., & Campion, M. A. (2008). Human resource configurations: Investigating fit with the organizational context. Journal of Applied Psychology, 93, 864-882.
34. Tonidandel, S., & LeBreton, J. M. (2010). Determining the relative importance of predictors in logistic regression: An extension of relative weights analysis. Organizational Research Methods, 13, 767-781.
35. Tonidandel, S., & LeBreton, J. M. (2011). Relative importance analyses: A useful supplement to multiple regression analyses. Journal of Business and Psychology, 26, 1-9.
36. Tonidandel, S., LeBreton, J. M., & Johnson, J. W. (2009). Determining the statistical significance tests of relative weights. Psychological Methods, 14, 387-399.
37. Urbakh, V. Y. (1971). Linear discriminant analysis: Loss of discriminating power when a variate is omitted. Biometrics, 27, 531-534.
38. Vignovic, J. A., & Thompson, L. F. (2010). Computer-mediated crosscultural collaboration: Attributing communication errors to the person versus the situation. Journal of Applied Psychology, 95, 265-276.
39. Walker, H. J., Feild, H. S., Giles, W. F., Armenakis, A. A., & Bernerth, J. B. (2009). Displaying employee testimonials on recruitment web sites: Effects of communication media, employee race, and job seeker race on organizational attraction and information credibility. Journal of Applied Psychology, 94, 1354-1364.
40. Weinfurt, K. P. (1998). Multivariate analysis of variance. In L. G. Grimm & P. R. Yarnold (Eds.), Reading and understanding multivariate statistics. Washington, DC: American Psychological Association.
41. Wilkinson, L. (1975). Response variable hypotheses in the multivariate analysis of variance. Psychological Bulletin, 82, 408-412.
42. Wilkinson, L. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.