Additive Models for Multitrait-Multimethod Data With a Multiplicative Trait-Method Relationship: A Simulation Study

Structural Equation Modeling

Volumn 21, Issue 1, 2014, Pages 68-80

  Zhang, Lidong ^a   Jin, Rong ^b   Leite, Walter L ^c   Algina, James ^c  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b AMERICAN INSTITUTES FOR RESEARCH   (United States)

^c UNIVERSITY OF FLORIDA   (United States)

Author keywords

composite direct product model (CDP); confirmatory factor analysis (CFA); correlated traits correlated methods model (CT CM); correlated traits correlated uniqueness model (CT CU); method effects; multitrait multimethod (MTMM) analysis

Indexed keywords

CONFIRMATORY FACTOR ANALYSES (CFA); CORRELATED TRAITS-CORRELATED METHODS MODEL (CT-CM); CORRELATED TRAITS-CORRELATED UNIQUENESS MODEL (CT-CU); DIRECT PRODUCT; METHOD EFFECTS; MULTITRAIT-MULTIMETHOD (MTMM) ANALYSIS;

FACTOR ANALYSIS;

COMPUTER SIMULATION;

EID: 84893657587     PISSN: 10705511     EISSN: 15328007     Source Type: Journal    
DOI: 10.1080/10705511.2014.856698     Document Type: Article

References (38)

1. Bagozzi, R. P. and Yi, Y. 1990. Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. Journal of Applied Psychology, 75: 547 - 560.
2. Bagozzi, R. P. and Yi, Y. 1991. Multitrait-multimethod matrices in consumer research. Journal of Consumer Research, 17: 426 - 439.
3. Bagozzi, R. P., Yi, Y. and Phillips, L. W. 1991. Assessing construct validity in organizational research. Administrative Science Quarterly, 36: 421 - 458.
4. Becker, T. E. and Cote, J. A. 1994. Additive and multiplicative effects in applied psychological research: An empirical assessment of three models. Journal of Management, 20: 625 - 641.
5. Beretvas, S. N., Meyers, J. L. and Leite, W. L. 2002. A reliability generalization study of the Marlowe-Crowne Social Desirability Scale. Educational and Psychological Measurement, 62: 570 - 589.
6. Browne, M. 1984. The decomposition of multitrait-multimethod matrices. British Journal of Mathematical and Statistical Psychology, 37: 1 - 21.
7. Browne, M. 1992. MUTMUM user's guide, Columbus, OH: The Ohio State University.
8. Byrne, B. M. and Goffin, R. D. 1993. Modeling MTMM data from additive and multiplicative covariance structures: An audit of construct validity concordance. Multivariate Behavioral Research, 28: 67 - 96.
9. Campbell, D. T. and Fiske, D. W. 1959. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56: 81 - 105.
10. Campbell, D. T. and O'Connell, E. J. 1967. Methods factors in multitrait-multimethod matrices: Multiplicative rather additive?. Multivariate Behavioral Research, 2: 409 - 426.
11. Coenders, G. and Saris, W. E. 2000. Testing nested additive, multiplicative and general multitrait-multimethod models. Structural Equation Modeling, 7: 219 - 250.
12. Cohen, J. 1973. Eta-squared and partial eta-squared in fixed factor ANOVA designs. Educational and Psychological Measurement, 33: 107 - 112.
13. Conway, J. M. 1996. Analysis and design of multitrait-multirater performance appraisal studies. Journal of Management, 22: 139 - 162.
14. Conway, J. M., Lievens, F., Scullen, S. E. and Lance, C. E. 2004. Bias in the correlated uniqueness model for MTMM data. Structural Equation Modeling, 11: 535 - 559.
15. Coovert, M. D., Craiger, J. P. and Teachout, M. S. 1997. Effectiveness of the direct product versus confirmatory factor model for reflecting the structure of multimethod-multirater job performance data. Journal of Applied Psychology, 82: 271 - 280.
16. Corten, I. W., Saris, W. E., Coenders, G., Van der Veld, W., Aalberts, C. E. and Kornelis, C. 2002. Fit of different models for multitrait-multimethod experiments. Structural Equation Modeling, 9: 213 - 232.
17. Dierdorff, E. C. and Wilson, M. A. 2003. A meta-analysis of job analysis reliability. Journal of Applied Psychology, 88: 635 - 646.
18. Eid, M. 2000. A multitrait-multimethod model with minimal assumptions. Psychometrika, 65: 241 - 261.
19. Eid, M., Lischetzke, T., Nussbeck, F. W. and Trierweiler, L. I. 2003. Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple-indicator CT-C (M-1) model. Psychological Methods, 8: 38 - 60.
20. Goffin, R. D. and Jackson, D. 1992. Analysis of multitrait-multirater performance appraisal data: composite direct product method versus confirmatory factor analysis. Multivariate Behavioral Research, 27: 363 - 385.
21. Hernández, A. and González-Romá, V. 2002. Analysis of the multitrait-multioccasion data: Additive versus multiplicative models. Multivariate Behavioral Research, 37: 59 - 87.
22. Hoogland, J. J. and Boomsma, A. 1998. Robustness studies in covariance structure modeling: An overview and a meta-analysis. Sociological Methods & Research, 26: 329 - 367.
23. Hu, L. and Bentler, P. M. 1999. cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Eqution Modeling, 6: 1 - 55.
24. Kenny, D. A. 1976. An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix. Journal of Experimental Social Psychology, 65: 507 - 516.
25. Kenny, D. A. and Kashy, D. A. 1992. Analysis of the multitrait-multimethod matrix by confirmatory factor analysis. Psychological Bulletin, 112: 165 - 172.
26. Kumar, A. and Dillon, W. R. 1992. An integrative look at the use of additive and multiplicative covariance structure models in the analysis of MTMM data. Journal of Marketing Research, 29: 51 - 64.
27. Lance, C. E., Noble, C. L. and Scullen, S. E. 2002. A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychological Methods, 7: 228 - 244.
28. Marsh, H. W. 1989. Confirmatory factor analysis of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement, 13: 335 - 361.
29. Marsh, H. W. and Bailey, M. 1991. Confirmatory factor analysis of multitrait-multimethod data: A comparison of alternative models. Applied Psychological Measurement, 15: 47 - 70.
30. Muthén, L. and Muthén, B. 2010. Mplus (Version 6.0), Los Angeles, CA: Muthén & Muthén.
31. R Development Core Team2010R A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. http://www.R-project.org (http://www.R-project.org)
32. Rodriguez, Michael C., & Maeda, Yukiko. (2006). Meta-analysis of coefficient alpha. Psychological Methods, 11, 306-322.
33. Swain, A. J. 1975. Analysis of parametric structures for variance matrices, Australia: University of Adelaide. Unpublished doctoral dissertation
34. Peterson, R. A. 1994. A meta-analysis of Cronbach's coefficient alpha. Journal of Consumer Research, 21: 381 - 391.
35. Rindskopf, D. and Rose, T. 1988. Some theory and applications of confirmatory second order factor analysis. Multivariate Behavioral Research, 23: 51 - 67.
36. Tomás, J. M., Hontangas, P. M. and Oliver, A. 2000. Linear confirmatory factor models to evaluate multitrait-multimethod matrices: The effects of number of indicators and correlation among methods. Multivariate Behavioral Research, 35: 469 - 499.
37. Vacha-Haase, T. and Thompson, B. 2011. Score reliability: A retrospective look back at 12 years of reliability generalization studies. Measurement and Evaluation in Counseling and Development, 44: 159 - 168.
38. Widaman, K. F. 1985. Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9: 1 - 26.