Analyzing multitrait-multimethod data: A comparison of three approaches

Methodology

Volumn 5, Issue 3, 2009, Pages 99-111

  Höfling, Volkmar ^a   Schermelleh Engel, Karin ^a   Moosbrugger, Helfried ^a  

^a GOETHE UNIVERSITY   (Germany)

Author keywords

Confirmatory factor analysis; Convergent validity; Correlated trait correlated method minus one model; Discriminant validity; Multilevel analysis; Multitrait multimethod analysis; Three mode factor model

Indexed keywords

EID: 69949099258     PISSN: 16141881     EISSN: 16142241     Source Type: Journal    
DOI: 10.1027/1614-2241.5.3.99     Document Type: Article

References (40)

1. Arbuckle, J. L., & Wottke, W. (2003). Amos 5.0 Update to the user's guide. Chicago: Small Waters Corporation.
2. Bentler, P. M., & Lee, S. Y. (1979). A statistical development of three-mode factor analysis. British Journal of Mathematical and Statistical Psychology, 32, 87-104.
3. Biesanz, J. C., & West, S. G. (2004). Towards understanding assessments of the Big Five: Multitrait-multimethod analyses of convergent and discriminant validity across measurement occasion and type of observer. Journal of Personality, 72, 845-876.
4. Bloxom, B. (1968). A note on invariance in three-mode factor analysis. Psychometrika, 33, 347-350.
5. Browne, M. W. (1984). The decomposition of multitrait-multimethod matrices. British Journal of Mathematical and Statistical Psychology, 37, 1-21.
6. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Beverly Hills, CA: Sage.
7. Bryk, A. S., & Raudenbusch, S. W. (1992). Hierarchical linear models for social and behavioral research: Application and data analysis methods. Newbury Park, CA: Sage.
8. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
9. Courvoisier, D. S., Nussbeck, F. W., Eid, M., Geiser, C., & Cole, D. A. (2008). Analyzing the convergent validity of states and traits: Development and application of multimethod latent state-trait models. Psychological Assessment, 20, 270-280.
10. Dumenci, L. (2000). Multitrait-multimethod analysis. In H. E. A. Tinsley & S. D. Brown (Eds.), Handbook of applied multivariate statistics and mathematical modeling (pp. 583-611). San Diego, CA: Academic Press.
11. Eid, M. (2000). A multitrait-multimethod model with minimal assumptions. Psychometrika, 65, 241-261.
12. Eid, M. (2006). Methodological approaches for analyzing multimethod data. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology (pp. 223-230). Washington, DC: APA.
13. Eid, M., & Diener, E. (2006). Introduction: The need for multimethod measurement in psychology. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology (pp. 283-299). Washington, DC: APA.
14. Eid, M., Lischetzke, T., & Nussbeck, F. W. (2006). Structural equation models for multitrait-multimethod data. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology (pp. 283-299). Washington, DC: APA.
15. Eid, M., Lischetzke, T., Nussbeck, F. W., & Geiser, C. (2004). Die Multitrait-Multimethod-Analyse: Entwicklung neuer Modelle und ihre Anwendung in der Differentiellen und Diagnostischen Psychologie [The multitrait-multimethod analysis: development of new models and their application in psychology]. Landau in der Pfalz: Universität Koblenz-Landau DFG-Projekt EI 379/5-2.
16. Eid, M., Lischetzke, T., Nussbeck, F. W., & Trierweiler, L. I. (2003). Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple indicator CT-C(M-1) model. Psychological Methods, 8, 38-60.
17. Eid, M., Nussbeck, F. W., Geiser, C., Cole, D. A., Gollwitzer, M., & Lischetzke, T. (2008). Structural equation modelling of multitrait-multimethod data: Different models for different types of methods. Psychological Methods, 13, 230-253.
18. Geiser, C., Eid, M., & Nussbeck, F. W. (2008). On the meaning of latent variables in the CT-C(M-1) model: A comment on Maydeu-Olivares and Coffman (2006). Psychological Methods, 13, 49-57.
19. Hox, J. J. (2002). Multilevel analysis. Techniques and applications. Mahwah, NJ: Lawrence Erlbaum Associates.
20. Hox, J. J., & Maas, C. (2006). Multilevel models for multimethod measurements. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology (pp. 269-281). Washington, DC: APA.
21. Kenny, D. A. (1976). An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix. Journal of Experimental Social Psychology, 12, 247-252.
22. Maas, C. J. M., Lensvelt-Mulders, G. J. L. M., & Hox, J. J. (2009). A multilevel multitrait-multimethod analysis. Methodology, 5, 72-77.
23. Marsh, H. W. (1989). Confirmatory factor analysis of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement, 12, 335-361.
24. Marsh, H. W., & Grayson, D. (1995). Latent variable models of multitrait-multimethod data. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 177-198). Thousand Oaks: Sage.
25. Marsh, H. W., & Hocevar, D. (1988). A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. Journal of Applied Psychology, 73, 107-117.
26. Muthén, L. K., & Muthén, B. O. (2006). Mplus user's guide. Los Angeles, CA: Muthén & Muthén.
27. Neale, M. C., Boker, S. M., Xie, G., & Maes, H. H. (1999). Mx: Statistical modeling (5th ed.) Available at: http://www.vcu.edu/mx.
28. Nussbeck, F. W. (2006). Assessing multimethod association with categorical variables. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology (pp. 231-247). Washington, DC: APA.
29. Nussbeck, F. W., Eid, M., Geiser, C., Courvoisier, D. S., & Lischetzke, T. (2009). A CTC(M-1) model for different types of raters. Methodology, 5, 88-98.
30. Oort, F. J. (1999). Stochastic three-mode models for mean and covariances structures. British Journal of Mathematical and Statistical Psychology, 52, 243-272.
31. Oort, F. J. (2009). Three-mode models for multitrait-multimethod data. Methodology, 5, 78-87.
32. Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903.
33. Pohl, S., Steyer, R., & Kraus, K. (2008). Modelling method effects as individual causal effects. Journal of the Royal Statistical Society, Series A, 171, 41-63.
34. Rost, J., & Carstensen, C. (2002). Multidimensional Rasch measurement via item component models and faceted designs. Applied Psychological Measurement, 26, 42-56.
35. Rost, J., & Walter, O. (2006). Multimethod item response theory. In M. Eid & E. Diener (Eds.), Handbook of multimethod measurement in psychology (pp. 249-268). Washington, DC: APA.
36. Schermelleh-Engel, K., Keith, N., Moosbrugger, H., & Hodapp, V. (2004). Decomposing person and occasion-specific effects: An extension of latent state-trait theory to hierarchical models. Psychological Methods, 9, 198-219.
37. Schermelleh-Engel, K., & Schweizer, K. (2007). Multitrait-Multimethod-Analysen. In H. Moosbrugger & A. Kelava [Multitrait-multimethod analyses] (Eds.), Testtheorie und Fragebogenkonstruktion [Test theory and questionnaire designing]. Heidelberg: Springer.
38. Snijders, T. A. B., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. London: Sage.
39. Swain, A. J. (1975). Analysis of parametric structures for variance matrices. Australia: University of Adelaide Unpublished doctoral dissertation.
40. Widaman, K.-F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9, 1-26.