A Comparison of Method Effects in Two Confirmatory Factor Models for Structurally Different Methods

Structural Equation Modeling

Volumn 19, Issue 3, 2012, Pages 409-436

  Geiser, Christian ^a   Eid, Michael ^b   West, Stephen G ^c   Lischetzke, Tanja ^d   Nussbeck, Fridtjof W ^e  

^a UTAH STATE UNIVERSITY   (United States)

^b FREIE UNIVERSITÄT BERLIN   (Germany)

^c ARIZONA STATE UNIVERSITY   (United States)

^d University of Koblenz Landau ^*  (Germany)

^e UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

confirmatory factor analysis; CT C(M 1); latent difference; method effects; multitrait multimethod analysis

Indexed keywords

EID: 84864658895     PISSN: 10705511     EISSN: None     Source Type: Journal    
DOI: 10.1080/10705511.2012.687658     Document Type: Article

References (43)

1. Amador-Campos, J. A., Forns-Santacana, M., Guardia-Olmos, J. and Peró-Cebollero, M. 2006. DSM-IV attention deficit hyperactivity disorder symptoms: Agreement between informants in prevalence and factor structure at different ages. Journal of Psychopathology and Behavioral Assessment, 28: 23-32.
2. Bandalos, D. L. 2002. The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling. Structural Equation Modeling, 9: 78-102.
3. Campbell, D. T. and Fiske, D. W. 1959. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56: 81-105.
4. Cohen, J., Cohen, P., West, S. G. and Aiken, L. S. 2003. Applied multiple regression/correlation analysis for the behavioral sciences. Mahwah, NJ: Erlbaum.
5. Cronbach, L. J. 1995. "Giving method variance its due.". In Personality research, methods, and theory: A festschrift honoring Donald W. Fiske, Edited by: Shrout, P. E. and Fiske, S. T. 145-157. Mahwah, NJ: Erlbaum.
6. Deegan, J. 1978. On the occurrence of standardized regression coefficients greater than one. Educational and Psychological Measurement, 38: 873-888.
7. Dumenci, L. 2000. "Multitrait-multimethod analysis.". In Handbook of applied multivariate statistics and mathematical modeling, Edited by: Brown, S. D. and Tinsley, H. E. A. 583-611. San Diego, CA: Academic.
8. Eid, M. 1996. Longitudinal confirmatory factor analysis for polytomous item responses: Model definition and model selection on the basis of stochastic measurement theory. Methods of Psychological Research-Online, 1: 65-85.
9. Eid, M. 2000. A multitrait-multimethod model with minimal assumptions. Psychometrika, 65: 241-261.
10. Eid, M. and Diener, E. 2006. Handbook of multimethod measurement in psychology. Washington, DC: American Psychological Association.
11. Eid, M., Lischetzke, T. and Nussbeck, F. W. 2006. "Structural equation models for multitrait-multimethod data.". In Handbook of multimethod measurement in psychology, Edited by: Eid, M. and Diener, E. 283-299. Washington, DC: American Psychological Association.
12. Eid, M., Lischetzke, T., Nussbeck, F. W. and Trierweiler, L. I. 2003. Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple indicator CT-C(M - 1) model. Psychological Methods, 8: 38-60.
13. Eid, M., Nussbeck, F. W., Geiser, C., Cole, D. A., Gollwitzer, M. and Lischetzke, T. 2008. Structural equation modeling of multitrait-multimethod data: Different models for different types of methods. Psychological Methods, 13: 230-253.
14. Fiske, D. W. and Campbell, D. T. 1992. Citations do not solve problems. Psychological Bulletin, 112: 393-395.
15. Gaudron, J.-P. and Vautier, S. 2007. Analyzing individual differences in vocational, leisure, and family interests: A multitrait-multimethod approach. Journal of Vocational Behavior, 70: 561-573.
16. Geiser, C., Eid, M. and Nussbeck, F. W. 2008. On the meaning of the latent variables in the CT-C(M - 1) model: A comment on Maydeu-Olivares and Coffman 2006. Psychological Methods, 13: 49-57.
17. Grigorenko, E. L., Geiser, C., Slobodskaya, H. R. and Francis, D. J. 2010. Cross-informant symptoms from CBCL, TRF, and YSR: Trait and method variance in a normative sample of Russian youths. Psychological Assessment, 22: 893-911.
18. Holland, P. W. 1986. Statistics and causal inference (with discussion). Journal of the American Statistical Association, 81: 945-960.
19. Jöreskog, K. G. 1971. Statistical analysis of sets of congeneric tests. Psychometrika, 36: 109-133.
20. Kenny, D. A. 1976. An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix. Journal of Experimental Social Psychology, 12: 247-252.
21. Kollmann, D. M., Brown, T. A. and Barlow, D. H. 2009. The construct validity of acceptance: A multitrait-multimethod investigation. Behavior Therapy, 40: 205-218.
22. Lischetzke, T., Eid, M. and Nussbeck, F. W. Unterschiedliche Definitionen von Methodeneffekten in MTMM Modellen und ihre Implikationen für die Analyse der Validität [Different definitions of method effects in MTMM models and their implications for validity analysis]. Paper presented at the 43rd meeting of the German Psychological Association. Berlin, Germany. September.
23. Marsh, H. W. and Bailey, M. 1991. Confirmatory factor analysis of multitrait-multimethod data: A comparison of alternative models. Applied Psychological Measurement, 15: 47-70.
24. Marsh, H. W. and Hocevar, D. 1988. A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. Journal of Applied Psychology, 73: 107-117.
25. McArdle, J. J. and Hamagami, F. 2001. "Latent difference score structural models for linear dynamic analysis with incomplete longitudinal data.". In New methods for the analysis of change, Edited by: Collins, L. M. and Sayer, A. G. 137-175. Washington, DC: American Psychological Association.
26. Millsap, R. E. 1995. "The statistical analysis of method effects in multitrait-multimethod data: A review.". In Personality research, methods, and theory: A festschrift honoring Donald W. Fiske., Edited by: Shrout, P. E. and Fiske, S. T. 93-109. Mahwah, NJ: Erlbaum.
27. Mitte, K. and Kämpfe, N. 2008. Personality and the four faces of positive affect: A multitrait-multimethod analysis using self- and peer-report. Journal of Research in Personality, 42: 1370-1375.
28. Muthén, L. K. and Muthén, B. O. 1998-2007. Mplus user's guide, 5th ed. Los Angeles, CA: Muthén & Muthén.
29. Novick, M. R. 1966. The axioms and principal results of classical test theory. Journal of Mathematical Psychology, 3: 1-18.
30. Nussbeck, F. W., Eid, M., Geiser, C., Courvoisier, D. S. and Lischetzke, T. 2009. A CTC(M - 1) model for different types of raters. Methodology, 5: 88-98.
31. Ozer, D. J. 1989. "Construct validity in personality assessment.". In Personality psychology: Recent trends and emerging directions, Edited by: Buss, D. M. and Cantor, N. 224-234. New York, NY: Springer.
32. Pohl, S. and Steyer, R. 2010. Modeling common traits and method effects in multitrait-multimethod analysis. Multivariate Behavioral Research, 45: 45-72.
33. Pohl, S., Steyer, R. and Kraus, K. 2008. Modelling method effects as individual causal effects. Journal of the Royal Statistical Society Series A, 171: 41-63.
34. Sechrest, L., Davis, M. F., Stickle, T. R. and McKnight, P. E. 2000. "Understanding "method" variance.". In Research design: Donald Campbell's legacy, Edited by: Bickman, L. 63-87. Thousand Oaks, CA: Sage.
35. Steyer, R. 1988. Conditional expectations: An introduction to the concept and its applications in empirical sciences. Methodika, 2: 53-78.
36. Steyer, R. 1989. Models of classical psychometric test theory as stochastic measurement models: Representation, uniqueness, meaningfulness, identifiability, and testability. Methodika, 3: 25-60.
37. Steyer, R. 2001. "Classical test theory.". In International encyclopedia of the social and behavioural sciences: Logic and inquiry and research design, Edited by: Ragin, C. and Cook, T. 1955-1962. Oxford, UK: Pergamon.
38. Steyer, R., Eid, M. and Schwenkmezger, P. 1997. Modeling true intraindividual change: True change as a latent variable. Methods of Psychological Research-Online, 2: 21-33.
39. Trierweiler, L. I., Eid, M. and Lischetzke, T. 2002. The structure of emotional expressivity: Each emotion counts. Journal of Personality and Social Psychology, 82: 1023-1040.
40. Vautier, S. and Pohl, S. 2009. Bipolarity of latent change in STAI Scores. Psychological Assessment, 21: 187-193.
41. Widaman, K.-F. 1985. Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9: 1-26.
42. Wothke, W. 1995. "Covariance components analysis of the multitrait-multimethod matrix.". In Personality research, methods, and theory: A festschrift honoring Donald W. Fiske, Edited by: Shrout, P. E. 125-144. Mahwah, NJ: Erlbaum.
43. Zimmerman, D. W. 1975. Probability spaces, Hilbert spaces, and the axioms of test theory. Psychometrika, 40: 395-412.