The Insidious Effects of Failing to Include Design-Driven Correlated Residuals in Latent-Variable Covariance Structure Analysis

Psychological Methods

Volumn 12, Issue 4, 2007, Pages 381-398

  Cole, David A ^a   Ciesla, Jeffrey A ^a   Steiger, James H ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

correlated residuals; model modification; multitrait multimethod (MTMM); shared method variance; structural equation modeling

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; PSYCHOLOGICAL MODEL; STATISTICAL ANALYSIS;

DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, PSYCHOLOGICAL; RESEARCH DESIGN;

EID: 38349113991     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.12.4.381     Document Type: Article

References (34)

1. Bollen K.A. Structural equations with latent variables (1989), Wiley, New York
2. Campbell D.T., and Fiske D.W. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 56 (1959) 81-105
3. Campbell D.T., and O'Connell E.J. Methods as diluting trait relationships rather than adding irrelevant systematic variance. In: Brinberg D., and Kidder L. (Eds). Forms of validity in research (1982), Jossey-Bass, San Francisco 93-111
4. Cliff N. Some cautions concerning the application of causal modeling methods. Multivariate Behavioral Research 18 (1983) 115-126
5. Cole D.A., Martin J.M., Peeke L.A., Henderson A., and Harwell J. Validation of depression and anxiety measures in White and Black youths: A multitrait-multimethod longitudinal analysis. Psychological Assessment 10 (1998) 261-276
6. Cook T. Postpositivist critical multiplism. In: Shotland R.L., and Marks M.M. (Eds). Social science and social policy (1985), Sage, Beverly Hills, CA 21-62
7. Eid M. A multitrait-multimethod model with minimal assumptions. Psychometrika 65 (2000) 241-261
8. Eid M., and Diener E. Introduction: The need for multimethod measurement in psychology. In: Eid M., and Diener E. (Eds). Handbook of multimethod measurement in psychology (2006), American Psychological Association, Washington, DC 3-9
9. Eid M., Lischetzke T., and Nussbeck F.W. Structural equation models for multitrait-multimethod data. In: Eid M., and Diener E. (Eds). Handbook of multimethod measurement in psychology (2006), American Psychological Association, Washington, DC 283-299
10. Eid, M., Nussbeck, F. W., Geiser, C., Cole, D. A., Gollwitzer, M., & Lischetzke, T. (2007). Structural equation modeling of multitrait-multimethod data: Some guidelines for selecting an appropriate model. Unpublished manuscript.
11. Gerbing D.W., and Anderson J.C. On the meaning of within-factor correlated measurement errors. Journal of Consumer Research 11 (1984) 572-580
12. Hershberger S.L. The specification of equivalent models before the collection of data. In: von Eye A., and Clogg C.C. (Eds). Latent variables analysis: Applications for developmental research (1994), Sage, Thousand Oaks, CA 68-105
13. Hoyt W.T., and Kerns M. Magnitude and moderators of bias in observer ratings: A meta-analysis. Psychological Methods 4 (1999) 403-424
14. Jöreskog K.G. Analyzing psychological data by structural analysis of covariance matrices. In: Krantz D.H., Atkinson R.C., Luce R.D., and Suppes P. (Eds). Contemporary developments in mathematical psychology: Vol. 2. Measurement, psychophysics, and neural information processing (1974), Freeman, San Francisco 1-56
15. Kenny D.A. An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix. Journal of Experimental Social Psychology 12 (1976) 247-252
16. Kenny D.A., and Kashy D.A. Analysis of the multitrait-multimethod matrix by confirmatory factor analysis. Psychological Bulletin 112 (1992) 165-172
17. Kenny D.A., Kashy D.A., and Bolger N. Data analysis in social psychology. In: Gilbert D.T., and Fiske S.T. (Eds). The handbook of social psychology. 4th ed. 1 (1998), McGraw-Hill, New York 233-265
18. Lance C.E., Noble C.L., and Scullen S.E. A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychological Methods 7 (2002) 228-244
19. MacCallum R.C. Specification searches in covariance structure modeling. Psychological Bulletin 100 (1986) 107-120
20. Marsh H.W. Confirmatory factor analysis of multitrait-multimethod data: Many problems and few solutions. Applied Psychological Measurement 13 (1989) 335-361
21. Marsh H.W., and Grayson D. Latent variable models of multitrait-multimethod data. In: Hoyle R.H. (Ed). Structural equation modeling: Concepts, issues, and applications (1995), Sage, Thousand Oaks, CA 177-198
22. Marsh H.W., and Hau K.T. Assessing goodness of fit: Is parsimony always desirable?. Journal of Experimental Education 64 (1996) 364-390
23. McDonald R.P. Test theory: A unified treatment (1999), Erlbaum, Mahwah, NJ
24. Millsap R.E. The statistical analysis of method effects in multitrait-multimethod data: A review. In: Shrout P.E., and Fiske S.T. (Eds). Personality research, methods, and theory: A festschrift honoring Donald W. Fiske (1995), Erlbaum, Hillsdale, NJ 99-109
25. Pohl, S., Steyer, R., & Kraus, K. (2007). Modeling method effects as individual causal effects. Unpublished manuscript.
26. Reichardt C.S. The principle of parallelism in the design of studies to estimate treatment effects. Psychological Methods 11 (2006) 1-18
27. Schumacker R.E. Conducting specification searches with Amos. Structural Equation Modeling 13 (2006) 118-129
28. Silvia E.S., and MacCallum R.C. Some factors affecting the success of specification searches in covariance structure modeling. Multivariate Behavioral Research 23 (1988) 297-326
29. Spearman C. "General intelligence," objectively determined and measured. American Journal of Psychology 15 (1904) 201-293
30. Steiger J.H. Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research 25 (1990) 173-180
31. Steiger J.H. When constraints interact: A caution about reference variables, identification constraints, and scale dependencies in structural equation modeling. Psychological Methods 7 (2002) 210-227
32. Tomarken A.J., and Waller N.G. Potential problems with "well fitting" models. Journal of Abnormal Psychology 112 (2003) 578-598
33. Tram J., and Cole D.A. A multimethod examination of the stability of depressive symptoms in childhood and adolescence. Journal of Abnormal Psychology 115 (2006) 674-686
34. Widaman K.F. Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement 9 (1985) 1-26