Collapsing factors in multitrait-multimethod models: examining consequences of a mismatch between measurement design and model

Frontiers in Psychology

Volumn 6, Issue , 2015, Pages

  Finch, Holmes ^a   Bishop, Jacob ^a   Lockhart, Ginger ^a  

^a Brigham Young University   (United States)

Author keywords

bifactor models; confirmatory factor models; estimation problems; interchangeable versus structurally different methods; latent state trait models; method factors; multitrait multimethod (MTMM) analysis; negative variances

Indexed keywords

EID: 84981352601     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2015.00946     Document Type: Article

References (32)

1. Campbell D. T. Fiske D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol. Bull. 56, 81–105. 13634291
2. Castro-Schilo L. Widaman K. F. Grimm K. J. (2013). Neglect the structure of multitrait-multimethod data at your peril: implications for associations with external variables. Struct. Equat. Model. 20, 181–207. 10.1080/10705511.2013.769385
3. Chen F. F. Hayes A. Carver C. S. Laurenceau J.-P. Zhang Z. (2012). Modeling general and specific variance in multifaceted constructs: a comparison of the bifactor model to other approaches. J. Pers. 80, 219–251. 10.1111/j.1467-6494.2011.00739.x22092195
4. Chen F. F. West S. G. Sousa K. H. (2006). A comparison of bifactor and second-order models of quality of life. Multivariate Behav. Res. 41, 189–225. 10.1207/s15327906mbr4102_5
5. Dumenci L. (2000). Multitrait-multimethod analysis, in Handbook of Applied Multivariate Statistics and Mathematical Modeling, eds Tinsley H. E. A. Brown S. D. (San Diego, CA: Academic Press), 583–611.
6. Eid M. (2000). A multitrait-multimethod model with minimal assumptions. Psychometrika 65, 241–261. 10.1007/BF02294377
7. Eid M. Lischetzke T. Nussbeck F. W. (2006). Structural equation models for multitrait-multimethod data, in Handbook of Multimethod Measurement in Psychology, eds Eid M. Diener E. (Washington, DC: American Psychological Association), 283–299.
8. Eid M. Lischetzke T. Nussbeck F. W. Trierweiler L. I. (2003). Separating trait effects from trait-specific method effects in multitrait-multimethod models: a multiple-indicator CT-C (M-1) model. Psychol. Methods 8, 38–60. 10.1037/1082-989X.8.1.3812741672
9. Eid M. Nussbeck F. W. Geiser C. Cole D. A. Gollwitzer M. Lischetzke T. (2008). Structural equation modeling of multitrait-multimethod data: different models for different types of methods. Psychol. Methods 13, 230–253. 10.1037/a001321918778153
10. Geiser C. Burns L. G. Servera M. (2014a). Testing for measurement invariance and latent mean differences across methods: interesting incremental information from multitrait-multimethod studies. Front. Psychol. 5:1216. 10.3389/fpsyg.2014.0121625400603
11. Geiser C. Eid M. Nussbeck F. W. (2008). On the meaning of the latent variables in the CT-C (M - 1) model: a comment on Maydeu-Olivares and Coffman (2006). Psychol. Methods 13:49. 10.1037/1082-989X.13.1.4918331153
12. Geiser C. Keller B. T. Lockhart G. Eid M. Cole D. A. Koch T. (2015). Distinguishing state variability from trait change in longitudinal data: The role of measurement (non)invariance in latent state-trait analyses. Behav. Res. Methods 47, 172–203. 10.3758/s13428-014-0457-z24652650
13. Geiser C. Koch T. Eid M. (2014b). Data-generating mechanisms versus constructively-defined latent variables in multitrait-multimethod analyses: a comment on castro-schilo, widaman, & grimm (2013). Struct. Equat. Model. 21, 509–523. 10.1080/10705511.2014.91981625419098
14. Holzinger K. J. Swineford F. (1937). The bi-factor method. Psychometrika 2, 41–54.
15. Hu L. Bentler P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equat. Model. 6, 1–55.
16. Kenny D. A. Kashy D. A. (1992). Analysis of the multitrait-multimethod matrix by confirmatory factor analysis. Psychol. Bull. 112, 165–172.
17. Koch T. Schultze M. Eid M. Geiser C. (2014). A longitudinal multilevel CFA-MTMM model for interchangeable and structurally different methods. Front. Psychol. 5:311. 10.3389/fpsyg.2014.0031124860515
18. Lance C. E. Noble C. L. Scullen S. E. (2002). A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychol. Methods 7, 228–244. 10.1037/1082-989X.7.2.22812090412
19. Marsh H. W. (1989). Confirmatory factor analyses of multitrait-multimethod data: many problems and a few solutions. Appl. Psychol. Meas. 13, 335–361.
20. Marsh H. W. Bailey M. (1991). Confirmatory factor analyses of multitrait-multimethod data: a comparison of alternative models. Appl. Psychol. Meas. 15, 47–70.
21. Marsh H. W. Grayson D. (1995). Latent variable models of multitrait-multimethod data, in Structural Equation Modeling: Concepts, Issues, and Applications, ed Hoyle R. H. (Thousand Oaks, CA: Sage), 177–198.
22. Marsh H. W. Hocevar D. (1988). A new, more powerful approach to multitrait-multimethod analyses: application of second-order confirmatory factor analysis. J. Appl. Psychol. 73, 107–117.
23. Maydeu-Olivares A. Coffman D. L. (2006). Random intercept item factor analysis. Psychol. Methods 11, 344–362. 10.1037/1082-989X.11.4.34417154751
24. Millsap R. (1995). The statistical analysis of method effects in multitrait-multimethod data: a review, in Personality Research, Methods, and Theory: A Festschrift Honoring Donald W. Fiske, eds Shrout P. E. Fiske S. T. (Hillsdale, NJ: Erlbaum), 93–109.
25. Muthén L. Muthén B. (1998–2012). Mplus User's Guide, 7th Edn. Los Angeles, CA: Muthén & Muthén.
26. Nussbeck F. W. Eid M. Geiser C. Courvoisier D. S. Lischetzke T. (2009). A CTC (M - 1) model for different types of raters. Methodology 5, 88–98. 10.1027/1614-2241.5.3.88
27. Reise S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behav. Res. 47, 667–696. 10.1080/00273171.2012.71555524049214
28. Schermelleh-Engel K. Keith N. Moosbrugger H. Hodapp V. (2004). Decomposing person and occasion-specific effects: an extension of latent state-trait (LST) theory to hierarchical LST models. Psychol. Methods 9, 198–219. 10.1037/1082-989X.9.2.19815137889
29. Schermelleh-Engel K. Moosbrugger H. Müller H. (2003). Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol. Res. 8, 23–74.
30. Schmiedek F. Li S. (2004). Toward an alternative representation for disentangling age-associated differences in general and specific cognitive abilities. Psychol. Aging 19, 40–56. 10.1037/0882-7974.19.1.4015065930
31. Steyer R. Ferring D. Schmitt M. (1992). States and traits in psychological assessment. Eur. J. Psychol. Assess. 8, 79–98.
32. Widaman K. F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Appl. Psychol. Meas. 9, 1–26.