The Thorny Relation Between Measurement Quality and Fit Index Cutoffs in Latent Variable Models

Journal of Personality Assessment

Volumn 100, Issue 1, 2018, Pages 43-52

  McNeish, Daniel ^a   An, Ji ^a   Hancock, Gregory R ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EXPOSURE; HUMAN; QUANTITATIVE STUDY; SCIENTIST; SIMULATION; STATISTICAL MODEL; THEORETICAL MODEL; THINKING; BEHAVIORAL RESEARCH; FACTOR ANALYSIS; PSYCHOLOGICAL MODEL; STANDARDS;

BEHAVIORAL RESEARCH; FACTOR ANALYSIS, STATISTICAL; HUMANS; MODELS, PSYCHOLOGICAL; MODELS, THEORETICAL;

EID: 85014574396     PISSN: 00223891     EISSN: None     Source Type: Journal    
DOI: 10.1080/00223891.2017.1281286     Document Type: Article

References (43)

1. Allan, N. P., Lonigan, C. J., & Phillips, B. M., (2015). Examining the factor structure and structural invariance of the PANAS across children, adolescents, and young adults. Journal of Personality Assessment, 97, 616–625.
2. Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R., (2010). On making causal claims: A review and recommendations. The Leadership Quarterly, 21, 1086–1120.
3. Bardeen, J. R., Fergus, T. A., Hannan, S. M., & Orcutt, H. K., (2016). Addressing psychometric limitations of the Difficulties in Emotion Regulation Scale through item modification. Journal of Personality Assessment, 98, 298–309.
4. Barrett, P., (2007). Structural equation modelling: Adjudging model fit. Personality and Individual Differences, 42, 815–824.
5. Beauducel, A., & Wittmann, W. W., (2005). Simulation study on fit indexes in CFA based on data with slightly distorted simple structure. Structural Equation Modeling, 12, 41–75.
6. Bentler, P. M., (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.
7. Bentler, P. M., (2007). On tests and indices for evaluating structural models. Personality and Individual Differences, 42, 825–829.
8. Browne, M. W., MacCallum, R. C., Kim, C. T., Andersen, B. L., & Glaser, R., (2002). When fit indices and residuals are incompatible. Psychological Methods, 7, 403–421.
9. Chen, F., Curran, P. J., Bollen, K. A., Kirby, J., & Paxton, P., (2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods & Research, 36, 462–494.
10. Cheung, G. W., & Rensvold, R. B., (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255.
11. Cole, D. A., & Preacher, K. J., (2014). Manifest variable path analysis: Potentially serious and misleading consequences due to uncorrected measurement error. Psychological Methods, 19, 300–315.
12. Credé, M., & Harms, P. D., (2015). 25 years of higher‐order confirmatory factor analysis in the organizational sciences: A critical review and development of reporting recommendations. Journal of Organizational Behavior, 36, 845–872.
13. Demianczyk, A. C., Jenkins, A. L., Henson, J. M., & Conner, B. T., (2014). Psychometric evaluation and revision of Carver and White's BIS/BAS scales in a diverse sample of young adults. Journal of Personality Assessment, 96, 485–494.
14. Fan, X., & Sivo, S. A., (2005). Sensitivity of fit indexes to misspecified structural or measurement model components: Rationale of two-index strategy revisited. Structural Equation Modeling, 12, 343–367.
15. Fan, X., & Sivo, S. A., (2007). Sensitivity of fit indices to model misspecification and model types. Multivariate Behavioral Research, 42, 509–529.
16. Fergus, T. A., Valentiner, D. P., McGrath, P. B., Gier-Lonsway, S. L., & Kim, H. S., (2012). Short forms of the Social Interaction Anxiety Scale and the Social Phobia Scale. Journal of Personality Assessment, 94, 310–320.
17. Hancock, G. R., & Mueller, R. O., (2001). Rethinking construct reliability within latent variable systems. In R., Cudeck, S., du Toit, & D., Sörbom (Eds.), Structural equation modeling: Present and future—A festschrift in honor of Karl Jöreskog (pp. 195–216). Lincolnwood, IL: Scientific Software International.
18. Hancock, G. R., & Mueller, R. O., (2011). The reliability paradox in assessing structural relations within covariance structure models. Educational & Psychological Measurement, 71, 306–324.
19. Hayduk, L. A., (2014). Shame for disrespecting evidence: The personal consequences of insufficient respect for structural equation model testing. BMC Medical Research Methodology, 14, 124.
20. Hayduk, L., Cummings, G., Boadu, K., Pazderka-Robinson, H., & Boulianne, S., (2007). Testing! Testing! One, two, three—Testing the theory in structural equation models! Personality and Individual Differences, 42, 841–850.
21. Hayduk, L. A., & Glaser, D. N., (2000). Jiving the four-step, waltzing around factor analysis, and other serious fun. Structural Equation Modeling, 7, 1–35.
22. Heene, M., Hilbert, S., Draxler, C., Ziegler, M., & Bühner, M., (2011). Masking misfit in confirmatory factor analysis by increasing unique variances: A cautionary note on the usefulness of cutoff values of fit indices. Psychological Methods, 16, 319–336.
23. Hu, L., & Bentler, P. M., (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.
24. Ion, A., Iliescu, D., Aldhafri, S., Rana, N., Ratanadilok, K., Widyanti, A., & Nedelcea, C., (2017). A cross-cultural analysis of personality structure through the lens of the Hexaco model. Journal of Personality Assessment, 99, 25–34.
25. Jackson, D. L., Gillaspy, J. A., Jr., & Purc-Stephenson, R., (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14, 6–23.
26. Jöreskog, K. G., & Sörbom, D., (1981). LISREL V: Analysis of linear structural relationships by maximum likelihood and least squares methods. Uppsala, Sweden: Department of Statistics, University of Uppsala.
27. Joshanloo, M., (2016). Factor structure of subjective well-being in Iran. Journal of Personality Assessment, 98, 435–443.
28. Kang, Y., McNeish, D. M., & Hancock, G. R., (2016). The role of measurement quality on practical guidelines for assessing measurement and structural invariance. Educational and Psychological Measurement, 76, 533–561.
29. Marsh, H. W., Hau, K. T., & Wen, Z., (2004). In search of golden rules: Comment on hypothesis testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling, 11, 320–341.
30. McDonald, R. P., (1970). The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23, 1–21.
31. McIntosh, C., (2007). Rethinking fit assessment in structural equation modelling: A commentary and elaboration on Barrett (2007). Personality and Individual Differences, 42, 859–867.
32. Michel, J. S., Pace, V. L., Edun, A., Sawhney, E., & Thomas, J., (2014). Development and validation of an explicit aggressive beliefs and attitudes scale. Journal of Personality Assessment, 96, 327–338.
33. Miles, J., & Shevlin, M., (2007). A time and a place for incremental fit indices. Personality and Individual Differences, 42, 869–874.
34. Mulaik, S., (2007). There is a place for approximate fit in structural equation modelling. Personality and Individual Differences, 42, 883–891.
35. Rice, K. G., Richardson, C. M., & Tueller, S., (2014). The short form of the revised Almost Perfect Scale. Journal of Personality Assessment, 96, 368–379.
36. Saris, W. E., & Satorra, A., (1992). Power evaluations in structural equation models. In K. A., Bollen and S., Long (Eds.), Testing in structural equation models (pp. 181–204). London, UK: Sage.
37. Saris, W. E., Satorra, A., & van der Veld, W. M., (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling, 16, 561–582.
38. Savalei, V., (2012). The relationship between root mean square error of approximation and model misspecification in confirmatory factor analysis models. Educational and Psychological Measurement, 72, 910–932.
39. Steiger, J. H., (2000). Point estimation, hypothesis testing, and interval estimation using the RMSEA: Some comments and a reply to Hayduk and Glaser. Structural Equation Modeling, 7, 149–162.
40. Steiger, J. H., (2007). Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Differences, 42, 893–898.
41. Steiger, J. H., & Lind, J. C., (1980, May). Statistically-based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.
42. Tomarken, A. J., & Waller, N. G., (2003). Potential problems with “well fitting” models. Journal of Abnormal Psychology, 112, 578–598.
43. You, J., Leung, F., Lai, K. K. Y., & Fu, K., (2013). Factor structure and psychometric properties of the Pathological Narcissism Inventory among Chinese university students. Journal of Personality Assessment, 95, 309–318.