Exploring sources of construct-relevant multidimensionality in psychiatric measurement: A tutorial and illustration using the Composite Scale of Morningness

International Journal of Methods in Psychiatric Research

Volumn 25, Issue 4, 2016, Pages 277-288

  Morin, Alexandre J S ^a   Arens, A Katrin ^b   Tran, Antoine ^c   Caci, Hervé ^c  

^a AUSTRALIAN CATHOLIC UNIVERSITY   (Australia)

^b GERMAN INSTITUTE FOR INTERNATIONAL EDUCATIONAL RESEARCH   (Germany)

^c UNIVERSITY HOSPITAL OF NICE   (France)

Author keywords

bifactor models; chronotype; Composite Scale of Morningness (CSM); diurnal preference; exploratory structural equation modelling (ESEM); multidimensionality

Indexed keywords

ADULT; CIRCADIAN RHYTHM; FEMALE; HUMAN; MALE; PHYSIOLOGY; PROCEDURES; PSYCHIATRY; PSYCHOMETRY; STATISTICAL MODEL;

ADULT; CIRCADIAN RHYTHM; FEMALE; HUMANS; MALE; MODELS, STATISTICAL; PSYCHIATRY; PSYCHOMETRICS;

EID: 84939546235     PISSN: 10498931     EISSN: 15570657     Source Type: Journal    
DOI: 10.1002/mpr.1485     Document Type: Article

References (44)

1. Asparouhov T., Muthén B. (2009) Exploratory structural equation modeling. Structural Equation Modeling, 16(3), 397–443, DOI: 10.1080/10705510903008204
2. Asparouhov T., Muthén B.O. (2006) Robust Chi-square Difference Testing with Mean and Variance Adjusted Test Statistics, Los Angeles, CA, Muthén and Muthén. http://www.statmodel.com/examples/webnote.shtml–web10
3. Beauducel A., Herzberg P.Y. (2006) On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling, 13(2), 186–203, DOI: 10.1207/s15328007sem1302_2
4. Browne M.W. (2001) An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36(1), 111–150, DOI: 10.1207/S15327906MBR3601_05
5. Caci H., Adan A., Bohlé P., Natale V., Pornpitakpan C., Tilley A. (2005) Transcultural properties of the Composite Scale of Morningness: the relevance of the ‘Morning Affect’ factor. Chronobiology International, 22(3), 523–540, DOI: 10.1081/CBI-200062401
6. Caci H., Deschaux O., Adan A., Natale V. (2009) Comparing three morningness scales: age and gender effects, structure and cut-off criteria. Sleep Medicine, 10(2), 240–245, DOI: 10.1016/j.sleep.2008.01.007
7. Caci H., Morin A.J.S., Tran A. (2014) Prevalence and correlates of attention deficit/hyperactivity disorder in adults from a French community sample. Journal of Nervous and Mental Disease, 202(4), 324–332, DOI: 10.1097/NMD.0000000000000126
8. Caci H., Morin A.J.S., Tran A. (in press) Teacher ratings of the ADHD-RS IV in a community sample: results from the ChiP-ARD study. Journal of Attention Disorders, DOI: 10.1177/1087054712473834
9. Chen F.F. (2007) Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504, DOI: 10.1080/10705510701301834
10. Chen F.F., West S.G., Sousa K.H. (2006) A comparison of bifactor and second-order models of quality of life. Multivariate Behavioral Research, 41(2), 189–225, DOI: 10.1207/s15327906mbr4102_5
11. Cheung G.W., Rensvold R.B. (2002) Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255, DOI: 10.1207/S15328007SEM0902_05
12. Clark S.L., Muthén B.O., Kaprio J., D'Onofrio B.M., Viken R., Rose R.J. (2013) Models and strategies for factor mixture analysis: an example concerning the structure of underlying psychological disorders. Structural Equation Modeling, 20(4), 681–703, DOI: 10.1080/10705511.2013.824786
13. Finney S.J., DiStefano C. (2006) Non-normal and categorical data in structural equation modeling. In Hancock G.R., Mueller R.O. (eds) Structural Equation Modeling: A Second Course, pp. 269–314, Greenwich, CT, IAP.
14. Gignac G.E., Watkins M.W. (2013) Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48(5), 639–662, DOI: 10.1080/00273171.2013.804398
15. Guay F., Morin A.J.S., Litalien D., Valois P., Vallerand R.J. (2015) An application of exploratory structural equation modeling to evaluate the Academic Motivation Scale. The Journal of Experimental Education, 83(1), 51–82, DOI: 10.1080/00220973.2013.876231
16. Hu L.T., Bentler P.M. (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55, DOI: 10.1080/10705519909540118
17. Jennrich R.I., Bentler P.M. (2011) Exploratory bi-factor analysis. Psychometrika, 76(4), 537–549, DOI: 10.1007/s11336-011-9218.4
18. Marsh H.W., Hau K.-T., Wen Z. (2004) In search of golden rules: comment on hypothesis-testing approaches to cutoff values for fit indexes and dangers in overgeneralizing Hu & Bentler's (1999). Structural Equation Modeling, 11(3), 320–341, DOI: 10.1207/s15328007sem1103_2
19. Marsh H.W., Lüdtke O., Nagengast B., Morin A.J.S., Von Davier M. (2013) Why item parcels are (almost) never appropriate: two wrongs do not make a right—camouflaging misspecification with item parcels in CFA models. Psychological Methods, 18(3), 257–284, DOI: 10.1037/a0032773
20. Marsh H.W., Morin A.J.S., Parker P., Kaur G. (2014) Exploratory structural equation modeling: an integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10, 85–110, DOI: 10.1146/annurev-clinpsy-032813-153700
21. Martel M.M., Roberts B., Gremillion M., von Eye A., Nigg J.T. (2011) External validation of the bifactor model of ADHD: explaining heterogeneity in psychiatric comorbidity, cognitive control, and personality trait profiles within DSM-IV ADHD. Journal of Abnormal Child Psychology, 39(8), 1111–1123, DOI: 10.1007/s10802-011-9538-y
22. Masyn K., Henderson C., Greenbaum P. (2010) Exploring the latent structures of psychological constructs in social development using the Dimensional-Categorical Spectrum. Social Development, 19(3), 470–493, DOI: 10.1111/j.1467-9507.2009.00573.x
23. McDonald R.P. (1970) The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. Bristish Journal of Mathematical and Statistical Psychology, 23(1), 1–21, DOI: 10.1111/j.2044-8317.1970.tb00432.x
24. Meredith W. (1993) Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525–543, DOI: 10.1007/BF02294825
25. Morin A.J.S., Arens A.K., Marsh H.W. (in press-a) A bifactor exploratory structural equation modeling framework for the identification of distinct sources of construct-relevant psychometric multidimensionality. Structural Equation Modeling., DOI: 10.1080/10705511.2014.961800
26. Morin A.J.S., Maïano C. (2011) Cross-validation of the short form of the physical self-inventory (PSI-S) using exploratory structural equation modeling (ESEM). Psychology of Sport & Exercise, 12(5), 540–554, DOI: 10.1016/j.psychsport.2011.04.003
27. Morin A.J.S., Marsh H.W. (2015) Disentangling shape from levels effects in person-centred analyses: an illustration based university teacher multidimensional profiles of effectiveness. Structural Equation Modeling, 22(1), 39–59, DOI: 10.1080/10705511.2014.919825
28. Morin A.J.S., Marsh H.W., Nagengast B. (2013) Exploratory structural equation modeling. In Hancock G.R., Mueller R.O. (eds) Structural Equation Modeling: A Second Course, pp. 395–436, Greewich, CT, IAP.
29. Morin A.J.S., Moullec G., Maïano C., Layet L., Just J.-L., Ninot G. (2011) Psychometric properties of the Center for Epidemiologic Studies Depression Scale (CES-D) in French clinical and non-clinical adults. Epidemiology and Public Health [Revue d'Épidémiologie et de Santé Publique], 59(5), 327–340, DOI: 10.1016/j.respe.2011.03.061
30. Morin A.J.S., Tran A., Caci H. (in press-b) Factorial validity of the ADHD adult symptom rating scale in a French community sample: results from the ChiP-ARD study. Journal of Attention Disorders, DOI: 10.1177/1087054713488825
31. Murray A.L., Johnson W. (2013) The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41(5), 407–422, DOI: 10.1016/j.intell.2013.06.004
32. Muthén B.O. (2004) Mplus Technical Appendices, Los Angeles, CA, Muthén and Muthén. http://www.statmodel.com/techappen.shtml
33. Muthén L.K., Muthén B.O. (2012) Mplus User's Guide. Seventh Edition, Los Angeles, CA, Muthén & Muthén.
34. Nunnally J.C., Bernstein I.H. (1994) Psychometric Theory, New York, McGraw-Hill.
35. Reininghaus U., Priebe S., Bentall R.P. (2013) Testing the psychopathology of psychosis: evidence for a general psychosis dimension. Schizophrenia Bulletin, 39(4), 884–895, DOI: 10.1093/schbul/sbr182
36. Reise S.P. (2012) Invited paper: the rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696, DOI: 10.1080/00273171.2012.715555
37. Reise S.P., Moore T.M., Maydeu-Olivares A. (2011) Target rotations and assessing the impact of model violations on the parameters of unidimensional item response theory models. Educational and Psychological Measurement, 71(4), 684–711, DOI: 10.1177/0013164410378690
38. Reise S.P., Morizot J., Hays R.D. (2007) The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research, 16(1), 19–31, DOI: 10.1007/s11136-007-9183-7
39. Rindskopf D., Rose T. (1988) Some theory and application of confirmatory second-order factor analyses. Multivariate Behavioral Research, 23(1), 51–67, DOI: 10.1207/s15327906mbr2301_3
40. Schmitt T.A., Sass D.A. (2011) Rotation criteria and hypothesis testing for exploratory factor analysis: implications for factor pattern loadings and interfactor correlations. Educational & Psychological Measurement, 71(1), 95–113, DOI: 10.1177/0013164410387348
41. Sijtsma K. (2009) On the use, misuse, and the very limited usefulness of Cronbach's alpha [Introduction to a special issue]. Psychometrika, 74(1), 107–120, DOI: 10.1007/s11336-008-9101-0
42. Simms L.J., Grös D.F., Watson D., O'Hara M. (2008) Parsing general and specific components of depression and anxiety with bifactor modeling. Depression and Anxiety, 25(7), E34–E46, DOI: 10.1002/da.20432
43. Yu C.Y. (2002) Evaluating Cutoff Criteria of Model Fit Indices for Latent Variable Models with Binary and Continuous Outcomes, Los Angeles, CA, University of California.
44. Yung Y.-F., Thissen D., McLeod L.D. (1999) On the relationship between the higher order factor model and the hierarchical factor model. Psychometrika, 64(2), 113–128, DOI: 10.1007/BF02294531