What's hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis

Frontiers in Psychology

Volumn 5, Issue JUN, 2014, Pages

  De Roover, Kim ^a   Timmerman, Marieke E ^b   De Leersnyder, Jozefien ^a   Mesquita, Batja ^a   Ceulemans, Eva ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Configural invariance; Measurement bias; Metric invariance; Weak invariance

Indexed keywords

EID: 84904544801     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2014.00604     Document Type: Article

References (53)

1. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychol. Bull. 107, 238-246. doi: 10.1037/0033-2909.107.2.238
2. Brannick, M. T. (1995). Critical comments on applying covariance structure modelling. J. Organ. Behav. 16, 201-213. doi: 10.1002/job.4030160303
3. Brislin, R. W. (1980). "Translation and content analysis of oral and written materials," in Handbook of Cross-Cultural Psychology: Vol. 2. Methodology, eds H. C. Triandis and J. W. Berry (Boston, MA: Allyn and Bacon), 137-164.
4. Byrne, B. M., Shavelson, R. J., and Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychol. Bull. 105, 456-466. doi: 10.1037/0033-2909.105.3.456
5. Byrne, B. M., and van de Vijver, F. J. R. (2010). Testing for measurement and structural equivalence in large-scale cross-cultural studies: addressing the issue of nonequivalence. Int. J. Testing 10, 107-132. doi: 10.1080/15305051003637306
6. Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behav. Res. 1, 245-276. doi: 10.1207/s15327906mbr0102_10
7. Ceulemans, E., Hubert, M., and Rousseeuw, P. (2013). Robust multilevel simultaneous component analysis. Chemometr. Intell. Lab. Syst. 129, 33-39. doi: 10.1016/j.chemolab.2013.06.016
8. Ceulemans, E., and Kiers, H. A. L. (2006). Selecting among three-mode principal component models of different types and complexities: a numerical convex hull based method. Br. J. Math. Stat. Psychol. 59, 133-150. doi: 10.1348/000711005X64817
9. Ceulemans, E., and Kiers, H. A. L. (2009). Discriminating between strong and weak structures in three-mode principal component analysis. Br. J. Math. Stat. Psychol. 62, 601-620. doi: 10.1348/000711008X369474
10. Cheung, G. W., and Rensvold, R. B. (1999). Testing factorial invariance across groups: a reconceptualization and proposed new method. J. Manage. 25, 1-27. doi: 10.1177/014920639902500101
11. Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Model. 9, 233-255. doi: 10.1207/S15328007SEM0902_5
12. Dag, I. (1991). Rotter'in iç-diÕ kontrol oda.i ölçe.inin üniversite ö.rencileri için güvenirli.i ve geçerli.i [The reliability and validity of Rotter's Internal-External Locus of Control Scale for university students]. Turk. Psychol. Assoc. J. 7, 10-16.
13. De Leersnyder, J., Mesquita, B., and Kim, H. S. (2011). Where do my emotions belong? A study of immigrants' emotional acculturation. Pers. Soc. Psychol. Bull. 37, 451-463. doi: 10.1177/0146167211399103
14. De Roover, K., Ceulemans, E., Timmerman, M. E., Nezlek, J. B., and Onghena, P. (2013a). Modeling differences in the dimensionality of multiblock data by means of clusterwise simultaneous component analysis. Psychometrika 78, 648-668. doi: 10.1007/s11336-013-9318-4
15. De Roover, K., Ceulemans, E., Timmerman, M. E., and Onghena, P. (2013b). A clusterwise simultaneous component method for capturing within-cluster differences in component variances and correlations. Br. J. Math. Stat Psychol. 86, 81-102. doi: 10.1111/j.2044-8317.2012.02040.x
16. De Roover, K., Ceulemans, E., Timmerman, M. E., Vansteelandt, K., Stouten, J., and Onghena, P. (2012). Clusterwise simultaneous component analysis for analyzing structural differences in multivariate multiblock data. Psychol. Methods 17, 100-119. doi: 10.1037/a0025385
17. Ergüder, Ü., Esmer, Y., and Kalaycioglu, E. (1991). Türk Toplumunun Degáerleri [Values in Turkish culture]. Istanbul: Tüsiad Yayinlari, Tüsiad, publication number T/91, 6.145.
18. Gorsuch, R. (1983). Factor Analysis, 2nd Edn. Hillsdale, NJ: L. Erlbaum Associates.
19. Gorsuch, R. L. (1990). Common factor analysis versus component analysis: some well and little known facts. Multivariate Behav. Res. 25, 33-39. doi: 10.1207/s15327906mbr2501_3
20. Green, B. F. (1976). On the factor score controversy. Psychometrika 41, 263-266. doi: 10.1007/BF02291843
21. Grice, J. W. (2001). Computing and evaluating factor scores. Psychol. Methods 6, 430-450. doi: 10.1037/1082-989X.6.4.430
22. Hu, L., and Bentler, P. M. (1999). Cutoffcriteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. 6, 1-55. doi: 10.1080/10705519909540118
23. Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika 36, 409-426. doi: 10.1007/BF02291366
24. Jöreskog, K. G., and Sörbom, D. (1996). LISREL 8: User's Reference Guide, 2nd Edn. Chicago, IL: Scientific Software International.
25. Kelloway, E. K. (1995). Structural equation modelling in perspective. J. Organ. Behav. 16, 215-224. doi: 10.1002/job.4030160304
26. Kiers, H. A. L., and ten Berge, J. M. F. (1994). Hierarchical relations between methods for simultaneous components analysis and a technique for rotation to a simple simultaneous structure. Br. J. Math. Stat. Psychol. 47, 109-126. doi: 10.1111/j.2044-8317.1994.tb01027.x
27. Kitayama, S., Mesquita, B., and Karasawa, M. (2006). The emotional basis of independent and interdependent selves: socially disengaging and engaging emotions in the US and Japan. J. Pers. Soc. Psychol. 91, 890-903. doi: 10.1037/0022-3514.91.5.890
28. Krysinska, K., De Roover, K., Bouwens, J., Ceulemans, E., Corveleyn, J., Dezutter, J., et al. (in press). Measuring religious attitudes in (post-)secularised Western European context: recent changes in the underlying dimensions of the Post-Critical Belief Scale. Int. J. Psychol. Relig. doi: 10.1080/10508619.2013.879429
29. Kuppens, P., Ceulemans, E., Timmerman, M. E., Diener, E., and Kim-Prieto, C. H. U. (2006). Universal intracultural and intercultural dimensions of the recalled frequency of emotional experience. J. Cross Cult. Psychol. 37, 491-515. doi: 10.1177/0022022106290474
30. Lawley, D. N., and Maxwell, A. E. (1962). Factor analysis as a statistical method. Statistician 12, 209-229. doi: 10.2307/2986915
31. Lester, D., Castromayor, I. J., and Içli, T. (1991). Locus of control, depression, and suicidal ideation among American, Philippine, and Turkish students. J. Soc. Psychol. 13, 447-449. doi: 10.1080/00224545.1991.9713873
32. Lorenzo-Seva, U., and ten Berge, J. M. F. (2006). Tucker's congruence coefficient as a meaningful index of factor similarity. Methodology 2, 57-64. doi: 10.1027/1614-2241.2.2.57
33. MacCallum, R. C. (1986). Specification searches in covariance structure modeling. Psychol. Bull. 100, 107-120. doi: 10.1037/0033-2909.100.1.107
34. MacCallum, R. C., Roznowski, M., and Necowitz, L. B. (1992). Model modifications in covariance structure analysis: the problem of capitalization on chance. Psychol. Bull. 111, 490-504. doi: 10.1037/0033-2909.111.3.490
35. Markus, H. R., and Kitayama, S. (1991). Culture and the self: Implications for cognition, emotion, and motivation. Psychol. Rev. 98, 224-253. doi: 10.1037/0033-295X.98.2.224
36. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika 58, 525-543. doi: 10.1007/BF02294825
37. Meredith, W., and Teresi, J. A. (2006). An essay on measurement and factorial invariance. Med. Care, 44, S69-S77. doi: 10.1097/01.mlr.0000245438.73837.89
38. Mesquita, B. (2001). Emotions in collectivist and individualist contexts. J. Pers. Soc. Psychol. 80, 68-74. doi: 10.1037/0022-3514.80.1.68
39. Muthén, B., and Asparouhov, T. (2012). Bayesian structural equation modeling: a more flexible representation of substantive theory. Psychol. Methods 17, 313-335. doi: 10.1037/a0026802
40. Muthén, B., and Asparouhov, T. (2013). BSEM Measurement Invariance Analysis (MplusWeb Notes No.17). Available online at: https://www.statmodel.com/examples/webnotes/webnote17.pdf (Accessed March 24, 2014).
41. Roseman, I. J. (2013). Appraisal in the emotion system: coherence in strategies for coping. Emot. Rev. 5, 141-149. doi: 10.1177/1754073912469591
42. Rosseel, Y. (2012). Lavaan: an R package for structural equation modeling. J. Stat. Softw., 48, 1-36.
43. Silvia, E. S. M., and MacCallum, R. C. (1988). Some factors affecting the success of specification searches in covariance structure modeling. Multivariate Behav. Res. 23, 297-326. doi: 10.1207/s15327906mbr2303_2
44. Sörbom, D. (1974). A general method for studying differences in factor means and factor structure between groups. Br. J. Math. Stat. Psychol. 27, 229-239. doi: 10.1111/j.2044-8317.1974.tb00543.x
45. Steiger, J. H. (1989). EzPATH: A Supplementary Module for SYSTAT and SYGRAPH. Evanston, IL: SYSTAT.
46. Stuive, I., Kiers, H. A. L., and Timmerman, M. E. (2009). Comparison of methods for adjusting incorrect assignments of items to subtests: oblique multiple group method versus confirmatory common factor method. Educ. Psychol. Measur. 69, 948-965. doi: 10.1177/0013164409332226
47. Tabachnick, B. G., and Fidell, L. S. (2005). Using Multivariate Statistics, 5th Edn. Boston, MA: Pearson.
48. Timmerman, M. E., and Kiers, H. A. L. (2003). Four simultaneous component models of multivariate time series from more than one subject to model intraindividual and interindividual differences. Psychometrika 86, 105-122. doi: 10.1007/BF02296656
49. Tucker, L., R. (1951). A Method for Synthesis of Factor Analysis Studies (Personnel Research Section Rep. No. 984). Washington, DC: Department of the Army.
50. Van Acker, K. (2012). Flanders' Real and Present Threat: How Representations of Intergroup Relations Shape Attitudes Towards Muslim Minorities. Doctoral dissertation, University of Leuven, Belgium. ISBN: 978-94-6190-938-1
51. Velicer, W. F., and Jackson, D. N. (1990). Component analysis versus common factor analysis: some issues in selecting an appropriate procedure. Multivariate Behav. Res. 25, 1-28. doi: 10.1207/s15327906mbr2501_1
52. Wilderjans, T. F., Ceulemans, E., and Meers, K. (2013). CHull: a generic convex hull based model selection method. Behav. Res. Methods 45, 1-15. doi: 10.3758/s13428-012-0238-5
53. Williams, R., and Thomson, E. (1986). Normalization issues in latent variable modeling. Sociol. Methods Res. 15, 24-43. doi: 10.1177/0049124186015001002