Analyzing observed composite differences across groups: Is partial measurement invariance enough?

Methodology

Volumn 9, Issue 1, 2013, Pages 1-12

  Steinmetz, Holger ^a  

^a JUSTUS LIEBIG UNIVERSITY   (Germany)

Author keywords

Composite scores; Differential item functioning; Group differences; Mean differences; Measurement invariance; Test bias

Indexed keywords

EID: 84874874489     PISSN: 16141881     EISSN: 16142241     Source Type: Journal    
DOI: 10.1027/1614-2241/a000049     Document Type: Article

References (56)

1. Bagozzi' R. P.' & Yi' Y. (1991). Multitrait-multimethod matrices in consumer research. Journal of Consumer Research' 17' 426-439.
2. Baumgartner' H.' & Steenkamp' J.-B. E. M. (1998). Multi-group latent variable models for varying numbers of items and factors with cross-national and longitudinal applications. Marketing Letters' 9' 21-35.
3. Bollen' K. A. (1989). Structural equations with latent variables. New York: Wiley.
4. Borsboom' D. (2006). The attack of the psychometricians. Psychometrika' 71' 425-440.
5. Borsboom' D.' & Mellenbergh' G. J. (2002). True scores' latent variables' and constructs: A comment on Schmidt and Hunter. Intelligence' 30' 505-514.
6. Brown' T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford.
7. Burke' M. J.' Brief' A. P.' & George' J. M. (1993). The role of negative affectivity in understanding relations between selfreports of stressors and strains: A comment on the applied psychology literature. Journal of Applied Psychology' 78' 402-412.
8. Byrne' B.' Shavelson' R. J.' & Muthén' B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin' 105' 456-466.
9. Cheung' G. W.' & Rensvold' R. B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equation modeling. Journal of Cross-Cultural Psychology' 31' 187-212.
10. Cole' N. S. (1981). Bias in testing. American Psychologist' 36' 1067-1077.
11. Coromina' L.' Saris' W. E.' & Oberski' D. (2009). The quality of the measurement of interest in the political issues. Paper presented at the QMSS2 meeting.
12. Crane' P. K.' van Belle' G.' & Larson' E. B. (2004). Test bias in a cognitive test: Differential item functioning in the CASI. Statistics in Medicine' 23' 241-256.
13. Davidov' E. (2008). A cross-country and cross-time comparison of the human values measurements with the second round of the European Social Survey. Survey Research Methods' 2' 33-46.
14. Davidov' E.' Schmidt' P.' & Schwartz' S. H. (2008). Bringing values back in: A multiple group comparison with 20 countries using the European Social Survey. Public Opinion Quarterly' 72' 420-445.
15. Edwards' J. R.' & Bagozzi' R. P. (2000). On the nature and direction of relationships between constructs and measures. Psychological Methods' 5' 155-174.
16. Eid' M. (2000). A multitrait-multimethod model with minimal assumptions. Psychometrika' 65' 241-261.
17. Flaugher' R. L. (1978). The many definitions of test bias. American Psychologist' 33' 671-679.
18. Gelfand' M. J.' Erez' M.' & Aycan' Z. (2007). Cross-cultural organizational behavior. Annual Review of Psychology' 58' 479-514.
19. Hayduk' L. A. (1989). Structural equation modeling - essentials and advances. Baltimore' MD and London: The John Hopkins University Press.
20. Helms-Lorenz' M.' & van de Vijver' F. J. R. (1995). Cognitive assessment in education in a multicultural society. European Journal of Psychological Assessment' 11' 158-169.
21. Holland' P. W.' & Wainer' H. (1993). Differential item functioning. Hillsdale' NJ: Erlbaum.
22. Hui' C. H.' & Triandis' H. C. (1985). Measurement in crosscultural psychology. Journal of Cross-Cultural Psychology' 16' 131-152.
23. Hunter' J. E.' & Schmidt' F. L. (1974). Racial and ethnic bias in psychological tests: Divergent implications of two definitions of test bias. American Psychologist' 29' 1-8.
24. Hyde' J. S. (2005). The gender similarities hypothesis. American Psychologist' 60' 581-592.
25. Jensen' A. R. (1980). Bias in mental testing. NewYork: Free Press.
26. Jöreskog' K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika' 36' 409-426.
27. Judge' T. A.' Bono' J. E.' Ilies' R.' & Gerhardt' M. W. (2002). Personality and leadership: A qualitative and quantitative review. Journal of Applied Psychology' 87' 765-780.
28. Judge' T. A.' Colbert' A. E.' & Ilies' R. (2004). Intelligence and leadership: A quantitative review and test of theoretical propositions. Journal of Applied Psychology' 89' 542-552.
29. Kenny' D. A.' & Kashy' D. A. (1992). Analysis of the multitraitmultimethod matrix by confirmatory factor analysis. Psychological Bulletin' 112' 165-172.
30. König' C.' Steinmetz' H.' Frese' M.' Rauch' A.' & Wang' Z.-M. (2007). Scenario-based scales measuring cultural orientations of business owners. Journal of Evolutionary Economics' 17' 211-239.
31. Little' T. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research' 32' 53-76.
32. Little' T. D. (2000). On the comparability of constructs in crosscultural research. Journal of Cross-Cultural Psychology' 31' 213-219.
33. MacKenzie' S. B.' Podsakoff' P. M.' & Jarvis' C. B. (2005). The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. Journal of Applied Psychology' 90' 710-730.
34. Marsh' H. W.' Tracey' D. K.' & Craven' R. G. (2006). Multidimensional self-concept structure for preadolescents with mild intellectual disabilities: A hybrid multigroup-MIMIC approach to factorial invariance and latent mean differences. Educational and Psychological Measurement' 66' 795-818.
35. Meredith' W. (1993). Measurement invariance' factor analysis and factorial invariance. Psychometrika' 58' 525-543.
36. Muthén' L. K.' & Muthén' B. O. (2007). Mplus user's guide. Los Angeles' CA: Muthén & Muthén.
37. Neisser' U.' Boodoo' G.' Bouchard' T. J. J.' Boykin' A. W.' Brody' N.' Ceci' S. J.'. . .' Urbina' S. (1996). Intelligence: Knowns and unknowns. American Psychologist' 51' 77-101.
38. Osterlind' S. J. (1983). Test item bias. Newbury Park' CA: Sage.
39. Paxton' P.' Curran' P. J.' Bollen' K. A.' Kirby' J.' & Chen' F. (2001). Monte Carlo experiments: Design and implementation. Structural Equation Modeling' 8' 287-312.
40. Ployhardt' R. E.' & Oswald' F. L. (2004). Applications of mean and covariance structure analysis: Integrating correlational and experimental approaches. Organizational Research Methods' 7' 27-65.
41. Podsakoff' P. M.' MacKenzie' S. B.' Lee' J.-Y.' & Podsakoff' N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology' 88' 879-903.
42. Reise' S. P.' Widaman' K. F.' & Pugh' R. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin' 114' 552-566.
43. Riordan' C.' & Vandenberg' R. J. (1994). A central question in cross-cultural research: Do employees of different cultures interpret work-related measures in an equivalent manner? Journal of Management' 20' 643-671.
44. Saris' W. E.' & Gallhofer' I. N. (2007). Design' evaluation and analysis of questionnaires for survey research. New York: Wiley.
45. Saris' W. E.' Satorra' A.' & van der Veld' W. M. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling' 16' 561-582.
46. Schaffer' B. S.' & Riordan' C. M. (2003). A review of crosscultural methodologies for organizational research: A bestpractices approach. Organizational Research Methods' 6' 169-215.
47. Schwartz' S. H. (2005). Basic human values: Their content and structure across cultures. In A. Tamayo & J. B. Porto (Eds.)' Valores e Comportamento nas Organizações [Values and behavior in organizations] (pp. 21-55). Petrópolis' Brazil: Vozes.
48. Smith' P. B. (2004). Acquiescent response bias as an aspect of cultural communication style. Journal of Cross-Cultural Psychology' 35' 50-61.
49. Spector' P. E. (1987). Method variance as an artifact in selfreported affect and perceptions at work: Myth or significant problem? Journal of Applied Psychology' 72' 438-443.
50. Spini' D. (2003). Measurement equivalence of 10 value types from the Schwartz value survey across 21 countries. Journal of Cross-Cultural Psychology' 34' 3-23.
51. Stark' S.' Chernyshenko' O. S.' & Drasgow' F. (2006). Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy. Journal of Applied Psychology' 91' 1292-1306.
52. Steenkamp' J.-B. E. M.' & Baumgartner' H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research' 25' 78-90.
53. Steinmetz' H. (2010). Estimation and comparison of latent means across cultures. In P. Schmidt' J. Billiet' & E. Davidov (Eds.)' Cross-cultural analysis: Methods and applications (pp. 85-116). Oxford: Routledge.
54. Steinmetz' H.' Schmidt' P.' Tina-Booh' A.' Schwartz' S. H.' & Wieczorek' S. (2009). Testing measurement invariance using multigroup CFA: Differences between educational groups in human values measurement. Quality and Quantity' 43' 599-616.
55. Teresi' J. A. (2006). Overview of quantitative measurement methods: Equivalence' invariance' and differential item functioning in health applications. Medical Care' 44' 39-49.
56. Vandenberg' R. J.' & Lance' C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions' practices' and recommendations for organizational research. Organizational Research Methods' 3' 4-69.