Impact of measurement invariance on construct correlations, mean differences, and relations with external correlates: An illustrative example using big five and RIASEC measures

Assessment

Volumn 18, Issue 4, 2011, Pages 412-427

  Schmitt, Neal ^a   Golubovich, Juliya ^a   Leong, Frederick T L ^a  

^a MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

cultural differences; measurement invariance; partially invariant models

Indexed keywords

AFRICAN AMERICAN; ARTICLE; CAUCASIAN; COMPARATIVE STUDY; DECISION MAKING; FACTORIAL ANALYSIS; HUMAN; METHODOLOGY; PERSONALITY TEST; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; STANDARD; STATISTICS; STUDENT; UNITED STATES; UNIVERSITY; VALIDATION STUDY;

AFRICAN AMERICANS; CAREER CHOICE; EUROPEAN CONTINENTAL ANCESTRY GROUP; FACTOR ANALYSIS, STATISTICAL; HUMANS; PERSONALITY TESTS; PSYCHOMETRICS; STUDENTS; UNITED STATES; UNIVERSITIES;

EID: 82155195540     PISSN: 10731911     EISSN: 15523489     Source Type: Journal    
DOI: 10.1177/1073191110373223     Document Type: Article

References (40)

1. Armstrong P.I.,Allison W.,Rounds J.Development and initial validation of brief public domain RIASEC marker scales.Journal of Vocational Behavior. 2008;73:287-299.
2. Atienza F.L.,Balaguer I.,Garcia-Merita M.L.Satisfaction with life scale: Analysis of factorial invariance across sexes.Personality and Individual Differences. 2003;35:1255-1260.
3. Bauer D.J.The role of nonlinear factor-to-indicator relations in tests of measurement equivalence.Psychological Methods. 2005;10:305-316.
4. Bentler P.M.Comparative fit indexes in structural models.Psychological Bulletin. 1990;107:238-246.
5. Bentler P.M.,Bonett D G.Significance tests and goodness-of-fit in the analysis of covariance structures.Psychological Bulletin. 1980;107:238-246.
6. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K.R. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 445-455). Newbury Park, CA: Sage.
7. Byrne B.M.Mahwah, NJ: Lawrence Erlbaum; 1998:.
8. Byrne B.M.,Shavelson R.,Muthen B.Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance.Psychological Bulletin. 1989;105:456-466.
9. Chen F.F.What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research.Journal of Personality and Social Psychology: Attitudes and Social Cognition. 2008;95:1005-1018.
10. Cheng C.H. K.,Watkins D.Age and gender invariance of self-concept factor structure: An investigation of a newly developed Chinese self-concept instrument.International Journal of Psychology. 2000;35:186-193.
11. Cheung G.W.,Rensvold R.B.Testing invariance across groups: A reconceptualization and proposed new method.Journal of Management. 1999;25:1-28.
12. ClarkL. (2001). Which career is for you?Retrieved June 10, 2010, from http://www.oaklandcc.edu/CareerFocus/Spring2001.
13. Cole M.S.,Bedeian A.G.,Field H.S.The measurement equivalence of web-based and paper-and-pencil measures of transformational leadership: A multinational test.Organizational Research Methods. 2006;9:339-368.
14. Costa P.T.,McCrae R.R.NEO PI-R professional manual. Odessa, FL: Psychological Assessment Resources; 1992:.
15. Digman J.M.Personality structure: Emergence of the Five-Factor Model.Annual Review of Psychology. 1990;41:417-440.
16. Fouad N.A.Cross-cultural differences in vocational interests: Between-group differences on the Strong Interest Inventory.Journal of Counseling Psychology. 2002;49:283-289.
17. Fouad N.A.,Harmon L.W.,Borgen F.H.Structure of interest in employed male and female members of U.S. racial-ethnic minority and non-minority groups.Journal of Counseling Psychology. 1997;44:339-345.
18. Goldberg, L. R. (1999). A broad-bandwidth public-domain personality inventory measuring the lower-level facets of several five-factor models. In I. Mervielde, I. Deary, F. De Fruyt, & F. Ostendorf (Eds.), Personality psychology in Europe (Vol. 7, pp. 7-28). Tilburg, Netherlands: Tilburg University Press.
19. Holland J.L.Vocational preference inventory: Professional manual. Odessa, FL: Psychological Assessment Resources; 1985:.
20. Holland J.L.Making vocational choices: A theory of vocational personalities and work environments. Baltimore: Psychological Assessment Resources; 1997:.
21. Hough, L. (1998). Personality at work: Issues and evidence. In M.D. Hakel (Ed.), Beyond multiple choice: Evaluating alternatives to traditional testing for selection (pp. 131-166). Mahwah, NJ: Lawrence Erlbaum.
22. Hu L.T.,Bentler P.M.Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives.Structural Equation Modeling: A Multidisciplinary Journal. 1999;6:1-55.
23. Jöreskog K.G.,Sörbom D.,du Toit S.,du Toit M.LISREL 8: New statistical features. Lincolnwood, IL: Scientific Software; 2000:.
24. MacCallum R.Specification searches in covariance structure modeling.Psychological Bulletin. 1986;100:107-120.
25. MacCallum R.,Roznowski M.,Necowitz L.B.Model modifications in covariance structure analysis: The problems of capitalization on chance.Psychological Bulletin. 1992;111:490-504.
26. Meade A.W.,Johnson E.C.,Braddy P.W.Power and sensitivity of alternative fit indices in tests of measurement invariance.Journal of Applied Psychology. 2008;93:568-593.
27. Meade A.W.,Kroustalis C.M.Problems with item parceling for confirmatory factor analytic tests of measurement invariance.Organizational Research Methods. 2006;9:369-403.
28. Meredith W.Measurement invariance, factor analysis, and factor.Psychometrika. 1993;53:525-543.
29. Miller M.J.,Springer T.,Wells D.Which occupational environments do Black youth prefer? Extending Holland's typology.School Counselor. 1988;36:103-106.
30. Millsap R.E.,Kwok O.Evaluating the impact of partial factorial invariance on selection in two populations.Psychological Methods. 2004;9:93-115.
31. Ployhart R.E.,Holtz B.C.The diversity-validity dilemma: Strategies for reducing racioethnic and sex subgroup differences and adverse impact in selection.Personnel Psychology. 2008;61:153-172.
32. Ployhart R.E.,Oswald F.L.Applications of mean and covariance structure analysis: Integrating correlational and experimental approaches.Organizational Research Methods. 2004;7:27-65.
33. Rosenberg M.Society and the adolescent self-image. Princeton, NJ: Princeton University Press; 1965:.
34. Sandoval, J., & Duran, R. P. (1998). Language. In J. Sandoval, C. L. Frisby, K. F. Geisinger, J. D. Scheuneman, & J. R. Grenier (Eds.), Test interpretation and diversity: Achieving equity in assessment (pp.181-212).Washington, DC: American Psychological Association.
35. Schmitt N.,Kuljanin G.Measurement invariance: Review of practice and implications.Human Resource Management Review. 2008;18:210-222.
36. Schmitt N.,Oswald F.L.,Kim B.H.,Imus A.,Drzakowski S.,Friede A., et al.The use of background and ability profiles to predict college student outcomes.Journal of Applied Psychology. 2007;92:165-179.
37. Stark S.,Chernyshenko O.S.,Drasgow F.Detecting DIF with CFA and IRT: Toward a unified strategy.Journal of Applied Psychology. 2006;91:1292-1306.
38. Steiger J.H.Structural model evaluation and modification: An interval estimation approach.Multivariate Behavioral Research. 1990;25:173-180.
39. Tracey T.J. G.Tracey T.J. G.RANDALL: A Microsoft Fortran program for a randomization test of hypothesized order relations.Educational and Psychological Measurement. 1997;57:164-168.
40. Vandenberg R.J.,Lance C.E.A review and synthesis of the measurement invariance methods and procedures.Organizational Research Methods. 2000;5:139-158.