Testing for measurement and structural equivalence in large-scale cross-cultural studies: Addressing the issue of nonequivalence

International Journal of Testing

Volumn 10, Issue 2, 2010, Pages 107-132

  Byrne, Barbara M ^a   van de Vijver, Fons J R ^b  

^a University of Ottawa   (South Africa)

^b TILBURG UNIVERSITY   (Netherlands)

Author keywords

Cross cultural research; Large scale studies; Measurement equivalence; Structural equation modeling

Indexed keywords

EID: 78650109204     PISSN: 15305058     EISSN: 15327574     Source Type: Journal    
DOI: 10.1080/15305051003637306     Document Type: Article

References (66)

1. Austin, J. T., & Calderón, R. F. (1996). Theoretical and technical contributions to structural equation modeling: An updated annotated bibliography. Structural Equation Modeling, 3, 105-175.
2. Bentler, P. M. (1978). The interdependence of theory, methodology, and empirical data: Causal modeling as an approach to construct validation. In D. B. Kandel (Ed.), Longitudinal research on drug use: Empirical findings and methodological issues (pp. 267-302). New York: Wiley.
3. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
4. Bentler, P. M. (2005). EQS 6 structural equations program manual. Encino, CA: Multivariate Software (www.mvsoft.com).
5. Boomsma, A., & Hoogland, J. J. (2001). The robustness of LISREL modeling revisited. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural equation modeling: A festschrift in honor of Karl Jöreskog (pp. 139-168). Lincolnwood, IL: Scientific Software.
6. Byrne, B.M. (1988). The Self Description Questionnaire III: Testing for equivalent factorial validity across ability. Educational and Psychological Measurement, 48, 397-406.
7. Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.
8. Byrne, B. M. (2003). Testing for equivalent self-concept measurement across culture: Issues, caveats, and application. In H. W. Marsh, R. G. Craven, & D. M. McInerney (Eds.), International advances in self research (Vol. 1, pp. 291-314). Greenwich, CT: Information Age.
9. Byrne, B. M. (2006). Structural equation modeling with EQS: Basic concepts, applications, and programming (2nd ed.). Mahwah, NJ: Erlbaum.
10. Byrne, B. M. (2008). Testing for multigroup equivalence of a measuring instrument: A walk through the process. Psicothema, 20, 872-882.
11. Byrne, B. M. (2009). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2nd ed.). New York: Routledge/Taylor & Francis.
12. Byrne, B.M., Baron, P., & Balev, J. (1998). The Beck Depression Inventory: A cross-validated test of factorial structure for Bulgarian adolescents. Educational and Psychological Measurement, 58, 241-251.
13. Byrne, B. M., & Campbell, T. L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface. Journal of Cross-cultural Psychology, 30, 557-576.
14. Byrne, B. M., Oakland, T., Leong, F. T. L., van de Vijver, F. J. R., Hambleton, R. K., Cheung, F. M., & Bartram, D. (2009). A critical analysis of cross-cultural research and testing practices: Implications for improved education and training. Training and Education in Professional Psychology, 3, 94-105.
15. Byrne, B. M., & Shavelson, R. J. (1986). On the structure of adolescent self-concept. Journal of Educational Psychology, 78, 474-481.
16. Byrne, B. M., & Shavelson, R. J. (1987). Adolescent self concept: Testing the assumption of equivalent structure across gender. American Educational Research Journal, 24, 365-385.
17. Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement equivalence. Psychological Bulletin, 105, 456-466.
18. Byrne, B. M., & Stewart, S. M. (2006). The MACS approach to testing for multigroup equivalence of a second-order structure: A walk through the process. Structural Equation Modeling, 13, 287-321.
19. Byrne, B. M., Stewart, S. M., Kennard, B. D., & Lee, P. (2007). The Beck Depression Inventory II: Testing for measurement equivalence and factor mean differences across Hong Kong and American Adolescents. International Journal of Testing, 7, 293-309.
20. Byrne, B. M., & Watkins, D. (2003). The issue of measurement equivalence revisited. Journal of Cross-cultural Psychology, 34, 155-175.
21. Cheung, M. W. -L., & Au, K. (2005). Applications of multilevel structural equation modeling to cross-cultural research. Structural Equation Modeling, 12, 598-619.
22. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
23. Cohen, A. B. (2009). Many forms of culture. American Psychologist, 64, 194-204.
24. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
25. Cooke, D. J., Kosson, D. S., & Michie, C. (2001). Psychopathy and ethnicity: Structural, item, and test generalizability of the Psychopathy Checklist-Revised (PCL-R) in Caucasian and African American participants. Psychological Assessment, 13, 531-542.
26. Curran, P. J., West S.G., Finch, J.F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1, 16-29.
27. Davidov, E. (2008). A cross-country and cross-time comparison of the Human Values measurements with the second round of the European Social Survey. Survey Research Methods, 2, 33-46.
28. Embretson, S. E. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179-197.
29. Georgas, J. (1989). Changing family values in Greece: From collectivist to individualist. Journal of Cross-Cultural Psychology, 20, 80-91.
30. Georgas, J. (1999). Family as a context variable in cross-cultural psychology. In J. Adamopoulos & Y. Kashima (Eds.), Social psychology and cultural context (pp. 163-175). Beverly Hills, CA: Sage.
31. Georgas, J., Berry, J. W., van de Vijver, F. J. R., Kagitcibasi, C., & Poortinga, Y. H. (2006). Fa milies across cultures: A 30-nation psychological study. Cambridge, United Kingdom: Cambridge University Press.
32. Harkness, J. A. (2003) Questionnaire translation. In J. A. Harkness, F.J. R. Van de Vijver, & P. Ph. Mohler (Eds.), Cross-cultural survey methods (pp. 35-56). New York: Wiley.
33. Harzing, A.-W. (2006). Response styles in cross-national survey research: A 26-country study. International Journal of Cross Cultural Management, 6, 243-266.
34. Hershberger, S. L. (2003). The growth of structural equation modelling: 1994-2001. Structural Equation Modeling, 10, 35-46.
35. Ho, D. Y. F. (1996). Filial piety and its psychological consequences. In M. H. Bond (Ed.), Handbook of Chinese psychology (pp. 155-165). Hong Kong: Oxford University Press.
36. Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement equivalence in aging research. Experimental Aging Research, 18, 117-144.
37. House, R. J., Hanges, P. J., Javidan, M., Dorfman, P. W., & Gupta, V. (2004). Culture, leadership, and organizations: The GLOBE study of 62 societies. Thousand Oaks, CA: Sage.
38. Hu, L-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
39. Hu, L-T., Bentler, P. M., & Kano, Y. (1992). Can test statistics in covariance structure analysis be trusted? Psychological Bulletin, 112, 351-362.
40. Johnson, T. P. (1998). Approaches to equivalence in cross-cultural and cross-national research. Zuma Nachrichten Spezial 3, 1-40.
41. Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36, 409-426.
42. Kagitcibasi, C. (2007). Family, self, and human development across cultures: Theory and applications (2nd ed.). Mahwah, NJ: Erlbaum.
43. Leong, F. T. L., Okazaki, S., & Tak, J. (2003). Assessment of depression and anxiety in East Asia. Psychological Assessment, 15, 290-305.
44. Leung, P. W. L., & Wong, M. M. T. (2003). Measures of child and adolescent psychopathology in Asia. Psychological Assessment, 15, 268-279.
45. Little, T. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76.
46. Little, T. D., Card, N. A., Slegers, D. W., & Ledford, E. C. (2007). Representing contextual effects in multiple-group MACS models. In T. D. Little, J. A. Bovaird, & N. A. Card (Eds.), Modeling contextual effects in longitudinal studies (pp. 121-147). Mahwah, NJ: Erlbaum.
47. Marsh, H. W. (1994). Confirmatory factor analysis models of factorial equivalence: A multifaceted approach. Structural Equation Modeling, 1, 5-34.
48. Marsh, H. W. (2007). Application of confirmatory factor analysis and structural equation modeling in sport/exercise psychology. In G. Tenenbaum & R. C. Eklund (Eds.), Handbook of sport psychology (3rd ed., pp. 774-798). New York: Wiley.
49. Marsh, H. W., Hau, K-T., Artelt, C., Baumert, J., & Peschar, J. L. (2006). OECD's brief self-report measure of educational psychology's most useful affective constructs: Cross-cultural, psychometric comparisons across 25 countries. International Journal of Testing, 6, 311-160.
50. Meredith, W. (1993). Measurement equivalence, factor analysis, and factorial equivalence. Psychometrika, 58, 525-543.
51. Millsap, R. E., & Kwok, OM. (2004). Evaluating the impact of partial factorial equivalence on selection in two populations. Psychological Methods, 9, 93-115.
52. Poortinga, Y. H. (1989). Equivalence of cross cultural data: An overview of basic issues. International Journal of Psychology, 24, 737-756.
53. Ryan, A. M., Chan, D., Ployhart, R. E., & Slade, L.A. (1999). Employee attitude surveys in a multinational organization considering language and culture in assessing measurement equivalence. Personnel Psychology, 52, 37-58.
54. Satorra, A., & Bentler, P.M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von Eye & C.C. Clogg (Eds.), Latent variables analysis: Applications for developmental research (pp. 399-419). Thousand Oaks, CA: Sage.
55. Schwartz, S. H. (1992). Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. In M. Zanna (Ed.), Advances in experimental social psychology (Vol. 25, pp. 1-65). Orlando, FL: Academic Press.
56. Selig, J. P., Card, N. A., & Little, T. D. (2008). Latent variable structural equation modelling in cross-cultural research: Multigroup and multilevel approaches. In F. J. R. van de Vijver, D. A., van Hemert, & Y. H. Poortinga (Eds.), Multilevel analysis of individuals and cultures (pp. 93-119). Mahwah, NJ: Erlbaum.
57. Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173-180.
58. Tremblay, P. F., & Gardner, R. C. (1996). Onthegrowthofstructural equation modelinginpsychological journals. Structural Equation Modeling, 3, 93-104.
59. Van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Thousand Oaks: Sage.
60. Van de Vijver, F. J. R., & Leung, K. (2000). Methodological issues in psychological research on culture. Journal of Cross-cultural Psychology, 31, 33-51.
61. Van de Vijver, F. J. R., Mylonas, K., Pavlopoulos, V., & Georgas, J. (2006). Results: Cross-cultural analyses of the family. In J. Georgas et al. (Eds.), Families across culture: A 30- nation psychological study (pp. 126-185). Cambridge, UK: Cambridge Press.
62. Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement equivalenceliterature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-70.
63. Welkenhuysen-Gybels, J., van de Vijver, F. J. R., & Cambre, B. (2007). A comparison of methods for the evaluation of construct equivalence in a multigroup setting. In G. Loosveldt, M. Swyngedouw, & B. Cambre (Eds.), Measuring meaningful data in social research (pp. 357-371). Leuven, Belgium: Acco.
64. Wells, L. E., & Marwell, G. (1976). Self-esteem: Its conceptualization and measurement. Beverly Hills, CA: Sage.
65. West, S. G., Finch, J. F., & Curran, P. J. (1995). Structural equation models with nonnormal variables: Problems and remedies. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 56-75). Thousand Oaks, CA: Sage.
66. Widaman, K. F., & Reise, S. P. (1997). Exploring the measurement equivalence of psychological instruments: Applications in the substance use domain. In K. J. Bryant, M. Windle, & S. G. West (E d s.), The science of prevention (pp. 281-324). Washington, DC: American PsychologicalAssociation.