The analysis of measurement equivalence in international studies using the Rasch model

Educational Research and Evaluation

Volumn 17, Issue 6, 2011, Pages 447-464

  Schulz, Wolfram ^a   Fraillon, Julian ^a  

^a Australian Council for Educational Research   (Australia)

Author keywords

civic and citizenship education; cross cultural research; international studies; measurement equivalence; Rasch modeling

Indexed keywords

EID: 84859141962     PISSN: 13803611     EISSN: 17444187     Source Type: Journal    
DOI: 10.1080/13803611.2011.630559     Document Type: Article

References (34)

1. Amadeo, J., Torney-Purta, J., Lehmann, R., Husfeldt, V. and Nikolova, R. 2002. Civic knowledge and engagement: An IEA study of upper secondary students in sixteen countries, Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement (IEA).
2. Byrne, B.M. 2003. "Testing for equivalent self-concept measurement across culture". In International advances in self-research: Speaking to the future, Edited by: Marsh, H.W., Craven, R.G. and McInerney, D.M. 291-314. Greenwich, CT: Information Age Publishing.
3. Chrostowski, S.J. and Malak, B. 2004. "Translation and cultural adaptation of the TIMSS 2003 instruments". In TIMSS 2003. Technical report, Edited by: Martin, M.O., Mullis, I.V.S. and Chrostowski, S.J. 93-108. Amsterdam, The Netherlands: IEA.
4. Fox, J.P. 2005. "Multilevel IRT model assessment". In New developments in categorical data analysis for the social and behavioral sciences, Edited by: van der Ark, L.A., Croon, M.A. and Sijtsma, K. 227-252. Mahwah, NJ: Lawrence Erlbaum.
5. Grisay, A. 2002. "Translation and cultural appropriateness of the test and survey material". In PISA 2000. Technical report, Edited by: Adams, R.J. and Wu, M. 57-70. Paris, France: OECD Publications.
6. Grisay, A., Gonzalez, E. and Monseur, C. 2009. "Equivalence of item difficulties across national versions of the PIRLS and PISA reading assessments". In IERI monograph series: Issues and methodologies in large-scale assessments 63-83. Retrieved fromhttp://www.ierinstitute.org/IERI_Monograph_Volume_02.pdf
7. Hambleton, R. and Rodgers, J. 1995. Item bias review. Practical Assessment, Research, and Evaluation, 4(6) Retrieved fromhttp://PAREonline.net/getvn.asp?v=4andn=6
8. Hambleton, R.K., Swaminathan, H. and Rogers, H.J. 1991. Fundamentals of item response theory, Newbury Park, CA: Sage.
9. Heine, S.J., Lehman, D.R., Peng, K. and Greenholtz, J. 2002. What's wrong with cross-cultural comparisons of subjective Likert scales? The reference group effect. Journal of Personality and Social Psychology, 82: 903-918.
10. Hencke, J., Rutkowski, L., Neuschmidt, O. and Gonzalez, E. 2009. "Curriculum coverage and scale correlation on TIMSS 2003". In IERI monograph series: Issues and methodologies in large-scale assessments 85-112. Retrieved fromhttp://www.ierinstitute.org/IERI_Monograph_Volume_02.pdf
11. Jak, S., Oort, F.J. and Dolan, C.V. 2010. Measurement bias and multidimensionality: An illustration of bias detection in multidimensional measurement models. ASTA Advances in Statistical Analysis, 94: 129-137.
12. Martin, M.O., Kennedy, A.M. and Trong, K.L. 2007. "Item analysis and review". In PIRLS 2006 technical report, Edited by: Martin, M.O., Mullis, I.V.S. and Kennedy, A.M. 131-148. Amsterdam, The Netherlands: IEA.
13. Masters, G.N. and Wright, B.D. 1997. "The partial credit model". In Handbook of modern item response theory, Edited by: van der Linden, W.J. and Hambleton, R.K. 101-122. New York, NY: Springer.
14. Olson, J.F., Martin, M.O. and Mullis, I.V.S. 2008. TIMSS 2007 technical report, Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement (IEA).
15. Olson, J.F., Martin, M.O., Mullis, I.V.S., Foy, P., Erberber, E. and Preuschoff, C. 2008. "TIMSS 2007 technical report". In Reviewing the TIMSS 2007 item statistics, Edited by: Olson, J.F., Martin, M.O. and Mullis, I.V.S. 193-224. Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement (IEA).
16. Organisation for Economic Co-operation and Development. 2009. PISA 2006 technical report, Paris, France: Author.
17. Park, C. and Bolt, D.M. 2008. "Application of multilevel IRT to investigate cross-national skill profiles on TIMSS 2003". In IERI monograph series: Issues and methodologies in large-scale assessments 71-96. Retrieved fromhttp://www.ierinstitute.org/IERI_Monograph_Volume_01.pdf
18. Perrone, M. 2006. Differential item functioning and item bias: Critical consideration in test fairness. Teachers College, Columbia University Working Papers in TESOL and Applied Linguistics, 6: 1-3.
19. Raju, N.S., Laffitte, L.J. and Byrne, B.M. 2002. Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87: 517-529.
20. Rasch, G. 1960. Probabilistic models for some intelligence and attainment tests, Copenhagen, Denmark: The Danish Institute of Education Research. (Expanded edition (1980) with foreword and afterword by B.D. Wright. Chicago, IL: The University of Chicago Press)
21. Rost, J. 1991. A logistic mixture distribution model for polytomous item responses. British Journal of Mathematical and Statistical Psychology, 44: 75-92.
22. Rost, J., Carstensen, C. and von Davier, M. 1997. "Applying the mixed Rasch model to personality questionnaires". In Applications of latent trait and latent class models in the social sciences, Edited by: Rost, J. and Langeheine, R. 324-332. Münster, Germany: Waxmann.
23. Rost, J. and von Davier, M. 1994. A conditional item-fit index for Rasch models. Applied Psychological Measurement, 18: 171-182.
24. Schulz, W. 2009. "Questionnaire construct validation in the International Civic and Citizenship Education Study". In IERI monograph series: Issues and methodologies in large-scale assessments 113-135. Retrieved fromhttp://www.ierinstitute.org/IERI_Monograph_Volume_02.pdf
25. Schulz, W., Ainley, J. and Fraillon, J. 2011. ICCS 2009 technical report, Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement (IEA).
26. Schulz, W., Ainley, J., Fraillon, J., Kerr, D. and Losito, B. 2010a. ICCS 2009 international report: Civic knowledge, attitudes, and engagement among lower secondary school students in thirty-eight countries, Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement (IEA).
27. Schulz, W., Ainley, J., Fraillon, J., Kerr, D. and Losito, B. 2010b. Initial findings from the IEA International Civic and Citizenship Study, Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement (IEA).
28. Schulz, W., Fraillon, J., Ainley, J., Losito, B. and Kerr, D. 2008. International Civic and Citizenship Education Study. Assessment framework, Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement (IEA).
29. Schulz, W. and Sibberns, H. 2004. IEA Civic Education Study. Technical report, Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement (IEA).
30. Torney-Purta, J., Lehmann, R., Oswald, H. and Schulz, W. 2001. Citizenship and education in twenty-eight countries, Amsterdam, The Netherlands: International Association for the Evaluation of Educational Achievement (IEA).
31. Van de Vijver, F.J.R. and Tanzer, N.K. 1997. Bias and equivalence in cross-cultural assessment: An overview. European Review of Applied Psychology, 47: 263-279.
32. Walker, M. 2007. Ameliorating culturally based extreme item tendencies to attitude items. Journal of Applied Measurement, 8: 267-278.
33. Wright, B.D. and Masters, G.N. 1982. Rating scale analysis: Rasch measurement, Chicago, IL: MESA Press.
34. Wu, M.L., Adams, R.J., Wilson, M.R. and Haldane, S. 2007. ACER ConQuest 2.0: General item response modelling software [Computer program manual], Camberwell, Victoria, Australia: ACER Press.