메뉴 건너뛰기




Volumn 12, Issue 3, 2012, Pages 203-223

Methodologies for Investigating Item- and Test-Level Measurement Equivalence in International Large-Scale Assessments

Author keywords

differential item functioning; differential test functioning; international large scale assessments; measurement comparability; PISA

Indexed keywords


EID: 84864657358     PISSN: 15305058     EISSN: 15327574     Source Type: Journal    
DOI: 10.1080/15305058.2011.617475     Document Type: Article
Times cited : (24)

References (40)
  • 2
    • 0003600480 scopus 로고    scopus 로고
    • American Educational Research Association, American Psychological Association, National Council on Measurement in Education, and Joint Committee on Standards for Educational and Psychological Testing Washington, DC: American Educational Research Association
    • American Educational Research Association, American Psychological Association, National Council on Measurement in Education, & Joint Committee on Standards for Educational and Psychological Testing. 1999. Standards for educational and psychological testing, Washington, DC: American Educational Research Association.
    • (1999) Standards for educational and psychological testing
  • 4
    • 41649115202 scopus 로고    scopus 로고
    • Measuring individualism and collectivism: The importance of considering differential components, reference groups, and measurement invariance
    • Chen, F. and West, S. 2008. Measuring individualism and collectivism: The importance of considering differential components, reference groups, and measurement invariance. Journal of Research in Personality, 42: 259-294.
    • (2008) Journal of Research in Personality , vol.42 , pp. 259-294
    • Chen, F.1    West, S.2
  • 5
    • 84927163182 scopus 로고    scopus 로고
    • Using statistical procedures to identify differentially functioning test items
    • Clauser, B. E. and Mazor, K. M. 1998. Using statistical procedures to identify differentially functioning test items. Educational Measurement: Issues and Practice, 17: 31-44.
    • (1998) Educational Measurement: Issues and Practice , vol.17 , pp. 31-44
    • Clauser, B.E.1    Mazor, K.M.2
  • 6
    • 84864723340 scopus 로고    scopus 로고
    • Practical considerations in linking scores on adapted tests
    • Brussels, Belgium: Keynote address at the 5th International Meeting of the International Test Commission
    • Cook, L. 2006. "Practical considerations in linking scores on adapted tests". Brussels, Belgium: Keynote address at the 5th International Meeting of the International Test Commission.
    • (2006)
    • Cook, L.1
  • 7
    • 0001789431 scopus 로고
    • PARDUX [Computer software]
    • CTB/McGraw-Hill Monterey, CA: CTB/McGraw-Hill
    • CTB/McGraw-Hill. 1991. "PARDUX [Computer software]". Monterey, CA: CTB/McGraw-Hill.
    • (1991)
  • 8
    • 4644335997 scopus 로고    scopus 로고
    • Comparability of bilingual versions of assessments: Sources of incomparability of English and French versions of Canada's national achievement tests
    • Ercikan, K., Gierl, M. J., McCreith, T., Puhan, G. and Koh, K. 2004. Comparability of bilingual versions of assessments: Sources of incomparability of English and French versions of Canada's national achievement tests. Applied Measurement in Education, 17(3): 301-321.
    • (2004) Applied Measurement in Education , vol.17 , Issue.3 , pp. 301-321
    • Ercikan, K.1    Gierl, M.J.2    McCreith, T.3    Puhan, G.4    Koh, K.5
  • 9
    • 84864711083 scopus 로고    scopus 로고
    • March, New York, NY: Paper presented at the annual meeting of the National Council on Measurement in Education
    • Ercikan, K. and Gonzalez, E. 2008, March. Score scale comparability in international assessments, New York, NY: Paper presented at the annual meeting of the National Council on Measurement in Education.
    • (2008) Score scale comparability in international assessments
    • Ercikan, K.1    Gonzalez, E.2
  • 10
    • 33846900345 scopus 로고    scopus 로고
    • Construct comparability of the English and French versions of TIMSS
    • Ercikan, K. and Koh, K. 2005. Construct comparability of the English and French versions of TIMSS. International Journal of Testing, 5: 23-35.
    • (2005) International Journal of Testing , vol.5 , pp. 23-35
    • Ercikan, K.1    Koh, K.2
  • 11
    • 84855803744 scopus 로고    scopus 로고
    • Effects of adaptations on comparability of test items
    • In: Robitaille D., Beaton A., editors Dordrecht, The Netherlands: Kluwer Academic Publisher
    • Ercikan, K. and McCreith, T. 2002. "Effects of adaptations on comparability of test items". In Secondary analysis of TIMSS results, Edited by: Robitaille, D. and Beaton, A. 391-405. Dordrecht, The Netherlands: Kluwer Academic Publisher.
    • (2002) Secondary analysis of TIMSS results , pp. 391-405
    • Ercikan, K.1    McCreith, T.2
  • 12
    • 34248206174 scopus 로고    scopus 로고
    • Iterative purification and effect size use with logistic regression for differential item functioning detection
    • French, B. F. and Maller, S. J. 2007. Iterative purification and effect size use with logistic regression for differential item functioning detection. Educational and Psychological Measurement, 67: 373-393.
    • (2007) Educational and Psychological Measurement , vol.67 , pp. 373-393
    • French, B.F.1    Maller, S.J.2
  • 13
    • 0035373504 scopus 로고    scopus 로고
    • Identifying sources of differential item and bundle functioning on translated achievement tests: A confirmatory analysis
    • Gierl, M. J. and Khaliq, S. N. 2001. Identifying sources of differential item and bundle functioning on translated achievement tests: A confirmatory analysis. Journal of Educational Measurement, 38(2): 164-187.
    • (2001) Journal of Educational Measurement , vol.38 , Issue.2 , pp. 164-187
    • Gierl, M.J.1    Khaliq, S.N.2
  • 14
    • 69949105386 scopus 로고    scopus 로고
    • Efficacy of effect size measures in logistic regression: An application for detecting DIF
    • Goméz-Benito, J., Hidalgo, M. D. and Padilla, J. L. 2009. Efficacy of effect size measures in logistic regression: An application for detecting DIF. Methodology, 5: 18-25.
    • (2009) Methodology , vol.5 , pp. 18-25
    • Goméz-Benito, J.1    Hidalgo, M.D.2    Padilla, J.L.3
  • 16
    • 10044266665 scopus 로고    scopus 로고
    • DIF detection and effect size: A comparison between logistic regression and Mantel-Haenszel variation
    • Hidalgo, M. D. and López-Pina, J. A. 2004. DIF detection and effect size: A comparison between logistic regression and Mantel-Haenszel variation. Educational and Psychological Measurement, 64: 903-915.
    • (2004) Educational and Psychological Measurement , vol.64 , pp. 903-915
    • Hidalgo, M.D.1    López-Pina, J.A.2
  • 17
    • 84864664001 scopus 로고    scopus 로고
    • Lessons from cross-national research on context and achievement: Hunting and fishing in the TIMSS landscape
    • In: Howie S. J., Plomp T., editors New York, NY: Routledge
    • Howie, S. J. and Plomp, T. 2006. "Lessons from cross-national research on context and achievement: Hunting and fishing in the TIMSS landscape". In Contexts of learning mathematics and science, Edited by: Howie, S. J. and Plomp, T. 3-15. New York, NY: Routledge.
    • (2006) Contexts of learning mathematics and science , pp. 3-15
    • Howie, S.J.1    Plomp, T.2
  • 18
    • 0040620288 scopus 로고    scopus 로고
    • Evaluation type 1 error and power rates using an effect size measure with the logistic regression procedure for DIF detection
    • Jodoin, M. G. and Gierl, M. J. 2001. Evaluation type 1 error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14(4): 329-349.
    • (2001) Applied Measurement in Education , vol.14 , Issue.4 , pp. 329-349
    • Jodoin, M.G.1    Gierl, M.J.2
  • 19
    • 84855416170 scopus 로고    scopus 로고
    • Structural equation modeling with ordinal variables using LISREL, SSI note
    • Retrieved from
    • Jöreskog, K. G. 2004. "Structural equation modeling with ordinal variables using LISREL, SSI note". Retrieved fromhttp://www.ssicentral.com/lisrel/techdocs/ordinal.pdf
    • (2004)
    • Jöreskog, K.G.1
  • 20
    • 0035540910 scopus 로고    scopus 로고
    • Factor analysis of ordinal variables: A comparison of three approaches
    • Jöreskog, K. G. and Moustaki, I. 2001. Factor analysis of ordinal variables: A comparison of three approaches. Multivariate Behavioral Research, 36(3): 347-387.
    • (2001) Multivariate Behavioral Research , vol.36 , Issue.3 , pp. 347-387
    • Jöreskog, K.G.1    Moustaki, I.2
  • 21
    • 84855199783 scopus 로고    scopus 로고
    • LISREL 8.50 [Computer software]
    • Chicago, IL: Scientific Software International
    • Jöreskog, K. G. and Sörbom, D. 2001. "LISREL 8.50 [Computer software]". Chicago, IL: Scientific Software International.
    • (2001)
    • Jöreskog, K.G.1    Sörbom, D.2
  • 22
    • 84965460461 scopus 로고
    • Interactions between item content and group membership on achievement test items
    • Linn, R. L. and Harnisch, D. L. 1981. Interactions between item content and group membership on achievement test items. Journal of Educational Measurement, 18: 109-118.
    • (1981) Journal of Educational Measurement , vol.18 , pp. 109-118
    • Linn, R.L.1    Harnisch, D.L.2
  • 23
    • 84864694868 scopus 로고    scopus 로고
    • Do different approaches to examining construct comparability lead to similar conclusions?
    • Oliveri, M. E. and Ercikan, K. 2011. "Do different approaches to examining construct comparability lead to similar conclusions?". In Applied Measurement in Education Vol. 24, 1-18.
    • (2011) Applied Measurement in Education , vol.24 , pp. 1-18
    • Oliveri, M.E.1    Ercikan, K.2
  • 24
    • 27644438039 scopus 로고    scopus 로고
    • Problem solving for tomorrow's world-First measures of cross-curricular competencies from PISA 2003
    • Organization for Economic Co-Operation and Development Retrieved from
    • Organization for Economic Co-Operation and Development. 2004. "Problem solving for tomorrow's world-First measures of cross-curricular competencies from PISA 2003". Retrieved fromhttp://www.pisa.oecd.org/dataoecd/25/12/34009000.pdf
    • (2004)
  • 25
    • 0000025035 scopus 로고
    • Kernel smoothing approaches to nonparametric item characteristic curve estimation
    • Ramsay, J. O. 1991. Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika, 56: 611-630.
    • (1991) Psychometrika , vol.56 , pp. 611-630
    • Ramsay, J.O.1
  • 26
    • 0003962795 scopus 로고    scopus 로고
    • TESTGRAF98: A program for the graphical analysis of multiple choice test and questionnaire data [Computer program]
    • Retrieved from
    • Ramsay, J. O. 2000. "TESTGRAF98: A program for the graphical analysis of multiple choice test and questionnaire data [Computer program]". Retrieved fromhttp://www.psych/mcgill.ca/faculty/ramsay/ramsay.html
    • (2000)
    • Ramsay, J.O.1
  • 27
    • 77951601196 scopus 로고    scopus 로고
    • International large-scale assessment data: Issues in secondary analysis and reporting
    • Rutkowski, L., Gonzalez, E., Joncas, M. and von Davier, M. 2010. International large-scale assessment data: Issues in secondary analysis and reporting. Educational Researcher, 39(2): 142-151.
    • (2010) Educational Researcher , vol.39 , Issue.2 , pp. 142-151
    • Rutkowski, L.1    Gonzalez, E.2    Joncas, M.3    von Davier, M.4
  • 28
    • 40849108090 scopus 로고    scopus 로고
    • Examining differential item functioning from a latent class perspective
    • Unpublished PhD dissertation, University of Maryland, College Park, MD
    • Samuelsen, K. M. 2005. "Examining differential item functioning from a latent class perspective". Unpublished PhD dissertation, University of Maryland, College Park, MD.
    • (2005)
    • Samuelsen, K.M.1
  • 29
    • 21144479363 scopus 로고
    • A model-based standardization approach that separates true bias/dif from group ability differences and detects test bias/dtf as well as item bias/dif
    • Shealy, R. and Stout, W. 1993. A model-based standardization approach that separates true bias/dif from group ability differences and detects test bias/dtf as well as item bias/dif. Psychometrika, 58: 159-194.
    • (1993) Psychometrika , vol.58 , pp. 159-194
    • Shealy, R.1    Stout, W.2
  • 30
    • 0034407669 scopus 로고    scopus 로고
    • Using bilingual respondents to evaluate translated-adapted items
    • Sireci, S. G. and Berberoglu, G. 2000. Using bilingual respondents to evaluate translated-adapted items. Applied Measurement in Education, 35: 229-259.
    • (2000) Applied Measurement in Education , vol.35 , pp. 229-259
    • Sireci, S.G.1    Berberoglu, G.2
  • 31
  • 32
    • 84988120749 scopus 로고
    • Detecting differential item functioning using logistic regression procedures
    • Swaminathan, H. and Rogers, H. J. 1990. Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27: 361-370.
    • (1990) Journal of Educational Measurement , vol.27 , pp. 361-370
    • Swaminathan, H.1    Rogers, H.J.2
  • 34
    • 84870938926 scopus 로고    scopus 로고
    • Decoding the meaning of factorial invariance and updating the practice of multi-group confirmatory factor analysis: A demonstration with TIMSS data
    • Wu, A. D., Li, Z. and Zumbo, B. D. 2007. Decoding the meaning of factorial invariance and updating the practice of multi-group confirmatory factor analysis: A demonstration with TIMSS data. Practical Assessment, Research and Evaluation, 12(3): 1-26.
    • (2007) Practical Assessment, Research and Evaluation , vol.12 , Issue.3 , pp. 1-26
    • Wu, A.D.1    Li, Z.2    Zumbo, B.D.3
  • 35
    • 84988115553 scopus 로고
    • Scaling performance assessments: Strategies for managing local item dependence
    • Yen, W. M. 1993. Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30: 187-214.
    • (1993) Journal of Educational Measurement , vol.30 , pp. 187-214
    • Yen, W.M.1
  • 37
    • 3242656525 scopus 로고    scopus 로고
    • Does item-level DIF manifest itself in scale-level analyses?: Implications for translating language tests
    • Zumbo, B. D. 2003. Does item-level DIF manifest itself in scale-level analyses?: Implications for translating language tests. Language Testing, 20: 136-147.
    • (2003) Language Testing , vol.20 , pp. 136-147
    • Zumbo, B.D.1
  • 38
    • 85055361086 scopus 로고    scopus 로고
    • Three generations of differential item functioning (DIF) analyses: Considering where it has been, where it is now, and where it is going
    • Zumbo, B. D. 2007. Three generations of differential item functioning (DIF) analyses: Considering where it has been, where it is now, and where it is going. Language Assessment Quarterly, 4: 223-233.
    • (2007) Language Assessment Quarterly , vol.4 , pp. 223-233
    • Zumbo, B.D.1
  • 40
    • 84864657157 scopus 로고    scopus 로고
    • Nonparametric IRT methodology for detecting DIF in moderate-to-small scale measurement: Operating characteristics and a comparison with the mantel haenszel
    • San Diego, CA: Paper presented at American Educational Research Association Meeting
    • Zumbo, B. D. and Witarsa, P. M. 2004. "Nonparametric IRT methodology for detecting DIF in moderate-to-small scale measurement: Operating characteristics and a comparison with the mantel haenszel". San Diego, CA: Paper presented at American Educational Research Association Meeting.
    • (2004)
    • Zumbo, B.D.1    Witarsa, P.M.2


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.