Examining differential item functioning trends for English language learners in a reading test: A meta-analytical approach

Language Testing

Volumn 31, Issue 1, 2014, Pages 89-109

  Koo, Jin ^a   Becker, Betsy Jane ^a   Kim, Young Suk ^b  

^a FLORIDA STATE UNIVERSITY   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

Author keywords

Differential item functioning; English language learners; meta analysis; reading test

Indexed keywords

EID: 84891700306     PISSN: 02655322     EISSN: 14770946     Source Type: Journal    
DOI: 10.1177/0265532213496097     Document Type: Article

References (44)

1. AbediJ.BaileyA. L.ButlerF.Castellon-WellingtonM.LeonS.MirochaJ. (2005). The validity of administering large-scale content assessments to English language learners: An investigation from three perspectives. CSE Report 663. Retrieved from http://cse.ucla.edu/products/reports/r663.pdf#page=87.
2. Abedi J.,Lord C.The language factor in mathematics tests.Applied Measurement in Education. 2001;14 (3): 219-234.
3. Alderman D. L.,Holland P. W.Item performance across native language groups on the Test of English as a Foreign Language. Princeton, NJ: Educational Testing Service; 1981:.
4. Al Otaiba S. A.,Petscher Y.,Pappamihiehl N. E.,Williams R. S.,Dyrlund A. K.,Connor C.Modeling oral reading fluency development in Latino students: A longitudinal study across second and third grade.Journal of Educational Psychology. 2009;101:315-329.
5. Anderson R. C.,Freebody P.Advances in reading research. Huston B., ed. Greenwich, CT: JAI Press; 1983:231-256.
6. Badian N. A.Reading disability defined as a discrepancy between listening and reading comprehension: A longitudinal study of stability, gender differences, and prevalence.Journal of Learning Disabilities. 1999;32:138-148.
7. Borenstein M.,Hedges L.,Higgins J.,Rothstein H.Introduction to meta-analysis. West Sussex, UK: Wiley; 2009:.
8. Briere E. J.A psycholinguistic study of phonological interference. The Hague: Mouton; 1968:.
9. Carnine D. W.,Silbert J.,Kame'enui E. J.,Tarver S.Direct instruction reading. 2010). Direct instruction reading (5th ed.). Upper Saddle River, NJ: Prentice Hall.Upper Saddle River, NJ: Prentice Hall; 2010:.
10. Dorans N. J.,Holland P. W.Differential item functioning. Holland P. W.Wainer H., ed. Hillsdale, NJ: Lawrence Erlbaum; 1993:35-66.
11. Erickson J.,Molloy J.Issues in language testing research. Oller J. W., ed. Rowley, MA: Newbury House; 1983:280-288.
12. Farhady H.Measures of language proficiency from the learner's perspective.TESOL Quarterly. 1982;16 (1): 43-59.
13. Florida Department of Education. (2004). Assessment & accountability briefing book. Tallahassee, FL: Florida Department of Education. Retrieved from http://fcat.fldoe.org/pdf/fcataabb.pdf.
14. Florida Department of Education. (2009). Understanding FCAT reports. Tallahassee, FL: Florida Department of Education. Retrieved from http://fcat.fldoe.org/fcatUnderstandReports.asp.
15. FrancisD. J.RiveraM.LesauxN.KiefferM. (2006). Research-based recommendations for instruction and academic interventions. Practical guidelines for the education of English language learners: Research-based recommendations for instruction and academic interventions. (Under cooperative agreement grant S283B050034 for U.S. Department of Education). Portsmouth, NH: RMC Research Corporation, Center on Instruction. Available online at www.centeroninstruction.org/files/ELL1-Interventions.pdf.
16. HaleS. (1988). Developmental trends in speed of information processing across the lifespan. Unpublished doctoral dissertation, University of Wisconsin-Milwaukee.
17. Hedges L. V.Meta-analysis.Journal of Educational Statistics. 1992;17:279-296.
18. Hedges L. V.,Olkin I.Statistical methods for meta-analysis. San Diego, CA: Academic Press; 1985:.
19. Hedges L. V.,Vevea J. L.Fixed- and random-effects models in meta-analysis.Psychological Methods. 1998;3 (4): 486-504.
20. Herber H. L.Teaching reading in content areas. Englewood Cliffs, NJ: Prentice-Hall; 1970:.
21. Holland P. W.,Thayer D. T.Test validity. Wainer H.Braun H. I., ed. Hillsdale, NJ: LEA; 1988:129-145.
22. Holland P. W.,Wainer H.Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum; 1993:.
23. Howard K.Cutting off the world's roof.Earth. 1997;6 (6): 20-21.
24. Hu L.,Bentler P. M.Cutoff criteria for fit indices in covariate structure analysis: Conventional criteria versus new alternatives.Structural Equation Modeling. 1999;6:1-55.
25. Kim Y. H.,Jang E. E.Differential functioning of reading subskills on the OSSLT for L1 and ELL students: A multidimensionality model-based DBF/DIF approach.Language Learning. 2009;59:825-865.
26. Kim Y.-S.The relations among L1 (Spanish) literacy skills, L2 (English) language, L2 text reading fluency, and L2 reading comprehension for Spanish-speaking ELL first grade students.Learning and Individual Differences. 2012;22:690-700.
27. KooJ. (2012). Meta-analysis of the Mantel-Haenszel index for the detection of differential item functioning. Unpublished doctoral dissertation, Florida State University.
28. Lesaux N. K.,Geva E.,Koda K.,Siegel L. S.,Shanahan T.Developing reading and writing in second language learners. August D.Shanahan T., ed. New York: Center for Applied Linguistics and International Reading Association; 2008:27-59.
29. Lesaux N. K.,Siegel L. S.The development of reading in children who speak English as a second language.Developmental Psychology. 2003;39:1005-1019.
30. Mancilla-Martinez J.,Lesaux N. K.Predictors of reading comprehension for struggling readers: The case of Spanish-speaking language minority learners.Journal of Educational Psychology. 2010;102:701-711.
31. Nakamoto J.,Lindsey K. A.,Manis F. R.A cross-linguistic investigation of English language learners' reading comprehension in English and Spanish.Scientific Studies of Reading. 2008;12:351-371.
32. National Center for Education Statistics. (2003). Average scale scores for reading by status as English language learner. Retrieved March 21, 2013, from http://nces.ed.gov/nationsreportcard/naepdata.
33. National Center for Education Statistics. (2011). Average scale scores for reading by status as English language learner. Retrieved March 21, 2013, from http://nces.ed.gov/nationsreportcard/naepdata.
34. Oltman P. K.,Stricker L. J.,Barrows T.Native language, English proficiency and the structure of the Test of English as a Foreign Language. Princeton, NJ: Educational Testing Service; 1988:.
35. Politzer R. L.,McGroarty M.An exploratory study of learning behaviors and their relationship to gains in linguistic and communicative competence.TESOL Quarterly. 1985;19 (1): 103-123.
36. Robins J.,Breslow N. E.,Greenland S.Estimators of the Mantel-Haenszel variance consistent in both sparse data and large-strata limiting models.Biometrics. 1986;42:311-324.
37. Scherbaum C. A.,Goldstein H. W.Examining the relationship between race-based differential item functioning and item difficulty.Educational and Psychological Measurement. 2008;64:537-553.
38. Siegel L. S.,Smythe I. S.Reflections on research on reading disability with special attention to gender issues.Journal of Learning Disabilities. 2005;38:473-477.
39. Spurling S.,Ilying D.The impact of learner variables on language test performance.TESOL Quarterly. 1985;19 (2): 283-301.
40. Stahl S. A.Vocabulary and readability: How knowing word meanings affects comprehension.Topics in Language Disorders. 2003;23:241-247.
41. Swinton S.,Powers D. E.Factor analysis of the Test of English as a Foreign Language for several language groups. Princeton, NJ: Educational Testing Service; 1980:.
42. Wagner R. K.,Schatschneider C.Classification of students based on developmental trajectories of reading: Robustness of findings across sample and method. Paper presented at the Scientific Studies of Reading Conference; 2009Boston, MA; 2009.
43. Wolf M. K.,Leon S.An investigation of the language demands in content assessments for English language learners.Educational Assessment. 2009;14:139-159.
44. Zwick R.,Ercikan K.Analysis of differential item functioning in the NAEP history assessment.Journal of Educational Measurement. 1989;26:55-66.