Accommodations for english language learners taking large-scale assessments: A meta-analysis on effectiveness and validity

Review of Educational Research

Volumn 79, Issue 3, 2009, Pages 1168-1201

  Kieffer, Michael J ^a   Lesaux, Nonie K ^a   Rivera, Mabel ^b   Francis, David J ^b  

^a HARVARD GRADUATE SCHOOL OF EDUCATION   (United States)

^b UNIVERSITY OF HOUSTON   (United States)

Author keywords

Achievement gap; Assessment; English language learners; High stakes testing; Language development

Indexed keywords

EID: 77950536960     PISSN: 00346543     EISSN: None     Source Type: Journal    
DOI: 10.3102/0034654309332490     Document Type: Article

References (58)

1. Abedi, J., Courtney, M., & Leon, S. (2003a). Effectiveness and validity of accommodations for English language learners in large-scale assessments (CSE Technical Report 608). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
2. Abedi, J., Courtney, M., & Leon, S. (2003b). Research-supported accommodation for English language learners in NAEP (CSE Technical Report 586). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
3. Abedi, J., Courtney, M., Mirocha, J., Leon, S., & Goldberg, J. (2005). Language accommodations for English language learners in large-scale assessments: Bilingual dictionaries and linguistic modification (CSE Technical Report 666). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
4. Abedi, J., & Hejri, F. (2004). Accommodations for students with limited English proficiency in the National Assessment of Educational Progress. Applied Measurement in Education, 17, 371-392.
5. Abedi, J., Hofstetter, C., Baker, E., & Lord, C. (2001). NAEP math performance test accommodations: Interactions with student language background (CSE Technical Report 536). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
6. Abedi, J., Hofstetter, C., & Lord, C. (2004). Assessment accommodations for English language learners: Implications for policy-based empirical research. Review of Educational Research, 74(1), 1-28.
7. Abedi, J., & Leon, S. (1999). Impact of students' language background on content-based performance: Analyses of extant data. Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing.
8. Abedi, J., Leon, S., & Mirocha, J. (2003). Impact of student language background on content-based performance: Analyses of extant data (CSE Technical Report 603). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
9. Abedi, J., & Lord, C. (2001). The language factor in mathematics tests. Applied Measurement in Education, 14(3), 219-234.
10. Abedi, J., Lord, C., Boscardin, C.K., & Miyoshi, J. (2001, September). The effects of accommodations on the assessment of limited English proficient students in the National Assessment of Educational Progress (Working Paper 200113). Washington, DC: National Center for Education Statistics.
11. Abedi, J., Lord, C., & Hofstetter, C. (1998). Impact of selected background variables on students' NAEP math performance (CSE Technical Report 478). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
12. Abedi, J., Lord, C., Hofstetter, C., & Baker, E. (2000). Impact of accommodation strategies on English language learners' test performance. Educational Measurements: Issues and Practice, 19(3), 16-26.
13. Abedi, J., Lord, C., & Plummer, J.R. (1997). Final report of language background as a variable in NAEP mathematics performance (CSE Technical Report 429). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
14. Albus, A., Bielinski, J., Thurlow, M., & Liu, K. (2001). The effect of a simplified English language dictionary on a reading test (LEP Project Report 1). Minneapolis: University of Minnesota, National Center on Educational Outcomes.
15. Albus, D., Thurlow, M., Liu, K., & Bielinski, J. (2005). Reading test performance of English-language learners using an English dictionary. The Journal of Educational Research, 98, 245-256.
16. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Education Research Association.
17. American Institutes of Research. (1999). Voluntary national tests in reading and math: Background paper reviewing laws and regulations, current practice, and research relevant to inclusion and accommodations for students with limited English proficiency. Palo Alto, CA: Author.
18. Anderson, M., Liu, K., Swierzbin, B., Thurlow, M., & Bielinski, J. (2000). Bilingual accommodations for limited English proficient students on statewide reading tests: Phase 2 (Minnesota Report 31). Minneapolis: University of Minnesota, National Center on Educational Outcomes.
19. Anderson, N.E., Jenkins, F.F., & Miller, K.E. (1996). NAEP inclusion criteria and testing accommodations: Findings from the NAEP 1995 field test in mathematics. Washington, DC: Educational Testing Service.
20. Bailey, A. (2005). Language analysis of standardized achievement tests: Considerations in the assessment of English language learners. In The validity of administering large-scale content assessments to English language learners: An investigation from three perspectives (CSE Technical Report 663; pp. 79-100). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
21. Batalova, J., Fix, M., & Murray, J. (2007). Measures of change: The demography and literacy of adolescent English language learners. New York: National Center on Immigrant Integration Policy.
22. Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2005). Comprehensive meta-analysis version 2. Englewood, NJ: Biostat.
23. Brown, P. (1999). Findings of the 1999 Plain Language Field Test (Publication T99- 013.1). Newark: University of Delaware, Delaware Education Research & Development Center.
24. Butler, F.A., & Castellon-Wellington, M. (2005). Students' concurrent performance on tests of English language proficiency and academic achievement. In The validity of administering large-scale content assessments to English language learners: An investigation from three perspectives (CSE Technical Report 663; pp. 47-78). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
25. Capps, R., Fix, M., Murray, J., Ost, J., Passel, J., & Herwantoro, S. (2005). The new demography of America's schools: Immigration and the No Child Left Behind Act. Washington, DC: Urban Institute.
26. Castellon-Wellington, M. (2000). The impact of preference for accommodations: The performance of English language learners on large-scale academic achievement tests (CSE Technical Report 524). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
27. Cazden, C. (1986). Classroom discourse. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 432-463). New York: Macmillan.
28. Center on Education Policy. (2006). Ten big effects of the No Child Left Behind Act on public schools. Phi Delta Kappan, 88(2), 1110-1113.
29. Crawford, J. (2004). Educating English learners: Language diversity in the classroom (5th ed.). Los Angeles: Bilingual Education Services.
30. Cuevas, G.J. (1984). Mathematics learning in English as a second language. Journal for Research in Mathematics Education, 15(2), 134-144.
31. Durkin, D. (1978-1979). What classroom observations reveal about comprehension instruction. Reading Research Quarterly, 14, 481-533.
32. Fuhrman, S. (2003). Riding waves, trading horses. The twenty-year effort to reform education. In D. T. Gordon (Ed.), A nation reformed? American education 20 years after A Nation At Risk (pp. 7-22). Cambridge, MA: Harvard Education Press.
33. Gándara, P., Rumberger, R., Maxwell-Jolly, J., & Callahan, R. (2003). English learners in California schools: Unequal resources, unequal outcomes. Educational Policy Analysis Archives, 11(36). Retrieved November 1, 2006, from http://epaa.asu.edu/epaa/v11n36/.
34. *Garcia Duncan, T., del Rio Parent, L., Chen, W., Ferrara, S., Johnson, E., Oppler, S.,et al.(2005). Study of a dual-language test booklet in eighth-grade mathematics. Applied Measurement in Education, 18(2), 129-161.
35. Hafner, A.L. (2001, April). Evaluating the impact of test accommodations on test scores of LEP students and non-LEP students. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
36. Hedges, L.V. (1981). Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics, 6(2), 107-128.
37. *Hofstetter, C.H. (2003). Contextual and mathematics accommodation test effects for English-language learners. Applied Measurement in Education, 16(2), 159-188.
38. Johnson, E., & Monroe, B. (2004). Simplified language as an accommodation on math tests. Assessment for Effective Intervention, 29(3), 35-45.
39. Koenig, J.A., & Bachman, L.F. (2004). Keeping score for all: The effects of inclusion and accommodation policies on large-scale educational assessment. Washington, DC: National Academies Press.
40. Kopriva, R.J., Emick, J.E., Hipolito-Delgado, C.P., & Cameron, C.A. (2007). Do proper accommodation assignments made a difference? Examining the impact of improved decision making on scores for English language learners. Educational Measurement: Issues and Practice, 26, 11-20.
41. Lager, C.A. (2006). Types of mathematics-language reading interactions that unnecessarily hinder algebra learning and assessment. Reading Psychology, 27, 165-204.
42. Lotherington-Woloszyn, H. (1993). Do simplified texts simplify language comprehension for ESL learners? (Technical report). Washington, DC: Office of Educational Research and Improvement.
43. Martiniello, M. (2007). Linguistic complexity and differential item functioning (DIF) for English language learners (ELL) in math word problems. Unpublished doctoral dissertation, Harvard Graduate School of Education, Cambridge, MA.
44. Miller, E.R., Okum, L., Sinai, R., & Miller, K.S. (1999, April). A study of the English language readiness of limited English proficient students to participate in New Jersey's statewide assessment system. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.
45. National Center on Education and the Economy. (1998). New Standards: Performance standards and assessments for the schools. Retrieved September 4, 2008, from http://www.ncee.org/store/products/index.jsp?setProtocol=true&stSection=1.
46. National Center for Education Statistics. (2005). National Assessment of Educational Progress, 2005. Washington, DC: U.S. Department of Education, Institute of Education Sciences. Retrieved November 1, 2006, from http://nces.ed.gov/nationsreportcard/.
47. Ragan, A., & Lesaux, N. (2006). Federal, state, and district level English language learner program entry and exit requirements: Effects on the education of language minority learners. Education Policy Analysis Archives, 14(20). Retrieved November 3, 2006, from http://epaa.asu.edu/epaa/v14n20/.
48. RAND Mathematical Study Panel. (2003). Mathematical proficiency for all students. Santa Monica, CA: RAND.
49. RAND Reading Study Group. (2002). Reading for understanding: Toward a research and development program in reading comprehension. Santa Monica, CA: RAND.
50. Raudenbush, S., & Bryk, A. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
51. Rivera, C., Collum, E., & Shafer Willner, L. (Eds.). (2006). State assessment policy and practice for English language learners: A national perspective. Mahwah, NJ: Lawrence Erlbaum.
52. Rivera, C., & Stansfield, C.W. (2004). The effect of linguistic simplification of science test items on score comparability. Educational Assessment, 9(3-4), 79-105.
53. Roser, N., & Juel, C. (1982). Effects of vocabulary instruction on reading comprehension. In J. A. Niles & L. A. Harris (Eds.), Yearbook of the National Reading Conference: Vol. 31. New inquiries in reading research and instruction (pp. 110-118). Rochester, NY: National Reading Conference.
54. SAS Institute. (1999). SAS version 8. Cary, NC: Author.
55. Scott, J.A., Jamieson-Noel, D., & Asselin, M. (2003). Vocabulary instruction throughout the day in twenty-three Canadian upper-elementary classrooms. Elementary School Journal, 103, 269-283.
56. Shepard, L., Taylor, G., & Betebenner, D. (1998). Inclusion of limited-English-proficient students in Rhode Island's grade 4 mathematics performance assessment (Technical Report 486). Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.
57. Sireci, S., Li, S., & Scarpati, S. (2003). The effect of test accommodation on test performance: A review of the literature (Research Report 495). Amherst: University of Massachusetts School of Education, Center for Educational Assessment.
58. Watts, S.M. (1995). Vocabulary instruction during reading lessons in six classrooms. Journal of Reading Behavior, 27, 399-424.