Assessment of English Language Learners in the Era of New Academic Content Standards

Review of Research in Education

Volumn 39, Issue 1, 2015, Pages 253-294

  Bailey, Alison L ^a   Carroll, Patricia E ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84924761241     PISSN: 0091732X     EISSN: 19351038     Source Type: Journal    
DOI: 10.3102/0091732X14556074     Document Type: Article

References (132)

1. Abedi J.Standardized achievement tests and English language learners: Psychometrics issues.Educational Assessment. 2002;8:231-257
2. Abedi J.The No Child Left Behind Act and English language learners: Assessment and accountability issues.Educational Researcher. 2004;33 (1): 4-14
3. English language proficiency assessment in the nation: Current status and future practice. Abedi J., ed. Davis: UC Davis School of Education; 2007:
4. Abedi J.Classification system for English language learners: Issues and recommendations.Educational Measurement: Issues and Practice. 2008;27 (3): 17-31
5. Abedi J.English Language Learners with disabilities: Classification, assessment, and accommodation issues. Journal of Applied Testing Technology. 2009;10 (2): 1-30
6. Abedi J.Handbook of formative assessment. Andrade H. L.Cizek G. J., ed. New York, NY: Routledge; 2010:37-66.
7. Abedi J.,Hofstetter C. H.,Lord C.Assessment accommodations for English language learners: Implications for policy-based empirical research.Review of Educational Research. 2004;74:1-28
8. Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 2014:
9. The language demands of school: Putting academic language to the test. Bailey A. L., ed. New Haven, CT: Yale University Press; 2007:
10. Bailey A. L.The education of English language learners. Shatz M.Wilkinson L., ed. New York, NY: Guilford Press; 2010:222-247.
11. Bailey A. L.Lessons from AZ’s EL identification struggle: How guidance could strengthen process.NCLB Advisor. 2011;6 (4): 5-8
12. Bailey A. L.,Butler F. A.,Stevens R.,Lord C.The language demands of school: Putting academic language to the test. Bailey A. L., ed. New Haven, CT: Yale University Press; 2007:103-156.
13. Bailey A. L.,Heritage M.Formative assessment for literacy, Grades K-6: Building reading and academic language skills across the curriculum. Thousand Oaks, CA: Sage; 2008:
14. Bailey A. L.,Heritage M.The role of language learning progressions in improved instruction and assessment of English language learners.TESOL Quarterly. 2014;48:480-506
15. Bailey A. L.,Heritage M.,Butler F. A.The companion to language assessment. Kunnan A. J., ed. Hoboken, NJ: Wiley-Blackwell; 2014:421-439.
16. Bailey A. L.,Huang B. H.Do current English language development/proficiency standards reflect the English needed for success in school?.Language Testing. 2011;28:343-365
17. Bailey A. L.,Kelly K. R.Home language survey practices in the initial identification of English learners in the United States.Educational Policy. 2013;27:770-804
18. BaileyA. L.WolfM. K. (2012). The challenge of assessing language proficiency aligned to the Common Core State Standards and some possible solutions (Understanding Language Initiative, commissioned paper). Stanford University, CA. Retrieved from http://ell.stanford.edu/publication/challenge-assessing-language-proficiency-aligned-common-core-state-standards-and-some
19. Bennett R. E.Cognitively based assessment of, for, and as learning (CBAL): A preliminary theory of action for summative and formative assessment.Measurement. 2010;8 (2–3): 70-91
20. Black P.,Wiliam D.Inside the black box: Raising standards through classroom assessment. London, England: Granada Learning Group; 1998:
21. Black P. J.,Wilson M.,Yao S.-Y.Road maps for learning: A guide to the navigation of learning progressions.Measurement. 2011;9 (2/3): 71-123
22. Boals T.,Kenyon D. M.,Blair A.,Cranley M. E.,Wilmes C.,Wright L. J.Transformation in K–12 English language proficiency assessment: Changing contexts, changing constructs.Review of Research in Education. 2015;39:122-164
23. Briggs D. C.,Ruiz-Primo M. A.,Furtak E.,Shepard L.,Yin Y.Meta-analytic methodology and inferences about the efficacy of formative assessment.Educational Measurement: Issues and Practice. 2012;31 (4): 13-17
24. Brown J. D.The companion to language assessment. Kunnan A.J., ed. Hoboken, NJ: Wiley-Blackwell; 2014:1182-1206.
25. CarrollP. E. (2012). Examining the validity of classifications from an English language proficiency assessment for English language learners and native English speakers in fifth grade (Master’s thesis). Available from ProQuest Dissertations and Theses database. (UMI No. 1516569)
26. Carroll P. E..Paper presented at the Northeastern Educational Research Association Annual Conference; 2014Trumbull, CT; 2014.
27. Carroll P. E.,Bailey A. L..Paper presented at the conference to honor Ronald Hambleton; 2012University of Massachusetts, Amherst; 2012.
28. Carroll P. E.,Bailey A.L..Paper presented at the annual meeting of the National Council on Measurement in Education; 2013aSan Francisco, CA; 2013a.
29. Carroll P. E.,Bailey A. L..Paper presented at the annual meeting of the American Educational Research Association; 2013bSan Francisco, CA; 2013b.
30. Castro-Olivo S. M.,Preciado J. A.,Sanford A. K.,Perry V.The academic and social-emotional needs of secondary Latino English learners: Implications for screening, identification, and instructional planning.Exceptionality. 2011;19:160-174
31. Framework for English language proficiency/development standards corresponding to the Common Core State Standards and the Next Generation Science Standards. Washington, DC: Author; 2012:
32. Chester M. D.Multiple measures and high-stakes decisions: A framework for combining measures.Educational Measurement: Issues in Practice. 2003;22 (2): 32-41
33. Clauser B. E.,Clyman S. G.,Margolis M. J.,Ross L. P.Are fully compensatory models appropriate for setting standards on performance assessments of clinical skills?.Academic Medicine. 1996;71:S90-S92
34. Coleman R.,Goldenberg C.What does research say about effective practices for English learners? Part IV: Models for schools and districts.Kappa Delta Pi Record. 2010;46:156-163
35. Common Core State Standards Initiative. (2010a). Common core state standards for English language arts & literacy in history/social studies, science, and technical subjects. Retrieved from http://www.corestandards.org/assets/CCSSI_ELA%20Standards.pdf
36. Common Core State Standards Initiative. (2010b). Common core state standards for mathematics. Retrieved from http://www.corestandards.org/assets/CCSSI_Math%20Standards.pdf
37. CookH. G.BoalsT.WilmesC.SantosM. (2008). Issues in the development of annual measurable achievement objectives for WIDA consortium states (WCER Working Paper No. 2008-2). Madison: University of Wisconsin-Madison, Wisconsin Center for Education Research. Retrieved from http://www.wcer.wisc.edu/publications/workingPapers/Working_Paper_No_2008_02.pdf
38. CookH. G.LinquantiR.ChinenM.JungH. (2012). National evaluation of Title III implementation supplemental report: Exploring approaches to setting English language proficiency performance criteria and monitoring English learner progress. Washington, DC: U.S. Department of Education, Office of Planning, Evaluation, and Policy Development, Policy and Program Studies Service. Retrieved from http://www.ed.gov/about/offices/list/opepd/ppss/index.html
39. Cook H. G.,MacDonald R.Reference performance level descriptors: Summary of a national working session on policies, practices, and tools for identifying potential English learners. Washington, DC: Council of Chief State School Officers; 2014:
40. Crane E. W.,Barrat V. X.,Huang M.The relationship between English proficiency and content knowledge for English language learner students in Grades 10 and 11 in Utah. Washington, DC: Regional Educational Laboratory West; 2011:
41. Davidson F.,Kim J. T.,Lee H.,Li J.,López A. A.The language demands of school: Putting academic English to the test. Bailey A. L., ed. New Haven, CT: Yale University Press; 2007:157-170.
42. Durán R. P.Assessing English-language learners’ achievement.Review of Research in Education. 2008;32:292-327
43. Durán R. P.Cultural validity in assessment: Addressing linguistic and cultural diversity. Basterra M. R.Trumbull E.Solano-Flores G., ed. New York, NY: Routledge; 2011:115-142.
44. Dutro S.Providing language instruction. Aiming high/Aspirando a lo Mejor resource. Santa Rosa, CA: Sonoma County Office of Education; 2006:
45. Elmore R. F.Redesigning accountability systems for education. Fuhrman S.Elmore R. F., ed. New York, NY: Teachers College Press; 2004:274-296.
46. EngageNY. (2013). NYS Bilingual Common Core Initiative: Theoretical foundations. Retrieved from https://www.engageny.org/resource/new-york-state-bilingual-common-core-initiative
47. Erickson F.Evidence in decision making: Yearbook of the National Society for the Study of Education. Moss P., ed. Malden, MA: Blackwell; 2007:186-216.
48. Estrada P.Expanding or eclipsing horizons for EL students: A cross-case analysis.Paper presented at the American Educational Research Association; 2010Denver, Colorado; 2010.
49. EstradaP. (2014). English learner curricular streams in four middle schools: Triage in the trenches. Urban Review. Retrieved from http://link.springer.com/article/10.1007/s11256-014-0276-7
50. Estrada P.,Wang H..Paper presented at the American Educational Research Association; 2013San Francisco, California; 2013.
51. Faulkner-BondM.WaringS.ForteE.CrenshawR. L.TindleK.BelkapB. (2012). Language instruction educational programs (LIEPs): A review of the foundational literature. Washington, DC: U.S. Department of Education; Office of Planning, Evaluation and Policy Development; Policy and Program Studies Service. Retrieved from http://www2.ed.gov/rschstat/eval/title-iii/language-instruction-ed-programs-report.pdf
52. Florez I. R.Examining the validity of the Arizona English Language Learners Assessment cut scores.Language Policy. 2012;11 (1): 33-45
53. ForteE.PerieM.PaekP. (2012). Exploring the relationship between English language proficiency and English language arts assessments. Retrieved from http://www.eveaproject.com/doc/EVEA%20ELPA%20ELA%20paper_03-5-12.pdf
54. Frantz R. S.,Bailey A. L.,Starr L.,Perea L.Measuring academic language proficiency in school-age English language proficiency assessments under New College and Career Readiness Standards in the U.S.Language Assessment Quarterly. in press;:
55. Gándara P.In the aftermath of the storm: English learners in the post-227 era.Bilingual Research Journal. 2000;24 (1&2): 1-13
56. GándaraP.RumbergerR.Maxwell-JollyJ.CallahanR. (2003, October7). English learners in California schools: Unequal resources, unequal outcomes. Education Policy Analysis Archives, 11(36). Retrieved from http://epaa.asu.edu/epaa/v11n36/
57. Gándara P.,Merino B.Measuring the outcome of LEP programs: Test scores, exit rates, and other mythological data.Educational Evaluation and Policy Analysis. 1993;15:320-338
58. GarciaE. E.LawtonK.DinizdeFigueiredoE. H. (2010). Assessment of young English language learners in Arizona: Questioning the validity of the state measure of English proficiency. Los Angeles: Civil Rights Project, University of California. Retrieved from http://civilrightsproject.ucla.edu/research
59. García G.,McKoon G.,August D.Developing literacy in second-language learners. August D.Shanahan T., ed. Mahwah, NJ: Lawrence Erlbaum; 2006:597-624.
60. García Bedolla L. G.,Rodriguez R.Classifying California’s English learners: Is the CELDT too blunt an instrument?. Berkeley: Center for Latino Policy Research, Institute for the Study of Societal Issues, UC Berkeley; 2011:
61. GoldenbergG.QuachS. R. (2010). The Arizona Home Language Survey and the identification of students For ELL services. Los Angeles: Civil Rights Project/Proyecto Derechos Civiles, UCLA. Retrieved from http://civilrightsproject.ucla.edu/research/k-12-education/language-minority-students/the-arizona-home-language-survey-and-the-identification-of-students-for-ell-services/AZ-PHLOTEGO8-17-10revision.pdf
62. Goodlad J. I.,Mantle-Bromley C.,Goodlad S. J.Education for everyone: Agenda for education in a democracy. Indianapolis, IN: Jossey-Bass; 2004:
63. GrissomJ. B. (2004, July30). Reclassification of English learners. Education Policy Analysis Archives, 12(36). Retrieved from http://epaa.asu.edu/ojs/article/view/191/317
64. Hakuta K.Educating language minority students and affirming their equal rights: Research and practical perspectives.Educational Researcher. 2011;40:163-174
65. Haladyna T. M.,Downing S. M.Construct-irrelevant variance in high-stakes testing.Educational Measurement: Issues and Practice. 2004;23 (1): 17-27
66. Hambleton R. K.,Jaeger R. M.,Plake B. S.,Mills C.Setting performance standards on complex educational assessments.Applied Psychological Measurement. 2000;24:355-366
67. Hambleton R. K.,Pitoniak M. J.Educational measurement. (2006). Setting performance standards. In BrennanR. (Ed.), Educational measurement (4th ed., pp. 433–470). Portsmouth, NH: Praeger.Brennan R., ed. Portsmouth, NH: Praeger; 2006:433-470.
68. Hein S. F.,Skaggs G. E.A qualitative investigation of panelists’ experiences of standard setting using two variations of the Bookmark method.Applied Measurement in Education. 2009;22:207-228
69. Heritage M.Formative assessment and next-generation assessment systems: Are we losing an opportunity?. Washington, DC: Council of Chief State School Officers; 2010:
70. Heritage M.,Heritage J..Paper presented at the annual meeting of the American Educational Research Association; 2011New Orleans, LA; 2011.
71. Heritage M.,Walqui A.,Linquanti R. T..Paper presented at the annual meeting of the American Educational Research Association; 2013San Francisco, CA; 2013.
72. Heubert J. P.Redesigning accountability systems for education. Fuhrman S. H.Elmore R. F., ed. New York, NY: Teachers College Press; 2004:220-242.
73. Hill L.,Weston M.,Hayes J.Reclassification of English-learner students in California. San Francisco: Public Policy Institute of California; 2014:
74. Hoff E.Interpreting the early language trajectories of children from low-SES and language minority homes: Implications for closing achievement gaps.Developmental Psychology. 2013;49:4-14
75. Hopkins M.,Thompson K. D.,Linquanti R.,Hakuta K.,August D.Fully accounting for English learner performance: A key issue in ESEA reauthorization.Educational Researcher. 2013;42:101-108
76. Kane M.Validating the interpretations and uses of test scores.Journal of Educational Measurement. 2013;50:1-73
77. Karatonis A.,Sireci S. G.The Bookmark standard-setting method: A literature review.Educational Measurement: Issues and Practice. 2006;25 (1): 4-12
78. Kenyon D. M.,MacGregor D.,Li D.,Cook H. G.Issues in vertical scaling of a K-12 English language proficiency test.Language Testing. 2011;28:383-400
79. Kieffer M. J.,Lesaux N. K.,Rivera M.,Francis D. J.Accommodations for English language learners taking large-scale assessments: A meta-analysis of effectiveness and validity.Review of Educational Research. 2009;79:1168-1201
80. Kieffer M. J.,Rivera M.,Francis D. J.Practical guidelines for the education of English language learners: Book 4. Research-based recommendations for the use of accommodations in large-scale assessments: 2012 Update. Portsmouth, NH: Center on Instruction; 2012:
81. Kim J.Relationships among and between ELL status, demographic characteristics, enrollment history, and school persistence. Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing; 2011:
82. Kim J.,Herman J. L.When to exit ELL students: monitoring success and failure in mainstream classrooms after ELLs’ reclassification. Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing; 2010:
83. Kindler A.Survey of the states’ limited English proficient students and available educational programs and services: 2000-2001 Summary report. Washington, DC: National Clearinghouse for English Language Acquisition; 2002:
84. Kopriva R.,Albers C. A.Handbook of testing and assessment in psychology. Geisinger K. F., ed. Washington, DC: American Psychological Association; 2013:370-390.
85. Kopriva R.,Gabel D.,Cameron C.Designing dynamic and interactive assessments for English learners that directly measure targeted science constructs. Evanston, IL: Society for Research on Educational Effectiveness; 2011:
86. Lane S.,Leventhal B.Psychometric challenges in assessing English language learners and students with disabilites.Review of Research in Education. 2015;39:165-214
87. Linquanti R.,Bailey A. L.Reprising the Home Language Survey: Summary of a national working session on policies, practices, and tools for identifying potential English learners. Washington, DC: Council of Chief State School Officers; 2014:
88. Linquanti R.,Cook H. G.Toward a “common definition of English learner”: Guidance for states and state assessment consortia in defining and addressing policy and technical issues and options. Washington, DC: Council of Chief State School Officers; 2013:
89. LinquantiR.HakutaK. (2012). How next-generation standards and assessments can foster success for California’s English learners (PACE Policy Brief No. 12-1). Stanford, CA: School of Education, Stanford University. Retrieved from http://www.edpolicyinca.org
90. Llosa L.Building and supporting a validity argument for a standards-based classroom assessment of English proficiency based on teacher judgments.Educational Measurement: Issues and Practice. 2008;27 (3): 32-42
91. Mahoney K. S.,Haladyna T.,MacSwan J.The education of language minority immigrants in the United States. Wiley T. G.Lee J. S.Rumberger R. W., ed. Tonawanda, NY: Multilingual Matters; 2009:240-262.
92. Martiniello M.Linguistic complexity, schematic representations, and differential item functioning for English language learners in math tests.Educational Assessment. 2009;14:160-179
93. Mayer J.The language demands of school: Putting academic language to the test. Bailey A. L., ed. New Haven, CT: Yale University Press; 2007:
94. McMillan J. H.Handbook of formative assessment. Andrade H. L.Cizek G. J., ed. 2010:41-58.
95. Menken K.English learners left behind: Standardized testing as language policy. Cleveden, England: Multilingual Matters; 2008:
96. Miller J. F.,Heilmann J.,Nockerts A.,Iglesias A.,Fabiano L.,Francis D. J.Oral language and reading in bilingual children.Learning Disabilities Research & Practice. 2006;21:30-43
97. Mitzel H. C.,Lewis D. M.,Patz R. J.,Green D. R.Setting performance standards: Concepts, methods, and perspectives. Cizek G. J., ed. Mahwah, NJ: Lawrence Erlbaum; 2001:249-281.
98. Mosier C. I.On the reliability of a weighted composite.Psychometrika. 1943;8:161-168
99. National Education Association. (2011). Preparing 21st century students for a global society: An educator’s guide to the “four Cs.” Retrieved from http://www.nea.org/assets/docs/A-Guide-to-Four-Cs.pdf
100. Allocating federal funds for state programs for English language learners. Washington, DC: National Academies Press; 2011:
101. Next Generation Science Standards. For states, by states. Washington, DC: National Academies Press; 2013:
102. Conference report to accompany H.R., 1, Rep. No. 107-334, House of Representatives, 107th Congress; ;.
103. Olsen L.Reparable harm: Fulfilling the unkept promise of educational opportunity for long term English Learners. Long Beach: Californians Together; 2010:
104. Palermo F.,Mikulski A. M.,Fabes R. A.,Hanish L. D.,Martin C. L.,Stargel L. E.English exposure in the home and classroom: Predictions to Spanish-speaking preschoolers’ English vocabulary skills.Applied Psycholinguistics. 2013;35:1163-1187
105. Parrish T. B.,Merickel A.,Perez M.,Linquanti R.,Socias M.,Spain A.,.. Delancey D.Effects of the implementation of Proposition 227 on the education of English learners, K-12: Findings from a five-year evaluation. Palo Alto, CA: American Institutes for Research and WestEd; 2006:
106. Perie M.,Forte E.Assessing students in the margins: Challenges, strategies, and techniques. Russell M., ed. Charlotte, NC: Information Age; 2011:335-378.
107. Porter S. G.,Vega J.English language proficiency assessment in the nation: Current status and future practice. Abedi J., ed. Davis: UC Davis School of Education; 2007:93-104.
108. RaganA.LesauxN. (2006). Federal, state, and district level English language learner program entry and exit requirements: Effects on the education of language minority learners. Education Policy Analysis Archives, 14, 1–29. Retrieved from http://epaa.asu.edu/ojs/article/view/91
109. Robinson J. P.Evaluating criteria for English learner reclassification: A causal-effects approach using a binding-score regression discontinuity design with instrumental variables.Educational Evaluation and Policy Analysis. 2011;33:267-292
110. Sireci S. G.,Faulkner-Bond M.Promoting validity in the assessment of English learners.Review of Research in Education. 2015;39:215-252
111. SireciS. G.LiS.ScarpatiS. (2003). The effects of test accommodation on test performance: A review of the literature (Center for Educational Assessment Research Report No. 485). Retrieved from http://www.cehd.umn.edu/nceo/onlinepubs/testaccommlitreview.pdf
112. Slama R. B.A longitudinal analysis of academic English proficiency outcomes for adolescent English language learners in the United States.Journal of Educational Psychology. 2012;104:265-285
113. Slama R. B.Investigating whether and when English learners are reclassified into mainstream classrooms in the United States A discrete-time survival analysis.American Educational Research Journal. 2014;51:220-252
114. Snow C. E.,Uccelli P.The Cambridge handbook of literacy. Olson D. R.Torrance N., ed. New York, NY: Cambridge University Press; 2009:112-133.
115. Solano-Flores G.Cultural validity in assessment: Addressing linguistic and cultural diversity. Basterra M. R.Trumbull E.Solano-Flores E.& G., ed. New York, NY: Routledge; 2011:3-21.
116. Stokes-Guinan K.,Goldenberg C.Use with caution: What CELDT results can and cannot tell us.CATESOL Journal. 2010;22:189-202
117. Sztajn P.,Confrey J.,Wilson P. H.,Edgington C.Learning trajectory based instruction: Toward a theory of teaching.Educational Researcher. 2012;41:147-156
118. Thurlow M. L.,Kopriva R. J.Advancing accessibility and accommodations in content assessments for students with disabilities and English learners.Review of Research in Education. 2015;39:331-369
119. Torrance H.,Pryor J.Investigating formative assessment. Philadelphia: Open University Press; 1998:
120. Valdés G.,Figueroa R. A.Bilingualism and testing: A special case of bias. Norwood, NJ: Ablex; 1995:
121. van Lier L.,Walqui A.Understanding language: Commissioned papers on language and literacy issues in the Common Core State Standards and Next Generation Science Standards. Hakuta K.Santos M., ed. Palo Alto, CA: Stanford University; 2012:44-51.
122. WangJ.NiemiD.WangH. (2007). Impact of different performance assessment cut scores on student promotion (CSE Report No. 719). Retrieved from http://files.eric.ed.gov/fulltext/ED498443.pdf
123. English language proficiency standards for English language learners in pre-kindergarten through Grade 12. Madison: Board of Regents of the University of Wisconsin System; 2004:
124. English language proficiency standards for English language learners in pre-kindergarten through Grade 12. Madison: Board of Regents of the University of Wisconsin System; 2007:
125. MODEL-K. Madison, WI: Board of Regents of the University of Wisconsin System; 2011:
126. WIDA Consortium. (2012). Amplification of the English Language Development Standards. Madison: Board of Regents of the University of Wisconsin System. Retrieved from http://www.wida.us/standards/eld.aspx
127. Winke P.Evaluating the validity of a high-stakes ESL test: Why teachers’ perceptions matter.TESOL Quarterly. 2011;45:628-660
128. WiseL. L. (2011). Combining multiple indicators (Paper for the PARCC technical advisory group). Retrieved from http://www.parcconline.org/sites/parcc/files/PARCCTACPaper-CombiningMultipleIndicatorsRevised09-06-2011.pdf
129. Wolf M. K.,Kao J.,Griffin N.,Herman J. L.,Bachman P. L.,Chang S.,Farnsworth T.Issues in assessing English language learners: English language proficiency measures and accommodation uses—Practice review. Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing; 2008:
130. Young J. W.,Cho Y.,Ling G.,Cline F.,Steinberg J.,Stone E.Validity and fairness of state standards-based assessments for English language learners.Educational Assessment. 2008;13:170-192
131. Young J. W.,Steinberg J.,Cline F.,Stone E.,Martiniello M.,Ling G.,Cho Y.Examining the validity of standards-based assessments for initially fluent students and former English language learners.Educational Assessment. 2010;15:87-106
132. Zhang B.Assessing the accuracy and consistency of language proficiency classification under competing measurement models.Language Testing. 2010;27:119-140