Issues in vertical scaling of a K-12 English language proficiency test

Language Testing

Volumn 28, Issue 3, 2011, Pages 383-400

  Kenyon, Dorry M ^a   MacGregor, David ^a   Li, Dongyang ^a   Cook, H Gary ^b  

^a CENTER FOR APPLIED LINGUISTICS   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

English language proficiency tests; test development; test linking; vertical scaling

Indexed keywords

EID: 79960751463     PISSN: 02655322     EISSN: 14770946     Source Type: Journal    
DOI: 10.1177/0265532211404190     Document Type: Review

References (28)

1. Brogan, E.D., & Yen, W.M. (1983). Detecting multi-dimensionality and examining its effects on vertical equating with the Three-Parameter Logistic Model. Paper presented at the Annual Meeting of the American Educational Research Association, Montreal.
2. Collier, V. (1995). Acquiring a second language for school. Directions in Language & Education, 1(4). Retrieved May 19, 2008, from www.ncela.gwu.edu/pubs/directions/04.htm.
3. Cook, H.G. (2009a). WIDA Focus on Growth. WIDA Focus on Series, vol 1: 1. Retrieved May 19, 2008, from www.wida.us/ACCESSTraining/Focus/on_Growth.pdf.
4. Cook, H.G. (2009b). Annual Measurable Achievement Objective # 2 (AMAO 2): A Report on a Meeting Comparing the Kentucky Core Content Test (KCCT) and ACCESS for ELLs™ to Establish an AMAO 2 Exit Criterion. Kentucky Department of Education.
5. Cook, H.G., Boals, T., Wilmes, C., & Santos, M. (2008). Issues in the development of annual measurable achievement objectives for WIDA consortium states (WCER Working Paper No. 2008-2). Madison, WI: University of Wisconsin-Madison, Wisconsin Center for Education Research. Retrieved May 19, 2008 from www.wcer.wisc.edu/publications/workingPapers/papers.php.
6. Custer, M., Omar, M.H., & Pomplun, M. (2006). Vertical scaling with the Rasch model utilizing default and tight convergence settings with WINSTEPS and BILOG-MG. Applied Measurement in Education, 19, 133-149.
7. Gottlieb, M. (2004). English language proficiency standards for English language learners in kindergarten through Grade 12: Framework for large-scale state and classroom assessment. Madison, WI: WIDA Consortium.
8. Gottlieb, M., Cranley, M.E., & Oliver, A. (2007). Understanding the WIDA English language proficiency standards: A resource guide. Madison, WI: WIDA Consortium.
9. Guskey, T.R. (1981). Comparison of a Rasch model scale and the grade equivalent scale for vertical equating of test scores. Applied Psychological Measurement, 5(2), 187-201.
10. Hanson, B.A. & Beguin, A.A. (2002). Obtaining a common scale for IRT item parameters using separate versus concurrent estimation in the common-item equating design. Applied Psychological Measurement, 26(1), 3-24.
11. Hendrickson, A.B., Cao, Y., Chae, S., & Li, D. (2006). Effect of Base Year on IRT Vertical Scaling from the Common-Item Design. Paper presented at the Annual Meeting of the National Council for Measurement in Education, San Francisco, CA.
12. Holmes, S.E. (1982). Unidimensionality and vertical equating with the Rasch model. Journal of Educational Measurement, 19(2), 139-147.
13. Hyltenstam, K., & Abrahamsson, N. (2003). Maturational constraints in SLA. In C. J. Doughty & M. H. Long (Eds.), The handbook of second language acquisition (pp. 539-588). Malden, MA: Blackwell.
14. Kenyon, D.M. (2006). Development and Field Test of ACCESS for ELLs® (WIDA Consortium Technical Report No. 1). Retrieved June 23, 2009, from www.wida.us/assessment/ACCESS/TechReports/Technical%20Report%201.pdf.
15. Kim, S.-H., & Cohen, A.S. (2002). A comparison of linking and concurrent calibration under the graded response model. Applied Psychological Measurement, 26(1), 25-41.
16. Kolen, M.J., & Brennan, R.L. (2004). Test equating: Methods and Practices (2nd ed.). New York: Springer-Verlag.
17. Linacre, J.M. (2002). What do Infit and Outfit, Mean-square and Standardized mean? Rasch Measurement Transactions, 16(2), www.rasch.org/rmt/rmt162f.htm.
18. Linacre, J.M. (2006). Winsteps Rasch measurement. [Computer Software]. Chicago, IL: Winsteps.
19. Long, M.H. (2003). Stabilization and fossilization in interlanguage. In C. J. Doughty & M. H. Long (Eds.), The handbook of second language acquisition (pp. 487-535). Malden, MA: Blackwell.
20. Loyd, B.H., & Hoover, H.D. (1980). Vertical equating using the Rasch Model. Journal of Educational Measurement, 17, 179-193.
21. Loyd, B.H., & Plake, B.S. (1987). Vertical equating: Effects of model, method, and content domain. Paper presented at the Annual Meeting of American Educational Research Association, Washington, DC.
22. No Child Left Behind Act of 2001. Public Law No. 107-110, § 115 Stat. 1425 (2002).
23. O'Brien, M.L., & John, D. (1984). Applying and evaluating Rasch vertical equating procedures for out-of-level testing. Paper presented at the Annual Meeting of the Eastern Educational Research Association, West Palm Beach.
24. Patience, W.M. (1981). A Comparison of latent trait and equipercentile methods of vertically equating tests. Paper presented at the Annual Meeting of the National Council on Measurement in Education, Los Angeles.
25. Raju, N.S., Edwards, J.E., & Osberg, D.W. (1983). The effect of anchor test size in vertical equating with the Rasch and three-parameter models. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal.
26. Swender, E. (1999). ACTFL OPI Tester Training Manual - Revised 1999. New York: ACTFL Publication.
27. Way, W.D., Twing, J.S., & Ansley, T.N. (1988). A comparison of vertical scalings with the three-parameter model using logist and bilog and two different calibration procedures. Paper presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans.
28. Young, M.J. (2006). Vertical scales. In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development (pp. 469-485). Mahwah, NJ: Lawrence Erlbaum.