THE CBAL READING ASSESSMENT: AN APPROACH FOR BALANCING MEASUREMENT AND LEARNING GOALS

ETS Research Report Series

Volumn 2011, Issue 1, 2011, Pages i-26

  Sheehan, Kathleen M ^a   O'Reilly, Tenaha ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

21st century skills; NCLB; reading comprehension; scenario based assessments

Indexed keywords

EID: 85164515704     PISSN: None     EISSN: 23308516     Source Type: Journal    
DOI: 10.1002/j.2333-8504.2011.tb02257.x     Document Type: Article

References (43)

1. Bennett, R. E., & Gitomer, D. H. (2009). Transforming K-12 assessment. In C. Wyatt-Smith & J. Cumming (Eds.), Educational assessment in the 21st century. New York, NY: Springer.
2. Bransford, J., Brown, A., & Cocking, R. (Eds.). (1999). How people learn: Brain, mind, experience, and school. Washington, DC: National Academies Press.
3. Chall, Jeanne, S. (1967). Stages of reading development. New York, NY: McGraw-Hill.
4. Committee on Prospering in the Global Economy of the 21st Century. (2007). Rising above the gathering storm: Energizing and employing America for a brighter economic future. Washington, DC: National Academies Press.
5. Embretson, S. E. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179–197.
6. Embretson, S. E., & Wetzel, C. D. (1987). Component latent trait models for paragraph comprehension tests. Applied Psychological Measurement, 11, 175–193.
7. Goldman, S. R. (2004). Cognitive aspects of constructing meaning through and across multiple texts. In N. Shuart-Ferris & D.M. Bloome (Eds.), Uses of intertextuality in classroom and educational research. (pp. 317–351). Greenwich, CT: Information Age Publishing.
8. Gorin, J. S., & Embretson, S. E. (2006). Item difficulty modeling of paragraph comprehension items. Applied Psychological Measurement, 30(5), 394–411.
9. Graesser, A. C., Wiley, J., Goldman, S., O'Reilly, T., Jeon, M., & McDaniel, B. (2007). SEEK web tutor: fostering a critical stance while exploring the causes of volcanic eruption. Metacognition and Learning, 2, 89–105.
10. Haertel, E. H., & Herman, J. L. (2005). A historical perspective on validity arguments for accountability testing. In J. L. Herman & E. H. Haertel (Eds.), Uses and misuses of data for educational accountability and improvement. The 104th yearbook of the National Society for the Study of Education (Part 2, pp. 1–34). Malden, MA: Blackwell.
11. Kintsch, W. (1998). Comprehension: A paradigm for cognition. Cambridge, UK: Cambridge University Press.
12. Kirsch, I., Braun, H., Yamamoto, K., & Sum, A. (2007). America's perfect storm: Three forces changing our nation's future. Princeton, NJ: ETS.
13. Leacock, C., & Chodorow, M. (2003). C-rater: Automated scoring of short-answer questions, Computers and the Humanities 37(4).
14. MacGinitie, W. H., MacGinitie, R. K., Maria, K., & Dreyer, L. G. (2000). Gates-MacGinitie Reading Tests, 4th Edition, Forms S and T. Itasca, IL: Riverside Publishing Company.
15. McNamara, D. S. (2004). SERT: Self explanation reading training. Discourse Processes, 38, 1–30.
16. McNamara, D. S., O'Reilly, T., Best, R., & Ozuru, Y. (2006). Improving adolescent students' reading comprehension with iSTART. Journal of Educational Computing Research. 34, 147–171.
17. McNamara, D. S., Ozuru, Y., Best, R., & O'Reilly, T. (2007). A reading strategies framework. In D. S. McNamara (Ed.), pp 465–496. Reading comprehension strategies: theory, interventions, and technologies. Mahwah, NJ: Erlbaum.
18. National Center on Education and the Economy. (2006). Tough times, tough choices: The report of the New Commission on the Skills of the American Workforce. Washington, DC: Government Printing Office.
19. O'Reilly, T. & Sheehan, K. M. (2008, July). Cognitively based assessment of, for, and as learning: a 21st century approach for assessing reading competency. Proceedings of the 30th Annual Meeting of the Cognitive Science Society, Washington, DC.
20. Ozuru, Y., Rowe, M., O'Reilly, T., & McNamara, D. S. (2008). Where's the difficulty in standardized reading tests: The passage or the question? Behavior Research Methods, 40, 1001–1015.
21. Paris, S. G., Carpenter, R. D., Paris, A. H., & Hamilton, E. E. (2005). In S. G. Paris & S. A. Stahl (Eds.), Children's reading comprehension and assessment. Mahwah, NJ: Lawrence Erlbaum Associates.
22. Partnership for 21st Century Skills, (2004). Learning for the 21st century: a report and mile guide for 21st century skills. Washington: Author. Retrieved from http://www.21stcenturyskills.org/images/stories/otherdocs/p21up_Report.pdf.
23. Pashler, H., Bain, P., Bottge, B., Graesser, A., Koedinger, K., McDaniel, M., & Metcalfe, J. (2007). Organizing instruction and study to improve student learning (NCER 2007–2004). Washington, DC: National Center for Education Research, Institute of Education Sciences, U.S. Department of Education. Retrieved from http://ncer.ed.gov.
24. Pellegrino, J., Chudowsky, J. N., & Glaser, R., (Eds.) (2001). Knowing what students know. The science and design of educational assessment. Washington, DC: National Academy Press.
25. Perfetti, C. A. (1985). Reading Ability. New York, NY: Oxford University Press.
26. Popham, W. J. (2008). Transformative assessment. Alexandria, VA: Association for Supervision and Curriculum Development.
27. Sabatini, J., Sheehan, K., O'Reilly, T., Bruce, K. (2007, June). Developing reading comprehension assessments targeting struggling readers: An overview and some findings so far. Poster presented at the Institute of Education Sciences 2007 Research Conference, Washington, DC.
28. Schmidt, W. H., McKnight, C. C., & Raizen, S.A. (1997). A spirited vision: An investigation of U.S. science and mathematics education. Dordrecht, the Netherlands: Kluwer.
29. Sheehan, K. M. (1997). A tree-based approach to proficiency scaling and diagnostic assessment. Journal of Educational Measurement, 34, 333–352.
30. Sheehan, K. M., & Ginther, A. (2001). Understanding performance on the current TOEFL reading section. Paper presented at the National Reading Conference, Orlando, FL.
31. Sheehan, K. M., Kostin, I & Futagi, Y., (2008a, July). Reading level assessment for high-stakes testing applications: A second look at variation due to differences in text genre. Paper presented at the Annual Meeting of the Society for Text and Discourse, Memphis, TN.
32. Sheehan, K.M., Kostin, I., & Futagi, Y. (2008b, July). When do standard approaches for measuring vocabulary difficulty, syntactic complexity and referential cohesion yield biased estimates of text difficulty? Poster presented at the 30th Annual Meeting of the Cognitive Science Society, Washington, DC.
33. Sheehan, K. M., Kostin, I., & Persky, H. (2006, April). Predicting item difficulty as a function of inferential processing requirements: An examination of the reading skills underlying performance on the NAEP Grade 8 reading assessment. Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Francisco, CA.
34. Sheehan, K. M., & Mislevy, R. J. (1990). Integrating cognitive and psychometric models to measure document literacy. Journal of Educational Measurement, 27, 1–18.
35. Sheehan, K. M. & O'Reilly, T. (2008, March). A cognitively based assessment system for reading comprehension competency. Paper presented at the American Educational Research Association Annual Meetings, New York, NY.
36. Snedecor, G. W., & Cochran, W. G. (1973). Statistical methods. Ames, IA: The Iowa State University Press.
37. Snow, C. (2002). Reading for understanding: Toward an R&D program in reading comprehension. Santa Monica, CA: RAND.
38. Tatsuoka, K. K. (1990). Toward an integration of item-response theory and cognitive error diagnosis. In N. Fredericksen, R. Glaser, A. Lesgold, & Shafto, M. G. (Eds.), Diagnostic monitoring of skill and knowledge acquisition. Hillsdale, NJ: Erlbaum.
39. Tatsuoka, K. K. (1983). Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345–354.
40. Tatsuoka, K. K., Birenbaum, M., Lewis, C., & Sheehan, K. (1993). Proficiency scaling based on conditional probability functions for attributes (ETS Research Report No. RR-93-50-ONR). Princeton, NJ: ETS.
41. Torgesen, J. K., Wagner, R. K., & Rashotte, C. A. (1999). Tests of word reading efficiency (TOWRE). Austin, TX: Pro-Ed.
42. Vellutino, F., Tunmer, W., & Jaccard, J. (2007). Components of reading ability: Multivariate evidence for a convergent skills model of reading development.; Scientific Studies of Reading, 11(1), 3–32.
43. Zechner, K., Sabatini, J., & Chen, L. (2009, June). Automatic scoring of children's read-aloud text passages and word lists. Proceedings of the Fourth International Workshop on Using Natural Language Processing Technologies for Building Educational Applications, Conference of the North American Chapter of the Association for Computational Linguistics and Human Language Technologies (HLT-NAACL-2009), Boulder, CO.