Meeting expectations? An empirical investigation of a standards-based assessment of reading comprehension

Educational Evaluation and Policy Analysis

Volumn 28, Issue 4, 2006, Pages 315-333

  Rupp, André A ^a   Lesaux, Nonie K ^b  

^a HUMBOLDT UNIVERSITY   (Germany)

^b HARVARD GRADUATE SCHOOL OF EDUCATION   (United States)

Author keywords

Accountability; Psychometrics; Reading; Standards based assessment

Indexed keywords

EID: 33846150311     PISSN: 01623737     EISSN: None     Source Type: Journal    
DOI: 10.3102/01623737028004315     Document Type: Article

References (56)

1. Adams, M. J. (1990). Beginning to read: Thinking and learning about print. Cambridge, MA: MIT Press.
2. Abrams, L. M. & Madaus, G. F. (2003). The lessons of high-stakes testing. Education Leadership, 61, 31-35.
3. Allen, N. L., Donoghue, J. R., & Schoeps, T. L. (2001). The NAEP 1998 technical report. Washington, DC: U.S. Department of Education, Office of Educational Research and Improvement. Retrieved June 1, 2006, from http://nces.ed.gov/nationsreportcard/pdf/main1998/2001509.pdf
4. Amrein, A. L. & Berliner, D. C. (2002, March 28). High-stakes testing, uncertainty, and student learning. Education Policy Analysis Archives, 10(18). Retrieved July 17, 2006, from http://epaa.asu.edu/epaa/ v10n18/
5. Baddeley, A. D. (1986). Working memory. New York: Oxford University Press.
6. Baddeley, A. D. (1992). Working memory. Science, 255, 556-559.
7. Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) The concept of validity. Psychological Review, 111(4), 1061-1071.
8. Buly, M. R., & Valencia, S. W. (2002). Below the bar: Profiles of students who fail state assessments. Educational Evaluation and Policy Analysis, 24(3), 219-239.
9. Cain, K. & Oakhill, J. (1998). Comprehension skill and inference-making ability: Issues and causality. In C. Hulme and R. M. Joshi (Eds.), Reading and Spelling: Development and Disorders. London: Erlbaum.
10. Cain, K., & Oakhill, J. (2000). Inference making ability and its relation to comprehension failure in young children. Reading and Writing: An Interdisciplinary Journal, 11, 489-503.
11. Cain, K., Oakhill, J., & Bryant, P. (2000). Investigating the causes of reading comprehension failure: The comprehension-age match design. Reading and Writing: An Interdisciplinary Journal, 12, 31-40.
12. Cizek, G. J., Bunch, M. B., & Koons, H. (2004). Setting performance standards: Contemporary methods. Educational Measurement: Issues and Practice, 25, 31-50.
13. Cizek, G. J., Hirsch, T., Trent, R., & Crandell, J. (2002). A preliminary investigation of pupil proficiency testing and state education reform initiatives. Educational Assessment, 7(4), 283-302.
14. Fuhrman, S. H. Riding waves, trading horses: The twenty-year effort to reform education. In D. T. Gordon (Ed), A Nation Reformed? American education 20 years after A Nation at Risk. (pp. 7-22). Cambridge, MA: Harvard Education Press.
15. Goldman, R., Fristoe, M., & Woodcock, R. (1974). Goldman-fristoe- woodcock auditory skills test battery. Circle Pines, MN: American Guidance Service.
16. Graham, P. A. (2005). Schooling America: How the public schools meet the nation's changing needs. New York: Oxford University Press.
17. Gottardo, A., Stanovich, K. E., & Siegel, L. S. (1996). The relationships between phonological sensitivity, syntactic processing, and verbal working memory in the reading performance of third-grade children. Journal of Experimental Child Psychology, 63, 563-582.
18. Heubert, J. P. & Hauser, R. M. (Eds.). (1999). High stakes testing for tracking, promotion, and graduation. Washington, DC: National Academy Press.
19. Invernizzi, M. A., Landrum, T. J., Howell, J. L., & Warley, H. P. (2005). Toward the peaceful coexistence of test developers, policymakers, and teachers in an era of accountability. The Reading Teacher, 58(7), 610-618.
20. Karlsen, B. & Gardner, E. (1994). Stanford diagnostic reading test. San Francisco: Harcourt Brace.
21. Kintsch, W. (1998). Comprehension: A paradigm for cognition. New York: Cambridge University Press.
22. Lesaux, N. K., & Siegel, L. S. (2003). The development of reading in children who speak English as a second language. Developmental Psychology, 39(6), 1005-1019.
23. Linn, R. L. (2001). A century of standardized testing: Controversies and pendulum swings. Educational Assessment, 7(1), 29-38.
24. Madaus, G. F. (1988). The influence of testing on the curriculum. In L. N. Tanner (Ed.), Eighty-seventh yearbook of the National Society for the Study of Education: Part 1. Critical issues in curriculum (pp. 83-121). Chicago: University of Chicago Press.
25. Messick, S. (1989). Validity. In R. Linn (Ed.), Educational Measurement (pp. 13-103). New York: Macmillan.
26. Messick, S. (1995). Validity of psychological assessment. Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741-749.
27. Mullis, I. V. S., Kennedy, A. M., Martin, M. O., & Sainsbury, M. (2006). PIRLS 2006 assessment framework and specifications. Chestnut Hill, MA: TIMSS & PIRLS International Study Center. Retrieved June 1, 2006, from http://pirls.bc.edu/PDF/P06Framework.pdf
28. Muter, V., Hulme, C., & Snowling, M. (1997). The phonological abilities test. London: Psychological Corporation.
29. Muthén, L. K., & Muthén, B. O. (2002). Mplus user's guide (2nd ed.). Los Angeles: Muthén & Muthén.
30. National Council on Education Standards and Testing. (1992). Raising standards for American education. Washington, DC: U.S. Government Printing Office.
31. National Institute of Child Health and Human Development. (2000). Report of the National Reading Panel. Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction (NIH Publication No. 00-4769). Washington, DC: U.S. Government Printing Office.
32. National Research Council. (2003). Assessment in support of instruction and learning:Bridging the gap between large-scale and classroom assessment. Washington, DC: National Academies Press.
33. No Child Left Behind Act of 2001, Pub. L. No. 107-110, §115 Stat. 1425 (2002). Retrieved September 4, 2005, from http://frwebgate.access.gpo.gov/ cgi-bin/getpage.cgi
34. Nold, G., & Rossa, H. (2006). Leseverstehen [Reading comprehension]. In E. Klieme & B. Beck (Eds.), Sprachliche Kompetenzen-Konzepte und Messung DESI Studie [Linguistic competencies-constructs and their measurement in the DESI study] (pp. 205-222). Weinheim: Beltz.
35. Organisation for Economic Co-operation and Development (OECD). (2005). PISA 2003 technical report. Retrieved June 1, 2006, from www.pisa.oecd.org
36. Pellegrino, J. W. (2001). Knowing what students know. Retrieved September 4, 2005, from www.nap.edu/issues/19.2/pellegrino.htm
37. Perfetti, C. A. (1985). Reading ability. London: Oxford University Press.
38. Price, J., & Koretz, D. (2005). Building assessment literacy. In K. Boudett, E. City, and R. Murnane (Eds.). Data wise: A step-by-step guide to using assessment results to improve teaching and learning. Cambridge, MA: Harvard Education Press.
39. RAND Reading Study Group. (2002). Reading for understanding: Toward a research and development program in reading comprehension. Santa Monica, CA: RAND Corporation.
40. Rosner, J. & Simon, D. (1971). The auditory analysis test: An initial report. Journal of Learning Disabilities, 4, 384-392.
41. Schwartz, R. B., & Smith, M. S. (2002). Staying the course with standards-based reform: What will it take. In Miles to go...: Reflections on mid-course corrections for standards-based reform (pp. 17-30). Bethesda, MD: The Education Week Press.
42. Seigneuric, A., Ehrlich, M.-R, Oakhill, J. V., & Yuill, N. M. (2000). Working memory resources and children's reading comprehension. Reading and Writing, 13, 81-103.
43. Shankweiler, D. (1989). How problems of comprehension are related to difficulties decoding. In D. Shankweiler & I. Y. Liberman (Eds.), Phonology and reading disabilities: Solving the reading puzzle (pp. 35-68). Ann Arbor: University of Michigan Press.
44. Shepard, L. A. (2002). The hazards of high-stakes testing. Issues in Science and Technology Online. Retrieved September 4, 2005, from http://www.issues.org/19.2/shepard.htm
45. Siegel, L. S., & Ryan, E. B. (1989). The development of working memory in normally achieving and subtypes of learning disabled children. Child Development, 60, 973-980.
46. Snow, C. E., Burns, M. S., & Griffin, P. (Eds.). (1998). Preventing reading difficulties in young children. Washington, DC: National Academies Press.
47. Swanson, H. L., & Saez, L. (2003). Memory difficulties in children and adults with learning disabilities. In H. L. Swanson, K. R. Harris, & S. Graham (Eds), Handbook of learning disabilities (pp. 182-198). New York: Guilford Press.
48. Sweet, A., & Snow, C. E. (Eds.). (2003). Rethinking reading comprehension. New York: Guilford Press.
49. Thorndike, R. L., Hagen, E. P., & Sattler, J. M. (1986). Technical manual: Stanford Binet intelligence scale: 4th edition. Chicago: Riverside.
50. Tunmer, W. E., & Hoover, W. A. (1993). Phonological receding skill and beginning reading. Read ing and Writing: An Interdisciplinary Journal, 5, 161-179.
51. Underwood, G., & Batt, V. (1996). Reading and understanding: An introduction to the psychology of reading. Cambridge, MA: Blackwell.
52. van Prooijen, J.-W., & van der Kloot, W. A. (2001). Confirmatory analysis of exploratively obtained factor structures. Educational and Psychological Measurement, 61, 777-792.
53. Willows, D. M. & Ryan, E. B. (1986). The development of grammatical sensitivity and its relation to early reading achievement. Reading Research Quarterly, 21, 253-266.
54. Wilkinson, G. S. (1993). The Wide Range Achievement Test - 3. Wilmington, DE: Jastak Associates.
55. Woodcock, R. W. (1987). Woodcock reading mastery tests - revised. Circle Pines, MN: American Guidance Service.
56. Yuill, N., & Oakhill, J. (1991). Children's problems in text comprehension: An experimental investigation. Cambridge, MA: Cambridge University Press.