Oral reading fluency assessment: Issues of construct, criterion, and consequential validity

Reading Research Quarterly

Volumn 45, Issue 3, 2010, Pages 270-291

  Valencia, Sheila W ^a   Smith, Antony T ^b   Reece, Anne M ^a   Li, Min ^a   Wixson, Karen K ^c   Newman, Heather ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

^b UNIVERSITY OF WASHINGTON BOTHELL   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Article; Assessment; Childhood; Early adolescence; Fluency; Policy

Indexed keywords

EID: 77954362585     PISSN: 00340553     EISSN: None     Source Type: Journal    
DOI: 10.1598/RRQ.45.3.1     Document Type: Article

References (82)

1. AIMSweb Progress Monitoring and RTI System. (n.d.). Retrieved December 10, 2009, from www.aimsweb.com/measures-2/reading-cbm
2. Arbuckle, J.L. (1997). AMOS users guide version 3.6. Chicago: SPSS.
3. Arbuckle, J.L., & Wothke, W. (1995). AMOS 4.0 users guide. Chicago: SmallWaters.
4. Armbruster, B.B., Lehr, F., & Osborn, J. (2001). Put reading first: The research building blocks for teaching children to read. Jessup, MD: National Institute for Literacy.
5. Chall, J.S. (1996). Stages of reading development (2nd ed.). Fort Worth, TX: Harcourt.
6. Cramer, K., & Rosenfield, S. (2008). Effect of challenge on reading performance. Reading & Writing Quarterly, 24 (1), 119137. doi:10.1080/10573560701501586
7. Crawford, L., Tindal, G.A., & Stieber, S. (2001). Using oral reading rate to predict student performance on statewide achievement tests. Educational Assessment, 7 (4), 303323. doi:10.1207/S15326977EA0704-04
8. Daane, M.C., Campbell, J.R., Grigg, W.S., Goodman, M.J., & Oranje, A. (2005). Fourth-grade students reading aloud: NAEP 2002 special study of oral reading (NCES 2006-469). Washington, DC: National Center for Educational Statistics, U.S. Department of Education, Institute of Education Sciences.
9. Deno, S.L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 52 (3), 219232.
10. Deno, S.L. (2003). Developments in curriculum-based measurement. The Journal of Special Education, 37 (3), 184192. doi:10.1177/00224669030370030801
11. Deno, S.L., & Marston, D.B. (2006). Curriculum-based measurement of oral reading: An indicator of growth in fluency. In S.J. Samuels & A.E. Farstrup (Eds.), What research has to say about fluency instruction (pp. 179203). Newark, DE: International Reading Association.
12. Deno, S.L., Mirkin, P.K., & Chiang, B. (1982). Identifying valid measures of reading. Exceptional Children, 49 (1), 3645.
13. Dowhower, S.L. (1987). Effects of repeated reading on secondgrade transitional readers fluency and comprehension. Reading Research Quarterly, 22 (4), 389406. doi:10.2307/747699
14. Francis, D.J., Santi, K.L., Barr, C., Fletcher, J.M., Varisco, A., & Foorman, B.R. (2008). Form effects on the estimation of students oral reading fluency using DIBELS. Journal of School Psychology, 46 (3), 315342. doi:10.1016/j.jsp.2007.06.003
15. Fuchs, L.S., & Deno, S.L. (1991). Paradigmatic distinctions between instructionally relevant measurement models. Exceptional Children, 57 (6), 488499.
16. Fuchs, L.S., & Deno, S.L. (1994). Must instructionally useful performance assessment be based in the curriculum? Exceptional Children, 61 (1), 1524.
17. Fuchs, L.S., Deno, S.L., & Mirkin, P.K. (1984). Effects of frequent curriculum-based measurement and evaluation on pedagogy, student achievement, and student awareness of learning. American Educational Research Journal, 21 (2), 449460.
18. Fuchs, L.S., Fuchs, D., & Hamlett, C.L. (2007). Using curriculumbased measurement to inform reading instruction. Reading and Writing, 20 (6), 553567.
19. Fuchs, L.S., Fuchs, D., Hosp, M.K., & Jenkins, J.R. (2001). Oral reading fluency as an indicator of reading competence: A theoretical, empirical, and historical analysis. Scientific Studies of Reading, 5 (3), 239256. doi:10.1207/S1532799XSSR0503-3
20. Fuchs, L.S., Fuchs, D., & Maxwell, L. (1988). The validity of informal reading comprehension measures. Remedial and Special Education, 9 (2), 2028. doi:10.1177/074193258800900206
21. Good, R.H., & Jefferson, G. (1998). Contemporary perspectives on curriculum-based measurement validity. In M.R. Shinn (Ed.), Advanced applications of curriculum-based measurement (pp. 6188). New York: Guilford.
22. Good, R.H., & Kaminski, R.A. (Eds.). (2002). Dynamic indicators of basic early literacy skills (6th ed.). Eugene, OR: Institute for the Development of Educational Achievement. Retrieved March 2, 2010, from dibels.uoregon.edu
23. Good, R.H., Kaminski, R.A., & Dill, S. (2002). DIBELS oral reading fluency and retell fluency. In R.H. Good & R.A. Kaminski (Eds.), Dynamic indicators of basic early literacy skills (6th ed.). Eugene, OR: Institute for the Development of Educational Achievement.
24. Good, R.H., Simmons, D.C., & Kameenui, E.J. (2001). The importance and decision-making utility of a continuum of fluencybased indicators of foundational reading skills for third-grade high stakes outcomes. Scientific Studies of Reading, 5 (3), 257288. doi:10.1207/S1532799XSSR0503-4
25. Hasbrouck, J., & Tindal, G.A. (2006). Oral reading fluency norms: A valuable assessment tool for reading teachers. The Reading Teacher, 59 (7), 636644. doi:10.1598/RT.59.7.3 (Pubitemid 44884661)
26. Hintze, J.M., & Christ, T.J. (2004). An examination of variability as a function of passage variance in CBM progress monitoring. School Psychology Review, 33 (2), 204217.
27. Hintze, J.M., Shapiro, E.S., Conte, K., & Basile, I. (1997). Oral reading fluency and authentic reading material: Criterion validity of the technical features of CBM survey-level assessment. School Psychology Review, 26 (4), 535553.
28. Hoover, H.D., Dunbar, S.B., & Frisbie, D.A. (2001). Iowa tests of basic skills. Itasca, IL: Riverside.
29. Hosp, M.K., & Fuchs, L.S. (2005). Using CBM as an indicator of decoding, word reading, and comprehension: Do the relations change with grade? School Psychology Review, 34 (1), 926.
30. Jenkins, J.R., Hudson, R.F., & Johnson, E.S. (2007). Screening for at-risk readers in a response to intervention framework. School Psychology Review, 36 (4), 582600.
31. Jenkins, J.R., & Jewell, M. (1993). Examining the validity of two measures for formative teaching: Reading aloud and maze. Exceptional Children, 59 (5), 421432.
32. Johnson, E.S., Jenkins, J.R., Petscher, Y., & Catts, H.W. (2009). How can we improve the accuracy of screening instruments? Learning Disabilities Research & Practice, 24 (4), 174185. doi:10.1111/j.1540-5826.2009.00291.x
33. Klauda, S.L., & Guthrie, J.T. (2008). Relationships of three components of reading fluency to reading comprehension. Journal of Educational Psychology, 100 (2), 310321. doi:10.1037/0022-0663.100.2.310
34. Klein, J.R., & Jimerson, S.R. (2005). Examining ethnic, gender, language, and socioeconomic bias in oral reading fluency scores among Caucasian and Hispanic students. School Psychology Quarterly, 20 (1), 2350. doi:10.1521/scpq.20.1.23.64196
35. Kranzler, J.H., Brownell, M.T., & Miller, M.D. (1998). The construct validity of curriculum-based measurement of reading: An empirical test of a plausible rival hypothesis. Journal of School Psychology, 36 (4), 399415.
36. Kranzler, J.H., Miller, M.D., & Jordan, L. (1999). An examination of racial/ethnic and gender bias on curriculum-based measurement of reading. School Psychology Quarterly, 14 (3), 327342. doi:10.1037/h0089012
37. Kuhn, M.R. (2005). A comparative study of small group fluency instruction. Reading Psychology, 26 (2), 127146. doi:10.1080/02702710590930492 (Pubitemid 40855267)
38. Kuhn, M.R., & Stahl, S.A. (2003). Fluency: A review of developmental and remedial practices. Journal of Educational Psychology, 95 (1), 321. doi:10.1037/0022-0663.95.1.3
39. LaBerge, D., & Samuels, S.J. (1974). Toward a theory of automatic information processing in reading. Cognitive Psychology, 6 (2), 293323. doi:10.1016/0010-0285(74)90015-2
40. Lesaux, N. (with Koda, K., Siegel, L.S., & Shanahan, T.). (2006). Development of literacy. In D. August & T. Shanahan (Eds.), Developing literacy in second-language learners: Report of the National Literacy Panel on language-minority children and youth (pp. 75122). Mahwah, NJ: Erlbaum.
41. Lipson, M.Y., & Wixson, K.K. (2009). Assessment and instruction of reading and writing difficulties: An interactive approach. Boston: Pearson.
42. Manzo, K.K. (2005). National clout of DIBELS test draws scrutiny. Education Week, 25 (5), 1, 12.
43. Manzo, K.K. (2007). State data show gains in reading. Education Week, 26 (34), 1, 27.
44. Marston, D.B. (1989). A curriculum-based measurement approach to assessing academic performance: What it is and why do it. In M.R. Shinn (Ed.), Curriculum-based measurement: Assessing special children (pp. 1878). New York: Guilford.
45. Marston, D.B., & Magnusson, D. (1988). Curriculum-based assessment: District-level implementation. In J. Graden, J.E. Zins, & M.J. Curtis (Eds.), Alternative educational delivery systems: Enhancing instructional options for all students (pp. 137172). Washington, DC: National Association of School Psychologists.
46. McGlinchey, M.T., & Hixson, M.D. (2004). Using curriculum-based measurement to predict performance on state assessments in reading. School Psychology Review, 33 (2), 193203.
47. Mehrens, W.A., & Clarizio, H.F. (1993). Curriculum-based measurement: Conceptual and psychometr ic considerations. Psychology in the Schools, 30 (3), 241254. doi:10.1002/1520-6807(199307)30:3<241::AID-PITS2310300307>3.0. CO;2-J
48. National Institute of Child Health and Human Development. (2000). Report of the National Reading Panel. Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction (NIH Publication No. 00-4769). Washington, DC: U.S. Government Printing Office.
49. Newman, H.M. (2009). The influence of mandated oral reading fluency assessments on teachers thinking and practice. Unpublished doctoral dissertation, University of Washington, Seattle.
50. OConnor, R.E., & Jenkins, J.R. (1999). Prediction of reading disabilities in kindergarten and first grade. Scientific Studies of Reading, 3 (2), 159197. doi:10.1207/s1532799xssr0302-4
51. Olson, L. (2007). Instant read on reading, in palms of their hands. Education Week, 26 (35), 24, 26, 28, 31, 3334.
52. Paris, S.G., Carpenter, R.D., Paris, A.H., & Hamilton, E.E. (2005). Spurious and genuine correlates of childrens reading comprehension. In S.G. Paris & S.A. Stahl (Eds.), Childrens reading comprehension and assessment (pp. 131160). Mahwah, N.J.: Erlbaum.
53. Pearson, P.D. (2006). Foreword. In K.S. Goodman (Ed.), The truth about DIBELS: What it is, what it does (pp. vxix). Portsmouth, NH: Heinemann.
54. Pearson, P.D., & Johnson, D.D. (1978). Teaching reading comprehension. New York: Holt, Reinhart and Winston.
55. Pedhazur, E.J., & Kerlinger, F.N. (1982). Multiple regression in behavioral research: Explanation and prediction (2nd ed.). New York: Holt, Rinehart and Winston.
56. Pikulski, J.J. (2006). Fluency: A developmental and language perspective. In S.J. Samuels & A.E. Farstrup (Eds.), What research has to say about fluency instruction (pp. 7093). Newark, DE: International Reading Association.
57. Pikulski, J.J., & Chard, D.J. (2005). Fluency: Bridge between decoding and reading comprehension. The Reading Teacher, 58 (6), 510519. doi:10.1598/RT.58.6.2 (Pubitemid 40551350)
58. Pinnell, G.S., Pikulski, J.J., Wixson, K.K., Campbell, J.R., Gough, P.B., & Beatty, A.S. (1995). Listening to children read aloud: Oral fluency. Washington, DC: U.S. Department of Education, National Center for Education Statistics.
59. Pressley, M., Hildren, K., & Shankland, R. (2005). An evaluation of end-grade-3 Dynamic Indicators of Basic Early Literacy Skills (DIBELS): Speed reading without comprehension, predicting little. East Lansing, MI: Michigan State University, College of Education, Literacy Achievement Research Center.
60. Rasinski, T.V. (1990). Investigating measures of reading fluency. Educational Research Quarterly, 14 (3), 3744.
61. Rasinski, T.V. (2006). Reading fluency instruction: Moving beyond accuracy, automaticity, and prosody. The Reading Teacher, 59 (7), 704706. doi:10.1598/RT.59.7.10 (Pubitemid 44884668)
62. Rasinski, T.V., & Hoffman, J.V. (2003). Theory and research into practice: Oral reading in the school literacy curriculum. Reading Research Quarterly, 38 (4), 510522. doi:10.1598/RRQ.38.4.5 (Pubitemid 39659316)
63. Rasinski, T.V., & Padak, N. (2005). 3-minute reading assessments: Word recognition, fluency, & comprehension. New York: Scholastic.
64. Rasinski, T.V., & Padak, N. (2008). From phonics to fluency: Effective teaching of decoding and reading fluency in the elementary school. Boston: Allyn & Bacon.
65. Riedel, B.W. (2007). The relation between DIBELS, reading comprehension, and vocabulary in urban first-grade students. Reading Research Quarterly, 42 (4), 546567. doi:10.1598/RRQ.42.4.5
66. Samuels, S.J. (2006). Toward a model of reading fluency. In S.J. Samuels & A.E. Farstrup (Eds.), What research has to say about fluency instruction (pp. 2446). Newark, DE: International Reading Association.
67. Samuels, S.J. (2007). The DIBELS Test: Is speed of barking at print what we mean by reading fluency? Reading Research Quarterly, 42 (4), 563566.
68. Schilling, S.G., Carlisle, J.F., Scott, S.E., & Zeng, J. (2007). Are fluency measures accurate predictors of reading achievement? The Elementary School Journal, 107 (5), 429448. doi:10.1086/518622
69. Schwanenflugel, P.J., Meisinger, E.B., Wisenbacker, J.M., Kuhn, M.R., Strauss, G.P., & Morris, R.D. (2006). Becoming a fluent and automatic reader in the early elementary school years. Reading Research Quarterly, 41 (4), 496522. doi:10.1598/RRQ.41.4.4 (Pubitemid 44662657)
70. Shapiro, E.S. (2000). School psychology from an instructional perspective: Solving big, not little problems. School Psychology Review, 29 (4), 560572.
71. Sharp, D. (2004). Supporting teachers data-driven instructional conversations: An environmental scan of reading first and step literacy assessments, data visualization, and assumptions about conversations that matter: Report to the Information Infrastructure System Project, The John D. and Catherine T. MacArthur Foundation, & the William and Flora Hewlett Foundation. Retrieved March 3, 2010, from www.dianasharp.com/pdf/report-IISP.pdf
72. Shinn, M.R., Good, R.H., Knutson, N., Tilly, W.D., & Collins, V.L. (1992). Curriculum-based measurement of oral reading fluency: A confirmatory analysis of its relation to reading. School Psychology Review, 21 (3), 459479.
73. Shinn, M.R., Tindal, G.A., & Stein, S. (1988). Curriculum-based measurement and the identification of mildly handicapped students: A research review. Professional School Psychology, 3 (1), 6985. doi:10.1037/h0090531
74. SPSS. (2004). SPSS 13.0 base users guide. Chicago: Author.
75. Stage, S.A., & Jacobsen, M.D. (2001). Predicting student success of state-mandated, performance-based state assessment using oral reading fluency. School Psychology Review, 30 (3), 407419.
76. Valencia, S.W. (in press). Reader profiles and reading disabilities. In R.L. Allington & A. McGill-Franzen (Eds.), Handbook of reading disabilities research. Mahwah, NJ: Erlbaum.
77. Valencia, S.W., Smith, A., Reece, A., Newman, H., Wixson, K.K., & Li, M. (2006, April). Assessment of oral reading fluency: New models. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
78. Wiley, H.I., & Deno, S.L. (2005). Oral reading and maze measures as predictors of success for English learners on a state standards assessment. Remedial and Special Education, 26 (4), 207214. doi: 10.1177/ 07419325050260040301
79. Wolf, M., & Katzir-Cohen, T. (2001). Reading fluency and its intervention. Scientific Studies of Reading, 5 (3), 211239. doi:10.1207/ S1532799XSSR0503-2
80. Young, A., & Bowers, P.G. (1995). Individual difference and text difficult determinants of reading fluency and expressiveness. Journal of Experimental Child Psychology, 60 (3), 428454. doi:10.1006/jecp.1995.1048 (Pubitemid 126006130)
81. Yovanoff, P., Duesbery, L., Alonzo, J., & Tindal, G.A. (2005). Grade-level invariance of a theoretical causal structure predicting reading comprehension with vocabulary and oral reading fluency. Educational Measurement: Issues and Practice, 24 (3), 412. doi:10.1111/j.1745-3992.2005.00014.x (Pubitemid 41658353)
82. Zutell, J., & Rasinski, T.V. (1991). Training teachers to attend to their students oral reading fluency. Theory Into Practice, 30 (3), 211217. doi:10.1080/00405849109543502