An Examination of Predictive Bias for Second Grade Reading Outcomes From Measures of Early Literacy Skills in Kindergarten With Respect to English-Language Learners and Ethnic Subgroups

School Psychology Quarterly

Volumn 23, Issue 4, 2008, Pages 553-570

  Betts, Joseph ^a   Reschly, Amy ^b   Pickart, Mary ^c   Heistad, Dave ^c   Sheran, Christina ^c   Marston, Doug ^c  

^a Renaissance Learning   (United States)

^b UNIVERSITY OF GEORGIA   (United States)

^c Minneapolis Public Schools   (United States)

Author keywords

curriculum based measurement; differential prediction; early literacy assessment; English language learners

Indexed keywords

EID: 69049118450     PISSN: 10453830     EISSN: None     Source Type: Journal    
DOI: 10.1037/1045-3830.23.4.553     Document Type: Article

References (88)

1. Abbott S.P., Reed E., Abbott R.D., and Beringer V.W. A year-long balance reading/writing tutorial: A design experiment used for dynamic assessment. Learning Disability Quarterly 20 (1997) 249-263
2. Abedi J. Psychometric issues in the ELL assessment and special education eligibility. Teachers College Record 108 (2006) 2282-2303
3. Adams M. Beginning to read: Thinking and learning about print (1990), MIT Press, Cambridge, MA
4. Aguinis H. Regression analysis for categorical moderators (2004), The Guilford Press, New York
5. Al Otaiba S., and Torgesen J. Effects from intensive standardized kindergarten and first-grade interventions for the prevention of reading difficulties. In: Jimerson S., Burns M., and VanDerHeyden A. (Eds). Handbook of response to intervention: The science and practice of assessment and intervention (2007), Springer, New York 212-222
6. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. Standards for educational and psychological testing (1985), American Psychological Association, Washington, DC
7. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. Standards for educational and psychological testing (1999), American Educational Research Association, Washington, DC
8. Baker S.K., and Good R. Curriculum-based measurement of English reading with bilingual Hispanic students: A validation study with second-grade students. School Psychology Review 24 (1995) 561-578
9. Betts, J., Pickart, M., Heistad, D., & Sheran, C. (2006). Predictive validity of verbal and quantitative literacy assessments in kindergarten for second grade outcomes. Manuscript under review.
10. Christenson S.L., and Peterson C.J. Family, school, and community influences on children's learning: A literature review. All Parents Are Teachers Project (formerly Live & Learn) (1998), University of Minnesota Extension Service, Minneapolis, MN
11. Cleary T. Test bias: Prediction of grades of Negro and white students in integrated colleges. Journal of Educational Measurement 5 (1968) 115-124
12. Cleary T., Humphreys L.G., Kendrick S.A., and Wesman A. Educational uses of tests with disadvantaged students. American Psychologist 30 (1975) 15-41
13. Clements M.A., Reynolds A.J., and Hickey E. Site-level predictors of children's school and social competence in the Chicago Child-Parent Centers. Early Childhood Research Quarterly 19 (2004) 273-296
14. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. (1988), Erlbaum, Hillsdale, NJ
15. Cole N., and Moss P. Bias in test use. In: Linn R.L. (Ed). Educational measurement. 3rd ed. (1993), The Oryx Press, Phoenix, AZ 201-220
16. Commission on Reading, National Academy of Education. Becoming a nation of readers (1985), National Institute of Education, Washington, DC
17. Cronbach L., Gleser G., Nanda H., and Rajaratnam N. The dependability of behavioral measurements: Theory of generalizability for scores and profiles (1972), Wiley, New York
18. Cunningham P., and Cunningham J. What we know about how to teach phonics. In: Farstrup A., and Samuels S. (Eds). What research has to say about reading instruction. 3rd ed. (2002), International Reading Association, Newark, DE 87-110
19. Daly E.J., Wright J.A., Kelly S.Q., and Martens B.K. Measures of early academic skills: Reliability and validity with a first grade sample. School Psychology Quarterly 12 (1997) 268-280
20. Deno S.L. Curriculum-based measurement: The emerging alternative. Exceptional Children 52 (1985) 219-232
21. Denton C.A., Foorman B.R., and Mathes P.G. Perspective: Schools that "beat the odds" implications for reading instruction. Remedial and Special Education 24 (2003) 258-261
22. Donovan M.S., and Cross C.T. Minority students in special and gifted education (2002), National Academy Press, Washington DC
23. Ehri L., and Nunes S. The role of phonemic awareness in learning to read. In: Farstrup A., and Samuels S. (Eds). What research has to say about reading instruction. 3rd ed. (2002), International Reading Association, Newark, DE 111-139
24. Fan X., and Chen M. Parental involvement and students' academic achievement: A meta-analysis. Educational Psychology Review 13 (2001) 1-22
25. Fantuzzo J., McWayne C., Perry M.A., and Childs S. Multiple dimensions of family involvement and their relationships to behavioral and learning competencies for urban, low-income children. School Psychology Review 33 (2004) 467-480
26. Feldt L., and Brennan R. Reliability. In: Linn R.L. (Ed). Educational measurement. 3rd ed. (1993), The Oryx Press, Phoenix, AZ 105-146
27. Foorman B.R., Schatschneider C., Eakin M.N., Fletcher J.M., Moats L.C., and Francis D.J. The impact of instructional practices in Grades 1 and 2 on reading and spelling achievement in high poverty schools. Contemporary Educational Psychology 31 (2004) 1-29
28. Gilmer J., and Feldt L. Reliability estimation for a test with parts of unknown lengths. Psychometrika 48 (1983) 99-111
29. Good R.H., Simmons D.C., and Kame'enui E.J. The importance of decision-making utility of a continuum of fluency-based indicators of foundational reading skills for third grade high-stakes outcomes. Scientific Studies of Reading 5 (2001) 257-288
30. Gottfried A.E., Fleming J.S., and Gottfried A.W. Role of cognitively stimulating home environment in children's academic intrinsic motivation: A longitudinal study. Child Development 69 5 (1998) 1448-1460
31. Gresham F. Evolution of the response-to-intervention concept: Empirical foundations and recent developments. In: Jimerson S., Burns M., and VanDerHeyden A. (Eds). Handbook of response to intervention: The science and practice of assessment and intervention (2007), Springer, New York 10-24
32. Gulliksen H., and Wilks S. Regression tests for several samples. Psychometrika 15 (1950) 91-114
33. Gutman L.M., and McLoyd V.C. Parents' management of their children's education within the home, at school, and in the community: An examination of African-American families living in poverty. The Urban Review 32 (2000) 1-23
34. Haager D. Promises and cautions regarding using response to intervention with English Language Learners. Learning Disability Quarterly 30 (2007) 213-218
35. Haager D., and Windmueller M.P. Early reading intervention for English Language Learners at-risk for Learning Disabilities: Student and teacher outcomes in an urban school. Learning Disability Quarterly 24 (2001) 235-250
36. Hart B., and Risley T. Meaningful differences in the everyday experiences of young American children (1995), Brookes, Baltimore
37. Hintze J., Callahan J., Matthews W., Williams S., and Tobin K. Oral reading fluency and prediction of reading comprehension in African American and Caucasian elementary school children. School Psychology Review 31 (2002) 540-554
38. Hintze J.M., Ryan A.L., and Stoner G. Concurrent validity and diagnostic accuracy of the Dynamic Indicators of Basic Early Literacy Skills and the Comprehensive Test of Phonological Processing. School Psychology Review 32 (2003) 541-546
39. Hintze J.M., and Silberglitt B. A longitudinal examination of the diagnostic accuracy and predictive validity of R-CBM and high stakes testing. School Psychology Review 34 (2005) 372-386
40. Jensen A. Bias in mental testing (1980), The Free Press, New York
41. Jimerson S., Burns M., and VanDerHeyden A. Handbook of response to intervention: The science and practice of assessment and intervention (2007), Springer, New York
42. Juel C. Learning to read and write: A longitudinal study of 54 children from first through fourth grades. Journal of Educational Psychology 80 (1988) 437-447
43. Kaminski R.A., and Good R.H. Towards a technology for assessing basic early literacy skills. School Psychology Review 25 (1996) 215-227
44. Kindler A. Survey of the states' limited English proficient students and available educational programs and services: 2000-2001 summary report (2002), National Clearinghouse for English Language Acquisition, Washington, DC
45. Klein J., and Jimerson S. Examining ethnic, gender, language, and socioeconomic bias in oral reading fluency scores among Caucasian and Hispanic students. School Psychology Quarterly 20 (2005) 23-50
46. Kranzler J.H., Miller M.D., and Jordan L. An examination of racial/ethnic and gender bias on Curriculum-Based Measurement of Reading. School Psychology Quarterly 14 (1999) 327-342
47. Kratochwill T., Clements M., and Kalymon K. Response to intervention: Conceptual and methodological issues in implementation. In: Jimerson S., Burns M., and VanDerHeyden A. (Eds). Handbook of response to intervention: The science and practice of assessment and intervention (2007), Springer, New York 25-52
48. Lennon J.E., and Slesinski C. Early intervention in reading: Results of a screening and intervention program for kindergarten. School Psychology Review 28 (1999) 353-365
49. Little R. A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association 83 (1988) 1198-1202
50. Little R., and Rubin D. Statistical analysis with missing data. 2nd ed. (2002), Wiley, New York
51. Marcon R.A. Positive relationships between parent school involvement and public school inner-city preschoolers' development and academic performance. School Psychology Review 28 (1999) 395-412
52. Marston D. A curriculum based measurement approach to assessing academic performance: What is it and why do it. In: Shinn M.R. (Ed). Curriculum Based Measurement: Assessing special children (1989), Guilford Press, New York
53. Marston D., Muyskens P., Lau M., and Canter A. Problem-solving model for decision-making with high-incidence disabilities: The Minneapolis experience. Learning Disabilities Research and Practice 18 (2003) 187-200
54. Marston D., Pickart M., Reschly A., Muyskens P., Heistad D., and Tindal G. Early literacy measures for improving student reading achievement: Translating research into practice. Exceptionality 15 (2007) 97-118
55. McCardle P., Mele-McCarthy J., Cutting L., Leos K., and E'milio T. Learning disabilities in English Language Learners: Identifying the issues. Learning Disabilities Research & Practice 20 (2005) 1-5
56. McConnell S.R., McEvoy M.A., and Priest J.S. "Growing" measures for monitoring progress in early childhood education: A research and development proves for Individual Growth and Development Indicators. Assessment for Effective Intervention 27 (2002) 3-14
57. McConnell S.R., Priest J.S., Davis S.D., and McEvoy M.A. Best practices in measuring growth and development for preschool children. In: Thomas A., and Grimes J. (Eds). Best practices in school psychology. 4th ed. 2 (2002), NASP, Washington, DC 1231-1246
58. Messick S. Test validity and the ethics of assessment. American Psychologist 35 (1980) 1012-1127
59. National Center for Educational Statistics. The condition of education 2006 (NCES 2006-071) (2006), U.S. Government Printing Office, Washington, DC
60. National Institute of Child Health and Human Development. Report of the National Reading Panel. Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction: Reports of the subgroups (NIH Publication No. 00-4754) (2000), U.S. Government Printing Office, Washington, DC
61. Northwest Evaluation Association. Reliability and validity estimates: NWEA Achievement Level tests and Measures of Academic Progress (2004), Northwest Evaluation Association, Lake Oswego, OR
62. Perie M., Grigg W.S., and Donahue P.L. The Nation's Report Card: Reading 2005. (NCES 2006-451). U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics (2005), U.S. Government Printing Office, Washington, DC
63. Pickart M., Sheran C., Betts J., and Heistad D. Minneapolis Kindergarten Assessments: Technical manual (2006), Minneapolis Public Schools, Minneapolis, MN
64. Potthoff R. Statistical aspects of the problem of biases in psychological tests. Institute of Statistics Mimeo Series, Report No. 479 (1966), Department of Statistics, University of North Carolina, Chapel Hill
65. Prakash N., West J., and Denton K. Schools' use of assessments in kindergarten entrance and placement: 1998-99. (NCES 2003-004) U.S. Department of Education (2003, March), National Center for Education Statistics, Washington, DC
66. Ramirez R.D., and Shapiro E.S. Curriculum-based measurement and the evaluation of reading skills of Spanish-Speaking English Language Learners in bilingual education classrooms. School Psychology Review 35 (2006) 356-369
67. Reschly D.J., Kicklighter R.H., and McKee P. Recent placement litigation, Part III: Analysis of differences in Larry P., Marshall, and S-I and implications for future practices. School Psychology Review 17 (1988) 37-48
68. Reynolds C. Methods for detecting construct and predictive bias. In: Berk R. (Ed). Handbook of methods for detecting test bias (1982), Johns Hopkins University Press, Baltimore, MD 199-227
69. Reynolds C., Lowe P., and Saenz A. The problem of bias in psychological assessment. In: Reynolds C.R., and Gutkin T.B. (Eds). The handbook of school psychology. 3rd ed. (1999), Wiley, New York
70. Rumberger, R. (2000). Educational outcomes and opportunities for English language learners. Presentation to the Joint Committee to Develop the Master Plan for Education, Kindergarten through University. Santa Barbara, CA: University of California Linguistic Minority Research Institute.
71. Sandberg, K., & Reschly, A. L. (2007). Curriculum based measurement and English language learners: A review of the literature. Manuscript in preparation.
72. Saunders D. Moderator variables in prediction. Educational and Psychological Measurement 16 (1956) 209-222
73. Shaprio E.S., Keller M.A., Lutz G., Santoro L.E., and Hintze J.M. Curriculum based measures and performance on state assessments and standardized tests: Reading and math performance in Pennsylvania. Journal of Psychoeducational Assessment 24 (2006) 19-35
74. Shinn M.R. Identifying and defining academic problems: CBM screening and eligibility procedures. In: Shinn M.R. (Ed). Curriculum based measurement: Assessing special children (1989), Guilford Press, New York
75. Silberglitt B., and Hintze J.M. Formative assessment using CBM-R cut scores to track progress toward success on state mandated achievement tests. Journal of Psychoeducational Assessment 23 (2005) 304-325
76. Simmons D., and Kame'enui E.J. What reading research tells us about children with diverse learning needs: Bases and basics (1998), Erlbaum, Inc, Mahwah, NJ
77. Snedecor G., and Cochran W. Statistical methods. 8th ed. (1989), Blackwell Publishing, Ames, IA
78. Snow C., Burns S., and Griffin P. Preventing reading difficulties in young children (1998), National Academy Press, Washington, DC
79. Stage S.A., and Jacobsen M.D. Predicting student success on a state-mandated performance-based assessment using oral reading fluency. School Psychology Review 30 (2001) 407-419
80. Strickland D. The importance of effective early intervention. In: Farstrup A., and Samuels S. (Eds). What research has to say about reading instruction. 3rd ed. (2002), International Reading Association, Newark, DE 69-86
81. Swanson C. Who graduates? Who doesn't? A statistical portrait of public high school graduation, Class of 2001 (2001), Education Policy Center, Washington, DC
82. Taylor B.M., Pearson P.D., Clark K., and Walpole S. Effective schools and accomplished teachers: Lessons about primary-grade reading instruction in low-income schools. The Elementary School Journal 101 (2000) 121-165
83. VanDerHeyden A.M., Witt J.C., and Naquin G. Development and validation of a process for screening referrals to special education. School Psychology Review 32 (2003) 204-228
84. Vaughn S., Linan-Thompson S., and Hickman P. Response to instruction as a means of identifying students with reading/learning disabilities. Exceptional Children 69 (2003) 391-409
85. Vellutino F., Scanlon D., and Zhang H. Identifying reading disability based on response to intervention: Evidence from early intervention research. In: Jimerson S., Burns M., and VanDerHeyden A. (Eds). Handbook of response to intervention: The science and practice of assessment and intervention (2007), Springer, New York 185-211
86. Vellutino F.R., Scanlon D.M., Sipay E.R., Small S.G., Pratt A., Chen R., and Denckla M.B. Cognitive profiles of difficult-to-remediate and readily remediated poor readers: Early intervention as a vehicle for distinguished between cognitive and experiential deficits as basic causes of specific reading disability. Journal of Educational Psychology 88 (1996) 601-638
87. Wiley H.I., and Deno S.L. Oral reading and maze measures as predictors of success for English Learners on a state standards assessment. Remedial & Special Education 26 (2005) 207-214
88. Zimmerman D., Zumbo B., and LaLonde C. Coefficient alpha as an estimate of test reliability under violations of two assumptions. Educational and Psychological Measurement 53 (1993) 33-49