How features of educational technology applications affect student reading outcomes: A meta-analysis

Educational Research Review

Volumn 7, Issue 3, 2012, Pages 198-215

  Cheung, Alan C K ^a   Slavin, Robert E ^b  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Educational technology applications; K 12; Meta analysis; Reading achievement

Indexed keywords

EID: 84870865768     PISSN: 1747938X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.edurev.2012.05.002     Document Type: Review

References (127)

1. Abram, S. L. (1984). The effect of computer assisted instruction on first grade phonics and mathematics achievement computation. Unpublished Doctoral Dissertation, Northern Arizona University.
2. Abrami, P. C., & Bernard, R. M. (2006). Research on distance education: In defense of field experiments. Distance Education, 27(1), 5-26.
3. Adams (2010). Technology for developing children's language and literacy: Bringing speech-recognition to the classroom. Providence, RI: Brown University.
4. Alessi, M. S., & Trollip, S. R. (2001). Multimedia for learning: Methods and development (3rd ed.). Boston: Allyn and Bacon.
5. Alifrangis, C. M. (1991). An integrated learning system in an elementary school: Implementation, attitudes, and results. Journal of Computing in Childhood Education, 2(3), 51-66.
6. Atkinson, R. C. (1968). Computerized instruction and the learning process. American Psychologist, 23(4), 225-239.
7. Atkinson, R. C., & Fletcher, J. D. (1972). Teaching children to read with a computer. The Reading Teacher, 25, 319-327.
8. Barker, T. A., & Torgesen, J. K. (1995). An evaluation of computer-assisted instruction in phonological awareness with below average readers. Journal of Educational Computing Research, 13, 89-103.
9. Barnett, L. B. (2006). The effect of computer-assisted instruction on the reading skills of emergent readers. Unpublished Doctoral Dissertation, Florida Atlantic University.
10. Bass, G., Ries, R., & Sharpe, W. (1986). Teaching basic skills through microcomputer assisted instruction. Journal of Educational Computing Research, 2(2), 207-219.
11. Beasley, N. (1989). The effects of IBM Writing to Read program on the achievement of selected first grade students. Dissertation Abstracts International, 51 (3), 739A (UMI No. 9122247).
12. Becker, H. J. (1992). Computer-based integrated learning systems in the elementary and middle grades: A critical review and synthesis of evaluation reports. Journal of Educational Computing Research, 8(1), 1-41.
13. Becker, H. J. (1994). Mindless or mindful use of integrated learning systems. International Journal of Educational Research, 21(1), 65-79.
14. Biggs, M. C., Homan, S. P., Dedrick, R., Minick, V., & Rasinski, T. (2008). Using an interactive singing software program: A comparative study of struggling middle school readers. Reading Psychology, 29(3), 195-213.
15. Birch, J. (2002). The effects of the Delaware Challenge Grant Program on the standardized reading and mathematics test scores of second and third grade students in the Caesar Rodney School District. Unpublished Doctoral Dissertation, Wilmington College.
16. Block, C. C., Campbell, M. J., Ninon, K., Williams, C., Helgert, M. (2007). Effects of AWARD Reading, a technology-based Approach to Literacy Instruction, on the Reading Achievement and Attitudes Toward Reading of Diverse K-1 Students in the United States of America. Charlotte, NC: The Institute of Literacy Enhancement, Research Report 124811.
17. Blok, H., Oostdam, R., Otter, M. E., & Overmatt, M. (2002). Computer-assisted instruction in support of beginning reading instruction: A review. Review of Educational Research, 72(1), 101-130.
18. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2005). Comprehensive meta-analysis (Version 2). Englewood, NJ: Biostat.
19. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. West Sussex: Wiley.
20. Bryg, V. (1984). The effect of computer assisted instruction upon reading achievement with selected fourth grade children. Unpublished Doctoral Dissertation, University of Nebraska.
21. Bucleitner, W. (1996). Why do kids love computers? Scholastic Early Childhood Today, 11, 15.
22. Caggiano, J. A. (2007). Addressing the learning needs of struggling adolescent readers: The impact of a reading intervention program on students in a middle school setting. Unpublished Doctoral Dissertation, The College of William and Mary.
23. Campbell, J.P. (2000). A comparison of computerized and traditional instruction in the area of elementary reading. Unpublished Doctoral Dissertation, University of Alabama.
24. Campuzano, L., Dynarski, M., Agodini, R., & Rall, K. (2009). Effectiveness of reading and mathematics software products: Findings from two student cohorts. Washington, DC: Institute of Education Sciences.
25. Cassady, J., & Smith, L. (2005). The impact of a structured integrated learning system on first grade students' reading gains. Reading and Writing Quarterly, 21(4), 361-376.
26. Chambers, B., Cheung, A., Madden, N., Slavin, R. E., & Gifford, R. (2006). Achievement effects of embedded multimedia in a Success for all reading program. Journal of Educational Psychology, 98(1), 232-237.
27. Chambers, B., Slavin, R. E., Madden, N. A., Abrami, P. C., Karanzalis, M., & Gifford, R. (2011). Small-group computer-assisted tutoring to improve reading outcomes for struggling first and second graders. Elementary School Journal, 111(4).
28. Chambers, B., Slavin, R. E., Madden, N. A., Abrami, P. C., Tucker, B. J., Cheung, A., & Gifford, R. (2008). Technology infusion in success for all: Reading outcomes for first graders. Elementary School Journal, 109(1), 1-15.
29. Clariana, R.B. (1994). The effects of an integrated learning system on third graders' mathematics and reading achievement. San Diego, CA: Jostens Learning Corporation. (ERIC Document Reproduction Service No. ED 409 181).
30. Clark, R. E. (1983). Reconsidering research on learning from media. Review of Educational Research, 53(4), 445-449.
31. Clark, R. E. (1985a). Confounding in education computing research. Journal of Educational Computing Research, 1(2), 445-460.
32. Clark, R. E. (1985b). Evidence for confounding in computer-based instruction studies: Analyzing the meta-analyses. Educational Communication and Technology Journal, 33(4), 249-262.
33. Clayton, I.L. (1992). The relationship between computer-assisted instruction in reading and mathematics achievement and selected student variables. Unpublished Doctoral Dissertation, The University of Southern Mississippi.
34. Collis, B., Ollila, L., & Ollila, K. (1990). Writing to read: An evaluation of a Canadian installation of a computer-supported initial language environment. Journal of Educational Computing Research, 6(4), 411-427.
35. Coomes, P. (1985). The effects of computer assisted instruction on the development of reading and language skills. Unpublished Doctoral Dissertation, North Texas State University.
36. Cooperman, K.S. (1985). An experimental study to compare the effectiveness of a regular classroom reading program to a regular classroom reading program with a computer-assisted instruction program in reading comprehension skills in grades two through four. Unpublished Doctoral Dissertation, The American University.
37. Davidson, J., & Miler, J. (2002). Scholastic's READ 180: A heritage of research. New York: Scholastic.
38. Denson, K. (2008). Passport Reading Journeys Effectiveness with Ninth Grade Students Identified for Reading Improvement Instruction in an Urban High School: Voyager Expanded Learning, Inc..
39. DiLeo, J. (2007). A study of a specific language arts and mathematics software program: Is there a correlation between usage levels and achievement? Unpublished Doctoral Dissertation, Indiana University of Pennsylvania.
40. Dynarski, M., Agodini, R., Heaviside, S. N., Carey, N., Campuzano, L., Means, B., et al. (2007). Effectiveness of reading and mathematics software products: Findings from the first student cohort. Washington, DC: Institute of Education Sciences.
41. Easterling, B. (1982). The effects of computer assisted instruction as a supplement to classroom instruction in reading comprehension and arithmetic. Unpublished Doctoral Dissertation, North Texas State University.
42. Ehri, L. C., Dreyer, L. G., Flugman, B., & Gross, A. (2007). Reading rescue: An effective tutoring intervention model for language-minority students who are struggling readers in first grade. American Educational Research Journal, 44(2), 414-448.
43. Erdner, R., Guy, R., & Bush, A. (1997). The impact of a year of computer assisted instruction on the development of first grade reading skills. Journal of Educational Computing Research, 18(4), 369-388.
44. Estep, S. (1997). An investigation of the relationship between integrated learning systems and academic achievement. Unpublished Doctoral Dissertation, Purdue University.
45. Faux, R. (2004). Evaluation of Lexia Software in Boston Public Schools, Final Report. Davis Square Research Associates.
46. Fletcher-Finn, C., & Gravatt, B. (1995). The efficacy of computer-assisted instruction (CAI): A meta-analysis. Journal of Educational Computing Research, 12(3), 219-241.
47. Frechtling, J. A., Zhang, X., & Silverstein, G. (2006). Voyager universal literacy system: Results from a study of Kindergarten students in inner-city schools. Journal of Education for Students Placed at Risk, 11(1), 75-95.
48. Gee, J. P. (2003). What video games have to teach us about learning and literacy. New York: Palgrave MacMillan
49. Glass, G., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
50. Granick, L., & Reid, E. (1987). Writing to Read program, FY 87. Baltimore: Baltimore City Public Schools.
51. Hagerman, T. E. (2003). A quasi-experimental study on the effects of Accelerated Reader at middle school. Unpublished Doctoral Dissertation, University of Oregon.
52. Haslam, B. M., White, R. N., & Klinge, A. (2006). Improving student literacy: READ 180 in the Austin independent school district 2004-2005. Washington, DC: Policy Studies Associates.
53. Hasselbring, T. S., & Goin, L. I. (2004). Literacy instruction for struggling readers: What is the role of technology? Reading and Writing Quarterly, 20, 123-144.
54. Hecht, S. A. (2003). A Study Between Voyager and Control Schools in Orange County. Florida: Florida Atlantic University. .
55. Hoffman, J. T. (1984). Reading achievement and attitude toward reading of elementary students receiving supplementary computer assisted instruction compared with students receiving supplementary traditional instruction. Unpublished Doctoral Dissertation, Ball State University.
56. Hunter, C. T. L. (1994). A study of the effect of instructional method on the reading and mathematics achievement of chapter one students in rural Georgia. Unpublished Doctoral Dissertation, South Carolina State University.
57. Hyson, M. C. (1986). "Computers? I love them!": Young children's concepts and attitudes about computers. Early Childhood Development and Care, 23(1), 17-29.
58. Interactive Inc. (2002). Final report: Study of READ 180 in the Council of Great City Schools. New York, NY: Interactive Inc.
59. James-Burdumy, S., Mansfield, W., Deke, J., Carey, N., Lugo-Gil, J., Hershey, A., et al (2009). Effectiveness of selected supplemental reading comprehension interventions: Impacts on a first cohort of fifth-grade students. Washington, DC: Institute of Education Sciences.
60. Kadel Research Consulting. (2006). Garfield heights city schools maple leaf intermediate, enhancing education through technology, end-year evaluation. Kadel Research Consulting.
61. Knox, M. (1996). An experimental study of the effects of The Accelerated Reader program and a teacher directed program on reading comprehension and vocabulary of fourth and fifth grade students. Dissertation Abstracts International, 57 (10), 4208A (UMI No. 9710798).
62. Kozma, R. B. (1994). Will media influence learning? Reframing the debate. Educational Technology Research and Development, 42(2), 7-19.
63. Kulik, C. L. C., & Kulik, J. A. (1991). Effectiveness of computer-based instruction: An update analysis. Computers in Human Behavior, 7(1-2), 75-94.
64. Kulik, J. A. (2003). Effects of using instructional technology in elementary and secondary schools: What controlled evaluation studies say. Arlington, VA: SRI International.
65. Lang, L., Torgesen, J., Vogel, W., Chanter, C., Lefksy, E., & Petscher, Y. (2009). Exploring the relative effectiveness of reading interventions for high school students. Journal of Research on Educational Effectiveness, 2(2), 149-175.
66. Liao, Y. K. (1999). Effects of hypermedia on students' achievement: A meta-analysis. Journal of Educational Multimedia and Hypermedia, 8(3), 255-277.
67. Levy, M. H. (1985). An evaluation of computer assisted instruction upon the achievement of fifth grade students as measured by standardized tests. Unpublished Doctoral Dissertation, University of Bridgeport.
68. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks: Sage.
69. Liston, W. R. (1991). The effects of computer-assisted instruction on remedial reading students' achievement in grade 10 identified South Carolina High Schools as measured by BSAP state testing in school years 1988-89 and 1989-90. Unpublished Doctoral Dissertation, University of South Carolina.
70. Macaruso, P., & Hook, P. E. (2001). Auditory processing: Evaluation of Fast ForWord for children with dyslexia. Perspectives, 27(3), 5-8.
71. Macaruso, P., Hook, P. E., & McCabe, R. (2006). The efficacy of computer-based supplementary phonics programs for advancing reading skills in at-risk elementary students. Journal of Research in Reading, 29, 162-172.
72. Marion, G. G. (2004). An examination of the relationship between students' use of the Fast ForWord Reading Program and their performance on standardized assessments in elementary schools. Unpublished Doctoral Dissertation, East Tennessee State University.
73. Mayer, R. (2009). Multimedia learning (2nd ed.). New York: Cambridge University Press.
74. Mayer, R. (2008). Information processing. In T. L. Good (Ed.). 21st century learning (Vol. 1, pp. 168-174). Thousand Oaks, CA: Sage.
75. Metrics Associates. (1981). Evaluation of the Computer Assisted Instruction Title I Project, 1980-81. Research Report. Chelmsford, MA: Merrimack Education Center.
76. Miller, H. (1997). Quantitative analyses of student outcome measures. International Journal of Educational Research, 25, 119-136.
77. Mims, C., Lowther, D., Strahl, J.D., & Nunnery, J. (2006). Little Roch School District READ 180 evaluation: Technical Report. Memphis, TN: The Center for Research in Educational Policy.
78. Mys, D.P. & Petrie, J. (1988). Evaluation of student reading and math WICAT computer managed instructional program Salina Elementary School November, 1985 - June 1988. Bulletin No. 1345, Office of Research and Evaluation, Public Schools, Bearhorn, MI.
79. Nave, J. (2007). An assessment of READ 180 regarding its association with the academic achievement of at-risk students in Sevier County schools. Unpublished Doctoral Dissertation, East Tennessee State University.
80. Nunnery, J., Ross, S. M., & Goldfeder, E. (2003). The effect of School Renaissance on TAAS scores in the McKinney ISD. Memphis: University of Memphis, Center for Research in Educational Policy.
81. Nunnery, J. A., & Ross, S. M. (2007). Effects of the school renaissance program on student achievement in reading and mathematics. Research in the Schools, 14(1), 40.
82. Niemiec, R., & Walberg, H. J. (1987). Comparative effects of computer-assisted instruction: A synthesis of reviews. Journal of Educational Computing Research, 3, 19-37.
83. Ouyang, J. (1993). Meta-analysis: CAI at the level of elementary education. Paper presented at the World Conference on Education Multimedia and Hypermedia.
84. Papalewis, R. (2004). Struggling middle school readers: Successful, accelerating intervention. Sacramento, CA: California State University.
85. Paterson, W., Henry, J., O'Quin, K., Ceprano, M., & Blue, E. (2003). Investigating the effectiveness of an integrated learning system on early emergent readers. Reading Research Quarterly, 38(2), 172-206.
86. Pearson, P. D., Ferdig, R. E., Blomeyer, R. L., Jr., & Moran, J. (2005). The effects of technology on reading performance in the middle-school grades: A meta-analysis with recommendations for policy. Naperville, IL: Learning Point Associates.
87. Rabiner, D. L., Murray, D. W., Skinner, A. T., & Malone, P. S. (2010). Randomized trial of two promising computer-based interventions for students with attention difficulties. Journal of Abnormal Child Psychology, 38(1), 131-142.
88. Ragosta, M. (1983). Computer-assisted instruction and compensatory education: A longitudinal analysis. Machine-Mediated Learning, 1(1), 97-127.
89. Ramey, M. (1991). Compensatory Education Sustained Gains from Spring 1988 to Spring 1990. Seattle School District Report No. 9-1, March.
90. Rieber, L. P. (1996). Seriously considering play: Design interactive learning environments based on the blending of microworlds, simulations, and games. Educational Technology Research and Development, 44(2), 43-58.
91. RMC (2004). The literacy center K-1 Las Vegas project [Retrieved March 17, 2007]. From .
92. Ross, S. M. & Nunnery, J. A. (2005). The effect of school renaissance on student achievement in two Mississippi school districts. Memphis: Center for Research in Educational Policy.
93. Ross, S. M., Nunnery, J., Avis, A., & Borek, T. (2005). The effects of School Renaissance on student achievement in two Mississippi school districts: A longitudinal quasi-experimental study. Memphis: TN: Center for Research in Education Policy.
94. Roth, S., & Beck, I. (1987). Theoretical and instructional implications of the assessment of two microcomputer word recognition programs. Reading Research Quarterly, 22(2), 197-218.
95. Rouse, C. E., & Krueger, Alan. B. (2004). Putting computerized instruction to the test: A randomized evaluation of a "scientifically based"reading program. Economics of Education Review, 23(4), 323-338.
96. Roy, J.W. (1993). An investigation of the efficacy of computer-assisted mathematics, reading, and language arts instruction. Unpublished Doctoral Dissertation, Baylor University.
97. Saracho, O. (1982). The effects of a computer-assisted computer program on basic skills achievement and attitudes toward instruction of Spanish-speaking migrant children. American Educational Research Journal, 19(2), 201-219.
98. Schardt, A. M. (1997). A comparison of English language and reading skills of limited english proficient students with and without use of multimedia cd-rom literature-based software. Unpublished Doctoral Dissertation, The University of Texas at Austin.
99. Schmidt, S. (1991). Technology for the 21st century: The effects of an integrated distributive computer network system on student achievement. Unpublished Doctoral Dissertation, University of La Verne, LaVerne, CA.
100. Scholastic Research (2008). Desert Sands Unified School District, CA. New York, NY: Scholastic Inc.
101. Scientific Learning Corporation (2006). Improved reading skills by students in Boone County School District who used Fast ForWord products. Maps for Learning: Educator Reports, 10(15), 1-7.
102. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
103. SETDA, 2010. National educational technology trends: 2010. Retrieved August 1, 2010: www.setda.org.
104. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin.
105. Shneyderman, A. (2006). Some results of the voyager passport reading intervention system in several district schools. Miami, FL: Miami-Dade County Public Schools Office of Program Evaluation.
106. Sinkis, D. M., & A. (1993). A comparison of chapter one student achievement with and without computer-assisted instruction. University of Massachusetts.
107. Slavin, R. E., & Madden, N. A. (2011). Measures inherent to treatment in program effectiveness reviews. Journal of Research on Educational Effectiveness, 4(4), 370-380.
108. Slavin, R. E., & Smith, D. (2009). The relationship between sample sizes and effect sizes in systematic reviews in education. Educational Evaluation and Policy Analysis, 31(4), 500-506.
109. Slavin, R. E. (2009). Educational psychology: Theory into practice (9th ed.). Boston: Allyn & Bacon.
110. Slavin, R. E. (2008). What works? Issues in synthesizing education program evaluations. Educational Researcher, 37(1), 5-14.
111. Slavin, R. E. (1994). Quality, appropriateness, incentive, and time: A model of instructional effectiveness. International Journal of Educational Research, 21, 141-157.
112. Soe, K., Koki, S., & Chang, J. M. (2000). Effect of computer assisted instruction (CAI) on reading achievement: A meta-analysis. Washington, DC: OERI.
113. Standish, D. (1995). The effects on reading comprehension of Jostens' integrated language arts for second-grade students along with Jostens' Basic learning system for second-grade chapter 1 students. Dissertation Abstracts International, 57 (3), 1079A. (UMI No. 9623238).
114. Stein, M., Berends, M., Fuchs, D., McMaster, K., Saenz, L., Yen, L., Fuchs, L., & Comption, D. (2008). Scaling up an early reading program: Relationships among teacher support, fidelity of implementation, and student performance across different sites and years. Educational Evaluation and Policy Analysis, 30(4), 368-388.
115. Stevenson, Z., Cathey-Pugh, J., & Kosmidis, M. (1988). Achievement in the Writing to Read program: A comparative evaluation study. Washington, DC: District of Columbia Public Schools, Division of Quality Assurance and Management Planning (ERIC No. ED293147).
116. Torgesen, J. K., Wagner, R. K., Rashotte, C. A., Herron, J., & Lindamood, P. (2010). Annals of Dyslexia, 60, 40-56.
117. Tracey, D. & Young, J. (2006). Technology and early literacy: The impact of an integrated learning system on high-risk kindergartners' achievement. Pearson Digital Learning, Inc.
118. Tracey, D. H., Young, J. W. (2004). Evaluation of KidBiz3000: Bayonne Study Final Report. Lakewood, NJ: www.achieve3000.com.
119. UNESCO. (1987). Glossary of educational technology terms (2nd ed.). Division of Educational Sciences, Content, and Methods of Education. Lausanne, Switzerland: Presses Centrales.
120. Vaughan, J., Serido, J., & Wilhelm, M. (2006). The effects of my reading coach on reading achievement of elementary education students. Phoenix, AZ: Arizona Board of Regents.
121. Virvou, M., Katsionis, G., & Manos, K. (2005). Combining software games with education: Evaluation of educational effectiveness. Educational Technology and Society, 8(2), 54-65.
122. Wentink, H., Van Bon, W. H. J., & Schreuder, R. (1997). Training of poor readers' phonological decoding skills: Evidence for syllable-bound processing. Reading and Writing: An Interdisciplinary Journal, 9, 163-192.
123. Whitaker, J. C. (2005). Impact of an integrated learning system on reading and mathematics achievement. Unpublished octoral Dissertation, Tennessee State University.
124. White, R. N., Haslam, M. B., Hewes, G. M. (2006). Improving student literacy in the Phoenix Union High School District, 2003-04 and 2004-05. Final Report. Washington, DC: Policy Studies Associates.
125. Williams, B.J. (2005). A quasi-experimental study on the effects of the OpenBook to Literacy program on fourth-grade students. Unpublished Doctoral Dissertation, Tennessee State University.
126. Woods, D.E. (2007). An investigation of the effects of a middle school reading intervention on school dropout rates. Unpublished Doctoral Dissertation, Virginia Polytechnic Institute and State University.
127. Yee, V. N. (2007). An evaluation of the impact of a standards-based intervention on the academic achievement of English language learners. Unpublished Doctoral Dissertation, University of Southern California.