The effectiveness of online and blended learning: A meta-analysis of the empirical literature

Teachers College Record

Volumn 115, Issue 3, 2013, Pages

  Means, Barbara ^a   Toyama, Yukie ^a   Murphy, Robert ^a   Baki, Marianne ^a  

^a SRI INTERNATIONAL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84886691803     PISSN: 01614681     EISSN: 14679620     Source Type: Journal    
DOI: None     Document Type: Article

References (109)

1. Aberson, C. L., Berger, D. E., & Romero, V. L. (2003). Evaluation of an interactive tutorial for teaching hypothesis testing concepts. Teaching of Psychology, 30(1), 75-78.
2. Al-Jarf, R. S. (2004). The effects of Web-based learning on struggling EFL college writers. Foreign Language Annals, 37(1), 49-57.
3. Allen, I. E., & Seaman, J. (2003). Sizing the opportunity: The quality and extent of online education in the United States, 2002 and 2003. Retrieved from http://sloanconsortium.org/publications/ survey/sizing_the_opportunity2003
4. Allen, I. E., & Seaman, J. (2010). Learning on demand : Online education in the United States, 2009. Retrieved from http://www.sloan c.org/publications/survey/pdf/learningon demand.pdf
5. Barab, S. A., Squire, K., & Dueber, B. (2000). Supporting authenticity through participatory learning. Educational Technology Research and Development, 48(2), 37-62.
6. Barab, S. A., & Thomas, M. K. (2001). Online learning: From information dissemination to fostering collaboration. Journal of Interactive Learning Research, 12(1), 105-143.
7. Bates, A. W. (1997). The future of educational technology. Learning Quarterly, 2, 7-16.
8. Beeckman, D., Schoonhoven, L., Boucque, H., Van Maele, G., & Defloor, T. (2008). Pressure ulcers: E-learning to improve classification by nurses and nursing students. Journal of Clinical Nursing, 17(13), 1697-1707.
9. Bello, G., Pennisi, M. A., Maviglia, R., Maggiore, S. M., Bocci, M. G., Montini, L., & Antonelli, M. (2005). Online vs. live methods for teaching difficult airway management to anesthesiology residents. Intensive Care Medicine, 31(4), 547-552.
10. Benjamin, S. E., Tate, D. F., Bangdiwala, S. I., Neelon, B. H., Ammerman, A. S., Dodds, J. M., & Ward, D. S. (2008). Preparing child care health consultants to address childhood overweight: A randomized controlled trial comparing web to in-person training. Maternal and Child Health Journal, 12(5), 662-669.
11. Bernard, R. M., Abrami, P. C., Lou, Y., Borokhovski, E., Wade, A., Wozney, L., Wallet, P. A., . . . Huang, B. (2004). How does distance education compare with classroom instruction? A meta-analysis of the empirical literature. Review of Educational Research, 74(3), 379-439.
12. Bersin, J. (2004). The blended learning book: best practices, proven methodologies, and lessons learned. San Francisco, CA: Wiley.
13. Bethel, E. C., & Bernard, R. M. (2010). Developments and trends in synthesizing diverse forms of evidence: Beyond comparisons between distance education and classroom instruction. Distance Education, 31(3), 231-256.
14. Beyea, J. A., Wong, E., Bromwich, M., Weston, W. W., & Fung, K. (2008). Evaluation of a particle repositioning maneuver web-based teaching module. The Laryngoscope, 118(1), 175-180.
15. Bhattacharya, M. (1999). A study of asynchronous and synchronous discussion on cognitive maps in a distributed learning environment. In Proceedings of WebNet World Conference on the WWW and Internet 1999 (pp. 100-105). Chesapeake, VA: AACE.
16. Biostat Solutions. (2006). Comprehensive Meta-Analysis (Version 2.2.027). Mt. Airy, MD: Biostat Solutions.
17. Bonk, C. J., & Graham, C. R. (Eds.). (2005). Handbook of blended learning: Global perspectives, local designs. San Francisco, CA: Pfeiffer.
18. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, England: Wiley.
19. Bransford, J. D., Brown, A. L., & Cocking, R. R. (1999). How people learn: Brain, mind, experience, and school. Washington, DC: National Academy Press.
20. Caldwell, E. R. (2006). A comparative study of three instructional modalities in a computer programming course: Traditional instruction, web-based instruction, and online instruction (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. AAT 3227694)
21. Cavanaugh, C. (2001). The effectiveness of interactive distance education technologies in K-12 learning: A meta-analysis. International Journal of Educational Telecommunications, 7(1), 73-78.
22. Cavanaugh, C., Gillan, K. J., Kromrey, J., Hess, M., & Blomeyer, R. (2004). The effects of distance education on K-12 student outcomes: A meta-analysis. Retrieved from http://www.ncrel.org/tech/distance/index.html
23. Cavus, N., Uzonboylu, H., & Ibrahim, D. (2007). Assessing the success rate of students using a learning management system together with a collaborative tool in web-based teaching of programming languages. Journal of Educational Computing Research, 36(3), 301-321.
24. Childs, J. M. (2001). Digital skill training research: Preliminary guidelines for distributed learning (Final report). Retrieved from http://www.stormingmedia.us/24/2471/A247193.htm
25. Christensen, C. M., Horn, M. B., & Johnson, C. W. (2008). Disrupting class: How disrupting innovation will change the way the world learns. New York, NY: McGraw-Hill.
26. Clark, R. E. (1983). Reconsidering research on learning from media. Review of Educational Research, 53(4), 445-449.
27. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
28. Davis, J. D., Odell, M., Abbitt, J., & Amos, D. (1999, March). Developing online courses: A comparison of web-based instruction with traditional instruction. Paper presented at the Society for Information Technology & Teacher Education International Conference, Chesapeake, Va. Retrieved from http://www.editlib.org/INDEX.CFM?fuseaction=Reader.View Abstract&paper_id=7520
29. Day, T. M., Raven, M. R., & Newman, M. E. (1998). The effects of World Wide Web instruction and traditional instruction and learning styles on achievement and changes in student attitudes in a technical writing in agricommunication course. Journal of Agricultural Education, 39(4), 65-75.
30. DeBord, K. A., Aruguete, M. S., & Muhlig, J. (2004). Are computer-assisted teaching methods effective?. Teaching of Psychology, 31(1), 65-68.
31. Dede, C. (2000). The role of emerging technologies for knowledge mobilization, dissemination, and use in education. Paper commissioned by the Office of Educational Research and Improvement, U.S. Department of Education.
32. Dede, C. (Ed.). (2006). Online professional development for teachers: Emerging models and methods. Cambridge, MA: Harvard Education Publishing Group.
33. Dynarski, M., Agodini, R., Heavisude, S., Novak, T., Carey, N., Campuzano, L., . . . Sussex, W. (2007). Effectiveness of reading and mathematics software products: Findings from the first student cohort. Report to Congress. NCEE 2007-4006. Washington, DC: U.S. Department of Education.
34. El-Deghaidy, H., & Nouby, A. (2008). Effectiveness of a blended e-learning cooperative approach in an Egyptian teacher education programme. Computers & Education, 51(3), 988-1006.
35. Ellis, R. C. T., Wood, G. D., & Thorpe, T. (2004). Technology-based learning and the project manager. Engineering, Construction and Architectural Management, 11(5), 358-365.
36. Englert, C. S., Zhao, Y., Dunsmore, K., Collings, N. Y., & Wolbers, K. (2007). Scaffolding the writing of students with disabilities through procedural facilitation: Using an Internet-based technology to improve performance. Learning Disability Quarterly, 30(1), 9-29.
37. Feng, M., Heffernan, N.T., & Koedinger, K.R. (2010). Using data mining findings to aid searching for better cognitive models. In V. Aleven, J. Kay, & J. Mostow (Eds.), Proceedings of the International Conference on Intelligent Tutoring Systems (pp. 368-370). Heidelberg, Berlin, Germany: Springer.
38. Florida TaxWatch. (2007). Final report: A comprehensive assessment of Florida virtual school. Retrieved from http://www.floridataxwatch.org/resources/pdf/110507FinalReport FLVS.pdf
39. Frederickson, N., Reed, P., & Clifford, V. (2005). Evaluating Web-supported learning versus lecture-based teaching: Quantitative and qualitative perspectives. Higher Education, 50(4), 645-664.
40. Galvis, A. H., McIntyre, C., & Hsi, S. (2006). Framework for the design and delivery of effective global blended learning experiences. Report prepared for the World Bank Group, Human Resources Leadership and Organizational Effectiveness Unit. Unpublished manuscript.
41. Gilliver, R. S., Randall, B., & Pok, Y. M. (1998). Learning in cyberspace: Shaping the future. Journal of Computer Assisted Learning, 14(3), 212-222.
42. Graham, C. R. (2005). Blended learning systems: Definition, current trends, and future directions. In C. J. Bonk & C. R. Graham (Eds.), Handbook of blended learning: Global perspectives, local designs (pp. 3-21). San Francisco, CA: Pfeiffer.
43. Hairston, N. R. (2007). Employees' attitudes toward e-learning: Implications for policy in industry environments (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. AAT 3257874)
44. Harris, J. M., Elliott, T. E., Davis, B. E., Chabal, C., Fulginiti, J. V., & Fine, P. G. (2008). Educating generalist physicians about chronic pain: Live experts and online education can provide durable benefits. Pain Medicine, 9(5), 555-563.
45. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
46. Hermann, F., Rummel, N., & Spada, H. (2001). Solving the case together: The challenge of net-based interdisciplinary collaboration. In P. Dillenbourg, A. Eurelings, & K. Hakkarainen (Eds.), European perspectives on computer-supported collaborative learning (pp. 293-300). Proceedings of the European conference on computer-supported collaborative learning. Maastricht, The Netherlands: McLuhan Institute.
47. Horn, M. B., & Staker, H. (2011). The rise of K-12 blended learning. Innosight Institute. Retrieved from http://www.innosightinstitute.org/media room/publications/educationpublications
48. Hugenholtz, N. I. R., de Croon, E. M., Smits, P. B., van Dijk, F. J. H., & Nieuwenhuijsen, K. (2008). Effectiveness of e-learning in continuing medical education for occupational physicians. Occupational Medicine, 58(5), 370-372.
49. Jang, K. S., Hwang, S. Y., Park, S. J., Kim, Y. M., & Kim, J. (2005). Effects of a Web-based teaching method on undergraduate nursing students' learning of electrocardiography. Journal of Nursing Education, 44(1), 35-39.
50. Jonassen, D. H., Lee, C. B., Yang, C.C., & Laffey, J. (2005). The collaboration principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 247-270). New York, NY: Cambridge University Press.
51. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis (Vol. 49). Thousand Oaks, CA: Sage.
52. Long, M., & Jennings, H. (2005). "Does it work?":The impact of technology and professional development on student achievement. Calverton, MD: Macro International.
53. Lowry, A. E. (2007). Effects of online versus face-to-face professional development with a team-based learning community approach on teachers' application of a new instructional practice (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. AAT 3262466)
54. Machtmes, K., & Asher, J. W. (2000). A meta-analysis of the effectiveness of telecourses in distance education. American Journal of Distance Education, 14(1), 27-46.
55. Maki, W. S., & Maki, R. H. (2002). Multimedia comprehension skill predicts differential outcomes of Web-based and lecture courses. Journal of Experimental Psychology: Applied, 8(2), 85-98.
56. Martyn, M. (2003). The hybrid online model: Good practice. Educause Quarterly. Retrieved from http://www.educause.edu/ir/library/pdf/EQM0313.pdf
57. Mentzer, G. A., Cryan, J., & Teclehaimanot, B. (2007). A comparison of face-to-face and Web-based classrooms. Journal of Technology and Teacher Education, 15(2), 233-246.
58. Midmer, D., Kahan, M., & Marlow, B. (2006). Effects of a distance learning program on physicians' opioid- and benzodiazepine-prescribing skills. Journal of Continuing Education in the Health Professions, 26(4), 294-301.
59. National Survey of Student Engagement. (2008). Promoting engagement for all students: the imperative to look within. Bloomington: Indiana University, Center for Postsecondary Research. Retrieved from http://www.nsse.iub.edu
60. Nguyen, H. Q., Donesky-Cuenco, D., Wolpin, S., Reinke, L. F., Benditt, J. O., Paul, S. M., & Carrieri-Kohlman, V. (2008). Randomized controlled trial of an Internet-based versus face-to-face dyspnea self-management program for patients with chronic obstructive pulmonary disease: Pilot study. Journal of Medical Internet Research. Retrieved from http://www.jmir.org/2008/2/e9/
61. Ocker, R. J., & Yaverbaum, G. J. (1999). Asynchronous computer-mediated communication versus face-to-face collaboration: Results on student learning, quality and satisfaction. Group Decision and Negotiation, 8(5), 427-440.
62. O'Dwyer, L. M., Carey, R., & Kleiman, G. (2007). A study of the effectiveness of the Louisiana Algebra I online course. Journal of Research on Technology in Education, 39(3), 289-306.
63. Padalino, Y., & Peres, H. H. C. (2007). E-learning: A comparative study for knowledge apprehension among nurses. Revista Latino-Americana de Enfermagem, 15, 397-403.
64. Paradise, A. (2008). 2007 State of the industry report. Alexandria, VA: American Society of Training and Development.
65. Parsad, B., & Lewis, L. (2008). Distance education at degree-granting postsecondary institutions: 2006-07. Washington, DC: National Center for Education Statistics, U.S. Department of Education.
66. Pearson, P. D., Ferdig, R. E., Blomeyer, R. L., Jr., & Moran, J. (2005). The effects of technology on reading performance in the middle school grades: A meta-analysis with recommendations for policy. Naperville, IL: Learning Point Associates.
67. Peterson, C. L., & Bond, N. (2004). Online compared to face-to-face teacher preparation for learning standards-based planning skills. Journal of Research on Technology in Education, 36(4), 345-361.
68. Picciano, A. G., & Seaman, J. (2007). K-12 online learning: A survey of U.S. school district administrators. Retrieved from http://www.sloan c.org/publications/survey/K-12_06.asp
69. Picciano, A. G., & Seaman, J. (2008). Staying the course: Online education in the United States. Retrieved from http://www.sloan c.org/publications/survey/pdf/staying_the_ course.pdf
70. Riel, M., & Polin, L. (2004). Online communities: Common ground and critical differences in designing technical environments. In S. A. Barab, R. Kling, & J. H. Gray (Ed.), Designing for virtual communities in the service of learning (pp. 16-50). Cambridge, England: Cambridge University Press.
71. Rockman et al. (2007). ED PACE final report. Submitted to the West Virginia Department of Education. Retrieved from http://www.rockman.com/projects/146.ies.edpace/finalreport
72. Rooney, J. E. (2003). Blending learning opportunities to enhance educational programming and meetings. Association Management, 55(5), 26-32.
73. Rudestam, K. E., & Schoenholtz-Read, J. (2010). The flourishing of adult online education: An overview. In K. E. Rudestam, & J. Schoenholtz-Read (Ed.), Handbook of online learning (pp. 1-18). Los Angeles, CA: Sage.
74. Schilling, K., Wiecha, J., Polineni, D., & Khalil, S. (2006). An interactive web-based curriculum on evidence-based medicine: Design and effectiveness. Family Medicine, 38(2), 126-132.
75. Schmeeckle, J. M. (2003). Online training: An evaluation of the effectiveness and efficiency of training law enforcement personnel over the Internet. Technology, 12(3), 205-260.
76. Schoenfeld-Tacher, R., McConnell, S., & Graham, M. (2001). Do no harm: A comparison of the effects of online vs. traditional delivery media on a science course. Journal of Science Education and Technology, 10(3), 257-265.
77. Schwen, T. M., & Hara, N. (2004). Community of practice: A metaphor for online design. In S. A. Barab, R. Kling, & J. H. Gray (Eds.), Designing for virtual communities in the service of learning (pp. 154-178). Cambridge, England: Cambridge University Press.
78. Shotsberger, P. G. (1999). Forms of synchronous dialogue resulting from web-based professional development. In J. Price et al. (Eds.), Proceedings of Society for Information Technology & Teacher Education International Conference 1999 (pp. 1777-1782). Chesapeake, VA: AACE.
79. Sexton, J. S., Raven, M. R., & Newman, M. E. (2002). A comparison of traditional and World Wide Web methodologies, computer anxiety, and higher order thinking skills in the inservice training of Mississippi 4-H extension agents. Journal of Agricultural Education, 43(3), 25-36.
80. Sitzmann, T., Kraiger, K. , Stewart, D., & Wisher, R. (2006). The comparative effectiveness of web-based and classroom instruction: A meta-analysis. Personnel Psychology, 59, 623-664.
81. Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752-760.
82. Smith, M. S. (2009). Opening education. Science, 323(5910), 89-93.
83. Smith, R., Clark, T., & Blomeyer, R. (2005) A synthesis of new research on K-12 online learning. Naperville, IL: Learning Point Associates.
84. Spires, H. A., Mason, C., Crissman, C., & Jackson, A. (2001). Exploring the academic self within an electronic mail environment. Research and Teaching in Developmental Education, 17(2), 5-14.
85. Suter, W. N., & Perry, M. K. (1997). Evaluation by electronic mail. Paper presented at the annual meeting of the Mid-South Educational Research Association, Memphis, TN.
86. Tallent-Runnels, M. K., Thomas, J. A., Lan, W. Y., Cooper, S., Ahern, T. C., Shaw, S. M., & Liu, X. (2006). Teaching courses online: A review of research. Review of Educational Research, 76, 93-135.
87. Taylor, J. C. (2001). Fifth generation distance education. Paper presented at the 20th ICDE World Conference, Düsseldorf, Germany. Retrieved from http://www.usq.edu.au/users/ taylorj/conferences.htm
88. Turner, M. K., Simon, S. R., Facemyer, K. C., Newhall, L. M., & Veach, T. L. (2006). Webbased learning versus standardized patients for teaching clinical diagnosis: A randomized, controlled, crossover trial. Teaching and Learning in Medicine, 18(3), 208-214.
89. Urban, C. Q. (2006). The effects of using computer-based distance education for supplemental instruction compared to traditional tutorial sessions to enhance learning for students at-risk for academic difficulties (Doctoral dissertation). George Mason University, Fairfax, VA.
90. U.S. Department of Education. (2010). Transforming American education: Learning powered by technology. National Education Technology Plan 2010. Washington, DC: Author.
91. Veerman, A., & Veldhuis-Diermanse, E. (2001). Collaborative learning through computermediated communication in academic education. In P. Dillenbourg, A. Eurelings, & K. Hakkarainen (Eds.), European perspectives on computer-supported collaborative learning. Proceedings of the First European Conference on CSCL. Maastricht, The Netherlands: McLuhan Institute, University of Maastricht.
92. Vandeweerd, J.-M. E. F., Davies, J. C., Pichbeck, G. L., & Cotton, J. C. (2007). Teaching veterinary radiography by e-learning versus structured tutorial: A randomized, singleblinded controlled trial. Journal of Veterinary Medical Education, 34(2), 160-167.
93. Vrasidas, C., & Glass, G. V. (2004). Teacher professional development: Issues and trends. In C. Vrasidas & G. V. Glass (Eds.), Online professional development for teachers (pp. 1-12). Greenwich, CT: Information Age.
94. Wallace, P. E., & Clariana, R. B. (2000). Achievement predictors for a computer-applications module delivered online. Journal of Information Systems Education, 11(1/2), 13-18.
95. Wang, L. (2008). Developing and evaluating an interactive multimedia instructional tool: Learning outcomes and user experiences of optometry students. Journal of Educational Multimedia and Hypermedia, 17(1), 43-57.
96. Watson, J. F. (2008). Blended learning: The convergence of online learning and face-to-face education. Retrieved from http://www.inacol.org/resources/promisingpractices/NACOL_PPBlendedLearning- lr.pdf
97. Watson, J. F., Gemin, B., Ryan, J., & Wicks, M. (2009). Keeping pace with K-12 online learning: A review of state-level policy and practice. Retrieved from http://www.kpk12.com/downloads/ KeepingPace09-fullreport.pdf
98. WestEd with Edvance Research. (2008). Evaluating online learning: Challenges and strategies for success. Retrieved from http://evalonline.ed.gov/
99. What Works Clearinghouse. (2007). Technical details of WWC-conducted computations. Washington, DC: Author.
100. Whitehouse, P. L., Breit, L. A., McCloskey, E. M., Ketelhut, D. J., & Dede, C. (2006). An overview of current findings from empirical research on online teacher professional development. In C. Dede (Ed.), Online professional development for teachers: Emerging models and methods (pp. 13-29). Cambridge, MA: Harvard University Press.
101. Wise, B., & Rothman, R. (2010, June). The online learning imperative: A solution to three looking crises in education. Washington, DC: Alliance for Excellent Education.
102. Wisher, R. A., & Olson, T. M. (2003). The effectiveness of web-based training. Alexandria, VA: U.S. Army Research Institute.
103. Wylie, R., Koedinger, K. R., & Mitamura, T. (2009, July-August). Is self-explanation always better?. The effects of adding self-explanation prompts to an English grammar tutor. In Proceedings of the 31st Annual Conference of the Cognitive Science Society. Amsterdam, The Netherlands.
104. Young, J. (2002). "Hybrid" teaching seeks to end the divide between traditional and online instruction: By blending approaches, colleges hope to save money and meet students' needs. Retrieved from http://chronicle.com/free/v48/i28/28a03301.htm
105. Zacharia, Z. C. (2007). Comparing and combining real and virtual experimentation: An effort to enhance students' conceptual understanding of electric circuits. Journal of Computer Assisted Learning, 23(2), 120-132.
106. Zhang, D. (2005). Interactive multimedia-based e-learning: A study of effectiveness. American Journal of Distance Education, 19(3), 149-162.
107. Zhang, D., Zhou, L., Briggs, R. O., & Nunamaker, J. F., Jr. (2006). Instructional video in elearning: Assessing the impact of interactive video on learning effectiveness. Information and Management, 43(1), 15-27.
108. Zhao, Y., Lei, J., Yan, B., Lai, C., & Tan, H. S. (2005). What makes the difference? A practical analysis of research on the effectiveness of distance education. Teachers College Record, 107(8), 1836-1884.
109. Zirkle, C. (2003). Distance education and career and technical education: A review of the research literature. Journal of Vocational Education Research, 28(2), 161-181.