The effectiveness of blended learning in health professions: Systematic review and meta-analysis

Journal of Medical Internet Research

Volumn 18, Issue 1, 2016, Pages

  Liu, Qian ^a   Peng, Weijun ^a   Zhang, Fan ^a   Hu, Rong ^a   Li, Yingxue ^a   Yan, Weirong ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Blended learning; Effectiveness; Health professions; Knowledge; Meta analysis

Indexed keywords

EDUCATION; HUMAN; MEDICAL PROFESSION; META ANALYSIS; PROCEDURES; VOCATIONAL EDUCATION;

EDUCATION, DISTANCE; EDUCATION, PROFESSIONAL; HEALTH OCCUPATIONS; HUMANS;

EID: 85014464490     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.4807     Document Type: Article

References (109)

1. Bediang G, Stoll B, Geissbuhler A, Klohn AM, Stuckelberger A, Nko'o S, et al. Computer literacy and E-learning perception in Cameroon: the case of Yaounde Faculty of Medicine and Biomedical Sciences. BMC Med Educ 2013;13:57 [FREE Full text] [doi: 10.1186/1472-6920-13-57] [Medline: 23601853]
2. Sun P, Tsai RJ, Finger G, Chen Y, Yeh D. What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & Education 2008 May;50(4):1183-1202. [doi: 10.1016/j.compedu.2006.11.007]
3. Choules AP. The use of elearning in medical education: a review of the current situation. Postgrad Med J 2007 Apr;83(978):212-216 [FREE Full text] [doi: 10.1136/pgmj.2006.054189] [Medline: 17403945]
4. Berners-Lee T, Cailliau R, Luotonen A, Nielsen HF, Secret A. The World-Wide Web. Communications of the ACM 1994 Aug;37(8):76-82 [FREE Full text]
5. Cook DA. Web-based learning: pros, cons and controversies. Clinical Medicine 2007 Jan 01;7(1):37-42. [doi: 10.7861/clinmedicine.7-1-37]
6. Yu S, Yang K. Attitudes toward Web-based distance learning among public health nurses in Taiwan: a questionnaire survey. Int J Nurs Stud 2006 Aug;43(6):767-774. [doi: 10.1016/j.ijnurstu.2005.09.005] [Medline: 16253261]
7. Peng Y, Wu X, Atkins S, Zwarentein M, Zhu M, Zhan XX, et al. Internet-based health education in China: a content analysis of websites. BMC Med Educ 2014;14:16 [FREE Full text] [doi: 10.1186/1472-6920-14-16] [Medline: 24467710]
8. Wu J, Tennyson RD, Hsia T. A study of student satisfaction in a blended e-learning system environment. Computers & Education 2010 Aug;55(1):155-164. [doi: 10.1016/j.compedu.2009.12.012]
9. Moreira IC, Ventura SR, Ramos I, Rodrigues PP. Development and assessment of an e-learning course on breast imaging for radiographers: a stratified randomized controlled trial. J Med Internet Res 2015;17(1):e3 [FREE Full text] [doi: 10.2196/jmir.3344] [Medline: 25560547]
10. Wu J, Tennyson RD, Hsia T, Liao Y. Analysis of E-learning innovation and core capability using a hypercube model. Computers in Human Behavior 2008 Sep;24(5):1851-1866. [doi: 10.1016/j.chb.2008.02.008]
11. Hara N. Student distress in a Web-based distance education course. Information, Communication & Society 2000 Jan;3(4):557-579. [doi: 10.1080/13691180010002297]
12. Kemp N, Grieve R. Face-to-face or face-to-screen? Undergraduates' opinions and test performance in classroom vs. online learning. Front Psychol 2014;5:1278 [FREE Full text] [doi: 10.3389/fpsyg.2014.01278] [Medline: 25429276]
13. Conole G, de Laat M, Dillon T, Darby J. ‘Disruptive technologies’, ‘pedagogical innovation’: What’s new? Findings from an in-depth study of students’ use and perception of technology. Computers & Education 2008 Feb;50(2):511-524. [doi: 10.1016/j.compedu.2007.09.009]
14. Bonk CJ, Graham CE. The handbook of blended learning: global perspectives, local designs. San Francisco, CA: Pfeiffer; 2006.
15. Thakore H, McMahon T. Virtually there: e-learning in medical education. Clinical Teacher 2006 Dec;3(4):225-228. [doi: 10.1111/j.1743-498X.2006.00114.x]
16. Makhdoom N, Khoshhal KI, Algaidi S, Heissam K, Zolaly MA. ‘Blended learning’ as an effective teaching and learning strategy in clinical medicine: a comparative cross-sectional university-based study. Journal of Taibah University Medical Sciences 2013 Apr;8(1):12-17. [doi: 10.1016/j.jtumed.2013.01.002]
17. Moore M. Emerging practice and research in blended learning. In: Handbook of distance education. New York: Routledge; 2012.
18. Norberg A, Dziuban CD, Moskal PD. A time based blended learning model. On the Horizon 2011 Aug 16;19(3):207-216. [doi: 10.1108/10748121111163913]
19. Mars M, McLean M. Students' perceptions of a multimedia computer-aided instruction resource in histology. S Afr Med J 1996 Sep;86(9):1098-1102. [Medline: 8888778]
20. Rouse DP. The effectiveness of computer-assisted instruction in teaching nursing students about congenital heart disease. Comput Nurs 2000;18(6):282-287. [Medline: 11105402]
21. Mangione S, Nieman LZ, Greenspon LW, Margulies H. A comparison of computer-assisted instruction and small-group teaching of cardiac auscultation to medical students. Med Educ 1991 Sep;25(5):389-395. [Medline: 1758315]
22. Cho K, Shin G. Operational effectiveness of blended e-learning program for nursing research ethics. Nurs Ethics 2013 Nov 19;21(4):484-495. [doi: 10.1177/0969733013505310] [Medline: 24258252]
23. Riesen E, Morley M, Clendinneng D, Ogilvie S, Ann MM. Improving interprofessional competence in undergraduate students using a novel blended learning approach. J Interprof Care 2012 Jul;26(4):312-318. [doi: 10.3109/13561820.2012.660286] [Medline: 22559163]
24. Wallen GR, Cusack G, Parada S, Miller-Davis C, Cartledge T, Yates J. Evaluating a hybrid web-based basic genetics course for health professionals. Nurse Educ Today 2011 Aug;31(6):638-642 [FREE Full text] [doi: 10.1016/j.nedt.2010.11.001] [Medline: 21106279]
25. Sung YH, Kwon IG, Ryu E. Blended learning on medication administration for new nurses: integration of e-learning and face-to-face instruction in the classroom. Nurse Educ Today 2008 Nov;28(8):943-952. [doi: 10.1016/j.nedt.2008.05.007] [Medline: 18599162]
26. Mukti MA, Razali D, Ramli MF, Zaman HB, Ahmad A. Hybrid learning and online collaborative enhance students performance.: IEEE; 2005 Presented at: 5th IEEE International Conference on Advanced Learning Technologies; July 5-8, 2005; Taiwan p. 481-483. [doi: 10.1109/ICALT.2005.166]
27. Seabra D, Srougi M, Baptista R, Nesrallah LJ, Ortiz V, Sigulem D. Computer aided learning versus standard lecture for undergraduate education in urology. J Urol 2004 Mar;171(3):1220-1222. [doi: 10.1097/01.ju.0000114303.17198.37] [Medline: 14767306]
28. Shomaker TS, Ricks DJ, Hale DC. A prospective, randomized controlled study of computer-assisted learning in parasitology. Acad Med 2002 May;77(5):446-449. [Medline: 12010707]
29. Fleetwood J, Vaught W, Feldman D, Gracely E, Kassutto Z, Novack D. MedEthEx Online: a computer-based learning program in medical ethics and communication skills. Teach Learn Med 2000;12(2):96-104. [doi: 10.1207/S15328015TLM1202_7] [Medline: 11228685]
30. Rowe M, Frantz J, Bozalek V. The role of blended learning in the clinical education of healthcare students: a systematic review. Med Teach 2012;34(4):e216-e221. [doi: 10.3109/0142159X.2012.642831] [Medline: 22455712]
31. McCutcheon K, Lohan M, Traynor M, Martin D. A systematic review evaluating the impact of online or blended learning vs. face-to-face learning of clinical skills in undergraduate nurse education. J Adv Nurs 2015 Feb;71(2):255-270. [doi: 10.1111/jan.12509] [Medline: 25134985]
32. Jwayyed S, Stiffler KA, Wilber ST, Southern A, Weigand J, Bare R, et al. Technology-assisted education in graduate medical education: a review of the literature. Int J Emerg Med 2011;4:51 [FREE Full text] [doi: 10.1186/1865-1380-4-51] [Medline: 21824405]
33. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. JAMA 2008 Sep 10;300(10):1181-1196. [doi: 10.1001/jama.300.10.1181] [Medline: 18780847]
34. Lahti M, Välimäki M. Is computer assisted learning among nurses or nursing students more effective than traditional learning? - A mini-review. Stud Health Technol Inform 2009;146:842. [Medline: 19593011]
35. Davis D, O'Brien MA, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A. Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? JAMA 1999 Sep 1;282(9):867-874. [Medline: 10478694]
36. Mayer RE. The Cambridge handbook of multimedia learning. New York: Cambridge University Press; 2005.
37. Cook DA, Thompson WG, Thomas KG, Thomas MR, Pankratz VS. Impact of self-assessment questions and learning styles in Web-based learning: a randomized, controlled, crossover trial. Acad Med 2006 Mar;81(3):231-238. [Medline: 16501263]
38. Cook DA, McDonald FS. E-learning: is there anything special about the "E"? Perspect Biol Med 2008;51(1):5-21. [doi: 10.1353/pbm.2008.0007] [Medline: 18192762]
39. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol 2009 Oct;62(10):e1-34 [FREE Full text] [doi: 10.1016/j.jclinepi.2009.06.006] [Medline: 19631507]
40. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000 Apr 19;283(15):2008-2012. [Medline: 10789670]
41. Cook DA, Levinson AJ, Garside S. Method and reporting quality in health professions education research: a systematic review. Med Educ 2011 Mar;45(3):227-238. [doi: 10.1111/j.1365-2923.2010.03890.x] [Medline: 21299598]
42. Cook DA, Reed DA. Appraising the quality of medical education research methods: the Medical Education Research Study Quality Instrument and the Newcastle-Ottawa Scale-Education. Acad Med 2015 Aug;90(8):1067-1076. [doi: 10.1097/ACM.0000000000000786] [Medline: 26107881]
43. Wells G, Shea B, Petersen J, Welch V, Losos M. Department of Epidemiology and Community Medicine, University of Ottawa, Canada. 2015. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomized studies in meta-analysesURL:http://www.medicine.mcgill.ca/rtamblyn/Readings/ The%20Newcastle%20-%20Scale%20for%20assessing%20the%20quality%20of%20nonrandomised%20studies%20in%20meta-analyses. pdf [accessed 2015-05-30] [WebCite Cache ID 6YueVvmaa]
44. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol 2011 Apr;64(4):383-394. [doi: 10.1016/j.jclinepi.2010.04.026] [Medline: 21195583]
45. Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol 2011 Apr;64(4):395-400. [doi: 10.1016/j.jclinepi.2010.09.012] [Medline: 21194891]
46. Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol 2011 Apr;64(4):401-406. [doi: 10.1016/j.jclinepi.2010.07.015] [Medline: 21208779]
47. Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, et al. GRADE guidelines: 4. Rating the quality of evidence-study limitations (risk of bias). J Clin Epidemiol 2011 Apr;64(4):407-415. [doi: 10.1016/j.jclinepi.2010.07.017] [Medline: 21247734]
48. Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, et al. GRADE guidelines: 5. Rating the quality of evidence-publication bias. J Clin Epidemiol 2011 Dec;64(12):1277-1282. [doi: 10.1016/j.jclinepi.2011.01.011] [Medline: 21802904]
49. Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence-imprecision. J Clin Epidemiol 2011 Dec;64(12):1283-1293. [doi: 10.1016/j.jclinepi.2011.01.012] [Medline: 21839614]
50. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 7. Rating the quality of evidence-inconsistency. J Clin Epidemiol 2011 Dec;64(12):1294-1302. [doi: 10.1016/j.jclinepi.2011.03.017] [Medline: 21803546]
51. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 8. Rating the quality of evidence-indirectness. J Clin Epidemiol 2011 Dec;64(12):1303-1310. [doi: 10.1016/j.jclinepi.2011.04.014] [Medline: 21802903]
52. Guyatt GH, Oxman AD, Sultan S, Glasziou P, Akl EA, Alonso-Coello P, et al. GRADE guidelines: 9. Rating up the quality of evidence. J Clin Epidemiol 2011 Dec;64(12):1311-1316. [doi: 10.1016/j.jclinepi.2011.06.004] [Medline: 21802902]
53. Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, et al. Grading quality of evidence and strength of recommendations. BMJ 2004 Jun 19;328(7454):1490 [FREE Full text] [doi: 10.1136/bmj.328.7454.1490] [Medline: 15205295]
54. Dunlap WP, Cortina JM, Vaslow JB, Burke MJ. Meta-analysis of experiments with matched groups or repeated measures designs. Psychological Methods 1996;1(2):170-177. [doi: 10.1037/1082-989X.1.2.170]
55. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003 Sep 6;327(7414):557-560 [FREE Full text] [doi: 10.1136/bmj.327.7414.557] [Medline: 12958120]
56. Flys T, González R, Sued O, Suarez CJ, Kestler E, Sosa N, et al. A novel educational strategy targeting health care workers in underserved communities in Central America to integrate HIV into primary medical care. PLoS One 2012;7(10):e46426 [FREE Full text] [doi: 10.1371/journal.pone.0046426] [Medline: 23115628]
57. Puri R, Bell C, Evers WD. Dietetics students' ability to choose appropriate communication and counseling methods is improved by teaching behavior-change strategies in computer-assisted instruction. J Am Diet Assoc 2010 Jun;110(6):892-897. [doi: 10.1016/j.jada.2010.03.022] [Medline: 20497778]
58. Buchowski MS, Plaisted C, Fort J, Zeisel SH. Computer-assisted teaching of nutritional anemias and diabetes to first-year medical students. Am J Clin Nutr 2002 Jan;75(1):154-161 [FREE Full text] [Medline: 11756073]
59. Weaver SB, Oji V, Ettienne E, Stolpe S, Maneno M. Hybrid e-learning approach to health policy. Currents in Pharmacy Teaching and Learning 2014 Mar;6(2):313-322. [doi: 10.1016/j.cptl.2013.11.013]
60. Pereira J, Palacios M, Collin T, Wedel R, Galloway L, Murray A, et al. The impact of a hybrid online and classroom-based course on palliative care competencies of family medicine residents. Palliat Med 2008 Dec;22(8):929-937. [doi: 10.1177/0269216308094561] [Medline: 18772211]
61. Karamizadeh Z, Zarifsanayei N, Faghihi AA, Mohammadi H, Habibi M. The study of effectiveness of blended learning approach for medical training courses. Iran Red Crescent Med J 2012 Jan;14(1):41-44 [FREE Full text] [Medline: 22737553]
62. Chandler T, Qureshi K, Gebbie KM, Morse SS. Teaching emergency preparedness to public health workers: use of blended learning in web-based training. Public Health Rep 2008;123(5):676-680 [FREE Full text] [Medline: 18828425]
63. Karaksha A, Grant G, Davey A, Anoopkumar-Dukie S. Development and evaluation of computer-assisted learning (CAL) teaching tools compared to the conventional didactic lecture in pharmacology education. In: Proceedings of EDULEARN11 Conference. 2011 Presented at: EDULEARN11 Conference; July 4-6, 2011; Spain p. 3580-3589.
64. Cragun DL, Couch SC, Prows CA, Warren NS, Christianson CA. A success of a genetics educational intervention for nursing and dietetic students: A model for incorporating genetics into nursing and allied health curricula. J Allied Health 2005;34(2):90-96. [Medline: 16032915]
65. Baumlin KM, Bessette MJ, Lewis C, Richardson LD. EMCyberSchool: an evaluation of computer-assisted instruction on the Internet. Acad Emerg Med 2000 Aug;7(8):959-962 [FREE Full text] [Medline: 10958144]
66. Mahnken AH, Baumann M, Meister M, Schmitt V, Fischer MR. Blended learning in radiology: is self-determined learning really more effective? Eur J Radiol 2011 Jun;78(3):384-387. [doi: 10.1016/j.ejrad.2010.12.059] [Medline: 21288674]
67. Raupach T, Münscher C, Pukrop T, Anders S, Harendza S. Significant increase in factual knowledge with web-assisted problem-based learning as part of an undergraduate cardio-respiratory curriculum. Adv Health Sci Educ Theory Pract 2010 Aug;15(3):349-356 [FREE Full text] [doi: 10.1007/s10459-009-9201-3] [Medline: 19774475]
68. Devitt P, Smith JR, Palmer E. Improved student learning in ophthalmology with computer-aided instruction. Eye (Lond) 2001 Oct;15(Pt 5):635-639. [doi: 10.1038/eye.2001.199] [Medline: 11702976]
69. Hsu L, Hsieh S. Effects of a blended learning module on self-reported learning performances in baccalaureate nursing students. J Adv Nurs 2011 Nov;67(11):2435-2444. [doi: 10.1111/j.1365-2648.2011.05684.x] [Medline: 21592188]
70. Kaveevivitchai C, Chuengkriankrai B, Luecha Y, Thanooruk R, Panijpan B, Ruenwongsa P. Enhancing nursing students' skills in vital signs assessment by using multimedia computer-assisted learning with integrated content of anatomy and physiology. Nurse Educ Today 2009 Jan;29(1):65-72. [doi: 10.1016/j.nedt.2008.06.010] [Medline: 18703258]
71. Howerton WB, Enrique PRT, Ludlow JB, Tyndall DA. Interactive computer-assisted instruction vs. lecture format in dental education. J Dent Hyg 2004;78(4):10. [Medline: 16197750]
72. Strickland S. The effectiveness of blended learning environments for the delivery of respiratory care education. J Allied Health 2009;38(1):E11-E16. [Medline: 19753407]
73. Llambí L, Esteves E, Martinez E, Forster T, García S, Miranda N, et al. Teaching tobacco cessation skills to Uruguayan physicians using information and communication technologies. J Contin Educ Health Prof 2011;31(1):43-48. [doi: 10.1002/chp.20100] [Medline: 21425359]
74. Perkins GD, Fullerton JN, Davis-Gomez N, Davies RP, Baldock C, Stevens H, et al. The effect of pre-course e-learning prior to advanced life support training: a randomised controlled trial. Resuscitation 2010 Jul;81(7):877-881. [doi: 10.1016/j.resuscitation.2010.03.019] [Medline: 20409627]
75. Lancaster JW, McQueeney ML, Van Amburgh JA. Online lecture delivery paired with in class problem-based learning … Does it enhance student learning? Currents in Pharmacy Teaching and Learning 2011 Jan;3(1):23-29. [doi: 10.1016/j.cptl.2010.10.008]
76. Sowan AK, Jenkins LS. Use of the seven principles of effective teaching to design and deliver an interactive hybrid nursing research course. Nurs Educ Perspect 2013;34(5):315-322. [Medline: 24245382]
77. Lancaster JW, Wong A, Roberts SJ. 'Tech' versus 'talk': a comparison study of two different lecture styles within a Master of Science nurse practitioner course. Nurse Educ Today 2012 Jul;32(5):e14-e18. [doi: 10.1016/j.nedt.2011.09.018] [Medline: 22071277]
78. Dankbaar MW, Storm DJ, Teeuwen IC, Schuit SE. A blended design in acute care training: similar learning results, less training costs compared with a traditional format. Perspect Med Educ 2014 Sep;3(4):289-299 [FREE Full text] [doi: 10.1007/s40037-014-0109-0] [Medline: 24477971]
79. Stewart A, Inglis G, Jardine L, Koorts P, Davies MW. A randomised controlled trial of blended learning to improve the newborn examination skills of medical students. Arch Dis Child Fetal Neonatal Ed 2013 Mar;98(2):F141-F144. [doi: 10.1136/archdischild-2011-301252] [Medline: 22684155]
80. Lowe CI, Wright JL, Bearn DR. Computer-aided Learning (CAL): an effective way to teach the Index of Orthodontic Treatment Need (IOTN)? J Orthod 2001 Dec;28(4):307-311. [doi: 10.1093/ortho/28.4.307] [Medline: 11709597]
81. Arroyo-Morales M, Cantarero-Villanueva I, Fernández-Lao C, Guirao-Piñeyro M, Castro-Martín E, Díaz-Rodríguez L. A blended learning approach to palpation and ultrasound imaging skills through supplementation of traditional classroom teaching with an e-learning package. Man Ther 2012 Oct;17(5):474-478. [doi: 10.1016/j.math.2012.04.002] [Medline: 22579034]
82. Kiviniemi MT. Effects of a blended learning approach on student outcomes in a graduate-level public health course. BMC Med Educ 2014;14:47 [FREE Full text] [doi: 10.1186/1472-6920-14-47] [Medline: 24612923]
83. Kumrow DE. Evidence-based strategies of graduate students to achieve success in a hybrid Web-based course. J Nurs Educ 2007 Mar;46(3):140-145. [Medline: 17396555]
84. Gadbury-Amyot CC, Singh AH, Overman PR. Teaching with technology: learning outcomes for a combined dental and dental hygiene online hybrid oral histology course. J Dent Educ 2013 Jun;77(6):732-743 [FREE Full text] [Medline: 23740910]
85. Gagnon M, Gagnon J, Desmartis M, Njoya M. The impact of blended teaching on knowledge, satisfaction, and self-directed learning in nursing undergraduates: a randomized, controlled trial. Nurs Educ Perspect 2013;34(6):377-382. [Medline: 24475598]
86. Boynton JR, Green TG, Johnson LA, Nainar SMH, Straffon LH. The virtual child: evaluation of an internet-based pediatric behavior management simulation. J Dent Educ 2007 Sep;71(9):1187-1193 [FREE Full text] [Medline: 17761625]
87. Kulier R, Gülmezoglu AM, Zamora J, Plana MN, Carroli G, Cecatti JG, et al. Effectiveness of a clinically integrated e-learning course in evidence-based medicine for reproductive health training: a randomized trial. JAMA 2012 Dec 5;308(21):2218-2225. [doi: 10.1001/jama.2012.33640] [Medline: 23212499]
88. Kavadella A, Tsiklakis K, Vougiouklakis G, Lionarakis A. Evaluation of a blended learning course for teaching oral radiology to undergraduate dental students. Eur J Dent Educ 2012 Feb;16(1):e88-e95. [doi: 10.1111/j.1600-0579.2011.00680.x] [Medline: 22251359]
89. Woltering V, Herrler A, Spitzer K, Spreckelsen C. Blended learning positively affects students' satisfaction and the role of the tutor in the problem-based learning process: results of a mixed-method evaluation. Adv Health Sci Educ Theory Pract 2009 Dec;14(5):725-738. [doi: 10.1007/s10459-009-9154-6] [Medline: 19184497]
90. Ilic D, Hart W, Fiddes P, Misso M, Villanueva E. Adopting a blended learning approach to teaching evidence based medicine: a mixed methods study. BMC Med Educ 2013;13:169 [FREE Full text] [doi: 10.1186/1472-6920-13-169] [Medline: 24341502]
91. Carbonaro M, King S, Taylor E, Satzinger F, Snart F, Drummond J. Integration of e-learning technologies in an interprofessional health science course. Med Teach 2008 Feb;30(1):25-33. [doi: 10.1080/01421590701753450] [Medline: 18278648]
92. Pereira JA, Pleguezuelos E, Merí A, Molina-Ros A, Molina-Tomás MC, Masdeu C. Effectiveness of using blended learning strategies for teaching and learning human anatomy. Med Educ 2007 Feb;41(2):189-195. [doi: 10.1111/j.1365-2929.2006.02672.x] [Medline: 17269953]
93. Raupach T, Muenscher C, Anders S, Steinbach R, Pukrop T, Hege I, et al. Web-based collaborative training of clinical reasoning: a randomized trial. Med Teach 2009 Sep;31(9):e431-e437. [Medline: 19811180]
94. Sherman H, Comer L, Putnam L, Freeman H. Blended versus lecture learning: outcomes for staff development. J Nurses Staff Dev 2012 Jul;28(4):186-190. [doi: 10.1097/NND.0b013e31825dfb71] [Medline: 22821022]
95. Gerdprasert S, Pruksacheva T, Panijpan B, Ruenwongsa P. Development of a web-based learning medium on mechanism of labour for nursing students. Nurse Educ Today 2010 Jul;30(5):464-469. [doi: 10.1016/j.nedt.2009.10.007] [Medline: 19931950]
96. Wahlgren C, Edelbring S, Fors U, Hindbeck H, Ståhle M. Evaluation of an interactive case simulation system in dermatology and venereology for medical students. BMC Med Educ 2006;6:40 [FREE Full text] [doi: 10.1186/1472-6920-6-40] [Medline: 16907972]
97. Farrell MJ, Rose L. Use of mobile handheld computers in clinical nursing education. J Nurs Educ 2008 Jan;47(1):13-19. [Medline: 18232610]
98. Taradi SK, Taradi M, Radic K, Pokrajac N. Blending problem-based learning with Web technology positively impacts student learning outcomes in acid-base physiology. Adv Physiol Educ 2005 Mar;29(1):35-39 [FREE Full text] [doi: 10.1152/advan.00026.2004] [Medline: 15718381]
99. de Sousa EE, de Arruda MM, Ferreira MJ. Oral health promotion through an online training program for medical students. J Dent Educ 2011 May;75(5):672-678 [FREE Full text] [Medline: 21546601]
100. Hilger AE, Hamrick HJ, Denny FW. Computer instruction in learning concepts of streptococcal pharyngitis. Arch Pediatr Adolesc Med 1996 Jun;150(6):629-631. [Medline: 8646314]
101. Teeraporn C. Computer-aided learning for medical chart review instructions. Afr J Pharm Pharmacol 2012 Jul 22;6(27):2061-2067. [doi: 10.5897/AJPP12.269]
102. Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale, NJ: L. Erlbaum Associates; 1988.
103. Maki RH, Maki WS, Patterson M, Whittaker PD. Evaluation of a Web-based introductory psychology course: I. Learning and satisfaction in on-line versus lecture courses. Behav Res Methods Instrum Comput 2000 May;32(2):230-239. [Medline: 10875167]
104. Cruickshank DR, Jenkins DB, Metcalf KK. The act of teaching. Boston: McGraw-Hill; 2006.
105. Hartley J, Davies IK. Preinstructional Strategies: The Role of Pretests, Behavioral Objectives, Overviews and Advance Organizers. Review of Educational Research 1976 Jan 01;46(2):239-265. [doi: 10.3102/00346543046002239]
106. Wilson JD. Subjective assessment. In: Evaluation of human work: a practical ergonomics methodology. Washington: Taylor & Francis; 1995.
107. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Acad Med 2010 May;85(5):909-922. [doi: 10.1097/ACM.0b013e3181d6c319] [Medline: 20520049]
108. Manochehr NN. Computers in Higher Education Economics Review. 2006. The influence of learning styles on learners in e-learning environments: An empirical studyURL:http://www.webcitation.org/6Yug8S5O3 [accessed 2015-05-30]
109. Wong G, Greenhalgh T, Pawson R. Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Med Educ 2010;10:12 [FREE Full text] [doi: 10.1186/1472-6920-10-12] [Medline: 20122253]