Online digital education for postregistration training of medical doctors: Systematic review by the digital health education collaboration

Journal of Medical Internet Research

Volumn 21, Issue 2, 2019, Pages

  George, Pradeep Paul ^a,b,c   Zhabenko, Olena ^c   Myint Kyaw, Bhone ^c   Antoniou, Panagiotis ^d   Posadzki, Pawel ^c   Saxena, Nakul ^e   Semwal, Monika ^c   Tudor Car, Lorainne ^c   Zary, Nabil ^c,f,g   Lockwood, Craig ^b   Car, Josip ^c,h  

^a NATIONAL HEALTHCARE GROUP   (Singapore)

^b UNIVERSITY OF ADELAIDE   (Australia)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^d ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^e Novartis   (Singapore)

^f KAROLINSKA INSTITUTE   (Sweden)

^g MOHAMMED VI UNIVERSITY OF HEALTH SCIENCES   (Morocco)

^h UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Effectiveness; Internet; Medical education; Randomized controlled trials; Systematic review

Indexed keywords

EDUCATION; HUMAN; LEARNING; MEDICAL EDUCATION; PHYSICIAN; PROCEDURES;

EDUCATION, DISTANCE; EDUCATION, MEDICAL; HUMANS; LEARNING; PHYSICIANS;

EID: 85062059549     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/13269     Document Type: Review

References (124)

1. Bleakley A, Bligh J, Browne J. Medical Education For The Future. Berlin, Germany: Springer Science & Business Media; 2019.
2. Chen N, Wang Y. Cyber schooling framework: Improving mobility and situated learning. Intl Journal of Eng Ed 2007;23:421-433 [FREE Full _text] [doi: 10.1109/ICALT.2005.99]
3. Clark D. Psychological myths in e-learning. Med Teach 2002 Nov;24(6):598-604 [FREE Full _text] [doi: 10.1080/0142159021000063916] [Medline: 12623452]
4. Cook DA. The research we still are not doing: an agenda for the study of computer-based learning. Acad Med 2005 Jun;80(6):541-548. [Medline: 15917356]
5. Sangrà A, Vlachopoulos D, Cabrera N. Building an inclusive definition of e-learning: an approach to the conceptual framework. Int Rev Res Open Distance Learn 2012;13:a.
6. Cook DA, Garside S, Levinson AJ, Dupras DM, Montori VM. What do we mean by web-based learning? A systematic review of the variability of interventions. Med Educ 2010 Aug;44(8):765-774. [doi: 10.1111/j.1365-2923.2010.03723.x] [Medline: 20633216]
7. Duque G, Demontiero O, Whereat S, Gunawardene P, Leung O, Webster P, et al. Evaluation of a blended learning model in geriatric medicine: a successful learning experience for medical students. Australas J Ageing 2013 Jun;32(2):103-109. [doi: 10.1111/j.1741-6612.2012.00620.x] [Medline: 23773249]
8. Makhdoom N, Khoshhal KI, Algaidi S, Heissam K, Zolaly MA. ‘Blended learning’ as an effective teaching and learning strategy in clinical medicine: a comparative cross-sectional university-based study. Journal of Taibah University Medical Sciences 2013 Apr;8(1):12-17. [doi: 10.1016/j.jtumed.2013.01.002]
9. Rowe M, Frantz J, Bozalek V. The role of blended learning in the clinical education of healthcare students: a systematic review. Med Teach 2012 Mar;34(4):e216-e221. [doi: 10.3109/0142159X.2012.642831] [Medline: 22455712]
10. George PP, Papachristou N, Belisario JM, Wang W, Wark PA, Cotic Z, et al. Online eLearning for undergraduates in health professions: A systematic review of the impact on knowledge, skills, attitudes and satisfaction. J Glob Health 2014 Jun;4(1):010406 [FREE Full _text] [doi: 10.7189/jogh.04.010406] [Medline: 24976965]
11. The Complexities of Physician Supply and Demand: Projections from 2013 to 2025. Washington, DC: Association of American Medical Colleges; 2015. URL: https://www.aamc.org/download/426248/data/ thecomplexitiesofphysiciansupplyanddemandprojectionsfrom2013to2.pdf [accessed 2019-02-12] [WebCite Cache ID 768UjV7lr]
12. Health and Care Professions Council. 2015. Continuing professional development (CPD) URL: https://www.hcpc-uk.org/cpd/ [accessed 2019-02-12] [WebCite Cache ID _768UriLWo]
13. Ally M. Foundations of educational theory for online learning. In: The Theory and Practice of Online Learning. Athabasca, Alberta: Athabasca University Press; 2004:15-44.
14. Rovai A. The International Review of Research in Open and Distributed Learning. 2002 Apr 01. Building Sense of Community at a Distance URL: http://www.irrodl.org/index.php/irrodl/article/view/79 [accessed 2019-02-12] [WebCite Cache ID _768V8cinI]
15. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. JAMA 2008 Sep 10;300(10):1181-1196. [doi: 10.1001/jama.300.10.1181] [Medline: 18780847]
16. Tudor CL, Riboli-Sasco E, Marcano BJ, Nikolaou CK, Majeed A, Zary N, et al. PROSPERO CRD42015029786. 2015. Mobile learning for delivering health professional education [Cochrane Protocol] URL: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42015029786 [accessed 2019-02-12] [WebCite Cache ID _768Op29KF]
17. Hervatis V, Kyaw B, Semwal M, Dunleavy G, Tudor CL, Zary N, et al. PROSPERO CRD42016045679. 2018. Offline and computer-based eLearning interventions for medical students' education [Cochrane Protocol] URL: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42016045679 [accessed 2019-02-12] [WebCite Cache ID _768PDW4wz]
18. Kononowicz A, Woodham L, Georg C, Edelbring S, Stathakarou N, Davies D, et al. PROSPERO CRD42016045912. 2016. Virtual patient simulations for health professional education [Cochrane Protocol] URL: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42016045912 [accessed 2019-02-12] [WebCite Cache ID _768PWyrTq]
19. Saxena N, Kyaw B, Vseteckova J, Dev P, Paul P, Lim K, et al. PROSPERO CRD42016045470. 2016. Virtual reality environments for health professional education [Cochrane Protocol] URL: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42016045470 [accessed 2019-02-12] [WebCite Cache ID _768PoyNgB]
20. Gentry S, L'Estrade E, Gauthier A, Alvarez J, Wortley D, van Rijswijk J, et al. PROSPERO CRD42016045997. 2016. Serious Gaming and Gamification interventions for health professional education [Cochrane Protocol] URL: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42016045997 [accessed 2019-02-12] [WebCite Cache ID 768Q8s7FV]
21. Semwal M, Wahabi H, Posadzki P, Divakar U, Lim K, Audouard-Marzin Y, et al. PROSPERO CRD42017083206. 2018. Offline and computer-based eLearning interventions for medical doctors' education [Cochrane protocol] URL: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42017083206 [accessed 2019-02-12] [WebCite Cache ID 768QQ9Ep6]
22. Allison JJ, Kiefe CI, Wall T, Casebeer L, Ray MN, Spettell CM, et al. Multicomponent Internet continuing medical education to promote chlamydia screening. Am J Prev Med 2005 Apr;28(3):285-290. [doi: 10.1016/j.amepre.2004.12.013] [Medline: 15766617]
23. Bernstein HH, Dhepyasuwan N, Connors K, Volkan K, Serwint JR, CORNET Investigators. Evaluation of a national Bright Futures oral health curriculum for pediatric residents. Acad Pediatr 2013 Mar;13(2):133-139. [doi: 10.1016/j.acap.2012.10.010] [Medline: 23257667]
24. Grover S, Currier PF, Elinoff JM, Katz JT, McMahon GT. Improving residents' knowledge of arterial and central line placement with a web-based curriculum. J Grad Med Educ 2010 Dec;2(4):548-554 [FREE Full _text] [doi: 10.4300/JGME-D-10-00029.1] [Medline: 22132276]
25. Kerfoot BP, Baker HE, Koch MO, Connelly D, Joseph DB, Ritchey ML. Randomized, controlled trial of spaced education to urology residents in the United States and Canada. J Urol 2007 Apr;177(4):1481-1487. [doi: 10.1016/j.juro.2006.11.074] [Medline: 17382760]
26. Marsh-Tootle WL, McGwin G, Kohler CL, Kristofco RE, Datla RV, Wall TC. Efficacy of a web-based intervention to improve and sustain knowledge and screening for amblyopia in primary care settings. Invest Ophthalmol Vis Sci 2011 Sep 09;52(10):7160-7167 [FREE Full _text] [doi: 10.1167/iovs.10-6566] [Medline: 21730344]
27. Sangvai S, Mahan JD, Lewis KO, Pudlo N, Suresh S, McKenzie LB. The impact of an interactive Web-based module on residents' knowledge and clinical practice of injury prevention. Clin Pediatr (Phila) 2012 Feb 10;51(2):165-174. [doi: 10.1177/0009922811419027] [Medline: 21985892]
28. Saxon D, Pearson AT, Wu P. Hyperlink-Embedded Journal Articles Improve Statistical Knowledge and Reader Satisfaction. J Grad Med Educ 2015 Dec;7(4):654-657 [FREE Full _text] [doi: 10.4300/JGME-D-14-00747.1] [Medline: 26692981]
29. Schroter S, Jenkins RD, Playle RA, Walsh KM, Probert C, Kellner T, et al. Evaluation of an online interactive Diabetes Needs Assessment Tool (DNAT) versus online self-directed learning: a randomised controlled trial. BMC Med Educ 2011 Jun 16;11(1):35-39 [FREE Full _text] [doi: 10.1186/1472-6920-11-35] [Medline: 21679446]
30. Shaw TJ, Pernar LI, Peyre SE, Helfrick JF, Vogelgesang KR, Graydon-Baker E, et al. Impact of online education on intern behaviour around joint commission national patient safety goals: a randomised trial. BMJ Qual Saf 2012 Oct 16;21(10):819-825 [FREE Full _text] [doi: 10.1136/bmjqs-2011-000702] [Medline: 22706930]
31. Pape-Koehler C, Immenroth M, Sauerland S, Lefering R, Lindlohr C, Toaspern J, et al. Multimedia-based training on Internet platforms improves surgical performance: a randomized controlled trial. Surg Endosc 2013 May;27(5):1737-1747 [FREE Full _text] [doi: 10.1007/s00464-012-2672-y] [Medline: 23475016]
32. Ruf D, Berner M, Kriston L, Lohmann M, Mundle G, Lorenz G, et al. Cluster-randomized controlled trial of dissemination strategies of an online quality improvement programme for alcohol-related disorders. Alcohol Alcohol 2010 Nov 04;45(1):70-78. [doi: 10.1093/alcalc/agp079] [Medline: 19889887]
33. Talib N, Onikul R, Filardi D, Simon S, Sharma V. Effective educational instruction in preventive oral health: hands-on training versus web-based training. Pediatrics 2010 Mar 01;125(3):547-553. [doi: 10.1542/peds.2009-0470] [Medline: 20123769]
34. Yardley L, Douglas E, Anthierens S, Tonkin-Crine S, O'Reilly G, Stuart B, et al. Evaluation of a web-based intervention to reduce antibiotic prescribing for LRTI in six European countries: quantitative process analysis of the GRACE/INTRO randomised controlled trial. Implement Sci 2013 Nov 15;8:134 [FREE Full _text] [doi: 10.1186/1748-5908-8-134] [Medline: 24238118]
35. Weston CM, Sciamanna CN, Nash DB. Evaluating online continuing medical education seminars: evidence for improving clinical practices. Am J Med Qual 2008 Nov;23(6):475-483. [doi: 10.1177/1062860608325266] [Medline: 19001103]
36. Franchi C, Tettamanti M, Djade CD, Pasina L, Mannucci PM, Onder G, ELICADHE Investigators. E-learning in order to improve drug prescription for hospitalized older patients: a cluster-randomized controlled study. Br J Clin Pharmacol 2016 Dec 05;82(1):53-63 [FREE Full _text] [doi: 10.1111/bcp.12922] [Medline: 26922904]
37. Kerfoot B, Turchin A, Breydo E, Gagnon D, Conlin P. An online spaced-education game among clinicians improves their patients' time to blood pressure control: a randomized controlled trial. Circ Cardiovasc Qual Outcomes 2014 May;7(3):468-474 [FREE Full _text] [doi: 10.1161/CIRCOUTCOMES.113.000814] [Medline: 24847084]
38. George PP, Toon E, Hadadgar A, Jirwe M, Saxena N, Lim K, et al. PROSPERO CRD42016045571. 2016. Online- and local area network (LAN)-based eLearning interventions for medical doctors' education [Cochrane Protocol] URL: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42016045571 [accessed 2019-02-12] [WebCite Cache ID 768Nw4Q5U]
39. Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1. URL: http://handbook-5-1.cochrane.org/ [accessed 2019-02-07] [WebCite Cache ID _760HwWOUg]
40. Car J, Carlstedt-Duke J, Tudor CL, Posadzki P, Zary N, Atun R, et al. Digital education for health professions: methods for overarching evidence syntheses. J Med Internet Res 2019:2018. [doi: 10.2196/12913]
41. Puffer S, Torgerson D, Watson J. Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals. BMJ 2003 Oct 04;327(7418):785-789 [FREE Full _text] [doi: 10.1136/bmj.327.7418.785] [Medline: 14525877]
42. Schünemann H, Oxman A, Higgins J, Vist G, Glasziou P, Guyatt G. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011), The Cochrane Collaboration. 2008 Sep 26. Presenting results and 'Summary of Findings' tables URL: https://onlinelibrary.wiley.com/doi/abs/10.1002/9780470712184.ch11 [accessed 2019-02-12] [WebCite Cache ID _768OZ6Q3M]
43. Braido F, Comaschi M, Valle I, Delgado L, Coccini A, Guerreras P, ARGA Study Group, EAACI/CME Committee. Knowledge and health care resource allocation: CME/CPD course guidelines-based efficacy. Eur Ann Allergy Clin Immunol 2012 Oct;44(5):193-199. [Medline: 23156067]
44. Connolly AM, Cunningham C, Sinclair AJ, Rao A, Lonergan A, Bye AM. 'Beyond Milestones': a randomised controlled trial evaluating an innovative digital resource teaching quality observation of normal child development. J Paediatr Child Health 2014 May 23;50(5):393-398. [doi: 10.1111/jpc.12485] [Medline: 24373114]
45. Farah SS, Winter M, Appu S. Helping doctors utilize the prostate-specific antigen effectively: an online randomized controlled trial (The DUPE trial). ANZ J Surg 2012 Sep 20;82(9):633-638. [doi: 10.1111/j.1445-2197.2012.06154.x] [Medline: 22900524]
46. Gyorki DE, Shaw T, Nicholson J, Baker C, Pitcher M, Skandarajah A, et al. Improving the impact of didactic resident training with online spaced education. ANZ J Surg 2013 Jun 26;83(6):477-480. [doi: 10.1111/ans.12166] [Medline: 23617607]
47. Harris J, Kutob R, Surprenant Z, Maiuro R, Delate T. Can Internet-based education improve physician confidence in dealing with domestic violence? Fam Med 2002 Apr;34(4):287-292. [Medline: 12017143]
48. Houwink EJ, van Teeffelen SR, Muijtjens AM, Henneman L, Jacobi F, van Luijk SJ, et al. Sustained effects of online genetics education: a randomized controlled trial on oncogenetics. Eur J Hum Genet 2013 Aug 14;22(3):310-316. [doi: 10.1038/ejhg.2013.163]
49. Kutob R, Senf J, Harris J. Teaching culturally effective diabetes care: results of a randomized controlled trial. Fam Med 2009 Mar;41(3):167-174 [FREE Full _text] [Medline: 19259838]
50. Thompson J, Lebwohl B, Syngal S, Kastrinos F. Tu1482 Assessment of U.S. Gastroenterology Trainees' Knowledge of Quality Performance Measures for Colonoscopy and the Impact of a Web-Based Intervention. Gastrointestinal Endoscopy 2011 Apr;73(4):AB423 [FREE Full _text] [doi: 10.1016/j.gie.2011.03.974]
51. World Health Organization. Geneva: WHO; 2013. Global health workforce shortage to reach 12.9 million in coming decades URL: https://www.who.int/mediacentre/news/releases/2013/health-workforce-shortage/en/ [accessed 2019-02-12] [WebCite Cache ID _768WLcBq3]
52. Alfieri J, Portelance L, Souhami L, Steinert Y, McLeod P, Gallant F, et al. Development and impact evaluation of an e-learning radiation oncology module. Int J Radiat Oncol Biol Phys 2012 Mar 01;82(3):e573-e580. [doi: 10.1016/j.ijrobp.2011.07.002] [Medline: 22024203]
53. Chang TP, Pham PK, Sobolewski B, Doughty CB, Jamal N, Kwan KY, et al. Pediatric emergency medicine asynchronous e-learning: a multicenter randomized controlled Solomon four-group study. Acad Emerg Med 2014 Aug;21(8):912-919 [FREE Full _text] [doi: 10.1111/acem.12434] [Medline: 25154469]
54. Claxton R, Marks S, Buranosky R, Rosielle D, Arnold RM. The educational impact of weekly e-mailed fast facts and concepts. J Palliat Med 2011 Apr;14(4):475-481. [doi: 10.1089/jpm.2010.0418] [Medline: 21395446]
55. Cullinan S, O'Mahony D, Byrne S. Use of an e-Learning Educational Module to Better Equip Doctors to Prescribe for Older Patients: A Randomised Controlled Trial. Drugs Aging 2017 Dec 4;34(5):367-374. [doi: 10.1007/s40266-017-0451-0] [Medline: 28258537]
56. Hearty T, Maizels M, Pring M, Mazur J, Liu R, Sarwark J, et al. Orthopaedic resident preparedness for closed reduction and pinning of pediatric supracondylar fractures is improved by e-learning: a multisite randomized controlled study. J Bone Joint Surg Am 2013 Sep 04;95(17):e1261-e1267. [doi: 10.2106/JBJS.L.01065] [Medline: 24005210]
57. Satterwhite T, Son J, Carey J, Zeidler K, Bari S, Gurtner G, et al. Microsurgery education in residency training: validating an online curriculum. Ann Plast Surg 2012 Apr;68(4):410-414. [doi: 10.1097/SAP.0b013e31823b6a1a] [Medline: 22421490]
58. Sullivan MD, Gaster B, Russo J, Bowlby L, Rocco N, Sinex N, et al. Randomized trial of web-based training about opioid therapy for chronic pain. Clin J Pain 2010;26(6):512-517. [doi: 10.1097/AJP.0b013e3181dc7adc] [Medline: 20551726]
59. Viguier M, Rist S, Aubin F, Leccia M, Richard M, Esposito-Farèse M, Club Rhumatismes et Inflammation. Online training on skin cancer diagnosis in rheumatologists: results from a nationwide randomized web-based survey. PLoS One 2015 May 21;10(5):e0127564 [FREE Full _text] [doi: 10.1371/journal.pone.0127564] [Medline: 25996152]
60. Westmoreland GR, Counsell SR, Tu W, Wu J, Litzelman DK. Web-based training in geriatrics for medical residents: a randomized controlled trial using standardized patients to assess outcomes. J Am Geriatr Soc 2010 Jun;58(6):1163-1169. [doi: 10.1111/j.1532-5415.2010.02869.x] [Medline: 20722848]
61. Gold J, Begg W, Fullerton D, Mathisen D, Olinger G, Orringer M, et al. Successful implementation of a novel internet hybrid surgery curriculum: the early phase outcome of thoracic surgery prerequisite curriculum e-learning project. Ann Surg 2004 Sep;240(3):499-507; discussion 507. [Medline: 15319721]
62. Stewart M, Marshall JN, Ostbye T, Feightner JW, Brown JB, Harris S, et al. Effectiveness of case-based on-line learning of evidence-based practice guidelines. Fam Med 2005 Feb;37(2):131-138 [FREE Full _text] [Medline: 15690254]
63. Enders F, Diener-West M. Methods of learning in statistics education: a randomized trial of public health graduate students. Statistics Education Research Journal 2006;5(1):5.
64. Short LM, Surprenant ZJ, Harris JM. A community-based trial of an online intimate partner violence CME program. Am J Prev Med 2006 Feb;30(2):181-185 [FREE Full _text] [doi: 10.1016/j.amepre.2005.10.012] [Medline: 16459218]
65. Dolan BM, Yialamas MA, McMahon GT. A Randomized Educational Intervention Trial to Determine the Effect of Online Education on the Quality of Resident-Delivered Care. J Grad Med Educ 2015 Sep;7(3):376-381 [FREE Full _text] [doi: 10.4300/JGME-D-14-00571.1] [Medline: 26457142]
66. Le TT, Rait MA, Jarlsberg LG, Eid NS, Cabana MD. A randomized controlled trial to evaluate the effectiveness of a distance asthma learning program for pediatricians. J Asthma 2010 Apr 15;47(3):245-250. [doi: 10.3109/02770900903560209] [Medline: 20394510]
67. Bell DS, Fonarow GC, Hays RD, Mangione CM. Self-study from web-based and printed guideline materials. A randomized, controlled trial among resident physicians. Ann Intern Med 2000 Jun 20;132(12):938-946. [Medline: 10858176]
68. Butzlaff M, Vollmar HC, Floer B, Koneczny N, Isfort J, Lange S. Learning with computerized guidelines in general practice? A randomized controlled trial. Fam Pract 2004 Apr;21(2):183-188. [Medline: 15020389]
69. Cabrera-Muffly C, Bryson PC, Sykes KJ, Shnayder Y. Free online otolaryngology educational modules: a pilot study. JAMA Otolaryngol Head Neck Surg 2015 Apr 01;141(4):324-328. [doi: 10.1001/jamaoto.2015.41] [Medline: 25695900]
70. Chung S, Mandl KD, Shannon M, Fleisher GR. Efficacy of an educational Web site for educating physicians about bioterrorism. Acad Emerg Med 2004 Feb;11(2):143-148 [FREE Full _text] [Medline: 14759955]
71. Ferguson MK, Thompson K, Huisingh-Scheetz M, Farnan J, Hemmerich J, Acevedo J, et al. The Impact of a Frailty Education Module on Surgical Resident Estimates of Lobectomy Risk. Ann Thorac Surg 2015 Jul;100(1):235-241 [FREE Full _text] [doi: 10.1016/j.athoracsur.2015.03.016] [Medline: 26004924]
72. Wang CL, Schopp JG, Kani K, Petscavage-Thomas JM, Zaidi S, Hippe DS, et al. Prospective randomized study of contrast reaction management curricula: computer-based interactive simulation versus high-fidelity hands-on simulation. Eur J Radiol 2013 Dec;82(12):2247-2252. [doi: 10.1016/j.ejrad.2013.08.044] [Medline: 24041436]
73. Hymowitz N, Schwab JV, Haddock CK, Pyle SA, Schwab LM. The pediatric residency training on tobacco project: four-year resident outcome findings. Prev Med 2007 Dec;45(6):481-490 [FREE Full _text] [doi: 10.1016/j.ypmed.2007.07.024] [Medline: 17707898]
74. Koppe H, van de Mortel TF, Ahern CM. How effective and acceptable is Web 2.0 Balint group participation for general practitioners and general practitioner registrars in regional Australia? A pilot study. Aust J Rural Health 2016 Feb 26;24(1):16-22 [FREE Full _text] [doi: 10.1111/ajr.12212] [Medline: 26114400]
75. Lee A, Mader E, Morley C. Teaching cross-cultural communication skills online: a multi-method evaluation. Fam Med 2015 Apr;47(4):302-308 [FREE Full _text] [Medline: 25853602]
76. Macrae HM, Regehr G, McKenzie M, Henteleff H, Taylor M, Barkun J, et al. Teaching practicing surgeons critical appraisal skills with an Internet-based journal club: A randomized, controlled trial. Surgery 2004 Sep;136(3):641-646. [doi: 10.1016/j.surg.2004.02.003] [Medline: 15349113]
77. Conroy EJ, Kirkham JJ, Bellis JR, Peak M, Smyth RL, Williamson PR, et al. A pilot randomised controlled trial to assess the utility of an e-learning package that trains users in adverse drug reaction causality. Int J Pharm Pract 2015 Dec 29;23(6):447-455 [FREE Full _text] [doi: 10.1111/ijpp.12197] [Medline: 26032626]
78. Edrich T, Stopfkuchen-Evans M, Scheiermann P, Heim M, Chan W, Stone MB, et al. A Comparison of Web-Based with Traditional Classroom-Based Training of Lung Ultrasound for the Exclusion of Pneumothorax. Anesth Analg 2016 Dec;123(1):123-128. [doi: 10.1213/ANE.0000000000001383] [Medline: 27159073]
79. Matzie KA, Kerfoot BP, Hafler JP, Breen EM. Spaced education improves the feedback that surgical residents give to medical students: a randomized trial. Am J Surg 2009 Feb;197(2):252-257. [doi: 10.1016/j.amjsurg.2008.01.025] [Medline: 18722585]
80. Pernar LI, Beleniski F, Rosen H, Lipsitz S, Hafler J, Breen E. Spaced education faculty development may not improve faculty teaching performance ratings in a surgery department. J Surg Educ 2012 Jan;69(1):52-57. [doi: 10.1016/j.jsurg.2011.06.013] [Medline: 22208833]
81. Fordis M, King JE, Ballantyne CM, Jones PH, Schneider KH, Spann SJ, et al. Comparison of the instructional efficacy of Internet-based CME with live interactive CME workshops: a randomized controlled trial. JAMA 2005 Sep 07;294(9):1043-1051. [doi: 10.1001/jama.294.9.1043] [Medline: 16145024]
82. Pelayo-Alvarez M, Perez-Hoyos S, Agra-Varela Y. Clinical effectiveness of online training in palliative care of primary care physicians. J Palliat Med 2013 Oct;16(10):1188-1196 [FREE Full _text] [doi: 10.1089/jpm.2013.0005] [Medline: 23987657]
83. Hemmati N, Omrani S, Hemmati N. A comparison of Internet-based learning and traditional classroom lecture to learn CPR for continuing medical education. TurkiOJDE 2013;14:256-265 [FREE Full _text]
84. Chenkin J, Lee S, Huynh T, Bandiera G. Procedures can be learned on the Web: a randomized study of ultrasound-guided vascular access training. Acad Emerg Med 2008 Oct;15(10):949-954 [FREE Full _text] [doi: 10.1111/j.1553-2712.2008.00231.x] [Medline: 18778380]
85. Hadley J, Kulier R, Zamora J, Coppus SF, Weinbrenner S, Meyerrose B, et al. Effectiveness of an e-learning course in evidence-based medicine for foundation (internship) training. J R Soc Med 2010 Jul 03;103(7):288-294 [FREE Full _text] [doi: 10.1258/jrsm.2010.100036] [Medline: 20522698]
86. Hugenholtz NIR, de Croon EM, Smits PB, van Dijk FJH, Nieuwenhuijsen K. Effectiveness of e-learning in continuing medical education for occupational physicians. Occup Med (Lond) 2008 Aug 20;58(5):370-372 [FREE Full _text] [doi: 10.1093/occmed/kqn053] [Medline: 18495676]
87. Bello G, Pennisi MA, Maviglia R, Maggiore SM, Bocci MG, Montini L, et al. Online vs live methods for teaching difficult airway management to anesthesiology residents. Intensive Care Med 2005 Apr 8;31(4):547-552. [doi: 10.1007/s00134-005-2561-0] [Medline: 15754200]
88. Chan D, Leclair K, Kaczorowski J. Problem-based small-group learning via the Internet among community family physicians: a randomized controlled trial. MD Comput 1999;16(3):54-58. [Medline: 10439603]
89. McLeod RS, MacRae HM, McKenzie ME, Victor JC, Brasel KJ, Evidence Based Reviews in Surgery Steering Committee. A moderated journal club is more effective than an Internet journal club in teaching critical appraisal skills: results of a multicenter randomized controlled trial. J Am Coll Surg 2010 Dec;211(6):769-776. [doi: 10.1016/j.jamcollsurg.2010.08.016] [Medline: 21036071]
90. Barthelemy FX, Segard J, Fradin P, Hourdin N, Batard E, Pottier P, et al. ECG interpretation in Emergency Department residents: an update and e-learning as a resource to improve skills. Eur J Emerg Med 2017 Apr;24(2):149-156. [doi: 10.1097/MEJ.0000000000000312] [Medline: 26287803]
91. Houwink EJF, Muijtjens AMM, van Teeffelen SR, Henneman L, Rethans JJ, Jacobi F, et al. Effect of comprehensive oncogenetics training interventions for general practitioners, evaluated at multiple performance levels. PLoS One 2015 Apr 2;10(4):e0122648 [FREE Full _text] [doi: 10.1371/journal.pone.0122648] [Medline: 25837634]
92. Shariff U, Kullar N, Haray PN, Dorudi S, Balasubramanian SP. Multimedia educational tools for cognitive surgical skill acquisition in open and laparoscopic colorectal surgery: a randomized controlled trial. Colorectal Dis 2015 May 21;17(5):441-450. [doi: 10.1111/codi.12863] [Medline: 25495835]
93. Wilkinson JS, Barake W, Smith C, Thakrar A, Johri AM. Limitations of Condensed Teaching Strategies to Develop Hand-Held Cardiac Ultrasonography Skills in Internal Medicine Residents. Can J Cardiol 2016 Dec;32(8):1034-1037. [doi: 10.1016/j.cjca.2015.10.008] [Medline: 26860772]
94. Schmitz CC, Braman JP, Turner N, Heller S, Radosevich DM, Yan Y, et al. Learning by (video) example: a randomized study of communication skills training for end-of-life and error disclosure family care conferences. Am J Surg 2016 Nov;212(5):996-1004. [doi: 10.1016/j.amjsurg.2016.02.023] [Medline: 27474496]
95. Putnam L, Pham D, Etchegaray J, Ostovar-Kermani T, Ottosen M, Thomas E, et al. How Should Surgical Residents Be Educated about Patient Safety in the Operating Room: A Pilot Randomized Trial. Journal of the American College of Surgeons 2015 Oct;221(4):S127-S128 [FREE Full _text] [doi: 10.1016/j.jamcollsurg.2015.07.301]
96. Kulier R, Gülmezoglu AM, Zamora J, Plana MN, Carroli G, Cecatti JG, et al. Effectiveness of a clinically integrated e-learning course in evidence-based medicine for reproductive health training: a randomized trial. JAMA 2012 Dec 05;308(21):2218-2243. [doi: 10.1001/jama.2012.33640] [Medline: 23212499]
97. Sharma V, Chamos C, Valencia O, Meineri M, Fletcher SN. The impact of internet and simulation-based training on transoesophageal echocardiography learning in anaesthetic trainees: a prospective randomised study. Anaesthesia 2013 Jun;68(6):621-627 [FREE Full _text] [doi: 10.1111/anae.12261] [Medline: 23594265]
98. Ali J, Sorvari A, Camera S, Kinach M, Mohammed S, Pandya A. Telemedicine as a potential medium for teaching the advanced trauma life support (ATLS) course. J Surg Educ 2013 Mar;70(2):258-264. [doi: 10.1016/j.jsurg.2012.11.008] [Medline: 23427974]
99. Perkins GD, Kimani PK, Bullock I, Clutton-Brock T, Davies RP, Gale M, Electronic Advanced Life Support Collaborators. Improving the efficiency of advanced life support training: a randomized, controlled trial. Ann Intern Med 2012 Jul 03;157(1):19-28. [doi: 10.7326/0003-4819-157-1-201207030-00005] [Medline: 22751757]
100. Platz E, Goldflam K, Mennicke M, Parisini E, Christ M, Hohenstein C. Comparison of Web-versus classroom-based basic ultrasonographic and EFAST training in 2 European hospitals. Ann Emerg Med 2010 Dec;56(6):660-667. [doi: 10.1016/j.annemergmed.2010.04.019] [Medline: 20538370]
101. Vollmar HC, Mayer H, Ostermann T, Butzlaff ME, Sandars JE, Wilm S, et al. Knowledge transfer for the management of dementia: a cluster randomised trial of blended learning in general practice. Implement Sci 2010 Jan 04;5(1):1-10 [FREE Full _text] [doi: 10.1186/1748-5908-5-1] [Medline: 20047652]
102. Szmuilowicz E, Neely KJ, Sharma RK, Cohen ER, McGaghie WC, Wayne DB. Improving residents' code status discussion skills: a randomized trial. J Palliat Med 2012 Jul;15(7):768-774 [FREE Full _text] [doi: 10.1089/jpm.2011.0446] [Medline: 22690890]
103. Ngamruengphong S, Horsley-Silva J, Hines S, Pungpapong S, Patel T, Keaveny A. Educational Intervention in Primary Care Residents' Knowledge and Performance of Hepatitis B Vaccination in Patients with Diabetes Mellitus. South Med J 2015 Sep;108(9):510-515. [doi: 10.14423/SMJ.0000000000000334] [Medline: 26332473]
104. Midmer D, Kahan M, Marlow B. Effects of a distance learning program on physicians' opioid- and benzodiazepine-prescribing skills. J Contin Educ Health Prof 2006;26(4):294-301. [doi: 10.1002/chp.82] [Medline: 17163499]
105. Kulier R, Coppus SF, Zamora J, Hadley J, Malick S, Das K, et al. The effectiveness of a clinically integrated e-learning course in evidence-based medicine: a cluster randomised controlled trial. BMC Med Educ 2009 May 12;9(1):21-27 [FREE Full _text] [doi: 10.1186/1472-6920-9-21] [Medline: 19435520]
106. Kronick J, Blake C, Munoz E, Heilbrunn L, Dunikowski L, Milne WK. Improving on-line skills and knowledge. A randomized trial of teaching rural physicians to use on-line medical information. Can Fam Physician 2003 Mar;49:312-317 [FREE Full _text] [Medline: 12675544]
107. Daetwyler CJ, Cohen DG, Gracely E, Novack DH. eLearning to enhance physician patient communication: A pilot test of “doc.com” and “WebEncounter” in teaching bad news delivery. Medical Teacher 2010 Aug 26;32(9):e381-e390. [doi: 10.3109/0142159X.2010.495759]
108. Estrada CA, Safford MM, Salanitro AH, Houston TK, Curry W, Williams JH, et al. A web-based diabetes intervention for physician: a cluster-randomized effectiveness trial. Int J Qual Health Care 2011 Dec 10;23(6):682-689 [FREE Full _text] [doi: 10.1093/intqhc/mzr053] [Medline: 21831967]
109. Epstein JN, Langberg JM, Lichtenstein PK, Kolb R, Altaye M, Simon JO. Use of an Internet portal to improve community-based pediatric ADHD care: a cluster randomized trial. Pediatrics 2011 Nov 17;128(5):e1201-e1208 [FREE Full _text] [doi: 10.1542/peds.2011-0872] [Medline: 22007005]
110. Dayton CS, Ferguson JS, Hornick DB, Peterson MW. Evaluation of an Internet-based decision-support system for applying the ATS/CDC guidelines for tuberculosis preventive therapy. Med Decis Making 2000 Jul;20(1):1-6. [doi: 10.1177/0272989X0002000101] [Medline: 10638531]
111. Gerbert B, Bronstone A, Maurer T, Berger T, McPhee SJ, Caspers N. The effectiveness of an Internet-based tutorial in improving primary care physicians' skin cancer triage skills. J Cancer Educ 2002;17(1):7-11. [doi: 10.1080/08858190209528784] [Medline: 12000111]
112. Meeker D, Linder JA, Fox CR, Friedberg MW, Persell SD, Goldstein NJ, et al. Effect of Behavioral Interventions on Inappropriate Antibiotic Prescribing Among Primary Care Practices: A Randomized Clinical Trial. JAMA 2016 Feb 09;315(6):562-570. [doi: 10.1001/jama.2016.0275] [Medline: 26864410]
113. Bell RA, McDermott H, Fancher TL, Green MJ, Day FC, Wilkes MS. Impact of a randomized controlled educational trial to improve physician practice behaviors around screening for inherited breast cancer. J Gen Intern Med 2015 Mar 2;30(3):334-341 [FREE Full _text] [doi: 10.1007/s11606-014-3113-5] [Medline: 25451990]
114. Butler CC, Simpson SA, Dunstan F, Rollnick S, Cohen D, Gillespie D, et al. Effectiveness of multifaceted educational programme to reduce antibiotic dispensing in primary care: practice based randomised controlled trial. BMJ 2012 Feb 02;344(feb02 1):d8173-d8173 [FREE Full _text] [doi: 10.1136/bmj.d8173] [Medline: 22302780]
115. Curtis JR, Westfall AO, Allison J, Becker A, Melton ME, Freeman A, et al. Challenges in improving the quality of osteoporosis care for long-term glucocorticoid users: a prospective randomized trial. Arch Intern Med 2007 Mar 26;167(6):591-596. [doi: 10.1001/archinte.167.6.591] [Medline: 17389291]
116. Feng B, Srinivasan M, Hoffman JR, Rainwater JA, Griffin E, Dragojevic M, et al. Physician communication regarding prostate cancer screening: analysis of unannounced standardized patient visits. Ann Fam Med 2013;11(4):315-323 [FREE Full _text] [doi: 10.1370/afm.1509] [Medline: 23835817]
117. Little P, Stuart B, Francis N, Douglas E, Tonkin-Crine S, Anthierens S, et al. Effects of internet-based training on antibiotic prescribing rates for acute respiratory-tract infections: a multinational, cluster, randomised, factorial, controlled trial. Lancet 2013 Oct 5;382(9899):1175-1182 [FREE Full _text] [doi: 10.1016/S0140-6736(13)60994-0] [Medline: 23915885]
118. Xiao Y, Seagull FJ, Bochicchio GV, Guzzo JL, Dutton RP, Sisley A, et al. Video-based training increases sterile-technique compliance during central venous catheter insertion. Crit Care Med 2007 May;35(5):1302-1306. [doi: 10.1097/01.CCM.0000263457.81998.27] [Medline: 17414726]
119. Légaré F, Labrecque M, Cauchon M, Castel J, Turcotte S, Grimshaw J. Training family physicians in shared decision-making to reduce the overuse of antibiotics in acute respiratory infections: a cluster randomized trial. CMAJ 2012 Sep 18;184(13):E726-E734 [FREE Full _text] [doi: 10.1503/cmaj.120568] [Medline: 22847969]
120. Girgis A, Cockburn J, Butow P, Bowman D, Schofield P, Stojanovski E, et al. Improving patient emotional functioning and psychological morbidity: evaluation of a consultation skills training program for oncologists. Patient Educ Couns 2009 Dec;77(3):456-462. [doi: 10.1016/j.pec.2009.09.018] [Medline: 19819660]
121. Jayakumar N, Brunckhorst O, Dasgupta P, Khan MS, Ahmed K. e-Learning in Surgical Education: A Systematic Review. J Surg Educ 2015 Nov;72(6):1145-1157. [doi: 10.1016/j.jsurg.2015.05.008] [Medline: 26111822]
122. Thepwongsa I, Kirby CN, Schattner P, Piterman L. Online continuing medical education (CME) for GPs: does it work? A systematic review. Aust Fam Physician 2014 Oct;43(10):717-721 [FREE Full _text] [Medline: 25286431]
123. Jwayyed S, Stiffler KA, Wilber ST, Southern A, Weigand J, Bare R, et al. Technology-assisted education in graduate medical education: a review of the literature. Int J Emerg Med 2011 Aug 08;4(1):51-13 [FREE Full _text] [doi: 10.1186/1865-1380-4-51] [Medline: 21824405]
124. Liu Q, Peng W, Zhang F, Hu R, Li Y, Yan W. The Effectiveness of Blended Learning in Health Professions: Systematic Review and Meta-Analysis. J Med Internet Res 2016 Jan 04;18(1):e2 [FREE Full _text] [doi: 10.2196/jmir.4807] [Medline: 26729058]