Quality specifications in postgraduate medical e-learning: An integrative literature review leading to a postgraduate medical e-learning model

BMC Medical Education

Volumn 16, Issue 1, 2016, Pages

  De Leeuw, R A ^a   Westerman, M ^b   Nelson, E ^c   Ket, J C F ^d   Scheele, F ^a,b  

^a ATHENA INSTITUTE   (Netherlands)

^b VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^c STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Distance learning; E learning; Education; Integrative review; Medical e learning; Medical education; Postgraduate medical education; Quality model

Indexed keywords

CLINICAL COMPETENCE; FEMALE; HEALTH CARE QUALITY; HUMAN; INTERPERSONAL COMMUNICATION; LEARNING; MALE; MEDICAL EDUCATION; MEDICAL ERROR; PREVENTION AND CONTROL; PROCEDURES; SOFTWARE DESIGN; STANDARDS; TEACHING;

CLINICAL COMPETENCE; COMMUNICATION; COMPUTER-ASSISTED INSTRUCTION; EDUCATION, MEDICAL, CONTINUING; FEMALE; HUMANS; LEARNING; MALE; MEDICAL ERRORS; PATIENT SIMULATION; QUALITY ASSURANCE, HEALTH CARE; SOFTWARE DESIGN;

EID: 84979695798     PISSN: None     EISSN: 14726920     Source Type: Journal    
DOI: 10.1186/s12909-016-0700-7     Document Type: Review

References (76)

1. Allen IE, Seaman J. Going the distance: Online education in the United States, 2011. The Sloan Consortium: Organizations Committed to Quality Online Education; 2011.
2. Sandars J, Schroter S. Web 2.0 technologies for undergraduate and postgraduate medical education: an online survey. Postgrad Med J. 2007;83(986):759-62.
3. Curran VR, Fleet L. A review of evaluation outcomes of web-based continuing medical education. Med Educ. 2005;39(6):561-7.
4. Jwayyed S, Stiffler KA, Wilber ST, Southern A, Weigand J, Bare R, Gerson LW. Technology-assisted education in graduate medical education: a review of the literature. Int J Emerg Med. 2011;4(1):51-64.
5. Childs S, Blenkinsopp E, Hall A, Walton G. Effective e-learning for health professionals and students-barriers and their solutions. A systematic review of the literature-findings from the HeXL project. Health Info Libr J. 2005;22 Suppl 2:20-32.
6. Cook DA, Dupras DM. A practical guide to developing effective web-based learning. J Gen Intern Med. 2004;19(6):698-707.
7. Maggio LA, Tannery NH, Chen HC, Cate O, O'Brien B. Evidence-Based Medicine Training in Undergraduate Medical Education. Acad Med. 2013;88(7):1022-8.
8. Ruiz JG, Mintzer MJ, Leipzig RM. The impact of E-learning in medical education. Acad Med. 2006;81(3):207-12.
9. Clark RC, Mayer R.E. E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning. 3rd ed. San Francisco: Pfeiffer; 2011.
10. Cook DA, Ellaway RH. Evaluating technology-enhanced learning: A comprehensive framework. Med Teach. 2015;37(10):961-70.
11. Hung DWL, Chen D-T. Situated Cognition, Vygotskian Thought and Learning from the Communities of Practice Perspective: Implications for the Design of Web-Based E-Learning. EMI Educ Media Int. 2001;38(1):3-12.
12. Marshall S. E-learning standards: Open enablers of learning or compliance strait jackets. Beyond the comfort zone: Proceedings of the 21st ASCILITE Conference. 2004:596-605.
13. Jonassen DH. Learning to solve problems: An instructional design guide. 1st ed. San Francisco: Pfeiffer; 2004. p. 1-10.
14. Koohang A, Harman K. Open source: A metaphor for e-learning. Inf Science J. 2005;8:75-86.
15. Schmidt HG, Van der Molen HT. Constructivist, Problem-Based Learning Does Work: A Meta-Analysis of Curricular Comparisons Involving a Single Medical School. Educ Psychol. 2009;44(4):227-49.
16. Ellaway R, Masters K. AMEE Guide 32: e-Learning in medical education Part 1: Learning, teaching and assessment. Med Teach. 2008;30(5):455-73.
17. Sweller J. Cognitive load during problem solving: Effects on learning. Cogn Sci. 1988;12(2):257-85.
18. Mayer RE. The Cambridge handbook of multimedia learning. 2nd ed. Cambridge: Cambridge University Press; 2014.
19. Singh H, Reed C. Demystifying e-learning standards. Ind Commer Train. 2002;34(2):62-5.
20. Olson CA, Shershneva MB. Setting quality standards for web-based continuing medical education. J Contin Educ Health Prof. 2004;24(2):100-11.
21. Marques CG, Noivo J, Verissimo M. e-QUAL: e-Learning with Quality. Proposal for an Evaluation Model on the Quality of e-Learning Courses. In Mendes AJ, Pereira I, Costa R, Editors. Computers and Education. Towards Educational Change and Innovation. London: Springer; 2008. p. 83-90.
22. Caramihai M, Severin I. eLearning Tools Evaluation based on Quality Concept Distance Computing. A Case Study. Int J Innov Res Sci Eng Technol. 2009;3(5):438-42.
23. Stracke CM. Quality Development and Standards in e-Learning: Benefits and Guidelines for Implementations. Proceedings of the ASEM Lifelong Learning Conference: e-Learning and Workplace Learning Bangkok (Thailand). 2009.
24. Ehlers UD, Goertz L, Hildebrandt B, Pawlowski JM. Quality in e-learning: use and dissemination of quality approaches in European e-learning: a study by the European Quality Observatory. Cedefop Panorama series. 2006 (116).
25. Little BB. The Use of Standards for Peer Review of Online Nursing Courses: A Pilot Study. J Nurs Educ. 2009;48(7):411-5.
26. Masters K, Ellaway R. e-Learning in medical education Guide 32 Part 2: Technology, management and design. Med Teach. 2008;30(5):474-89.
27. Pawlowski JM. The quality adaptation model: adaptation and adoption of the quality standard ISO/IEC 19796-1 for learning, education, and training. J Educ Techno Soc. 2007;10(2):3-16.
28. Zhang W, Cheng YL. Quality assurance in e-learning: PDPP evaluation model and its application. Int Rev Res Open Dis. 2012;13(3):66-82.
29. Chan CH, Robbins LI. E-Learning Systems: Promises and Pitfalls. Acad Psychiatry. 2006;30(6):491-7.
30. Abdous M. E-learning quality assurance: a process-oriented lifecycle model. Qual Assur Educ. 2009;17(3):281-95.
31. Cooke M, Irby DM, O'Brien BC. Educating physicians: a call for reform of medical school and residency. J1st ed. San Francisco: Jossey-Bass Imprint; 2010.
32. Whittemore R, Knafl K. The integrative review: updated methodology. J Adv Nurs. 2005;52(5):546-53.
33. Harvey L, Green D. Defining Quality. Assess Eval High Educ. 2006;18(1):9-34.
34. Editor. ACCME about us. 2013. http://www.accme.org/about-us. Accessed 11 May 2014.
35. Al-Jewair TS, Azarpazhooh A, Suri S, Shah PS. Computer-assisted learning in orthodontic education: a systematic review and meta-analysis. J Dent Educ. 2009;73(6):730-9.
36. Mastrangelo G, Fadda E, Rossi CR, Zamprogno E, Buja A, Cegolon L. Literature search on risk factors for sarcoma: PubMed and Google Scholar may be complementary sources. BMC Res Notes. 2010;3:131.
37. Alexander LK, Horney JA, Markiewicz M, MacDonald PDM. 10 Guiding principles of a comprehensive Internet-based public health preparedness training and education program. Public Health Rep. 2010;125 Suppl 5:51-60.
38. Gordon M, Chandratilake M, Baker P. Low fidelity, high quality: a model for e-learning. Clin Teach. 2013;10(4):258-63.
39. Sowan AK, Jenkins LS. Use of the seven principles of effective teaching to design and deliver an interactive hybrid nursing research course. Nurs Educ Perspect. 2013;34(5):315-22.
40. Sorden SD. A cognitive approach to instructional design for multimedia learning. Informing Sci J. 2005;8:263-79.
41. Raymond M, Iliffe S, Pickett J. Technology-enhanced learning. Educ Prim Care. 2012;23(5):458-9.
42. Lau KHV. Computer-based teaching module design: principles derived from learning theories. Med Educ. 2014;48(3):247-54.
43. Garde S, Heid J, Haag M, Bauch M, Weires T, Leven FJ. Can design principles of traditional learning theories be fulfilled by computer-based training systems in medicine: The example of CAMPUS. Int J Med Inform. 2007;76(2-3):124-9.
44. Casebeer L, Kristofco RE, Strasser S, Reilly M, Krishnamoorthy P, Rabin A, Zheng S, Karp S, Myers L. Standardizing evaluation of on-line continuing medical education: physician knowledge, attitudes, and reflection on practice. J Contin Educ Health Prof. 2004;24(2):68-75.
45. Maor D, Volet S. Interactivity in professional online learning: A review of research based studies. Int J Educ Techno. 2007;23(2):269-90.
46. Bangert AW. The seven principles of effective teaching: a framework for designing, delivering, and evaluating an internet-based assessment course for nurse educators. Nurse Educ. 2005;30(5):221-5.
47. Curry M, Smith L. Twelve tips for authoring on-line distance learning medical post-registration programmes. Med Teach. 2005;27(4):316-21.
48. Knight CL, Sakowski HA, Houghton BL, Laya MB, DeWitt DE. Developing a peer review process for web-based curricula: minting a new coin of the realm. J Gen Intern Med. 2004;19(5):594-8.
49. Chang H-C, Liu C-F, Hwang H-G. Exploring Nursing E-Learning Systems Success Based on Information System Success Model. Comput Inform Nurs. 2011;29(12):741-7.
50. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Acad Med. 2010;85(5):909-22.
51. Wong G, Greenhalgh T, Pawson R. Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Med Educ. 2010;10(1):12.
52. Lewis KO, Cidon MJ, Seto TL, Chen H, Mahan JD. Leveraging e-Learning in Medical Education. Curr Probl Pediatr Adolesc Health Care. 2014;44(6):150-63.
53. Yavner SD, Pusic MV, Kalet AL, Song HS, Hopkins MA, Nick MW, Ellaway RH. Twelve tips for improving the effectiveness of web-based multimedia instruction for clinical learners. Med Teach. 2015;37(3):239-44.
54. Mayer RE. Applying the science of learning to medical education. Med Educ. 2010;44(6):543-9.
55. Minasian-Batmanian LC. Guidelines for developing an online learning strategy for your subject. Med Teach. 2002;24(6):645-7.
56. Davids MR, Chikte UME, Halperin ML. Effect of improving the usability of an e-learning resource: a randomized trial. Adv Physiol Educ. 2014;38:155-60.
57. Khoiny FE. Factors that contribute to computer-assisted instruction effectiveness. Comput Nurs. 1995;13(4):165-8.
58. El Mhouti ANA, Erradi M. Development of a Tool for quality assessment of digital learning resources. I J Comp Appl. 2013;64:27-31.
59. Cook DA. Revisiting Cognitive and Learning Styles in Computer-Assisted Instruction. Acad Med. 2012;87(6):778-84.
60. Mounsey A, Reid A. A randomized controlled trial of two different types of web-based instructional methods: One with case-based scenarios and one without. Med Teach. 2012;34(9):654-8.
61. Bluestone J, Johnson P, Fullerton J, Carr C, Alderman J, BonTempo J. Effective in-service training design and delivery: evidence from an integrative literature review. Hum Resour Health. 2013;11:51.
62. Friedlander MJ, Andrews L, Armstrong EG, Aschenbrenner C, Kass JS, Ogden P, Schwartzstein R, Viggiano TR. What can medical education learn from the neurobiology of learning? Acad Med. 2011;86(4):415-20.
63. Issa N, Schuller M, Santacaterina S, Shapiro M, Wang E, Mayer RE, DaRosa DA. Applying multimedia design principles enhances learning in medical education. Med Educ. 2011;45:818-26.
64. Short SED, Guillemette J-M, Duncan AM, Kirby F. Defining quality criteria for online continuing medical education modules using modified nominal group technique. J Contin Educ Health Prof. 2010;30(4):246-50.
65. Van Merrienboer JJG, Sweller J. Cognitive load theory in health professional education: design principles and strategies. Med Educ. 2010;44(1):85-93.
66. Posel N, Fleiszer D, Shore BM. 12 Tips: Guidelines for authoring virtual patient cases. Med Teach. 2009;31(8):701-8.
67. Triola MM, Huwendiek S, Levinson AJ, Cook DA. New directions in e-learning research in health professions education: Report of two symposia. Med Teach. 2012;34(1):15-20.
68. Mehta NB, Hull AL, Young JB, Stoller JK. Just Imagine. Acad Med. 2013;88(10):1418-23.
69. Liyanagunawardena TR, Williams SA. Massive open online courses on health and medicine: review. J Med Internet Res. 2014;16(8):e191.
70. Hillman T, Sherbino J. Social media in medical education: a new pedagogical paradigm? Postgrad Med J. 2015;91(1080):544-5.
71. Casimiro L, MacDonald CJ, Thompson TL, Stodel EJ. Grounding theories of W(e)Learn: A framework for online interprofessional education. J Interprof Care. 2009;23(4):390-400.
72. Kim P, Eng TR, Deering MJ, Maxfield A. Published criteria for evaluating health related web sites: review. BMJ. 1999;318:647-9.
73. Sekikawa A, Aaron DJ, Acosta B, Sa E, LaPorte RE. Does the perception of downloading speed influence the evaluation of web-based lectures? Public Health. 2001;115:152-6.
74. Doyle DJ. Web page evaluation in medical education. Can J Anaesth. 2002;49:997.
75. Jha V, Duffy S. "Ten golden rules" for designing software in medical education: results from a formative evaluation of DIALOG. Med Teach. 2002;24:417-21.
76. Shaw T, Barnet S, Mcgregor D, Avery J. Using the Knowledge, Process, Practice (KPP) model for driving the design and development of online postgraduate medical education. Med Teach. 2015;37(1):53-8.