Technology-enabled assessment of health professions education: Consensus statement and recommendations from the Ottawa 2010 conference

Medical Teacher

Volumn 33, Issue 5, 2011, Pages 364-369

  Amin, Zubair ^a   Boulet, John R ^b   Cook, David A ^c   Ellaway, Rachel ^d   Fahal, Ahmad ^e   Kneebone, Roger ^f   Maley, Moira ^g   Ostergaard, Doris ^h   Ponnamperuma, Gominda ⁱ   Wearn, Andy ^j   Ziv, Amitai ^k  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b Education Commission for Foreign Medical Graduates   (United States)

^c Mayo Clinic   (United States)

^d NORTHERN ONTARIO SCHOOL OF MEDICINE   (Canada)

^e UNIVERSITY OF KHARTOUM   (Sudan)

^f IMPERIAL COLLEGE LONDON   (United Kingdom)

^g UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

^h UNIVERSITY OF COPENHAGEN   (Denmark)

ⁱ UNIVERSITY OF COLOMBO   (Sri Lanka)

^j UNIVERSITY OF AUCKLAND   (New Zealand)

^k Israel Centre for Medical Simulation   (Israel)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPUTER; COMPUTER SIMULATION; CURRICULUM; EDUCATION; HEALTH CARE PERSONNEL; HUMAN; MEDICAL INFORMATICS; METHODOLOGY; REPRODUCIBILITY; WIRELESS COMMUNICATION;

COMPUTER SIMULATION; COMPUTERS; CURRICULUM; EDUCATIONAL MEASUREMENT; HEALTH PERSONNEL; HUMANS; MEDICAL INFORMATICS; REPRODUCIBILITY OF RESULTS; WIRELESS TECHNOLOGY;

EID: 79955375287     PISSN: 0142159X     EISSN: 1466187X     Source Type: Journal    
DOI: 10.3109/0142159X.2011.565832     Document Type: Conference Paper

References (49)

1. Bradley P. 2006. The history of simulation in medical education and possible future directions. Med Educ 40(3):254-262.
2. Bennett RE. 2005. Using new technology to improve assessment. Educ Meas 18(3):5-12. Available from: http://www3.interscience.wiley.com/journal/ 119079459/abstract?CRETRY=1&SRETRY=0 (accessed 4 June 2010).
3. Boulet JR, Murray D, Kras J, Woodhouse J, Mcallister J, Ziv A. 2003. Reliability and validity of a simulation-based acute care skills assessment for medical students and residents. Anesthesiol 99:1270-1280. (Pubitemid 37475170)
4. Boulet JR. 2008. Summative assessment in medicine: The promise of simulation for high-stakes evaluation. Acad Emerg Med 15(11):1017-1024.
5. Boulet JR, Murray D. 2010. Simulation-based assessment in anesthesiology: Requirements for practical implementation. Anesthesiol 112(4): 1041-1052.
6. Bradley P, Bligh J. 2005. Clinical skills centres: Where are we going? Med Educ 39(7):649-650. (Pubitemid 40897303)
7. California HealthCare Foundation 2010. How smart phone is changing health care for consumers and providers. Available from http://www.chcf.org/ publications/2010/04/how-smartphones-are-changing-health-care-for-consumers-and- providers (accessed 23 June 2010).
8. Cook DA, Beckman TJ. 2006. Current concepts in validity and reliability for psychometric instruments: Theory and application. Am J Med 119: 166.e7-e16.
9. Dev P, Youngblood P, Heinrichs WL, Kusumoto L. 2007. Virtual worlds and team training. Anesthesiol Clin 25:321-336. (Pubitemid 46898937)
10. TM). Qual Saf Health Care 13:41-45.
11. Downing SM, Haladyna TM. 2004. Validity threats: Overcoming interfer-ence with proposed interpretations of assessment data. Med Educ 38:327-333. (Pubitemid 38375761)
12. Economist 2010. Wireless health care when your carpet calls your doctor. 8 April 2010. New York. Available from: http://www. economist.com/business- finance/displaystory.cfm?story-id=15868133& source=hptextfeature (accessed 10 April 2010).
13. Ellaway RH, Kneebone R, Lachapelle K, Topps D. 2009. Practica continua: Connecting and combining simulation modalities for integrated teach-ing, learning and assessment. Med Teach 31(8):725-731.
14. Ellaway R, Martin R. 2008. What's mine is yours-open source as a new paradigm for sustainable healthcare education. Med Teach 30(2):175-179. (Pubitemid 351942683)
15. Ellaway R, Masters K. 2008. AMEE Guide 32: e-learning in medical education Part 1: Learning, teaching and assessment. Med Teach 30(5):455-473. (Pubitemid 351983065)
16. Epstein RM, Hundert EM. 2002. Defining and assessing clinical competence. JAMA 387:226-235.
17. Errichetti A, Boulet JR. 2006. Comparing traditional and computer-based training methods for standardized patients. Acad Med 81(10): S91-S94.
18. Fischer M, Kopp V, Holzer M, Ruderich F, Jünger J. 2005. A modified electronic key feature examination for undergraduate medical students: Validation threats and opportunities. Med Teach 27(5):450-455. (Pubitemid 41387892)
19. Fried MP, Satava R, Weghorst S, Gallagher A, Sasaki C, Ross D, Sinanan M, Uribe J, Zeltsan M, Arora H, et al. 2004. Identifying and reducing errors with surgical simulation. Qual Saf Health Care 13:19-26.
20. Galvagno SM, Segal BS. 2009. Critical action procedures testing: A novel method for test enhanced learning. Med Educ 43:1182-1187.
21. Gesundheit N, Brutlag P, Youngblood P, Gunning WT, Zary N, Fors U. 2009. The use of virtual patients to assess the clinical skills and reasoning of medical students: Initial insights on student acceptance. Med Teach 31(8):739-742.
22. Gordon JA, Wilkerson WM, Shaffer DW, Armstrong EG. 2001. Practicing medicine without risk: Students' and educators' responses to high-fidelity patient simulation. Acad Med 76(5):469-472. (Pubitemid 32417332)
23. Graham G. 1999. The internet: A philosophical inquiry. London, UK Routledge.
24. Greenhalgh T. 2001. Computer assisted learning in undergraduate medical education. BMJ 322:40-44. (Pubitemid 32066262)
25. Hersh W. 1994. Relevance and retrieval evaluation: Perspectives from medicine. J Am Soc Inform Sci 45(3):201-206.
26. Issenberg SB, McGaghie WC, Hart IR, Mayer JW, Felner JM, Petrusa ER, Waugh RA, Brown DD, Safford RR, Gessner IH, et al. 1999. Simulation technology for health care professional skills training and assessment. JAMA 282:861-866. (Pubitemid 29408938)
27. Issenberg SB, McGaghie WC, Petrusa ER, Gordon DL, Scalese RJ. 2005. Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review. Med Teach 27(1):10-28. (Pubitemid 40514851)
28. Kneebone RL. 2009a. Practice, rehearsal, and performance: An approach for simulation-based surgical and procedure training. JAMA 302: 1336-1388.
29. Kneebone R. 2009b. Perspective: Simulation and transformational change: The paradox of expertise. Acad Med 84(7):954-957.
30. Kneebone R, Arora S, King D, Bello F, Sevdalis N, Kassab E, Aggarwal R, Darzi A, Nestel D. 2010. Distributed simulation-accessible immersive training. Med Teach 32:65-70.
31. Kneebone R, Kidd J, Nestel D, Asvall S, Paraskeva P, Darzi A. 2002. An innovative model for teaching and learning clinical procedures. Med Educ 36:628-634. (Pubitemid 34779815)
32. Kress G. 2010. Multimodality: A social semiotic approach to contemporary communication. London, UK: Routledge.
33. Larsen PD, Butler A, Roediger III HL. 2009. Repeated testing improves long-term retention relative to repeated study: A randomised controlled trial. Med Educ 43:1174-1181.
34. Margolis MB, Clauser BE, Harik P. 2004. Scoring the computer-based case simulation component of USMLE Step 3: A comparison of preopera-tional and operational data. Acad Med 79:S62-S64. (Pubitemid 39281219)
35. Norcini JJ, McKinley DW. 2007. Assessment methods in medical education. Teach Teach Educ 23:239-250.
36. Norcini JJ, Anderson B, Bollela V, Burch V, Costa MJ, Duvivier R, Galbraith R, Hays R, Kent A, Perrott V. 2011. Criteria of good assessment Consensus statement and recommendations from the Ottawa 2010 Conference 2010 Conference. Med Teach 33(3):206-214.
37. Reiser SJ. 2009. Technological medicine: The changing world of doctors and patients. New York: Cambridge University Press.
38. Reznick RK, MacRea H. 2006. Teaching surgical skills-changes in the wind. N EnglJ Med 355:2664-2669.
39. Round J, Conradi E, Poulton T. 2009. Improving assessment with virtual patients. Med Teach 31(8):759-763.
40. Scalese RJ, Obeso VT, Issenberg SB. 2007. Simulation technology for skills training and competency assessment in medical education. J Gen Intern Med 23(Suppl 1):46-49.
41. Scarborough H, Corbett JM. 1992. Technology and organization: Power, meaning and design. London, UK: Routledge.
42. Schuwirth LWT, van der Vleuten CPM, De Kock CA, Peperkamp AGW, Donkers HHLM. 1996. Computerized case-based testing: A modern method to assess clinical decision making. Med Teach 18(4):294-299 (Pubitemid 27042579)
43. Shachak A, Hadas-Dayagi M, Ziv A, Reis S. 2009. Primary care physicians' use of an electronic medical record system: A cognitive task analysis. J Gen Intern Med 24(3):341-348.
44. Shavit I, Keidan I, Hoffmann Y, Mishuk L, Rubin O, Ziv A, Steiner I. 2007. Enhancing patient safety during pediatric sedation: The impact of simulation-based training of non-anesthesiologists. Arch Pediatr Adolesc Med 161(8):740-743. (Pubitemid 47236439)
45. Sica GT, Barron DM, Blum R, Frenna TH, Raemer DB. 1999. Computerized realistic simulation: A teaching module for crisis management in radiology. AJR AmJ Roentqenol 172:301-304. (Pubitemid 29082630)
46. Tekian A, McGuire CH, McGaghie WC. 1999. Innovative simulations for assessing professional competence: From paper-and-pencil to virtual reality. Chicago. Dept of Medical Education, University of Illinois at Chicago. Chicago, USA.
47. Wiggins G. 1993. Assessing student performance exploring the purpose and limits of testing. San Francisco, USA: Jossey-Bass.
48. Wong SH, Ng KF, Chen PP. 2002. The application of clinical simulation in crisis management Training. Hong Kong Med J 8:131-135
49. Ziv A, Wolpe PR, Small SD, Glick S. 2003. Simulation-based medical education: An ethical imperative. Acad Med 78:783-788. (Pubitemid 36993078)