Teaching and assessing procedural skills using simulation: Metrics and methodology

Academic Emergency Medicine

Volumn 15, Issue 11, 2008, Pages 1079-1087

  Lammers, Richard L ^a   Davenport, Moira ^b   Korley, Frederick ^c   Griswold Theodorson, Sharon ^d   Fitch, Michael T ^e   Narang, Aneesh T ^f   Evans, Leigh V ^g   Gross, Amy ^h   Rodriguez, Elliot ⁱ   Dodge, Kelly L ^g   Hamann, Cara J ^g   Robey III, Walter C ^j  

^a MICHIGAN STATE UNIVERSITY   (United States)

^b ALLEGHENY GENERAL HOSPITAL   (United States)

^c JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d DREXEL UNIVERSITY COLLEGE OF MEDICINE   (United States)

^e WAKE FOREST UNIVERSITY HEALTH SCIENCES   (United States)

^f BOSTON MEDICAL CENTER   (United States)

^g YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^h WESTERN MICHIGAN UNIVERSITY   (United States)

ⁱ State University of New York Upstate Medical University: College of Medicine   (United States)

^j EAST CAROLINA UNIVERSITY   (United States)

more..

Author keywords

Competence; Emergency medicine; Medical education; Procedures; Simulation; Technical skills

Indexed keywords

CONFERENCE PAPER; EMERGENCY MEDICINE; EMERGENCY PHYSICIAN; HUMAN FACTORS RESEARCH; MEDICAL ASSESSMENT; MEDICAL EDUCATION; MEDICAL INSTRUMENTATION; MEDICAL PRACTICE; OUTCOME ASSESSMENT; PRIORITY JOURNAL; RELIABILITY; SENSITIVITY ANALYSIS; SIMULATION; SIMULATOR; SKILL RETENTION; TEAMWORK; VALIDITY;

CLINICAL COMPETENCE; EMERGENCY MEDICINE; HUMANS; LEARNING; RESEARCH DESIGN; TASK PERFORMANCE AND ANALYSIS; TEACHING;

EID: 56849124281     PISSN: 10696563     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1553-2712.2008.00233.x     Document Type: Conference Paper

References (51)

1. Accreditation Council for Graduate Medical Education. Emergency Medicine Residency Review Committee. Available at: http://www.acgme.org/acWebsite/ navPages/nav_110.asp. Accessed Jul 21, 2008.
2. Accreditation Council on Graduate Medical Education. General Competency Standards. Available at: http://www.acgme.org/outcome/comp/ GeneralCompetenciesStandards21307.pdf. Accessed Jul 21, 2008.
3. Rothman A, Cohen R. A comparison of empirically-and rationally-defined standards for clinical skills checklists. Acad Med. 1996; 71(Suppl):S1-3.
4. Bardes C, Colliver J, Alonso D, Swartz M. Validity of standardized-patient examination scores as an indicator of faculty observer ratings. Acad Med. 1996; 71(Suppl):S82-3.
5. Gordon J, McLauglhin S, Shapiro M, Bond W, Spillane L. Simulation in emergency medicine. In: Loyd G, Lake C, Greenberg C, eds. Practical Health Care Simulations. Philadelphia, PA: Elsevier, 2004: pp 299-337.
6. Rosenthal R, Gantert W, Hamel C, et al. Assessment of construct validity of a virtual reality laparoscopy simulator. J Lap Adv Surg Tech. 2007; 17:407-13.
7. Hayden S, Panacek E. Procedural competency in emergency medicine: the current range of resident experience. Acad Emerg Med. 1999; 6:728-35.
8. Chapman D, Rhee K, Marx J, et al. Open thoracotomy procedural competency: validity study of teaching and assessment modalities. Ann Emerg Med. 1996; 28:641-7.
9. Nicholson W, Cates C, Patel A, et al. Face and content validation of virtual reality simulation for carotid angiography: results from the first 100 physicians attending the Emory Neuro Anatomy Carotid Training (ENACT) program. Simul Healthc. 2006; 1:147-50.
10. Kazdin AE. Behavior Modification in Applied Settings. Florence, KY: Brooks/Cole; 1989, pp 54-6.
11. Aggarwal R, Grantchorov T, Darzi A. Framework for systemic training and assessment of technical skills. J Am Coll Surg. 2007; 204:697-705.
12. Slagle R, Weinger M, Dinh M, Brumer V, Williams K. Assessment of the intra-rater and inter-rater reliability of an established clinical task analysis methodology. Anesthesiology. 2002; 96:1129-39.
13. Newble D. Guidelines for assessing clinical competence. Teach Learn Med. 1994; 4:213-20.
14. Bond W, Spillane L. The use of simulation for emergency medicine resident assessment. Acad Emerg Med. 2002; 9:1295-9.
15. Wood R. Task complexity: definition of a construct. Organ Behav Hum Dec Proc. 1986; 37:60-82.
16. Cizek G. Setting passing scores. Educ Meas: Issues Pract. 1996; (Summer):20-31.
17. deChamplain A. Ensuring that the competent are truly competent: an overview of common methods and procedures used to set standards on high-stakes examinations. J Vet Med Educ. 2004; 31:62-6.
18. Norcini J. Setting standards on educational tests. Med Educ. 2003; 37:464-9.
19. McKinley D, Boulet J, Hambleton R. A work-centered approach for setting passing scores on performance-based assessments. Eval Health Prof. 2005; 28:349-69.
20. Boulet J, Champlain Ad, McKinley D. Setting defensible performance standards on OSCEs and standardized patient examinations. Med Teach. 2003; 25:245-9.
21. Boulet J, Murray D, Kras J, Woodhouse J. Setting performance standards for mannequin-based acute care scenarios. Simul Healthc. 2008; 3:72-81.
22. Morrison H. The passing score in the objective structured clinical examination. Med Ed. 1996; 30:345-8.
23. Plake B. Setting performance standards for professional licensure and certification. Appl Meas Educ. 1998; 11:65-80.
24. Talente G, Haist S, Wilson J. A model for setting performance standards for standardized patient examinations. Eval Health Prof. 2003; 26:427-46.
25. Thomas H, Binder L, Chapman D, et al. The 2003 model of the clinical practice of emergency medicine: the 2005 update. Acad Emerg Med. 2006; 13:1070-3.
26. Chapman D. Definitively defining the specialty of emergency medicine: issues of procedural competency. Acad Emerg Med. 1999; 6:678-81.
27. Baily J, Burch M. Research Methods in Applied Behavior Analysis. Thousand Oaks, CA: Sage Publications, 2002, pp 63-80.
28. Kazdin A. The token economy: a decade later. J Appl Behav Anal. 1982; 15:431-45.
29. Johnston J, Pennypacker H. Strategies and Tactics of Behavioral Research. Hillsdale, NJ: Lawrence Erlbaum, 1985, pp 135-43.
30. Reznick R. Teaching and testing technical skills. Am J Surg. 1993; 165:358-61.
31. Ferrell B. Clinical performance assessment using standardized patients: a primer. Fam Med. 1995; 27:14-9.
32. Carter F, Schijven M, Aggarwal R, et al. Consensus guidelines for validation of virtual reality surgical simulators. Simul Healthc. 2006; 1:171-9.
33. Scalese R, Obeso V, Issenberg S. Simulation technology for skills training and competency assessment in medical education. J Gen Intern Med. 2007; 23(Suppl): 46-9.
34. Issenberg S, McGaghie W, Petrusa E. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systemic review. Med Teach. 2005; 27:10-28.
35. McGaghie W, Issenberg S, Petrusa E, Scalese R. Effect of practice on standardized learning outcomes in simulation-based medical education. Med Educ. 2006; 40:792-7.
36. Ericsson K. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004; 10(Suppl):S1-12.
37. Brydges R, Carnahan H, Backstein D, Dubrowski A. Application of motor learning principles to complex surgical tasks: searching for the optimal practice schedule. J Motor Behav. 2007; 39:40-8.
38. Lujan H, DeCarlo S. First year medical students prefer multiple learning styles. Adv Physiol Educ. 2006; 30:13-6.
39. Prystowsky J, Regehr G, Rogers D, Loan J, Hiemenz L, Smith K. A virtual reality module for intravenous catheter placement. Am J Surg. 1999; 177:171-5.
40. Anastakis D, Wanzel K, Brown M, McIlroy J, Hamstra S, Ali J. Evaluating the effectiveness of a 2-year-curriculum in a surgical skills center. Am J Surg. 2003; 185:378-5.
41. Fried G. Proving the value of simulation in laparoscopic surgery. Ann Surg. 2004; 240:518-28.
42. Kneebone R, Kidd J, Nestal D. Blurring the boundaries: scenario-based simulation in a clinical setting. Med Educ. 2005; 39:580-7.
43. Wong J, Matsumoto E. Primer: cognitive motor learning for teaching surgical skill-how are surgical skills taught and assessed? Nat Clin Prac Urol. 2008; 2008:47-54.
44. Arthur W Jr, Bennett W Jr, Day EA, McNelly TL. Skill Decay: A Comparative Assessment of Training Protocols and Individual Differences in the Loss and Reacquisition of Complex Skills. Springfield, VA: National Technical Information Service, 2002.
45. Stolovitch H, Keeps E. Telling Ain't Training. Alexandria, VA: ASTD Press, 2006.
46. Kneebone R, Kidd J, Nestel D, Asvall S, Paraskeva P, Darzi A. An innovative model for teaching and learning clinical procedures. Med Educ. 2002; 36:628-34.
47. McLaughlin S, Doezema D, Sklar D. Human simulationn in emergency medicine training: a model curriculum. Acad Emerg Med. 2002; 9:1310-8.
48. Dawson S. Procedural simulation: a primer. J Vasc Intervent Radiol. 2006; 17:205-13.
49. Ericsson K. The Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance. The Cambridge Handbook of Expertise and Expert Performance. Cambridge, UK: Cambridge University Press, 2006, pp 685-706.
50. Ericsson K, Lehmann A. Expert and exceptional performance: evidence on maximal adaptations on task constraints. Annu Rev Psych. 1996; 47:273-305.
51. Bereiter C, Scardamalia M. Surpassing Ourselves: An Inquiry into the Nature and Implications of Expertise. Chicago and La Salle, IL: Open Court Publishing Company, 1993, p 11.