Learning, testing, and the evaluation of learning environments in medicine: Global performance assessment in medical education

Interactive Learning Environments

Volumn 12, Issue 3, 2004, Pages 167-178

  Shaffer, David Williamson ^a   Gordon, James A ^b   Bennett, Nancy L ^c  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b MASSACHUSETTS GENERAL HOSPITAL   (United States)

^c HARVARD MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33746386346     PISSN: 10494820     EISSN: 17445191     Source Type: Journal    
DOI: 10.1080/10494820512331383409     Document Type: Article

References (51)

1. Albanese, M. (1999). Rating educational quality: Factors in the erosion of professional standards. Academic Medicine, 74(6), 652-658.
2. Ali, J., Adam, R.U., Josa, D., Pierre, I., Bedaysie, H., West, U., et al. (1999). Comparison of performance of interns completing the old (1993) and new interactive (1997) Advanced trauma life support courses. Journal of Trauma, 46(1), 80-86.
3. Bradley, P., & Humphris, G. (1999). Assessing the ability of medical students to apply evidence in practice: The potential of the OSCE. Medical Education, 33(11), 815-817.
4. Braun, B.I., Koss, R.G., & Loeb, J.M. (1999). Integrating Performance Measure Data into the Joint Commission Accreditation Process. Evaluation and the Health Professions, 22(3), 283-297.
5. Brennan, R., Braslow, A., Batcheller, A., & Kaye, W. (1996). A reliable and valid method for evaluating cardiopulmonary resuscitation training outcomes. Resuscitation, 32(2), 85-93.
6. Chaudhry, A., Sutton, C., Wood, J., Stone, R., & McCloy, R. (1999). Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: Quality of human-computer interface. Annals of the Royal College of Surgeons of England, 81(4), 281-286.
7. Clyman, S.G., Melnick, D.E., & Clauser, B.E. (1999). Computer-based case simulations from medicine: Assessing skills in patient management. In W.C. McGahie (Ed.), Innovative simulations for assessing professional competence (pp. 29-41). Chicago: Department of Medical Education, University of Illinois at Chicago.
8. Cohen, D., Colliver, J., Marcy,M., Fried, E., & Swartz, M. (1996). Psychometric properties of a standardized-patient checklist and rating-scale form used to assess interpersonal and communications skills. Academic Medicine, 71, S87-S89.
9. Collins, J., & Harden, R. (1998). AMEE Medical Education Guide No. 13: Real patients, simulated patients and simulators in clinical examinations. Medical Teacher, 20, 508-521.
10. Cuschieri, A. (2000). Human reliability assessment in surgery - a new approach for improving surgical performance and clinical outcome. Annals of the Royal College of Surgeons of England, 82(2), 83-87.
11. Dreyfus, H.L., & Dreyfus, S.E. (1986). Mind over machine: The power of human intuition and expertise in the era of the computer. New York: Free Press.
12. Dupras, D., & Li, J. (1995). Use of an objective structured clinical examination to determine clinical competence. Academic Medicine, 70(11), 1029-1034.
13. Everitt, N. (1997). An alternative database for the computerized surgical logbook. Annals of the Royal College of Surgeons of England, 79(6 Suppl.), 249-253.
14. Gordon, J.A., Oriol, N.E., & Cooper, J.B. (2004). Brining good teaching cases "to life": A simulator-based medical education service. Academic Medicine, 79, 23-27.
15. Hodges, B., Regehr, G., McNaughton, N., Tiberius, R., & Hanson, M. (1999). OSCE checklists do not capture increasing levels of expertise. Academic Medicine, 10(74), 1129-1134.
16. Iglehart, J. (1998). Forum on the future of academic medicine: Session III - getting from here to there. Academic Medicine, 73(2), 146-151.
17. Jolly, B., & Ho-Ping-Kong, H. (1991). Independent learning: An exploration of student grand rounds. Medical Education, 25(4), 334-342.
18. Kaufman, D.M., Mann, K.V., Muijtjens, A.M., & van der Vleuten, C.P. (2000). A comparison of standard-setting procedures for an OSCE in undergraduate medical education. Academic Medicine, 75(3), 267-271.
19. Kohn, L.T., Corrigan, J.M., & Donaldson, M.S. (Eds.). (2000). To err is human: Building a safer health system. Washington, DC: National Academy Press.
20. Krakower, J.Y., Williams, D.J., & Jones, R.F. (1999). Review of US medical school finances, 1997-1998. JAMA, 282, 847-854.
21. Kwolek, C., Donnelly, M., Sloan, D., Birrell, S., Strodel, W., & Schwartz, R. (1997). Ward evaluations: Should they be abandoned? Journal of Surgical Research, 69(1), 1-6.
22. Martin, J.A., Regehr, G., Reznick, R., MacRae, H., Murnaghan, J., Hutchison, C., et al. (1997). Objective structured assessment of technical skill (OSATS) for surgical residents. British Journal of Surgery, 84(2), 273-278.
23. Mavis, B., Henry, R., Ogle, K., & Hoppe, R. (1996). The emperor's new clothes: The OSCE reassessed. Academic Medicine, 71(5), 447-453.
24. McGraw, R., & O'Connor, H. (1999). Standardized patients in the early acquisition of clinical skills. Medical Education, 33(8), 572-578.
25. Morgan, P., & Cleave-Hogg, D. (2000). Evaluation of medical students' performance using the anesthesia simulator. Medical Education, 34(1).
26. Noel, G., Herbers, J., Caplow, M., Cooper, G., Pangaro, L., & Harvey, J. (1992). How well do internal medicine faculty members evaluate the clinical skills of residents? Annals of Internal Medicine, 117, 757-765.
27. Phillips, N., & John, N. (2000). Web-based surgical simulation for ventricular catheterization. Neurosurgery, 46(4), 933-936; discussion 936-937.
28. Ram, P., Grol, R., Rethans, J., Schouten, B., Vleuten, C., & Kester, A. (1999). Assessment of general practitioners by video observation of communicative and medical performance in daily practice: Issues of validity, reliability and feasibility. Medical Education, 33(6), 447-454.
29. Sambrook, P., Smith, A., Hewitt, G., & Goss, A.N. (1996). Development of a national clinical logbook system for oral and maxillofacial surgery trainees - the RACDS, OMS system. International Journal of Maxillofacial Surgery, 25(3), 242-244.
30. Scheuneman, A., Carley, J., & Baker, W. (1994). Residency evaluations: Are they worth the effort? Archives of Surgery, 129(10), 1067-1073.
31. Schubert, A., Tetzlaff, J., Tan, M., Barnes, A., Ryckman, J., & Mascha, E. (1999). Consistency, inter-rater reliability, and validity of 441 consecutive mock oral examinations in anesthesiology: Implications for use as a tool for assessment of residents. Anesthesiology, 91(1), 288-298.
32. Schwartz, R., Witzke, D., Donnelly, M., Stratton, T., Blue, A., & Sloan, D. (1998). Assessing residents' clinical performance: Cumulative results of a four-year study with the Objective Structured Clinical Examination. Surgery, 124(2), 307-312.
33. Schweinhart, L. (1999). Evaluation of early childhood programs. Child and Adolescent Psychiatric Clinics of North America, 8(2), 395-407, viii-ix.
34. Searle, J. (2000). Defining competency - the role of standard setting. Medical Education, 34(5), 363-366.
35. Shaffer, D.W., Dawson, S., Meglan, D., Cotin, S., Ferrell, M., Norbash, A., et al. (2000). Design principles for the use of simulation as an aid in interventional cardiology training. Minimally Invasive Therapy and Applied Technologies, 10(2).
36. Shaffer, D.W., Kigin, C., Kaput, J., & Gazelle, G. (2002). What is digital medicine? In R. Bushko (Ed.), Future of health technology: IOS Press.
37. Shaffer, D.W., Meglan, D., Ferrell, M., & Dawson, S. (1999). Virtual rounds: Simulation-based education in procedural medicine. In H. Pien (Ed.), Proceedings of SPIE Vol. 3712: Battlefield Biomedical Technologies.
38. Simon, S., Sullivan, A., Pan, R., Connelly, M., Peters, A., Clark-Chiarelli, N., et al. (1999). Views of managed care - a survey of students, residents, faculty, and deans at medical schools in the United States. New England Journal of Medicine, 340(12), 928-936.
39. Sloan, D., Donnelly, M., Schwartz, R., Felts, J., Blue, A., & Strodel, W. (1996). The use of objective structured clinical examination (OSCE) for evaluation and instruction in graduate medical education. Journal of Surgical Research, 63(1), 225-230.
40. Sloan, D., Donnelly, M., Schwartz, R., & Strodel, W. (1995). The Objective Structured Clinical Examination: The new gold standard for evaluating postgraduate clinical performance. Annals of Surgery, 222(6), 735-742.
41. Smith, F., Singleton, A., & Hilton, S. (1998). General practitioners' continuing education: A review of policies, strategies and effectiveness, and their implications for the future. British Journal of General Practice, 48(435), 1689-1695.
42. Smith, S., Torkington, J., & Darzi, A. (1999). Objective assessment of surgical dexterity using simulators. Hospital Medicine, 60(9), 672-675.
43. Sutnick, A., Stillman, P., Norcini, J., Friedman, M., Williams, R., Trace, S.M., et al. (1994). Pilot study of the use of the ECFMG clinical competence assessment to provide profiles of clinical competencies of graduates of foreign medical schools for residency directors. Academic Medicine, 69(1), 65-67.
44. Swartz, M., & Colliver, J. (1996). Using standardized patients for assessing clinical performance: An overview. Mount Sinai Journal of Medicine, 63(3-4), 241-249.
45. Sykes, R.S., Ito, K., Fitzpatrick, A.R., & Ercikan, K. (1997). Review of technical issues in large-scale performance assessment. Journal of Educational Measurement, 4, 379-384.
46. Van Horn, R.L., Burns, L.R., & Wholey, D.R. (1997). The impact of physician involvement in managed care on efficient use of hospital resources. Medical Care, 35(9), 873-889.
47. Veloski, J., Rabinowitz, H., Robeson, M., & Young, P. (1999). Patients don't present with five choices: An alternative to multiple choice tests in assessing physicians' competence. Academic Medicine, 74(5), 539.
48. Warf, B., Donnelly, M., Schwartz, R., & Sloan, D. (1999). Interpreting the judgment of surgical faculty regarding resident competence. Journal of Surgical Research, 86(1), 29-35.
49. Weingarten, M., Polliack, M., Tabenkin, H., & Kahan, E. (2000). Variations among examiners in family medicine residency board oral examinations. Medical Education, 34(1), 13-17.
50. White, A., Tuckey, J., & Crane, S. (1999). Education and training module for a specialist registrar: A move forward in specialist registrar education. British Journal of Family Planning, 25(2), 77-80.
51. Williams, R.G., Klamen, D.A., & McGaghie, W.C. (2003). Cognitive, social and environmental sources of bias in clinical performance ratings. Teaching and Learning in Medicine, 15(4), 270-292.