Comparing the psychometric properties of checklists and global ratings scales for assessing performance on an OSCE-format examination

Academic Medicine

Volumn 73, Issue 9, 1998, Pages 993-997

  Regehr, Glenn ^a   MacRae, Helen ^b   Reznick, Richard K ^b   Szalay, David ^b  

^a UNIVERSITY HEALTH NETWORK   (Canada)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPETENCE; HUMAN; MAJOR CLINICAL STUDY; MEDICAL SPECIALIST; POSTGRADUATE EDUCATION; PRIORITY JOURNAL; PSYCHOMETRY; RESIDENCY EDUCATION; SKILL;

EID: 0031713909     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: 10.1097/00001888-199809000-00020     Document Type: Article

References (18)

1. Streiner DL. Global rating scales. In: Neufeld VR, Norman GR (eds). Assessing Clinical Competence. New York: Springer, 1985.
2. Harden R, Stevenson M, Downie W, Wilson G. Assessment of clinical competence using an objective structured examination. BMJ. 1975;1: 447-51.
3. Barrows HS, Williams RG, Moy RH. A comprehensive performance-based assessment of fourth-year students' clinical skills. J Med Educ. 1987; 62:805-9.
4. Norman GR. Theoretical and psychometric considerations. In: Task Force of the Evaluation Committee, Royal College of Physicians and Surgeons of Canada. Report on the Evaluation System for Specialist Certification. 1993.
5. Norman GR, Feightner JW. A comparison of behaviour on simulated patients and patient management problems. Med Educ. 1981;15:26-32.
6. Norman GR, Tugwell P, Feightner W, Muzzin LJ, Jacoby LL. Knowledge and clinical problem solving. Med Educ. 1985;19:344-56.
7. Stillman P1 Swanson D, Regan MB, et al. Assessment of clinical skills of residents utilizing standardized patients: a follow up study and recommendations for application. Ann Intern Med. 1991;114:393-401.
8. Reznick R, Cohen R. An objective structured clinical examination for senior residents: testing at the high end. Paper presented at The Sixth Ottawa Conference on Medical Education, Toronto, Ontario, Canada, June 1994.
9. Martin J, Regehr O, Reznick R, et al. An objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:273-8.
10. Littlefield JH, Troendle GR. Effects of rating task instructions on consistency and accuracy of expert raters. Paper presented at the annual meeting of the American Educational Research Association, Washington, DC, April 1987.
11. Cohen R, Rothman Al, Poldre P, Ross J. Validity and generalizability of global ratings in an objective structured clinical examination. Acad Med. 1991;66:545-8.
12. MacRae HM, Vu NV, Word-Sims M, Graham B, Colliver J, Robbs R. Comparison of checklists and databases with physicians' ratings as a measure of history and physical examination skills. Acad Med. 1995;70:313-7.
13. Reznick RK, Regehr G, MacRae H, Martin J, McCulloch W. Testing technical skills outside the operating room: an innovative bench model examination. Am J Surg. 1997;173:226-30.
14. Winckle C, Reznick RK, Cohen R, Taylor B. Reliability and construct validity of a structured technical skills assessment form. Am J Surg. 1994;167:423-7.
15. Feldt LS, Brennan RL. Reliability. In: Lin RL. Educational Measurement. 3rd ed. Phoenix, AZ: Oryx Press, 1993.
16. Regehr G, MacRae HM, Reznick R. Task specific checklists vs. global ratings scales: comparing the reliability and validity of OSCE performance measures. Paper presented at the annual meeting of the Association of American Medical Colleges, San Francisco, CA, November 1996.
17. Pangaro L, Worth-Dickerson H, Macmillan K, Klass D, Shatzer J. Use of 'standardized examinees' in a clinical practice examination. Paper presented at the Seventh Ottawa Conference on Medical Education, Maastricht, The Netherlands, June 1996.
18. Clauser B, Ross L, Margolis M, Nungester R, Klass D. Determining weights for items on a standardized patient checklist. Paper presented at the Seventh Ottawa Conference on Medical Education, Maastricht, The Netherlands, June 1996.