Relying on others' reliability: Challenges in clinical teaching assessment

Teaching and Learning in Medicine

Volumn 23, Issue 1, 2011, Pages 21-27

  Zibrowski, Elaine M ^a   Myers, Kathryn ^b   Norman, Geoff ^c   Goldszmidt, Mark A ^a  

^a WESTERN UNIVERSITY   (Canada)

^b LONDON HEALTH SCIENCES CENTRE   (Canada)

^c MCMASTER UNIVERSITY MEDICAL CENTRE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CANADA; CLINICAL COMPETENCE; HEALTH PERSONNEL ATTITUDE; HUMAN; HUMAN RELATION; MEDICAL SCHOOL; METHODOLOGY; PILOT STUDY; QUALITY CONTROL; REPRODUCIBILITY; STANDARD; STATISTICS; TEACHING; VALIDATION STUDY;

ATTITUDE OF HEALTH PERSONNEL; CLINICAL COMPETENCE; FACULTY, MEDICAL; HUMANS; INTERPERSONAL RELATIONS; ONTARIO; PILOT PROJECTS; QUALITY CONTROL; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; STATISTICS AS TOPIC; TEACHING;

EID: 78751484537     PISSN: 10401334     EISSN: None     Source Type: Journal    
DOI: 10.1080/10401334.2011.536754     Document Type: Article

References (23)

1. Beckman TJ, Ghosh AK, Cook DA, Erwin PJ, Mandrekar JN. How reliable are assessment of clinical teaching? Journal of General Internal Medicine 2004;19:971-7.
2. Jones RF, Froom JD. Faculty and administration views of problems in faculty evaluation. Academic Medicine 1994;69:476-83.
3. Atasoylu AA, Wright SM, Beasley BW, et al. Promotion criteria for clinician-educators. Journal of General Internal Medicine 2003;18:711-16.
4. Downing SM. Reliability: On the reproducibility of assessment data. Medical Education 2004;38:1006-12.
5. Downing SM. Validity: On meaningful interpretation of assessment data. Medical Education 2003;37:830-7.
6. Norman G, Eva K. Quantitative research methods in medical education. Understanding medical education. Edinburgh, Scotland: Association for the Study of Medical Education, 2008.
7. McGaghie WC, Butter J, Kaye M. Observational assessment. In SM Downing and R Yudkowsky (Eds.), Assessment in health professions education (pp. 185-215). New York, NY: Routledge, 2009.
8. Copeland HL, Hewson MG. Developing and testing an instrument to measure the effectiveness of clinical teaching in an academic teaching center. Academic Medicine 2000;75;161-5.
9. Frank JR. The CanMEDS 2005 Physican Competency Framework. Better standards. Better physician. Better care. (Ottawa, ON. The Royal College of Physicians and Surgeons of Canada).
10. Tekian A, Williams RG. Vital indicators of teaching and learning success (VITALS): stakeholders' perceptions of a course-improvement system. Academic Medicine 1997;72:412.
11. Skeff KM. Enhancing teaching effectiveness and vitality in the ambulatory setting. Journal of Internal Medicine 1988;3:S26-33.
12. Zuberi RW, Bordage G, Norman GR. Validation of the SETOC instrument: Student evaluation of teaching in outpatient clinics. Advances in Health Sciences Education 2007;12:55-69.
13. Streiner DL. Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment 2003;80:99-103.
14. Nunally JC, Bernstein IH. Psychometric theory, 3rd edition. New York: McGraw-Hill, 1994.
15. Streiner DL, Norman GR. Health measurement scales: A practical guide to their development and use (3rd ed., pp. 126-151). New York: Oxford University Press, 2003.
16. Williams BC, Pillsbury MS, Kolars JC, Gram CM, Hayward RA. Reliability of a global measure of faculty teaching performance. Journal of General Internal Medicine 1996;12:S100.
17. Williams BC, Litzelman DK, Babbott SF, Lubitz RM, Hofer TP. Validation of a global measure of faculty's clinical teaching performance. Academic Medicine 2002;77:177-80.
18. Norcini JJ, Blank LL, Arnold GK, Kimball HR. The Mini-CEX (Clinical Evaluation Exercise): A preliminary investigation. Annals of Internal Medicine 1995;123:795-9.
19. Regehr G, MacRae H, Reznick R, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. AcademicMedicine 1998;73:993-7.
20. Hodges B, Regehr G, McNaughton N, Tiberius R, Hanson M. OSCE checklists do not capture increasing levels of expertise. Academic Medicine 1999;74:1129-34.
21. Downing SM. Threats to the validity of clinical teaching assessments: What about rater error? Medical Education 2005;39: 353-5.
22. Downing SM, Haladyna TM. Validity and its threats. In SM Downing, R Yudkowsky (Eds.), Assessment in health professions education. New York: Routledge, 2009.
23. Dudek NL, Marks MB, Wood TJ, Lee AC. Assessing the quality of supervisors' completed clinical evaluation reports. Medical Education 2008;42:816-22.