The interpersonal, cognitive and efficiency domains of clinical teaching: Construct validity of a multi-dimensional scale

Medical Education

Volumn 39, Issue 12, 2005, Pages 1221-1229

  Beckman, Thomas J ^a   Mandrekar, Jayawant N ^a  

^a MAYO CLINIC   (United States)

Author keywords

Clinical medicine education; Cognition; Education, medical, undergraduate standards; Educational measurement methods; Female; Humans; Interpersonal relations; Male; Minnesota; Observer variation; Teaching standards methods

Indexed keywords

ARTICLE; ATTENTION; COGNITION; CONTROLLED STUDY; FACTORIAL ANALYSIS; FEMALE; HOSPITAL PATIENT; HOSPITAL SERVICE; HUMAN; MALE; MEDICAL ASSESSMENT; MEDICAL EDUCATION; MEDICAL SCHOOL; OBSERVER VARIATION; PHYSICIAN; RELIABILITY; RESIDENT; SAMPLE SIZE; SCORING SYSTEM; TEACHER; VALIDATION PROCESS;

CLINICAL MEDICINE; COGNITION; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; FEMALE; HUMANS; INTERPERSONAL RELATIONS; MALE; MINNESOTA; OBSERVER VARIATION; TEACHING;

EID: 28644452052     PISSN: 03080110     EISSN: 13652923     Source Type: Journal    
DOI: 10.1111/j.1365-2929.2005.02336.x     Document Type: Article

References (44)

1. Beckman TJ, Lee MC, Mandrekar JN. A comparison of clinical teaching evaluations by resident and peer physicians. Med Teacher 2004;26:321-5.
2. Jones RG, Froom JD. Faculty and administration views of problems in faculty evaluations. Acad Med 1994;69:476-83.
3. Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ 2003;37:830-7.
4. Crossley J, Humphris G, Jolly B. Assessing health professionals. Med Educ 2002;36:800-4.
5. Beckman TJ, Ghosh AK, Cook DA, Erwin PJ, Mandrekar JN. How reliable are assessments of clinical teaching? A review of the published instruments. J Gen Intern Med 2004;19:971-7.
6. Beckman TJ, Lee MC, Rohren CH, Pankratz VS. Evaluating an instrument for the peer review of inpatient teaching. Med Teacher 2003;25(2):131-5.
7. Benbassat J, Bachar E. Validity of students' ratings of clinical instructors. Med Educ 1981;15:373-6.
8. Cohen R, McRae H, Jamieson C. Teaching effectiveness of surgeons. Am J Surg 1996;171:612-4.
9. Copeland HL, Hewson MG. Developing and testing an instrument to measure the effectiveness of clinical teaching in an academic medical centre. Acad Med 2000;75:161-6.
10. Donnelly MB, Woolliscroft JO. Evaluation of clinical instructors by third year medical students. Acad Med 1989;64:159-64.
11. Donner-Banzhoff N, Merle H, Baum E, Basler HD. Feedback for general practice trainers: developing and testing a standardised instrument using the importance-quality-score method. Med Educ 2003;37: 772-7.
12. Guyatt GH, Nishikawa J, Willan A et al. A measurement process for evaluating clinical teachers in internal medicine. CMAJ 1993;149(8):1097-102.
13. Hayward RA, Williams BC, Gruppen LD, Rosenbaum D. Measuring attending physician performance in a general medicine outpatient clinic. J Gen Intern Med 1995;10:504-10.
14. Irby DM, Rakestraw P. Evaluating clinical teaching in medicine. J Med Educ 1981;56:181-6.
15. James PA, Osborne JW. A measure of medical instructional quality in ambulatory settings: the MedIQ. Fam Med 1999;31(4):263-9.
16. Litzelman DK, Westmorland GR, Skeff KM, Stratos GA. Student and resident evaluations of faculty - how reliable are they? Acad Med 1999;74(10):25-7.
17. Litzelman DK, Stratos GA, Marriott DJ, Skeff KM. Factorial validation of a widely disseminated educational framework for evaluating clinical teachers. Acad Med 1998;73:688-95.
18. Magill MK, McClure C, Commerford K. A system for evaluating teaching in the ambulatory setting. Fam Med 1986;18(3):173-4.
19. McLeod PJ, James CA, Abrahamowicz M. Clinical tutor evaluation: a 5-year study by students on an inpatient service and residents in an ambulatory care clinic. Med Educ 1993;27:48-54.
20. Ramsbottom-Lucier MT, Gillmore GM, Irby DM, Ramsey PG. Evaluation of clinical teaching by general internal medicine faculty in outpatient and inpatient settings. Acad Med 1994;69:152-4.
21. Risucci DA, Lutsky L, Rosati RJ, Tortolani AJ. Reliability and accuracy of resident evaluations of surgical faculty. Eval Health Prof 1992;15(3):313-24.
22. Shellenberger S, Mahan JM. A factor analytic study of teaching in off-campus general practice clerkships. Med Educ 1982;16:151-5.
23. Solomon DJ, Speer AJ, Rosebraugh CJ, DiPette DJ. The reliability of medical student ratings of clinical teaching. Eval Health Prof 1997;20(3):343-52.
24. Steiner IP, Franc-Law J, Kelly KD, Rowe BH. Faculty evaluation by residents in an emergency medicine program: a new evaluation instrument. Acad Emerg Med 2000;7:1015-21.
25. Tortolani AJ, Rissucci DA, Rosati RJ. Resident evaluation of surgical faculty. J Surg Res 1991;51:186-91.
26. Williams BC, Litzelman DK, Babbott SF, Lubitz RM, Hofer TP. Validation of a global measure of faculty's clinical teaching performance. Acad Med 2002;77:177-80.
27. Perkoff GT. Teaching clinical medicine in the ambulatory setting: an idea whose time may have finally come. N Engl J Med 1986;314:27-31.
28. Schwab DP. Construct validity in organisational behaviour. Res Organ Behav 1980;2:3-43.
29. Downing DM, Haladyna TM. Validity threats: overcoming interference with proposed interpretations of assessment data. Med Educ 2004;38:327-33.
30. Durning SJ, Cation LJ, Jackson JL. The reliability and validity of the American Board of Internal Medicine monthly evaluation form. Acad Med 2003;78:1175-82.
31. Beckman TJ. Lessons learned from a peer review of bedside teaching. Acad Med 2004;79:343-6.
32. Vaughn LM, Baker RC. Psychological size and distance: emphasising the interpersonal relationship as a pathway to optimal teaching and learning conditions. Med Educ 2004;38:1053.
33. DeVellis RF. Scale Development: Theory and Applications. London: Sage Publications 1991.
34. Fleiss JL, Leven B, Paik MC. Statistical Methods for Rates and Proportions. 3rd edn. Hoboken, New Jersey: John Wiley & Sons 2003.
35. Fleiss JL, Cohen J. The equivalence of weighted kappa and the intra-class correlation coefficient as measures of reliability. Educational Psychol Measurement 1973;33:613-9.
36. Landis JR, Koch CG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159-74.
37. American Education Research Association, American Psychological Association, National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington, DC: American Education Research Association 1999.
38. Silber CG, Nasca TJ, Paskin DL, Eiger G, Robeson M, Voleski J. Do global rating forms enable program directors to assess the ACGME competencies? Acad Med 2004;79:549-56.
39. Rogers CR, Freiberg HJ. Freedom to Learn. 3rd edn. Upper Saddle River, New Jersey: Merrill 1994.
40. Maslow AH. The Farther Reaches of Human Nature. New York: Viking Press 1971.
41. Irby DM, Gillmore GM, Ramsey PG. Factors affecting ratings of clinical teachers by medical students and residents. J Med Educ 1987;62:1-7.
42. de Groot J, Brunet A, Kaplan AS, Bagby M. A comparison of evaluations of male and female psychiatry supervisors. Acad Psych 2003;27:39-43.
43. Messick S. Validity. In: Linn RL, ed. Educational Measurement. 3rd edn. Phoenix, Arizona: Oryx Press 1933.
44. Downing SM. Reliability: on the reproducibility of assessment data. Med Educ 2004;38:1006-12.