Developing a peer assessment of lecturing instrument: Lessons learned

Academic Medicine

Volumn 84, Issue 8, 2009, Pages 1104-1110

  Newman, Lori R ^a   Lown, Beth A ^b   Jones, Richard N ^a   Johansson, Anna ^a   Schwartzstein, Richard M ^c  

^a HARVARD MEDICAL SCHOOL   (United States)

^b MOUNT AUBURN HOSPITAL   (United States)

^c BETH ISRAEL DEACONESS MEDICAL CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ARTICLE; DECISION MAKING; DELPHI STUDY; FACULTY PRACTICE; HUMAN; MEDICAL EDUCATION; MEDICAL SCHOOL; PEER GROUP; PEER REVIEW; PRIORITY JOURNAL; RATING SCALE; RELIABILITY; STATISTICAL ANALYSIS; TEACHING;

EID: 68949194376     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: 10.1097/ACM.0b013e3181ad18f9     Document Type: Article

References (35)

1. Beckman TJ, Lee MC, Rohren CH, Pankratz VS. Evaluating an instrument for the peer review of inpatient teaching. Med Teach. 2003;25:131-135.
2. Leamon MH, Servis MH, Canning RD, Searles RC. A comparison of student evaluations and faculty peer evaluations of faculty lecturers. Acad Med. 1999;74(suppl): 22-24.
3. Simpson D, Fincher RM, Hafler JP, et al. Advancing educators and education by defining the components and evidence associated with educational scholarship. Med Educ. 2007;41:1002-1009.
4. Wilkerson L, Irby DM. Strategies for improving teaching practices: A comprehensive approach to faculty development. Acad Med. 1998;73:387-396.
5. Arreloa RA. Developing a Comprehensive Faculty Evaluation System. Bolton, Mass: Anker Publishing Company; 1995.
6. Centra JA. Reflective Faculty Evaluation: Enhancing Teaching and Determining Faculty Effectiveness. San Francisco, Calif: Jossey Bass; 1993.
7. Irby DM. Peer review of teaching in medicine. J Med Educ. 1983;58:457-461.
8. Van Note Chism N. Peer Review of Teaching: A Sourcebook. Bolton, Mass: Anker Publishing; 1999.
9. Kohut GF, Burnap C, Yon MG. Peer observation of teaching: Perceptions of the observer and the observed. Coll Teach. 2007; 55:19-25.
10. DeZure D. Evaluating teaching through peer classroom observation. In: Seldin P. Changing Practices in Evaluating Teaching: A Practical Guide to Improved Faculty Performance and Promotion/Tenure Decisions. Bolton, Mass: Anker Publishing; 1999:70-96.
11. Gelula MH. Effective lecture presentation skills. Surg Neurol. 1997;47:201-204.
12. Laidlaw JM. Twelve tips for lecturers. Med Teach. 1988;10:13-17.
13. Steinert Y, Snell LS. Interactive lecturing: Strategies for increasing participation in large group presentation. Med Teach. 1999;21:37-42.
14. Cantillon P. ABC of learning and teaching in medicine: Teaching large groups. BMJ. 2003; 326:437-440.
15. Irby DM, DeMers J, Scher M, Matthew D. A model for the improvement of medical faculty lecturing. J Med Educ. 1976;51:403-409.
16. Nelson MS. Peer evaluation of teaching: An approach whose time has come. Acad Med. 1998;73:4-5.
17. Schwartzstein R, Huang G, Coughlin C. Development and implementation of a comprehensive strategic plan for medical education at an academic medical center. Acad Med. 2008;83:550-559.
18. Hatem CJ, Lown BA, Newman LR. The academic health center coming of age: Helping faculty become better teachers and agents of educational change. Acad Med. 2006;81:941-944.
19. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32:1008-1015.
20. Jones J, Hunter D. Qualitative research: Consensus methods for medical and health services research. BMJ. 1995;311:376-380.
21. Copeland HL, Longworth DL, Hewson MG, Stoller JK. Successful lecturing: A prospective study to validate attributes of the effective medical lecture. J Gen Intern Med. 2000;15: 366-371.
22. Nierenberg DW. The challenge of "teaching" large groups of learners: Strategies to increase active participation and learning. Int J Psychiatry Med. 1998;28:115-122.
23. Casteel CP, Mortillaro NA, Taylor AE. Teaching effectiveness analysis plan applied to lectures in medical physiology. Am J Physiol. 1989;256(suppl):3-8.
24. Brown G, Manogue M. AMEE Medical Education Guide No. 22: Refreshing lecturing: A guide for lecturers. Med Teach. 2001;23:231-244.
25. Sullivan RL, McIntosh N. Delivering Effective Lectures. Available at: (http://www.reproline.jhu.edu/english/6read/6training/lecture/ delivering-lecture.htm). Accessed April 3, 2009.
26. Seldin P. Changing Practices in Evaluating Teaching: A Practical Guide to Improved Faculty Performance and Promotion/Tenure Decisions. Bolton, Mass: Anker Publishing; 1999.
27. Cronbach L. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297-334.
28. Royston P. Multiple imputation of missing values: Update. Stata J. 2005;5:118-201.
29. Nunnally JC, Bernstein IH. Psychometric Theory. 3rd ed. New York, NY: McGraw-Hill College Division; 1994.
30. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159-174.
31. Nicole DJ, Macfarlane-Dick D. Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Stud High Educ. 2006;31:199-218.
32. Williams RG, Klamen DA, McGaghie WC. Cognitive, scholar and environmental sources of bias in clinical performance ratings. Teach Learn Med. 2003;15:270-292.
33. Shea JA, Fortna GS. Psychometric methods. In: Norman G, van der Vleuten CPM, Newble DI, eds. International Handbook of Research in Medical Education: Part One. Dordrecht, the Netherlands: Kluwer Academic Publishers; 2002.
34. Braskamp LA, Ory JC. Assessing Faculty Work: Enhancing Individual and Instructional Performance. San Francisco, Calif: Jossey-Bass; 1994.
35. Govaerts MJB, van der Vleuten CPM, Schuwirth LWT, Muijtjens AMM. Broadening perspectives on clinical performance assessment: Rethinking the nature of in-training assessment. Adv Health Sci Educ. 2007;12:239-260.