Guidelines: the do’s, don’ts and don’t knows of feedback for clinical education

Perspectives on Medical Education

Volumn 4, Issue 6, 2015, Pages 284-299

  Lefroy, Janet ^a   Watling, Chris ^b   Teunissen, Pim W ^c   Brand, Paul ^d  

^a KEELE UNIVERSITY SCHOOL OF MEDICINE   (United Kingdom)

^b WESTERN UNIVERSITY   (Canada)

^c VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^d ISALA HOSPITAL   (Netherlands)

Author keywords

Feedback; Feedback culture; Feedback relationship; Formative assessment; Workplace based assessment

Indexed keywords

EID: 85004082638     PISSN: 22122761     EISSN: 2212277X     Source Type: Journal    
DOI: 10.1007/s40037-015-0231-7     Document Type: Article

References (92)

1. Evans C. Making sense of assessment feedback in higher education. Rev Educ Res. 2013;83:70–120.
2. Eva KW, Armson H, Holmboe E, et al. Factors influencing responsiveness to feedback: on the interplay between fear, confidence, and reasoning processes. Adv Health Sci Educ Theory Pract. 2012;17:15–26.
3. Sargeant J, Mann K, Vleuten C van der, Metsemakers J. ‘Directed’ self-assessment: practice and feedback within a social context. J Contin Educ Health Prof. 2008;28:47–54.
4. Watling C, Driessen E, Van der Vleuten CPM, Vanstone M, Lingard L. Beyond individualism: professional culture and its influence on feedback. Med Educ. 2013;47:585–94.
5. Van de Ridder JMM, Stokking KM, McGaghie WC, ten Cate OTJ. What is feedback in clinical education? Med Educ. 2008;42:189–97.
6. Teunissen PW. Experience, trajectories, and reifications: an emerging framework of practice-based learning in healthcare workplaces. Adv Heal Sci Educ. 2015;20:843–56.
7. Bing-You RG, Paterson J. Feedback falling on deaf ears: residents’ receptivity to feedback tempered by sender credibility. Med Teach. 1997;19:40.
8. Sargeant J, Mann K, Ferrier S. Exploring family physicians’ reactions to multisource feedback: perceptions of credibility and usefulness. Med Educ. 2005;39:497–504.
9. Sargeant J, Mann K, Sinclair D, Van Der Vleuten C, Metsemakers J. Challenges in multisource feedback: intended and unintended outcomes. Med Educ. 2007;41:583–91.
10. Watling C, Driessen E, Vleuten CPM van der, Lingard L. Learning from clinical work: the roles of learning cues and credibility judgements. Med Educ. 2012;46:192–200.
11. Watling C, Kenyon C, Zibrowski E, et al. Rules of engagement: residents’ perceptions of the in-training evaluation process. Acad Med. 2008;83(10 Suppl):S97–100.
12. Walsh C, Ling S, Carnahan H. Concurrent versus terminal feedback: it may be better to wait. Acad Med. 2009;84(10 Suppl):S54–7.
13. Hattie J, Timperley H. The power of feedback. Rev Educ Res. 2007;77:81–112.
14. Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259.(John Wiley & Sons, Ltd)
15. Higgins E. Promotion and prevention: regulatory focus as a motivational principle. In: Zanna MP, editor. Advances in experimental social psychology. San Diego: Academic Press; 1998. p. 1–46.
16. Tuckey M, Brewer N, Williamson P. The influence of motives and goal orientation on feedback seeking. J Occup Organ Psychol. 2002;75:195–216.
17. Teunissen PW, Bok HGJ. Believing is seeing: how people’s beliefs influence goals, emotions and behaviour. Med Educ. 2013;47:1064–72.
18. Morrison E, Cummings L. The impact of feedback diagnosticity and performance expectations on feedback-seeking behaviour. Hum Perform. 1992;5:251–64.
19. Tsui AS, Ashford SJ. Adaptive self-regulation: a process view of managerial effectiveness. J Manage. 1994;20(1):93–121.
20. Teunissen PW, Stapel DA, Vleuten CPM van der, Scherpbier AJJA, Boor K, Scheele F. Who wants feedback? An investigation of the variables influencing residents’ feedback- seeking behavior in relation to night shifts. Acad Med. 2009;84:910.
21. Molloy E, Boud D. Seeking a different angle on feedback in clinical education: the learner as seeker, judge and user of performance information. Med Educ. 2013;47:227–9.
22. Boud D, Molloy E. Rethinking models of feedback for learning: the challenge of design. Assess Eval High Educ. 2013;38:698–712.
23. Van de Ridder JMM, McGaghie WC, Stokking KM, ten Cate OTJ. Variables that affect the process and outcome of feedback, relevant for medical training: a meta-review. Med Educ. 2015;49:658–73.
24. Hewson M, Little M. Giving feedback in medical education. J Gen Intern Med. 1998;13:111.
25. Watling C, Driessen E, Vleuten CPM van der, Vanstone M, Lingard L. Understanding responses to feedback: the potential and limitations of regulatory focus theory. Med Educ. 2012;46:593–603.
26. Lefroy J, Hawarden A, Gay SP, McKinley RK, Cleland J. Grades in formative workplace-based assessment: a study of what works for whom and why. Med Educ. 2015;49:307–20.
27. Shute VJ. Focus on formative feedback. Rev Educ Res. 2008;78:153–89.
28. Kluger A, DeNisi A. The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull. 1996;119:254.
29. Weston PSJ, Smith CA. The use of mini-CEX in UK foundation training six years following its introduction: lessons still to be learned and the benefit of formal teaching regarding its utility. Med Teach. 2014;36:155–63.
30. Goodman JS, Wood RE, Hendrickx M. Feedback specificity, exploration, and learning. J Appl Psychol. 2004;89:248–62.
31. Sargeant J, Mann K, Sinclair D, Vleuten C van der, Metsemakers J. Understanding the influence of emotions and reflection upon multi-source feedback acceptance and use. Adv Heal Sci Educ Theory Pr. 2008;13:275–88.
32. Archer JC. State of the science in health professional education: effective feedback. Med Educ. 2010;44:101–8.
33. Higgins E. Making a good decision: value from fit. Am Psychol. 2000;55:1215.
34. Kluger A, Van Dijk A. Feedback, the various tasks of the doctor, and the feedforward alternative. Med Educ. 2010;44:1166.
35. Bok HGJ, Teunissen PW, Spruijt A, et al. Clarifying students’ feedback-seeking behaviour in clinical clerkships. Med Educ. 2013;47:282–91.
36. Higgins R, Hartley P, Skelton A. The Conscientious consumer: reconsidering the role of assessment feedback in student learning. Stud High Educ. 2002;27:53–64.
37. Sadler DR. Beyond feedback: developing student capability in complex appraisal. Assess Eval High Educ. 2010;35:535–50.
38. Watling C, Driessen E, Vleuten CPM van der, Lingard L. Learning culture and feedback: an international study of medical athletes and musicians. Med Educ. 2014;48:713–23.
39. Wood D, Bruner J, Ross G. The role of tutoring in problem-solving. J Child Psychol Psychiatry. 1976;17:89–100.
40. Vygotsky L. Thought and language. Cambridge: MIT Press; 1986.
41. Smith SE, Tallentire VR, Cameron HS, Wood SM. The effects of contributing to patient care on medical students’ workplace learning. Med Educ. 2013;47:1184–96.
42. Carless D, Salter D, Yang M, Lam J. Developing sustainable feedback practices. Stud High Educ. 2011;36:395–407.
43. Lingard L, Garwood K, Schryer CF, Spafford MM. A certain art of uncertainty: case presentation and the development of professional identity. Soc Sci Med. 2003;56:603–16.
44. Sitzmann T, Ely K. A meta-analysis of self-regulated learning in work-related training and educational attainment: what we know and where we need to go. Psychol Bull. 2011;137(3):421.
45. Overeem K. “Paying it forward”: performance improvement through feedforward interviews. Med Educ. 2010;44:1159–61.
46. Dohrenwend A. Serving up the feedback sandwich. Fam Pract Manag. 2002;9:43–6.
47. Pendleton D, Schofield T, Tate P, Havelock P. The new consultation developing doctor-patient communication. Oxford: Oxford University Press; 2003.
48. Cantillon P, Sargeant J. Giving feedback in clinical settings. BMJ. 2008;337:1292–4.
49. Kurtz S, Silverman J, Draper J. Teaching and learning communication skills in medicine. 2nd ed. Oxford: Radcliffe Publishing Ltd; 2005.
50. Dijksterhuis MGK, Schuwirth LWT, Braat DDM, Teunissen PW, Scheele F. A qualitative study on trainees’ and supervisors' perceptions of assessment for learning in postgraduate medical education. Med Teach. 2013;35:e1396–402.
51. Telio S, Ajjawi R, Regehr G. The “Educational Alliance” as a framework for reconceptualizing feedback in medical education. Acad Med. 2015;90:609–14.
52. Sargeant JM, Mann KV, Vleuten CP van der, Metsemakers JF. Reflection: a link between receiving and using assessment feedback. Adv Heal Sci Educ. 2008;14:399–410.
53. Schultz KW, Kirby J, Delva D, et al. Medical students’ and residents’ preferred site characteristics and preceptor behaviours for learning in the ambulatory setting: a cross-sectional survey. BMC Med Educ. 2004;4:12.
54. Minehart R, Rudolph J, Pian-Smith M, Raemar D. Improving faculty feedback to resident trainees during a simulated case. Anesthesiology. 2014;120:160–71.
55. Sox CM, Dell M, Phillipi CA, Cabral HJ, Vargas G, Lewin LO. feedback on oral presentations during pediatric clerkships: a randomized controlled trial. Pediatrics. 2014;134:965–71.
56. Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach. 2007;29:855.
57. Lipnevich AA, Smith JK. Effects of differential feedback on students’ examination performance. J Exp Psychol Appl. 2009;15:319–33.
58. Driessen E, Scheele F. What is wrong with assessment in postgraduate training? Lessons from clinical practice and educational research. Med Teach. 2013;35:569–74.
59. Van Merriënboer JJG, Sweller J. Cognitive load theory in health professional education: design principles and strategies. Med Educ. 2010;44:85–93.
60. Kalyuga S. Instructional benefits of spoken words: a review of cognitive load factors. Educ Res Rev. 2012;7:145–59.
61. Eraut M. Learning from other people in the workplace. Oxford Rev Educ. 2007;33:403–22.
62. Billett S. Toward a workplace pedagogy: guidance, participation, and engagement. Adult Educ Q. 2002;53:27–43.
63. GMC. Tomorrow’s doctors the duties of a doctor registered with the General Medical Council. 2009.
64. Eva K, Regehr G. Self-assessment in the health professions: a reformulation and research agenda. Acad Med. 2005;80:46.
65. Raat J, Kuks J, Cohen-Schotanus J. Learning in clinical practice: stimulating and discouraging response to social comparison. Med Teach. 2010;32:899–904.
66. Urquhart LM, Rees CE, Ker JS. Making sense of feedback experiences: a multi-school study of medical students’ narratives. Med Educ. 2014;48:189–203.
67. Bates J, Konkin J, Suddards C, Dobson S, Pratt D. Student perceptions of assessment and feedback in longitudinal integrated clerkships. Med Educ. 2013;47:362–74.
68. Veloski J, Boex JR, Grasberger J, Evans A, Wolfson DB. Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7. Med Teach. 2006;28(2):117.
69. Bok HG, Teunissen PW, Favier RP. Programmatic assessment of competency-based workplace learning: when theory meets practice. BMC Med Educ. 2013;13:123.
70. Hägg-Martinell A, Hult H, Henriksson P, Kiessling A. Students perceive healthcare as a valuable learning environment when accepted as a part of the workplace community. Educ Heal Chang Learn Pract. 2014;27:15–23.
71. Lefroy J, Thomas A, Harrison C, et al. Development and face validation of strategies for improving consultation skills. Adv Heal Sci Educ. 2014;19:661–85.
72. Jippes E, Steinert Y, Pols J, Achterkamp M, Engelen J van, Brand P. How do social networks and faculty development courses affect clinical supervisors’ adoption of a medical education innovation? An exploratory study. Acad Med. 2013;88:398–404.
73. Jippes E, Van Luijk SJ, Pols J, Achterkamp MC, Brand PLP, Van Engelen JML. Facilitators and barriers to a nationwide implementation of competency-based postgraduate medical curricula: a qualitative study. Med Teach. 2012;34:e589–602.
74. Van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Med Educ. 2005;39:309–17.
75. Schuwirth LWT, Van der Vleuten CPM. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach. 2011;33:478–85.
76. Driessen EW, Tartwijk J van, Govaerts M, Teunissen P, Vleuten CPM van der. The use of programmatic assessment in the clinical workplace: a Maastricht case report. Med Teach. 2012;34:226–31.
77. Bok HGJ, Jaarsma ADC, Spruijt A, Van Beukelen P, Van Der Vleuten CPM, Teunissen PW. Feedback-giving behaviour in performance evaluations during clinical clerkships. Med Teach. 2015;00:1–8.(Informa UK Ltd)
78. Nasca TJ, Weiss KB, Bagian JP. Improving clinical learning environments for for tomorrow ’ s physicians. N Engl J Med. 2014;370:2014–6.
79. Wearne S, Dornan T, Teunissen PW, Skinner T. General practitioners as supervisors in postgraduate clinical education: an integrative review. Med Educ. 2012;46:1161–73.
80. Alves de Lima A, Conde D, Costabel J, Corso J, Vleuten C van der. A laboratory study on the reliability estimations of the mini-CEX. Adv Heal Sci Educ. 2013;18:5–13.
81. Hammoud MM, Edwards ME, Lyon JA, White C. Is video review of patient encounters an effective tool for medical student learning? A review of the literature. Adv Med Educ Pract. 2012;3:19–30.
82. Fluit CV, Bolhuis S, Klaassen T, et al. Residents provide feedback to their clinical teachers: reflection through dialogue. Med Teach. 2013;35:e1485–92.
83. Fokkema J, Scheele F, Westerman M, et al. Research reports perceived effects of innovations in postgraduate medical education: a q study focusing on workplace-based assessment. Acad Med. 2014;89:1259–66.
84. Watling C, Driessen E, Vleuten CPM van der, Vanstone M, Lingard L. Music lessons: revealing medicine’s learning culture through a comparison with that of music. Med Educ. 2013;47:842–50.
85. Boor K, Teunissen PW, Scherpbier AJJA, Vleuten CPM van der, Lande J van de, Scheele F. Residents’ perceptions of the ideal clinical teacher-a qualitative study. Eur J Obstet Gynecol Reprod Biol. 2008;140:152–7.
86. Van der Vleuten CPM, Schuwirth LWT, Driessen EW, et al. A model for programmatic assessment fit for purpose. Med Teach. 2012;34:205–14.
87. Massie J, Ali JM. Workplace-based assessment: a review of user perceptions and strategies to address the identified shortcomings. Adv Health Sci Educ Theory Pract. 2015. doi:10.1007/s10459-015-9614-0.
88. Eva KW, Regehr G. Exploring the divergence between self-assessment and self-monitoring. Adv Health Sci Educ Theory Pract. 2011;16:311–29.
89. Gabelica C, Bossche P Van Den, Segers M, Gijselaers W. Feedback, a powerful lever in teams: a review. Educ Res Rev. 2012;7:123–44.
90. Rowe AD, Wood LN. What feedback do students want? Australian Educational Researcher. 2007. http://www.aare.edu.au/publications-database.php/5501/what-feedback-do-students-want. Accessed 6 Aug 2015.
91. Cavalcanti RB, Detsky AS. The education and training of future physicianswhy coaches can’t be judges. JAMA. 2011;306:993–4.
92. Kogan JR, Conforti LN, Bernabeo EC, Durning SJ, Hauer KE, Holmboe ES. Faculty staff perceptions of feedback to residents after direct observation of clinical skills. Med Educ. 2012;46:201–15.