Practice feedback interventions: 15 suggestions for optimizing effectiveness

Annals of Internal Medicine

Volumn 164, Issue 6, 2016, Pages 435-441

  Brehaut, Jamie C ^a   Colquhoun, Heather L ^b   Eva, Kevin W ^c   Carroll, Kelly ^a   Sales, Anne ^d   Michie, Susan ^e   Ivers, Noah ^f   Grimshaw, Jeremy M ^a  

^a OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^d UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

^e UNIVERSITY COLLEGE LONDON   (United Kingdom)

^f WOMEN S COLLEGE HOSPITAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BEHAVIOR CHANGE; COGNITION; FEEDBACK SYSTEM; HEALTH CARE PERSONNEL; HUMAN; INFORMATION TECHNOLOGY; INTERVIEW; PILOT STUDY; PRACTICE GUIDELINE; PRIORITY JOURNAL; SOCIAL INTERACTION; TOTAL QUALITY MANAGEMENT; COMPARATIVE EFFECTIVENESS; CONSTRUCTIVE FEEDBACK; MANAGEMENT; STANDARDS;

COMPARATIVE EFFECTIVENESS RESEARCH; FORMATIVE FEEDBACK; HUMANS; PRACTICE MANAGEMENT, MEDICAL; QUALITY IMPROVEMENT;

EID: 84960889080     PISSN: 00034819     EISSN: 15393704     Source Type: Journal    
DOI: 10.7326/M15-2248     Document Type: Article

References (68)

1. Ivers NM, Grimshaw JM, Jamtvedt G, Flottorp S, O'Brien MA, French SD., et al. Growing literature, stagnant science?. Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care. J Gen Intern Med. 2014; 29: 1534-[PMID: 24965281] doi: 10.1007/s11606-014-2913-y
2. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD., et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012; 6: CD000259. [PMID: 22696318] doi: 10.1002/14651858.CD000259 .pub3
3. Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S., et al. A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implement Sci. 2013; 8: 66. [PMID: 23759034] doi: 10.1186/1748-5908-8-66
4. Cochrane Collaboration. Effective Practice and Organisation of Care Group. Accessed at http://epoc.cochrane.org on 16 September 2015
5. Thomas RE, Croal BL, Ramsay C, Eccles M, Grimshaw J. Effect of enhanced feedback and brief educational reminder messages on laboratory test requesting in primary care: a cluster randomised trial. Lancet. 2006; 367: 1990-6. [PMID: 16782489]
6. Eccles M, Steen N, Grimshaw J, Thomas L, McNamee P, Soutter J., et al. Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet. 2001; 357: 1406-9. [PMID: 11356439]
7. Mitchell E, Sullivan F, Grimshaw JM, Donnan PT, Watt G. Improving management of hypertension in general practice: a randomised controlled trial of feedback derived from electronic patient data. Br J Gen Pract. 2005; 55: 94-101. [PMID: 15720929]
8. Ivers NM, Tu K, Young J, Francis JJ, Barnsley J, Shah BR., et al. Feedback GAP: pragmatic, cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care. Implement Sci. 2013; 8: 142. [PMID: 24341511] doi: 10.1186/1748-5908-8-142
9. Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ., et al. No more ?business as usual? with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014; 9: 14. [PMID: 24438584] doi: 10.1186/1748-5908-9-14
10. Brehaut JC, Eva KW. Building theories of knowledge translation interventions: use the entire menu of constructs. Implement Sci. 2012; 7: 114. [PMID: 23173596] doi: 10.1186/1748-5908-7-114
11. Shute VJ. Focus on formative feedback. Rev Educ Res. 2008; 78: 153-89
12. Hysong SJ. Meta-Analysis: audit and feedback features impact effectiveness on care quality. Med Care. 2009; 47: 356-63. [PMID: 19194332] doi: 10.1097/MLR.0b013e3181893f6b
13. Kluger AN, DeNisi A. The effects of feedback interventions on performance: a historical review, a meta-Analysis, and a preliminary feedback intervention theory. Psychol Bull. 1996; 119: 254-84
14. Vredenburg K, Isensee S, Righi C. User-Centered Design: An Integrated Approach. Upper Saddle River, NJ: Prentice Hall; 2002
15. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M; Medical Research Council Guidance. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008; 337: a1655. [PMID: 18824488] doi: 10.1136/bmj.a1655
16. Locke EA, Latham GP. A Theory of Goal Setting and Task Performance. Englewood Cliffs, NJ: Prentice Hall; 1990
17. Locke EA, Latham GP. Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. Am Psychol. 2002; 57: 705-17. [PMID: 12237980]
18. Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J, Beckmann J, eds. Action Control: From Cognition to Behaviour. Berlin, Germany: Springer-Verlag; 1985
19. Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals' intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008; 3: 36. [PMID: 18631386] doi: 10.1186/1748-5908-3-36
20. Fidler H, Lockyer JM, Toews J, Violato C. Changing physicians' practices: the effect of individual feedback. Acad Med. 1999; 74: 702-14. [PMID: 10386101]
21. Sheeran P, Milne S, Webb TL, Gollwitzer PM. Implementation intentions and health behaviour. In: Conner M, Norman P, eds. Predicting Health Behaviours. Maidenhead, UK: Open University Pr; 2005: 276-323
22. Locke EA. Goal theory vs. control theory: contrasting approaches to understanding work motivation. Motiv Emotion. 1991; 15: 9-28
23. Carver C, Scheier MF. On the Self-Regulation of Behaviour. New York: Cambridge Univ Pr; 1998
24. Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008; 27: 379-87. [PMID: 18624603] doi: 10.1037/0278-6133.27.3.379
25. Metcalfe J, Kornell N, Son LK. A cognitive-science based programme to enhance study efficacy in a high and low risk setting. Eur J Cogn Psychol. 2007; 19: 743-768. [PMID: 19148303]
26. Lurie NH, Swaminathan JM. Is timely information always better?. The effect of feedback frequency on decision making. Organ Behav Hum Decis Process. 2009; 108: 315-29
27. Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R. What do we know about how to do audit and feedback?. Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005; 5: 50. [PMID: 16011811]
28. Ilgen DR, Fisher CD, Taylor MS. Consequences of individual feedback on behavior in organizations. J Appl Psychol. 1979; 64: 349-71
29. Van Der Sijs H, Aarts J, Vulto A, Berg M. Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006; 13: 138-47. [PMID: 16357358]
30. Lam C, DeRue D, Karam E, Hollenbeck J. The impact of feedback frequency on learning and task performance: challenging the "more is better" assumption. Organ Behav Hum Decis Process. 2011; 116: 217-28
31. Veloski J, Boex JR, Grasberger MJ, Evans A, Wolfson DB. Systematic review of the literature on assessment, feedback and physicians' clinical performance: BEME Guide No. 7. Med Teach. 2006; 28: 117-28. [PMID: 16707292]
32. Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance. Med Care. 1986; 24: 659-66. [PMID: 3736141]
33. Archer-Kath J, Johnson D, Johnson R. Individual versus group feedback in cooperative groups. J Soc Psychol. 1994; 134: 681-94
34. Eva KW, Armson H, Holmboe E, Lockyer J, Loney E, Mann K., et al. Factors influencing responsiveness to feedback: on the interplay between fear, confidence, and reasoning processes. Adv Health Sci Educ Theory Pract. 2012; 17: 15-26. [PMID: 21468778] doi: 10 .1007/s10459-011-9290-7
35. Goldstein EB. Perceiving objects and scenes: the gestalt approach to object perception. In: Goldstein EB. Sensation and Perception. 8th ed. Belmont, CA: Wadsworth Cengage Learning; 2009
36. Nielsen J. Designing Web Usability: The Practice of Simplicity. Indianapolis, IN: New Riders Publishing; 2000
37. Mayer RE. Multimedia Learning. New York: Cambridge Univ Pr; 2001: 63-80
38. Elwyn G, O'Connor A, Stacey D, Volk R, Edwards A, Coulter A, et al; International Patient Decision Aids Standards (IPDAS) Collaboration. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006; 333: 417. [PMID: 16908462]
39. Hibbard JH, Peters E, Slovic P, Finucane ML, Tusler M. Making health care quality reports easier to use. Jt Comm J Qual Improv. 2001; 27: 591-604. [PMID: 11708039]
40. Sweller J, Van Merriënboer JJG, Paas FGWC. Cognitive architecture and instructional design. Educ Psychol Rev. 1998; 10: 251-96
41. Tufte E. The Visual Display of Quantitative Information. 2nd ed. Cheshire, CT: Graphics Pr; 2004
42. Cleveland WS. The Elements of Graphing Data. Summit, NJ: Hobart Pr; 1994
43. Sales AE, Fraser K, Baylon MA, O'Rourke HM, Gao G, Bucknall T., et al. Understanding feedback report uptake: process evaluation findings from a 13-month feedback intervention in long-term care settings. Implement Sci. 2015; 10: 20. [PMID: 25884696] doi: 10.1186/s13012-015-0208-2
44. Logan J, Graham ID. Toward a comprehensive interdisciplinary model of health care research use. Sci Commun. 1998; 20: 227-46
45. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A; "Psychological Theory" Group. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005; 14: 26-33. [PMID: 15692000]
46. Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012; 7: 37. [PMID: 22530986] doi: 10.1186/1748-5908-7-37
47. Michie S, Van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011; 6: 42. [PMID: 21513547] doi: 10 .1186/1748-5908-6-42
48. Opiyo N, Shepperd S, Musila N, Allen E, Nyamai R, Fretheim A., et al. Comparison of alternative evidence summary and presentation formats in clinical guideline development: a mixed-method study. PLoS One. 2013; 8: e55067. [PMID: 23372813] doi: 10.1371/journal .pone.0055067
49. Lavis JN, Wilson MG, Grimshaw JM, Haynes RB, Ouimet M, Raina P., et al. Supporting the use of health technology assessments in policy making about health systems. Int J Technol Assess Health Care. 2010; 26: 405-14. [PMID: 20923592] doi: 10.1017/S026646231000108X
50. Stull MK. Performance feedback: a question of source credibility. J Nurs Adm. 1986; 16: 17, 39. [PMID: 3633964]
51. Exworthy M, Wilkinson EK, McColl A, Moore M, Roderick P, Smith H., et al. The role of performance indicators in changing the autonomy of the general practice profession in the UK. Soc Sci Med. 2003; 56: 1493-504. [PMID: 12614700]
52. Elwyn G, O'Connor AM, Bennett C, Newcombe RG, Politi M, Durand M.A., et al. Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi). PLoS One. 2009; 4: e4705. [PMID: 19259269] doi: 10 .1371/journal.pone.0004705
53. Kluger AN, Van Dijk D. Feedback, the various tasks of the doctor, and the feedforward alternative. Med Educ. 2010; 44: 1166-74. [PMID: 21091758] doi: 10.1111/j.1365-2923.2010.03849.x
54. Briñol P, McCaslin MJ, Petty RE. Self-generated persuasion: effects of the target and direction of arguments. J Pers Soc Psychol. 2012; 102: 925-40. [PMID: 22352326] doi: 10.1037/a0027231
55. Cantillon P, Sargeant J. Giving feedback in clinical settings. BMJ. 2008; 337: a1961. [PMID: 19001006] doi: 10.1136/bmj.a1961
56. Brown JD, Farnham SD, Cook KE. Emotional responses to changing feedback: is it better to have won and lost than never to have won at all?. J Pers. 2002; 70: 127-41. [PMID: 11908533]
57. Anseel F, Lievens F, Schollaert E. Reflection as a strategy to enhance task performance after feedback. Organ Behav Hum Decis Process. 2009; 110: 23-35
58. Boud D, Molloy E. Rethinking models of feedback for learning: the challenge of design. Assessment & Evaluation in Higher Education. 2013; 38: 698-712
59. Ivanovic J, Anstee C, Ramsay T, Gilbert S, Maziak DE, Shamji FM., et al. Using surgeon-specific outcome reports and positive deviance for continuous quality improvement. Ann Thorac Surg. 2015; 100: 1188-95. [PMID: 26188970] doi: 10.1016/j.athoracsur.2015.04.012
60. Sargeant J, Lockyer J, Mann K, Holmboe E, Silver I, Armson H., et al. Facilitated reflective performance feedback: developing an evidence- and theory-based model that builds relationship, explores reactions and content, and coaches for performance change (R2C2). Acad Med. 2015; 90: 1698-706. [PMID: 26200584] doi: 10.1097/ACM .0000000000000809
61. Reiter HI, Rosenfeld J, Nandagopal K, Eva KW. Do clinical clerks provide candidates with adequate formative assessment during objective structured clinical examinations?. Adv Health Sci Educ Theory Pract. 2004; 9: 189-99. [PMID: 15316270]
62. Carless D, Salter D, Yang M, Lam J. Developing sustainable feedback practices. Studies in Higher Education. 2011; 36: 395-407
63. Overeem K, Driessen EW, Arah OA, Lombarts KM, Wollersheim HC, Grol RP. Peer mentoring in doctor performance assessment: strategies, obstacles and benefits. Med Educ. 2010; 44: 140-7. [PMID: 20040054] doi: 10.1111/j.1365-2923.2009.03580.x
64. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M; Medical Research Council Guidance. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008; 337: a1655. [PMID: 18824488] doi: 10.1136/bmj.a1655
65. Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008; 57: 660-80
66. Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005; 58: 107-12. [PMID: 15680740]
67. Gardner B, Whittington C, McAteer J, Eccles MP, Michie S. Using theory to synthesise evidence from behaviour change interventions: the example of audit and feedback. Soc Sci Med. 2010; 70: 1618-25. [PMID: 20207464] doi: 10.1016/j.socscimed.2010.01.039
68. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W., et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013; 46: 81-95. [PMID: 23512568] doi: 10.1007/s12160-013-9486-6