Influence of educational, audit and feedback, system based, and incentive and penalty interventions to reduce laboratory test utilization: A systematic review

Clinical Chemistry and Laboratory Medicine

Volumn 53, Issue 2, 2015, Pages 157-183

  Kobewka, Daniel M ^a,b   Ronksley, Paul E ^c   McKay, Jennifer A ^b   Forster, Alan J ^a,b,c,d   Van Walraven, Carl ^a,b,c,d  

^a UNIVERSITY OF OTTAWA   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

^c OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^d INSTITUTE FOR CLINICAL EVALUATIVE SCIENCES   (Canada)

Author keywords

Audit and feedback; Education; Laboratory utilization; Reducing; Test use

Indexed keywords

COST CONTROL; EDUCATION; EMBASE; FEEDBACK SYSTEM; HEALTH CARE QUALITY; HUMAN; INVESTMENT; LABORATORY TEST; MEDICAL AUDIT; MEDLINE; PATIENT SAFETY; PHYSICIAN; PRIORITY JOURNAL; PUBLICATION; PUNISHMENT; QUALITY CONTROL; REVIEW; SYSTEMATIC REVIEW; COST BENEFIT ANALYSIS; ECONOMICS; LABORATORY;

COST-BENEFIT ANALYSIS; HUMANS; LABORATORIES;

EID: 84920884020     PISSN: 14346621     EISSN: 14374331     Source Type: Journal    
DOI: 10.1515/cclm-2014-0778     Document Type: Review

References (124)

1. National Health Expenditure trends, 1975 to 2013. Ottawa, ON: Canadian Institute for Health Information, 2013.
2. Health at a Glance 2013: OECD Indicators. Paris: OECD Publishing, 2013.
3. Qaseem A, Alguire P, Dallas P, Feinberg LE, Fitzgerald FT, Horwitch C, et al. Appropriate use of screening and diagnostic tests to foster high-value, cost-conscious care. Ann Intern Med 2012;156:147-9.
4. van Walraven C, Naylor CD. Do we know what inappropriate laboratory utilization is? A systematic review of laboratory clinical audits. J Am Med Assoc 1998;280:9.
5. Grossman RM. A review of physician cost-containment strategies for laboratory testing. Med Care 1983;21:783-802.
6. Axt-Adam P, van der Wouden JC, van der Does E. Influencing behavior of physicians ordering laboratory tests: a literature study. Med Care 1993;31:784-94.
7. Young DW. Improving laboratory usage: a review. Postgrad Med 1988;64:283-9.
8. Solomon DH, Hashimoto H, Daltroy L, Liang MH. Techniques to improve physicians' use of diagnostic tests: a new conceptual framework. J Am Med Assoc 1998;280:2020-7.
9. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Br Med J 2009;339:b2535.
10. Egger M, Smith GD, Altman DG. Principles of and procedures for systematic reviews. Systematic Reviews in Health Care: meta analysis in context, 2nd ed. London: BMJ Publishing Group, 2008:23-42.
11. Cochrane Effective Practice and Organization of Care Review Group. Data collection checklist. Ottawa: Institute of Population Health, University of Ottawa, 2002.
12. Al AM, Zidan A, Hamza AA, Al-Suwaidi R. Evaluation of laboratory investigations in accident and emergency department, Salmaniya Medical Complex. Bahrain Med Bull 2002;24:95-7.
13. Amukele TK, Baird GS, Chandler WL. Reducing the use of coagulation test panels. Blood Coagul Fibrinolysis 2011;22:688-95.
14. Archambault AJ, Arkin CF, Skelton T, Abel G, Gawoski J. Blood (ASH Annual Meeting Abstracts) 2011;118:Abstract 4774.
15. Attali M, Barel Y, Somin M, Beilinson N, Shankman M, Acker-man A, et al. A cost-effective method for reducing the volume of laboratory tests in a university-associated teaching hospital. Mt Sinai J Med 2006;73:787-94.
16. Barazzoni F, Grilli R, Amicosante AM, Brescianini S, Marca MA, Baggi M, et al. Impact of end user involvement in implementing guidelines on routine pre-operative tests. Int J Qual Health Care 2002;14:321-7.
17. Bareford D, Hayling A. Inappropriate use of laboratory services: long term combined approach to modify request patterns. Br Med J 1990;301:1305-7.
18. Baricchi R, Zini M, Nibali MG, Vezzosi W, Insegnante V, Manfuso C, et al. Using pathology-specific laboratory profiles in clinical pathology to reduce inappropriate test requesting: two completed audit cycles. BMC Health Serv Res 2012;12:187.
19. Barie PS, Hydo LJ. Lessons learned: durability and progress of a program for ancillary cost reduction in surgical critical care. J Trauma 1997;43:590-6.
20. Bates DW, Kuperman GJ, Jha A, Teich JM, Orav EJ, Ma'luf N, et al. Does the computerized display of charges affect inpatient ancillary test utilization? Arch Intern Med 1997;157:2501-8.
21. Bates DW, Kuperman GJ, Rittenberg E, Teich JM, Fiskio J, Ma'luf N, et al. A randomized trial of a computer-based intervention to reduce utilization of redundant laboratory tests. Am J Med 1999;106:144-50.
22. Berenholtz S, Pronovost P, Lipsett P, Dawson P, Dorman T. Assessing the effectiveness of critical pathways on reducing resource utilization in the surgical intensive care unit. Intens Care Med 2001;27:1029-36.
23. Berwick DM, Coltin KL. Feedback reduces test use in a health maintenance organization. J Am Med Assoc 1986;255:1450-4.
24. Boon-Falleur L, Sokal E, Peters M, Ketelslegers JM. A rule-based decision support application for laboratory investigations management. Proc Annu Symp Comput Appl Med Care 1995;314-8.
25. Buckingham K, Russell I, Ross I, Gibson P, Paterson N. The effect of allowing clinical discretion in ordering biochemical tests. Evaluation by complementary methods. Int J Technol Assess 1994;10:695-700.
26. Bunting PS, Van Walraven C. Effect of a controlled feedback intervention on laboratory test ordering by community physicians. Clin Chem 2004;50:321-6.
27. Burnett L, Chesher D, Burnett JR. Optimizing the availability of 'stat' laboratory tests using Shewhart 'C' control charts. Ann Clin Biochem 2002;39:140-4.
28. Calderon-Margalit R, Mor-Yosef S, Mayer M, Adler B, Shapira SC. An administrative intervention to improve the utilization of laboratory tests within a university hospital. Int J Qual Health Care 2005;17:243-8.
29. Carson K, Murillo P, Runge A, Vogel DG, Baum LG. A test-ordering algorithm can reduce laboratory test use. Lab Med 1995;26:277-81.
30. Carter E, Bennett BD. Reference test review by pathology house staff: a cost-containment strategy for the clinical laboratory. Clin Leader Manag Rev 2002;16:3-6.
31. Chen P, Tanasijevic MJ, Schoenenberger RA, Fiskio J, Kuperman GJ, Bates DW. A computer-based intervention for improving the appropriateness of antiepileptic drug level monitoring. Am J Clin Pathol 2003;119:432-8.
32. Chu K, Wagholikar A, Greenslade J. Reducing laboratory test ordering by limiting the range of tests that may be requested by interns and residents on pathology request forms. Emerg Med Australas 2012;24:21.
33. Chu UB, Clevenger FW, Imami ER, Lampard SD, Frykberg ER, Tepas JJ. The impact of selective laboratory evaluation on utilization of laboratory resources and patient care in a level-I trauma center. Am J Surg 1996;172:558-3.
34. Cohen DI, Jones P, Littenberg B, Neuhauser D. Does cost information availability reduce physician test usage? A randomized clinical trial with unexpected findings. Med Care 1982;20: 286-92.
35. Davidoff F, Goodspeed R, Clive J. Changing test ordering behavior. A randomized controlled trial comparing probabilistic reasoning with cost-containment education. Med Care 1989;27:45-58.
36. Detsky AS, McLaughlin JR, Abrams HB, L'Abbe K, Markel FM. Do interns and residents order more tests than attending staff? Results of a house staff strike. Med Care 1986;24: 526-34.
37. Dickinson JC. From process to policy: a generic prescription for test over-utilization in the emergency department. Fam Pract Res J 1987;7:12-21.
38. Dixon RH, Laszlo J. Utilization of clinical chemistry services by medical house-staff. Arch Intern Med 1974;134:1064-7.
39. Dowling PT, Alfonsi G, Brown MI, Culpepper L. An education program to reduce unnecessary laboratory tests by residents. Acad Med 1989;64:410-2.
40. Durand-Zaleski I, Rymer JC, Roudot-Thoraval F, Revuz J, Rosa J. Reducing unnecessary laboratory use with new test request form: example of tumour markers. Lancet 1993;342:150-3.
41. Durieux P, Ravaud P, Porcher R, Fulla Y, Manet C-S, Chaussade S. Long-term impact of a restrictive laboratory test ordering form on tumor marker prescriptions. Int J Technol Assess Health Care 2003;19:106-13.
42. Eccles M, Steen N, Grimshaw J, Thomas L, McNamee P, Soutter J, et al. Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet 2001;357:1406-9.
43. Eisenberg JM. An educational program to modify laboratory use by house staff. J Med Educ 1977;52:578-81.
44. Emerson JF, Emerson SS. The impact of requisition design on laboratory utilization. Am J Clin Pathol 2001;116:879-84.
45. Everett GD. Impact of supervision by medical teachers and in-patient test control programmes on the out-patient test utilization of residents. Med Educ 1985;19:138-42.
46. Everett GD, deBlois CS, Chang PF, Holets T. Effect of cost education, cost audits, and faculty chart review on the use of laboratory services. Arch Intern Med 1983;143:942-4.
47. Feldkamp CS, Carey JL. An algorithmic approach to thyroid function testing in a managed care setting: 3-Year experience. Am J Clin Pathol 1996;105:11-6.
48. Feldman LS, Shihab HM, Thiemann D, Yeh HC, Ardolino M, Mandell S, et al. Impact of providing fee data on laboratory test ordering: a controlled clinical trial. JAMA Intern Med 2013;173:903-8.
49. Finegan BA, Rashiq S, McAlister FA, O'Connor P. Selective ordering of preoperative investigations by anesthesiologists reduces the number and cost of tests. Can J Anaesth 2005;52:575-80.
50. Fong BW. Common diagnostic tests: use and interpretation. Hawaii Med J 1989;48:7-9.
51. Fowkes FG, Hall R, Jones JH, Scanlon MF, Elder GH, Hobbs DR, et al. Trial of strategy for reducing the use of laboratory tests. Br Med J 1986;292:883-5.
52. Friedman KG, Rathod RH, Farias M, Graham D, Powell AJ, Fulton DR, et al. Resource utilization after introduction of a standardized clinical assessment and management plan. Congenit Heart Dis 2010;5:374-81.
53. Froom P, Barak M. Cessation of dipstick urinalysis reflex testing and physician ordering behavior. Am J Clin Pathol 2012;137:486-9.
54. Gama R, Nightingale PG, Broughton PM, Peters M, Bradby GV, Berg J, et al. Feedback of laboratory usage and cost data to clinicians: does it alter requesting behaviour? Ann Clin Biochem 1991;28(Pt 2):143-9.
55. Gama R, Nightingale PG, Broughton PM, Peters M, Ratcliffe JG, Bradby GV, et al. Modifying the request behaviour of clinicians. J Clin Pathol 1992;45:248-9.
56. Goddard K, Austin SJ. Appropriate regulation of routine laboratory testing can reduce the costs associated with patient stay in intensive care. Crit Care 2011;15:S47-8.
57. Golden WE, Pappas AA, Lavender RC. Financial unbundling reduces outpatient laboratory use. Arch Intern Med 1987;147:1045-8.
58. Gortmaker SL, Bickford AF, Mathewson HO, Dumbaugh K, Tirrell PC. A successful experiment to reduce unnecessary laboratory use in a community hospital. Med Care 1988;26:631-42.
59. Grivell AR, Forgie HJ, Fraser CG, Berry MN. Effect of feedback to clinical staff of information on clinical biochemistry requesting patterns. Clin Chem 1981;27:1717-20.
60. Groopman DS, Powers RD. Effect of 'standard order' deletion on emergency department coagulation profile use. Ann Emerg Med 1992;21:524-7.
61. Gross PA, Van Antwerpen CL, Hess WA, Reilly KA. Use and abuse of blood cultures: program to limit use. Am J Infect Control 1988;16:114-7.
62. Haschke-Becher E, Totzke U, Afazel S, Johansson T, Schwarz M, Ladurner G, et al. Clinical decision rules for the use of liquor diagnostics in hospitalized neurology patients reduced costs without affecting clinical outcomes. Int J Technol Assess Health Care 2009;25:208-13.
63. Hutton HD, Drummond HS, Fryer AA. The rise and fall of C-reac-tive protein: managing demand within clinical biochemistry. Ann Clin Biochem 2009;46:155-8.
64. Jelinek GA, Banham ND. Reducing the use of plain abdominal radiographs in an emergency department. Arch Emerg Med 1990;7:241-5.
65. Kelly AM. Rationalising the ordering of blood cultures. Aust Health Rev 1998;21:245-50.
66. Kumwilaisak K, Noto A, Schmidt UH, Beck CI, Crimi C, Lewand-rowski K, et al. Effect of laboratory testing guidelines on the utilization of tests and order entries in a surgical intensive care unit. Crit Care Med 2008;36:2993-9.
67. Larocque BJ, Maykut RJ. Implementation of guidelines for preoperative laboratory investigations in patients scheduled to undergo elective surgery. Can J Surg 1994;37:397-401.
68. Levick DL, Stern G, Meyerhoefer CD, Levick A, Pucklavage D. Reducing unnecessary testing in a CPOE system through implementation of a targeted CDS intervention. BMC Med Inform Decis 2013;13:43.
69. Lewandrowski K, Bailey E, Dhanak E, Laposata M, Flood J. Mandatory laboratory consultation: how one hospital's program reduced overuse of cardiac tests. Lab Med 1994;25:460-3.
70. Mancuso CA. Impact of new guidelines on physicians' ordering of preoperative tests. J Gen Intern Med 1999;14:166-72.
71. Martin AR, Wolf MA, Thibodeau LA, Dzau V, Braunwald E. A trial of two strategies to modify the test-ordering behavior of medical residents. N Engl J Med 1980;303:1330-6.
72. Marton KI, Tul V, Sox HC. Modifying test-ordering behavior in the outpatient medical clinic. A controlled trial of two educational interventions. Arch Intern Med 1985;145:816-21.
73. May TA, Clancy M, Critchfield J, Ebeling F, Enriquez A, Gallagher C, et al. Reducing unnecessary inpatient laboratory testing in a teaching hospital. Am J Clin Pathol 2006;126:200-6.
74. Mehari SM, Havill JH, Montgomery C. A written guideline implementation can lead to reductions in laboratory testing in an intensive care unit. Anaesth Intensive Care 1997;25:33-7.
75. Meng QH, Zhu S, Booth C, Stevens L, Bertsch B, Qureshi M, et al. Impact of the cardiac troponin testing algorithm on excessive and inappropriate troponin test requests. Am J Clin Pathol 2006;126:195-9.
76. Merlani P, Garnerin P, Diby M, Ferring M, Ricou B. Quality improvement report: linking guideline to regular feedback to increase appropriate requests for clinical tests: blood gas analysis in intensive care. Br Med J 2001;323:620-4.
77. Meyer L, Schmeler K, Wallbillich J, Urbauer D, Soliman P, Frumo-vitz M, et al. Clinical practice guidelines decrease unnecessary Pap tests in survivors of gynecologic malignancies. Gynecol Oncol 2011;120:S30-1.
78. Miyakis S, Karamanof G, Liontos M, Mountokalakis TD. Factors contributing to inappropriate ordering of tests in an academic medical department and the effect of an educational feedback strategy. Postgrad Med 2006;82:823-9.
79. Morris AJ, Wilson ML, Reller LB. Application of rejection criteria for stool ovum and parasite examinations. J Clin Microbiol 1992;30:3213-6.
80. Mutimer D, McCauley B, Nightingale P, Ryan M, Peters M, Neuberger J. Computerised protocols for laboratory investigation and their effect on use of medical time and resources. J Clin Pathol 1992;45:572-4.
81. Nardella A, Pechet L, Snyder LM. Continuous improvement, quality control, and cost containment in clinical laboratory testing: effects of establishing and implementing guidelines for preoperative tests. Arch Pathol Lab Med 1995;119:518-22.
82. Neilson EG, Johnson KB, Rosenbloom ST, Dupont WD, Talbert D, Giuse DA, et al. The impact of peer management on test-ordering behavior. Ann Intern Med 2004;141:196-204.
83. Nelson III RB. Teaching technologic restraint. An evaluation of a single session. Eval Health Prof 1978;1:21-8.
84. Nightingale PG, Peters M, Mutimer D, Neuberger JM. Effects of a computerised protocol management system on ordering of clinical tests. Qual Health Care 1994;3:23-8.
85. Nirel N, Rosen B, Sharon A, Samuel H, Cohen AD. The impact of an integrated hospital-community medical information system on quality of care and medical service utilisation in primary-care clinics. Inform Health Soc Ca 2011;36:63-74.
86. Pageler N, Longhurst C, Shin A, Adams E, Widen E, Barth R, et al. Using computerized provider order entry (CPOE) to promote sustained optimization of diagnostic radiologic service utilization. Crit Care Med 2009;37:A363.
87. Pageler NM, Franzon D, Longhurst CA, Wood M, Shin AY, Adams ES, et al. Embedding time-limited laboratory orders within computerized provider order entry reduces laboratory utilization. Pediatr Crit Care Med 2013;14:413-9.
88. Patel HD, Livsey SA, Swann RA, Bukhari SS. Can urine dipstick testing for urinary tract infection at point of care reduce laboratory workload? J Clin Pathol 2005;58:951-4.
89. Pilon CS, Leathley M, London R, McLean S, Phang PT, Priestley R, et al. Practice guideline for arterial blood gas measurement in the intensive care unit decreases numbers and increases appropriateness of tests. Crit Care Med 1997;25:1308-13.
90. Pop P, Winkens RA. A diagnostic centre for general practitioners: results of individual feedback on diagnostic actions. J R Coll Gen Pract 1989;39:507-8.
91. Power LM, Thackray NM. Reduction of preoperative investigations with the introduction of an anaesthetist-led preoperative assessment clinic. Anaesth Intensive Care 1999;27:481-8.
92. Powles L, Green J, Taylor E. Can redesigning a laboratory request form reduce the number of inappropriate PSA requests without compromising clinical outcome. Urology 2009;74:S148.
93. Prat G, Lefevre M, Nowak E, Tonnelier J-M, Renault A, L'Her E, et al. Impact of clinical guidelines to improve appropriateness of laboratory tests and chest radiographs. Intens Care Med 2009;35:1047-53.
94. Pysher TJ, Bach PR, Lowichik A, Petersen MD, Shields LH. Chemistry test ordering patterns after elimination of predefined multitest chemistry panels in a children's hospital. Pediatr Dev Pathol 1999;2:446-53.
95. Ramoska EA. Information sharing can reduce laboratory use by emergency physicians. Am J Emerg Med 1998;16:34-6.
96. Ratnaike S, Hunt D, Eilermann LJ, Hazen R, Deam D. The investigation of chest pain: audit and intervention. Med J Australia 1993;159:666-71.
97. Rhyne RL, Gehlbach SH. Effects of an educational feedback strategy on physician utilization of thyroid function panels. J Fam Practice 1979;8:1003-7.
98. Roberts DE, Bell DD, Ostryzniuk T, Dobson K, Oppenheimer L, Martens D, et al. Eliminating needless testing in intensive care-an information-based team management approach. Crit Care Med 1993;21:1452-8.
99. Rosenbloom ST, Chiu K-W, Byrne DW, Talbert DA, Neilson EG, Miller RA. Interventions to regulate ordering of serum magnesium levels: report of an unintended consequence of decision support. J Am Med Informat Assoc 2005;12:546-53.
100. Santos IS, Bensenor IM, Machado JB, Fedeli LM, Lotufo PA. Intervention to reduce C-reactive protein determination requests for acute infections at an emergency department. Emerg Med J 2012;29:965-8.
101. Seguin P, Bleichner J, Grolier J, Guillou Y, Malledant Y. Efects of price information on test ordering in an intensive care unit. Intens Care Med 2002;28:332-5.
102. Shalev V, Chodick G, Heymann AD. Format change of a laboratory test order form afects physician behavior. Int J Med Inform 2009;78:639-44.
103. Sorita A, Steinberg D, Leitman M, Luhan P, Burger A, Sivaprasad L. Impact of targeted individual feedback on provider patterns of stat laboratory test ordering frequency. J Hosp Med 2011;6:S135-6.
104. Spray J, Brackbill M, Baker P. Evaluation of efect of electronic decision tree electrolyte replacement protocol on number of electrolyte labs ordered for patients in critical care. Crit Care Med 2012;40:248.
105. Stafford RS. Feedback intervention to reduce routine electrocardiogram use in primary care. Am Heart J 2003;145:979-85.
106. Sucov A, Bazarian JJ, deLahunta EA, Spillane L. Test ordering guidelines can alter ordering patterns in an academic emergency department. J Emerg Med 1999;17:391-7.
107. Sussman E, Goodwin P, Rosen H. Administrative change and diagnostic test use: the efect of eliminating standing orders. Med Care 1984;22:569-72.
108. Thompson RS, Kirz HL, Gold RA. Changes in physician behavior and cost savings associated with organizational recommendations on the use of 'routine' chest X rays and multichannel blood tests. Prev Med 1983;12:385-96.
109. Tierney WM, McDonald CJ, Hui SL, Martin DK. Computer predictions of abnormal test results. Efects on outpatient testing. J Am Med Assoc 1988;259:1194-8.
110. Tierney WM, Miller ME, McDonald CJ. The efect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med 1990;322:1499-504.
111. Toubert ME, Chevret S, Cassinat B, Schlageter MH, Beressi JP, Rain JD. From guidelines to hospital practice: reducing inappropriate ordering of thyroid hormone and antibody tests. Eur J Endocrinol 2000;142:605-10.
112. van Wijk MA, van dL, Mosseveld M, Bohnen AM, van Bemmel JH. Assessment of decision support for blood test ordering in primary care. a randomized trial. Ann Intern Med 2001;134:274-81.
113. Vardy DA, Simon T, Limoni Y, Kuperman O, Rabzon I, Cohen A, et al. The impact of structured laboratory routines in computerized medical records in a primary care service setting. J Med Syst 2005;29:619-26.
114. Verstappen WH, van der Weijden T, Sijbrandij J, Smeele I, Hermsen J, Grimshaw J, et al. Efect of a practice-based strategy on test ordering performance of primary care physicians: a randomized trial. J Am Med Assoc 2003;289:2407-12.
115. Wagholikar A, O'Dwyer J, Hansen D, Chu K. Observing efective-ness of pathology ordering controls in emergency departments. Stud Health Tech Informat 2011;168:172-8.
116. Winkens RA, Pop P, Bugter-Maessen A, Grol RP, Kester AD, Beusmans GH, et al. Randomised controlled trial of routine individual feedback to improve rationality and reduce numbers of test requests. Lancet 1995;345:498-502.
117. Winkens RA, Pop P, Grol RP, Kester AD, Knottnerus JA. Efect of feedback on test ordering behaviour of general practitioners. Br Med J 1992;304:1093-6.
118. Wones RG. Failure of low-cost audits with feedback to reduce laboratory test utilization. Med Care 1987;25:78-82.
119. Zaat JO. Attempts to change test ordering behavior in laboratories. Ann Clin Biochem 1992;17:8-14.
120. Zaidi AK, Macone A, Goldmann AD. Impact of simple screening criteria on utilization of low-yield bacterial stool cultures in a Children's Hospital. Pediatrics 1999;103: 1189-92.
121. Zia HM, Singh G. Optimization of utilization of serum protein analysis: role of the electronic medical record in promoting consultation by pathology. Am J Clin Pathol 2013;139:793-7.
122. Roshanov PS, You JJ, Dhaliwal J, Kof D, Mackay JA, Weise-Kelly L, et al. Can computerized clinical decision support systems improve practitioners' diagnostic test ordering behavior? A decision-maker-researcher partnership systematic review. Implement Sci 2011;6:88.
123. Buntinx F, Winkens R, Grol R, Knottnerus JA. Influencing diagnostic and preventive performance in ambulatory care by feedback and reminders. A review. Fam Pract Res J 1993;10:219-28.
124. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: efects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012;6:CD000259.