Changing physician performance: A systematic review of the effect of continuing medical education strategies

Journal of the American Medical Association

Volumn 274, Issue 9, 1995, Pages 700-705

  Davis, David A ^a   Thomson, Mary Ann ^b   Oxman, Andrew D ^c   Haynes, R Brian ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b MCMASTER UNIVERSITY   (Canada)

^c NORWEGIAN INSTITUTE OF PUBLIC HEALTH   (Norway)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUING EDUCATION; EDUCATION PROGRAM; HEALTH CARE DELIVERY; HEALTH PROMOTION; JOB PERFORMANCE; MEDICAL EDUCATION; PHYSICIAN; PREVENTIVE MEDICINE; PRIORITY JOURNAL; REVIEW; TREATMENT OUTCOME;

EID: 0029021368     PISSN: 00987484     EISSN: None     Source Type: Journal    
DOI: 10.1001/jama.274.9.700     Document Type: Review

References (122)

1. Amara R, Morrison JI, Schmid G. Looking Ahead at American Health Care. Institute for the Future, Healthcare Information Center, Washington, DC: McGraw-Hill International Book Co; 1988.
2. Association of American Medical Colleges. Roles for medical education in health care reform. Acad Med. 1994;69:512-515.
3. Pories WJ, Smout JC, Morris A, Lewkow VE. US health care reform: will it change postgraduate surgical education? World J Surg. 1994;18:745-752.
4. Haynes RB, Davis DA, McKibbon A, Tugwell P. A critical appraisal of the efficacy of continuing medical education. JAMA. 1984;251:61-64.
5. Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME: a review of 50 randomized controlled trials. JAMA. 1992;268:1111-1117.
6. Lau J, Antman EM, Jimenez-Silva J, Kupelnick B, Mosteller F, Chalmers TC. Cumulative metaanalysis of therapeutic trials for myocardial infarction. N Engl J Med. 1992;327:248-254.
7. Jay SJ, Anderson JG. Continuing medical education and public policy in an era of health care reform. J Contin Educ Health Profess. 1993;13:195-209.
8. Oxman AD, Thomson MA, Haynes RB, Davis DA. No magic bullets: a systematic review of 102 trials of interventions to help health care professionals deliver services more effectively and efficiently. Can Med Assoc J. In press.
9. Bertram DA, Brooks-Bertram PA. The evaluation of continuing medical education: a literature review. Health Educ Monogr. 1977;5:330-362.
10. Beaudry JS. The effectiveness of continuing medical education: a quantitative synthesis. J Contin Educ Health Profess. 1989;9:285-307.
11. McLaughlin PJ, Donaldson JF. Evaluation of continuing medical education programs: a selected literature. 1984-1988. J Contin Educ Health Profess. 1991;11:65-84.
12. Cochrane Collaboration. Optimal MEDLINE Search Strategy for Identifying Randomized Clinical Trials (RCTs): Cochrane Collaboration Handbook. Oxford, England: UK Cochrane Centre; 1994: 29.
13. Davis DA, Fox RD, eds. The Physician as Learner: Linking Research to Practice. Chicago, Ill: American Medical Association Press; 1994:xiii.
14. Anderson FA Jr, Wheeler HB, Goldberg RJ, Hosmer DW, Forcier A, Patwardhan NA. Changing clinical practice: prospective study of the impact of continuing medical education and quality assurance programs on use of prophylaxis for venous thromboembolism. Arch Intern Med. 1994; 154:669-677.
15. Avorn J, Soumerai SB. Improving drug-therapy decisions through educational outreach: a randomized controlled trial of academically based 'detailing.' N Engl J Med. 1983;308:1457-1463.
16. Avorn J, Soumerai SB, Everitt DE, et al. A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes. N Engl J Med. 1992;327:168-173.
17. Barnett GO. A computer based monitoring system for follow-up of elevated blood pressure. Med Care. 1983;21:400-409.
18. Bass MJ, McWhinney IR, Donner A. Do family physicians need medical assistants to detect and manage hypertension? Can Med Assoc J. 1986;134: 1247-1255.
19. Berwick DM, Coltin KL. Feedback reduces test use in a health maintenance organization. JAMA. 1986;255:1450-1454.
20. Billi JE, Hejna GF, Wolf FM, Shapiro LR, Stross JK. The effects of a cost-education program on hospital charges. J Gen Intern Med. 1987;2:306-311.
21. Brimberry R. Vaccination of high-risk patients for influenza: a comparison of telephone and mail reminder methods. J Fam Pract. 1988;26:397-400.
22. Britton ML, Lurvey PL. Impact of medication profile review on prescribing in a general medicine clinic. Am J Public Health. 1991;48:265-270.
23. Browner WS, Baron RB, Solkowitz S, Adler LJ, Gullion DS. Physician management of hypercholesterolemia: a randomized trial of continuing medical education. West J Med. 1994;161:572-578.
24. Buntinx F. Does feedback improve the quality of cervical smears? a randomized controlled trial. Br J Gen Pract. 1993;43:194-198.
25. Callahan CM, Hendrie HC, Dittus RS, Brater DC, Hui SL, Tierney WM. Improving treatment of late life depression in primary care: a randomized clinical trial. J Am Geriatr Soc. 1994;42:839-846.
26. Chambers CV, Balaban DJ, Carlson BL. Microcomputer-generated reminders: improving the compliance of primary care physicians with mammography screening guidelines. J Fam Pract. 1989; 29:273-280.
27. Chase CR. Medical information management: improving the transfer of research results to presurgical evaluation. Med Care. 1983;21:410-424.
28. Chassin MR, McCue SM. A randomized trial of medical quality assurance: improving physicians' use of pelvimetry. JAMA. 1986;256:1012-1016.
29. Cheney C, Ramsdell JW. Effect of medical records' checklists on implementation of periodic health measures. Am J Med. 1987;83:129-136.
30. Cockburn J, Ruth D, Silagy C, et al. Randomised trial of three approaches for marketing smoking cessation programmes to Australian general practitioners. BMJ. 1992;304:691-694.
31. Cohen DI, Jones P, Littenberg B, Neuhauser D. Does cost information availability reduce physician test usage? a randomized clinical trial with unexpected findings. Med Care. 1982;20:286-292.
32. Cohen SJ, Christen AG, Katz BP, et al. Counseling medical and dental patients about cigarette smoking: the impact of nicotine gum and chart reminders. Am J Public Health. 1987;77:313-316.
33. Cohen SJ, Weinberger M, Hui SL, Tierney WM, McDonald CJ. The impact of reading on physicians' nonadherence to recommended standards of medical care. Soc Sci Med. 1985;21:909-914.
34. Cowan JA. Effect of a fact sheet reminder on performance of the periodic health examination: a randomized controlled trial. Am J Prev Med. 1992; 8:104-109.
35. Cummings SR, Coates TJ, Richard RJ, et al. Training physicians in counselling about smoking cessation: a randomized trial of the 'Quit for Life' program. Ann Intent Med. 1989;110:640-647.
36. Cummings SR, Richard RJ, Duncan CL, et al. Training physicians about smoking cessation: a controlled trial in private practice. J Gen Intern Med. 1989;4:482-489.
37. Davidoff F, Goodspeed R, Clive J. Changing test ordering behavior: a randomized controlled trial comparing probabilistic reasoning with costcontainment education. Med Care. 1989;27:45-58.
38. Dickinson JC. Improving hypertension control: impact of computer feedback and physician education. Med Care. 1981;19:843-854.
39. Dietrich AJ. Cancer: improving early detection and prevention, a community practice randomised trial. BMJ. 1992;304:687-691.
40. Evans CE, Haynes RB, Birkett NJ, et al. Does a mailed continuing education program improve physician performance? results of a randomized trial in antihypertensive care. JAMA. 1986;255:501-504.
41. Everett GD, deBlois CS, Chang PF, Holets T. Effect of cost education, cost audits, and faculty chart review on the use of laboratory services. Arch Intern Med. 1983;143:942-944.
42. Gehlbach SH, Wilkinson WE, Hammond WE, et al. Improving drug prescribing in a primary care practice. Med Care. 1984;22:193-201.
43. Gullion DS, Tschann JM, Adamson TE, Coates TJ. Management of hypertension in private practice: a randomized controlled trial in continuing medical education. J Contin Educ Health Profess. 1988;8:239-255.
44. Headrick LA, Speroff T, Pelecanos HI, Cebul RD. Efforts to improve compliance with the National Cholesterol Education Program guidelines: results of a randomized controlled trial. Arch Intern Med. 1992;152:2490-2496.
45. Heale J, Davis DA, Norman GR, Woodward C, Neufeld VR, Dodd P. A randomized controlled trial assessing the impact of problem based versus didactic teaching methods in CME. Proc Annu Conf Res Med Educ. 1988;27:72-77.
46. Hershey CO, Goldberg HI, Cohen DI. The effect of computerized feedback coupled with a newsletter upon outpatient prescribing charges. Med Care. 1988;26:88-93.
47. Hershey CO, Porter DK, Breslau D, Cohen DI. Influence of simple computerized feedback on prescription charges in an ambulatory clinic. Med Care. 1986;24:472-481.
48. Jennett PA, Laxdal OE, Hayton RC, et al. The effects of continuing medical education on family doctor performance in office practice: a randomized control study. Med Educ. 1988;22:139-145.
49. Kottke TE, Brekke ML, Solberg LI, Hughes JR. A randomized trial to increase smoking intervention by physicians: doctors helping smokers, round I. JAMA. 1989;261:2101-2106.
50. Levinson W. The effects of two continuing medical education programs on communication skills of practicing primary care physicians. J Gen Intern Med. 1993;8:318-324.
51. Linn BS. Continuing medical education: impact on emergency room burn care. JAMA. 1980;244: 565-570.
52. Litzelman DK, Dittus RS, Miller ME, Tierney WM. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. J Gen Intern Med. 1993; 8:311-317.
53. Lomas J, Enkin M, Anderson GM, Hannah WJ, Vayda E, Singer J. Opinion leaders vs audit and feedback to implement practice guidelines: delivery after previous cesarean section. JAMA. 1991; 265:2202-2207.
54. Magruder-Habib K, Zung WWK, Feussner JR. Improving physicians' recognition and treatment of depression in general medical care: result from a randomized clinical trial. Med Care. 1990;28:239-250.
55. Maiman LA, Becker MH, Liptak GS, Nazarian LF, Rounds KA. Improving pediatricians' compliance-enhancing practices. AJDC. 1988;142:773-779.
56. Manheim LM, Feinglass J, Hughes R, Martin GJ, Conrad K, Hughes EF. Training house officers to be cost conscious: effects of an educational intervention on charges and length of stay. Med Care. 1990;28:29-42.
57. Martin AR, Wolf MA, Thibodeau LA, Dau V, Braunweld E. A trial of two strategies to modify the test-ordering behavior of medical residents. N Engl J Med. 1980;303:1330-1336.
58. Marton KI, Tul V, Sox HC Jr. Modifying test-ordering behavior in the outpatient medical clinic: a controlled trial of two educational interventions. Arch Intern Med. 1985;145:816-821.
59. Mayefsky JH, Foye HR. Use of a chart audit: teaching well child care to pediatric house officers. Med Educ. 199327:170-174.
60. Mazzuca SA, Vinicor F, Einterz RM, Tierney WM, Norton JA, Kalasinski LA. Effects of the clinical environment on physicians' response to postgraduate medical education. Am Educ Res J. 1990; 27:473-488.
61. McAlister NH, Covvey HD, Tong C, Lee A, Wigle ED. Randomised controlled trial of computer assisted management of hypertension in primary care. BMJ (Clin Res Ed). 1986;293:670-674.
62. McConnell TS, Cushing AH, Bankhurst AD, Healy JL, Mcllvenna PA, Skipper BJ. Physician behavior modification using claims data: tetracycline for upper respiratory infection. West J Med. 1982;137:448-450.
63. McDonald CJ. Use of a computer to detect and respond to clinical events: its effect on clinician behaviour. Ann Intern Med. 1976;84:162-167.
64. McDonald CJ. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med. 1976;295:1351-1355.
65. McDonald CJ, Hui SL, Smith DM, et al. Reminders to physicians from an introspective computer medical record. Ann Intern Med. 1984;100: 130-138.
66. McDonald CJ, Wilson GA, McCabe GP Jr. Physician response to computer reminders. JAMA. 1980; 244:1579-1581.
67. McDowell I, Newell C, Rosser W. Computerized reminders to encourage cervical screening in family practice. J Fam Pract. 1989;28:420-424.
68. McPhee SJ, Bird JA, Fordham D, Rodnick JE, Osborn EH. Promoting cancer prevention activities by primary care physicians. JAMA. 1991;266: 538-544.
69. McPhee SJ, Bird JA, Jenkins CN, Fordham D. Promoting cancer screening: a randomized, controlled trial of three interventions. Arch Intern Med. 1989;149:1866-1872.
70. Meyer TJ, Van Kooten D, Marsh S, Prochazka AV. Reduction of polypharmacy by feedback to clinicians. J Gen Intern Med. 1991;6:133-135.
71. Morgan M. Computerized concurrent review of prenatal care. Q Rev Bull. 1978;4:33-36.
72. Norton PG, Dempsey LJ. Self-audit: its effect on quality of care. J Fam Pract. 1985;21:289-291.
73. Palmer RH, Louis TA, Hsu L, et al. A randomized controlled trial of quality assurance in sixteen ambulatory care practices. Med Care. 1985; 23:751-770.
74. Perera DR, LoGerfo JP, Shulenberger E, Ylvisaker JT, Kirz HL. Teaching sigmoidoscopy to primary care physicians: a controlled study of continuing medical education. J Fam Pract. 1983;16:785-788.
75. Pierce M, Lundy S, Palanisamy A, Winning S, King J. Prospective randomised controlled trial of methods of call and recall for cervical cytology screening. BMJ. 1989;99:160-162.
76. Pinkerton RE, Tinanoff N, Willms JL, Tapp JT. Resident physician performance in a continuing education format: does newly acquired knowledge improve patient care? JAMA. 1980;244:2183-2185.
77. Pollack MM, Getson PR. Pediatric critical care cost containment: combined actuarial and clinical program. Crit Care Med. 1991;19:12-20.
78. Pozen MW, D'Agostino RB, Mitchell JB, et al. The usefulness of a predictive instrument to reduce inappropriate admissions to the coronary care unit. Ann Intern Med. 1980;92:238-242.
79. Pozen MW, D'Agostino RB, Selker HP, Sytkowski PA, Hood WB Jr. A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease: a prospective multicenter clinical trial. N Engl J Med. 1984;310:1273-1278.
80. Pugh JA, Frazier LM, DeLong E, Wallace AG, Ellenbogen P, Linfors E. Effect of daily charge feedback on inpatient charges and physician knowledge and behavior. Arch Intern Med. 1989;149:426-429.
81. Putnam RW, Curry L. Impact of patient care appraisal on physician behaviour in the office setting. Can Med Assoc J. 1985;132:1025-1029.
82. Putnam RW, Curry L. Physicians' participation in establishing criteria for hypertension management in the office: will patient outcomes be improved? Can Med Assoc J. 1989;140:806-809.
83. Rabin DL, Boekeloo BO, Marx ES, Bowman MA, Russell NK, Willis AG. Improving office-based physicians' prevention practices for sexually transmitted diseases. Ann Intent Med. 1994;121:513-519.
84. Raisch DW, Bootman JL, Larson LN, McGhan WF. Improving antiulcer agent prescribing in a health maintenance organization. Am J Hosp Pharm. 1990;47:1766-1773.
85. Restuccia JD. The effect of concurrent feedback in reducing inappropriate hospital utilization. Med Care. 1982;20:46-62.
86. Rogers JL. Medical information systems: assessing impact in areas of hypertension, obesity, and renal disease. Med Care. 1982:20:63-74.
87. Rosser WW, McDowell I, Newell C. Use of reminders for preventive procedures in family medicine. Can Med Assoc J. 1991;145:807-814.
88. Rubenstein LV, Calkins DR, Young RT, et al. Improving patient function: a randomized trial of functional disability screening. Ann Intern Med. 1989;111:836-842.
89. Sanazaro PJ, Worth RM. Concurrent quality assurance in hospital care: report of a study by private initiative in PSRO. N Engl J Med. 1978; 298:1171-1177.
90. Sibley JC, Sackett DL, Neufeld V, Gerrard B, Rudnick KV, Fraser W. A randomized trial of continuing medical education. N Engl J Med. 1982; 306:511-515.
91. Soumerai SB, Salem-Schatz S, Avorn J, Casteris CS, Ross-Degnan D, Popovsky MA. A controlled trial of educational outreach to improve blood transfusion practice. JAMA. 1993;270:961-966.
92. Steele MA, Bess DT, Franse VL, Graber SE. Cost effectiveness of two interventions for reducing outpatient prescribing costs. DICP. 1989;23: 497-500.
93. Stross JK. Evaluation of a continuing education program in rheumatoid arthritis. Arthritis Rheum. 1980;23:846-849.
94. Stross JK, Bole GG. Evaluation of an educational program for primary care practitioners, on the management of osteoarthritis. Arthritis Rheum. 1985;28:108-111.
95. Stross JK, Hiss RG, Watts CM, Davis WK, MacDonald R. Continuing education in pulmonary disease for primary-care physicians. Am Rev Respir Dis. 1983;127:739-746.
96. Sulmasy DP, Geller G, Faden R, Levine DM. The quality of mercy: caring for patients with 'do not resuscitate' orders, JAMA. 1992;267:682-686.
97. Szczepura A, Wilmot J, Davies C, Fletcher J. Effectiveness and cost of different strategies for information feedback in general practice. Br J Gen Pract. 1994;44:19-24.
98. Tape TG, Campbell JR. Computerized medical records and preventive health care: success depends on many factors. Am J Med. 1993:94:619-625.
99. Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Med Care. 1986;24:659-666.
100. Tierney WM, McDonald CJ, Hui SL, Martin DK. Computer predictions of abnormal test results: effects on outpatient testing. JAMA. 1988;259:1194-1198.
101. Tierney WM, Miller ME, McDonald CJ. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990;322:1499-1504.
102. Turner RC, Waivers LE, O'Brien K. The effect of patient-carried reminder cards on the performance of health maintenance measures. Arch Intern Med. 1990;150:645-647.
103. Vinicor F, Cohen SJ, Mazzuca SA, et al. Diabetes: a randomized trial of the effects of physician and/or patient education on diabetes patient outcomes. J Chronic Dis. 1987;40:345-356.
104. Weingarten MA, Bazel D, Shannon HS. Computerized protocol for preventive medicine: a controlled self-audit in family practice. Fam Pract. 1989;6:120-124.
105. Wexler JR. Impact of a system of computer-assisted diagnosis. AJDC. 1975;129:203-205.
106. White CW, Albanese MA, Brown DD, Caplan RM. The effectiveness of continuing medical education in changing the behaviour of physicians caring for patients with acute myocardial infarction. Ann Intern Med. 1985;102:686-692.
107. White PT, Pharoah CA, Anderson HR, Freeling P. Randomized controlled trial of small group education on the outcome of chronic asthma in general practice. J R Coll Gen Pract. 1989;39:182-186.
108. Wigton RS, Zimmer JL, Wigton JH, Patil KD. Chart reminders in the diagnosis of anemia. JAMA. 1981;245:1745-1747.
109. Wilson DM, Taylor DW, Gilbert JR, et al. A randomized trial of a family physician intervention for smoking cessation. JAMA. 1988;260:1570-1574.
110. Winickoff RN, Coltin KL, Morgan MM, Buxbaum RC, Barnett GO. Improving physician performance through peer comparison feedback. Med Care. 1984;22:527-534.
111. Winickoff RN, Wilner S, Neisuler R, Barnett GO. Limitation of provider interventions in hypertension quality assurance. Am J Public Health. 1985;75:43-46.
112. Wones RG. Failure of low-cost audits with feedback to reduce laboratory test utilization. Med Care. 1987;25:78-82.
113. Oxman AD, Guyatt GH. A consumers guide to subgroup analyses. Ann Intern Med. 1992;116:78-84.
114. American Medical Association. Physician Characteristics and Distribution in the USA, Chicago, Ill: American Medical Association; January 1, 1995.
115. Evidence-Based Medicine Working Group. Evidence-based medicine: a new approach to teaching the practice of medicine. JAMA. 1992;268:2420-2425.
116. Green L, Kreuter M, Deeds S, Partridge K. Health Education. Planning: A Diagnostic Approach. Palo Alto, Calif: Mayfield Press; 1980.
117. Rogers EM. Diffusion of Innovation. New York, NY: The Free Press; 1983.
118. Nowlen PM. A New Approach to Continuing Education for Business and the Professions. New York, NY: Macmillan; 1988.
119. Bandura A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, NJ: Prentice-Hall; 1986.
120. Fox RD, Mazmanian PE, Putnam RW. Changing and Learning in the Lives of Physicians. New York, NY: Praeger; 1989.
121. American Medical Association. The CME Directory. Chicago, Ill: American Medical Association; 1994.
122. Freemantle N, Grilli R, Grimshaw J, Oxman AD. The Cochrane Collaboration on Effective Professional Practice. Q Health Care. 1995;4:45-47.