Does CME work? An analysis of the effect of educational activities on physician performance or health care outcomes

International Journal of Psychiatry in Medicine

Volumn 28, Issue 1, 1998, Pages 21-39

  Davis, Dave ^a,b  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Continuing medical education; Effectiveness; Health care and patient outcomes; Physician performance

Indexed keywords

COMMUNITY; CONFERENCE PAPER; CONTINUING EDUCATION; FEEDBACK SYSTEM; HEALTH CARE; HUMAN; MEDICAL EDUCATION; OUTCOMES RESEARCH; PERFORMANCE; PHYSICIAN;

EID: 0031748834     PISSN: 00912174     EISSN: None     Source Type: Journal    
DOI: 10.2190/UA3R-JX9W-MHR5-RC81     Document Type: Conference Paper

References (121)

1. Amara R, Morrison JI, Schmid G. Looking ahead at American health care. Institute for the Future, Healthcare Information Center, Washington, DC: McGraw-Hill, 1981.
2. Roles for medical education in health care reform. Association of American Medical Colleges. Academic Medicine 1994;69:512-515.
3. Pories WJ, Smout JC, Morris A, Lewkow VE. U.S. health care reforms: Will it change postgraduate surgical education? World Journal of Surgery 1994;18:745-752.
4. Haynes RB, Davis DA, McKibbon A, Tugwell P. A critical appraisal of the efficacy of continuing medical education. Journal of the American Medical Association 1984;251(1):61-64.
5. Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. Journal of the American Medical Association 1992;268:1111-1117.
6. Lau J, Antman EM, Jiminez-Silva J, Kupelnick B, Mosteller F, Chalmers TC. Cumulative meta-analysis of therapeutic trials for myocardial infarction. New England Journal of Medicine 1992;327:248-254.
7. Jay SJ, Anderson JG. Continuing medical education and public policy in an era of health care reform. Journal of Continuing Education of Health Professions 1993;13:195-209.
8. Oxman AD, Thomson MA, Haynes RB, Davis DA. No magic bullets: A systematic review of 102 trials of interventions to help health care professionals deliver services more effectively and efficiently. Canadian Medical Association Journal 1995; 153:1423-1431.
9. Bertram DA, Brooks-Bertram PA. The evaluation of continuing medical education: A literature review. Health Education Monograph 1977;5(4):330-362.
10. Beaudry JS. The effectiveness of continuing medical education: A quantitative synthesis. Journal of Continuing Education in Health Professions 1989;9:285-307.
11. McLaughlin PJ, Donaldson JF. Evaluation of continuing medical education programs: A selected literature, 1984-1988. Journal of Continuing Education in Health Professions 1991;11(1):65-84.
12. Cochrane Collaboration. Optimal MEDUNE search strategy for identifying randomized clinical trials (RCTs). Cochrane Collaboration Handbook 1994;Section V, Append. 2:29.
13. Davis DA, Fox, RD, editors. The physician as learner: Linking research to practice. Chicago: American Medical Association Press, 1994, xiii.
14. Anderson FA, Jr., Wheeler HB, Goldberg RJ, Hosmer DW, Forcier A, Patwardhan NA. Changing clinical practice. Prospective study of the impact of continuing medical education and quality assurance programs on use of prophylaxis for venous thromboembolism. Archives of Internal Medicine 1994;154:669-677.
15. Avorn J, Soumerai SB. Improving drug-therapy decisions through educational outreach: A randomized controlled trial of academically based "detailing." New England Journal of Medicine 1983;308(24):1457-1463.
16. Avorn J, Soumerai SB, Everitt DE, Ross-Degnan D, Beers MH, Sherman D, SalemSchatz SR, Fields D. A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes. New England Journal of Medicine 1992; 327:168-173.
17. Barnett GO. A computer based monitoring system for follow-up of elevated blood pressure. Medical Care 1983;21:400-409.
18. Bass MJ, McWhinney IR, Donner A. Do family physicians need medical assistants to detect and manage hypertension? Canadian Medical Association Journal 1986; 134:1247-1255.
19. Berwick DM, Coltin KL. Feedback reduces test use in a health maintenance organization. Journal of the American Medical Association 1986;255:1450-1454.
20. Billi JE, Hejna GF, Wolf FM, Shapiro LR, Stross JK. The effects of a costeducation program on hospital charges. Journal of General Internal Medicine 1987; 2:306-311.
21. Brimberry R. Vaccination of high-risk patients for influenza. A comparison of telephone and mail reminder methods. Journal of Family Practice 1988;26: 397-400.
22. Britton ML, Lurvey PL. Impact of medication profile review on prescribing in a general medicine clinic. American Journal of Public Health 1991;48:265-270.
23. Browner WS, Baron RB, Solkowitz S, Adler LJ, Gullion DS. Physician management of hypercholesterolemia. A randomized trial of continuing medical education. Western Journal of Medicine 1994;161:572-578.
24. Buntinx F. Does feedback improve the quality of cervical smears? A randomized controlled trial. British Journal of General Practice 1993;43:194-198.
25. Callahan CM, Hendrie HC, Dittus RS, Brater DC, Hui SL, Tierney WM. Improving treatment of late life depression in primary care: A randomized clinical trial. Journal of the American Geriatrics Society 1994;42:839-846.
26. Chambers CV, Balaban DJ, Carlson BL. Microcomputer-generated reminders: Improving the compliance of primary care physicians with mammography screening guidelines. Journal of Family Practice 1989;29:273-280.
27. Chase CR. Medical information management. Improving the transfer of research results to presurgical evaluation. Medical Care 1983;21:410-424.
28. Chassin MR, McCue SM. A randomized trial of medical quality assurance: Improving physicians' use of pelvimetry. Journal of the American Medical Association 1986;256:1012-1016.
29. Cheney C, Ramsdell JW. Effect of medical records' checklists on implementation of periodic health measures. American Journal of Medicine 1987;83:129-136.
30. Cockbum J, Ruth D, Silagy C, Dobbin M, Reid Y, Scollo M, Naccarella L. Randomised trial of three approaches for marketing smoking cessation programmes to Australian general practitioners. British Medical Journal 1992;304:691-694.
31. Cohen DI, Jones P, Littenberg B, Neuhauser D. Does cost information availability reduce physician test usage? A randomized clinical trial with unexpected findings. Medical Care 1982;20:286-292.
32. Cohen SJ, Christen AG, Katz BP, Drook CA, Davis BJ, Smith DM, Stookey GK. Counseling medical and dental patients about cigarette smoking: The impact of nicotine gum and chart reminders. American Journal of Public Health 1987;77: 313-316.
33. Cohen SJ, Weinberger M, Hui SL, Tierney WM, McDonald CJ. The impact of reading on physicians' nonadherence to recommended standards of medical care. Social Science and Medicine 1985;21:909-914.
34. Cowan JA. Effect of a fact sheet reminder on performance of the periodic health examination: A randomized controlled trial. American Journal of Preventive Medicine 1992;8:104-109.
35. Cummings SR, Coates TJ, Richard RJ, Hansen B, Zahnd EG, VanderMartin R, Duncan C, Gerbert B, Martin A, Stein MJ. Training physicians in counselling about smoking cessation: A randomized trial of the "Quit for Life" program. Annals of Internal Medicine 1989;110:640-647.
36. Cummings SR, Richard RJ, Duncan CL, Hansen B, VanderMartin R, Gerbert B, Coates TJ. Training physicians about smoking cessation: A controlled trial in private practice. Journal of General Internal Medicine 1989;4(6):482-489.
37. Davidoff F, Goodspeed R, Clive J. Changing test ordering behavior A randomized controlled trial comparing probabilistic reasoning with cost-containment education. Medical Care 1989;27:45-58.
38. Dickinson JC. Improving hypertension control: Impact of computer feedback and physician education. Medical Care 1981;19:843-854.
39. Dietrich AJ. Cancer: Improving early detection and prevention. A community practice randomised trial. British Medical Journal 1992;304:687-691.
40. Evans CE, Haynes RB, Birkett NJ, Gilbert JR, Taylor DW, Sackett DL, Johnstone ME, Hewson SA. Does a mailed continuing education program improve physician performance? Results of a randomized trial in hypertensive care. Journal of the American Medical Association 1986;255:501-504.
41. Everett GD, deBlois CS, Chang P, Holets T. Effect of cost education, cost audits, and faculty chart review on the use of laboratory services. Archives of Internal Medicine 1983;143:942-944.
42. Gehlbach SH, Wilkinson WE, Hammond WE, Clapp NE, Finn AL, Taylor WJ, Rodell MS. Improving drug prescribing in a primary care practice. Medical Care 1984;22:193-201.
43. Gullion DS, Tschann JM, Adamson TE, Coates TJ. Management of hypertension in private practice: A randomized controlled trial in continuing medical education. Journal of Continuing Education for Health Professions 1988;8:239-255.
44. Headrick LA. Efforts to improve compliance with the National Cholesterol Education Program guidelines. Results of a randomized controlled trial. Archives of Internal Medicine 1992;152:2490-2496.
45. Heale J, Davis DA, Norman GR, Woodward C, Neufeld VR, Dodd P. A randomized controlled trial assessing the impact of problem based versus didactic teaching methods in CME. RIME Proceedings 1988;27:72-77.
46. Hershey CO, Goldberg HI, Cohen DI. The effect of computerized feedback coupled with a newsletter upon outpatient prescribing changes. Medical Care 1988;26:88-93.
47. Hershey CO, Porter DK, Breslau D, Cohen DI. Influence of simple computerized feedback on prescription charges in an ambulatory clinic. Medical Care 1986;24:472-481.
48. Jennett PA, Laxdal OE, Hayton RC, Klanssen DJ, Swanson RW, Wilson JW, Spooner RW, Mainprize GW, Wickett RE. The effects of continuing medical education on family doctor performance in office practice: A randomized control study. Medical Education 1988;22:139-145.
49. Kottke TE, Brekke ML, Solberg LI, Hughes JR. A randomized trial to increase smoking intervention by physicians. Doctors helping smokers, round 1. Journal of the American Medical Association 1989;261:2101-2106.
50. Levinson W. The effects of two continuing medical education programs on communication skills of practicing primary care physicians. Journal of General Internal Medicine 1993;8:318-324.
51. Linn BS. Continuing Medical Education: Impact on emergency room bum care. Journal of the American Medical Association 1980;244:565-570.
52. Litzelman DK, Dittus RS, Miller ME, Tierney WM. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. Journal of General Internal Medicine 1993;8:311-317.
53. Lomas J, Enkin M, Andersen GM, Hannah WJ, Vayda E, Singer J. Opinion leaders vs. audit and feedback to implement practice guidelines. Delivery after previous cesarean section. Journal of the American Medical Association 1991;265:2202-2207.
54. Magruder-Habib K, Zung WWK, Feussner JR. Improving physicians' recognition and treatment of depression in general medical care: Result from a randomized clinical trial. Medical Care 1990;28:239-250.
55. Maiman LA, Becker H, Liptak GS, Nazarian LF, Rounds KA. Improving pediatricians' compliance-enhancing practices. American Journal of Diseases of Children 1988;142:773-779.
56. Manheim LM, Feinglass J, Hughes R, Martin GJ, Conrad K, Hughes EF. Training house officers to be cost conscious. Effects of an educational intervention on changes and length of stay. Medical Care 1990;28:29-42.
57. Martin HR. A trial of two strategies to modify the test-ordering behavior of medical residents. New England Journal of Medicine 1980;303:1330-1336.
58. Marton KI, Tul V, Sox HC. Modifying test-ordering behavior in the outpatient medical clinic. Archives of Internal Medicine 1985;145:816-821.
59. Mayefsky JH, Foye HR. Use of a chart audit: Teaching well child care to paediatric house officers. Medical Education 1993;27:170-174.
60. Mazzuca SA, Vinicor F, Einterz RM, Tierney WM, Norton JA, Kalasinski LA. Effects of the clinical environment on physicians' response to postgraduate medical education. American Education and Research Journal 1990;27:473-488.
61. McAlister NH, Covvey HD, Tong C, Lee A, Wigle ED. Randomised controlled trial of computer assisted management of hypertension in primary care. British Medical Journal (Clinical Research Education) 1986;293:670-674.
62. McConnell TS, Cushing AH, Bankhurst AD, Healy JL, Mcllvenna PA, Skipper BJ. Physician behavior modification using claims data: Tetracycline for upper respiratory infection. Western Journal of Medicine 1982;137:448-450.
63. McDonald CJ. Use of a computer to detect and respond to clinical events: Its effect on clinician behavior. Annals of Internal Medicine 1976;84:162-167.
64. McDonald CJ. Protocol-based computer reminders, the quality of care and the non perfectibility of man. New England Journal of Medicine 1976;295: 1351-1355.
65. McDonald CJ, Hui SL, Smith DM, Tierney WM, Cohen SJ, Weinberger M, McCabe GP. Reminders to physicians from an introspective computer medical record. Annals of Internal Medicine 1984;100:130-138.
66. McDonald CJ, Wilson GA, McCabe GP. Physician response to computer reminders. Journal of the American Medical Association 1980;244:1579-1581.
67. McDowell I, Newell C, Rosser W. Computerized reminders to encourage cervical screening in family practice. Journal of Family Practice 1989;28:420-424.
68. McPhee SJ, Bird JA, Fordham D, Rodnick JE, Osborn EH. Promoting cancer prevention activities by primary care physicians. Journal of the American Medical Association 1991;266:538-544.
69. McPhee SJ, Bird JA, Jenkins CN, Fordham D. Promoting cancer screening. A randomized, controlled trial of three interventions. Archives of Internal Medicine 1989;149:1866-1872.
70. Meyer TJ, Van Kooten D, Marsh S, Prochazka AV. Reduction of polypharmacy by feedback to clinicians. Journal of General Internal Medicine 1991;6:133-135.
71. Morgan M. Computerized concurrent review of prenatal care. Quality Review Bulletin 1978;4:33-36.
72. Norton PG, Dempsey LJ. Self-audit: Its effect on quality of care. Journal of Family Practice 1985;21:289-291.
73. Palmer RH, Louis TA, Hsu L, Peterson HF, Rothrock JK, Strain R, Thompson MS, Wright EA. A randomized controlled trial of quality assurance in sixteen ambulatory care practices. Medical Care 1985;23:751-770.
74. Perera DR, LoGerfo JP, Shulenberger E, Ylvisaker JT, Kirz HL. Teaching sigmoidoscopy to primary care physicians: A controlled study of continuing medical education. Journal of Family Practice 1983;16:785-788.
75. Pierce M, Lundy S, Palanisamy A, Winning S, King J. Prospective randomised controlled trial of methods of call and recall for cervical cytology screening. British Medical Journal 1989;299:160-162.
76. Pinkerton RE. Resident physician performance in a continuing education format: Does newly acquired information improve patient care? Journal of the American Medical Association 1980;244:2183-2185.
77. Pollack MM, Getson PR. Pediatric critical care cost containment: Combined actuarial and clinical program. Critical Care Medicine 1991;19:12-20.
78. Prozen MW, D'Agostino RB, Mitchell JB, Rosenfeld DM, Guglielmino JT, Schwartz ML, Teebagy N, Valentine JM, Wood WB, Jr. The usefulness of a predictive instrument to reduce inappropriate admissions to the coronary care unit. Annals of Internal Medicine 1980;92:238-242.
79. Pozen MW, D'Agostino RB, Selker HP, Sytkowski PA, Hood WB, Jr. A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. A prospective multicenter clinical trial. New England Journal of Medicine 1984;310:1273-1278.
80. Pugh JA, Frazier LM, DeLong E, Wallace AG, Ellenbogen P, Linfors E. Effect of daily charge feedback on inpatient charges and physician knowledge and behavior. Archives of Internal Medicine 1989;149:426-429.
81. Putnam RW, Curry L. Impact of patient care appraisal on physician behaviour in the office setting. Canadian Medical Association Journal 1985;132:1025-1029.
82. Putnam RW, Curry L. Physicians' participation in establishing criteria for hypertension management in the office: Will patient outcomes be improved? Canadian Medical Association Journal 1989;140:806-809.
83. Rabin DL, Boekeloo BO, Marx ES, Bowman MA, Russell NK, Willis AG. Improving office-based physician's prevention practices for sexually transmitted diseases. Annals of Internal Medicine 1994;121:513-519.
84. Raisch DW, Bootman JL, Larson LN, McGhan WF. Improving antinuclear agent prescribing in a health maintenance organization. American Journal of Hospital Pharmacy 1990;47:1766-1773.
85. Restuccia JD. The effect of concurrent feedback in reducing inappropriate hospital utilization. Medical Care 1982;20:46-62.
86. Rogers JL. Medical information systems: Assessing impact in areas of hypertension, obesity, and renal disease. Medical Care 1982;20:63-74.
87. Rosser WW, McDowell I, Newell C. Use of reminders for preventive procedures in family medicine. Canadian Medical Association Journal 1991;145:807-814.
88. Rubenstein LV, Calkins DR, Young RT, Cleary PD, Fink A, Kosecoff J, Jette AM, Davies AR, Delbanco TL, Brook RH. Improving patient function: A randomized trial of functional disability screening. Annals of Internal Medicine 1989;111:836-842.
89. Sanazaro PJ. Concurrent quality assurance in hospital care. Report of a study in private initiative in PSRO. New England Journal of Medicine 1978;298:1171-1177.
90. Sibley JC, Sackett DL, Neufeld V, Gerrard B, Rudnick KV, Fraser W. A randomized trial of continuing medical education. New England Journal of Medicine 1982; 306:511-515.
91. Soumerai SB. A controlled trial of educational outreach to improve blood transfusion practice. Journal of the American Medical Association 1993;270:961-966.
92. Steele MA, Bess DT, Franse VL, Graber SE. Cost effectiveness of two interventions for reducing outpatient prescribing costs. DICP-Annals of Pharmacotherapy 1989; 23:497-500.
93. Stross JK. Evaluation of a continuing education program in rheumatoid arthritis. Arthritis and Rheumatism 1980;23:846-849.
94. Stross JK, Bole GG. Evaluation of an educational program for primary care practitioners, on the management of osteoarthritis. Arthritis and Rheumatism 1985; 28:108-111.
95. Stross JK, Hiss RG, Watts CM, Davis WK, MacDonald R. Continuing education in pulmonary disease for primary-care physicians. American Review of Respiratory Diseases 1983;127:739-746.
96. Sulmasy DP, Geller G, Faden R, Levine DM. The quality of mercy: Caring for patients with 'do not resuscitate' orders. Journal of the American Medical Association 1992;267:682-686.
97. Szczepura A, Wilmot J, Davies C, Fletcher J. Effectiveness and cost of different strategies for information feedback in general practice. British Journal of General Practice 1994;44:19-24.
98. Tape TG, Campbell JR. Computerized medical records and preventive health care: Success depends on many factors. American Journal of Medicine 1993;94:619-625.
99. Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Medical Care 1986;24: 659-666.
100. Tierney WM, McDonald CJ, Hui SL, Martin DK. Computer predictions of abnormal test results: Effects on outpatient testing. Journal of the American Medical Association 1988;259:1194-1198.
101. Tierney WM, Miller ME, McDonald CJ. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. New England Journal of Medicine 1990;322:1499-1504.
102. Turner RC, Waivers LE, O'Brien K. The effect of patient-carried reminder cards on the performance of health maintenance measures. Archives of Internal Medicine 1990;150:645-647.
103. Vinicor F, Cohen SJ, Mazzuca SA, Moorman N, Wheeler M, Kuebler T, Swanson S, Ours P, Fineberg SE, Gordon EE, et al. Diabeds: A randomized trial of the effects of physician and/or patient education on diabetes patient outcomes. Journal of Chronic Disease 1987;40:345-356.
104. Weingarten MA, Bazel D, Shannon HS. Computerized protocol for preventive medicine: A controlled self-audit in family practice. Family Practice 1989;6: 120-124.
105. Wexler JR. Impact of a system of computer-assisted diagnosis. American Journal of Diseases of Childhood 1975;129:203-205.
106. White CW, Albanese MA, Brown DD, Caplan RM. The effectiveness of continuing medical education in changing the behaviour of physicians caring for patients with acute myocardial infarction. Annals of Internal Medicine 1985; 102:686-692.
107. White PT, Pharoah CA, Anderson HR, Freeling P. Randomized controlled trial of small group education on the outcome of chronic asthma in general practice. Journal of the Royal College of General Practice 1989;39:182-186.
108. Wigton RS, Zimmer JL, Wigton JH, Patil KD. Chart reminders in the diagnosis of anemia. Journal of the American Medical Association 1981;245:1745-1747.
109. Wilson DM, Taylor W, Gilbert JR, Best JA, Lindsay EA, Willms DG, Singer J. A randomized trial of a family physician intervention for smoking cessation. Journal of the American Medical Association 1988;260:1570-1574.
110. Winickoff RN, Coltin KL, Morgan MM, Buxbaum RC, Barnett GO. Improving physician performance through peer comparison feedback. Medical Care 1984; 22:527-534.
111. Winickoff RN, Wilner S, Neisuler R, Bamett GO. Limitation of provider interventions in hypertension quality assurance. American Journal of Public Health 1985; 75:43-46.
112. Wones RG. Failure of low-cost audits with feedback to reduce laboratory test utilization. Medical Care 1987;25:78-82.
113. American Medical Association. Physician characteristics and distribution in the U.S.A., Chicago, January 1, 1995.
114. Green L, Kreuter M, Deeds S, Partridge K. Health education planning: A diagnostic approach, Palo Alto, CA: Mayfield Press, 1980.
115. Rogers EM. Diffusion of innovation, New York: The Free Press, 1983.
116. Nowlen PM. A new approach to continuing education for business and the professions, New York: Macmillan, 1988.
117. Bandura A. Social foundations of thought and action: A social cognitive theory, Englewood Cliffs, NJ: Prentice-Hall, 1986.
118. Thomson MA, Freemantle N, Wolf F, Davis DA, Oxman Associate Dean. Educational meetings, workshops and preceptorships to improve the practice of health professionals and health care outcomes. [Review for the] Cochrane Collaboration on Effective Professional Practice (CCEPP), 1997.
119. Fox RD, Mazmanian PE, Putnam RW. Changing and learning in the lives of physicians, New York: Praeger, 1989.
120. Prochaska JO, Velicer WF, Rossi JS, Goldstein MG, Marcus BH, Rakowski W, Fiore C, Harlow LL, Redding CA, Rosenbloom D, Rossi SR. Stages of change and decisional balance for 12 problem behaviors. Health Psychology 1994; 13:39-46.
121. American Medical Association. The CME Directory. Chicago, IL: AMA Publication, 1994.