Achieving desired results and improved outcomes: Integrating planning and assessment throughout learning activities

Journal of Continuing Education in the Health Professions

Volumn 29, Issue 1, 2009, Pages 1-15

  Moore, Donald E ^a   Green, Joseph S ^b   Gallis, Harry A ^c  

^a VANDERBILT UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b AMERICAN COLLEGE OF CARDIOLOGY   (United States)

^c LEVINE CANCER INSTITUTE   (United States)

Author keywords

Assessing; Continuing; Education; Formative assessment; Medical; Physician competence; Physician learning; Physician performance; Planning

Indexed keywords

CLINICAL COMPETENCE; HEALTH CARE QUALITY; MEDICAL EDUCATION; ORGANIZATION AND MANAGEMENT; PHYSICIAN ATTITUDE; REVIEW; TREATMENT OUTCOME; UNITED STATES;

CLINICAL COMPETENCE; EDUCATION, MEDICAL, CONTINUING; PHYSICIAN'S ROLE; QUALITY ASSURANCE, HEALTH CARE; TREATMENT OUTCOME; UNITED STATES;

EID: 67249157455     PISSN: 08941912     EISSN: 1554558X     Source Type: Journal    
DOI: 10.1002/chp.20001     Document Type: Review

References (80)

1. Miller SH, Thompson JN, Mazmanian PE, et al. Continuing medical education, professional development, and requirements for medical licensure: a white paper of the Conjoint Committee on CME. J Contin Educ Health Prof. 2008;28 (2):95-98.
2. Berwick DM. Continuous improvement as an ideal in health care. N Engl J Med. 1989;320(1):53-56.
3. Greiner AC, Knebel E, eds. Health Professions Education: A Bridge to Quality. Washington DC: National Academy Press; 2003.
4. Kohn LT, Corrigan JM, Donaldson MS. To Err Is Human: Building a Safer Health System. Washington DC: National Academy Press; 1991.
5. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington DC: National Academy Press; 2001.
6. McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348 (26): 2635-2645.
7. Leape LL, Berwick DM. Five years after To Err Is Human: what have we learned? JAMA. 2005;293 (19):2384-2390.
8. Miller SH. American Board of Medical Specialties and repositioning for excellence in lifelong learning: maintenance of certification. J Contin Educ Health Prof. 2005;25 (3):151-156.
9. Assuring the ongoing competence of licensed physicians. Federation of State Medical Boards Web site. http://www.fsmb.org/pdf/bd_rpt_08-03_assuring_ongoing_competence_of_licensed_physicians_2008.pdf. Board Report 08-3. Accessed December 17, 2008.
10. Whittemore AD, Keenan M, Mihalich J, Watts B. Guidelines for Competency-Based Hospital Credentialing. Boston, MA: Massachusetts Board of Registration in Medicine; 2008.
11. Moore DE Jr, Green JS, Jay SJ, Leist JC, Maitland FM. Creating a new paradigm for CME: seizing opportunities within the health care revolution. J Contin Educ Health Prof. 1994;14 (1):4-31.
12. ACCME Essential Areas and Policies. Accreditation Council for CME Web site. http://www.accme.org. Accessed December 17, 2008.
13. Marinopoulos SS, Dorman T, Ratanawongsa N, et al. Effectiveness of Continuing Medical Education. Rockville, MD: Agency for Healthcare Research and Quality; 2007. Evidence Report/Technology Assessment 149. AHRQ Publication No. 07-E006.
14. Fox RD, Mazmanian PE, Putnam RW. Changing and Learning in the Lives of Physicians. New York, NY: Praeger; 1989.
15. Davis DA, Thomson MA, Oxman AD, Haynes RB. Changing physician performance. Asystematic review of the effect of continuing medical education strategies. JAMA. 1995;274 (9):700-705.
16. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006; 296 (9):1094-1102.
17. Grimshaw JM, Shirran L, Thomas R, et al. Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001;39 (8) (suppl 2):II2- 45.
18. Mann KV, Lindsay EA, Putnam RW, Davis DA. Increasing physician involvement in cholesterol-lowering practices: the role of knowledge, attitudes and perceptions. Adv Health Sci Educ Theory Pract. 1997; 2 (3):237-253.
19. Grimshaw JM, Thomas RE, MacLennan G, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8 (6):iii-iv, 1-72.
20. Moore DE Jr. A framework for outcomes evaluation in the continuing professional development of physicians. In: Davis D, Barnes BE, Fox R, eds. The Continuing Professional Development of Physicians: From Research to Practice. Chicago, IL: American Medical Association Press; 2003:249-274.
21. Kirkpatrick D. Evaluating Training Programs: The Four Levels. 2nd ed. San Francisco, CA: Berrett-Koehler; 1998.
22. Havens C, Bellman P, Jayachandron K, Waters S. Measuring higher level outcomes. Alliance for CME Almanac. 2005;27 (10):1-4.
23. Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65 (9) (suppl):S63-S67.
24. Senior JR. Toward the Measurement of Competence in Medicine. Philadelphia, PA: National Board of Medical Examiners; 1976.
25. Kolb DA. Experiential Learning: Experience as the Source of Learning and Development. Englewood Cliffs, NJ: Prentice-Hall; 1984.
26. Kern DE, Thomas PA, Howard DM, Bass EB. Curriculum Development for Medical Education: A Six-Step Approach. Baltimore, MD: Johns Hopkins University Press; 1998.
27. Caffarella RS. Planning Programs for Adult Learners. 2nd ed. San Francisco, CA: Jossey-Bass; 2002.
28. Handfield-Jones RS, Mann KV, Challis ME, et al. Linking assessment to learning: a new route to quality assurance in medical practice. Med Educ. 2002;36 (10):949-958.
29. Slotnick HB. How doctors learn: physicians' self-directed learning episodes. Acad Med. 1999;74 (10):1106-1117.
30. Geertsma RH, Parker RC, Jr., Whitbourne SK. How physicians view the process of change in their practice behavior. J Med Educ. 1982;57 (10): 752-761.
31. Means RP. How family physicians use information sources. In: Green JS, Grosswald SJ, Suter E, Walthall DB, eds. Continuing Education for the Health Professions. San Francisco, CA: Jossey-Bass; 1984:72-86.
32. Garcia R, Newsom R. Learning and change among emergency physicians. J Contin Educ Health Prof. 1996;16 (1):33-41.
33. Putnam RW, Campbell D. Competence. In: Fox RD, Mazmanian PE, Putnam RW, eds. Changing and Learning in the Lives of Physicians. New York, NY: Praeger; 1989:29-97.
34. Schön D. The Reflective Practitioner: How Professionals Think in Action. New York, NY: Basic Books; 1983:21-73.
35. Pathman DE, Konrad TR, Freed GL, Freeman VA, Koch GG. The awareness-to-adherence model of the steps to clinical guideline compliance: the case of pediatric vaccine recommendations. Med Care. 1996; 34 (9):873-889.
36. Moore DE Jr. How physicians learn and how to design learning experiences for them: an approach based on an interpretive review of the evidence. In: Hager M, Russell S, Fletcher S, eds. Continuing Education in the Health Professions: Improving Healthcare through Lifelong Learning, Proceedings of a Conference Sponsored by the Josiah Macy Jr. Foundation. New York, NY: Josiah Macy Foundation; 2008:30-62.
37. Green LW, Kreuter MW. Health Promotion Planning: An Educational and Environmental Approach. Mountain View, CA: Mayfield Publishing Co; 1991:151-177.
38. Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. JAMA. 1992;268 (9):1111-1117.
39. Cantillon P, Jones R. Does continuing medical education in general practice make a difference? BMJ. 1999;318 (7193):1276-1279.
40. White MI. Toward an Evidence-Informed, Theory-Driven Model for Continuing Medical Education [dissertation]. Vancouver, Canada: The University of British Columbia; 2003.
41. Wiggins G, McTighe J. Understanding by Design. Alexandria, VA: Association for Supervision and Curriculum Design; 2005.
42. Scriven M. The Methodology of Evaluation. Washington DC: American Educational Research Association; 1967.
43. Moore DE Jr. Needs assessment in the new health care environment: combining discrepancy analysis and outcomes to create more effective CME. J Contin Educ Health Prof. 1998;18 (3):133-141.
44. Moore DE, Cervero RM, Fox RD. A conceptual model of CME to address disparities in depression care. J Contin Educ Health Prof. 2007;27 (suppl 1):S40-S54.
45. Eisenberg JM. Doctors' Decisions and the Cost of Medical Care. Ann Arbor, MI: Health Administration Press; 1986.
46. Greco PJ, Eisenberg JM. Changing physicians' practices. N Engl J Med. 1993;329 (17):1271-1275.
47. Merrill MD. Instructional Design Theory. Englewood Cliffs, NJ: Educational Technology Publications; 1994.
48. Bennett NL, Fox RD, Davis DA. Feedback and reminders: tools for change in the practice setting. In: Davis DA, Barnes BE, Fox RD, eds. The Continuing Professional Development of Physicians: From Research to Practice. Chicago, IL: AMA Press; 2003:221-240.
49. Mazmanian PE, Daffron SR, Johnson RE, Davis DA, Kantrowitz MP. Information about barriers to planned change: a randomized controlled trial involving continuing medical education lectures and commitment to change. Acad Med. 1998;73 (8):882-886.
50. Ende J. Feedback in clinical medical education. JAMA. 1983;250 (6): 777-781.
51. Hewson MG, Little ML. Giving feedback in medical education: verification of recommended techniques. J Gen Intern Med. 1998;13 (2): 111-116.
52. Slotnick HB, Harris TR, Antonenko DR. Changes in learning-resource use across physicians' learning episodes. Bull Med Libr Assoc. 2001; 89 (2):194-203.
53. Janssen-Noordman AM, Merrienboer JJ, van der Vleuten CP, Scherpbier AJ. Design of integrated practice for learning professional competences. Med Teach. 2006;28 (5):447-452.
54. Haidet P, Morgan RO, O'Malley KO, Moran BJ, Richards BF. A controlled trial of active versus passive learning strategies in a large group setting. Adv Health Sci Educ. 2004;9 (1):15-27.
55. Mazmanian PE, Davis DA. Continuing medical education and the physician as a learner: guide to the evidence. JAMA. 2002;288 (9):1057-1060.
56. Schmidt HG. Foundations of problem-based learning: some explanatory notes. Med Educ. 1993;27:422-432.
57. Craig JL. The OSCME (Opportunity for self-assessment CME). J Contin Educ Health Prof. 1991;11 (1):87-94.
58. Knowles MS. The Modern Practice of Adult Education: From Pedagogy to Andragogy. New York, NY: Cambridge Books; 1980.
59. Wakefield J. Commitment to change: exploring its role in changing physician behavior through continuing education. J Contin Educ Health Prof. 2004;24 (4):197-204.
60. Mazmanian PE, Mazmanian PM. Commitment to change: theoretical foundations, methods, and outcomes. J Contin Educ Health Prof. 2002; 19 (4):200-207.
61. Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000;283 (13):1715-1722.
62. Peabody JW, Luck J, Glassman P, et al. Measuring the quality of physician practice by using clinical vignettes: a prospective validation study. Ann Intern Med. 2004;141 (10):771-780.
63. Blandford L, Lockyer J. Audience response systems and touch pad technology: their role in CME. J Contin Educ Health Prof. 1995;15 (1): 52-57.
64. Miller RG, Ashar BH, Getz KJ. Evaluation of an audience response system for continuing education of health professionals. J Contin Educ Health Prof. 2003;23 (2):109-115.
65. Herbert CP, Wright JM, Maclure M, et al. Better prescribing project: a randomized controlled trial of the impact of case-based educational modules and personal prescribing feedback on prescribing for hypertension in primary care. Fam Pract. 2004;21 (5):575-581.
66. Aedet L, Altshuler L, Kachur E, et al. The " Culture OSCE" introducing a formative assessment into a postgraduate program. Educ Health (Abingdon). 2007;20 (1):11.
67. Rethans JJ, Gorter S, Bokken L, Morrison L. Unannounced standardised patients in real practice: a systematic literature review. Med Educ. 2007;41 (6):537-549.
68. Norcini JJ. Current perspectives in assessment: the assessment of performance at work. Med Educ. 2005;39 (9):880-889.
69. Buse JB, Bigger JT, Byington RP, et al. Action to control cardiovascular risk in diabetes (ACCORD) trial: design and methods. Am J Cardiol. 2007;99 (12A):21i-33i.
70. Iezzoni L. Assessing quality using administrative data. Ann Int Med. 1997;127 (8, pt 2):666-674.
71. Garratt AM, Schmidt L, Fitzpatrick R. Patient-assessed health outcome measures for diabetes: a structured review. Diabet Med. 2002;19 (1):1-11.
72. Bradley C. Importance of differentiating health status from quality of life. Lancet. 2001;357 (9249):7-8.
73. Wasserman J, Boyce-Smith G, Hopkins DS, et al. A comparison of diabetes patients' self-reported health status with hemoglobin A1c test results in 11 California health plans. Manag Care. 2001;10 (3):58-62, 65-58, 70.
74. Rethans JJ, Norcini JJ, Baron-Maldonado M, et al. The relationship between competence and performance: implications for assessing practice performance. Med Educ. 2002;36 (10):901-909.
75. Jennett PA, Sinclair LB, Harrison RV. Methods, tools, and techniques of evaluation. In: Davis D, Barnes BE, Fox RD, eds. The Continuing Professional Development of Physicians: From Research to Practice. Chicago, IL: American Medical Association Press; 2003:275-316.
76. Hays RB, Davies HA, Beard JD, et al. Selecting performance assessment methods for experienced physicians. Med Educ. 2002;36 (10): 910-917.
77. van der Vleuten CP, Schuwirth LW. Assessing professional competence: from methods to programmes. Med Educ. 2005;39 (3):309-317.
78. van der Vleuten CPM. The assessment of professional competence: developments, research, and practical applications. Adv Health Sci Educ. 1996;1:41-67.
79. Competencies of the ACGME Outcomes Project. Accreditation Council for Graduate Medical Education Web site. http://www.acgme.org/outcome/comp/compHome.asp. Accessed December 17, 2008.
80. Mattessich PW, Murray-Close M, Monsey BR. Collaboration: What Makes it Work. St. Paul, MN: Amherst M. Wilden Foundation; 2001.