American Board of Medical Specialties Maintenance of Certification: Theory and Evidence Regarding the Current Framework

Journal of Continuing Education in the Health Professions

Volumn 33, Issue S1, 2013, Pages

  Hawkins, Richard E ^a   Lipner, Rebecca S ^b   Ham, Hazen P ^c   Wagner, Robin ^d   Holmboe, Eric S ^b  

^a AMERICAN MEDICAL ASSOCIATION   (United States)

^b AMERICAN BOARD OF INTERNAL MEDICINE   (United States)

^c AMERICAN BOARD OF PEDIATRICS   (United States)

^d Accreditation Council for Graduate Medical Education   (United States)

Author keywords

Maintenance of certification; Profession physicians; Program planning curriculum development

Indexed keywords

CERTIFICATION; CLINICAL COMPETENCE; DOCTOR PATIENT RELATION; HUMAN; INTERPERSONAL COMMUNICATION; MEDICAL EDUCATION; PEER REVIEW; PROCEDURES; SELF EVALUATION; STANDARDS; TOTAL QUALITY MANAGEMENT; TRENDS; UNITED STATES;

CERTIFICATION; CLINICAL COMPETENCE; COMMUNICATION; EDUCATION, MEDICAL, CONTINUING; EDUCATION, MEDICAL, GRADUATE; HUMANS; PEER REVIEW, HEALTH CARE; PHYSICIAN-PATIENT RELATIONS; QUALITY IMPROVEMENT; SELF-ASSESSMENT; SPECIALTY BOARDS; UNITED STATES;

EID: 84890515079     PISSN: 08941912     EISSN: 1554558X     Source Type: Journal    
DOI: 10.1002/chp.21201     Document Type: Article

References (150)

1. ABMS Maintenance of Certification. http://www.abms.org/Maintenance_of_Certification/ABMS_MOC.aspx. Accessed July 25, 2012.
2. Iglehart JK, Baron RB. Ensuring physicians' competence: is maintenance of certification the answer? N Engl J Med. 2012;376:2543-2549.
3. Drazen JM, Weinstein DF. Considering recertification. N Engl J Med. 2010;362:946-947.
4. Levinson W, King TE Jr, Goldman L, Goroll AH, Kessler B. American Board of Internal Medicine maintenance of certification program. N Engl J Med. 2010;362:948-952.
5. Kane M. Validating the interpretations and uses of test scores. In Lissitz R, ed. The Concept of Validity: Revisions, New Directions, and Applications. Charlotte, NC: Information Age Publishing Inc.; 2009.
6. Leape LL, Fromson JA. Problem doctors: is there a system-level solution? Ann Intern Med. 2006;144:107-115.
7. Williams BW. The prevalence and special educational requirements of dyscompetent physicians. J Contin Educ Health Prof. 2006:26:173-191.
8. Hawkins R, Roemheld-Hamm B, Ciccone A, Mee J, Tallia A. A multimethod study of needs for physician assessment: implications for education and regulation. J Contin EducHealth Prof. 2009;29(4):220-234.
9. McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348(26):2635-2645.
10. National Healthcare Quality Report 2012. AHRQ Publication No. 3-0002. U.S. Department of Health and Human Services. May 2013, www.ahrg.gov/research/findings/nhqrdr/index.html
11. Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med. 2005;142(4):260-273.
12. Khaliq AA, Dimassi H, Huang CY, Narine L, Smego RA. Disciplinary action against physicians: who is likely to get discipline? Am J Med. 2005;118:773-777.
13. Kohatsu ND, Gould D, Ross LK, Fox FJ. Characteristics associated with physician discipline: a case-control study. Arch Intern Med. 2004;164:653-658.
14. Eva KW, Regehr G. "I'll never play professional footbal" and other fallacies of self-assessment. J Contin Educ Health Prof. 2008;28(1):14-19.
15. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296(9):1094-1102.
16. Adams RJ, Smith BJ, Ruffin RE. Impact of the physician's participatory style in asthma outcomes and patient satisfaction. Ann Allergy Asthma Immunol. 2001;86(3):263-271.
17. Heisler M, Bouknight RR, Hayward RA, Smith DM, Kerr EA. The relative importance of physician communication, participatory decision making, and patient understanding in diabetes self-management. J Gen Intern Med. 2002;17(4):243-252.
18. Heisler M, Cole I, Weir D, Kerr EA, Hayward RA. Does physician communication influence older patients' diabetes self-management and glycemic control? Results from the Health and Retirement Study (HRS). J Gerontol. 2007;62(62):1435-1442.
19. Kim SS, Kaplowitz S, Johnston MV. The effects of physician empathy on patient satisfaction and compliance. Eval Health Prof. 2004;27(3):237-251.
20. Kaplan SH, Greenfield S, Ware JE Jr. Assessing the effects of physician-patient interactions on the outcomes of chronic disease. Med Care. 1989;27(3)(suppl):S110-S127.
21. Stewart M, Brown JB, Donner A, et al. The impact of patient-centered care on outcomes. J Fam Pract. 2000;49(9):796-804.
22. Suchman AL, Roter D, Green M, Lipkin M Jr. Physician satisfaction with primary care office visits. Collaborative Study Group of the American Academy on Physician and Patient. Med Care. 1993;31(12):1083-1092.
23. Wilson IB, Schoen C, Neuman P, et al. Physician-patient communication about prescription medication nonadherence: a 50-state study of America's seniors. J Gen Intern Med. 2007;22(1):6-12.
24. Peterson MC, Holbrook JH, Von Hales D, Smith NL, Staker LV. Contributions of the history, physical examination, and laboratory investigation in making medical diagnoses. West J Med. 1992;156(2):163-165.
25. Beckman HB, Markakis KM, Suchman AL, Frankel RM. The doctor-patient relationship and malpractice. Lessons from plaintiff depositions. Arch Intern Med. 1994;154(154):1365-1370.
26. Ambady N, Laplante D, Nguyen T, Rosenthal R, Chaumeton N, Levinson W. Surgeons' tone of voice: a clue to malpractice history. Surgery. 2002;132(1):5-9.
27. Beckman HB, Frankel RM. The effect of physician behavior on the collection of data. Ann Intern Med. 1984;101(5):692-696.
28. Rhoades DR, McFarland KF, Finch WH, Johnson AO. Speaking and interruptions during primary care office visits. Fam Med. 2001;33(7):528-532.
29. Braddock CH 3rd, Edwards KA, Hasenberg NM, Laidley TL, Levinson W. Informed decision making in outpatient practice: time to get back to basics. JAMA. 1999;282(24):2313-2320.
30. Levinson W, Gorawara-Bhat R, Lamb J. A study of patient clues and physician responses in primary care and surgical settings. JAMA. 2000;284(8):1021-1027.
31. Easter DW, Beach W. Competent patient care is dependent upon attending to empathic opportunities presented during interview sessions. Curr Surg. 2004;61(3):313-318.
32. Eva KW, Norman GR. Heuristics and biases-a biased perspective on clinical reasoning. Med Educ. 2005;39(9):870-872.
33. Lipner RS, Blank LL, Leas BF, Fortna GS. The value of patient and peer ratings in recertification. Acad Med. 2002;77(10) (suppl):S64-S66.
34. Violato C, Marini A, Toews J, Lockyer J, Fidler H. Feasibility and psychometric properties of using peers, consulting physicians, co-workers, and patients to assess physicians. Acad Med. 1997;72(10)(suppl 1):S82-S84.
35. Violato C, Lockyer J, Fidler H. Multisource feedback: a method of assessing surgical practice. BMJ. 2003;326(7388):546-548.
36. Hall W, Violato C, Lewkonia R, et al. Assessment of physician performance in Alberta: the physician achievement review. CMAJ. 1999;161(1):52-57.
37. Sargeant J, Mann K, Sinclair D, van der Vleuten C, Metsemakers J. Challenges in multisource feedback: intended and unintended outcomes. Med Educ. 2007;41(6):583-591.
38. Lewin SA, Skea ZC, Entwistle V, Zwarenstein M, Dick J. Interventions for providers to promote a patient-centred approach in clinical consultations. Cochrane Database Syst Rev. 2001(4):CD003267.
39. Rao JK, Anderson LA, Inui TS, Frankel RM. Communication interventions make a difference in conversations between physicians and patients: a systematic review of the evidence. Med Care. 2007;45(4):340-349.
40. Reinders ME, Ryan BL, Blankenstein AH, van der Horst HE, Stewart MA, van Marwijk HW. The effect of patient feedback on physicians' consultation skills: a systematic review. Acad Med. 2011;86(11):1426-1436.
41. Levinson W, Roter D. The effects of two continuing medical education programs on communication skills of practicing primary care physicians. J Gen Intern Med. z 993;8(6):318-324.
42. Delvaux N, Merckaert I, Marchal S, et al. Physicians' communication with a cancer patient and a relative: a randomized study assessing the efficacy of consolidation workshops. Cancer. 2005;103(11):2397-2411.
43. Fellowes D, Wilkinson S, Moore P. Communication skills training for health care professionals working with cancer patients, their families and/or carers. Cochrane Database Syst Rev. 2004(2):CD003751.
44. Legare F, Ratte S, Stacey D, et al. Interventions for improving the adoption of shared decision making by healthcare professionals. Cochrane Database Syst Rev. 2010(5):CD006732.
45. Merckaert I, Libert Y, Delvaux N, et al. Factors that influence physicians' detection of distress in patients with cancer: can a communication skills training program improve physicians' detection? Cancer. 2005;104(2):411-421.
46. Ranmal R, Prictor M, Scott JT. Interventions for improving communication with children and adolescents about their cancer. Cochrane Database System Rev. 2008(4):CD002969.
47. Roter DL, Hall JA, Kern DE, Barker LR, Cole KA, Roca RP. Improving physicians' interviewing skills and reducing patients' emotional distress: a randomized clinical trial. Arch Intern Med. 1995;155(17):1877-1884.
48. Maly RC, Bourque LB, Engelhardt RF. A randomized controlled trial of facilitating information giving to patients with chronic medical conditions: effects on outcomes of care. J Fam Pract. 1999;48(5):356-363.
49. Bonvicini KA, Perlin MJ, Bylund CL, Carroll G, Rouse RA, Goldstein MG. Impact of communication training on physician expression of empathy in patient encounters. Patient Educ Couns. 2009;75(1):3-10.
50. Lockyer JM, Violato C, Fidler H. A multi source feedback program for anesthesiologists. Can J Anaesth. 2006;53(1):33-39.
51. Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP. Use of peer ratings to evaluate physician performance. JAMA. 1993;269(13):1655-1660.
52. Violato C, Lockyer JM, Fidler H. Assessment of pediatricians by a regulatory authority. Pediatrics. 2006;117(3):796-802.
53. Campbell EG, Regan S, Gruen RL, et al. Professionalism in medicine: results of a national survey of physicians. Ann Intern Med. 2007;147(11):795-802.
54. Violato C, Lockyer JM, Fidler H. Assessment of psychiatrists in practice through multisource feedback. Can J Psychiatry. 2008;53(8):525-533.
55. Lockyer JM, Violato C, Fidler H. The assessment of emergency physicians by a regulatory authority. Acad Emerg Med. 2006;13(12):1296-1303.
56. Lockyer JM, Violato C, Fidler H, Alakija P. The assessment of pathologists/laboratory medicine physicians through a multisource feedback tool. Arch Pathol Lab Med. 2009;133(8):1301-1308.
57. Violato C, Lockyer JM, Fidler H. Changes in performance: a 5-year longitudinal study of participants in a multi-source feedback programme. Med Educ. 2008;42(10):1007-1013.
58. Lockyer JM, Violato C. An examination of the appropriateness of using a common peer assessment instrument to assess physician skills across specialties. Acad Med. 2004;79(10)(suppl):S5-S8.
59. Fidler H, Lockyer JM, Toews J, Violato C. Changing physicians' practices: the effect of individual feedback. Acad Med. 1999;74(6):702-714.
60. Sargeant J, Mann K, Ferrier S. Exploring family physicians' reactions to multisource feedback: perceptions of credibility and usefulness. Med Educ. 2005;39(5):497-504.
61. Sargeant JM, Mann KV, Ferrier SN, et al. Responses of rural family physicians and their colleague and coworker raters to a multi-source feedback process: a pilot study. Acad Med. 2003;78(10)(suppl):S42-S44.
62. Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof. 2003;23(1):4-12.
63. Violato C, Lockyer J. Self and peer assessment of pediatricians, psychiatrists and medicine specialists: implications for self-directed learning. Adv Health Sci Educ Theory Pract. 2006;11(3):235-244.
64. Kruger J, Dunning D. Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. J Pers Soc Psychol. 1999;77(6):1121-1134.
65. Overeem K, Wollersheim H, Driessen E, et al. Doctors' perceptions of why 360-degree feedback does (not) work: a qualitative study. Med Educ. 2009;43(9):874-882.
66. Mazmanian PE, Davis DA. Continuing medical education and the physician as a learner: guide to the evidence. JAMA. 2002;288(9):1057-1060.
67. Marinopoulos SS, Dorman T, Ratanawongsa N, et al. Effectiveness of continuing medical education. Evid Rep Technol Assess. 2007(149):1-69.
68. Forsetlund L, Bjorndal A, Rashidian A, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009(2):CD003030.
69. Davis D, Galbraith R, American College of Chest Physicians H, Science Policy C. Continuing medical education effect on practice performance: effectiveness of continuing medical education: American College of Chest Physicians evidence-based educational guidelines. Chest. 2009;135(3)(suppl):42S-48S.
70. Davis DA, Thomson MA, Oxman AD, Haynes RB. Changing physician performance: a systematic review of the effect of continuing medical education strategies. JAMA. 1995;274(9):700-705.
71. Bowen JL. Educational strategies to promote clinical diagnostic reasoning. N Engl J Medicine. 2006;355(21):2217-2225.
72. Gruppen LD, Frohna, A.Z. Clinical Reasoning. International Handbook of Research in Medical Education. London, England: Kluwer Academic; 2002.
73. Koens F, Mann KV, Custers EJ, Ten Cate OT. Analysing the concept of context in medical education. Med Educ. 2005;39(12):1243-1249.
74. Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med. 2005;165(13):1493-1499.
75. Norman G. Research in clinical reasoning: past history and current trends. Med Educ. 2005;39(4):418-427.
76. Durning SJ, Artino AR, Holmboe E, Beckman TJ, van der Vleuten C, Schuwirth L. Aging and cognitive performance: challenges and implications for physicians practicing in the 21st century. J Contin Educ Health Prof. 2010;30(3):153-160.
77. Day SC, Norcini JJ, Webster GD, Viner ED, Chirico AM. The effect of changes in medical knowledge on examination performance at the time of recertification. Res Med Educ. 1988;27:138-144.
78. Brennan TA, Horwitz RI, Duffy FD, Cassel CK, Goode LD, Lipner RS. The role of physician specialty board certification status in the quality movement. JAMA. 2004;292(9):1038-1043.
79. Specialties ABoM. Facts about the 2008 ABMS consumer survey: how Americans choose their doctors. 2008; http://www.abms.org/News_and_Events/Media_Newsroom/pdf/ABMS_Survey_Fact_Sheet.pdf
80. Freed GL, Dunham KM, Clark SJ, Davis MM, Research Advisory Committee of the American Board of P. Perspectives and preferences among the general public regarding physician selection and board certification. J Pediatrics. 2010;156(5):841-845.
81. Norcini JJ, Shea JA, Benson JA, Jr. Changes in the medical knowledge of candidates for certification. Ann Intern Med. 1991;114(1):33-35.
82. Shea JN, Day, S.C., Webster, G.D., Benson JA Jr. Performance of US citizen Caribbean medical school graduates on the American Board of Internal Medicine certifying examinations, 1984-1987. Int J Teach Learning Med. 1989;1(1):10-15.
83. Norcini JJ, Shea JA, Webster GD, Benson JA Jr. Predictors of the performance of foreign medical graduates on the 1982 certifying examination in internal medicine. JAMA. 1986;256(24):3367-3370.
84. Steel K, Norcini J, Brummel-Smith K, Erwin D, Markson L. The first certifying examination in geriatric medicine. J Am Geriatr Soc. 1989;37(12):1188-1191.
85. Norcini JJ, Shea JA, Langdon LO, Hudson LD. First American Board of Internal Medicine critical care examination: process and results. Crit Care Med. 1989;17(7):695-698.
86. Norcini JJ. Indicators of the educational effectiveness of subspecialty training programs in internal medicine. Acad Med. 1995;70(6):512-516.
87. Jeffe DB, Andriole DA. Factors associated with American Board of Medical Specialties member board certification among US medical school graduates. JAMA. 2011;306(9):961-970.
88. Lipner R, Song H, Biester T, Rhodes R. Factors that influence general internists' and surgeons' performance on maintenance of certification exams. Acad Med. 2011;86(1):53-58.
89. Norcini JJ, Webster GD, Grosso LJ, Blank LL, Benson JA Jr., Ratings of residents' clinical competence and performance on certification examination. J Med Educ. 1987;62(6):457-462.
90. Norcini JJ, Maihoff NA, Day SC, Benson JA Jr. Trends in medical knowledge as assessed by the certifying examination in internal medicine. JAMA. 1989;262(17):2402-2404.
91. Shea JA, Norcini JJ, Kimball HR. Relationships of ratings of clinical competence and ABIM scores to certification status. Acad Med. 1993;68(10)(suppl):S22-24.
92. Norcini JJ, Grosso LJ, Shea JA, Webster GD. The relationship between features of residency training and ABIM certifying examination performance. J Gen Intern Med. 1987;2(5):330-336.
93. Norcini JJ Jr, Downing SM. The relationship between training program characteristics and scores on the cardiovascular disease certification examination. Acad Med. 1996;71(1)(suppl):S46-S48.
94. Boulet JR, Cooper RA, Seeling SS, Norcini JJ, McKinley DW. US citizens who obtain their medical degrees abroad: an overview, 1992-2006. Health Aff (Millwood). 2009;28(1):226-233.
95. Ramsey PG, Carline JD, Inui TS, Larson EB, LoGerfo JP, Wenrich MD. Predictive validity of certification by the American Board of Internal Medicine. Ann Intern Med. 1989;110(9):719-726.
96. Wenghofer E, Klass D, Abrahamowicz M, et al. Doctor scores on national qualifying examinations predict quality of care in future practice. Med Educ. 2009;43(12):1166-1173.
97. Norcini JJ, Lipner RS. The relationship between the nature of practice and performance on a cognitive examination. Acad Med. 2000;75(10)(suppl):S68-S70.
98. Norcini JJ, Lipner RS. Recertification: is there a link between take-home and proctored examinations? Acad Med. 1999;74(10)(suppl):S28-S30.
99. Papadakis MA, Arnold GK, Blank LL, Holmboe ES, Lipner RS. Performance during internal medicine residency training and subsequent disciplinary action by state licensing boards. Ann Intern Med. 2008;148(11):869-876.
100. Sharp LK, Bashook PG, Lipsky MS, Horowitz SD, Miller SH. Specialty board certification and clinical outcomes: the missing link. Acad Med. 2002;77(6):534-542.
101. Kelly JV, Hellinger FJ. Physician and hospital factors associated with mortality of surgical patients. Med Care. 1986;24(9):785-800.
102. Haas JS, Orav EJ, Goldman L. The relationship between physicians' qualifications and experience and the adequacy of prenatal care and low birthweight. Am J Public Health. 1995;85(8 Pt 1):1087-1091.
103. Norcini JJ, Kimball HR, Lipner RS. Certification and specialization: do they matter in the outcome of acute myocardial infarction? Acad Med. 2000;75(12):1193-1198.
104. Norcini J, Lipner R, Kimball H. The certification status of generalist physicians and the mortality of their patients after acute myocardial infarction. Acad Med. 2001;76(10)(suppl):S21-S23.
105. Norcini JJ, Lipner RS, Kimball HR. Certifying examination performance and patient outcomes following acute myocardial infarction. Med Educ. 2002;36(9):853-859.
106. Norcini JJ, Boulet JR, Dauphinee WD, Opalek A, Krantz ID, Anderson ST. Evaluating the quality of care provided by graduates of international medical schools. Health Aff. 2010;29(8):1461-1468.
107. Hanson KL, Butts GC, Friedman S, Fairbrother G. Physician credentials and practices associated with childhood immunization rates: private practice pediatricians serving poor children in New York City. J Urban Health. 2001;78(1):112-124.
108. Tamblyn R, Abrahamowicz M, Dauphinee WD, et al. Association between licensure examination scores and practice in primary care. JAMA. 2002;288(23):3019-3026.
109. Silber JH, Kennedy SK, Even-Shoshan O, et al. Anesthesiologist board certification and patient outcomes. Anesthesiology. 2002;96(5):1044-1052.
110. Prystowsky JB, Bordage G, Feinglass JM. Patient outcomes for segmental colon resection according to surgeon's training, certification, and experience. Surgery. 2002;132(4):663-670; discussion 670-662.
111. Masoudi FA, Gross CP, Wang Y, et al. Adoption of spironolactone therapy for older patients with heart failure and left ventricular systolic dysfunction in the United States, 1998-2001. Circulation. 2005;112(1):39-47.
112. Pham HH, Schrag D, Hargraves JL, Bach PB. Delivery of preventive services to older adults by primary care physicians. JAMA. 2005;294(4):473-481.
113. Chen J, Rathore SS, Wang Y, Radford MJ, Krumholz HM. Physician board certification and the care and outcomes of elderly patients with acute myocardial infarction. J Gen Intern Med. 2006;21(3):238-244.
114. Turchin A, Shubina M, Chodos AH, Einbinder JS, Pendergrass ML. Effect of board certification on antihypertensive treatment intensification in patients with diabetes mellitus. Circulation. 2008;117(5):623-628.
115. Holmboe ES, Wang Y, Meehan TP, et al. Association between maintenance of certification examination scores and quality of care for medicare beneficiaries. Arch Intern Med. 2008;168(13):1396-1403.
116. Holmboe ES, Weng W, Arnold GK, et al. The comprehensive care project: measuring physician performance in ambulatory practice. Health Serv Res. 2010;45(6 Pt 2):1912-1933.
117. Weng W, Hess, B., Lynn, L., Holmboe E., Lipner, R. Measuring physicians' performance in clinical practice: reliability, classification accuracy, and validity. Eval Health Prof. 2010;33:302-330.
118. Hess BJ, Weng W, Holmboe ES, Lipner RS. The association between physicians' cognitive skills and quality of diabetes care. Acad Med. 2012;87(2):157-163.
119. Hess BJ, Weng W, Lynn LA, Holmboe ES, Lipner RS. Setting a fair performance standard for physicians' quality of patient care. J Gen Intern Med. 2011;26(5):467-473.
120. Reid RO, Friedberg MW, Adams JL, McGlynn EA, Mehrotra A. Associations between physician characteristics and quality of care. Arch Intern Med. 2010;170(16):1442-1449.
121. Batalden PB, Davidoff F. What is "quality improvement" and how can it transform healthcare? Qual Saf Health Care. 2007;16(1):2-3.
122. Medicine Io. To Err Is Human: Building a Safer Health System. Washington, DC: National Academies Press; 2000.
123. Medicine Io. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001.
124. Nolte E, McKee M. Variations in amenable mortality-trends in 16 high-income nations. Health Policy. 2011;103(1):47-52.
125. Research AfHQa. National healthcare quality report, 2010. http://www.ahrq.gov/qual/qrdr10.htm. Accessed August 10, 2012.
126. Duffy FD, Lynn LA, Didura H, et al. Self-assessment of practice performance: development of the ABIM Practice Improvement Module (PIM). J Contin Educ Health Prof. 2008;28(1):38-46.
127. Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259.
128. Veloski J, Boex JR, Grasberger MJ, Evans A, Wolfson DB. Systematic review of the literature on assessment, feedback and physicians' clinical performance: BEME Guide No. 7. Med Teach. 2006;28(2):117-128.
129. Sargeant J, Armson H, Chesluk B, et al. The processes and dimensions of informed self-assessment: a conceptual model. Acad Med. 2010;85(7):1212-1220.
130. Sargeant J, Eva KW, Armson H, et al. Features of assessment learners use to make informed self-assessments of clinical performance. Med Educ. 2011;45(6):636-647.
131. Holmboe ES, Meehan TP, Lynn L, Doyle P, Sherwin T, Duffy FD. Promoting physicians' self-assessment and quality improvement: the ABIM diabetes practice improvement module. J Contin Educ Health Prof. 2006;26(2):109-119.
132. Caverzagie KJ, Bernabeo EC, Reddy SG, Holmboe ES. The role of physician engagement on the impact of the hospital-based practice improvement module (PIM). J Hosp Med. 2009;4(8):466-470.
133. Hess BJ, Lynn LA, Holmboe ES, Lipner RS. Toward better care coordination through improved communication with referring physicians. Acad Med. 2009;84(10)(suppl):S109-S112.
134. Simpkins J, Divine G, Wang M, Holmboe E, Pladevall M, Williams LK. Improving asthma care through recertification: a cluster randomized trial. Arch Intern Med. 2007;167(20):2240-2248.
135. Holmboe ES, Hess BJ, Conforti LN, Lynn LA. Comparative trial of a web-based tool to improve the quality of care provided to older adults in residency clinics: Modest success and a tough road ahead. Academic Medicine. 2012;87(5):627-634.
136. Oyler J, Vinci L, Arora V, Johnson J. Teaching internal medicine residents quality improvement techniques using the ABIM's practice improvement modules. J Gen Intern Medicine. 2008;23(7):927-930.
137. Miles PV. Maintenance of certification: the role of the American Board of Pediatrics in improving children's heathcare. Pediatr Clin N Am. 2009;56:987-994.
138. American Board of Pediatrics. Quality improvement standards for Part IV of MOC. Accessed at https://www.abp.org/abpwebsite/moc/performanceinpractice/approvedq1projects/approved/qi_project_standards.
139. Baker DP, Salas E, King H, Battles J, Barach P. The role of teamwork in the professional education of physicians: current status and assessment recommendations. Jt Comm J Qual Pateint Saf. 2005;31:185-202.
140. American Academy of Family Physicians, American Academy of Pediatrics, American College of Physicians, American Osteopathic Association. Joint principles of the patient-centered medical home; March 2007. http://www.pcpcc.net/content/joint-principles-patient-centered-medical-home. Accessed January 4, 2013.
141. McClellan M, McKethan AN, Lewis JL, Roski J, Fisher ES. A national strategy to put accountable care into practice. Health Aff (Millwood). 2010;29:982-990.
142. Cystic Fibrosis Foundation. Quality Improvement Initiative. http://www.cff.org/LivingWithCF/CareCenterNetwork/CareCenterData/
143. Miller MR, Griswold M, Harris JM 2nd, et al. Decreasing PICU catheter-associated bloodstream infections: NACHRI's quality transformation efforts. Pediatrics. 2010;125:206-213.
144. Maintenance of Certification Activity Manager. Portfolio program reviewers; 2012. http://www.mocactivitymanager.org/overview/MSPAP/portfolio_program_reviewers/
145. American Board of Pathology. Maintenance of certification. Accessed at http://www.abpath.org/MOCGenInfo.htm.
146. Howanitz PJ, Renner, SW, Walsh, MK. Continuous wristband monitoring over 2 years decreases identification errors: a College of American Pathologists Q-Tracks study. Arch Pathol Lab Med. 2002;126:809-815.
147. Zarbo RJ, Jones BA, Friedberg RC, et al. Q-Tracks: A College of American Pathologists program of continuous laboratory monitoring and longitudinal performance tracking. Arch Pathol Lab Med. 2002;126:1036-1044.
148. Valenstein PJ, Walsh MK. Five-year follow-up of routine outpatient test turnaround time: a College of American pathologists Q-PROBES study. Arch Pathol Lab Med. 2003;127:1421-1423.
149. Raab SS, Jones BA, Souers R, Tworek JA. The effect of continuous monitoring of cytologic-histologic correlation data on cervical cancer screening performance. Arch Pathol Lab Med. 2008;132:16-22.
150. Shifman RB, Howanitz PJ, Zarbo RJ. Q-Probes: A College of Pathologists benchmarking program for quality management in pathology and laboratory medicine. Adv Pathol. 1996;9:83-120.