Evaluating investment in quality improvement capacity building: A systematic review

BMJ Open

Volumn 7, Issue 2, 2017, Pages

  Mery, Gustavo ^a   Dobrow, Mark J ^a   Baker, G Ross ^a   Im, Jennifer ^a   Brown, Adalsteinn ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

CALCULATION; CAPACITY BUILDING; DATA BASE; ECONOMIC EVALUATION; GOVERNMENT; HUMAN; INVESTMENT; SYSTEMATIC REVIEW; TOTAL QUALITY MANAGEMENT; TRAINING; ECONOMICS; EDUCATION; STANDARDS;

CAPACITY BUILDING; EDUCATION; HUMANS; QUALITY IMPROVEMENT;

EID: 85013382478     PISSN: None     EISSN: 20446055     Source Type: Journal    
DOI: 10.1136/bmjopen-2016-012431     Document Type: Review

References (71)

1. ∅vretveit J. Does improving quality save money? A review of evidence of which improvements to quality reduce costs to health service providers. London: The Health Foundation, 2009.
2. Dentzer S. Still crossing the quality chasm-or suspended over? Health Aff (Millwood) 2011;30:554-5.
3. Adler PS, Riley P, Kwon SW, et al. Performance improvement capability: keys to accelerating improvement to hospitals. California Manag Rev 2003;45:12-33.
4. Chassin MR, Loeb JM. The ongoing quality improvement journey: next stop, high reliability. Health Aff (Millwood) 2011;30:559-68.
5. Batalden PB, Davidoff F. What is "quality improvement", how can it transform health care? Qual Saf Health Care 2007;16:2-3.
6. Health Quality Ontario. What is quality improvement? 2014. http://www. hqontario. ca/quality-improvement (accessed 26 Jun 2015).
7. Robert Wood Johnson Foundation. Quality improvement training: scanning the field and developing resources. 2011. http://www. rwjf. org/content/dam/farm/reports/program-results-reports/2011/rwjf71893 (accessed 29 Feb 2016).
8. Robert Wood Johnson Foundation. Spreading Quality Improvement: Institute for Healthcare Improvement's Open School. 2011. http://www. rwjf. org/en/library/research/2011/12/spreading-quality-improvement-. html (accessed 29 Feb 2016).
9. Dobrow MJ, Neeson J, Sullivan T. Canadian chief executives' prescription for higher quality: more clinical engagement, shared accountability and capacity development. Healthc Q 2011;14:18-21.
10. Harvey G, Jas P, Walshe K. Analysing organisational context: case studies on the contribution of absorptive capacity theory to understanding inter-organisational variation in performance improvement. BMJ Qual Saf 2015;24:48-55.
11. Kringos DS, Sunol R, Wagner C, et al. The influence of context on the effectiveness of hospital quality improvement strategies: a review of systematic reviews. BMC Health Serv Res 2015;15:277.
12. Bevan H. How can we build skills to transform the healthcare system? J Res Nurs 2010;15:139-48.
13. Baker GR, MacIntosh-Murray A, Porcellato C, et al. High performing healthcare systems: delivering quality by design. Toronto: Longwoods Publishing, 2008.
14. Baker GR, Denis JL. A comparative study of three transformative healthcare systems: lessons for Canada. Ottawa, ON: Canadian Foundation for Healthcare Improvement, 2011. http://www. cfhi-fcass. ca/sf-docs/default-source/commissioned-research-reports/Baker-Denis-EN. pdf?sfvrsn (accessed 29 Feb 2016).
15. Crisp BR, Swerissen H, Duckett SJ. Four approaches to capacity building in health: consequences for measurement and accountability. Health Promot Int 2000;15:99-107.
16. Potter C, Brough R. Systemic capacity building: a hierarchy of needs. Health Policy Plan 2004;19:336-45.
17. Wing KT. Assessing the effectiveness of capacity-building initiatives: seven issues for the field. Nonprof Volunt Sec Q 2004;33:153-60.
18. ∅vretveit J, Staines A. Sustained improvement? Findings from an independent case study of the Jönköping quality program. Q Manag Health Care 2007;16:68-83.
19. Shortell SM, Bennett CL, Byck GR. Assessing the impact of continuous quality improvement on clinical practice: what it will take to accelerate progress. Milbank Q 1998;76:593-624.
20. Canadian Foundation for Healthcare Improvement. Exploring accountable care in Canada: integrating financial and quality incentives for physicians and hospitals. Ottawa, ON: Canadian Foundation for Healthcare Improvement, 2014.
21. Kirkpatrick Partners. The Kirkpatrick Model. 2015. http://www. kirkpatrickpartners. com/OurPhilosophy/TheKirkpatrickModel (accessed 28 Jul 2015).
22. Tian J, Atkinson NL, Portnoy B, et al. A systematic review of evaluation in formal continuing medical education. J Contin Educ Health Prof 2007;27:16-27.
23. Belfield C, Thomas H, Bullock A, et al. Measuring effectiveness for best evidence medical education: a discussion. Med Teach 2001;23:164-70.
24. McLinden D, Phillips R, Hamlin S, et al. Evaluating the future value of educational interventions in a health care setting. Perform Improv Q 2010;22:121-30.
25. Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, cost. Health Aff (Millwood) 2008;27:759-69.
26. Cornett A, Thomas M, Davis MV, et al. Early evaluation results from a statewide quality improvement training program for local public health departments in North Carolina. J Public Health Management Practice 2012;18:43-51.
27. Davis MV, Vincus A, Eggers M, et al. Effectiveness of public health quality improvement training approaches: application, application, application. J Public Health Manag Pract 2012;18:E1-7.
28. Riley W, Parsons H, McCoy K, et al. Introducing quality improvement methods into local public health departments: structured evaluation of a statewide pilot project. Health Serv Res 2009;44(5 Pt 2):1863-79.
29. Ruud KL, Leland JR, Liesinger JT, et al. Effectiveness of a quality improvement training course: Mayo clinic quality academy. Am J Med Qual 2012;27:130-8.
30. Ng S, Trimnell J. Evaluation of the IDEAS advanced learning program-year 1. Toronto: Vision & Results, 2015.
31. Daugherty JD, Blake SC, Kohler SS, et al. Quality improvement training: experiences of frontline staff. Int J Health Care Qual Assur 2013;27:627-41.
32. Rask KJ, Gitomer RS, Spell NC, et al. A two-pronged quality improvement training program for leaders and frontline staff. Jt Comm J Qual Patient Saf 2011;37:147-53.
33. Blake SC, Kohler SS, Culler SD, et al. Designing effective healthcare quality improvement training programs: perceptions of nursing and other senior leaders. J Nurs Educ Pract 2013;3:66-77.
34. Lavigne J. Implementing "educating pharmacy students and pharmacists to improve quality" (EPIC) as a requirement at the Wegmans school of pharmacy. Currents Pharm Teach Learn 2012;4:212-16.
35. Warholak TL, Noureldin M, West D, et al. Faculty perceptions of the educating pharmacy students to improve quality (EPIQ) program. Am J Pharm Educ 2011;75:163.
36. Diaz VA, Carek PJ, Johnson SP. Impact of quality improvement training during residency on current practice. Fam Med 2012;44:569-73.
37. Canal DF, Torbeck L, Djuricich AM. Practice-based learning and improvement: a curriculum in continuous quality improvement for surgery residents. Arch Surg 2007;142:479-83; discussion 482-3.
38. Djuricich AM, Ciccarelli M, Swignoski NL. A continuous quality improvement curriculum for residents: addressing core competency, improving systems. Acad Med 2004;79(Suppl 10):S65-7.
39. Ogrinc G, Headrick LA, Morrison LJ, et al. Teaching and assessing resident competence in practice-based learning and improvement. J Gen Intern Med 2004;19:496-500.
40. Didic S, Phillips K, Muller-Clemm W, et al. Effective governance for quality and patient safety program: an evaluative assessment. Ottawa, ON: Canadian Health Services Research Foundation, 2011. http://www. cfhi-fcass. ca/sf-docs/default-source/reports/Effective-Governance-EN. pdf?sfvrsn=0 (accessed 1 Mar 2016).
41. Robert Wood Johnson Foundation. Evaluating Quality Improvement Training Programs. 2013. http://www. rwjf. org/en/library/research/2013/08/evaluating-quality-improvement-training-programs. html (accessed 1 Mar, 2016).
42. Morganti KG, Lovejoy S, Haviland AM, et al. Measuring success for health care quality improvement interventions. Med Care 2012;50:1086-92.
43. Morganti KG, Lovejoy S, Burke B, et al. A retrospective evaluation of the perfecting patient care university training program for health care. Am J Med Qual 2014;29:30-8.
44. Stover KE, Tesfaye S, Hailmichael Frew AH, et al. Building district-level capacity for continuous improvement in maternal and newborn health. J Midwifery Womens Health 2014;59: S91-100.
45. Matovu JK, Wanyenze RK, Mawemuko S, et al. Strengthening health workforce capacity through work-based training. BMC Int Health Hum Rights 2013;13:8.
46. Runnacles J, Moult B, Lachman P. Developing future clinical leaders for quality improvement: experience from a London children's hospital. BMJ Qual Saf 2013;22:956-63.
47. Davis MV, Mahanna E, Joly B, et al. Creating quality improvement culture in public health agencies. Am J Public Health 2014;104
48. Health Quality Ontario. Learning Community Program Implementation Evaluation Final Report. Christine Frank & Associates/Cathexis Conculting Inc. 2011. http://www. hqontario. ca/portals/0/Documents/qi/qi-learncomm-implement-evaluation-finalreport-1107-en. pdf (accessed 1 Mar 2016).
49. Weiner BJ, Alexander JA, Shortell SM, et al. Quality improvement implementation and hospital performance on quality indicators. Health Serv Res 2006;41:307-34.
50. Gagliardi AR, Majewski C, Victor JC, et al. Quality improvement capacity: a survey of hospital quality managers. Qual Saf Health Care 2010;19:27-30.
51. Ontario Hospital Association. Quality Improvement in Hospitals: OHA survey results. 2013. http://www. oha. com/CurrentIssues/Issues/Documents/QI%20Survey-Analysis%20Report%20%28Sept %2010%202013%29. pdf (accessed 1 Mar 2016).
52. British Columbia Patient Safety and Quality Council. Education for quality and safety leaders: a needs assessment and program review. 2012. https://bcpsqc. ca//documents/2012/11/education. pdf (accessed 1 Mar 2016).
53. Lawrence RH, Tomolo AM. Development and preliminary evaluation of a practice-based learning and improvement tool for assessing resident competence and guiding curriculum development. J Grad Med Educ 2011;3:41-8.
54. Batalden PB, Leach D, Swing S, et al. General competencies and accreditation in graduate medical education. Health Affairs 2002;21:103-11.
55. Butterworth T, Jones K, Jordan S. Building capacity and capability in patient safety, innovation and service improvement: an English case study. J Res Nurs 2011;16:243-51.
56. Headrick LA, Barton AJ, Ogrinc G, et al. Results of an effort to integrate quality and safety into medical and nursing school curricula and foster joint learning. Health Aff (Millwood) 2012;31:2669-80.
57. American Academy of Family Physicians. Practice based learning and improvement: recommended curriculum guidelines for family medicine residents. 2012. http://www. aafp. org/dam/AAFP/documents/medical-education-residency/program-directors/Reprint289C-Learning. pdf (accessed 1 Mar 2016).
58. Saskatchewan Health Quality Council. Building a culture of quality improvement in Saskatchewan's health care system: assessing the impact of the health quality council. 2010. http://hqc. sk. ca/Portals/0/documents/assess-hqc-impact. pdf (accessed 1 Mar 2016).
59. Hutchison B, Levesque JF, Strumpf E, et al. Primary health care in Canada: systems in motion. Milbank Q 2011;89:256-88.
60. Farley DO, Morton SC, Damberg CL, et al. Assessment of the National Patient Safety Initiative: context and baseline evaluation report I. RAND Health. 2008. http://www. rand. org/content/dam/rand/pubs/technical-reports/2005/RAND-TR203. pdf (accessed 1 Mar 2016).
61. Headrick LA, Shalaby M, Baum KD, et al. Exemplary care and learning sites: linking the continual improvement of learning and the continual improvement of care. Acad Med 2011;86:e6-7.
62. American Association of Colleges of Nursing. Hallmarks of quality and patient safety: recommended baccalaureate competencies and curricular guidelines to ensure high-quality and safe patient care. J Prof Nurs 2006;22: 329-30.
63. Cronenwett L, Sherwood G, Barnsteiner J, et al. Quality and safety education for nurses. Nurs Outlook 2007;55:122-31.
64. Cronenwett L, Sherwood G, Pohl J, et al. Quality and safety education for advanced nursing practice. Nurs Outlook 2009;57:338-48.
65. Batalden PB, Stevens DP, Kizer KW. Knowledge for improvement: who will lead the learning? Qual Manag Health Care 2002;10:3-9.
66. Splaine ME, Aron DC, Dittus RS, et al. A curriculum for training quality scholars to improve the health and health care of veterans and the community at large. Qual Manag Health Care 2002;10:10-18.
67. Splaine ME, Ogrinc G, Gilman SC, et al. The department of veterans affairs national quality scholars fellowship program: experience from 10 years of training quality scholars. Acad Med 2009;84:1741-8.
68. Phillips JJ. Return on investment in training and performance improvement programs. Boston: Butterworth-Heinemann, 2003.
69. NHS Institute for Innovation and Improvement. Rapid Impact Assessment of The Productive Ward. Releasing time to care. Coventry: National Health Institutes. 2011. http://www. institute. nhs. uk/quality-and-value/productivity-series/productive-ward. html (accessed 29 Feb 2016).
70. Kaplan HC, Brady PW, Dritz MC, et al. The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q 2010;88:500-59.
71. Kaplan HC, Provost LP, Froehle CM, et al. The Model for Understanding Success in Quality (MUSIQ): building a theory of context in healthcare quality improvement. BMJ Qual Saf 2012;21:13-20.