Health systems performance assessment in low-income countries: Learning from international experiences

Globalization and Health

Volumn 10, Issue 1, 2014, Pages

  Tashobya, Christine K ^a,b   da Silveira, Valéria C ^a   Ssengooba, Freddie ^c   Nabyonga Orem, Juliet ^d   Macq, Jean ^e   Criel, Bart ^a  

^a INSTITUTE OF TROPICAL MEDICINE   (Belgium)

^b MINISTRY OF HEALTH   (Uganda)

^c MAKERERE UNIVERSITY SCHOOL OF PUBLIC HEALTH   (Uganda)

^d WHO Regional Uganda for Africa ^*  (Congo)

^e UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Health systems; Low income countries; Performance assessment framework; Uganda

Indexed keywords

CONCEPTUAL FRAMEWORK; DEVELOPING WORLD; GUIDELINE; HEALTH POLICY; HEALTH SERVICES; LOW INCOME POPULATION; PERFORMANCE ASSESSMENT; POLICY ANALYSIS; POLICY APPROACH;

ARTICLE; CONCEPTUAL FRAMEWORK; EMPOWERMENT; HEALTH CARE FINANCING; HEALTH CARE MANAGEMENT; HEALTH CARE ORGANIZATION; HEALTH CARE POLICY; HEALTH CARE QUALITY; HEALTH CARE SYSTEM; HEALTH SYSTEM PERFORMANCE ASSESSMENT; LOWEST INCOME GROUP; MEDICAL INFORMATION SYSTEM; PERFORMANCE MEASUREMENT SYSTEM; PRIORITY JOURNAL; TOTAL QUALITY MANAGEMENT; UGANDA; DEVELOPING COUNTRY; HEALTH CARE DELIVERY; HUMAN; INTERNATIONAL COOPERATION; METHODOLOGY; POVERTY; REVIEW;

UGANDA;

DELIVERY OF HEALTH CARE; DEVELOPING COUNTRIES; HUMANS; INTERNATIONALITY; POVERTY; QUALITY ASSURANCE, HEALTH CARE; UGANDA;

EID: 84896727045     PISSN: None     EISSN: 17448603     Source Type: Journal    
DOI: 10.1186/1744-8603-10-5     Document Type: Article

References (99)

1. Arah OA, Westert GP. Correlates of health and health care performance: applying the Canadian health indicators framework at the provincial-territorial level. BMC Health Services Research 2005, 5:76. 10.1186/1472-6963-5-76, 1325226, 16321155.
2. Loeb MJ. The current state of performance measurement in health care. International Journal for Quality in Health Care 2004, 16(Supplement 1):i5-i9.
3. Thier SO, Geljins CA. Perspective: Improving health: the reason performance measurement matters. Health Affairs 1998, 17(4):26-28.
4. Arah OA, Westert GP, Hurst J, Klazinga NS. A conceptual framework for the OECD health care quality improvement project. International Journal for Quality in Health Care 2006, 5-13.
5. McLoughlin V, Leatherman S, Fletcher M, Owen JW. Improving performance using indicators. Recent experiences in the United States, the United Kingdom and Australia. International Journal for Quality in Health Care 2001, 13(6):455-462. 10.1093/intqhc/13.6.455, 11769747.
6. Veillard J, Champagne F, Klazinga NS, Kazandjian V, Arah OA, Guisset AL. A performance assessment framework for hospitals: the WHO regional office for Europe PATH project. International Journal for Quality in Health Care 2005, 17(6):487-496. 10.1093/intqhc/mzi072, 16155049.
7. Kalinichenko O, Amado CAF, Santos PS. Performance Assessment in Primary Health Care: A systematic review 2013, Evora Portugal CEFAGE-UE Working Paper 2013/03 CEFAGE- UE Universidale Evora.
8. Smith PC, Mossialos E, Papanicolas I, Leatherman S. Introduction. Performance measurement for health system improvement: experiences, challenges and prospects 2009, 3-24. New York: Cambridge University Press, Smith PC, Mossialos E, Papanicolas I, Leatherman S.
9. Barron P, Day C, Monticelli F, Vermaak K, Okorafor O, Moodley K, Doherty T. The District Health Barometer 2005/06 2006, Durban South Africa Health Systems Trust.
10. Ministry of Health The Health Sector Strategic and Investment Plan 2010/11 to 2014/15 2010, Kampala Uganda: Ministry of Health, Ministry of Health.
11. Yates R, Tashobya CK, Cruz OV, McPake B, Ssengooba F, Murindwa G, Lochoro P, Bataringaya J, Nazerali H, Omaswa F. The Uganda health system reforms: miracle or mirage?. Health system reforms in Uganda: processes and outputs 2006, London, United Kingdom: London School of Hygiene and Tropical Medicine, Tashobya CK, Ssengooba F, Cruz OV.
12. World Health Organisation Investing in Health for Economic Development 2001, Geneva, Switzerland: Commission on Macroeconomics and Health, World Health Organisation, World Health Organisation.
13. Tashobya CK, Ogwal PO. The effort to achieve the millennium development goals in Uganda: reaching for the sky?. Health Policy and Development 2004, 2(1):33-39.
14. World Health Organisation Health System Performance Assessment: Debates, Methods, Empricism. 2003, Geneva Switzerland: World Health Organisation, Murray JLC, Evans DB, World Health Organisation.
15. Arah OA, Klazinga NS, Delnoij JMD, Ten Asbroek AHA, Clusters T. Conceptual framework for health system performance: a quest for effectiveness, quality and improvement. International Journal for Quality in Health Care 2003, 15(5):377-398. 10.1093/intqhc/mzg049, 14527982.
16. Edward A, Kumar B, Kakah F, Salehi AS, Burnham G, Peters DH. Configuring Balanced Scorecards for measuring health system performance: evidence from 5 years evaluation in Afghanistan. PLoS Medicine 2011, 8(7):e1001066. 10.1371/journal.pmed.1001066, 3144209, 21814499.
17. Tawfik-Shukor AR, Klazinga NS, Arah OA. Comparing health system performance and management approaches in the Netherlands and Ontario, Canada. BMC Health Services Research 2007, 7(25). doi:10.1186/1472-6963-1187-1125.
18. Siddiqqi S, Masud IT, Nishtar S, Peters DH, Sabri B, Bile MK, Jama AM. Framework for assessing governance of the health system in developing countries: gateway to good governance. Health Policy 2009, 90:13-25. 10.1016/j.healthpol.2008.08.005, 18838188.
19. Ministry of Health Annual Health Sector Performance Report 2002/03 2003, Kampala Uganda Ministry of Health Uganda, Ministry of Health.
20. Komakech I. The curse of league tables: how Uganda missed the point. Health Policy and Development 2005, 3(2):165-169.
21. Ministry of Health Mid-term Review of the Health Sector Strategic Plan II 2008, Kampala Uganda Ministry of Health Uganda, Ministry of Health.
22. Lalonde M. A new perspective on the health of Canadians: a working document 1981, Ministry of Supply and Services Government of Canada: Ottawa Canada.
23. Murray JLC, Frenk J. A framework for assessing the performance of health systems. Bulletin of the World Health Organisation 2000, 78(6):717-731.
24. World Health Organisation The World Health Report 2000: Improving Performance 2000, Geneva Switzerland World Health Organisation, World Health Organisation.
25. World Health Organisation Everybody's Business. Strengthening Health Systems to Improve Health Outcomes 2007, Geneva Switzerland: World Health Organisation, World Health Organisation.
26. Van Olmen J, Criel B, Bhojani U, Marchal B, van Belle S, Chenge MF, Hoeree T, Pirard M, Van Damme W, Kegels G. The health systems dynamics framework. The intorduction of an analytical model for health system analysis and its application to two cases. Health Culture and Society 2012, 2(1). doi:10.5195/hcs.2012.5171.
27. Atun R. Health systems, systems thinking and innovation. Health Policy and Planning 2012, 27:iv4-iv8. 10.1093/heapol/czs002, 23014152.
28. McDaniel RR, Lanham HJ, Anderson RA. Implications of complex adaptive systems theory for the design of research on health care organisation. Health Care Management Review 2009, 34(2):191-199. 10.1097/HMR.0b013e31819c8b38, 3667498, 19322050.
29. Sterman JD. Learning from evidence in a complex world. American Journal of Public Health 2006, 96(3):505-514. 10.2105/AJPH.2005.066043, 1470513, 16449579.
30. Rouse WB. Health care as a complex adaptive system: implications for design and management. The Bridge Spring 2008, (2008).
31. Palomba CA, Banta TW. Assessment essentials: planning, implementing and improving assessment in higher education 1999, San Fransisco CA: Jossey-Bass Publishers.
32. Sicotte C, Champagne F, Contadriopoloulos AP, Barnsley J, Beland F, Leggat SG, Denis JL, Bilodeau H, Langley A, Bremond M, et al. A conceptual framework for the analysis of health care organsiations' performance. Health Services Management Research 1998, 11:24-28.
33. Parsons T. Social Systems and the Evolution of Action Theory 1977, New York USA Free Press.
34. Quinn RE, Rohrbaugh J. A spatial model of effectiveness criteria: towards a competing values approach to organisational analysis. Management Science 1983, 29:363-377.
35. Oxford Dictionaries http://www.oxforddictionaries.com/definition/english/framework. accessed February 10, 2014, Oxford Dictionaries.
36. Groene O, Klazinga NS, Kazandjian V, Lombrail P, Bartels P. The World Health Organisation Performance Assessment Tool for Quality Improvement in Hospitals (PATH): an analysis of the pilot implementation in 37 hospitals. International Journal for Quality in Health Care 2008, 20(3):155-161. 10.1093/intqhc/mzn010, 18378511.
37. Chiu W, Yang C, Lin H, Chu T. Development and implementation of a nationwide healthcare quality indicator system in Taiwan. International Journal for Quality in Health Care 2007, 19(1):21-28.
38. El-Jardali F, Salehi AS, Ataya N, Jamal D. Design, implementation and scaling up of the balanced score card for Hospitals in Lebanon: policy coherence, and application of lessons for low and middle income countries. Health Policy 2011, 103:305-314. 10.1016/j.healthpol.2011.05.006, 21658787.
39. Leggat SG, Narine L, Lemieux-Charles L, Barnsley J, Baker GR, Sicotte C, Champagne F, Bilodeau H. A review of organisational performance assessment in health care. Health Services Management Research 1998, 11:3-13.
40. Minvielle E, Sicotte C, Champagne F, Contadriopoloulos AP, Jeanet M, Preaubert N, Bourdil A, Richard C. Hospital performance: competing or shared values. Health Policy 2007, (2007). doi:10.1016/j.healthpol.2007.09.017.
41. Weir E, d'Entremont N, Stalker S, Kurji K, Robinson V. Applying the balanced score card to local public health measurement: deliberation and decisions. BMC Public Health 2009, 9:127. doi:10.1186/1471-2458-9-127, 10.1186/1471-2458-9-127, 2684743, 19426508.
42. Braveman P, Starfield B, Geiger JH. World Health Report 2000: how it removes equity from the agenda for public health monitoring policy. BMJ 2001, 323:678-681. 10.1136/bmj.323.7314.678, 1121239, 11566834.
43. AbouZahr C, Adjei S, Kanchanachitra C. From data to policy: good practices and cautionary tales. Lancet 2007, 369:1039-1046. 10.1016/S0140-6736(07)60463-2, 17382830.
44. Handler A, Issel M, Turnock B. A conceptual framework to measure performance of the public health system. American Journal of Public Health 2001, 91(8):1235-1239. 10.2105/AJPH.91.8.1235, 1446752, 11499110.
45. Kruk ME, Freedman LP. Assessing health system performance in developing countries: a review of the literature. Health Policy 2008, 85:263-276. 10.1016/j.healthpol.2007.09.003, 17931736.
46. Scutchfield FD, Bhandari WM, Lawhorn AN, Lamberth DC, Ingram CR. Public health performance. American Journal of Preventive Medicine 2009, 36(3):266-272. 10.1016/j.amepre.2008.11.007, 19215852.
47. Smith PC, Mossialos E, Papanicolas I, Leatherman S. Conclusions. Performance measurement for health system improvement: experiences, challenges and prospects 2009, 675-706. New York USA: Cambrige University Press, Smith PC, Mossialos E, Papanicolas, S L I.
48. Hurst J, Jee-Hughes M. Performance measurement and performance management in OECD health systems. OECD Labour Market and Social Policy Occasional Papers 2001, OECD Publishing, http://www.oecd.ilibrary.org/content/workingpaper/78822407371.
49. Ibrahim JE. Performance indicators for all perspectives. International Journal for Quality in Health Care 2001, 13(6):431-432. 10.1093/intqhc/13.6.431, 11769743.
50. Navarro V. Assessment of the World Health Report. Lancet 2000, 356:1598-1601. 10.1016/S0140-6736(00)03139-1, 11075789.
51. Williams A. Science or marketing at WHO? A commentary on 'World Health Report 2000'. Health Economics 2000, 10(2):283-285.
52. Kirigia MJ, Kirigia GD. The essence of governance in health development. International Archives of Medicine 2011, 4:11. 10.1186/1755-7682-4-11, 3072323, 21443766.
53. Olafsdottir AE, Redpath DD, Pokhrel S, Allotey P. Health system performance in sub-Saharan Africa: governance, outcome, equity. BMC Public Health 2011, 11:237. 10.1186/1471-2458-11-237, 3095561, 21496303.
54. Eddy MD. Performance measurement: problems and solutions. Health Affairs 1998, 17(4):7-25.
55. Bierman S, Clark JP. Performance measurement and equity. BMJ 2007, 334:1333-1334. 10.1136/bmj.39251.660127.AD, 1906660, 17599980.
56. Freeman T. Using performance indicators to improve health care quality in the public sector: a review of literature. Health Services Management Research 2002, 15:126-137. 10.1258/0951484021912897, 12028801.
57. McGlynn AE. Selecting common measures of quality and system performance. Medical Care 2003, 41(1, Supplement 1):i39-i47.
58. Donabedian A. Evaluating the quality of medical care. The Milbank Quarterly 2005, 83:691-729. 10.1111/j.1468-0009.2005.00397.x, 2690293, 16279964.
59. Kaplan RS, Norton DP. The balanced score card - measures that drive performance. Harvard Business Review 1992, 71-79.
60. Wong TS, Yin D, Bhattacharya O, Wang B, Liu L, Chen B. Developing a performance measurement framework and indicators for community health service facilities in urban China. BMC Family Practice 2010, 11:91. 10.1186/1471-2296-11-91, 2999588, 21087516.
61. McGlynn AE. The outcomes utility index. International Journal for Quality in Health Care 1998, 10(6):485-490. 10.1093/intqhc/10.6.485, 9928587.
62. Mannion R, Davies HTO. Reporting health care performance: learning from the past, prospects for the future. Journal of Evaluation in Clinical Practice 2001, 8(2):215-228.
63. Nutley S, Smith PC. League Tables for performance improvement in healthcare Journal for Health Services Research and. Policy 1998, 3:50-57.
64. Nandraj S, Khot A, Menon S, Brugha R. A stakeholder approach towards hospital accreditation in India. Health Policy and Planning 2001, 16(Supplement 2):70-79.
65. Sutherland K, Leatherman S. Professional regulation: does certification improve medical standards?. BMJ 2006, 333:439-441. 10.1136/bmj.38933.377824.802, 1553526, 16931845.
66. Haffner JM, Williams SC, Koss GR, Tschurtz BA, Schmaltz SP, Loeb JM. The perceived impact of public reporting hospital performance data: interviews with hospital staff. International Journal for Quality in Health Care 2011, 23(6):697-704. 10.1093/intqhc/mzr056, 21840943.
67. Leatherman S, McCarthy D. Public disclosure of health care performance reports: experience, evidence and issues for policy. International Journal for Quality in Health Care 1999, 11(2):93-98. 10.1093/intqhc/11.2.93, 10442837.
68. Shekelle PG. Public performance reporting on quality information. Performance measurement for health system improvement: experiences, challenges and prospects 2009, New York USA: Cambridge University Press, Smith PC, Mossialos E, Papanicolas I, Leatherman S.
69. Conrad DA. Incentives for healthcare performance improvement. Performance measurement for health system improvement: experiences, challenges and prospects 2009, New York USA: Cambridge University Press, Smith PC, Mossialos E, Papanicolas I, Leatherman S.
70. Witter S, Fretheim A, Kessy FL, Lindahl AK. Paying for performance to improve the delivery of health interventions in low and middle income countries. Cochrane Database of Systematic Reviews 2012, 2:CD007899.
71. Mannion R, Davies HTO. Payment for performance in health care. BMJ 2008, 336:306-308. 10.1136/bmj.39463.454815.94, 2234517, 18258966.
72. Day C, Barron P, Massyn N, Padarath A, English R. The District Health Barometer 2012 2012, South Africa Health Systems Trust: Durban.
73. Ministry of Health Holistic Assessment of performance in the health sector 2008, Accra Ghana Ministry of Health Ghana, Ministry of Health.
74. Health Canada and the Public Agency of Canada Evaluation of the Health Information Initiative 2007-2008 to 2011-2012 2013, Ontario Canada: Evaluation Directorate of Health Canada & Public Health Agency of Canada, At http://www.cihi.ca/CIHI-ext-portal/pdf/internet/ROADMAP_EXSUMM_EN, Health Canada and the Public Agency of Canada.
75. IBM Evaluation of the Health Information Roadmap Initiative: Roadmap II and Raodmap II plus, Executive Summary 2008, Ontario Canada: IBM, IBM.
76. Ten Asbroek AHA, Arah OA, Geelhoed J, Custers T, Delnoij JMD, Klazinga NS. Develoding a national performance indicator framework for the Dutch health system. International Journal for Quality in Health Care 2004, 16:i65-i71. 10.1093/intqhc/mzh020, 15059989.
77. Barron P, Day C, Loveday M, Monticelli F. The District Health Barometer Year 1, January - December 2004 2005, South Africa Health Systems Trust: Durban.
78. Ministry of Health Independent Review Health Sector Programme of Work 2010, Final Report 2008, Accra Ghana Ministry of Health Ghana, Ministry of Health.
79. Australia Institute of Health and Welfare Australia's health in 2012: in brief 2012, Canberra Australia Australia Institute of Health and Welfare, Australia Institute of Health and Welfare.
80. Canada Institute for Health Information Annual Report for 2003-04 2004, Ottawa Ontario Canada Canada Institute for Health Information, Canada Institute for Health Information.
81. Fonn S, Padarath A. Editorial. South Africa Health Review 2010, Durban South Africa Health Systems Trust, Fonn S, Padarath A.
82. English R, Masilela T, Barron P, Schonfeldt A. Health Information Systems in South Africa. South Africa Health Review 2011 2011, Durban South Africa Health Systems Trust, Padarath A, English R.
83. Treasury Board of Canada Secretariat TUp-front Multi-year funding: grant to the Canada Institute for Health Information At http://www.hc-sc.gc.ca/ahc-asc/performance/eval/2013-hii-iis-eng.php, Treasury Board of Canada Secretariat.
84. Canada H. Healthy Canadians - a Federal Report on Comparable Health Indicators 2010 2011, Health Canada: Ottawa Ontario Canada.
85. Persaud DD, Nestman L. The utilisation of systematic outcome mapping to improve performance management in health care. Health Services Management Research 2006, 19:264-276. 10.1258/095148406778951466, 17132202.
86. National Health Information Standards and Statistics Committee (NHISSC) The National Health Performance Framework. Canberra Australia NHISSC 2009, National Health Information Standards and Statistics Committee (NHISSC).
87. Human Rights Watch Stop Making Excuses, Accountability for Maternal Health Care in South Africa 2011, New York USA Human Rights Watch, Human Rights Watch.
88. The Lancet South Africa Series Executive Summary Core Group Health in South Africa: Executive Summary for the Series 2009, Cape Town South Africa: The Lancet Health in South Africa: Executive Summary for the Series, Lawn JE, Kinney MV, The Lancet South Africa Series Executive Summary Core Group.
89. Ministry of Health Subnational (District) health system performance assessment report 2004 2004, Kampala Uganda Ministry of Health Uganda and World Health Organisation Uganda Country Office, Ministry of Health.
90. Health Systems 20/20 The Health System Assessment Approach: A how to manual 2012, At http://www.healthsystems2020.org/content/resource/detail/528 Version 2.0, Health Systems 20/20.
91. McPake B, Mills A. What can we learn from international comparisons of health systems and health reform?. Bulletin of the World Health Organisation 2000, 78(6):811-820.
92. Rose R. Lesson drawing in public policy: a guide to learning across time and space 1993, New Jersey Chatham House Publishers.
93. Millar J. Healthy Canadians in 2010?. Canadian Medical Association Journal 2000, 162(13):1823-1824. 1231371, 10906916.
94. Hyder AA. Misunderstanding the World Health Report 2000. American Journal of Public Health 2002, 92(7):1054-1055. 10.2105/AJPH.92.7.1054, 1447183, 12084673.
95. Hyder AA. Applying WHO's health system performance assessment in Pakistan: critical reflections. Journal of College of Physicians and Surgeons of Pakistan 2003, 13(4):187-191.
96. Australia Institute of Health and Welfare Australia's Health 2010 2010, Canberra Australia Australia Institute of Health and Welfare, Australia Institute of Health and Welfare.
97. Navarro V. The new conventional wisdom: an evaluation of the WHO Report. Health Systems: Improving Performance International Journal of Health Services 2001, 31(1):23-33.
98. Weinberg N. Using performance measures to identofy plans of action to improve care. Journal on Quality Improvement 2001, 27(12):683-688.
99. Smith PC. Measuring health system performance. European Journal of Health Economics 2002, 3:145-148. 10.1007/s10198-002-0138-1, 15609138.