Measuring and evaluating performance

Health Systems in Low- and Middle-Income Countries: An Economic and Policy Perspective

Volumn , Issue , 2012, Pages

  Nolte, Ellen ^a,b   McKee, Martin ^b  

^a RAND CORPORATION   (United States)

^b LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

Author keywords

Health sectors; Health services; Performance assessment; Performance measurement; Tracer approach

Indexed keywords

EID: 84920895644     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/acprof:oso/9780199566761.003.0031     Document Type: Chapter

References (86)

1. OECD (1985). Measuring health care, 1960-1983 expenditure, costs and performance. OECD, Paris.
2. World Health Organization (2000). The World Health Report 2000. Health systems: improving performance. World Health Organization, Geneva.
3. Smith P (2002). Measuring health system performance. European Journal of Health Economics, 3, 145-8.
4. Spiegelhalter D (1999). Surgical audit: statistical lessons from Nightingale and Codman. Journal of the Royal Statistical Society, 22, 45-58.
5. McIntyre D, Rogers L, Heiei E (2001). Overview, history, and objectives of performance measurement. Health Care Financing Review, 22, 7-43.
6. Brinkerhoff D (2004). Accountability and health systems: toward conceptual clarity and policy relevance. Health Policy and Planning, 19, 371-9.
7. Smith P (2002). Editor's preface. In Smith P (ed) Measuring up. Improving health system performance in OECD countries, pp.7-9. OECD, Paris.
8. Becher EC, Chassin MR (2001). Improving the quality of health care: who will lead? Health Affairs, 20, 164-79.
9. Advisory Council for the Concerted Action in Health Care (2001). Appropriateness and efficiency. Volume III: Overuse, underuse and misuse. Report 2000/2001. Executive summary. Advisory Council for the Concerted Action in Health Care, Bonn.
10. Smith R (1998). Regulation of doctors and the Bristol inquiry. British Medical Journal, 317, 1539-40.
11. Kohn LT, Corrigan JM, Donaldson MS (1999). To err is human. Building a safer health system. National Academic Press, Washington, DC.
12. Naylor CD, Iron K, Handa K (2002). Measuring health system performance: problems and opportunities in the era of assessment and accountability, in Measuring up. Improving health system performance in OECD countries, pp.13-34. OECD, Paris.
13. Stroetmann VN, Hüsing T, Kubitschke L, Stroetmann KA. (2002). The attitudes, expectations and needs of elderly people in relation to e-health applications: results from a European survey. Journal of Telemedicine and Telecare, 8(Suppl 2), 82-4.
14. Working Party on Performance Monitoring in the Public Services (2005). Performance indicators: good, bad, and ugly. Journal of the Royal Statistical Society,168, 1-27.
15. Smith P, Mossialos E, Papanicolas I (2009). Introduction. In Smith P, Mossialos E, Papanicolas I, Leatherman S (eds) Performance measurement for health system improvement, pp.3-24. Cambridge University Press, Cambridge.
16. Campbell S, Braspenning J, Hutchinson A, Marshall MN (2003). Research methods used in developing and applying quality indicators in primary care. British Medical Journal, 326, 816-19.
17. Girard J-F, Minvielle E (2002). Measuring up: lessons and potential. In Measuring up. Improving health system performance in OECD countries, pp.337-47. OECD, Paris.
18. OECD (1990). Health care systems in transition. OECD, Paris.
19. Murray CJL, Evans DB (2003). Health systems performance assessment: goals, framework and overview, In Murray CJL, Evans DB (eds) Health Systems Performance Assessment. Debates, methods and empiricism, pp.3-18.World Health Organization, Geneva.
20. Murray C, Frenk J (2000). World Health Report 2000: a step towards evidence-based health policy. Lancet, 357, 1698-700.
21. Hurst J, Jee-Hughes M (2000). Performance measurements and performance management in OECD health systems. OECD, Paris.
22. Nolte E, McKee M, Wait S (2005). Describing and evaluating health systems. In Bowling A, Ebrahim S (eds) Handbook of health research methods: investigation, measurement and analysis, pp.12-43. Open University Press, Maidenhead.
23. Arah O, Westert GP, Hurst J, Klazinga NS (2006). A conceptual framework for the OECD Health Care Quality Indicators Project. International Journal for Quality in Health Care, 18(Suppl 1), 5-13.
24. Lalonde M (1974). A new perspective on the health of Canadians. Government of Canada, Ottawa.
25. Nutley S, Smith PC (1998). League tables for performance improvement in health care. Journal of Health Services Research and Policy, 3, 50-7.
26. NHS Executive (1998). The NHS performance assessment framework. Department of Health, London.
27. Canadian Institute for Health Information and Statistics Canada (2000). Canadian Health Information Roadmap Initiative Indicators Framework. Canadian Institute for Health Information, Ottawa.
28. Canadian Institute for Health Information (2003). About health indicators. Available at (accessed 16 June 2009).
29. National Health Performance Committee (2001). National health performance framework report. NHPC, Brisbane.
30. Mainz J, Krog BR, Bjørnshave B, et al. (2004). Nationwide continuous quality improvement using clinical indicators: the Danish National Indicator Project. International Journal for Quality in Health Care, 16(Suppl.1), i45-i50.
31. Agency for Healthcare Research and Quality (2009). Measuring healthcare quality. Available at: (accessed 16 June 2009).
32. Westert, G., van den Berg M, Koolman X, Verkleij H (2008). Dutch health care performance report 2008. National Institute for Public Health and the Environment, Bilthoven.
33. Westert G, Verkleij H (2006). Dutch health care performance report. National Institute for Public Health and the Environment, Bilthoven.
34. Heugren M, Aberg A, Koester M, Ljung R (2007). Performance indicators in Swedish health care. BMC Health Services Research, 7(Suppl), A10.
35. Chiu WT, Yang CM, Lin HW, Chu TB (2007). Development and implementation of a nationwide health care quality indicator system in Taiwan. International Journal for Quality in Health Care, 19, 21-8.
36. National Health and Hospitals Reform Commission (2008). Beyond the blame game: accountability and performance benchmarks for the next Australian Health Care Agreements. National Health and Hospitals Reform Commission, Canberra.
37. The Commonwealth Fund Commission on a High Performance Health System (2006). Why not the best? Results from a national scorecard on U.S. health system performance. The Commonwealth Fund, New York.
38. The Commonwealth Fund Commission on a High Performance Health System (2008). Why not the best? Results from the national scorecard on U.S. health system performance. The Commonwealth Fund, New York.
39. Arah OA, Klazinga NS, Delnoij DMJ, Ten Asbroek AHA, Custers T (2003). Conceptual framework for health systems performance: a quest for effectiveness, quality and improvement. International Journal of Quality in Health Care, 15, 377-98.
40. Nolte E (2009). International benchmarking of health care quality. A review of the literature. RAND Corporation, Santa Monica.
41. Tawfik-Shukor A, Klazinga NS, Arah OA (2007). Comparing health system performance assessment and management approaches in the Netherlands and Ontario, Canada. BMC Health Services Research, 7, 25.
42. Murray C, Frenk J (2000). A framework for assessing the performance of health systems. Bulletin of the World Health Organization, 78, 717-31.
43. Kelley E, Hurst J (2006). Health care quality indicators project. Conceptual framework paper. In OECD Health Working Papers 23. OECD, Paris.
44. Musgrove P (2003). Judging health systems: reflections on WHO's methods. Lancet, 361, 1817-20.
45. Valentine N, Prasad A, Rice N, Robone S, Chatterji S (2009). Health systems responsiveness - a measure of the acceptability of health care processes and systems from the user's perspective. In Smith P (ed) Performance measurement for health system improvement: experiences, challenges and prospects, pp.138-86. Cambridge University Press, Cambridge.
46. Hussey PS, Anderson GF, Osborn R, et al. (2004). How does the quality of care compare in five countries? Health Affairs, 23, 89-99.
47. Idänpään-Heikkilä U (2003). The Nordic Indicator Group Project. Presentation at the OECD Health Care Quality Indicators Meeting, 13-14 January, 2003, Paris.
48. Lohr K (1990). Medicare: A strategy for quality assurance. National Academy Press, Washington, DC.
49. Mattke S, Kelley E, Scherer P, et al. (2006). Health Care Quality Indicators Project: Initial indicators report. OECD, Paris.
50. Mattke S, Epstein A, Leatherman S (2006). The OECD Health Care Quality Indicators Project: history and background. International Journal for Quality in Health Care, 18, 1-4.
51. Garcia Armesto S, Gil Lapetra ML, Wei L, Kelley E, Members of the HCQI Expert Group (2007). Health care quality indicators project 2006 data collection update report. In OECD Health Working Papers No. 29. OECD, Paris.
52. OECD (2007). Health at a glance 2007 - OECD indicators. OECD, Paris.
53. Nolte E, McKee M (2003). Measuring the health of the nations: how much is attributable to health care? An analysis of mortality amenable to medical care. British Medical Journal, 327, 1129-32.
54. Nolte E, McKee M (2004). Does healthcare save lives? Avoidable mortality revisited. The Nuffield Trust, London.
55. Hill K, Thaomas K, AbouZhar C, et al. (2007). Estimates of maternal mortality worldwide between 1990 and 2005: an assessment of available data. Lancet, 370, 1311-19.
56. World Health Organization Regional Office for Europe (2009). European health for all database. Updated January 2009. World Health Organization Regional Office for Europe, Copenhagen.
57. Kinyanjui, S, Timaeus IA (2010). External review of the INDEPTH Network: Report to SIDA and other funders. Swedish International Development Cooperation Agency, Stockholm.
58. Walshe K (2003). International comparisons of the quality of health care: what do they tell us? Quality and Safety in Health Care, 12, 4-5.
59. Plochg T, Klazinga NS (2002). Community-based integrated care: myth or must? International Journal for Quality in Health Care, 14, 91-101.
60. Donabedian A (1966). Evaluating the quality of medical care. Milbank Quarterly, 44, 166-203.
61. Donabedian A (1988). The quality of care: how can it be assessed? Journal of the American Medical Association, 260, 1743-8.
62. Mant J (2001). Process versus outcome indicators in the assessment of quality of health care. International Journal for Quality in Health Care, 13, 475-80.
63. Kruk M, Freedman L (2008). Assessing health system performance in developing countries: A review of the literature. Health Policy, 85, 263-76.
64. Smith P (2002). Developing composite indicators for assessing health system efficiency. In Smith P (ed) Measuring up. Improving health system performance in OECD countries, pp.295-316. OECD, Paris.
65. Kessner DM, Kalk CE, Singer J (1973). Assessing health quality: the case for tracers. New England Journal of Medicine, 288, 189-94.
66. Nolte E, Bain C, McKee M (2006). Chronic diseases as tracer conditions in international benchmarking of health systems: the example of diabetes. Diabetes Care, 29, 1007-11.
67. Nolte E, Bain C, McKee M (2009). Population health. In Smith P (ed) Performance measurement for health system improvement: experiences, challenges and prospects, pp.27-62. Cambridge University Press, Cambridge.
68. Adeyi O, Smith O, Robles S (2007). Public Policy and the challenge of chronic noncommunicable diseases. World Bank, Washington DC.
69. Beran D, Yudkin J, de Courten M (2005). Access to care for patients with insulinrequiring diabetes in developing countries: case studies of Mozambique and Zambia. Diabetes Care, 28, 2136-40.
70. Hopkinson B, Balabanova D, McKee M, Kutzin J (2004). The human perspective on health care reform: coping with diabetes in Kyrgyzstan. International Journal of Health Planning and Management, 19, 43-61.
71. Diabetes Control and Complications Trial Research Group (1993). The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. New England Journal of Medicine, 329, 977-86.
72. United Kingdom Prospective Diabetes Study Group (UKPDS) (1998). Intensive bloodglucose control with sulfonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS33). Lancet, 352, 837-53.
73. Laing SP, Swerdlow AJ, Slater SD, et al. (2003). Mortality from heart disease in a cohort of 23,000 patients with insulin-treated diabetes. Diabetologia, 46, 760-5.
74. McColl AJ, Gulliford MC (1993). Population health outcome indicators for the NHS. A feasibility study. Faculty of Public Health Medicine and the Department of Public Health Medicine, United Medical and Dental Schools of Guy's and St Thomas' Hospitals, London.
75. World Health Organization (1999). Definition, diagnosis and classification of diabetes mellitus and its complications. Part 1: diagnosis and classification of diabetes mellitus. World Health Organization, Geneva.
76. Wild S, Roglic G, Green A, Sicree R, King H (2004). Global prevalence of diabetes. Diabetes Care, 27, 1047-53.
77. Yudkin JS, Beran D (2003). Prognosis of diabetes in the developing world. Lancet, 362, 1420-1.
78. Balabanova D, McKee M, Koroleva N, et al. (2009). Navigating the health system: diabetes care in Georgia. Health Policy Planning, 24, 46-54.
79. Loeb J (2004). The current state of performance measurement in health care. International Journal for Quality in Health Care, 16(Suppl 1), i5-i9.
80. Bevan G, Hood C (2006). Have targets improved performance in the English NHS? British Medical Journal, 332, 419-22.
81. Fung, C., Lim YW, Mattke S, Damberg C, Shekelle PG. (2008). Systematic review: the evidence that releasing performance data to the public improves quality of care. Annals of Internal Medicine, 148, 111-23.
82. Marshall MN, Shekelle PG, Leatherman S, Brook RH (2000). The public release of performance data: what do we expect to gain? A review of the evidence. Journal of the American Medical Association, 283, 1866-74.
83. Chassin MR (2002). Achieving and sustaining improved quality: lessons from New York State and cardiac surgery. Health Affairs, 21, 40-51.
84. Hibbard J, Stockard J, Tusler M (2005). Hospital performance reports: impact on quality, market share, and reputation. Health Affairs, 24, 1150-60.
85. Leatherman S (2002). Applying performance indicators to health system improvement. In Smith P (ed) Measuring up. Improving health system performance in OECD countries, pp.319-33. OECD, Paris.
86. Smith P, Mossialos E, Papanicolas I, Leatherman S (eds) (2009). Performance measurement for health system improvement. Cambridge University Press, Cambridge.