Using composite indicators to measure performance in health care

Performance Measurement for Health System Improvement: Experiences, Challenges and Prospects

Volumn , Issue , 2010, Pages 339-368

  Goddard, Maria ^a   Jacobs, Rowena ^a  

^a UNIVERSITY OF YORK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84927082717     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9780511711800.013     Document Type: Chapter

References (56)

1. Almeida, C., Braveman, P., Gold, MR., Szwarcwald, CL., Ribeiro, JM., Miglionico, A., Millar, JS., Porto, S., Costa, NR., Rubio, VO., Segall, M., Starfield, B., Travessos, C., Uga, A., Valente, J., Viacava, F. (2001). ‘Methodological concerns and recommendations on policy consequences of The world health report 2000.’ Lancet, 357(9269): 1692-1697.
2. Appleby, J., Mulligan, J. (2000). How well is the NHS performing? A composite performance indicator based on public consultation. London: King’s Fund.
3. Appleby, J., Street, A. (2001). ‘Health system goals: life, death and… football.’ Journal of Health Services Research, 6(4): 220-225.
4. Aron, D., Rajan, M., Pogach, L. (2007). ‘Summary measures of quality of diabetes care: comparison of continuous weighted performance measurement and dichotomous thresholds.’ International Journal for Quality in Health Care, 19(1): 29-36.
5. Beaulieu, N., Horrigan, D. (2005). ‘Putting smart money to work for quality improvement.’ Health Services Research, 40(5 Pt. 1): 1318-1334.
6. Berg, K., Mor, V., Morris, J., Murphy, K., Moore, T., Harris, Y. (2002). ‘Identification and evaluation of existing nursing home quality indicators.’ Health Care Financing Review, 23(4): 19-36.
7. Bethell, C., Peck Reuland, C., Halfon, N., Edward, L. (2004). ‘Measuring the quality of preventive and developmental services for young children.’ Paediatrics, 113(Suppl. 6): 1973-1983.
8. Centers for Medicare and Medicaid Services (2005). Medicare ‘pay for performance (P4P)’ initiatives. Baltimore, MD: Centres for Medicare and Medicaid Services (http://www.cms.hhs.gov/apps/media/press/release.asp?counter=1343).
9. Cherchye, L., Moesen, W., Rogge, N., Van Puyenbroeck, T (2007). ‘An introduction to ‘benefit of the doubt’ composite indicators.’ Social Indicators Research, 82(1): 111-145.
10. CIHI (2001). Health care in Canada 2001: a second annual report. Ottawa: Canadian Institute for Health Information.
11. CIHI (2001a). Health indicators 2001. Ottawa: Canadian Institute for Health Information.
12. CIHI (2007). Health indicators 2007. Ottawa: Canadian Institute for Health Information.
13. Commonwealth Fund Commission on a High Performance Health System (2007). Aiming higher: results from a state scorecard on health system performance. New York: The Commonwealth Fund.
14. Crombie, I., Davies, HTO. (1998). ‘Beyond health outcomes: the advantages of measuring process.’ Journal of Evaluation in Clinical Practice, 4(1): 31-38.
15. Cutler, T (2002). ‘Star or black hole?’ Community Care, 30 May: 40-41.
16. Department of Health (2001). NHS performance ratings: acute trusts 2000/01. London: Department of Health (http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4003181).
17. Department of Health (2002). NHS performance ratings and indicators: acute trusts, specialist trusts, ambulance trusts, mental health trusts 2001/02. London: Department of Health (http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4002706).
18. Dolan, P., Gudex, C., Kind, P., Williams, A. (1996). ‘Valuing health states: a comparison of methods.’ Journal of Health Economics, 15(2): 209-231.
19. Dr Foster Intelligence (2007) [web site]. How healthy is your hospital? London: Dr Foster Intelligence http://www.drfosterintelligence.co.uk/library/reports/hospitalGuide2007.pdf.
20. Freudenberg, M. (2003). Composite indicators of country performance: a critical assessment. Paris: Organisation for Economic Co-operation and Development (STI Working paper DSTI/DOC 2003/16).
21. Halasyamani, L., Davis, M. (2007). ‘Conflicting measures of hospital quality: ratings from ‘hospital compare’ versus ‘best hospitals’.’ Journal of Hospital Medicine, 2(3): 128-134.
22. Healthcare Commission (2004). 2004 performance ratings. London: Healthcare Commission http://ratings2004.healthcarecommission.org.uk/.
23. Healthcare Commission (2005). 2005 performance ratings. London: Healthcare Commission http://ratings2005.healthcarecommission.org.uk/.
24. Healthcare Commission (2007). Annual health check 2006/07. A national overview of the performance of NHS trusts in England. London: Healthcare Commission http://www.cqc.org.uk/_db/_documents/Annual_health_check_national_overview_2006-2007.pdf.
25. Health Consumer Powerhouse & Frontier Centre for Public Policy (2008). Euro-Canada health consumer index 2008. Brussels, Ottawa & Winnipeg (FC Policy Series No. 38).
26. Institute of Medicine (2001). Crossing the quality chasm: a new health system for the 21st century. Washington DC: Institute of Medicine of the National Academies, Committee on Quality of Health Care in America.
27. Jacobs, R., Goddard, M., Smith, PC. (2005). ‘How robust are hospital ranks based on composite performance measures?’ Medical Care, 43(12): 1177-1184.
28. Jencks, S., Cuerdon, T., Burwen, D., Fleming, B., Houck, P., Kussmaul, A., Nilasena, D., Ordin, D., Arday, D. (2000). ‘Quality of medical care delivered to Medicare beneficiaries: a profile at state and national levels.’ Journal of the American Medical Association, 284(13): 1670-1676.
29. Jencks, S., Huff, E., Cuerdon, T. (2003). ‘Change in the quality of care delivered to Medicare beneficiaries, 1998-1999 to 2000-2001.’ Journal of the American Medical Association, 289(3): 305-312.
30. Joint Research Centre (2002). State-of-the-art report on current methodologies and practices for composite indicator development. Report prepared by the Applied Statistics Group. Brussels: European Commission, Institute for the Protection and Security of the Citizen http://composite-indicators.jrc.ec.europa.eu/Document/state-of-the-art_EUR20408.pdf.
31. Kmietowicz, Z (2003). ‘Star rating system fails to reduce variation.’ British Medical Journal, 327(7408): 184.
32. Krumholz, H., Rathore, S., Chen, J., Wang, Y., Radford, M. (2002). ‘Evaluation of a consumer-orientated internet health care report card.’ Journal of the American Medical Association, 287(10): 1277-1287.
33. Lied, T., Malsbary, R., Eisenberg, C., Ranck, J. (2002). ‘Combining HEDIS indicators: a new approach to measuring plan performance.’ Health Care Financing Review, 23(4): 117-129.
34. Lindenauer, P., Remus, D., Roman, S., Rothberg, M., Benjamin, E., Ma, A., Bratzler, D. (2007). ‘Public reporting and pay for performance in hospital quality improvement.’ New England Journal of Medicine, 356(5): 486-496.
35. Lun, G., Holzer, D., Tappeiner, G., Tappeiner, U. (2006). ‘The stability of rankings derived from composite indicators: analysis of the ‘IL Sole 24 Ore’ quality of life report.’ Social Indicators Research, 77(2): 307-331.
36. Miller, N (2002). ‘Missing the target.’ Community Care, 21 November: 36-38.
37. Mullen, P., Spurgeon, P. (2000). Priority setting and the public. Abingdon: Radcliffe Medical Press.
38. Nardo, M., Saisana, M., Saltelli, A., Tarantola, S., Hoffman, A., Giovanni, E. (2005). Handbook on constructing composite indicators: methodology and user guide. Paris: Organisation for Economic Co-operation and Development (OECD Statistics Working Paper 2005/03).
39. Navarro, V (2002). ‘The world health report 2000: can health care systems be compared using a single measure of performance?’ American Journal of Public Health, 92(1): 31-34.
40. Nietert, P., Wessell, A., Jenkins, R., Feifer, C., Nemeth, L., Ornstein, S. (2007). ‘Using a summary measure for multiple quality indicators in primary care: the Summary QUality InDex (SQUID).’ Implementation Science, 2: 11.
41. Nord, E (2002). ‘Measures of goal attainment and performance: a brief, critical consumer guide.’ Health Policy, 59(3): 183-191.
42. O Brien, S., Shahian, D., Delong, E., Normand, SL., Edwards, F., Ferraris, V., Haan, C., Rich, J., Shewan, C., Dokholyan, R., Anderson, R., Peterson, E. (2007). ‘Quality measurement in adult cardiac surgery: Part 2 - statistical considerations in composite measure scoring and provider rating.’ Annals of Thoracic Surgery, 83(Suppl. 4): 13-26.
43. O Malley, A., Zaslavsky, A., Hays, R., Heppner, K., Keller, S., Cleary, P. (2005). ‘Exploratory factor analyses of the CAHPS®hospital pilot survey responses across and within medical, surgical, and obstetric services. Health Services Research, 40(6 Pt 2): 2078-2095.
44. Page, S., Cramer, K. (2001). ‘Maclean’s rankings of health care indices in Canadian communities, 2000: comparisons and statistical contrivance.’ Canadian Journal of Public Health (Revue Canadienne de Sante Publique), 92(4): 295-298.
45. Premier (2005). CMS/Premier Hospital Quality Incentive Demonstration (HQID). Washington, DC: Premier http://www.premierinc.com/all/quality/hqi/index.jsp.
46. Reeves, D., Campbell, S., Adams, J., Shekelle, P., Kontopantelis, E., Roland, M. (2007). ‘Combining multiple indicators of clinical quality: an evaluation of different analytic approaches.’ Medical Care, 45(6): 489-496.
47. Ryan, M., Farrer, S. (2000). ‘Using conjoint analysis to elicit preferences for health care.’ British Medical Journal, 320(7248): 1530-1533.
48. Saaty, R (1987). ‘The analytical hierarchy process: what it is and how it is used.’ Mathematical Modelling, 9: 161-176.
49. Smith, PC (2002). Developing composite indicators for assessing health system efficiency. In: Smith, PC (ed.). Measuring up: improving the performance of health systems in OECD countries. Paris: Organisation for Economic Co-operation and Development.
50. Snelling, I (2003). ‘Do star ratings really reflect hospital performance?’ Journal of Health Organization and Management, 17(3): 210-223.
51. US News & World Report (2007). America’s Best Hospitals 2007 methodology. Washington, DC. New York, NY: US News & World Health Report http://www.usnews.com/usnews/health/best-hospitals/meth- odology_report.pdf.
52. Werner, R., Bradlow, E. (2006). ‘Relationship between Medicare’s hospital compare performance measures and mortality rates.’ Journal of the American Medical Association, 296(22): 2694-2702.
53. WHO (2000). The world health report 2000. Health systems: improving performance. Geneva: World Health Organization.
54. Williams, A (2001). ‘Science or marketing at WHO? A commentary on world health 2000.’ Health Economics, 10(2): 93-100.
55. Williams, S., Koss, R., Morton, D., Loeb, J. (2006). ‘Performance of top-ranked heart care hospitals on evidence-based process measures.’ Circulation, 114(6): 558-564.
56. Zaslavsky, AM., Shaul, JA., Zaborski, LB., Cioffi, MJ., Cleary, PD. (2002). ‘Combining health plan performance indicators into simpler composite measures.’ Health Care Financing Review, 23(4): 101-116.