Limitations of ranking lists based on cardiac surgery mortality rates

Circulation: Cardiovascular Quality and Outcomes

Volumn 5, Issue 3, 2012, Pages 403-409

  Siregar, Sabrina ^a   Groenwold, Rolf H H ^a   Jansen, Evert K ^b   Bots, Michiel L ^a   Van Der Graaf, Yolanda ^a   Van Herwerden, Lex A ^a  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b VU UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

Cardiac outcomes; Mortality rates; Outcomes research; Surgery

Indexed keywords

ARTICLE; CORONARY ARTERY BYPASS GRAFT; CORONARY CARE UNIT; HEART SURGERY; HEART VALVE SURGERY; HUMAN; NETHERLANDS; OUTCOME ASSESSMENT; PRIORITY JOURNAL; RISK ASSESSMENT; STATISTICAL ANALYSIS; SURGICAL MORTALITY;

CARDIAC SURGICAL PROCEDURES; CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; HOSPITALS; HUMANS; LOGISTIC MODELS; MORTALITY; NETHERLANDS; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); QUALITY INDICATORS, HEALTH CARE; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; RISK FACTORS; TIME FACTORS; TREATMENT OUTCOME;

EID: 84864602326     PISSN: 19417713     EISSN: 19417705     Source Type: Journal    
DOI: 10.1161/CIRCOUTCOMES.111.964460     Document Type: Article

References (23)

1. Adult cardiac surgery in New York State 2005-2007. Albany, New York: New York State Department of Health; 2010.
2. Hospital Guide 2010. What makes a good hospital? Dr Foster Intelligence. 2010.
3. Jha AK, Epstein AM. The predictive accuracy of the New York State coronary artery bypass surgery report-card system. Health Aff (Millwood). 2006;25:844-855.
4. Goldstein H, Spiegelhalter DJ. League tables and their limitations: statistical issues in comparisons of institutional performance. J R Stat Soc Ser A Stat Soc.1996159 385-443.
5. Green J, Wintfeld N. Report cards on cardiac surgeons. Assessing New York State's approach. N Engl J Med. 1995;332:1229-1232.
6. Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg. 1999;16:9-13.
7. Metropolis N, Ulam S. The Monte Carlo Method. J Am Stat Assoc.1949 44 335-341.
8. Lingsma HF, Steyerberg EW, Eijkemans MJ, Dippel DW, Scholte Op Reimer WJ, Van Houwelingen HC. Comparing and ranking hospitals based on outcome: results from The Netherlands Stroke Survey. QJM. 2010;103:99-108.
9. Thomas N, Longford NT, Rolph JE. A Statistical Framework for Severity Adjustment of Hospital Mortality Rates. Santa Monica, Ca: Rand; 1992.
10. Thomas N, Longford NT, Rolph JE. Empirical Bayes methods for estimating hospital-specific mortality rates. Stat Med. 1994;13:889-903.
11. Janssen KJ, Moons KG, Kalkman CJ, Grobbee DE, Vergouwe Y. Updating methods improved the performance of a clinical prediction model in new patients. J Clin Epidemiol. 2008;61:76-86.
12. Shahian DM, Normand SL. Comparison of "risk-adjusted" hospital outcomes. Circulation. 2008;117:1955-1963.
13. Ranstam J, Wagner P, Robertsson O, Lidgren L. Health-care quality registers: outcome-orientated ranking of hospitals is unreliable. J Bone Joint Surg Br. 2008;90:1558-1561.
14. Feudtner C, Berry JG, Parry G, Hain P, Morse RB, Slonim AD, Shah SS, Hall M. Statistical uncertainty of mortality rates and rankings for children's hospitals. Pediatrics. 2011;128:e966-e972.
15. van Dishoeck AM, Lingsma HF, Mackenbach JP, Steyerberg EW. Random variation and rankability of hospitals using outcome indicators. BMJ Qual Saf. 2011;20:869-874.
16. Marshall EC, Spiegelhalter DJ. Reliability of league tables of in vitro fertilisation clinics: retrospective analysis of live birth rates. BMJ. 1998; 316:1701-1704.
17. Parry GJ, Gould CR, McCabe CJ, Tarnow-Mordi WO. Annual league tables of mortality in neonatal intensive care units: longitudinal study. International Neonatal Network and the Scottish Neonatal Consultants and Nurses Collaborative Study Group. BMJ. 1998;316:1931-1935.
18. van Dishoeck AM, Looman CW, van der Wilden-van Lier EC, Mackenbach JP, Steyerberg EW. Displaying random variation in comparing hospital performance. BMJ Qual Saf. 2011;20:651-657.
19. Jacobs R, Goddard M, Smith PC. How robust are hospital ranks based on composite performance measures? Med Care. 2005;43: 1177-1184.
20. Shahian DM, Normand SL, Torchiana DF, Lewis SM, Pastore JO, Kuntz RE, Dreyer PI. Cardiac surgery report cards: comprehensive review and statistical critique. Ann Thorac Surg. 2001;72:2155-2168.
21. Hannan EL, Sarrazin MS, Doran DR, Rosenthal GE. Provider profiling and quality improvement efforts in coronary artery bypass graft surgery: the effect on short-term mortality among Medicare beneficiaries. Med Care. 2003;41:1164-1172.
22. Lingsma HF, Eijkemans MJ, Steyerberg EW. Incorporating natural variation into IVF clinic league tables: the expected rank. BMC Med Res Methodol. 2009;9:53.
23. Siregar S, Groenwold RH, de HF, Bots ML, van der GY, van Herwerden LA. Performance of the original EuroSCORE. Eur J Cardiothorac Surg. 2012;41:746-754.