Statistical uncertainty of mortality rates and rankings for children's hospitals

Pediatrics

Volumn 128, Issue 4, 2011, Pages

  Feudtner, Chris ^a   Berry, Jay G ^b   Parry, Gareth ^c   Hain, Paul ^d   Morse, Rustin B ^e   Slonim, Anthony D ^f   Shah, Samir S ^a   Hall, Matt ^g  

^a CHILDREN S HOSPITAL OF PHILADELPHIA   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

^c INSTITUTE FOR HEALTHCARE IMPROVEMENT   (United States)

^d MONROE CARELL JR CHILDREN S HOSPITAL AT VANDERBILT   (United States)

^e PHOENIX CHILDREN'S HOSPITAL   (United States)

^f Saint Barnabas Health Care System   (United States)

^g Child Health Corporation of America   (United States)

Author keywords

Hospital performance; Mortality rates; Quality appraisal; Quality improvement

Indexed keywords

ACCURACY; ADOLESCENT; ADULT; ARTICLE; BAYES THEOREM; BOOTSTRAPPING; CENTRAL TENDENCY BIAS; CHILD; CHILDHOOD MORTALITY; CONFIDENCE INTERVAL; CONTROLLED STUDY; CROSS-SECTIONAL STUDY; FEMALE; HEALTH CARE QUALITY; HOSPITAL DISCHARGE; HOSPITAL MANAGEMENT; HOSPITAL RANKING; HUMAN; INFANT; MAJOR CLINICAL STUDY; MALE; MEDICAL INFORMATION SYSTEM; MONTE CARLO METHOD; PEDIATRIC HOSPITAL; PRESCHOOL CHILD; PRIORITY JOURNAL; PROBABILITY; RELIABILITY; SCHOOL CHILD; STATISTICAL ANALYSIS; STATISTICAL SIGNIFICANCE; UNITED STATES;

ADOLESCENT; CHILD; CHILD, PRESCHOOL; CROSS-SECTIONAL STUDIES; DATA INTERPRETATION, STATISTICAL; FEMALE; HOSPITAL MORTALITY; HOSPITALS, PEDIATRIC; HUMANS; INFANT; MALE; MONTE CARLO METHOD; QUALITY ASSURANCE, HEALTH CARE; RETROSPECTIVE STUDIES; RISK ADJUSTMENT; UNCERTAINTY; UNITED STATES;

EID: 80053491875     PISSN: 00314005     EISSN: 10984275     Source Type: Journal    
DOI: 10.1542/peds.2010-3074     Document Type: Article

References (28)

1. Rothberg MB, Morsi E, Benjamin EM, Pekow PS, Lindenauer PK. Choosing the best hospital: the limitations of public quality reporting. Health Aff (Millwood). 2008;27(6):1680-1687
2. Bonow RO, Masoudi FA, Rumsfeld JS, et al. ACC/AHA classification of care metrics: performance measures and quality metrics: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures. Circulation. 2008;118(24):2662-2666
3. Comarow A. Best hospitals 2011-12: the methodology. US News and World Report. Available at: http://health.usnews.com/health-news/best-hospitals/ articles/2011/07/18/best-hospitals-2011-12-the-methodology. Accessed August 18, 2011
4. Hannan EL, Kumar D, Racz M, Siu AL, Chassin MR. New York State's Cardiac Surgery Reporting System: four years later. Ann Thorac Surg. 1994;58(6):1852-1857 (Pubitemid 24379027)
5. Lilford R, Pronovost P. Using hospital mortality rates to judge hospital performance: a bad idea that just won't go away. BMJ. 2010;340:c2016
6. Black N. Assessing the quality of hospitals. BMJ. 2010;340:c2066
7. Apolito RA, Greenberg MA, Menegus MA, et al. Impact of the New York State Cardiac Surgery and Percutaneous Coronary Intervention Reporting System on the management of patients with acute myocardial infarction complicated by cardiogenic shock. Am Heart J. 2008;155(2):267-273
8. Resnic FS, Welt FG. The public health hazards of risk avoidance associated with public reporting of risk-adjusted outcomes in coronary intervention. J Am Coll Cardiol. 2009;53(10):825-830
9. Steinberg SM, Popa MR, Michalek JA, Bethel MJ, Ellison EC. Comparison of risk adjustment methodologies in surgical quality improvement. Surgery. 2008;144(4):662-667
10. Hughes J. 3M HIS APR DRG classification software: overview. Available at: www.ahrq.gov/qual/mortality/Hughessumm.htm. Accessed March 11, 2011
11. Iezzoni LI. Risk Adjustment for Measuring Health Care Outcomes. 3rd ed. Chicago, IL: Health Administration Press; 2003
12. Frisch L, Anscombe L, Bamford M. How can we know whether short term trends in a hospital's HSMR are significant? Stud Health Technol Inform. 2009;143:149-154
13. Shahian DM, Wolf RE, Iezzoni LI, Kirle L, Normand SL. Variability in the measurement of hospital-wide mortality rates. N Engl J Med. 2010;363(26):2530- 2539
14. Leyland AH, Boddy FA. League tables and acute myocardial infarction. Lancet. 1998;351(9102):555-558 (Pubitemid 28077561)
15. Marshall EC, Spiegelhalter DJ. Reliability of league tables of in vitro fertilisation clinics: retrospective analysis of live birth rates. BMJ. 1998;316(7146):1701-1704
16. Rabilloud M, Ecochard R, Esteve J. Maternity hospitals ranking on prophylactic caesarean section rates: uncertainty associated with ranks. Eur J Obstet Gynecol Reprod Biol. 2001;94(1):139-144 (Pubitemid 32008012)
17. Ranstam J, Wagner P, Robertsson O, Lidgren L. Health-care quality registers: outcome-orientated ranking of hospitals is unreliable. J Bone Joint Surg Br. 2008;90(12):1558-1561
18. Davidson G, Moscovice I, Remus D. Hospital size, uncertainty, and pay-for-performance. Health Care Financ Rev. 2007;29(1):45-57 (Pubitemid 350261905)
19. Agency for Healthcare Research and Quality. Introduction to the HCUP Kids' Inpatient Database (KID) 2006. Rockville, MD: Agency for Healthcare Research and Quality; 2008
20. Meurer SJ. Mortality risk adjustment methodology for University Health System's clinical data base. Available at: www.ahrq.gov/qual/mortality/Meurer. htm. Accessed June 25, 2011
21. Normand S-LT, Shahian DM. Statistical and clinical aspects of hospital outcome profiling. Stat Sci. 2007;22(2):206-226
22. Efron B. Better bootstrap confidence intervals. J Am Stat Assoc. 1987;82(397):171-185
23. Holloway RG, Quill TE. Mortality as a measure of quality: implications for palliative and end-of-life care. JAMA. 2007;298(7):802-804 (Pubitemid 47263163)
24. Fung CH, Lim YW, Mattke S, Damberg C, Shekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med. 2008;148(2):111-123 (Pubitemid 351651554)
25. Marshall MN, Shekelle PG, Leatherman S, Brook RH. The public release of performance data: what do we expect to gain? A review of the evidence. JAMA. 2000;283(14):1866-1874 (Pubitemid 30207624)
26. Werner RM, Asch DA. The unintended consequences of publicly reporting quality information. JAMA. 2005;293(10):1239-1244 (Pubitemid 40327909)
27. Chien AT, Chin MH, Davis AM, Casalino LP. Pay for performance, public reporting, and racial disparities in health care: how are programs being designed? Med Care Res Rev. 2007;64(5 suppl):283S-304S (Pubitemid 47459679)
28. O'Connor GT, Malenka DJ, Quinton H, et al. Multivariate prediction of in-hospital mortality after percutaneous coronary interventions in 1994-1996. J Am Coll Cardiol. 1999;34(3):681-691 (Pubitemid 29436172)