Short term survival after admission for heart failure in Sweden: Applying multilevel analyses of discriminatory accuracy to evaluate institutional performance

PLoS ONE

Volumn 11, Issue 2, 2016, Pages

  Ghith, Nermin ^a,b   Wagner, Philippe ^a,c   Frølich, Anne ^b   Merlo, Juan ^a  

^a LUND UNIVERSITY   (Sweden)

^b BISPEBJERG HOSPITAL   (Denmark)

^c UPPSALA UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; AREA UNDER THE CURVE; ARTICLE; CARDIOVASCULAR MORTALITY; CORRELATION COEFFICIENT; FEMALE; HEART FAILURE; HOSPITAL; HOSPITAL ADMISSION; HOSPITAL DISCHARGE; HUMAN; LOGISTIC REGRESSION ANALYSIS; MAJOR CLINICAL STUDY; MALE; MULTILEVEL LOGISTIC REGRESSION ANALYSIS; RECEIVER OPERATING CHARACTERISTIC; SHORT TERM SURVIVAL; SINGLE LEVEL LOGISTIC REGRESSION ANALYSIS; SWEDEN; WARD; CLINICAL TRIAL; DISEASE FREE SURVIVAL; EVALUATION STUDY; MIDDLE AGED; MULTICENTER STUDY; RISK FACTOR; SEXUAL DEVELOPMENT; SURVIVAL RATE; VERY ELDERLY;

AGED; AGED, 80 AND OVER; DISEASE-FREE SURVIVAL; FEMALE; HEART FAILURE; HOSPITALS; HUMANS; MALE; MIDDLE AGED; RISK FACTORS; SEX CHARACTERISTICS; SURVIVAL RATE; SWEDEN;

EID: 84959018432     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0148187     Document Type: Article

References (67)

1. Schaufelberger M, Swedberg K, Köster M, Rosén M, Rosengren A. Decreasing one-year mortality and hospitalization rates for heart failure in Sweden. European Heart Journal. 2004; 25(4):300-7. PMID: 14984918
2. Merlo J, Ostergren PO, Broms K, Bjorck-Linne A, Liedholm H. Survival after initial hospitalisation for heart failure: a multilevel analysis of patients in Swedish acute care hospitals. J Epidemiol Community Health. 2001; 55(5):323-9. Epub 2001/04/12. PMID: 11297650; PubMed Central PMCID: PMC1731888.
3. Bhatia RS, Austin PC, Stukel TA, Schull MJ, Chong A, Tu JV, et al. Outcomes in patients with heart failure treated in hospitals with varying admission rates: population-based cohort study. BMJ Quality & Safety. 2014. doi: 10.1136/bmjqs-2014-002816
4. Harris S, Tepper D, Ip R. Divergent Trends in Survival and Readmission Following a Hospitalization for Heart Failure in the Veterans Affairs Health Care System 2002 to 2006. Congestive Heart Failure. 2011; 17(1):47-. doi: 10.1111/j.1751-7133.2010.00194.x
5. Krumholz HM, Merrill AR, Schone EM, Schreiner GC, Chen J, Bradley EH, et al. Patterns of Hospital Performance in Acute Myocardial Infarction and Heart Failure 30-Day Mortality and Readmission. Circulation: Cardiovascular Quality and Outcomes. 2009; 2(5):407-13. doi: 10.1161/circoutcomes.109. 883256
6. Goldstein H, Spiegelhalter D. League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance. Journal of the Royal Statistical Society, SocA. 1996; 159:385-443.
7. Leckie G, Goldstein H. Understanding Uncertainty in School League Tables. Fiscal Studies. 2011; doi: 10.1111/j.1475-5890.2011.00133
8. Merlo J. Changing analytical approaches in European epidemiology - a short comment on a recent article. European journal of epidemiology. 2005; 20(8):737; author reply 8. Epub 2005/09/10. doi: 10.1007/s10654-005-2065-9 PMID: 16151890.
9. Merlo J, Gerdtham UG, Eckerlund I, Hakansson S, Otterblad-Olausson P, Pakkanen M, et al. Hospital level of care and neonatal mortality in low-and high-risk deliveries: reassessing the question in Sweden by multilevel analysis. Med Care. 2005; 43(11):1092-100. Epub 2005/10/15. PMID: 16224302.
10. Ohlsson H, Librero J, Sundquist J, Sundquist K, Merlo J. Performance evaluations and league tables: do they capture variation between organizational units? An analysis of 5 Swedish pharmacological performance indicators. Med Care. 2011; 49(3):327-31. Epub 2011/01/26. doi: 10.1097/MLR. 0b013e31820325c5 PMID: 21263360.
11. Ohlsson H, Merlo J. Is there important variation among health care institutions? Med Care. 2010; 48 (8):757-8; author reply 8. Epub 2010/07/22. doi: 10.1097/MLR.0b013e3181e80861 PMID: 20647865.
12. Vernaz N, Huttner B, Muscionico D, Salomon J-L, Bonnabry P, López-Lozano JM, et al. Modelling the impact of antibiotic use on antibiotic-resistant Escherichia coli using population-based data from a large hospital and its surrounding community. Journal of Antimicrobial Chemotherapy. 2011. doi: 10.1093/jac/dkq525
13. Harbarth S, Harris AD, Carmeli Y, Samore MH. Parallel Analysis of Individual and Aggregated Data on Antibiotic Exposure and Resistance in Gram-Negative Bacilli. Clinical Infectious Diseases. 2001; 33 (9):1462-8. doi: 10.1086/322677 PMID: 11588690
14. Vernaz N, Sax H, Pittet D, Bonnabry P, Schrenzel J, Harbarth S. Temporal effects of antibiotic use and hand rub consumption on the incidence of MRSA and Clostridium difficile. Journal of Antimicrobial Chemotherapy. 2008; 62(3):601-7. doi: 10.1093/jac/dkn199 PMID: 18468995
15. Tu JV, Ko DT. Ecological Studies and Cardiovascular Outcomes Research. Circulation. 2008; 118 (24):2588-93. doi: 10.1161/circulationaha.107.729806 PMID: 19064693
16. Bottle A, Middleton S, Kalkman CJ, Livingston EH, Aylin P. Global Comparators Project: International Comparison of Hospital Outcomes Using Administrative Data. Health Services Research. 2013; 48 (6pt1):2081-100. doi: 10.1111/1475-6773.12074 PMID: 92599947.
17. Mohammed MA, Deeks JJ, Girling A, Rudge G, Carmalt M, Stevens AJ, et al. Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals2009 2009-03-18 15:01:48.
18. Collaboration. Atlas VPM. Atlas de Variaciones en la Práctica Médica en el Sistema Nacional De Salud http://wwwatlasvpmorg/avpm/inicioiniciodo. 2010.
19. Bernal E, (Coordinator). The European Collaboration for Health Optimization (ECHO). http://echohealth. eu/partners/accessed 11-02-2015. European Comission, Research & Innovation (Health). 2015.
20. Bernal-Delgado E, Christiansen T, Bloor K, Mateus C, Yazbeck AM, Munck J, et al. ECHO: health care performance assessment in several European health systems. European journal of public health. 2015; 25 Suppl 1:3-7. doi: 10.1093/eurpub/cku219 PMID: 25690123.
21. Garcia-Armesto S, Angulo-Pueyo E, Martinez-Lizaga N, Mateus C, Joaquim I, Bernal-Delgado E, et al. Potential of geographical variation analysis for realigning providers to value-based care. ECHO case study on lower-value indications of C-section in five European countries. European journal of public health. 2015; 25 Suppl 1:44-51. doi: 10.1093/eurpub/cku224 PMID: 25690129.
22. Merlo J, Viciana-Fernandez FJ, Ramiro-Farinas D, Research Group of Longitudinal Database of Andalusian P. Bringing the individual back to small-area variation studies: a multilevel analysis of all-cause mortality in Andalusia, Spain. Soc Sci Med. 2012; 75(8):1477-87. Epub 2012/07/17. doi: 10.1016/j. socscimed.2012.06.004 PMID: 22795359.
23. Merlo J, Chaix B, Yang M, Lynch J, Rastam L. A brief conceptual tutorial of multilevel analysis in social epidemiology: linking the statistical concept of clustering to the idea of contextual phenomenon. J Epidemiol Community Health. 2005; 59(6):443-9. Epub 2005/05/25. doi: 10.1136/jech.2004.023473 PMID: 15911637; PubMed Central PMCID: PMC1757045.
24. Merlo J. Invited Commentary: Multilevel Analysis of Individual Heterogeneity - A Fundamental Critique of the Current Probabilistic Risk Factor Epidemiology. Am J Epidemiol. 2014. doi: 10.1093/aje/kwu108 PMID: 24925064.
25. Merlo J, Östergren P-O, Broms K, Bjorck-Linné A, Liedholm H. Survival after initial hospitalisation for heart failure: a multilevel analysis of patients in Swedish acute care hospitals. Journal of Epidemiology and Community Health. 2001; 55(5):323-9. doi: 10.1136/jech.55.5.323 PMID: 11297650
26. Ash AS, Fienberg E, Louis A, Norm S-lT, Stukel A, Utts PJ. STATISTICAL ISSUES IN ASSESSING HOSPITAL PERFORMANCE Commissioned by the Committee of Presidents of Statistical Societies The COPSS-CMS White Paper Committee. 2011.
27. Khoury MJ, Newill CA, Chase GA. Epidemiologic evaluation of screening for risk factors: application to genetic screening. American journal of public health. 1985; 75(10):1204-8. Epub 1985/10/01. PMID: 3862352; PubMed Central PMCID: PMC1646387.
28. Pepe MS, Janes H, Longton G, Leisenring W, Newcomb P. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am J Epidemiol. 2004; 159(9):882-90. Epub 2004/04/24. PMID: 15105181.
29. Wagner P, Merlo J. Measures of discriminatory accuracy in multilevel analysis. European journal of epidemiology. 2013; 28(1, Supplement):135.
30. Wagner P, Merlo J. Discriminatory accuracy of a random effect in multilevel logistic regression. 20th IEA World Congress of Epidemiology (WCE2014). 2014.
31. Merlo J, Wagner P, Ghith N, leckie G. An original stepwise multilevel logistic regression analysis of discriminatory accuracy: the case of neighbourhoods and health. PLOS-ONE. 2015 (PONE-D-15-36083-R1).
32. Merlo J, Chaix B, Ohlsson H, Beckman A, Johnell K, Hjerpe P, et al. A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. J Epidemiol Community Health. 2006; 60(4):290-7. Epub 2006/03/16. doi: 10.1136/jech.2004.029454 PMID: 16537344; PubMed Central PMCID: PMC2566165.
33. Joynt KE, Orav EJ, Jha AK. The association between hospital volume and processes, outcomes, and costs of care for congestive heart failure. Annals of Internal Medicine. 2011; 154(2):94-102. doi: 10. 1059/0003-4819-154-2-201101180-00008 PMID: PMC3336194.
34. Ross JS, Normand S-LT, Wang Y, Ko DT, Chen J, Drye EE, et al. Hospital Volume and 30-Day Mortality for Three Common Medical Conditions. New England Journal of Medicine. 2010; 362(12):1110-8. doi: 10.1056/NEJMsa0907130 PMID: 20335587.
35. Hughes RG, Garnick DW, Luft HS, McPhee SJ, Hunt SS. Hospital volume and patient outcomes. The case of hip fracture patients. Med Care. 1988; 26(11):1057-67. PMID: 3185017.
36. Tsai AC, Votruba M, Bridges JF, Cebul RD. Overcoming bias in estimating the volume-outcome relationship. Health services research. 2006; 41(1):252-64. doi: 10.1111/j.1475-6773.2005.00461.x PMID: 16430610; PubMed Central PMCID: PMC1681538.
37. Moons KG, de Groot JA, Bouwmeester W, Vergouwe Y, Mallett S, Altman DG, et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med. 2014; 11(10):e1001744. doi: 10.1371/journal.pmed.1001744 PMID: 25314315; PubMed Central PMCID: PMC4196729.
38. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. Journal of Chronic Diseases. 1987; 40(5):373-83. doi: http://dx.doi.org/10.1016/0021-9681(87)90171-8. PMID: 3558716
39. Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity Measures for Use with Administrative Data. Medical Care. 1998; 36(1):8-27. PMID: 9431328
40. Li P, Kim M, Doshi J. Comparison of the performance of the CMS Hierarchical Condition Category (CMS-HCC) risk adjuster with the charlson and elixhauser comorbidity measures in predicting mortality. BMC Health Services Research. 2010; 10(1):245. doi: 10.1186/1472-6963-10-245
41. Larsen K, Merlo J. Appropriate assessment of neighborhood effects on individual health: integrating random and fixed effects in multilevel logistic regression. Am J Epidemiol. 2005; 161(1):81-8. Epub 2004/12/24. doi: 10.1093/aje/kwi017 PMID: 15615918.
42. Larsen K, Petersen JH, Budtz-Jorgensen E, Endahl L. Interpreting parameters in the logistic regression model with random effects. Biometrics. 2000; 56(3):909-14. PMID: 10985236
43. Browne WJ. MCMC Estimatin in MLwiN v2.29. Centre for Multilevel Modelling, University of Bristol.; 2013.
44. Spiegelhalter DJ, Best N, Carlin BP, Linde AVD. Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society Series C, Applied statistics. 2002; 64:583-639.
45. Health Indicators Warehouse: Medicare Hospital Compare (CMS); 2012 [cited 2015 17 May]. Available from: http://www.healthindicators.gov/Indicators/Hospital-30-day-death-mortality-heart-failure-patientspercent- 344/Profile/ClassicData.
46. Northwestern Memorial HealthCare: DEATH FROM ANY CAUSE WITHIN 30 DAYS OF HOSPITALIZATION FOR HEART FAILURE: U.S. Department of Health & Human Services; 2012 [cited 2015 12 April]. Available from: www.hospitalcompare.hhs.gov; http://www.nmh.org/nm/quality-death-from-anycause-within-30-days-of-heart-failure.
47. Ludvigsson JF, Andersson E, Ekbom A, Feychting M, Kim JL, Reuterwall C, et al. External review and validation of the Swedish national inpatient register. BMC public health. 2011; 11:450. doi: 10.1186/1471-2458-11-450 PMID: 21658213; PubMed Central PMCID: PMC3142234.
48. Lang CC, Mancini DM. Non-cardiac comorbidities in chronic heart failure. Heart. 2007; 93(6):665-71. doi: 10.1136/hrt.2005.068296 PMID: PMC1955190.
49. Lee C, Chien C, Bidwell J, Gelow J, Denfeld Q, Creber R, et al. Comorbidity profiles and inpatient outcomes during hospitalization for heart failure: an analysis of the U.S. Nationwide inpatient sample. BMC Cardiovascular Disorders. 2014; 14(1):73. doi: 10.1186/1471-2261-14-73
50. Hosmer DW Jr, Lemeshow S, Sturdivant RX. Applied logistic regression: John Wiley & Sons; 2013.
51. Moons KGM, de Groot JAH, Bouwmeester W, Vergouwe Y, Mallett S, Altman DG, et al. Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies: The CHARMS Checklist. PLoS Med. 2014; 11(10):e1001744. doi: 10.1371/journal.pmed.1001744 PMID: 25314315
52. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. Journal of Clinical Epidemiology. 49(12):1373-9. doi: 10. 1016/S0895-4356(96)00236-3 PMID: 8970487
53. Katzan IL, Spertus J, Bettger JP, Bravata DM, Reeves MJ, Smith EE, et al. Risk Adjustment of Ischemic Stroke Outcomes for Comparing Hospital Performance: A Statement for Healthcare Professionals From the American Heart Association/American Stroke Association. Stroke. 2014; 45(3):918-44. doi: 10.1161/01.str.0000441948.35804.77 PMID: 24457296
54. Coiera E, Wang Y, Magrabi F, Concha O, Gallego B, Runciman W. Predicting the cumulative risk of death during hospitalization by modeling weekend, weekday and diurnal mortality risks. BMC Health Services Research. 2014; 14(1):226. doi: 10.1186/1472-6963-14-226
55. Umegaki T, Sekimoto M, Hayashida K, Imanaka Y. An outcome prediction model for adult intensive care. Crit Care Resusc. 2010; 12(2):96-103. PMID: 20513217.
56. Gastmeier P, Sohr D, Breier A, Behnke M, Geffers C. Prolonged duration of operation: an indicator of complicated surgery or of surgical (mis)management? Infection. 2011; 39(3):211-5. doi: 10.1007/s15010-011-0112-x PMID: 21509426
57. Brinkman S, Abu-Hanna A, de Jonge E, de Keizer N. Prediction of long-term mortality in ICU patients: model validation and assessing the effect of using in-hospital versus long-term mortality on benchmarking. Intensive Care Med. 2013; 39(11):1925-31. doi: 10.1007/s00134-013-3042-5 PMID: 23921978
58. Krumholz HM, Lin Z, Drye EE, Desai MM, Han LF, Rapp MT, et al. An Administrative Claims Measure Suitable for Profiling Hospital Performance Based on 30-Day All-Cause Readmission Rates Among Patients With Acute Myocardial Infarction. Circulation Cardiovascular Quality and Outcomes. 2011; 4 (2):243-52. doi: 10.1161/CIRCOUTCOMES.110.957498 PMID: PMC3350811.
59. Varagunam M, Hutchings A, Black N. Do patient-reported outcomes offer a more sensitive method for comparing the outcomes of consultants than mortality? A multilevel analysis of routine data. BMJ Quality & Safety. 2014. doi: 10.1136/bmjqs-2014-003551
60. Wagner P, Merlo J. Measures of discriminatory accuracy are an alternative to the Median Odds Ratio and intra-class correlation for estimating contextual effects in multilevel analyses. EUROEPI (submitted) Lund University, working paper ©. 2013.
61. Saunders L, Perennec-Olivier M, Jarno P, L'Hériteau F, Venier A-G, Simon L, et al. Improving Prediction of Surgical Site Infection Risk with Multilevel Modeling. PLoS ONE. 2014; 9(5):e95295. doi: 10. 1371/journal.pone.0095295 PMID: 24835189
62. Merlo J, Broms K, Ostergren PO, Hagberg O, Norlund A, Lithman T. [Multilevel analysis of regional disparities in survival after heart failure: differences between county health services affect little patients' prognosis]. Lakartidningen. 2001; 98(44):4838-44. Epub 2001/12/04. PMID: 11729797.
63. Lynch KF, Subramanian SV, Ohlsson H, Chaix B, Lernmark A, Merlo J. Context and disease when disease risk is low: the case of type 1 diabetes in Sweden. J Epidemiol Community Health. 2010; 64 (9):789-95. Epub 2009/10/17. doi: 10.1136/jech.2008.083667 PMID: 19833608.
64. Merlo J. Multilevel analytical approaches in social epidemiology: measures of health variation compared with traditional measures of association. J Epidemiol Community Health. 2003; 57(8):550-2. Epub 2003/07/29. PMID: 12883048; PubMed Central PMCID: PMC1732554.
65. Merlo J. Invited commentary: multilevel analysis of individual heterogeneity - a fundamental critique of the current probabilistic risk factor epidemiology. American Journal of Epidemiology. 2014; 180 (2):208-12. Epub 2014/06/14. doi: 10.1093/aje/kwu108 PMID: 24925064.
66. Krumholz HM, Lin Z, Normand S-LT. Measuring hospital clinical outcomes. BMJ. 2013; 346. doi: 10. 1136/bmj.f620
67. Merlo J, Chaix B, Ohlsson H, Beckman A, Johnell K, Hjerpe P, et al. A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. Journal of Epidemiology and Community Health. 2006; 60(4):290-7. doi: 10.1136/jech.2004.029454 PMID: 16537344