Fixed effects modelling for provider mortality outcomes: Analysis of the Australia and New Zealand Intensive Care Society (ANZICS) adult patient data-base

PLoS ONE

Volumn 9, Issue 7, 2014, Pages

  Moran, John L ^a   Solomon, Patricia J ^b  

^a QUEEN ELIZABETH HOSPITAL   (Australia)

^b UNIVERSITY OF ADELAIDE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUSTRALIA; AUSTRALIA AND NEW ZEALAND INTENSIVE CARE SOCIETY ADULT PATIENT DATABASE; AVERAGE MARGINAL EFFECT; BAYESIAN LEARNING; COHORT ANALYSIS; DATA BASE; FEMALE; FIXED EFFECT MODEL; GRAND OBSERVATION WEIGHTED MEAN; HOSMER LEMESHOW STATISTIC; HUMAN; INTENSIVE CARE UNIT; MAJOR CLINICAL STUDY; MALE; MORTALITY; NEW ZEALAND; PROBABILITY; RECEIVER OPERATING CHARACTERISTIC; RISK ASSESSMENT; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICAL PARAMETERS; AGED; FACTUAL DATABASE; HEALTH CARE PERSONNEL; HOSPITAL; INTENSIVE CARE; MIDDLE AGED; STATISTICS AND NUMERICAL DATA;

ADULT; AGED; AUSTRALIA; DATABASES, FACTUAL; FEMALE; HEALTH PERSONNEL; HOSPITALS; HUMANS; INTENSIVE CARE; MALE; MIDDLE AGED; MODELS, STATISTICAL; MORTALITY; NEW ZEALAND;

EID: 84904321816     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0102297     Document Type: Article

References (82)

1. Normand S-LT, Shahian DM (2007) Statistical and Clinical Aspects of Hospital Outcomes Profiling. Statistical Science 22: 206-226.
2. Shahian DM, Normand SL (2008) Comparison of "risk-adjusted" hospital outcomes. Circulation 117: 1955-1963.
3. van Gestel YRBM, Lemmens VEPP, Lingsma HF, de Hingh IHJT, Rutten HJT et al. (2012) The Hospital Standardized Mortality Ratio Fallacy A Narrative Review. Med Care 50: 662-667.
4. Iezzoni LI (1997) The risks of risk adjustment. JAMA 278: 1600-1607.
5. Kipnis P, Escobar GJ, Draper D (2010) Effect of Choice of Estimation Method on Inter-Hospital Mortality Rate Comparisons. Med Care 48: 458-465.
6. DeLong ER, Peterson ED, DeLong DM, Muhlbaier LH, Hackett S, et al. (1997) Comparing risk-adjustment methods for provider profiling. Stat Med 16: 2645-2664. (Pubitemid 27496913)
7. Normand S-LT, Glickman ME, Gatsonis CA (1997) Statistical methods for profiling providers of medical care: issues and applications. Journal of the American Statistical Association 92: 803-814.
8. Concato J, Feinstein AR, Holford TR (1993) The Risk of Determining Risk with Multivariable Models. Ann Intern Med 118: 201-210. (Pubitemid 23034807)
9. Christiansen CL, Morris CN (1997) Improving the statistical approach to health care provider profiling. Ann Intern Med 127: 764-768. (Pubitemid 27446563)
10. Moore L, Hanley JA, Turgeon AF, Lavoie A (2010) Evaluating the Performance of Trauma Centers: Hierarchical Modeling Should be Used. Journal of Trauma-Injury Infection and Critical Care 69: 1132-1137.
11. Shahian DM, Torchiana DF, Shemin RJ, Rawn JD, Normand SL (2005) Massachusetts Cardiac Surgery Report Card: Implications of Statistical Methodology. The Annals of Thoracic Surgery 80: 2106-2113. (Pubitemid 41718036)
12. Kasza J, Moran JL, Solomon PJ (2013) Evaluating the performance of Australian and New Zealand intensive care units in 2009 and 2010. Stat Med 13: 3720-3736.
13. Mukamel DB, Glance LG, Dick AW, Osler TM (2010) Measuring Quality for Public Reporting of Health Provider Quality: Making It Meaningful to Patients. Am J Public Health 100: 264-269.
14. Silber JH, Rosenbaum PR, Brachet TJ, Ross RN, Bressler LJ, et al. (2010) The Hospital Compare Mortality Model and the Volume-Outcome Relationship. Health Serv Res 45: 1148-1167.
15. Ash AS, Fienberg SE, Louis TA, Norman SL, Stukel TA, et al. (2012) Statistical issues in assessing hospital performance. Committee of Presidents of Statistical Societies.
16. Kalbfleisch J, Wolfe R (2013) On Monitoring Outcomes of Medical Providers. Stat Biosci 1-17.
17. Cohen ME, Dimick JB, Bilimoria KY, Ko CY, Richards K, et al. (2009) Risk Adjustment in the American College of Surgeons National Surgical Quality Improvement Program: A Comparison of Logistic Versus Hierarchical Modeling. J Am Coll Surg 209: 687-693.
18. Alexandrescu R, Jen MH, Bottle A, Jarman B, Aylin P (2011) Logistic Versus Hierarchical Modeling: An Analysis of a Statewide Inpatient Sample. J Am Coll Surg 213: 392-401.
19. Hannan ELP, Wu CM, DeLong ERP, Raudenbush SWE (2005) Predicting Risk-Adjusted Mortality for CABG Surgery: Logistic Versus Hierarchical Logistic Models. Med Care 43: 726-735.
20. Austin PC, Alter DA, Tu JV (2003) The use of fixed- and random-effects models for classifying hospitals as mortality outliers: a Monte Carlo assessment. Med Decis Making 23: 526-529.
21. Mood C (2010) Logistic Regression: Why We Cannot Do What We Think We Can Do, and What We Can Do About It. Eur Sociol Rev 26: 67-82.
22. Angrist JD (2001) Estimation of limited dependent variable models with dummy endogenous regressors: Simple strategies for empirical practice. Journal of Business & Economic Statistics 19: 2-16.
23. Stow PJ, Hart GK, Higlett T, George C, Herkes R, et al. (2006) Development and implementation of a high-quality clinical database: the Australian and New Zealand Intensive Care Society Adult Patient Database. J Crit Care 21: 133-141. (Pubitemid 43850185)
24. Australian and New Zealand Intensive Care Society (2013) Centre for Outcome and Resource Evaluation (ANZICS CORE). Available: http://www.anzics.com. au/core. Accessed 2013 Jan 20.
25. Cameron CC, Trivedi PK (2010) Nonlinear regression methods. In: Microeconomics using Stata. College Station, Texas: Stata Press. pp. 319-362.
26. Williams R (2012) Using the margins command to estimate and interpret adjusted predictions and marginal effects. Stata Journal 12: 308-331.
27. Muller CJ, MacLehose RF (2014) Estimating predicted probabilities from logistic regression: different methods correspond to different target populations. Int J Epidemiol.
28. Stata Corporation (2013) Margins - Marginal means, predictive margins, and marginal effects. Available: http://www.stata.com/manuals13/margins.pdf. Accessed 2013 Sep 14.
29. Moran JL, Bristow P, Solomon PJ, George C, Hart GK, et al. (2008) Mortality and length-of-stay outcomes, 1993-2003, in the binational Australian and New Zealand intensive care adult patient database. Crit Care Med 36: 46-61.
30. Moran JL, Solomon PJ (2012) Mortality and Intensive Care volume in ventilated patients, 1995-2009, in the Australian and New Zealand bi-national adult patient intensive care database. Crit Care Med 40: 800-812.
31. Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, et al. (1991) The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 100: 1619-1636.
32. Wagner D, Knaus W, Bergner M (1989) Statistical-Methods. Crit Care Med 17: S194-S198.
33. ANZICS Centre for Outcome and Resource Evaluation (CORE) of the Australian and New Zealand Intensive Care Society (ANZICS) (2012) APD Data Dictionary: Version 3.2 Updated February 2012. Available: http://www.anzics.com. au/core/data-collection-tools. Accessed 2012 Sep 21.
34. Kahn JM, Goss CH, Heagerty PJ, Kramer AA, O'Brien CR, et al. (2006) Hospital Volume and the Outcomes of Mechanical Ventilation. N Engl J Med 355: 41-50.
35. Gunasekara FI, Richardson K, Carter K, Blakely T (2014) Fixed effects analysis of repeated measures data. Int J Epidemiol 43: 264-269.
36. Rogers W (1993) sg17: Regression standard errors in clustered samples. Stata Technical Bulletin Reprints 3: 88-94.
37. Stata Corporation (2013) Estimation and postestimation commands. Available: http://www.stata.com/manuals13/u20.pdf. Accessed 2013 Sep 14.
38. Angrist JD, Pischke J-S (2009) Nonstandard error issues. In: Mostly Harmless Econometrics: An Empiricist's Companion. Princeton, NJ: Princeton University Press. pp. 293-323.
39. Rabe-Hesketh S, Skrondal A, Pickles A (2002) Reliable estimation of generalized linear mixed models using adaptive quadrature. Stata Journal 2: 1-21.
40. Stolwijk AM, Straatman H, Zielhuis GA (1999) Studying seasonality by using sine and cosine functions in regression analysis. J Epidemiol Community Health 53: 235-238. (Pubitemid 29137686)
41. Harrell FE Jr. (2001) Regression modelling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer-Verlag.
42. Stata Corporation (2013) -rmcoll - Remove collinear variables. Available: http://www.stata.com/manuals13/p.pdf. Accessed 2013 Sep 14.
43. Rowan KM, Kerr JH, Major E, McPherson K, Short A, et al. (1993) Intensive Care Society's APACHE II study in Britain and Ireland - I: Variations in case mix of adult admissions to general intensive care units and impact on outcome. BMJ 307: 972-977. (Pubitemid 23306763)
44. Paul P, Pennell ML, Lemeshow S (2013) Standardizing the power of the Hosmer-Lemeshow goodness of fit test in large data sets. Stat Med 32: 67-80.
45. Wilk MB, Gnanades R (1968) Probability Plotting Methods for Analysis of Data. Biometrika 55: 1-17.
46. Gelman A, Hill J (2007) Logistic Regression. In: Data analysis using Regression and Multilelvel/ Hierarchal Models. New York, NY: Cambridge University Press. pp. 79-108.
47. O'Brien BJ, Drummond MF, Labelle RJ, Willan A (1994) In search of power and significance: issues in the design and analysis of stochastic cost-effectiveness studies in health care. Med Care 32: 150-163.
48. Gabriel KR, Odoroff CL (1990) Biplots in medical research. Stat Med 9: 469-485.
49. Moran J, Solomon P, Australian and New Zealand Intensive Care Society (ANZICS) (2010) Global quantitative indices reflecting provider process-of-care: data-base derivation. BMC Medical Research Methodology 10: 32.
50. Mustillo S, Landerman LR, Land KC (2012) Modeling Longitudinal Count Data: Testing for Group Differences in Growth Trajectories Using Average Marginal Effects. Sociological Methods & Research 41: 467-487.
51. Norton EC (2012) Log odds and ends. NBER Working Paper Series. Available: http://www.nber.org/papers/w18252. Accessed 2013 Oct 2.
52. Bartus T (2005) Estimation of marginal effects using margeff. Stata Journal 5: 309-329.
53. Vittinghoff E, Glidden DV, Shiboski SC, McCulloch CE (2012) Strengthening causal inference. In: Vittinghoff E, Glidden DV, Shiboski SC, McCulloch CE, editors. Regression methods in Biostatistics: Linear, logistic, suvival and repeated measures models. New York: Springer Science+Business Media, LLC. pp. 331-394.
54. Clarke PS, Windmeijer F (2010) Identification of causal effects on binary outcomes using structural mean models. Biostat 11: 756-770.
55. Graubard BI, Korn EL (1999) Predictive margins with survey data. Biometrics 55: 652-659. (Pubitemid 29302598)
56. Chang IM, Gelman R, Pagano M (1982) Corrected Group Prognostic Curves and Summary Statistics. J Chronic Dis 35: 669-674. (Pubitemid 12099867)
57. Lane PW, Nelder JA (1982) Analysis of Covariance and Standardization as Instances of Prediction. Biometrics 38: 613-621. (Pubitemid 13286338)
58. Stata Corporation (2013) nlcom - Nonlinear combinations of estimators. Available: http://www.stata.com/manuals13/r.pdf. Accessed 2013 Sep 14.
59. Mitchell MN (2012) Categorical predictors. In: Mitchell MN, editors.Interpret-Interpreting and Visualizing Regression Models Using Stata. College Station, TX: Stata Press. pp. 167-208.
60. Krumholz HM, Wang Y, Mattera JA, Wang YF, Han LF, et al. (2006) An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with heart failure. Circulation 113: 1693-1701.
61. Glance LG, Dick A, Osler TM, Li Y, Mukamel DB (2006) Impact of changing the statistical methodology on hospital and surgeon ranking: the case of the New York State cardiac surgery report card. Med Care 44: 311-319. (Pubitemid 43755434)
62. Glance LG, Dick AW, Osler TM, Mukamel D (2003) Using hierarchical modeling to measure ICU quality. Intensive Care Med 29: 2223-2229. (Pubitemid 38030676)
63. Chan CK, Feinstein AR, Jekel JF, Wells CK (1988) The Value and Hazards of Standardization in Clinical Epidemiologic Research. J Clin Epidemiol 41: 1125-1134. (Pubitemid 19037940)
64. Grunkemeier GL, Wu Y (2007) What are the odds? Ann Thorac Surg 83: 1240-1244. (Pubitemid 46440793)
65. Sanagou M, Wolfe R, Forbes A, Reid CM (2012) Hospital-level associations with 30-day patient mortality after cardiac surgery: a tutorial on the application and interpretation of marginal and multilevel logistic regression. BMC Medical Research Methodology 12.
66. Pouw ME, Peelen LM, Lingsma HF, Pieter D, Steyerberg E, et al. (2013) Hospital standardized mortality ratio: consequences of adjusting hospital mortality with indirect standardization. Plos One 8: e59160.
67. Mohammed MA, Manktelow BN, Hofer TP (2012) Comparison of four methods for deriving hospital standardised mortality ratios from a single hierarchical logistic regression model. Stat Methods Med Res.
68. Harrison DAP, Brady ARM, Parry GJP, Carpenter JRD, Rowan KD (2006) Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med 34: 1378-1388.
69. Greene WH (2001) Estimating Econometric Models With Fixed Effects. Available: http://www.stern.nyu.edu/eco/wkpapers/workingpapers01/01-10Greene. doc. Accessed 2010 Oct 13.
70. Mroz TA, Zayats YV (2008) Arbitrarily Normalized Coefficients, Information Sets, and False Reports of Biases in Binary Outcome Models. Rev Econ Stat 90: 406-413.
71. Williams RL (2000) A Note on Robust Variance Estimation for Cluster-Correlated Data. Biometrics 56: 645-646.
72. Bryan ML, Jenkins SP (2013) Regression analysis of country effects using multilevel data: a cautionary tale. ISER Working Paper Series: 2013-14. Available: https://www.iser.essex.ac.uk/publications/working-papers/iser/2013- 14; Accessed 2013 Sep 22.
73. Madigan D, Ryan PB, Schuemie M, Stang PE, Overhage JM, et al. (2013) Evaluating the Impact of Database Heterogeneity on Observational Study Results. Am J Epidemiol.
74. MacKenzie TA, Brown JR, Likosky DS, Wu Y, Grunkemeier GL (2012) Review of Case-Mix Corrected Survival Curves. Ann Thorac Surg 93: 1416-1425.
75. Goldstein H, Healy MJR (1995) The graphical presentation of a collection of means. Journal of the Royal Statistical Society, A 158: 175-177.
76. Mohammed MA, Deeks JJ (2008) In the Context of Performance Monitoring, the Caterpillar Plot Should Be Mothballed in Favor of the Funnel Plot. The Annals of Thoracic Surgery 86: 348.
77. Spiegelhalter D (2002) Funnel plots for institutional comparison. Quality & Safety in Health Care 11: 390-391.
78. Stata Corporation (2013) pwcompare - Pairwise comparisons. Available: http://www.stata.com/manuals13/r.pdf. Accessed 2013 Sep 14.
79. Hosmer DW, Lemeshow S (1997) Confidence interval estimates of an index of quality performance based on logistic regression models - Reply. Stat Med 16: 1303.
80. Solomon PJ, Kasza J, Moran JL (2014) Identifying unusual performance in Australian and New Zealand intensive care units from 2000 to 2010. BMC Medical Research Methodology 14.
81. Verbeke G, Molenberghs G (2013) The gradient function as an exploratory goodness-of-fit assessment of the random-effects distribution in mixed models. Biostat doi:10.1093/biostatistics/kxs059.
82. Fielding A (2004) The role of the Hausman test and whether higher level effects should be treated as random or fixed. Multilevel Modelling Newsletter 16. Available: http://www.cmm.bristol.ac.uk/learning-training/multilevel- msupport/new16-2.pdf. Accessed 2010 Mar 6.