Forest and funnel plots illustrated the calibration of a prognostic model: a descriptive study

Journal of Clinical Epidemiology

Volumn 60, Issue 7, 2007, Pages

  Ming Ho, Kwok ^a,b  

^a ROYAL PERTH HOSPITAL   (Australia)

^b UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

Critically ill; Model calibration; Outcome prediction; Risk adjustment; Standardized mortality ratio; Uniformity of fit

Indexed keywords

ADULT; AGED; APACHE; ARTICLE; AUSTRALIA; CALIBRATION; CRITICALLY ILL PATIENT; DATA BASE; DESCRIPTIVE RESEARCH; FOREST PLOT; FUNNEL PLOT; HUMAN; INTENSIVE CARE UNIT; MODEL; MORTALITY; MULTIPLE TRAUMA; PLOTS AND CURVES; PREDICTION; PRIORITY JOURNAL; PROGNOSIS; RISK ASSESSMENT;

EID: 34250012858     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2006.10.017     Document Type: Article

References (24)

1. Knaus W.A. APACHE 1978-2001: the development of a quality assurance system based on prognosis: milestones and personal reflections. Arch Surg 137 (2002) 37-41
2. Gunning K., and Rowan K. ABC of intensive care: outcome data and scoring systems. BMJ 319 (1999) 241-244
3. den Boer S., de Keizer N.F., and de Jonge E. Performance of prognostic models in critically ill cancer patients-a review. Crit Care 9 (2005) R458-R463
4. Hosmer D.W., and Lemeshow S. Applied logistic regression (2000), John Wiley & Sons, New York
5. Moreno R., Apolone G., and Miranda D.R. Evaluation of the uniformity of fit of general outcome prediction models. Intensive Care Med 24 (1998) 40-47
6. Moreno R.P., Metnitz P.G., Almeida E., Jordan B., Bauer P., Campos R.A., et al. SAPS 3 Investigators. SAPS 3-from evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 31 (2005) 1345-1355
7. Ho K.M., Dobb G.J., Knuiman M., Finn J., Lee K.Y., and Webb S.A. A comparison of admission and worst 24-hour Acute Physiology and Chronic Health Evaluation II scores in predicting hospital mortality: a retrospective cohort study. Crit Care 10 (2005) R4
8. Egger M., Smith G.D., and Altman D.G. Systematic reviews in health care: meta-analysis in context (2001), BMJ, London
9. Knaus W.A., Draper E.A., Wagner D.P., and Zimmerman J.E. APACHE II: a severity of disease classification system. Crit Care Med 13 (1985) 818-829
10. Ho K.M., Finn J., Dobb G.J., and Webb S.A. The outcome of critically ill indigenous patients. Med J Aust 184 (2006) 496-499
11. Cox D.R. Two further applications of a model for binary regression. Biometrika 45 (1958) 562-565
12. Vergouwe Y., Steyerberg E.W., Eijkemans M.J., and Habbema J.D. Substantial effective sample sizes were required for external validation studies of predictive logistic regression models. J Clin Epidemiol 58 (2005) 475-483
13. Steyerberg E.W., Borsboom G.J., van Houwelingen H.C., Eijkemans M.J., and Habbema J.D. Validation and updating of predictive logistic regression models: a study on sample size and shrinkage. Stat Med 23 (2004) 2567-2586
14. Higgins J.P., Thompson S.G., Deeks J.J., and Altman D.G. Measuring inconsistency in meta-analyses. BMJ 327 (2003) 557-560
15. Zimmerman J.E., Shortell S.M., Rousseau D.M., Duffy J., Gillies R.R., Knaus W.A., et al. Improving intensive care: observations based on organizational case studies in nine intensive care units: a prospective, multicenter study. Crit Care Med 21 (1993) 1443-1451
16. Glance L.G., Osler T.M., and Dick A. Rating the quality of intensive care units: is it a function of the intensive care unit scoring system?. Crit Care Med 30 (2002) 1976-1982
17. Afessa B., Keegan M.T., Hubmayr R.D., Naessens J.M., Gajic O., Long K.H., et al. Evaluating the performance of an institution using an intensive care unit benchmark. Mayo Clin Proc 80 (2005) 174-180
18. Beck D.H., Smith G.B., and Taylor B.L. The impact of low-risk intensive care unit admissions on mortality probabilities by SAPS II, APACHE II and APACHE III. Anaesthesia 57 (2002) 21-26
19. Glance L.G., Osler T.M., and Papadakos P. Effect of mortality rate on the performance of the acute physiology and chronic health evaluation II: a simulation study. Crit Care Med 28 (2000) 3424-3428
20. Metnitz P.G., Lang T., Vesely H., Valentin A., and Le Gall J.R. Ratios of observed to expected mortality are affected by differences in case mix and quality of care. Intensive Care Med 26 (2000) 1466-1472
21. Chawda M.N., Hildebrand F., Pape H.C., and Giannoudis P.V. Predicting outcome after multiple trauma: which scoring system?. Injury 35 (2004) 347-358
22. Zhu B.P., Lemeshow S., Hosmer D.W., Klar J., Avrunin J., and Teres D. Factors affecting the performance of the models in the Mortality Probability Model II system and strategies of customization: a simulation study. Crit Care Med 24 (1996) 57-63
23. Hosmer D.W., and Hjort N.L. Goodness-of-fit processes for logistic regression: simulation results. Stat Med 21 (2002) 2723-2738
24. Altman D.G., Machin D., Byrant T.N., and Gardner M.J. Statistics with confidence (2000), BMJ, Bristol