Assessing discriminative ability of risk models in clustered data

BMC Medical Research Methodology

Volumn 14, Issue 1, 2014, Pages

  Van Klaveren, David ^a   Steyerberg, Ewout W ^a   Perel, Pablo ^b   Vergouwe, Yvonne ^a  

^a ERASMUS MEDICAL CENTER   (Netherlands)

^b LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

Author keywords

Clustered data; Concordance; Discrimination; Meta analysis; Prediction; Risk model

Indexed keywords

ADULT; ARTICLE; BRAIN INJURY; CLUSTER ANALYSIS; HUMAN; MIDDLE AGED; MORTALITY; OCULOGRAPHY; RISK ASSESSMENT; STATISTICAL MODEL; THEORETICAL MODEL; YOUNG ADULT;

ADULT; BRAIN INJURIES; CLUSTER ANALYSIS; EYE MOVEMENT MEASUREMENTS; HUMANS; MIDDLE AGED; MODELS, STATISTICAL; MODELS, THEORETICAL; RISK ASSESSMENT; YOUNG ADULT;

EID: 84893053141     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-14-5     Document Type: Article

References (31)

1. Assessing the performance of prediction models: a framework for traditional and novel measures. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW, Epidemiology 2010 21 1 128 138 10.1097/EDE.0b013e3181c30fb2 20010215
2. Evaluating the yield of medical tests. Harrell FE Jr, Califf RM, Pryor DB, Lee KL, Rosati RA, JAMA 1982 247 18 2543 2546 10.1001/jama.1982. 03320430047030 7069920 (Pubitemid 12155954)
3. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Pencina MJ, D'Agostino RB, Stat Med 2004 23 13 2109 2123 10.1002/sim.1802 15211606 (Pubitemid 38968032)
4. Prediction models for clustered data: comparison of a random intercept and standard regression model. Bouwmeester W, Twisk JW, Kappen TH, van Klei WA, Moons KG, Vergouwe Y, BMC Med Res Methodol 2013 13 19 10.1186/1471-2288-13-19 23414436
5. Gelman A, Hill J, Data analysis using regression and multilevel/ hierarchical models Cambridge: Cambridge University Press 2007
6. Duchateau L, Janssen P, The Frailty Model New York: Springer 2008
7. An application of Harrell's C-index to PH frailty models. Van Oirbeek R, Lesaffre E, Stat Med 2010 29 30 3160 3171 10.1002/sim.4058 21170910
8. Assessing the predictive ability of a multilevel binary regression model. Van Oirbeek R, Lesaffre E, Comput Stat Data Anal 2012 56 6 1966 1980 10.1016/j.csda.2011.11.023
9. Predicting outcome after traumatic brain injury: practical prognostic models based on large cohort of international patients. Collaborators MCT, Perel P, Arango M, Clayton T, Edwards P, Komolafe E, Poccock S, Roberts I, Shakur H, Steyerberg E, et al. BMJ 2008 336 7641 425 429 18270239 (Pubitemid 351310887)
10. Predicting outcome after traumatic brain injury: development and international validation of prognostic scores based on admission characteristics. Steyerberg EW, Mushkudiani N, Perel P, Butcher I, Lu J, McHugh GS, Murray GD, Marmarou A, Roberts I, Habbema JD, et al. PLoS Med 2008 5 8 165 10.1371/journal.pmed.0050165 18684008
11. Final results of MRC CRASH, a randomised placebo-controlled trial of intravenous corticosteroid in adults with head injury-outcomes at 6 months. Edwards P, Arango M, Balica L, Cottingham R, El-Sayed H, Farrell B, Fernandes J, Gogichaisvili T, Golden N, Hartzenberg B, et al. Lancet 2005 365 9475 1957 1959 15936423
12. Assessment of coma and impaired consciousness. A practical scale. Teasdale G, Jennett B, Lancet 1974 2 7872 81 84 4136544
13. Assessment of outcome after severe brain damage. Jennett B, Bond M, Lancet 1975 1 7905 480 484 46957
14. R Development Core Team, R: A Language and Environment for Statistical Computing Vienna, Austria: R Foundation for Statistical Computing 2011 ISBN 3-900051-07-0, URL http://www.R-project.org/
15. survival: Survival analysis, including penalised likelihood. R package version 2.36-9. Therneau T, original Splus->R port by Lumley T, 2011 http://CRAN.R-project.org/package=survival
16. Quade D, Nonparametric partial correlation. Volume No. 526 North Carolina: Institute of Statistics Mimeo 1967 Volume 526
17. Quantifying heterogeneity in a meta-analysis. Higgins JP, Thompson SG, Stat Med 2002 21 11 1539 1558 10.1002/sim.1186 12111919 (Pubitemid 34746062)
18. Meta-analysis in clinical trials. DerSimonian R, Laird N, Control Clin Trials 1986 7 3 177 188 10.1016/0197-2456(86)90046-2 3802833 (Pubitemid 17189972)
19. Random-effects model for meta-analysis of clinical trials: an update. DerSimonian R, Kacker R, Contemp Clin Trials 2007 28 2 105 114 10.1016/j.cct.2006.04.004 16807131 (Pubitemid 44937874)
20. A re-evaluation of random-effects meta-analysis. Higgins JPT, Thompson SG, Spiegelhalter DJ, J R Soc Health Series A 2009 172 1 137 159
21. Interpretation of random effects meta-analyses. Riley RD, Higgins JPT, Deeks JJ, BMJ 2011 342 549 10.1136/bmj.d549 21310794
22. Detecting and describing heterogeneity in meta-analysis. Hardy RJ, Thompson SG, Stat Med 1998 17 8 841 856 10.1002/(SICI)1097-0258(19980430)17: 8<841::AID-SIM781>3.0.CO;2-D 9595615 (Pubitemid 28185164)
23. rmeta: Meta-analysis. R package version 2.16. Lumley T, 2009 http://CRAN.R-project.org/package=rmeta
24. External validity of risk models: use of benchmark values to disentangle a case-mix effect from incorrect coefficients. Vergouwe Y, Moons KG, Steyerberg EW, Am J Epidemiol 2010 172 8 971 980 10.1093/aje/kwq223 20807737
25. Steyerberg EW, Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating New York: Springer 2009
26. Concordance probability and discriminatory power in proportional hazards regression. Gönen M, Heller G, Biometrika 2005 92 4 965 970 10.1093/biomet/92.4.965 (Pubitemid 41681247)
27. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Uno H, Cai T, Pencina MJ, D'Agostino RB, Wei LJ, Stat Med 2011 30 10 1105 1117 21484848
28. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Hanley JA, McNeil BJ, Radiology 1982 143 1 29 36 7063747 (Pubitemid 12142173)
29. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. DeLong ER, DeLong DM, Clarke-Pearson DL, Biometrics 1988 44 3 837 845 10.2307/2531595 3203132
30. Discrimination Index, the Area under the ROC Curve. Nam BH, D'Agostino RB, Goodness-of-Fit Tests and Model Validity Boston: Birkhauser 2002 267 279
31. Efron B, Tibshirani R, An Introduction to the Bootstrap Boca Raton, FL: CRC press 1993