Visualizing and assessing discrimination in the logistic regression model

Statistics in Medicine

Volumn 29, Issue 24, 2010, Pages 2508-2520

  Royston, Patrick ^a   Altman, Douglas G ^b  

^a MRC CLINICAL TRIALS UNIT   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Clinical prediction models; Discrimination; Effect size; Logistic regression; ROC area; Visualization

Indexed keywords

AREA UNDER THE CURVE; ARTICLE; BREAST CANCER; CANCER DIAGNOSIS; EFFECT SIZE; HISTOGRAM; ISCHEMIC HEART DISEASE; LOGISTIC REGRESSION ANALYSIS; OUTCOME ASSESSMENT; PERFORMANCE MEASUREMENT SYSTEM; PREDICTION; PROGNOSIS; RECEIVER OPERATING CHARACTERISTIC; SCORING SYSTEM; SENSITIVITY AND SPECIFICITY; SIMULATION;

BREAST NEOPLASMS; CONFIDENCE INTERVALS; CORONARY DISEASE; DATA DISPLAY; DECISION SUPPORT TECHNIQUES; DISCRIMINANT ANALYSIS; FEMALE; HUMANS; LOGISTIC MODELS; MULTIVARIATE ANALYSIS; PREDICTIVE VALUE OF TESTS; PROGNOSIS; RISK ASSESSMENT; ROC CURVE; TREATMENT OUTCOME;

EID: 77958482572     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.3994     Document Type: Article

References (38)

1. Altman DG. Practical Statistics for Medical Research. Chapman & Hall: London, 1991.
2. Hosmer DW, Lemeshow S. Applied Logistic Regression (2nd edn). Wiley: New York, 2000.
3. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW. Assessing the performance of prediction models. Epidemiology 2010; 21:128-138.
4. Nashef SAM, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. and the EuroSCORE study group. European system for cardiac operative risk evaluation (EuroSCORE). European Journal of Cardiothoracic Surgery 1999; 16:9-13.
5. Roques F, Nashef SAM, Michel P, Gauducheau E, de Vincentiis C, Baudet E, Cortina J, David M, Faichney A, Gavrielle F, Gams E, Harjula A, Jones MT, Pinna Pintor P, Salamon R, Thulin L. Risk factors and outcome in European cardiac surgery: analysis of the EuroSCORE multinational database of 19030 patients. European Journal of Cardio-Thoracic Surgery 1999; 15:816-823.
6. Knaus WA, Zimmerman JE, Wagner DP, Draper EA, Lawrence DE. APACHE-Acute Physiology and Chronic Health Evaluation: a physiologically based evaluation system. Critical Care Medicine 1981; 9:591-597.
7. Antman EM, Cohen M, Bernink PJLM, McCabe CH, Horacek T, Papuchis G, Mautner B, Corbalan R, Radley D, Braunwald E. The TIMI risk score for unstable angina/non-ST elevation MI. Journal of the American Medical Association 2000; 284:835-842.
8. Van den Bosch JE, Kalkman CJ, Vergouwe Y, Van Klei WA, Bonsel GJ, Grobbee DE, Moons KGM. Assessing the applicability of scoring systems for predicting postoperative nausea and vomiting. Anaesthesia 2005; 60:323-331.
9. Royston P, Moons KGM, Altman DG, Vergouwe Y. Prognosis and prognostic research: developing a prognostic model. British Medical Journal 2009; 338:b604.
10. Pocock SJ, McCormack V, Gueyffier F, Boutitie F, Fagard RH, Boissel J-P. and on behalf of the INDANA project steering committee. A score for predicting risk of death from cardiovascular disease in adults with raised blood pressure, based on individual patient data from randomized controlled trials. British Medical Journal 2001; 323:75-81.
11. Pepe MS, Janes H, Longton G, Leisenring W, Newcomb P. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. American Journal of Epidemiology 2004; 159:882-890.
12. Saunders IW. A measure of the performance of biomarkers for disease. Cancer Biomarkers 2006; 2:145-150.
13. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143:29-36.
14. Pepe MS, Longton G. Standardizing diagnostic markers to evaluate and compare their performance. Epidemiology 2005; 16:598-603.
15. Harrell Jr FE, Califf RM, Prior DB, Lee KL, Rosati RA. Evaluating the yield of medical tests. Journal of the American Medical Association 1982; 247:2543-2546.
16. Harrell FE, Lee KL, Califf RM, Pryor DB, Rosati RA. Regression modeling strategies for improved prognostic prediction. Statistics in Medicine 1984; 3:143-152.
17. Hand DJ. Construction and Assessment of Classification Rules. Wiley: Chichester, 1997.
18. Hedges LV. Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics 1981; 6:107-128.
19. Cohen J. Statistical Power Analysis for the Behavioral Sciences (2nd edn). Lawrence Erlbaum Associates: Hillsdale, NJ, 1988.
20. Bradley EL. Overlapping coefficient. Encyclopedia of Statistical Sciences, vol. 6. Wiley: New York, 1985; 546-547.
21. Rom DR, Hwang E. Testing for individual and population equivalence based on the proportion of similar responses. Statistics in Medicine 1996; 15:1489-1505.
22. Stine RA, Heyse JF. Non-parametric estimates of overlap. Statistics in Medicine 2001; 20:215-236.
23. Clemons TE, Bradley EL. A nonparametric measure of the overlapping coefficient. Computational Statistics and Data Analysis 2000; 34:51-61.
24. Mizuno S, Yamaguchi T, Fukushima A, Matsuyama Y, Ohashi Y. Overlap coefficient for assessing the similarity of pharmacokinetic data between ethnically different populations. Clinical Trials 2005; 2:174-181.
25. Senn S. Testing for individual and population equivalence based on the proportion of similar responses [letter]. Statistics in Medicine 1997; 16:1301-1306.
26. Royston P, Ambler G, Sauerbrei W. The use of fractional polynomials to model continuous risk variables in epidemiology. International Journal of Epidemiology 1999; 28:964-974.
27. Sauerbrei W, Royston P. Building multivariable prognostic and diagnostic models: transformation of the predictors using fractional polynomials. Journal of the Royal Statistical Society, Series A 1999; 162:71-94.
28. Royston P, Sauerbrei W. Building multivariable regression models with continuous covariates in clinical epidemiology, with an emphasis on fractional polynomials. Methods of Information in Medicine 2005; 44:561-571.
29. Altman DG, Vergouwe Y, Royston P, Moons KGM. Prognosis and prognostic research: validating a prognostic model. British Medical Journal 2009; 338:b605.
30. Brown JR, Cochran RP, Leavitt BJ, Dacey LJ, Ross CS, MacKenzie TA, Kunzelman KS, Kramer RS, Hernandez F, Helm RE, Westbrook BM, Dunton RF, Malenka DJ, O'Connor GT. and for the Northern New England Cardiovascular Disease Study Group. Multivariable prediction of renal insufficiency developing after cardiac surgery. Circulation 2007; 116(suppl I):I-139-I-143.
31. Burd RS, Jang TS, Nair SS. Predicting hospital mortality among injured children using a national trauma database. Journal of Trauma 2006; 60:792-801.
32. Harrison DA, Brady AR, Parry GJ, Carpenter JR, Rowan K. Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Critical Care Medicine 2006; 34:1378-1388.
33. Walter SD. Properties of the summary receiver operating characteristic (roc) curve for diagnostic test data. Statistics in Medicine 2002; 21:1237-1256.
34. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. Journal of Clinical Epidemiology 2005; 58:882-893.
35. Cook NR. Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 2007; 115:928-935.
36. Pencina MJ, D'Agostino Sr RB, D'Agostino Jr RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Statistics in Medicine 2008; 27:157-172.
37. Moons KGM, Altman DG, Vergouwe Y, Royston P. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. British Medical Journal 2009; 338:b606.
38. Royston P, Altman DG. Approximating statistical functions by using fractional polynomial regression. The Statistician 1997; 46:1-12.