A note on the evaluation of novel biomarkers: Do not rely on integrated discrimination improvement and net reclassification index

Statistics in Medicine

Volumn 33, Issue 19, 2014, Pages 3405-3414

  Hilden, Jørgen ^a   Gerds, Thomas A ^a  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Biomarker; IDI; NRI; Prediction; Prognostic models; Proper scoring rules

Indexed keywords

BIOLOGICAL MARKER; EPIRUBICIN; ANTINEOPLASTIC AGENT; ESTROGEN RECEPTOR;

AREA UNDER THE CURVE; ARTICLE; BREAST CANCER; BRIER SCORE; CANCER CHEMOTHERAPY; CONCORDANCE STATISTICS; HUMAN; INTEGRATED DISCRIMINATION IMPROVEMENT; MONTE CARLO METHOD; NET RECLASSIFICATION INDEX; PREDICTION; RECEIVER OPERATING CHARACTERISTIC; SCORING SYSTEM; STATISTICAL ANALYSIS; STATISTICS; BIOSTATISTICS; BREAST NEOPLASMS; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; EVALUATION STUDY; FEMALE; METABOLISM; PROGNOSIS; REGRESSION ANALYSIS; STATISTICAL MODEL;

ANTINEOPLASTIC AGENTS; BIOLOGICAL MARKERS; BIOSTATISTICS; BREAST NEOPLASMS; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; EPIRUBICIN; FEMALE; HUMANS; MODELS, STATISTICAL; MONTE CARLO METHOD; PROGNOSIS; RECEPTORS, ESTROGEN; REGRESSION ANALYSIS; ROC CURVE;

EID: 84904008367     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.5804     Document Type: Article

References (18)

1. Pepe M, Janes H, Longton G, Leisenring W, Newcomb P.Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. American Journal of Epidemiology 2004; 159(9):882.
2. Kattan MW.Evaluating a new marker's predictive contribution. Clinical Cancer Research 2004; 10(3):822-824.
3. Pencina M, D'Agostino R Sr., D'Agostino R Jr., Vasan R.Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Statistics in Medicine 2008; 27(2):157-172.
4. Hlatky MA, Greenland P, Arnett DK, Ballantyne CM, Criqui MH, Elkind MSV, Go AS, Harrell FE, Hong Y, Howard BV, Howard VJ, Hsue PY, Kramer CM, McConnell JP, Normand S-LT, O'Donnell CJ, Smith S C Jr., Wilson PWF.Criteria for evaluation of novel markers of cardiovascular risk: a scientific statement from the American Heart Association. Circulation 2009; 119(17):2408-2416.
5. Cook N.Assessing the incremental role of novel and emerging risk factors. Current Cardiovascular Risk Reports 2010; 4(2):112-119.
6. Kerr K, McClelland R, Brown E, Lumley T.Evaluating the incremental value of new biomarkers with integrated discrimination improvement. American Journal of Epidemiology 2011; 174(3):364-374.
7. Cook N.Clinically relevant measures of fit? A note of caution. American Journal of Epidemiology 2012; 176(6):488-491.
8. Gneiting T, Raftery AE.Strictly proper scoring rules, prediction, and estimation. Journal of the American Statistical Association 2007; 102(477):359-378.
9. Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA.Evaluating the yield of medical tests.Journal of the American Medical Association 1982; 247:2543-2546.
10. Harrell FE, Lee KL, Mark DB.Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Statistics in Medicine 1996; 15:361-87.
11. Pepe MS.The Statistical Evaluation of Medical Tests for Classification and Prediction. Oxford University Press: United Kingdom, 2003.
12. Savage LJ.Elicitation of personal probabilities and expectations. Journal of the American Statistical Association 1971; 66:783-801.
13. Hilden J, Habbema J, Bjerregaard B.The measurement of performance in probabilistic diagnosis. Methods of Information in Medicine 1978; 17:238-246.
14. Ryberg M, Nielsen D, Cortese G, Nielsen G, Skovsgaard T, Andersen P.New insight into epirubicin cardiac toxicity: competing risks analysis of 1097 breast cancer patients. Journal of the National Cancer Institute 2008; 100(15):1058-1067.
15. Harrell F E Jr.rms: regression modeling strategies, 2012. http://CRAN.R-project.org/package=rms [Accessed date: 2013-02-01], R package version 3.4-0.
16. Breiman L, Friedman J, Olshen R, Stone C.Classification and Regression Trees. Wadsworth International Group: Belmont, California, 1984.
17. Therneau TM, Ripley B, Atkinson B.rpart: recursive partitioning, 2012. http://CRAN.R-project.org/package=rpart [Accessed date: 2013-02-01], R package version 3.1-51.
18. Winkler RL.The quantification of judgment: some methodological suggestions. Journal of the American Statistical Association 1967; 62:1105-1120.