Added predictive value of high-throughput molecular data to clinical data and its validation

Briefings in Bioinformatics

Volumn 12, Issue 3, 2011, Pages 215-229

  Boulesteix, Anne Laure ^a   Sauerbrei, Willi ^b  

^a UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Added predictive value; Clinical usefulness; Independent data; Prediction models; Supervised classification; Survival analysis; Validation

Indexed keywords

ALGORITHM; ARTICLE; BIOLOGY; FACTUAL DATABASE; HIGH THROUGHPUT SCREENING; METHODOLOGY; SURVIVAL; VALIDATION STUDY;

ALGORITHMS; COMPUTATIONAL BIOLOGY; DATABASES, FACTUAL; HIGH-THROUGHPUT SCREENING ASSAYS; SURVIVAL ANALYSIS;

EID: 79955757684     PISSN: 14675463     EISSN: 14774054     Source Type: Journal    
DOI: 10.1093/bib/bbq085     Document Type: Article

References (58)

1. Golub TR, Slonim DK, Tamayo P, et al. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 1999;286:531-7.
2. The International Non-Hodgkin's Lymphoma Prognostic Factors Project. A predictive model for aggressive non-Hodgkin's lymphoma: report of the jury. N Engl J Med 1993;329:987-94.
3. Galea MH, Blamey RW, Elston CE, et al. The Nottingham prognostic index in primary breast cancer. Breast Cancer Res Treat 1992;22:207-19.
4. Eden P, Ritz C, Rose C, et al. "Good old" clinical markers have similar power in breast cancer prognosis as microarray gene expression profilers. Eur J Cancer 2004;40: 1837-41.
5. Truntzer C, Maucort-Boulch D, Roy P. Comparative optimism in models involving both classical clinical and gene expression information. BMC Bioinformatics 2008;9: 434.
6. Simon R. Development and validation of therapeutically relevant multi-gene biomarker classifiers. J Natl Cancer Inst 2006;97:866-7.
7. Buyse M, Loi S, van't Veer L, et al. Validation and clinical utility of a 70-gene prognostic signature for women with node-negative breast cancer. J Natl Cancer Inst 2006;98: 1183-92.
8. George S. Statistical issues in translational cancer research. Clin Cancer Res 2008;14:5954-8.
9. Ioannidis JPA. Expectations, validity, and reality in omics. J Clin Epidemiol 2010;63:960-3.
10. Mischak H, Allmaier G, Apweiler R, et al. Recommendations for biomarker identification and qualification in clinical proteomics. Sci Trans Med 2010;2:1-5.
11. Pencina MJ, D'Agostino RB, D'Agostino RB, et al. Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Stat Med 2008;27:157-72.
12. Altman D, Royston P. What do we mean by validating a prognostic model? StatMed 2000;19:453-73.
13. Royston P, Sauerbrei W. Multivariable model-building-A pragmatic approach to regression analysis baded on fractional polynomials for modelling continuous variables. Chichester: Wiley & Son Ltd, 2008.
14. Boulesteix AL, Strobl C. Optimal classifier selection and negative bias in error rate estimation: an empirical study on high-dimensional prediction. BMC Med Res Methodol 2009;9:85.
15. Jelizarow M, Guillemot V, Tenenhaus A, et al. Overoptimism in bioinformatics: an illustration. Bioinformatics 2010;26:1990-8.
16. Bleeker SE, Moll HA, Steyerberg EW, et al. External validation is necessary in prediction research: a clinical example. J Clin Epidemiol 2003;56:826-32.
17. König IR, Malley JD, Weimar C, et al. Practical experiences on the necessity of external validation. Stat Med 2007;26: 5499-511.
18. van Houwelingen H. Validation, calibration, revision and combination of prognostic survival models. Stat Med 2000; 19:3401-15.
19. Simon R, Radmacher MD, Dobbin K, et al. Pitfalls in the use of dna microarray data for diagnostic and prognostic classification. J Natl Cancer Inst 2003;95:14-8.
20. Dupuy A, Simon R. Critical review of published microarray studies for cancer outcome and guidelines on statistical analysis and reporting. J Natl Cancer Inst 2007;99: 147-57.
21. Tibshirani R. Regression shrinkage and selection via the LASSO. J Royal Stat Soc B 1996;58:267-88.
22. Zou H, Hastie T. Regularization and variable selection via the elastic net. J Royal Stat Soc B 2005;67:301-20.
23. Benner A, Zucknick M, Hielscher T, et al. Highdimensional cox models: the choice of penalty as part of the model building process. Biomet J 2010;52:50-69.
24. Bair E, Tibshirani R. Semi-supervised methods to predict patient survival from gene expression data. PLoS Biol 2004; 2:0511.
25. Breiman L. Random forests. Mach Learn 2001;45:5-32.
26. Hothorn T, Bühlmann P, Dudoit S, et al. Survival ensembles. Biostatistics 2006;7:355-73.
27. Bühlmann P, Hothorn T. Boosting algorithms: regularization, prediction and model fitting (with discussion). Stat Sci 2007;22:477-505.
28. Boulesteix AL, Hothorn T. Testing the additional predictive value of high-dimensional molecular data. BMC Bioinformatics 2010;11:78.
29. Binder H, Schumacher M. Allowing for mandatory covariates in boosting estimation of sparse high-dimensional survival models. BMC Bioinformatics 2008;9:14.
30. Bovelstad HM, Nygard S, Borgan O. Survival prediction from clinico-genomic models - a comparative study. BMC Bioinformatics 2009;10:413.
31. Goeman JJ. Penalized: L1 (Lasso) and L2 (Ridge) Penalized Estimation in GLMs and in the Cox Model, 2010. R Package version 0.9-31.
32. Boulesteix A-L, Strobl C, Augustin T, et al. Evaluating microarray-based classifiers: an overview. Cancer Informat 2008;6:77-97.
33. Tibshirani R, Efron B. Pre-validation and inference in microarrays. Stat Appl GenetMol Biol 2002;1:1.
34. Schemper M. The relative importance of prognostic factors in studies of survival. StatMed 1993;12:2377-82.
35. Diepgen TL, Sauerbrei W, Fartasch M. Development and validation of diagnostic scores for atopic dermatitis incorporating criteria of data quality and practical usefulness. J Clin Epidemiol 1996;49:1031-8.
36. Taylor JM, Ankerst DP, Andridge RR. Validation of biomarker-based risk prediction models. Clin Cancer Res 2008;14:5977-83.
37. Graf E, Schmoor C, Sauerbrei W, et al. Assessment and comparison of prognostic classification schemes for survival data. Stat Med 1999;18:2529-45.
38. Gerds T, Schumacher M. Consistent estimation of the expected Brier score in general survival models with right-censored event times. Biomet J 2006;48:698-705.
39. Royston P, Sauerbrei W. A new measure of prognostic separation in survival data. Stat Med 2004;23:723-48.
40. Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 2010;21: 128-38.
41. Gerds TA. pec: Validation of Predicted Surival Probabilities Using InverseWeighting andResampling. 2009. R Package version 1.1.1.
42. Gu W, Pepe MS. Measures to summarize and compare the predictive capacity of markers. IntJ Biostat 2009;5:27.
43. Metzeler KH, Hummel M, Bloomfield CD, et al. An 86 probe set gene expression signature predicts survival in cytogenetically normal acute myeloid leukemia. Blood 2008; 112:4193-201.
44. Yao M, Huang Y, Shioi K, et al. A three-gene expression signature model to predict clinical outcome of clear cell renal carcinoma. Int J Cancer 2008;123:1126-32.
45. Pepe MS, Janes H, Longton G, et al. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. AmJ Epidemiol 2004;159:882-90.
46. Schumacher M, Binder H, Gerds T. Assessment of survival prediction models based on microarray data. Bioinformatics 2007;23:1768-74.
47. Hirsch RP. Validation samples. Biometrics 1991;47:1193-94.
48. Goeman JJ, van de Geer SA, de Kort F, et al. A global test for groups of genes: testing association with a clinical outcome. Bioinformatics 2004;20:93-9.
49. Goeman JJ, Oosting J, Cleton-Jansen AM, et al. Testing association of a pathway with survival using gene expression data. Bioinformatics 2005;21:1950-7.
50. Hummel M, Meister R, Mansmann U. GlobalANCOVA: exploration and assessment of gene group effects. Bioinformatics 2008;24:78-85.
51. Mansmann U, Meister R, Hummel M, et al. GlobalAncova: Calculates a Global test for Differential Gene Expression Between Groups. 2010. R Bioconductor Package version 3.16.0.
52. Lusa L, McShane LM, Rademacher MD, et al. Appropriateness of some resampling-based inference procedures for assessing performance of prognostic classifiers derived from microarray data. StatMed 2007;26:1102-13.
53. van de Wiel M, Berkhof J, van Wieringen W. Testing the prediction error difference between 2 predictors. Biostatistics 2009;10:550-60.
54. Höfling H, Tibshirani R. A study of pre-validation. Ann App Stat 2008;2:643-64.
55. Pepe MS, Janes H, Longton G, et al. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. AmJ Epidemiol 2004;159:882-90.
56. Ein-Dor L, Kela I, Getz G, et al. Outcome signature genes in breast cancer: is there a unique set? Bioinformatics 2005;21: 171-8.
57. Boulesteix AL, Slawski M. Stability and aggregation of ranked gene lists. Brief Bioinformatics 2009;10:556-68.
58. Ntzani EE, Ioannidis JPA. Predictive ability of DNA microarrays for cancer outcomes and correlates: an empirical assessment. Lancet 2003;362:1439-44.