Selecting a single model or combining multiple models for microarray-based classifier development? - A comparative analysis based on large and diverse datasets generated from the MAQC-II project

BMC Bioinformatics

Volumn 12, Issue SUPPL. 10, 2011, Pages

  Chen, Minjun ^a   Shi, Leming ^a   Kelly, Reagan ^a   Perkins, Roger ^a   Fang, Hong ^a   Tong, Weida ^a  

^a NATIONAL CENTER FOR TOXICOLOGICAL RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BETTER PERFORMANCE; CLINICAL APPLICATION; CLINICAL PRACTICES; COMPARATIVE ANALYSIS; ENSEMBLE MODELING; PREDICTIVE MODELS; PREDICTIVE PERFORMANCE; TOXICOLOGICAL RESEARCH;

GENES;

MICROARRAYS;

ARTICLE; BIOLOGICAL MODEL; DNA MICROARRAY; GENE EXPRESSION PROFILING; GENETICS; HUMAN; META ANALYSIS (TOPIC); METHODOLOGY; NEOPLASM; QUALITY CONTROL; TOXICOGENETICS;

GENE EXPRESSION PROFILING; HUMANS; META-ANALYSIS AS TOPIC; MODELS, GENETIC; NEOPLASMS; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; QUALITY CONTROL; TOXICOGENETICS;

EID: 80054120281     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/1471-2105-12-S10-S3     Document Type: Article

References (36)

1. Waring JF, Ciurlionis R, Jolly RA, Heindel M, Ulrich RG. Microarray analysis of hepatotoxins in vitro reveals a correlation between gene expression profiles and mechanisms of toxicity. Toxicol Lett 2001, 120(1-3):359-368. 10.1016/S0378-4274(01)00267-3, 11323195.
2. Fielden MR, Zacharewski TR. Challenges and limitations of gene expression profiling in mechanistic and predictive toxicology. Toxicol Sci 2001, 60(1):6-10. 10.1093/toxsci/60.1.6, 11222867.
3. Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA, et al. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 1999, 286(5439):531-537. 10.1126/science.286.5439.531, 10521349.
4. Moniaux N, Chakraborty S, Yalniz M, Gonzalez J, Shostrom VK, Standop J, Lele SM, Ouellette M, Pour PM, Sasson AR, et al. Early diagnosis of pancreatic cancer: neutrophil gelatinase-associated lipocalin as a marker of pancreatic intraepithelial neoplasia. Br J Cancer 2008, 98(9):1540-1547. 10.1038/sj.bjc.6604329, 2391106, 18392050.
5. Huang F, Reeves K, Han X, Fairchild C, Platero S, Wong TW, Lee F, Shaw P, Clark E. Identification of candidate molecular markers predicting sensitivity in solid tumors to dasatinib: rationale for patient selection. Cancer Res 2007, 67(5):2226-2238. 10.1158/0008-5472.CAN-06-3633, 17332353.
6. van de Vijver MJ, He YD, van't Veer LJ, Dai H, Hart AA, Voskuil DW, Schreiber GJ, Peterse JL, Roberts C, Marton MJ, et al. A gene-expression signature as a predictor of survival in breast cancer. N Engl J Med 2002, 347(25):1999-2009. 10.1056/NEJMoa021967, 12490681.
7. Kaplowitz N. Idiosyncratic drug hepatotoxicity. Nat Rev Drug Discov 2005, 4(6):489-499. 10.1038/nrd1750, 15931258.
8. van't Veer LJ, Dai H, van de Vijver MJ, He YD, Hart AA, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT, et al. Gene expression profiling predicts clinical outcome of breast cancer. Nature 2002, 415(6871):530-536. 10.1038/415530a, 11823860.
9. Dupuy A, Simon RM. Critical review of published microarray studies for cancer outcome and guidelines on statistical analysis and reporting. J Natl Cancer Inst 2007, 99(2):147-157. 10.1093/jnci/djk018, 17227998.
10. Michiels S, Koscielny S, Hill C. Prediction of cancer outcome with microarrays: a multiple random validation strategy. Lancet 2005, 365(9458):488-492. 10.1016/S0140-6736(05)17866-0, 15705458.
11. Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. International Joint Conference on Artificial Intelligence; Montreal IJCAI 1995, Unpaged.
12. Simon R. Using DNA microarrays for diagnostic and prognostic prediction. Expert Rev Mol Diagn 2003, 3(5):587-595. 10.1586/14737159.3.5.587, 14510179.
13. Simon R, Radmacher MD, Dobbin K, McShane LM. Pitfalls in the use of DNA microarray data for diagnostic and prognostic classification. J Natl Cancer Inst 2003, 95(1):14-18. 10.1093/jnci/95.1.14, 12509396.
14. Braga-Neto UM, Dougherty ER. Is cross-validation valid for small-sample microarray classification?. Bioinformatics 2004, 20(3):374-380. 10.1093/bioinformatics/btg419, 14960464.
15. Varma S, Simon R. Bias in error estimation when using cross-validation for model selection. BMC Bioinformatics 2006, 7:91. 10.1186/1471-2105-7-91, 1397873, 16504092.
16. Naderi A, Teschendorff AE, Barbosa-Morais NL, Pinder SE, Green AR, Powe DG, Robertson JF, Aparicio S, Ellis IO, Brenton JD, et al. A gene-expression signature to predict survival in breast cancer across independent data sets. Oncogene 2007, 26(10):1507-1516. 10.1038/sj.onc.1209920, 16936776.
17. Sotiriou C, Neo SY, McShane LM, Korn EL, Long PM, Jazaeri A, Martiat P, Fox SB, Harris AL, Liu ET. Breast cancer classification and prognosis based on gene expression profiles from a population-based study. Proc Natl Acad Sci U S A 2003, 100(18):10393-10398. 10.1073/pnas.1732912100, 193572, 12917485.
18. Wang Y, Klijn JG, Zhang Y, Sieuwerts AM, Look MP, Yang F, Talantov D, Timmermans M, Meijer-van Gelder ME, Yu J, et al. Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer. Lancet 2005, 365(9460):671-679.
19. Ein-Dor L, Kela I, Getz G, Givol D, Domany E. Outcome signature genes in breast cancer: is there a unique set?. Bioinformatics 2005, 21(2):171-178. 10.1093/bioinformatics/bth469, 15308542.
20. Clemen R. Combining forecasts: A review and annotated bibliography. Journal of Forecasting 1989, 5:559-583.
21. Gramatica P, Pilutti P, Papa E. Validated QSAR prediction of OH tropospheric degradation of VOCs: splitting into training-test sets and consensus modeling. J Chem Inf Comput Sci 2004, 44(5):1794-1802.
22. Tan AC, Gilbert D. Ensemble machine learning on gene expression data for cancer classification. Appl Bioinformatics 2003, 2(3 Suppl):S75-83.
23. Su Z, Hong H, Perkins R, Shao X, Cai W, Tong W. Consensus analysis of multiple classifiers using non-repetitive variables: diagnostic application to microarray gene expression data. Comput Biol Chem 2007, 31(1):48-56. 10.1016/j.compbiolchem.2007.01.001, 17303535.
24. Shi L, Campbell G, Jones WD, Campagne F, Wen Z, Walker SJ, Su Z, Chu TM, Goodsaid FM, Pusztai L, et al. The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models. Nat Biotechnol 2010, 28(8):827-838. 10.1038/nbt.1665, 20676074.
25. Thomas RS, Pluta L, Yang L, Halsey TA. Application of genomic biomarkers to predict increased lung tumor incidence in 2-year rodent cancer bioassays. Toxicol Sci 2007, 97(1):55-64. 10.1093/toxsci/kfm023, 17311802.
26. Fielden MR, Brennan R, Gollub J. A gene expression biomarker provides early prediction and mechanistic assessment of hepatic tumor induction by nongenotoxic chemicals. Toxicol Sci 2007, 99(1):90-100. 10.1093/toxsci/kfm156, 17557906.
27. Lobenhofer EK, Auman JT, Blackshear PE, Boorman GA, Bushel PR, Cunningham ML, Fostel JM, Gerrish K, Heinloth AN, Irwin RD, et al. Gene expression response in target organ and whole blood varies as a function of target organ injury phenotype. Genome Biol 2008, 9(6):R100. 10.1186/gb-2008-9-6-r100, 2481421, 18570634.
28. Hess KR, Anderson K, Symmans WF, Valero V, Ibrahim N, Mejia JA, Booser D, Theriault RL, Buzdar AU, Dempsey PJ, et al. Pharmacogenomic predictor of sensitivity to preoperative chemotherapy with paclitaxel and fluorouracil, doxorubicin, and cyclophosphamide in breast cancer. J Clin Oncol 2006, 24(26):4236-4244. 10.1200/JCO.2006.05.6861, 16896004.
29. Zhan F, Huang Y, Colla S, Stewart JP, Hanamura I, Gupta S, Epstein J, Yaccoby S, Sawyer J, Burington B, et al. The molecular classification of multiple myeloma. Blood 2006, 108(6):2020-2028. 10.1182/blood-2005-11-013458, 1895543, 16728703.
30. Shaughnessy JD, Zhan F, Burington BE, Huang Y, Colla S, Hanamura I, Stewart JP, Kordsmeier B, Randolph C, Williams DR, et al. A validated gene expression model of high-risk multiple myeloma is defined by deregulated expression of genes mapping to chromosome 1. Blood 2007, 109(6):2276-2284. 10.1182/blood-2006-07-038430, 17105813.
31. Oberthuer A, Berthold F, Warnat P, Hero B, Kahlert Y, Spitz R, Ernestus K, Konig R, Haas S, Eils R, et al. Customized oligonucleotide microarray gene expression-based classification of neuroblastoma patients outperforms current clinical risk stratification. J Clin Oncol 2006, 24(31):5070-5078. 10.1200/JCO.2006.06.1879, 17075126.
32. Tusher VG, Tibshirani R, Chu G. Significance analysis of microarrays applied to the ionizing radiation response. Proc Natl Acad Sci U S A 2001, 98(9):5116-5121. 10.1073/pnas.091062498, 33173, 11309499.
33. Team RDC. R: A language and environment for statistical computing. R Foundation for Statistical computing 2010, Vienna, Austria ISBN 3-900051-07-0., http://www.R-project.org
34. Weihs C, Ligges U, Luebke K, Rabbe N. klaR analyzing German business cycle. Data Analysis and Decision Support 2005, 335-343. Springer-Verlag, Berlin, Baier, D, Decker, R and Schmitd-Thieme, L.
35. Rokach L. Ensemble-based classifiers. The Artificial Intelligence Review 2010, 33(1-2):1-33.
36. Gramatica P, Giani E, Papa E. Statistical external validation and consensus modeling: a QSPR case study for Koc prediction. J Mol Graph Model 2007, 25(6):755-766. 10.1016/j.jmgm.2006.06.005, 16890002.