Multi-factorial analysis of class prediction error: Estimating optimal number of biomarkers for various classification rules

Journal of Bioinformatics and Computational Biology

Volumn 8, Issue 6, 2010, Pages 945-965

  Khondoker, Mizanur R ^a   Bachmann, Till T ^b   Mewissen, Muriel ^b   Dickinson, Paul ^b,c   Dobrzelecki, Bartosz ^c   Campbell, Colin J ^b   Mount, Andrew R ^c   Walton, Anthony J ^c   Crain, Jason ^c,d   Schulze, Holger ^b   Giraud, Gerard ^c   Ross, Alan J ^b   Ciani, Ilenia ^c   Ember, Stuart W J ^b   Tlili, Chaker ^c   Terry, Jonathan G ^c   Grant, Eilidh ^c   Mcdonnell, Nicola ^c   Ghazal, Peter ^b,c  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c UNIVERSITY OF EDINBURGH   (United Kingdom)

^d NATIONAL PHYSICAL LABORATORY   (United Kingdom)

Author keywords

classification; gene expression; leave one out cross validation; machine learning; Microarrays

Indexed keywords

BIOLOGICAL MARKER;

ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGY; BLOOD; CLASSIFICATION; DNA MICROARRAY; FACTUAL DATABASE; GENE EXPRESSION PROFILING; HUMAN; METHODOLOGY; MICROARRAY ANALYSIS; STATISTICAL MODEL; STATISTICS;

ARTIFICIAL INTELLIGENCE; BIOLOGICAL MARKERS; CLASSIFICATION; COMPUTATIONAL BIOLOGY; DATABASES, FACTUAL; GENE EXPRESSION PROFILING; HUMANS; MICROARRAY ANALYSIS; MODELS, STATISTICAL; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS;

EID: 78649846620     PISSN: 02197200     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219720010005063     Document Type: Article

References (33)

1. Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA et al., Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring, Science 286:531-537, 1999.
2. Alizadeh AA, Eisen MB, Davis RE, Ma C, Lossos IS, Rosenwald A, Boldrick JC, Sabet H, Tran T, Yu X et al., Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling, Nature 403:503-511, 2000.
3. Khan J, Wei JS, Ringnér M, Saal LH, Ladanyi M, Westermann F, Berthold F, Schwab M, Antonescu C, Peterson C et al., Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks, Nat Med 7:673-679, 2001.
4. van't Veer LJ, Dai H, van de Vijver MJ, He YD, Hart AAM, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT et al., Gene expression profiling predicts clinical outcome of breast cancer, Nature 415:530-536, 2002.
5. Rhodes DR, Yu J, Shanker K, Deshpande N, Varambally R, Ghosh D, Barrette T, Pandey A, Chinnaiyan AM, Large-scale meta-analysis of cancer microarray data identifies common transcriptional profiles of neoplastic transformation and progression, Proc Natl Acad Sci USA 101:9309-9314, 2004.
6. Chang HY, Nuyten DSA, Sneddon JB, Hastie T, Tibshirani R, Sorlie T, Dai H, He YD, van't Veer LJ, Bartelink H et al., Robustness, scalability, and integration of a wound-response gene expression signature in predicting breast cancer survival, Proc Natl Acad Sci USA 102:3738-3743, 2005.
7. Thomas RS, Rank DR, Penn SG, Zastrow GM, Hayes KR, Pande K, Glover E, Silander T, Craven MW, Reddy JK et al., Identification of toxicologically predictive gene sets using cDNA microarrays, Mol Pharmacol 60:1189-1194, 2001.
8. Waring JF, Ciurlionis R, Jolly RA, Heindel M, Ulrich RG, Microarray analysis of hepatotoxins in vitro reveals a correlation between gene expression profiles and mechanisms of toxicity, Toxicol Lett 120:359-368, 2001.
9. Gunther EC, Stone DJ, Gerwien RW, Bento P, Heyes MP, Prediction of clinical drug efficacy by classification of drug-induced genomic expression profiles in vitro, Proc Natl Acad Sci USA 100:9608-9613, 2003.
10. Natsoulis G, El Ghaoui L, Lanckriet GRG, Tolley AM, Leroy F, Dunlea S, Eynon BP, Pearson CI, Tugendreich S, Jarnagin K, Classification of a large microarray data set: Algorithm comparison and analysis of drug signatures, Genome Res 15:724-736, 2005.
11. Ramilo O, Allman W, Chung W, Mejias A, Ardura M, Glaser C, Wittkowski KM, Piqueras B, Banchereau J, Palucka AK et al., Gene expression patterns in blood leukocytes discriminate patients with acute infections, Bl ood 109:2066-2077, 2007.
12. Li L, Weinberg CR, Darden TA, Pedersen LG, Gene selection for sample classification based on gene expression data: Study of sensitivity to choice of parameters of the GA/KNN method, Bioinformatics 17:1131-1142, 2001.
13. Díaz-Uriarte R, Alvarez de Andrés S, Gene selection and classification of microarray data using random forest, BMC Bioinformatics 7:1471-2105, 2006.
14. Raudys ŠJ, Determination of optimal dimensionality in statistical pattern classification, Pattern Recognition 11:263-270, 1979.
15. Hua J, Xiong Z, Dougherty ER, Determination of the optimal number of features for quadratic discriminant analysis via the normal approximation to the discriminant distribution, Pattern Recognition 38:403-421, 2004.
16. Hua J, Xiong Z, Lowey J, Suh E, Dougherty ER, Optimal number of features as a function of sample size for various classification rules, Bioinformatics 21:1509-1515, 2005.
17. Breiman L, Random Forests, Machine Learning 45:5-32, 2001.
18. Vapnik VN, The Nature of Statistical Learning Theory. Springer, New York, 1995.
19. Cortes C, Vapnik V, Support-vector networks, Machine Learning 20:273-297, 1995.
20. Vapnik VN, Statistical Learning Theory, John Wiley & Sons, New York, 1998.
21. Fisher RA, The use of multiple measurements in taxonomic problems, Annals of Eugenics 7:179-188, 1936.
22. McLachlan GJ, Discriminant Analysis and Statistical Pattern Recognition, Wiley-Interscience, 1992.
23. Duda RO, Hart PE, Stork DG, Pattern Classification. Wiley, New York, 2001.
24. Dasarathy BV, Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. IEEE Computer Society, 1991.
25. Shakhnarovich G, Darrell T, Indyk P, Nearest-neighbor Methods in Learning and Vision: Theory and Practice. MIT Press, 2005.
26. R Development Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing Vienna, Austria, 2009.
27. Efron B, Estimating the error rate of a prediction rule: Improvement on crossvalidation, J Am Stat Assoc 78:316-331, 1983.
28. Smith CL, Dickinson P, Forster T, Khondoker MR, Craigon M, Ross A, Storm P, Burgess S, Lacaze P, Stenson BJ et al., Quantitative assessment of human whole blood RNA as a potential biomarker for infectious disease, The Analyst 132:1200-1209, 2007.
29. Hughes G, On the mean accuracy of statistical pattern recognizers, IEEE Trans Inform Theory 14:55-63, 1968.
30. Ein-Dor L, Zuk O, Domany E, Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer, Proc Natl Acad Sci 103:5923-5928, 2006.
31. Zhang M, Yao C, Guo Z, Zou J, Zhang L, Xiao H, Wang D, Yang D, Gong X, Zhu J et al., Apparently low reproducibility of true differential expression discoveries in microarray studies, Bioinformatics 24:2057-2063, 2008.
32. Zhang M, Zhang L, Zou J, Yao C, Xiao H, Liu Q, Wang J, Wang D, Wang C, Guo Z, Evaluating reproducibility of differential expression discoveries in microarray studies by considering correlated molecular changes, Bioinformatics 25:1662-1668, 2009.
33. Smyth GK, Linear models and empirical Bayes methods for assessing differential expression in microarray experiments, Statistical Applications in Genetics and Molecular Biology 3:Article 3, 2004.