Classification with high-dimensional genetic data: Assigning patients and genetic features to known classes

Biometrical Journal

Volumn 50, Issue 6, 2008, Pages 911-926

  Schwender, Holger ^a   Ickstadt, Katja ^a   Rahnenführer, Jörg ^a  

^a TU DORTMUND UNIVERSITY   (Germany)

Author keywords

Bioinformaties; Discrimination; Gene expression; Genetics; Microarray; SNP supervised learning

Indexed keywords

GENE EXPRESSION;

BIOINFORMATIE; DISCRIMINATION; GENES EXPRESSION; GENETIC; GENETIC DATA; HIGH-DIMENSIONAL; HIGHER-DIMENSIONAL; SINGLE NUCLEOTIDE POLYMORPHISM SUPERVISED LEARNING; SINGLE NUCLEOTIDE POLYMORPHISMS; SUPERVISED CLASSIFICATION;

SUPERVISED LEARNING;

EID: 57649225876     PISSN: 03233847     EISSN: 15214036     Source Type: Journal    
DOI: 10.1002/bimj.200810475     Document Type: Article

References (77)

1. Alvarez, S., Diaz-Uriarte, R., Osorio, A., Barroso, A., Melchor, L., Paz, M. F., Honrado, E., Rodriguez, R., Urioste, M., Valle, L., Diez, O., Cigudosa, J. C., Dopazo, J., Esteller, M., and Benitez, J. (2005). A predictor based on the somatic genomic changes of the BRCA1/BRCA2 breast cancer tumors identifies the non-BRCA1/BRCA2 tumors with BRCA1 promoter hypermethylation. Clinical Cancer Research 11, 1146-1153.
2. Ambroise, C. and McLachlan, G. (2002). Selection bias in gene extraction on the basis of microarray gene-expression data. Proceedings of the National Academy of Sciences 99, 6562-6566.
3. Bo, T. and Jonassen, I. (2002). New feature subset selection procedures for classification of expression profiles. Genome Biology 3, RESEARCH0017.
4. Boulesteix, A.-L. (2004). PLS dimension reduction for classification with microarray data. Statistical Applications in Genetics andMolecular Biology 3, Article 33.
5. Boulesteix, A.-L. and Strimmer, K. (2007). Partial least squares: a versatile tool for the analysis of high-dimensional genomic data. Briefings in Bioinformatics 8, 32-44.
6. Boulesteix, A.-L., Porzelius, C., and Daumer, M. (2008). Microarray-based classification and clinical predictors: on combined classifiers and additional predictive value. Bioinformatics 24, 1698-1706.
7. Breiman, L. (1996). Bagging predictors. Machine Learning 26, 123-140.
8. Breiman, L. (1998). Arcing classifiers. The Annals of Statistics 26, 801-849.
9. Breiman, L. (2001). Random Forests. Machine Learning 45, 5-32.
10. Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J. (1984). Classification and regression trees. Wadsworth, Belmont, CA.
11. Brown, M., Grundy, W., Lin, D., Cristianini, N., Sugnet, C., Furey, T., Ares, M., and Haussler, D. (2000). Knowledge-based analysis of microarray gene expression data by using support vector machines. Proceedings of the National Academy of Sciences 97, 262-267.
12. Bühlmann, P. and Hothorn, T. (2007). Boosting algorithms: regularization, prediction and model fitting. Statistical Science 22, 477-505. With discussion.
13. Bühlmann, P. and Yu, B. (2002). Analyzing bagging. Annals of Statistics 30, 927-961.
14. Bureau, A., Dupuis, J., Falls, K., Lunetta, K. L., Hayward, B., Keith, T. P., and van Eerdewegh, P. (2005). Identifying SNPs predictive of phenotype using Random Forests. Genetic Epidemiology 28, 171-1 82.
15. Cho, J. H., Lee, D., Park, J. H., and Lee, I. B. (2004). Gene selection and classification from microarray data using kernel machine. FEBS Letters 571, 93-98.
16. Culverhouse, R., Suarez, B. K., Lin, J., and Reich, T. (2002). A perspective on epistasis: limits of models displaying no main effect. American Journal of Human Genetics 70,461-471.
17. Dettling, M. (2004). BagBoosting for tumor classification with gene expression data. Bioinformatics 20,3583-3593.
18. Dettling, M. and Bühlmann (2003). Boosting for tumor classification with gene expression data. Bioinformatics 19, 1061-1069.
19. Diaz-Uriarte, R. and Alvarez de Andres, S. (2006). Gene selection and classification of microarray data using Random Forest. BMC Bioinformatics 7, 3.
20. Ding, C. and Peng, H. (2005). Minimum redundancy feature selection from microarray gene expression data. Journal of Bioinformatics and Computational Biology 3, 185-205.
21. Dudoit, S. and Fridlyand, J. (2003). Bagging to improve the accuracy ofa clustering procedure. Bioinformatics 19, 1090-1099.
22. Dudoit, S. and van der Laan, M. (2008). Multiple Testing Procedures and Applications to Genomics. Springer, Berlin.
23. Dudoit, S., Fridlyand, J., and Speed, T. (2002). Comparison of discrimination methods for the classification of tumors using gene expression data. Journal of the American Statistical Association 97, 77-87.
24. Dudoit, S., Shaffer, J. P., and Boldrick, J. C. (2003). Multiple hypothesis testing in microarray experiments. Statistical Science 18,71-103.
25. Eilers, P. H., Boer, J. M., van Ommen, G. J., and van Houwelingen, H. C. (2001). Classification of microarray data with penalized logistic regression. In Bittner, M. L., Chen, Y., Dorsel, A. N., and Dougherty, E. R. (Eds.), Proceedings of SPIE, volume 4266, pp. 187-198.
26. Fix, E. and Hodges, J. L. (1951). Discriminatory analysis - nonparametric discrimination: consistency properties. Technical report, USAF School ofAviation Medicine.
27. Freund, Y. and Shapire, R. E. (1996). Experiments with a new boosting algorithm. In Machine Learning: Proceedings of the 13th International Conference. Morgan Kauffman, San Francisco, CA, pp. 148-156.
28. Friedman, J. (1989). Regularized discriminant analysis. Journal of the American Statistical Association 84, 165175.
29. Friedman, J., Hastie, T., and Tibshirani, R. (2000). Additive logistic regression: a statistical view of boosting. The Annals of Statistics 28, 337-407. With discussion.
30. Furey, T. S., Cristianini, N., Duffy, N., Bednarski, D. W., Schummer, M., and Haussler, D. (2000). Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics 16, 906-914.
31. Furlanello, C., Serafini, M., Merler, S., and Jurman, G. (2003). Entropy-based gene ranking without selection bias for the predictive classification ofmicroarray data. BMC Bioinformatics 4, 54.
32. Günther, E., Stone, D. J., Gerwien, R. W., Bento, P., and Heyes, M. P. (2003). Prediction of clinical drug efficacy by classification of drug-induced genomic expression profiles in vitro. Proceedings of the National Academy of Sciences 100, 9608-9613.
33. Guo, Y., Hastie, T., and Tibshirani, R. (2007). Regularized linear discriminant analysis and its application in microarrays. Biostatistics 8, 86-100.
34. Guyon, I., Weston, J., Bamhill, S., and Vapnik, V. (2002). Gene selection for cancer classification using support vector machines. Machine Learning 46, 389-422.
35. Guyon, I., Gunn, S., Nikravesh, M., and Zadeh, L. A. (Eds.) (2006). Feature Extra ction. Foundations and Applications. Springer, Heidelberg.
36. Hastie, T., Tibshirani, R., and Friedman, J. H. (2001). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, New York, NY
37. Hoerl, A. E. and Kennard, R. (1970). Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12, 55-67.
38. Jaeger, J., Sengupta, R., and Ruzzo, W. L. (2003). Improved gene selection for classification ofmicroarrays. Pacific Symposium on Biocomputing 8, 53-64.
39. Jaeger, J., Weichenhan, D., Ivandic, B., and Spang, R. (2005). Early diagnostic marker panel determination for microarray based clinical studies. Statistical Applications in Genetics and Molecular Biology 4, Article 9.
40. Kirkpatrick, S., Gelatt, C. D. J., and Vecchi, M. P. (1983). Optimization by simulated annealing. Science 220, 671-680.
41. Kooperberg, C., Ruczinski, I., LeBlanc, M., and Hsu, L. (2001). Sequence analysis using logic regression. Genetic Epidemiology 21, 626-631.
42. Lee, J. W., Lee, J. B., Park, M., and Song, S. H. (2005). An extensive comparison of recent classification tools applied to microarray data. Computational Statistics & Data Analysis 48, 869-885.
43. Lee, Y and Lee, C. K. (2003). Classification of multiple cancer types by multicategory support vector machines using gene expression data. Bioinformatics 19, 1132-1139.
44. Leisch, F. (1999). Bagged clustering. Technical Report 51, Vienna University of Economics and Business Administration, Vienna, Austria.
45. Liu, Z., Jiang, F., Tian, G., Wang, S., Sato, F., Meltzer, S., and Tan, M. (2007). Sparse logistic regression with Lp penalty for biomarker identification. Statistical Applications in Genetics and Molecular Biology 6, Article 6.
46. Lottaz, C., Kostka, D., and Spang, R. (2007). Analysis of expression data: classification of patients. In Lengauer, T. (Ed.), Bioinformatics - From Genomes to Therapies, 2. Getting at the Inner Workings: Molecular Interactions. Wiley-VCH, Weinheim, chapter 28, pp. 1023-1059.
47. Lunetta, K. L., Hayward, L., Segal, J., and van Eerdewegh, P. (2004). Screening large-scale association study data: exploiting interactions using Random Forests. BMC Genetics 5, 32.
48. Man, M. Z., Dyson, G., Johnson, K., and Liao, B. (2004). Evaluating methods for classifying expression data. Journal of Biopharmaceutical Statistics 14, 1065-1 084.
49. Markowetz, F. and Spang, R. (2005). Molecular diagnosis, classification, model selection and performance evaluation. Methods of Information in Medicine 44, 438-443.
50. Nunkesser, R., Bernholt, T., Schwender, H., Ickstadt, K., and Wegener, I. (2007). Detecting high-order interactions of single nucleotide polymorphisms using genetic programming. Bioinformatics 23, 3280- 3288.
51. Park, M. Y. and Hastie, T. (2008). Penalized logistic regression for detecting gene interactions. Biostatistics 9, 30-50.
52. Quinlan, J. R. (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco, CA.
53. R Development Core Team (2008). R: A Language and Environmentfor Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0.
54. Rakotomamonjy, A. (2003). Variable selection using SVM-based criteria. Journal of Machine Learning Research 3, 1357-1370.
55. Ramaswamy, S., Tamayo, P., Rifkin, R., Mukherjee, S., Yeang, C. H., Angelo, M., Ladd, C., Reich, M., Latulippe, E., Mesirov, J. P., Poggio, T., Gerald, W., Loda, M., Lander, E. S., and Golub, T. R. (2001). Multiclass cancer diagnosis using tumor gene expression signatures. Proceedings of the National Academy of Sciences 98, 15149-15154.
56. Roth, V. (2004). The generalized LASSO. IEEE Transactions on Neural Networks 15, 16-28.
57. Ruczinski, I., Kooperberg, C., and LeBlanc, M. (2003). Logic regression. Journal of Computational and Graphical Statistics 12, 475-511.
58. Ruczinski, I., Kooperberg, C., and LeBlanc, M. (2004). Exploring interactions in high-dimensional genomic data: an overview of logic regression, with applications. Journal of Multivariate Analysis 90, 178-195.
59. Ruschhaupt, M., Huber, W., Poustka, A., and Mansmann, U. (2004). A compendium to ensure computational reproducibility in high-dimensional classification tasks. Statistical Applications in Genetics and Molecular Biology 3, Article 37.
60. Schoelkopf, B. and Smola, A. (2001). Learning with Kernels. MIT Press, Cambridge, MA.
61. Schwarz, D., Szymczak, S., Ziegler, A., and Knig, I. R. (2007). Picking single-nucleotide polymorphisms in forests. BMC Proceedings 1(Suppl 1), S59.
62. Schwender, H. and Ickstadt, K. (2008). Identification of SNP interactions using logic regression. Biostatistics 9, 187-198.
63. Schwender, H., Zucknick, M., Ickstadt, K., Bolt, H. M., and Network, G. (2004). A pilot study on the application of statistical classification procedures to molecular epidemiological data. Toxicology Letters 151, 29 1-299.
64. Schwender, H., Rabstein, S., and Ickstadt, K. (2006). Do you speak Genomish? Chance 19, 3-10.
65. Shevade, S. K. and Keerthi, S. S. (2003). A simple and efficient algorithm for gene selection using sparse logistic regression. Bioinformatics 19, 2246-2253.
66. Simon, R., Radmacher, M. D., Dobbin, K., and McShane, L. M. (2003). Pitfalls in the use of DNA microarray data for diagnostic and prognostic classification. Journal of the National Cancer Institute 95, 14-18.
67. Strobl, C., Boulesteix, A. L., Zeileis, A., and Hothorn, T. (2007). Bias in Random Forest variable importance measures: illustrations, sources and a solution. BMC Bioinformatics 8, 25.
68. Tan, A. C. and Gilbert, D. (2003). Ensemble machine learning on gene expression data for cancer classification. Applied Bioinformatics 2(Suppl 3), S75-S83.
69. Theilhaber, J., Connolly, T., Roman-Roman, S., Bushnell, S., Jackson, A., Call, K., Garcia, T., and Baron, R. (2002). Finding genes in the c2c12 osteogenic pathway by k-nearest-neighbor classification of expression data. Genome Research 12, 165-176.
70. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistics Society B 58, 267-288.
71. Tibshirani, R., Hastie, T., Narasimhan, B., and Chu, G. (2003). Class prediction by nearest shrunken centroids, with applications to DNA microarray s. Statistical Science 18, 104-117.
72. Tusher, V., Tibshirani, R., and Chu, G. (2001). Significance analysis ofmicroarrays applied to the ionizing radiation response. Proceedings of the National Academy of Sciences 98, 5116-5124.
73. Vapnik, V. (2000). The Nature of Statistical Learning Theory, 2nd edition. Springer, New York, NY
74. Witte, J. S. and Fijal, B. A. (2001). Introduction: analysis of sequence data and population structure. Genetic Epidemiology 21, 600-601.
75. Yao, Z. and Ruzzo, W. L. (2006). A regression-based k nearest neighbor algorithm for gene function prediction from heterogeneous data. BMC Bioinformatics 7(Suppl 1), S11.
76. Zhu, J. and Hastie, T. (2004). Classification of gene microarrays by penalized logistic regression. Biostatistics 5, 427-443.
77. Ziegler, A., König, I. R., and Thompson, J. R. (2008). Biostatistical aspects of genome-wide association studies. Biometrical Journal 50, 8-28.