Forest classification trees and forest support vector machines algorithms: Demonstration using microarray data

Computers in Biology and Medicine

Volumn 40, Issue 5, 2010, Pages 519-524

  Zintzaras, Elias ^a,b,c   Kowald, Axel ^a,d  

^a UNIVERSITY OF THESSALY   (Greece)

^b UNIVERSITY OF PIRAEUS   (Greece)

^c TUFTS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d HUMBOLDT UNIVERSITY   (Germany)

Author keywords

Algorithms; Classification; Classification trees; Forest; Gene expression; Microarrays; Support vector machines

Indexed keywords

CLASSIFICATION ALGORITHM; CLASSIFICATION TREES; DECISION RULES; FOREST; FOREST CLASSIFICATION; GENE EXPRESSION DATA; GENE EXPRESSION MICROARRAY; HIGH DIMENSIONAL DATA; MICROARRAY DATA; MISCLASSIFICATION RATES; MISCLASSIFICATIONS; MULTIPLE CLASS; SUPPORT VECTOR MACHINES ALGORITHMS; TERMINAL NODES; TISSUE SAMPLES;

CLUSTERING ALGORITHMS; DATA STRUCTURES; GENE EXPRESSION; MICROARRAYS; SUPPORT VECTOR MACHINES; VECTORS; WATER METERS;

DATA MINING;

ANALYTIC METHOD; ARTICLE; CALCULATION; CLASSIFICATION ALGORITHM; CONTROLLED STUDY; FOREST CLASSIFICATION TREE; FOREST SUPPORT VECTOR MACHINE; GENE EXPRESSION; GENETIC ALGORITHM; MATHEMATICAL MODEL; METASTASIS; MICROARRAY ANALYSIS; PRIORITY JOURNAL; SUPPORT VECTOR MACHINE; TUMOR; ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; DECISION SUPPORT SYSTEM; DNA MICROARRAY; GENE EXPRESSION PROFILING; HUMAN; MALE; METABOLISM; PROCEDURES; PROSTATIC NEOPLASMS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DECISION SUPPORT TECHNIQUES; DIAGNOSIS, COMPUTER-ASSISTED; GENE EXPRESSION PROFILING; HUMANS; MALE; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; PATTERN RECOGNITION, AUTOMATED; PROSTATIC NEOPLASMS; TUMOR MARKERS, BIOLOGICAL;

TUMOR MARKER;

EID: 77952541011     PISSN: 00104825     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compbiomed.2010.03.006     Document Type: Article

References (50)

1. Barrett J.C., Cardon L.R. Evaluating coverage of genome-wide association studies. Nat. Genet. 2006, 38:659-662.
2. Boguski M.S., McIntosh M.W. Biomedical informatics for proteomics. Nature 2003, 422:233-237.
3. Golub T.R., Slonim D.K., Tamayo P., Huard C., Gaasenbeek M., Mesirov J.P., Coller H., Loh M.L., Downing J.R., Caligiuri M.A., Bloomfield C.D., Lander E.S. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 1999, 286:531-537.
4. Zintzaras E., Ioannidis J.P. Meta-analysis for ranked discovery datasets: theoretical framework and empirical demonstration for microarrays. Comput. Biol. Chem. 2008, 32:38-46.
5. Dudoit S., Fridlyand J., Speed T.P. Comparison of discrimination methods for the classification of tumors using gene expression data. J. Am. Stat. Assoc. 2002, 97:77-87.
6. Hong H., Tong W., Perkins R., Fang H., Xie Q., Shi L. Multiclass decision forest-a novel pattern recognition method for multiclass classification in microarray data analysis. DNA Cell Biol. 2004, 23:685-694.
7. Markowetz F., Spang R. Molecular diagnosis. classification, model selection and performance evaluation. Meth. Inf. Med. 2005, 44:438-443.
8. Brown M.P., Grundy W.N., Lin D., Cristianini N., Sugnet C.W., Furey T.S., Ares M., Haussler D. Knowledge-based analysis of microarray gene expression data by using support vector machines. Proc. Natl. Acad. Sci. USA 2000, 97:262-267.
9. Furey T.S., Cristianini N., Duffy N., Bednarski D.W., Schummer M., Haussler D. Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics 2000, 16:906-914.
10. Guyon I., Weston J., Barnhill S. Gene selection for cancer classification using support vector machines. Mach. Learn. 2002, 46:389-422.
11. Hsu C.W., Lin C.J. A comparison of methods for multiclass support vector machines. IEEE Trans. Neural Networks 2002, 13:415-425.
12. Ramaswamy S., Tamayo P., Rifkin R., Mukherjee S., Yeang C.H., Angelo M., Ladd C., Reich M., Latulippe E., Mesirov J.P., Poggio T., Gerald W., Loda M., Lander E.S., Golub T.R. Multiclass cancer diagnosis using tumor gene expression signatures. Proc. Natl. Acad. Sci. USA 2001, 98:15149-15154.
13. Wu B., Abbott T., Fishman D., McMurray W., Mor G., Stone K., Ward D., Williams K., Zhao H. Comparison of statistical methods for classification of ovarian cancer using mass spectrometry data. Bioinformatics 2003, 19:1636-1643.
14. Phan J., Moffitt R., Dale J., Petros J., Young A., Wang M. Improvement of SVM Algorithm for microarray analysis using intelligent parameter selection. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2005, 5:4838-4841.
15. Vapnik V. The Nature of Statistical Learning Theory 1995, Springer-Verlag, Berlin.
16. Breiman L., Friedman J.H., Olson R.A., Stone J.C. Classification and Regression Trees 1984, Wadsworth, Belmont.
17. Zintzaras E., Brown N.P., Kowald A. Growing a classification tree using the apparent misclassification rate. Comput. Appl. Biosci. 1994, 10:263-271.
18. Allory Y., Bazille C., Vieillefond A., Molinie V., Cochand-Priollet B., Cussenot O., Callard P., Sibony M. Profiling and classification tree applied to renal epithelial tumours. Histopathology 2008, 52:158-166.
19. Khan J., Wei J.S., Ringner M., Saal L.H., Ladanyi M., Westermann F., Berthold F., Schwab M., Antonescu C.R., Peterson C., Meltzer P.S. Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nat. Med. 2001, 7:673-679.
20. Zhang H., Yu C.Y., Singer B., Xiong M. Recursive partitioning for tumor classification with gene expression microarray data. Proc. Natl. Acad. Sci. USA 2001, 98:6730-6735.
21. Yeang C.H., Ramaswamy S., Tamayo P., Mukherjee S., Rifkin R.M., Angelo M., Reich M., Lander E., Mesirov J., Golub T. Molecular classification of multiple tumor types. Bioinformatics 2001, 17(Suppl 1):S316-S322.
22. Breiman L. Random forests. Mach. Learn. 2001, 45:5-32.
23. Bureau A., Dupuis J., Falls K., Lunetta K.L., Hayward B., Keith T.P., Van E.P. Identifying SNPs predictive of phenotype using random forests. Genet. Epidemiol. 2005, 28:171-182.
24. Zhang H., Bonney G. Use of classification trees for association studies. Genet. Epidemiol. 2000, 19:323-332.
25. Zintzaras E., Brown N.P., Kowald A. Non-parametric classification of protein secondary structures. Comput. Biol. Med. 2006, 36:145-156.
26. Zintzaras E., Bai M., Douligeris C., Kowald A., Kanavaros P. A tree-based decision rule for identifying profile groups of cases without predefined classes: application in diffuse large B-cell lymphomas. Comput. Biol. Med. 2007, 37:637-641.
27. Zintzaras E. Classification tree based protein structure distances for testing sequence-structure correlation. Comput. Biol. Med. 2008, 38:469-474.
28. C.D. Sutton, Classification and regression trees, bagging, and boosting, in: C.R. Rao, E.J. Wegman, J.L. Solka, (Eds.), Handbook of Statistics, vol. 24, 2005 pp. 302-328.
29. Efron B., Tibshirani R. Statistical data analysis in the computer age. Science 1991, 253:390-395.
30. Chandran U.R., Ma C., Dhir R., Bisceglia M., Lyons-Weiler M., Liang W., Michalopoulos G., Becich M., Monzon F.A. Gene expression profiles of prostate cancer reveal involvement of multiple molecular pathways in the metastatic process. BMC Cancer 2007, 7:64.
31. Diaz-Uriarte R., varez de A.S. Gene selection and classification of microarray data using random forest. BMC Bioinformatics 2006, 7:3.
32. Dabney A.R. Classification of microarrays to nearest centroids. Bioinformatics 2005, 21:4148-4154.
33. Romualdi C., Campanaro S., Campagna D., Celegato B., Cannata N., Toppo S., Valle G., Lanfranchi G. Pattern recognition in gene expression profiling using DNA array: a comparative study of different statistical methods applied to cancer classification. Hum. Mol. Genet. 2003, 12:823-836.
34. Carvalho D.R., Freitas A.A. Hybrid decision tree/genetic algorithm method for data mining. Inf. Sci. 2004, 163:13-35.
35. Cha S.H., Tappert C.C. A genetic algorithm for constructing compact binary decision trees. J. Pattern Recognition Res. 2009, 4:1-13.
36. Goldberg D.E. Genetic Algorithms in Search, Optimization, and Machine Learning 1988, Addison-Wesley, Reading.
37. Dejong K.A., Spears W.M., Gordon D.F. Using genetic algorithms for concept-learning. Mach. Learn. 1993, 13:161-188.
38. Gray J.B., Fan G.Z. Classification tree analysis using TARGET. Comput. Stat. Data Anal. 2008, 52:1362-1372.
39. Turney P.D. Cost-sensitive classification: empirical evaluation of a hybrid genetic decision tree induction algorithm. J. Artif. Intell. Res. 1995, 2:369-409.
40. A. Papagelis, D. Kalles, Breeding decision trees using evolutionary techniques, in: International Conference on Machine Learning, Williamstown, 2001.
41. A. Papagelis, D. Kalles, GATree: Genetically evolved decision trees, in: Proceedings of 12th IEEE International Conference on Tools with Artificial Intelligence, Vancouver, 2000.
42. A. Papagelis, D. Kalles, Lossless fitness inheritance in genetic algorithms for decision trees, Soft Computing, in press. doi:10.1007/s00500-009-0489-y.
43. Li L., Weinberg C.R., Darden T.A., Pedersen L.G. Gene selection for sample classification based on gene expression data: study of sensitivity to choice of parameters of the GA/KNN method. Bioinformatics 2001, 17:1131-1142.
44. Zintzaras E., Margaritopoulos J., Tsitsipis J. Statistical tree classification of aphids based on morphological characters. Comput. Electron. Agric. 1999, 24:165-175.
45. Raudys S., Pikelis V. On dimensionality, sample size, classification error and complexity of classification algorithm in pattern recognition. IEEE Trans. Pattern Anal. Mach. Intell. 1980, 242-252.
46. Raudys S. On dimensionality, sample size and classification error of nonparametric linear classification algorithms. IEEE Trans. Pattern. Anal. Mach. Intell. 1997, 19:667-671.
47. Raudys S. Statistical and Neural Classifiers: An Integrated Approach to Design (Advances in Pattern Recognition S.) 2001, Springer, London.
48. Wharton S.W. An analysis of the effects of sample size on classification performance of a histogram based cluster analysis procedure. Pattern Recognition 1984, 17:239-244.
49. Boulesteix A.L., Tutz G., Strimmer K. A CART-based approach to discover emerging patterns in microarray data. Bioinformatics 2003, 19:2465-2472.
50. Braga-Neto U.M., Dougherty E.R. Is cross-validation valid for small-sample microarray classification?. Bioinformatics 2004, 20:374-380.