An ensemble of SVM classifiers based on gene pairs

Computers in Biology and Medicine

Volumn 43, Issue 6, 2013, Pages 729-737

  Tong, Muchenxuan ^a   Liu, Kun Hong ^a   Xu, Chungui ^b   Ju, Wenbin ^c  

^a XIAMEN UNIVERSITY   (China)

^b PEKING UNIVERSITY PEOPLE S HOSPITAL   (China)

^c DALIAN MEDICAL UNIVERSITY   (China)

Author keywords

Ensemble learning; Genetic algorithm (GA); Microarray data; Support vector machine (SVM); Top scoring pair (TSP)

Indexed keywords

ENSEMBLE CLASSIFIERS; ENSEMBLE LEARNING; ENSEMBLE SYSTEMS; INFORMATIVE GENES; INTERPRETABILITY; MICROARRAY DATA; MICROARRAY EXPRESSIONS; OPTIMIZED COMBINATIONS;

GENES; GENETIC ALGORITHMS;

SUPPORT VECTOR MACHINES;

ACCURACY; ARTICLE; GENE EXPRESSION; GENETIC ALGORITHM; MICROARRAY ANALYSIS; PRIORITY JOURNAL; SUPPORT VECTOR MACHINE;

GENE EXPRESSION PROFILING; GENE EXPRESSION REGULATION; GENES; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; SUPPORT VECTOR MACHINES; TRANSCRIPTOME;

EID: 84877695360     PISSN: 00104825     EISSN: 18790534     Source Type: Journal    
DOI: 10.1016/j.compbiomed.2013.03.010     Document Type: Article

References (55)

1. Golub T.R., Slonim D.K., Tamayo P., Huard C., Gaasenbeek M., Mesirov J.P., Coller H., Loh M.L., Downing J.R., Caligiuri M.A., Bloomfield C.D., Lander E.S. Molecular classification of cancer. class discovery and class prediction by gene expression monitoring. Science 1999, 286(5439):531-537.
2. Breiman L. Statistical modeling. the two cultures. Stat. Sci. 2001, 16(3):199-231.
3. Breiman L. Heuristics of instability and stabilization in model selection. Ann. Stat. 1996, 24(6):2350-2383.
4. Saeys Y., Inza I., Larrañaga P. A review of feature selection techniques in bioinformatics. Bioinformatics 2007, 23(19):2507.
5. Hua J., Tembe W., Dougherty E. Performance of feature-selection methods in the classification of high-dimension data. Pattern Recognition 2009, 42(3):409-424.
6. Alter O., Brown P.O., Botstein D. Singular value decomposition for genome-wide expression data processing and modeling. Proc. Natl. Acad. Sci. 2000, 97(18):10101-10106. arXiv:http://www.pnas.org/content/97/18/10101.full.pdf+html.
7. Cangelosi R., Goriely A. Component retention in principal component analysis with application to cdna microarray data. Biol. Direct 2007, 2:1-21. 10.1186/1745-6150-2-2.
8. Liebermeister W. Linear modes of gene expression determined by independent component analysis. Bioinformatics 2002, 18(1):51.
9. Lee S., Batzoglou S., et al. Application of independent component analysis to microarrays. Genome Biol. 2003, 4(11):76.
10. Chiappetta P., Roubaud M., Torrésani B. Blind source separation and the analysis of microarray data. J. Comput. Biol. 2004, 11(6):1090-1109.
11. Huang D., Zheng C. Independent component analysis-based penalized discriminant method for tumor classification using gene expression data. Bioinformatics 2006, 22(15):1855.
12. Liu K., Li B., Zhang J., Du J. Ensemble component selection for improving ica based microarray data prediction models. Pattern Recognition 2009, 42(7):1274-1283.
13. Liu K., Li B., Wu Q.-Q., Zhang J., Du J.-X., Liu G.-Y. Microarray data classification based on ensemble independent component selection. Comput. Biol. Med. 2009, 39(11):953-960.
14. Vapnik V. The Nature of Statistical Learning Theory 2000, Springer, Verlag.
15. Lee J., Lee J., Park M., Song S. An extensive comparison of recent classification tools applied to microarray data. Comput. Stat. Data Anal. 2005, 48(4):869-885.
16. Boulesteix A., Strobl C., Augustin T., Daumer M. Evaluating microarray-based classifiers. an overview. Cancer Inf. 2008, 6:77.
17. Kuncheva L.I. Combining Pattern Classifiers. Methods and Algorithms 2004, Wiley-Interscience.
18. Freund Y., Schapire R. A decision-theoretic generalization of on-line learning and an application to boosting. Computational Learning Theory 1995, 23-37. Springer, Berlin, Heidelberg. P. Vitányi (Ed.).
19. Kuncheva L.I., Whitaker C.J. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach. Learn. 2003, 51(2):181-207.
20. Kuncheva L.I., Rodriguez J.J. Classifier ensembles with a random linear oracle. IEEE Trans. Knowl. Data Eng. 2007, 19(4):500-508.
21. Geman D., d'Avignon C., Naiman D.Q., Winslow R.L. Classifying gene expression profiles from pairwise mRNA comparisons. Stat. Appl. Genet. Mol. Biol. 2004, 3(1):19.
22. Price N., Trent J., El-Naggar A., Cogdell D., Taylor E., Hunt K., Pollock R., Hood L., Shmulevich I., Zhang W. Highly accurate two-gene classifier for differentiating gastrointestinal stromal tumors and leiomyosarcomas. Proc. Natl. Acad. Sci. 2007, 104(9):3414.
23. Tan A., Naiman D., Xu L., Winslow R., Geman D. Simple decision rules for classifying human cancers from gene expression profiles. Bioinformatics 2005, 21(October):3896-3904.
24. Luo H., Sudibyo Y., Miller L., Karuturi R. Weighted top score pair method for gene selection and classification. Pattern Recognition in Bioinformatics of Lecture Notes in Computer Science 2008, vol. 5265:323-333. Springer, Berlin, Heidelberg.
25. M. Czajkowski, M. Krtowski, Novel extension of k-tsp algorithm for microarray classification, in: New Frontiers in Applied Artificial Intelligence, Lecture Notes in Computer Science, vol. 5027, Springer, Berlin, Heidelberg, 2008, pp. 456-465.
26. Li J., Tang X. A new classification model with simple decision rule for discovering optimal feature gene pairs. Comput. Biol. Med. 2007, 37(11):1637-1646.
27. Yoon S., Kim S. k-top scoring pair algorithm for feature selection in SVM with applications to microarray data classification. Soft Comput. Fusion Found. Methodol. Appl. 2010, 14(2):151-159.
28. Shi P., Ray S., Zhu Q., Kon M. Top scoring pairs for feature selection in machine learning and applications to cancer outcome prediction. BMC Bioinf. 2011, 12(1):375.
29. Chopra P., Lee J., Kang J., Lee S. Improving cancer classification accuracy using gene pairs. PLoS ONE 2010, 5(12):e14305.
30. M. Tong, K. Liu, A novel ensemble SVM classifier based on gene pairs, in: Sixth International Conference on Bioinformatics and Biomedical Engineering, iCBBE 2012, vol. 2, 2012, pp. 473-476.
31. Welsh J., Sapinoso L., Su A., Kern S., Wang-Rodriguez J., Moskaluk C., Frierson H., Hampton G. Analysis of gene expression identifies candidate markers and pharmacological targets in prostate cancer. Cancer Res. 2001, 61(16):5974-5978.
32. Cortes C., Vapnik V. Support-vector networks. Mach. Learn. 1995, 20:273-297. 10.1007/BF00994018.
33. Chang C.-C., Lin C.-J. LIBSVM. a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2:27:1-27:27.
34. Ko A.H., Sabourin R., Alceu Souza Britto J. From dynamic classifier selection to dynamic ensemble selection. Pattern Recognition 2008, 41(5):1718-1731.
35. Perone C.S. Pyevolve. a python open-source framework for genetic algorithms. SIGEVOlution 2009, 4:12-20.
36. Li T., Zhang C., Ogihara M. A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression. Bioinformatics 2004, 20(15):2429-2437.
37. Pomeroy S.L., Tamayo P., Gaasenbeek M., Sturla L.M., Angelo M., McLaughlin M.E., Kim J.Y.H., Goumnerova L.C., Black P.M., Lau C., Allen J.C., Zagzag D., Olson J.M., Curran T., Wetmore C., Biegel J.A., Poggio T., Mukherjee S., Rifkin R., Califano A., Stolovitzky G., Louis D.N., Mesirov J.P., Lander E.S., Golub T.R. Prediction of central nervous system embryonal tumour outcome based on gene expression. Nature 2002, 415(6870):436-442.
38. Shipp M.A., Ross K.N., Tamayo P., Weng A.P., Kutok J.L., Aguiar R.C., Gaasenbeek M., Angelo M., Reich M., Pinkus G.S., Ray T.S., Koval M.A., Last K.W., Norton A., Lister T.A., Mesirov J., Neuberg D.S., Lander E.S., Aster J.C., Golub T.R. Diffuse large b-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning. Nat. Med. 2002, 8(1):68-74.
39. Alon U., Barkai N., Notterman D., Gish K., Ybarra S., Mack D., Levine A. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc. Natl. Acad. Sci. USA 1999, 96(12):6745-6750.
40. Singh D., Febbo P.G., Ross K., Jackson D.G., Manola J., Ladd C., Tamayo P., Renshaw A.A., D'Amico A.V., Richie J.P., Lander E.S., Loda M., Kantoff P.W., Golub T.R., Sellers W.R. Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 2002, 1(2):203-209.
41. Stuart R.O., Wachsman W., Berry C.C., Wang-Rodriguez J., Wasserman L., Klacansky I., Masys D., Arden K., Goodison S., McClelland M., Wang Y., Sawyers A., Kalcheva I., Tarin D., Mercola D. In silico dissection of cell-type-associated patterns of gene expression in prostate cancer. Proc. Natl. Acad. Sci. USA 2004, 101(2):615-620.
42. Gordon G.J., Jensen R.V., Hsiao L.-L., Gullans S.R., Blumenstock J.E., Ramaswamy S., Richards W.G., Sugarbaker D.J., Bueno R. Translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma. Cancer Res. 2002, 62(17):4963-4967.
43. Wang Y., Klijn J.G., Zhang Y., Sieuwerts A.M., Look M.P., Yang F., Talantov D., Timmermans M., Meijer-van Gelder M.E., Yu J., Jatkoe T., Berns E.M., Atkins D., Foekens J.A. Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer. Lancet 2005, 365(9460):671-679.
44. Beer D.G., Kardia S.L.R., Huang C.-C., Giordano T.J., Levin A.M., Misek D.E., Lin L., Chen G., Gharib T.G., Thomas D.G., Lizyness M.L., Kuick R., Hayasaka S., Taylor J.M.G., Iannettoni M.D., Orringer M.B., Hanash S. Gene-expression profiles predict survival of patients with lung adenocarcinoma. Nat. Med. 2002, 8(8):816-824.
45. Guyon I., Weston J., Barnhill S., Vapnik V. Gene selection for cancer classification using support vector machines. Mach. Learn. 2002, 46(1/3):389-422.
46. Pedregosa F., Varoquaux G., Gramfort A., Michel V., Thirion B., Grisel O., Blondel M., Prettenhofer P., Weiss R., Dubourg V., Vanderplas J., Passos A., Cournapeau D., Brucher M., Perrot M., Duchesnay E. Scikit-learn. machine learning in python. J. Mach. Learn. Res. 2011, 12:2825-2830.
47. Armstrong S.A., Staunton J.E., Silverman L.B., Pieters R., den Boer M.L., Minden M.D., Sallan S.E., Lander E.S., Golub T.R., Korsmeyer S.J. Mll translocations specify a distinct gene expression profile that distinguishes a unique leukemia. Nat. Genet. 2002, 30(1):41-47.
48. Khan J., Wei J., Ringnér M., Saal L., Ladanyi M., Westermann F., Berthold F., Schwab M., Antonescu C., Peterson C., et al. Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nat. Med. 2001, 7(6):673-679.
49. Perou C.M., Sørlie T., Eisen M.B., van de Rijn M., Jeffrey S.S., Rees C.a., Pollack J.R., Ross D.T., Johnsen H., Akslen L.a., Fluge O., Pergamenschikov A., Williams C., Zhu S.X., Lønning P.E., Børresen Dale a.L., Brown P.O., Botstein D. Molecular portraits of human breast tumours. Nature 2000, 406(6797):747-752.
50. Bhattacharjee A., Richards W.G., Staunton J., Li C., Monti S., Vasa P., Ladd C., Beheshti J., Bueno R., Gillette M., Loda M., Weber G., Mark E.J., Lander E.S., Wong W., Johnson B.E., Golub T.R., Sugarbaker D.J., Meyerson M. Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses. Proc. Natl. Acad. Sci. USA 2001, 98(24):13790-13795.
51. Alizadeh A.A., Eisen M.B., Davis R.E., Ma C., Lossos I.S., Rosenwald A., Boldrick J.C., Sabet H., Tran T., Yu X., Powell J.I., Yang L., Marti G.E., Moore T., Hudson J., Lu L., Lewis D.B., Tibshirani R., Sherlock G., Chan W.C., Greiner T.C., Weisenburger D.D., Armitage J.O., Warnke R., Levy R., Wilson W., Grever M.R., Byrd J.C., Botstein D., Brown P.O., Staudt L.M. Distinct types of diffuse large b-cell lymphoma identified by gene expression profiling. Nature 2000, 403(6769):503-511.
52. Yeoh E., Ross M.E., Shurtleff S.A., Williams W.K., Patel D., Mahfouz R., Behm F.G., Raimondi S.C., Relling M.V., Patel A., Cheng C., Campana D., Wilkins D., Zhou X., Li J., Liu H., Pui C., Evans W.E., Naeve C., Wong L., Downing J.R. Classification, subtype discovery, and prediction of outcome in pediatric acute lymphoblastic leukemia by gene expression profiling. Cancer Cell 2002, 1(2):133-143.
53. Su A., Welsh J., Sapinoso L., Kern S., Dimitrov P., Lapp H., Schultz P., Powell S., Moskaluk C., Frierson H., Hampton G. Molecular classification of human carcinomas by use of gene expression signatures. Cancer Res. 2001, 61:7388-7393.
54. Ramaswamy S., Tamayo P., Rifkin R., Mukherjee S., Yeang C.H., Angelo M., Ladd C., Reich M., Latulippe E., Mesirov J.P., Poggio T., Gerald W., Loda M., Lander E.S., Golub T.R. Multiclass cancer diagnosis using tumor gene expression signatures. Proc. Natl. Acad. Sci. USA 2001, 98(26):15149-15154.
55. D. Margineantu, T. Dietterich, Pruning adaptive boosting, in: Proceedings of the Fourteenth International Conference on Machine Learning, Morgan Kaufmann Publishers Inc., 1997, pp. 211-218.