Effective automated feature construction and selection for classification of biological sequences

PLoS ONE

Volumn 9, Issue 7, 2014, Pages

  Kamath, Uday ^a   De Jong, Kenneth ^a,b   Shehu, Amarda ^a,b  

^a George Mason University   (United States)

^b GEORGE MASON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DNA; RNA SPLICING;

ALU SEQUENCE; ARTICLE; AUTOMATION; BIOINFORMATICS; CONTROLLED STUDY; DNA DETERMINATION; DNA SEQUENCE; DNA STRUCTURE; EVOLUTIONARY ALGORITHM; MACHINE LEARNING; RNA SPLICING; SEQUENCE ANALYSIS; SIGNAL PROCESSING; SUPPORT VECTOR MACHINE; ALGORITHM; AUTOMATED PATTERN RECOGNITION; BIOLOGY; GENETICS; NUCLEOTIDE SEQUENCE; PROCEDURES; REGULATORY SEQUENCE; SIGNAL TRANSDUCTION;

ALGORITHMS; ALU ELEMENTS; BASE SEQUENCE; COMPUTATIONAL BIOLOGY; DNA; PATTERN RECOGNITION, AUTOMATED; REGULATORY SEQUENCES, NUCLEIC ACID; RNA SPLICE SITES; SEQUENCE ANALYSIS, DNA; SIGNAL TRANSDUCTION;

EID: 84904490572     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0099982     Document Type: Article

References (121)

1. ENCODE Consortium (2012) An integrated encyclopedia of DNA elements in the human genome. Nature 489: 457-74.
2. Majoros WH, Pertea M, Antonescu C, Salzberg SL (2003) GlimmerM, Exonomy and Unveil: three ab initio eukaryotic genefinders. Nucl Acids Res 31: 3601-3604. (Pubitemid 37442206)
3. Bajic V, Brent M, Brown R, Frankish A, Harrow J, et al. (2006) Performance assessment of promoter predictions on ENCODE regions in the EGASP experiment. Genome Biology 489: 457-474.
4. Mathé C, Sagot MF, Schiex T, Rouzé P (2002) Current methods of gene prediction, their strengths and weaknesses. Nucl Acids Res 30: 4103-4117.
5. Stamatoyannopoulos JA (2012) What does our genome encode? Genome Res 22: 1602-1611.
6. Burge C, Karlin S (1997) Prediction of complete gene structures in human genomic DNA. J Mol Biol 268: 78-94. (Pubitemid 27192680)
7. Pertea M, Lin X, Salzberg SL (2001) Genesplicer: a new computational method for splice site prediction. Nucl Acids Res 29: 1185-1190. (Pubitemid 32186204)
8. Kim W, Wilbur WJ (2002) DNA splice site detection: a comparison of specific and general methods. In: AMIA Symp. pp. 390-394.
9. Sonnenburg S, Rätsch G, Jagota A, Müller K (2002) New methods for splice-site recognition. In: Proc Intl Conf on Artificial Neural Networks. Springer-Verlag, pp. 329-336.
10. Raymer ML, Punch WF, Goodman ED, Kuhn LA, Jain AK (2004) Accurate splice site detection for caenorhabditis elegans. In: Kernel Methods in Computational Biology, MIT Press. pp. 277-298.
11. Yeo G (2004) Maximum entropy modeling of short sequence motifs with applications to RNA splicing signals. J Comp Biol 11: 377-394.
12. Sonnenburg S, Schweikert G, Philips P, Behr J, Rätsch G (2007) Accurate splice site prediction using support vector machines. BMC Bioinformatics 8: S7.
13. Islamaj-Dogan R, Getoor L, Wilbur WJ (2006) A feature generation algorithm for sequences with application to splice-site prediction. In: Lecture Notes in Computer Science: Knowledge Discovery in Databases, Springer, volume 4213. pp. 553-560. (Pubitemid 44617757)
14. Islamaj-Dogan R, Getoor L, Wilbur WJ, Mount SM (2007) Features generated for computational splice-site prediction correspond to functional elements. BMC Bioinformatics 8: 410-416.
15. Kamath U, Shehu A, De Jong KA (2010) Using evolutionary computation to improve SVM classification. In: WCCI: IEEE World Conf. Comp. Intel. Barcelona, Spain: IEEE, pp. 1-8.
16. Kamath U, Compton J, Islamaj Dogan R, De Jong KA, Shehu A (2012) An evolutionary algorithm approach for feature generation from sequence data and its application to dna splice-site prediction. IEEE Trans Comp Biol and Bioinf 9: 1387-1398.
17. Maston GA, Evans SK, Green MR (2006) Transriptional regulatory elements in the human genome. Annu Rev Genom Human Genet 7: 29-59. (Pubitemid 44627921)
18. Blanchette M, Bataille AR, Chen X, Poitras C, Laganiere J, et al. (2006) Genome-wide computational prediction of transcriptional regulatory modules reveals new insights into human gene expression. Genome Res 16: 656-668.
19. Sinha S, Tompa M (2002) Discovery of novel transcription factor binding sites by statistical overrepresentation. Nucl Acids Res 30: 5549-5560. (Pubitemid 36113932)
20. Berman BP, Nibu Y, Pfeiffer BD, Tomancak P, Celniker SE, et al. (2002) Exploiting transcription factor binding site clustering to identify cis-regulatory modules involved in pattern formation in the Drosophila genome. Proc Natl Acad Sci USA 98: 757-762. (Pubitemid 34106583)
21. Tompa M, Li N, Bailey TL, Church GM, De Moor B, et al. (2005) Assessing computational tools for the discovery of transcription factor binding sites. Nat Biotechnol 23: 137-144. (Pubitemid 41724640)
22. Wu C (1980) The 50′ ends of drosophila heat shock genes in chromatin are hypersensitive to DNase I. Nature 286: 854-860.
23. Gross DS, Garrard WT (1988) Nuclear hypersensitive sites in chromatin. Annu Rev Biochem 57: 159-197.
24. Lowrey CH, Bodine DM, Nienhuis AW (1992) Mechanism of DNase I hypersensitive site formation within the human globin locus control region. Proc Natl Acad Sci USA 89: 1143-1147.
25. Noble WS, Kuehn S, Thurman R, Yu M, Stamatoyannopoulos JA (2005) Predicting the in vivo signature of human gene regulatory sequences. Bioinformatics 21: i338-i343. (Pubitemid 41794506)
26. Kamath U, De Jong KA, Shehu A (2010) Selecting predictive features for recognition of hypersensitive sites of regulatory genomic sequences with an evolutionary algorithm. In: GECCO: Gen. Evol. Comp. Conf. New York, NY, USA: ACM, pp. 179-186.
27. Kamath U, Shehu A, De Jong KA (2010) Feature and kernel evolution for recognition of hypersensitive sites in DNA sequences. In: BIONETICS: Intl. Conf. on Bio-inspired Models of Network, Information, and Computing Systems. Boston, MA: Springer, pp. 213-238.
28. Kamath U, Shehu A, De Jong KA (2011) A two-stage evolutionary approach for effective classification of hypersensitive dna sequences. J Bioinf & Comp Biol 9: 399-413.
29. Jurka J (1993) A new subfamily of recently retroposed human alu repeats. Nucl Acids Res 21: 2252.
30. Claverie J, Makalowski W (194) Alu alert. Nature 752: 752.
31. Lander ES, Linton LM, Birren B, Nusbaum C, Zody MC, et al. (2001) Initial sequencing and analysis of the human genome. Nature 409: 860-921.
32. Deininger P (2011) Alu elements: know the SINEs. Genome Biol 12: 236-249.
33. Dharmasaroja P (2011) Artificial neural networks and support vector machine identify alu elements as being associated with human housekeeping genes. In: Intl. Conf. on Biomedical Engineering and Informatics (BMEI). volume 3, pp. 1664-1668. doi:10.1109/BMEI.2011.6098522.
34. Cui F, Sirotin MV, Zhurkin VB (2011) Impact of alu repeats on the evolution of human p53 binding sites. Biology Direct 6: 1-20.
35. Zhang W, Edwards A, Fan W, Deininger P, Zhang K (2011) Alu distribution and mutation types of cancer genes. BMC Genomics 12: 157-172.
36. Smialowski P, Schmidt T, Cox J, Kirschner A, Frishman D (2006) Will my protein crystallize? A sequence-based predictor. Proteins: Struct Funct Bioinf 62: 343-355. (Pubitemid 43054356)
37. Habib T, Zhang C, Yang JY, Yang MQ, Deng Y (2008) Supervised learning method for the prediction of subcellular localization of proteins using amino acid and amino acid pair composition. BMC Genom 9: S1-S16.
38. Kernytsky A, Rost B (2009) Using genetic algorithms to select most predictive protein features. Proteins: Struct Funct Bioinf 75: 75-88.
39. Veltri D, Shehu A (2013) Physicochemical determinants of antimicrobial activity. In: Intl Conf on Bioinf and Comp Biol (BICoB). Honolulu, Hawaii, pp. 1-6.
40. Randou EG, Veltri D, Shehu A (2013) Systematic analysis of global features and model building for recognition of antimicrobial peptides. In: ICCABS: IEEE Intl Conf on Comput Adv in Bio and Med Sciences. New Orleans, LA, pp. 1-6.
41. Karchin R, Cline M, Mandel-Gutfreund Y, Karplus K (2003) Hidden Markov Models that use predicted local structures for fold recognition: alphabets of backbone geometry. Proteins 51: 504-514. (Pubitemid 36676135)
42. Ivankov DN, Finkelstein AV (2004) Prediction of protein folding rates from the amino-acid sequence-predicted secondary structure. Proc Natl Acad Sci USA 101: 8942-8944. (Pubitemid 38781590)
43. Bystroff C, Krogh A (2008) Hidden Markov Models for prediction of protein features. Methods Mol Biol 413: 173-198.
44. Cole C, Barber JD, Barton GJ (2008) The Jpred 3 secondary structure prediction server. Nucl Acids Res 35: W197-W201.
45. Whisstock JC, Lesk AM (2003) Prediction of protein function from protein sequence and structure. Q Rev Biophys 36: 307-340. (Pubitemid 38268660)
46. Sharan R, Ulitsky I, Shamir R (2007) Network-based prediction of protein function. Nat Mol Sys Biol 3: 1-13. (Pubitemid 46423534)
47. Luque-Escamilla PL, Martinez-Aroza J, Oliver JL (2005) Compositional searching of CpG islands in the human genome. Phys Rev E 71: 061925.
48. Ng AY, Jordan MI (2002) On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes. Neural Information Processing Systems: 1-8.
49. Bishop CM, Lasserre J (2007) Generative or discriminative? getting the best of both worlds. Bayesian Statistics 8: 3-24.
50. Bishop CM (2006) Pattern Recognition and Machine Learning. Singapore: Springer.
51. Keilwagen J, Grau J, Posch S, Strickert M, Grosse I (2010) Unifying generative and discriminative learning principles. BMC Bioinformatics 11: 1-9.
52. Staden R (1984) Methods to locate signals in nucleic acid sequences. Nucl Acids Res 12: 505-519.
53. Gershenzon NI, Stormo GD, Ioshikhes IP (2005) Computational technique for improvement of the position-weight matrices for the DNA/protein binding sites. Nucl Acids Res 33: 2290-2301. (Pubitemid 41439896)
54. Taher L, Meinicke P, Morgensten B (2007) On splice site prediction using weight array models: a comparison of smoothing techniques. J of Physics: Conference Series 90: 012004.
55. Xing EP, Jordan MI, Karp RM, Russell S (2002) A hierarchical Bayesian Markovian model for motifs in biopolymer sequences. In: Advances in Neural Information Processing Systems. pp. 200-207.
56. Keilwagen J, Grau J, Paponov IA, Posch S, Strickert M, et al. (2011) De-novo discovery of differentially abundant transcription factor binding sites including their positional preference. PLoS Comp Biol 7: e1001070.
57. Cai D, Delcher A, Kao B, Kasif S (2000) Modeling splice sites with bayes networks. Bioinformatics 16: 152-158. (Pubitemid 30248592)
58. Ben-Gal I, Shani A, Gohr A, Grau J, Arviv S, et al. (2005) Identification of transcription factor binding sites with variable-order bayesian networks. Bioinformatics 21: 2657-2666. (Pubitemid 40852312)
59. Yakhnenko O, Silvescu A, Honavar V (2005) Discriminatively trained Markov model for sequence classification. In: ICDM: IEEE Intl Conf on Data Mining. pp. 1-8.
60. Bernal A, Crammer K, Hatzigeorgiou A, Pereira F (2003) Global discriminative learning for higher-accuracy computational gene prediction. PLoS Comp Biol 3: e54.
61. Barash Y, Elidan G, Friedman N, Kaplan T (2003) Modeling dependencies in protein-DNA binding sites. In: RECOMB: Intl Conf on Res in Comput Mol Biol). New York, NY: ACM Press, pp. 1-8.
62. King OD, Roth FP (2003) A non-parametric model for transcription factor binding sites. Nucl Acids Res 31: e116.
63. Vapnik VN (1995) The nature of statistical learning theory. New York, NY: Springer.
64. Noble WS (2004) Support vector machine applications in computational biology. In: Schölkopf B, Tsuda K, Vert JP, editors, Kernel Methods in Computational Biology, Cambridge, MA: MIT Press. pp. 71-92.
65. Sonnenburg S, Zien A, Rätsch G (2006) ARTS: accurate recognition of transcription starts in human. Bioinformatics 22: e472-480. (Pubitemid 44288318)
66. Tech M, Pfeifer N, Morgenstein B, Meinicke P (2005) TICO: a tool for improving predictions of prokaryotic translation initiation sites. Bioinformatics 21: 3568-3569. (Pubitemid 41236003)
67. Schweikert G, Zien A, Zeller G, Behr J, Dieterich C, et al. (2009) mGene: accurate SVM-based gene finding with an application to nematode genomes. Genome Res 19: 2133-2143.
68. Jiang B, Zhang MQ, Zhang X (2007) OSCAR: one-class SVM for accurate recognition of ciselements. Bioinformatics 23: 2823-2838.
69. Schultheiss SJ (2010) Kernel-based identification of regulatory modules. In: Computational Biology of Transcription Factor Binding Sites, Springer, volume 674 of Methods Mol Biol. pp. 213-223.
70. Leslie C, Eskin E, Noble WS (2002) The spectrum kernel: a string kernel for SVM protein classification. In: Pacific Symposium on Biocomputing. Baoding, China, volume 7, pp. 564-575.
71. Zhou X, Ruan J, Wang G, Zhang W (2007) Characterization and identification of microrna core promoters in four model species. PLoS Comp Biol 3: e37.
72. Anwar F, Baker SM, Jabid T, Hasan MM, Shoyaib M, et al. (2008) Pol II promoter prediction using characteristic 4-mer motifs: a machine learning approach. BMC Bioinformatics 9: 414-421.
73. Fletez-Brant C, Lee D, McCallion AS, Beer MA (2013) Kmer-SVM: a web server for identifying predictive regulatory sequence features in genomic data sets. Nucl Acids Res 41: W544-W556.
74. Chuzhanova NA, Jones AJ, Margetts S (1998) Feature selection for genetic sequence classification. Bioinformatics 14: 139-143. (Pubitemid 28395872)
75. Riviere R, Barth D, Cohen J, Denise A (2007) Shuffling biological sequences with motif constraints. J Discrete Algo 6: 192-204.
76. De Jong KA (2001) Evolutionary computation: a unified approach. Cambridge, MA: MIT Press.
77. Siedlecki W, Sklansky J (1989) A note on genetic algorithms for large-scale feature selection. Pattern Recogn Lett 10: 335-347.
78. Brill FA, Brown DE, Martin WN (1992) Fast genetic selection of features for neural networks. IEEE Trans on Neural Networks 3: 324-328.
79. Kuncheva LI, Jain LC (1999) Nearest neighbor classifier: simultaneous editing and feature selection. Pattern Recogn Lett 20: 1149-1156. (Pubitemid 32261892)
80. Raymer ML, Punch WF, Goodman ED, Kuhn LA, Jain AK (2000) Dimensionality reduction using genetic algorithms. IEEE Trans Evol Comput 4: 164-171.
81. Oh IS, Lee JS, Moon BR (2004) Hybrid genetic algorithms for feature selection. IEEE Trans on Pattern Analysis and Mach Learn 26: 1424-1437.
82. Huang J, Cai Y, Xu X (2007) A hybrid genetic algorithm for feature selection wrapper based on mutual information. J Pattern Recogn Lett 28: 1825-1844. (Pubitemid 47058633)
83. Leardi R, Boggia R, Terrile M (2005) Genetic algorithms as a strategy for feature selection. J Chemometrics 6: 267-281.
84. Smith SF (1980) A Learning System Based on Genetic Adaptive Algorithms. Ph.D. thesis, University of Pittsburgh.
85. Cramer NL (1985) A representation for the adaptive generation of simple sequential programs. In: Intl. Conf. on Genet. Algo. and the Applications. Pittsburgh, PA, pp. 183-187.
86. Schmidhuber J (1987) Evolutionary principles in self-referential learning. Ph.D. thesis, Tech. Univ. Munich.
87. Koza JR (1992) On the Programming of Computers by Means of Natural Selection. Boston, MA: MIT Press.
88. Venkatraman V, Dalby AR, Yang ZR (2004) Evaluation of mutual information and genetic programming for feature selection in QSAR. J Chem Inf Comput Sci 44: 1686-1692.
89. Muni DP, Pal NR, Das J (2006) Genetic programming for simultaneous feature selection and classifier design. Annu Rev Genom Human Genet 36: 106-117. (Pubitemid 43174145)
90. Yu J, Yu J, Almal AA, Dhanasekaran SM, Ghosh D, et al. (2007) Feature selection and molecular classification of cancer using genetic programming. Neoplasia 9: 292-303. (Pubitemid 46608296)
91. 1H NMR data. Chemometrics and Intell Laboratory Sys 81: 50-59.
92. Ramirez R, Puiggros M (2007) A genetic programming approach to feature selection and classification of instantaneous cognitive states. Lecture Notes in Computer Science: Applications of Evolutionary Computing 4448: 311-319. (Pubitemid 47290087)
93. Bins J (2000) Feature selection of huge feature sets in the context of computer vision. Ph.D. thesis, Colorado State University.
94. Kohavi R, John GH (1997) Wrappers for feature subset selection. Artificial Intelligence J 97: 273-324. (Pubitemid 127401107)
95. Blum AL, Rivest RL (1992) Training a 3-node neural network is NP-complete. Neural Networks 5: 117-127.
96. Hyafil L, Rivest RL (1976) Constructing optimal binary decision trees is NP-complete. Information Processing Letters 5: 15-17.
97. Kittler J (1978) Feature set search algorithms. In: Pattern Recognition and Signal Processing, The Netherlands: Sijthoff & Noordhoff, Alphen aan den Rijn. pp. 41-60.
98. Siedlecki W, Sklansky J (1988) On automatic feature selection. Intl J of Pattern Recognition and Artificial Intelligence 2: 197-220.
99. Liu H (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans on Knowledge and Data Engineering 17: 491-502.
100. IUPAC Committee (1985) Nomenclature committee of the international union of biochemistry (nciub). nomenclature for incompletely specified bases in nucleic acid sequences. Recommendations 1984. Biochemistry 229: 75-88.
101. Spears WM (1992) Crossover or mutation? Foundations of Genetic Algorithms 2: 221-237.
102. Kohavi R, John GH (1997) Wrappers for feature subset selection. Artificial Intelligence 97: 273-324. (Pubitemid 127401107)
103. Dosin CD, Belew RK (1997) New methods of competitive coevolution. Evol Comput 5: 1-29.
104. Hall MA (1999) Correlation-based Feature Selection for Machine Learning. Ph.D. thesis, University of Waikato, Hamilton, New Zealand.
105. Rish I, Hellerstein J, Thathachar J (2001) An analysis of data characteristics that affect naive Bayes performance. Technical report, IBM J. Watson.
106. Rish I (2001) An empirical study of the naive Bayes performance. In: IJCAI Workshop on Empirical Methods in AI. pp. 41-46.
107. Grau J, Keilwagen J, Gohr A, Haldemann B, Posch S, et al. (2012) A java framework for statistical analysis and classification of biological sequences. J Mach Learn Res 13: 1967-1971.
108. Luke S, Panait L, Balan G, Paus S, Skolicki Z, et al. (2010). ECJ: A java-based evolutionary computation research. URL http://cs.gmu. edu/~eclab/projects/ecj/.
109. Holland RC, Down TA, Pocock M, Prlic A, Huen D, et al. (2008) BioJava: an open-source framework for bioinformatics. Bioinformatics 24: 2096-2097.
110. Sonnenburg S, Rätsch G, Henschel S, Widmer C, Behr J, et al. (2010) The SHOGUN machine learning toolbox. J Mach Learn Res 11: 1799-1802.
111. Chang CC, Lin CJ (2001) LIBSVM: a library for support vector machines. Online.
112. Mitchell TM (1997) Machine Learning. Boston, MA: Mc-Graw Hill Companies, Inc., 1 edition, 414 pp.
113. Davis J, Goadrich M (2006) The relationship between precision-recall and roc curves. In: Intl Conf on Mach. Learn. (ICML). New York, NY, USA: ACM, ICML '06, pp. 233-240.
114. Sabo PJ, Humbert R, Hawrylycz M, Wallace JC, Dorschner MO, et al. (2004) Genome-wide identification of DNase I hypersensitive sites using active chromatin sequence libraries. Proc Natl Acad Sci USA 101: 4537-4542. (Pubitemid 38437446)
115. Reese MG, Eeckman F, Kulp D, Haussler D (1997) Improved splice site detection in genie. J COMPUT BIOL 4: 311-323. (Pubitemid 27355870)
116. Boguski MS, Lowe TM, Tolstoshev CM (1993) dbest-database for "expressed sequence tags". Nature Genetics 4: 332-333.
117. Claverie JM, Makalowski W (1994) Alu alert. Nature 371: 752.
118. Iwamoto S, Suganuma H, Kamesaki T, Omi T, Okuda H, et al. (2000) Cloning and characterization of erythroid-specific DNase i-hypersensitive site in human rhesus-associated glycoprotein gene. J Biol Chem 275: 27324-31.
119. Tuan D, London IM (1984) Mapping of DNase i-hypersensitive sites in the upstream dna of human embryonic epsilon-globin gene in k562 leukemia cells. Proc Natl Acad Sci U S A 81: 2718-22. (Pubitemid 14109330)
120. Sonnenburg S, Zien A, Philips P, Rätsch G (2008) POIMs: positional oligomer importance matrices - understanding support vector machine based signal detectors. Bioinformatics 24: i6-i14. (Pubitemid 351911652)
121. Ma Q, Wang JT, Wu CH (1998) Detection of alu sequences in dna: a neural network approach. In: Proceedings of the Fourth Joint Conference on Information Sciences. Citeseer, volume 1, pp. 392-395.