Biologically inspired intelligent decision making: A commentary on the use of artificial neural networks in bioinformatics

Bioengineered

Volumn 5, Issue 2, 2013, Pages

  Manning, Timmy ^a   Sleator, Roy D ^a   Walsh, Paul ^b  

^a Munster Technological University   (Ireland)

^b NSilico Lifescience Ltd   (Ireland)

Author keywords

Artificial neural networks; Bioinformatics; Gene identification; Gene gene interaction; Genome wide association study; Multilayer perceptron; Protein structure prediction

Indexed keywords

ALGORITHM; ANIMAL; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BIOLOGY; BIOMIMETICS; DECISION MAKING; DECISION SUPPORT SYSTEM; HUMAN; NERVE CELL NETWORK; PHYSIOLOGY; PROCEDURES; BIOINFORMATICS; CONSENSUS DEVELOPMENT; EXPLOSION;

ALGORITHMS; ANIMALS; BIOMIMETICS; COMPUTATIONAL BIOLOGY; DECISION MAKING; DECISION MAKING, COMPUTER-ASSISTED; DECISION SUPPORT TECHNIQUES; HUMANS; NERVE NET; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 84931833092     PISSN: 19491018     EISSN: 19491026     Source Type: Journal    
DOI: 10.4161/bioe.26997     Document Type: Article

References (126)

1. Durda K, Buchanan L, Caron R. Grounding cooccurrence: Identifying features in a lexical co-occurrence model of semantic memory. Behav Res Methods 2009; 41:1210-23; PMID:19897830; http://dx.doi. org/10.3758/BRM.41.4.1210.
2. Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR. Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:12070580 2012.
3. McEvoy FJ, Amigo JM. Using machine learning to classify image features from canine pelvic radiographs: evaluation of partial least squares discriminant analysis and artificial neural network models. Vet Radiol Ultrasound 2012; 54:122-6; PMID:23228122; http://dx.doi.org/10.1111/vru.12003.
4. Acharya UR, Vinitha Sree S, Mookiah MR, Yantri R, Molinari F, Zieleznik W, Małyszek-Tumidajewicz J, Stepien B, Bardales RH, Witkowska A, et al. Diagnosis of Hashimoto's thyroiditis in ultrasound using tissue characterization and pixel classification. Proc Inst Mech Eng H 2013; 227:788-98; PMID:23636761; http://dx.doi.org/10.1177/0954411913483637.
5. Mariani S, Grassi A, Mendez MO, Milioli G, Parrino L, Terzano MG, Bianchi AM. EEG segmentation for improving automatic CAP detection. Clin Neurophysiol 2013; 124:1815-23; PMID:23643311; http://dx.doi.org/10.1016/j.clinph.2013.04.005.
6. Sachdeva J, Kumar V, Gupta I, Khandelwal N, Ahuja CK. Segmentation, feature extraction, and multiclass brain tumor classification. J Digit Imaging 2013; 26:1141-50; PMID:23645344; http://dx.doi. org/10.1007/s10278-013-9600-0.
7. Zhao Y, Chen D, Luo Y, Li H, Deng B, Huang SB, Chiu TK, Wu MH, Long R, Hu H, et al. A microfluidic system for cell type classification based on cellular size-independent electrical properties. Lab Chip 2013; 13:2272-7; PMID:23640025; http://dx.doi. org/10.1039/c3lc41361f.
8. Elfwing S, Uchibe E, Doya K. Scaled free-energy based reinforcement learning for robust and efficient learning in high-dimensional state spaces. Front Neurorobot 2013; 7:3; PMID:23450126
9. Firoozpour L, Sadatnezhad K, Dehghani S, Pourbasheer E, Foroumadi A, Shafiee A, Amanlou M. An efficient piecewise linear model for predicting activity of caspase-3 inhibitors. Daru 2012; 20:31; PMID:23351435
10. Leite D, Costa P, Gomide F. Evolving granular neural networks from fuzzy data streams. Neural Netw 2013; 38:1-16; PMID:23201554; http://dx.doi. org/10.1016/j.neunet.2012.10.006.
11. Plake C, Schiemann T, Pankalla M, Hakenberg J, Leser U. AliBaba: PubMed as a graph. Bioinformatics 2006; 22:2444-5; PMID:16870931; http://dx.doi. org/10.1093/bioinformatics/btl408.
12. Roberts RJ. PubMed Central: The GenBank of the published literature. Proc Natl Acad Sci USA 2001; 98:381-2; PMID:11209037; http://dx.doi. org/10.1073/pnas.98.2.381.
13. Sleator RD. Digital biology: a new era has begun. Bioengineered 2012; 3:311-2; PMID:23099453; http://dx.doi.org/10.4161/bioe.22367.
14. Chen K, Kurgan LA. Neural Networks in Bioinformatics. Handbook of Natural Computing: Springer, 2012:565-83.
15. Lancashire LJ, Lemetre C, Ball GR. An introduction to artificial neural networks in bioinformatics--application to complex microarray and mass spectrometry datasets in cancer studies. Brief Bioinform 2009; 10:315-29; PMID:19307287; http://dx.doi. org/10.1093/bib/bbp012.
16. Yang Z. Neural Networks. In: Carugo O, Eisenhaber F, eds. Data Mining Techniques for the Life Sciences: Humana Press, 2010:197-222.
17. Meireles MR, Almeida PE, Simões MG. A comprehensive review for industrial applicability of artificial neural networks. Industrial Electronics. IEEE Transactions on 2003; 50:585-601
18. Rumelhart DE, Hintont GE, Williams RJ. Learning representations by back-propagating errors. Nature 1986; 323:533-6; http://dx.doi. org/10.1038/323533a0.
19. Uberbacher EC, Mural RJ. Locating protein-coding regions in human DNA sequences by a multiple sensor-neural network approach. Proc Natl Acad Sci USA 1991; 88:11261-5; PMID:1763041; http:// dx.doi.org/10.1073/pnas.88.24.11261.
20. Qian N, Sejnowski TJ. Predicting the secondary structure of globular proteins using neural network models. J Mol Biol 1988; 202:865-84; PMID:3172241; http://dx.doi.org/10.1016/0022-2836(88)90564-5.
21. Bishop CM. Neural networks for pattern recognition. Oxford university press, 1995.
22. Kotsiantis S, Zaharakis I, Pintelas P. Supervised machine learning: A review of classification techniques. Frontiers in Artificial Intelligence and Applications 2007; 160:3
23. Montana DJ, Davis L. Training feedforward neural networks using genetic algorithms. Proceedings of the eleventh international joint conference on artificial Intelligence: San Mateo, CA, 1989:762-7.
24. Baba N. A new approach for finding the global minimum of error function of neural networks. Neural Netw 1989; 2:367-73; http://dx.doi. org/10.1016/0893-6080(89)90021-X.
25. Sietsma J, Dow RJ. Creating artificial neural networks that generalize. Neural Netw 1991; 4:67-79; http://dx.doi.org/10.1016/0893-6080(91)90033-2.
26. Razavi S, Tolson BA. A new formulation for feedforward neural networks. IEEE Trans Neural Netw 2011; 22:1588-98; PMID:21859600; http://dx.doi. org/10.1109/TNN.2011.2163169.
27. Gardner M, Dorling S. Artificial neural networks (the multilayer perceptron)-a review of applications in the atmospheric sciences. Atmos Environ 1998; 32:2627-36; http://dx.doi.org/10.1016/ S1352-2310(97)00447-0.
28. Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev 1958; 65:386-408; PMID:13602029; http://dx.doi.org/10.1037/h0042519.
29. Widrow B, Lehr MA. 30 years of adaptive neural networks: perceptron, madaline, and backpropagation. Proc IEEE 1990; 78:1415-42; http://dx.doi. org/10.1109/5.58323.
30. Arad BS, El-Amawy A. On fault tolerant training of feedforward neural networks. Neural Netw 1997; 10:539-53; http://dx.doi.org/10.1016/ S0893-6080(96)00089-5.
31. Hughes VF, Melvin DG, Niranjan M, Alexander GA, Trull AK. Clinical validation of an artificial neural network trained to identify acute allograft rejection in liver transplant recipients. Liver Transpl 2001; 7:496-503; PMID:11443576; http://dx.doi.org/10.1053/ jlts.2001.24642.
32. Sontag ED, Sussmann HJ. Backpropagation can give rise to spurious local minima even for networks without hidden layers. AIP Conf Proc 1989; 3:91-106
33. Djavan B, Remzi M, Zlotta A, Seitz C, Snow P, Marberger M. Novel artificial neural network for early detection of prostate cancer. J Clin Oncol 2002; 20:921-9; PMID:11844812; http://dx.doi. org/10.1200/JCO.20.4.921.
34. Funahashi K-I. On the approximate realization of continuous mappings by neural networks. Neural Netw 1989; 2:183-92; http://dx.doi. org/10.1016/0893-6080(89)90003-8.
35. Happel BL, Murre JM. Design and evolution of modular neural network architectures. Neural Netw 1994; 7:985-1004; http://dx.doi.org/10.1016/ S0893-6080(05)80155-8.
36. Homaei H. Design a PID controller for suspension system by back propagation neural network. J Eng 2013; 2013:421543
37. Cybenko G. Approximation by superpositions of a sigmoidal function. Math Contr Signals Syst 1989; 2:303-14; http://dx.doi.org/10.1007/BF02551274.
38. Hecht-Nielsen R. Theory of the backpropagation neural network. Neural Networks, 1989 IJCNN, International Joint Conference on: IEEE, 1989:593-605.
39. Nissen S. Implementation of a fast artificial neural network library (fann). Report, Department of Computer Science University of Copenhagen (DIKU) 2003; 31.
40. Sussillo D, Nuyujukian P, Fan JM, Kao JC, Stavisky SD, Ryu S, Shenoy K. A recurrent neural network for closed-loop intracortical brain-machine interface decoders. J Neural Eng 2012; 9:026027; PMID:22427488; http://dx.doi.org/10.1088/1741-2560/9/2/026027.
41. Rodríguez-González A, García-Crespo Á, Colomo-Palacios R, Guldrís Iglesias F, Gómez-Berbís JM. CAST: Using neural networks to improve trading systems based on technical analysis by means of the RSI financial indicator. Expert Syst Appl 2011; 38:11489-500; http://dx.doi.org/10.1016/j.eswa.2011.03.023.
42. Sjöström PJ, Frydel BR, Wahlberg LU. Artificial neural network-aided image analysis system for cell counting. Cytometry 1999; 36:18-26; PMID:10331623; http://dx.doi.org/10.1002/
43. Taylor JA, Hieber LL, Ivry RB. Feedback-dependent generalization. J Neurophysiol 2013; 109:202-15; PMID:23054603; http://dx.doi.org/10.1152/ jn.00247.2012.
44. Jacobs RA. Increased rates of convergence through learning rate adaptation. Neural Netw 1988; 1:295-307; http://dx.doi. org/10.1016/0893-6080(88)90003-2.
45. Jin W, Li ZJ, Wei LS, Zhen H. The improvements of BP neural network learning algorithm. Signal Processing Proceedings, 2000 WCCC-ICSP 2000 5th International Conference on: IEEE, 2000:1647-9.
46. Attoh-Okine NO. Analysis of learning rate and momentum term in backpropagation neural network algorithm trained to predict pavement performance. Adv Eng Software 1999; 30:291-302; http://dx.doi. org/10.1016/S0965-9978(98)00071-4.
47. Picton P. Neural networks. 2nd ed. Basingstoke: Palgrave; 2000.
48. Werbos P. Beyond regression: New tools for prediction and analysis in the behavioral sciences. [doctoral thesis]. [Cambridge (MA)] Harvard University; 1974.
49. Touretzky DS, Sejnowski TJ, Hinton GE, eds. Proceedings of the 1988 Connectionist Models Summer School; 1988 Jun 17-26. Carnegie Mellon University, Pittsburgh, PA. San Mateo, CA: Morgan Kauffman; 1988
50. Tu JV. Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J Clin Epidemiol 1996; 49:1225-31; PMID:8892489; http://dx.doi. org/10.1016/S0895-4356(96)00002-9.
51. Shavlik JW, Mooney RJ, Towell GG. Symbolic and neural learning algorithms: An experimental comparison. Mach Learn 1991; 6:111-43; http://dx.doi. org/10.1007/BF00114160.
52. Tetko IV, Livingstone DJ, Luik AI. Neural network studies. 1. Comparison of overfitting and overtraining. J Chem Inf Comput Sci 1995; 35:826-33; http:// dx.doi.org/10.1021/ci00027a006.
53. Atkinson PM, Tatnall A. Introduction neural networks in remote sensing. Int J Remote Sens 1997; 18:699-709; http://dx.doi.org/10.1080/014311697218700.
54. Prechelt L. Proben1: A set of neural network benchmark problems and benchmarking rules. Fakultät für Informatik, Univ Karlsruhe, Karlsruhe, Germany, Tech Rep 1994; 21:94.
55. Florido J, Pomares H, Rojas I, Guillén A, Ortuno F, Urquiza J. An effective, practical and low computational cost framework for the integration of heterogeneous data to predict functional associations between proteins by means of artificial neural networks. Neurocomputing 2013; 121:64-78; http://dx.doi. org/10.1016/j.neucom.2012.11.040.
56. Ein-Dor L, Zuk O, Domany E. Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer. Proc Natl Acad Sci USA 2006; 103:5923-8; PMID:16585533; http://dx.doi. org/10.1073/pnas.0601231103.
57. Chuang H-Y, Lee E, Liu Y-T, Lee D, Ideker T. Network-based classification of breast cancer metastasis. Mol Syst Biol 2007; 3:140; PMID:17940530; http://dx.doi.org/10.1038/msb4100180.
58. Chowdhury SA, Nibbe RK, Chance MR, Koyutürk M. Subnetwork state functions define dysregulated subnetworks in cancer. J Comput Biol 2011; 18:263-81; PMID:21385033; http://dx.doi.org/10.1089/ cmb.2010.0269.
59. Szu H, Hartley R. Fast simulated annealing. Phys Lett A 1987; 122:157-62; http://dx.doi. org/10.1016/0375-9601(87)90796-1.
60. Chen X, Tang Z, Variappan C, Li S, Okada T. A modified error backpropagation algorithm for complex-value neural networks. Int J Neural Syst 2005; 15:435-43; PMID:16385633; http://dx.doi. org/10.1142/S0129065705000426.
61. Gori M, Tesi A. On the problem of local minima in backpropagation. IEEE Trans Pattern Anal Mach Intell 1992; 14:76-86; http://dx.doi. org/10.1109/34.107014.
62. Pollack JB. Backpropagation is sensitive to initial conditions. Complex Systems 1990; 4:269-80
63. Stanley KO, Miikkulainen R. Evolving neural networks through augmenting topologies. Evol Comput 2002; 10:99-127; PMID:12180173; http://dx.doi. org/10.1162/106365602320169811.
64. Bahri B, Aziz AA, Shahbakhti M, Muhamad Said MF. Understanding and detecting misfire in an HCCI engine fuelled with ethanol. Appl Energy 2013; 108:24-33; http://dx.doi.org/10.1016/j. apenergy.2013.03.004.
65. Mashhadi Meighani H, Dehghani A, Rekabdar F, Hemmati M, Goodarznia I. Artificial intelligence vs. classical approaches: a new look at the prediction of flux decline in wastewater treatment. Desalin Water Treat 2013; 51:7476-89; http://dx.doi.org/10.1080/1 9443994.2013.773861
66. Surkan AJ, Singleton JC. Neural networks for bond rating improved by multiple hidden layers. Neural Networks, 1990, 1990 IJCNN International Joint Conference on: IEEE, 1990:157-62.
67. Xu S, Chen L. A novel approach for determining the optimal number of hidden layer neurons for FNN's and its application in data mining. International Conference on Information Technology and Applications: iCITA, 2008:683-6.
68. Shamseldin AY. Application of a neural network technique to rainfall-runoffmodelling. J Hydrol (Amst) 1997; 199:272-94; http://dx.doi.org/10.1016/ S0022-1694(96)03330-6.
69. Bertin E, Arnouts S. SExtractor: Software for source extraction. Astron Astrophys Suppl Ser 1996; 117:393-404; http://dx.doi.org/10.1051/ aas:1996164.
70. Floreano D, Dürr P, Mattiussi C. Neuroevolution: from architectures to learning. Evolutionary Intelligence 2008; 1:47-62
71. Manning T, Sleator RD, Walsh P. Naturally selecting solutions: the use of genetic algorithms in bioinformatics. Bioengineered 2013; 4:266-78; PMID:23222169; http://dx.doi.org/10.4161/ bioe.23041.
72. Khan MM, Khan GM, Miller JF. Evolution of neural networks using cartesian genetic programming. Evolutionary Computation (CEC), 2010 IEEE Congress on: IEEE, 2010:1-8.
73. Manning T, Walsh P. Improving the performance of CGPANN for breast cancer diagnosis using crossover and radial basis functions. Evolutionary Computation, Machine Learning and Data Mining in Bioinformatics: Springer, 2013:165-76.
74. Ahmad AM, Khan GM, Mahmud SA, Miller JF. Breast cancer detection using cartesian genetic programming evolved artificial neural networks. Proceedings of the fourteenth international conference on Genetic and evolutionary computation conference: ACM, 2012:1031-8.
75. Manning T, Walsh P. Automatic task decomposition for the neuroevolution of augmenting topologies (NEAT) algorithm. Evolutionary Computation, Machine Learning and Data Mining in Bioinformatics: Springer, 2012:1-12.
76. Rögnvaldsson T, You L. Why neural networks should not be used for HIV-1 protease cleavage site prediction. Bioinformatics 2004; 20:1702-9; PMID:14988129; http://dx.doi.org/10.1093/bioinformatics/ bth144.
77. Irsoy O, Yildiz OT, Alpaydin E. Design and analysis of classifier learning experiments in bioinformatics: survey and case studies. IEEE/ACM Trans Comput Biol Bioinform 2012; 9:1663-75; PMID:22908127
78. Chan K, Lee T-W, Sample PA, Goldbaum MH, Weinreb RN, Sejnowski TJ. Comparison of machine learning and traditional classifiers in glaucoma diagnosis. IEEE Trans Biomed Eng 2002; 49:963-74; http://dx.doi.org/10.1109/TBME.2002.802012; PMID:12214886
79. Cho S-B, Ryu J. Classifying gene expression data of cancer using classifier ensemble with mutually exclusive features. Proc IEEE 2002; 90:1744-53; http:// dx.doi.org/10.1109/JPROC.2002.804682.
80. Cho S-B, Won H-H. Machine learning in DNA microarray analysis for cancer classification. Proceedings of the First Asia-Pacific bioinformatics conference on Bioinformatics 2003-Volume 19: Australian Computer Society, Inc., 2003:189-98.
81. Chang R-F, Wu W-J, Moon WK, Chou Y-H, Chen D-R. Support vector machines for diagnosis of breast tumors on US images. Acad Radiol 2003; 10:189-97; PMID:12583571; http://dx.doi.org/10.1016/S1076-6332(03)80044-2.
82. Sleator RD. Prediction of protein functions. Methods Mol Biol 2012; 815:15-24; PMID:22130980; http:// dx.doi.org/10.1007/978-1-61779-424-7_2.
83. Henry M, Coffey A, O'Mahony J, Sleator RD. Comparative modelling of LysB from the mycobacterial bacteriophage Ardmore. Bioeng Bugs 2011; 2:88-95; PMID:21636995; http://dx.doi.org/10.4161/ bbug.2.2.14138.
84. Dobson CM. The structural basis of protein folding and its links with human disease. Philos Trans R Soc Lond B Biol Sci 2001; 356:133-45; PMID:11260793; http://dx.doi.org/10.1098/rstb.2000.0758.
85. Sleator RD. Proteins: form and function. Bioeng Bugs 2012; 3:80-5; PMID:22095055; http://dx.doi. org/10.4161/bbug.18303.
86. Rodrigues JP, Levitt M, Chopra G. KoBaMIN: a knowledge-based minimization web server for protein structure refinement. Nucleic Acids Res 2012; 40:W323-8; PMID:22564897; http://dx.doi. org/10.1093/nar/gks376.
87. Tsien RY. The green fluorescent protein. Annu Rev Biochem 1998; 67:509-44; PMID:9759496; http:// dx.doi.org/10.1146/annurev.biochem.67.1.509.
88. Rao PNDT, Kaladhar D, Sridhar G, Appa A. Protein secondary structure prediction using pattern recognition neural network. Int J Eng Sci 2010; 2:1752-7
89. Møller MF. A scaled conjugate gradient algorithm for fast supervised learning. Neural Netw 1993; 6:525-33; http://dx.doi.org/10.1016/S0893-6080(05)80056-5.
90. Kabsch W, Sander C. Dictionary of protein secondary structure: pattern recognition of hydrogenbonded and geometrical features. Biopolymers 1983; 22:2577-637; PMID:6667333; http://dx.doi. org/10.1002/bip.360221211.
91. Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ. Basic local alignment search tool. J Mol Biol 1990; 215:403-10; PMID:2231712.
92. Altschul SF, Madden TL, Schäffer AA, Zhang J, Zhang Z, Miller W, Lipman DJ. Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res 1997; 25:3389-402; PMID:9254694; http://dx.doi.org/10.1093/ nar/25.17.3389.
93. McGuffin LJ, Bryson K, Jones DT. The PSIPRED protein structure prediction server. Bioinformatics 2000; 16:404-5; PMID:10869041; http://dx.doi. org/10.1093/bioinformatics/16.4.404.
94. Rost B, Sander C. Prediction of protein secondary structure at better than 70% accuracy. J Mol Biol 1993; 232:584-99; PMID:8345525; http://dx.doi. org/10.1006/jmbi.1993.1413.
95. Jones DT. Protein secondary structure prediction based on position-specific scoring matrices. J Mol Biol 1999; 292:195-202; PMID:10493868; http:// dx.doi.org/10.1006/jmbi.1999.3091.
96. Moult J, Hubbard T, Fidelis K, Pedersen JT. Critical assessment of methods of protein structure prediction (CASP): round III. Proteins 1999; 37(Suppl 3):2-6; PMID:10526346
97. Moult J, Fidelis K, Zemla A, Hubbard T. Critical assessment of methods of protein structure prediction (CASP): round IV. Proteins 2001; 45(Suppl 5):2-7; PMID:11835476
98. Sleator RD. An overview of the current status of eukaryote gene prediction strategies. Gene 2010; 461:1-4; PMID:20430068; http://dx.doi. org/10.1016/j.gene.2010.04.008.
99. Bandyopadhyay S, Maulik U, Roy D. Gene identification: classical and computational intelligence approaches. IEEE SYS MAN CYBERN C Appl Rev 2008; 38:55-68; http://dx.doi.org/10.1109/ TSMCC.2007.906066
100. Fogel GB, Chellapilla K, Fogel DB. Identification of coding regions in DNA sequences using evolved neural networks. Evolutionary Computation in Bioinformatics 2003:193-218.
101. Fickett JW, Tung C-S. Assessment of protein coding measures. Nucleic Acids Res 1992; 20:6441-50; PMID:1480466; http://dx.doi.org/10.1093/ nar/20.24.6441.
102. Wada K, Aota S, Tsuchiya R, Ishibashi F, Gojobori T, Ikemura T. Codon usage tabulated from the GenBank genetic sequence data. Nucleic Acids Res 1990; 18(Suppl):2367-411; PMID:2333226; http:// dx.doi.org/10.1093/nar/18.suppl.2367.
103. Fickett JW. Recognition of protein coding regions in DNA sequences. Nucleic Acids Res 1982; 10:5303-18; PMID:7145702; http://dx.doi.org/10.1093/ nar/10.17.5303.
104. Burset M, Guigó R. Evaluation of gene structure prediction programs. Genomics 1996; 34:353-67; PMID:8786136; http://dx.doi.org/10.1006/ geno.1996.0298.
105. Waibel A, Hanazawa T, Hinton G, Shikano K, Lang KJ. Phoneme recognition using time-delay neural networks. IEEE Trans Acoust Speech Signal Process 1989; 37:328-39; http://dx.doi. org/10.1109/29.21701
106. Waibel A. Modular construction of time-delay neural networks for speech recognition. Neural Comput 1989; 1:39-46; http://dx.doi.org/10.1162/ neco.1989.1.1.39.
107. Reese MG. Application of a time-delay neural network to promoter annotation in the Drosophila melanogaster genome. Comput Chem 2001; 26:51-6; PMID:11765852; http://dx.doi.org/10.1016/S0097-8485(01)00099-7.
108. Hayward JA, Tachedjian M, Cui J, Field H, Holmes EC, Wang L-F, Tachedjian G. Identification of diverse full-length endogenous betaretroviruses in megabats and microbats. Retrovirology 2013; 10:35; PMID:23537098; http://dx.doi.org/10.1186/1742-4690-10-35.
109. Lowery JW, Lavigne AW, Kokabu S, Rosen V. Comparative genomics identifies the mouse Bmp3 promoter and an upstream evolutionary conserved region (ECR) in mammals. PLoS ONE 2013; 8:e57840; PMID:23451274; http://dx.doi. org/10.1371/journal.pone.0057840.
110. Nannapaneni K, Ben-Shahar Y, Keen HL, Welsh MJ, Casavant TL, Scheetz TE. Computational identification of operon-like transcriptional loci in eukaryotes. Comput Biol Med 2013; 43:738-43; PMID:23668349; http://dx.doi.org/10.1016/j.compbiomed. 2013.03.004.
111. Van den Broeke A, Van Poucke M, Van Zeveren A, Peelman L. Ribosomal protein SA and its pseudogenes in ruminants: an extremely conserved gene family. Czech J Anim Sci 2013; 58:79-90
112. Yao AI, Fenton TA, Owsley K, Seitzer P, Larsen DJ, Sit H, Lau J, Nair A, Tantiongloc J, Tagkopoulos I, et al. Promoter element arising from the fusion of standard BioBrick parts. ACS Synth Biol 2013; 2:111-20; PMID:23656374; http://dx.doi.org/10.1021/ sb300114d
113. Turner SD, Dudek SM, Ritchie MD. ATHENA: A knowledge-based hybrid backpropagation-grammatical evolution neural network algorithm for discovering epistasis among quantitative trait Loci. BioData Min 2010; 3:5; PMID:20875103
114. Giacobini M, Vanneschi L, Bush W, eds. Proceedings of the 10th European conference on Evolutionary Computation, Machine Learning and Data Mining in Bioinformatics, EvoBIO 2012; 2012 Apr 11-13. University of Málaga, Málaga, Spain. Heidelberg, Berlin: Springer; 2012
115. Holzinger ER, Dudek SM, Frase AT, Krauss RM, Medina MW, Ritchie MD. ATHENA: A tool for meta-dimensional analysis applied to genotypes and gene expression data to predict HDL cholesterol levels. Pacific Symposium on Biocomputing Pacific Symposium on Biocomputing: World Scientific, 2013:385.
116. Holzinger ER, Buchanan CC, Dudek SM, Torstenson EC, Turner SD, Ritchie MD. Initialization parameter sweep in ATHENA: optimizing neural networks for detecting gene-gene interactions in the presence of small main effects. Proceedings of the 12th annual conference on Genetic and evolutionary computation: ACM, 2010:203-10.
117. Bush WS, Dudek SM, Ritchie MD. Biofilter: a knowledge-integration system for the multi-locus analysis of genome-wide association studies. Pacific Symposium on Biocomputing Pacific Symposium on Biocomputing: NIH Public Access, 2009:368.
118. Hawkins J, George D, Niemasik J. Sequence memory for prediction, inference and behaviour. Philos Trans R Soc Lond B Biol Sci 2009; 364:1203-9; PMID:19528001; http://dx.doi.org/10.1098/ rstb.2008.0322.
119. Hawkins J, Ahmad S, Dubinsky D. Hierarchical temporal memory including HTM cortical learning algorithms. Techical report, Numenta, Inc, Palto Alto 2010.
120. Hinton G, Deng L, Yu D, Dahl GE, Mohamed A-R, Jaitly N, Senior A, Vanhoucke V, Nguyen P, Sainath TN. Deep neural networks for acoustic modeling in speech recognition: the Shared Views of Four Research Groups. Signal Processing Magazine, IEEE 2012; 29:82-97
121. Larochelle H, Bengio Y, Louradour J, Lamblin P. Exploring strategies for training deep neural networks. J Mach Learn Res 2009; 10:1-40
122. Fahlman SE, Lebiere C. The cascade-correlation learning architecture. Pittsburgh (PA): Carnegie Mellon University; 1989 Feb. 15 p. Report No.: CMU-CS-90-100.
123. Hinton GE, Osindero S, Teh Y-W. A fast learning algorithm for deep belief nets. Neural Comput 2006; 18:1527-54; PMID:16764513; http://dx.doi. org/10.1162/neco.2006.18.7.1527.
124. Mohamed A-R, Dahl GE, Hinton G. Acoustic modeling using deep belief networks. IEEE T Audio Speech 2012; 20:14-22; http://dx.doi.org/10.1109/ TASL.2011.2109382
125. Mohamed A-R, Sainath TN, Dahl G, Ramabhadran B, Hinton GE, Picheny MA. Deep belief networks using discriminative features for phone recognition. Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on: IEEE, 2011:5060-3.
126. Salakhutdinov R, Hinton GE. Deep Boltzmann machines. Proceedings of the international conference on artificial intelligence and statistics: MIT Press Cambridge, MA, 2009:448-55.