Improved access to sequential motifs: A note on the architectural bias of recurrent networks

IEEE Transactions on Neural Networks

Volumn 16, Issue 2, 2005, Pages 491-494

  Bodén, Mikael ^a   Hawkins, John ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

Architectural bias; Bioinformatics; Biological sequence; Recurrent neural network

Indexed keywords

CODES (SYMBOLS); DATA STRUCTURES; ENCODING (SYMBOLS); FEEDFORWARD NEURAL NETWORKS; LEARNING ALGORITHMS; LEARNING SYSTEMS; PATTERN MATCHING; PATTERN RECOGNITION;

ARCHITECTURAL BIAS; BIOINFORMATICS; BIOLOGICAL SEQUENCE;

RECURRENT NEURAL NETWORKS;

ARTIFICIAL NEURAL NETWORK; BIOLOGY; ENTROPY; LETTER; METHODOLOGY; SEQUENCE ANALYSIS;

COMPUTATIONAL BIOLOGY; ENTROPY; NEURAL NETWORKS (COMPUTER); SEQUENCE ANALYSIS;

EID: 15344351555     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2005.844086     Document Type: Article

References (9)

1. P. Baldi, S. Brunak, P. Frasconi, G. Soda, and G. Pollastri, "Exploiting the past and the future in protein secondary structure prediction," Bioinformatics, vol. 15, pp. 937-946, 1999.
2. M. Christiansen and N. Chater, "Toward a connectionist model of recursion in human linguistic performance," Cogn. Sci., vol. 23, pp. 157-205, 1999.
3. B. Hammer and P. Tino, "Recurrent neural networks with small weights implement definite memory machines," Neural Computat., vol. 15, no. 8, pp. 1897-1929, 2003.
4. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computat., vol. 9, no. 8, pp. 1735-1780, 1997.
5. J. F. Kolen, "Recurrent networks: State machines or iterated function systems?," in Proc. Connectionist Models Summer School, M. C. Mozer, P. Smolensky, D. S. Touretzky, J. L. Elman, and A. S. Weigend, Eds. Hillsdale, NJ, 1994, pp. 203-210.
6. G. Pollastri, D. Przybylski, B. Rost, and P. Baldi, "Improving the prediction of protein secondary structure in three and eight classes using recurrent neural networks and profiles," Proteins, vol. 47, pp. 228-235, 2002.
7. J. Schmidhuber, F. Gers, and D. Eck, "Learning nonregular languages: A comparison of simple recurrent networks and LSTM," Neural Computat. vol. 14, no. 9, pp. 2039-2041, 2002.
8. P. Tino, M. Cernansky, and L. Benuskova, "Markovian architectural bias of recurrent neural networks," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 6-15, Jan. 2004.
9. P. Tino and B. Hammer, "Architectural bias in recurrent neural networks: Fractal analysis," Neural Computat., vol. 15, no. 8, pp. 1931-1957, 2003.