Can non-linear readout nodes enhance the performance of reservoir-based speech recognizers?

Proceedings - 1st International Conference on Informatics and Computational Intelligence, ICI 2011

Volumn , Issue , 2011, Pages 262-267

  Triefenbach, Fabian ^a   Martens, Jean Pierre ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

Automatic Speech Recognition; Linear Regression; Logistic Regression; On line Training; Recurrent Neural Networks; Reservoir Computing

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; CONTINUOUS SPEECH; ERROR BACK-PROPAGATION; EXPERIMENTAL EVIDENCE; LARGE NETWORKS; LINEAR OUTPUT; LOCAL OPTIMA; LOGISTIC REGRESSION; NON-LINEAR REGRESSION; ONLINE TRAINING; RESERVOIR COMPUTING; SPEECH RECOGNIZER;

ARTIFICIAL INTELLIGENCE; HIDDEN MARKOV MODELS; INFORMATION SCIENCE; LINEAR REGRESSION; LOGISTICS;

RECURRENT NEURAL NETWORKS;

EID: 84857152342     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICI.2011.50     Document Type: Conference Paper

References (12)

1. A. Robinson, "An application of recurrent neural nets to phone probability estimation, " IEEE Trans. on Neural Networks, vol. 5, pp. 298-305, 1994.
2. H. Jaeger, "Tutorial on training recurrent neural networks, covering BPTT, RTRL, EKF and the echo state network approach, " German National Research Center for Information Technology, Tech. Rep., 2002. [Online]. Available: http://www.faculty.jacobs-university.de/hjaeger.
3. D. Verstraeten, B. Schrauwen, M. D'Haene, and D. Stroobandt, "An experimental unification of reservoir computing methods, " Neural Networks, vol. 20, pp. 391-403, 2007. (Pubitemid 46856109)
4. H. Jaeger, M. Lukosevicius, D. Popovici, and U. Siewert, "Optimization and applications of echo state networks with leaky-integrator neurons, " Neural Networks, vol. 20, pp. 335- 352, 2007. (Pubitemid 46876638)
5. A. Jalalvand, F. Triefenbach, D. Verstraeten, and J.-P. Martens, "Connected digit recognition by means of reservoir computing, " in Procs. of INTERSPEECH, 2011, pp. 1725- 1728.
6. F. Triefenbach, A. Jalalvand, B. Schrauwen, and J.-P. Martens, "Phoneme recognition with large hierarchical reservoirs, " in Proc. Advances in Neural Information Processing Systems (NIPS), 2010, pp. 2307-2315.
7. D. W. Marquardt and R. D. Snee, "Ridge regression in practice, " The American Statistician, vol. 29, no. 1, pp. pp. 3-20, 1975.
8. M. Schumacher, R. Rossner, and W. Vach, "Neural networks and logistic regression: Part i, " Computational Statistics and Data Analysis, vol. 21, no. 6, pp. 661-682, 1996.
9. J.-P. Martens and N. Weymaere, "An equalized error backpropagation algorithm for the on-line training of multilayer perceptrons, " IEEE Trans. on Neural Networks, vol. 13, pp. 532-541, 2002. (Pubitemid 34669645)
10. R. Golden, Mathematical methods for neural network design and analysis. Cambridge, MIT Press, 1996.
11. M. Richard and R. Lippmann, "Neural net classifiers estimate posterior probabilities, " Neural Computation, vol. 3(4), pp. 461-483, 1991.
12. J. Garofolo, L. Lamel, W. Fisher, J. Fiscus, D. Pallett, and N. Dahlgren, "The DARPA TIMIT acoustic-phonetic continuous speech corpus cd-rom, " National Institute of Standards and Technology, Tech. Rep., 1993.