Introducing CURRENNT: The Munich open-source CUDA RecurREnt neural network toolkit

Journal of Machine Learning Research

Volumn 16, Issue , 2015, Pages 547-551

  Weninger, Felix ^a   Bergmann, Johannes ^a   Schuller, Björn ^a,b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Deep neural networks; Long short term memory; Parallel computing; Recurrent neural networks

Indexed keywords

BENCHMARKING; BRAIN; COMPUTER GRAPHICS; OPEN SOURCE SOFTWARE; PARALLEL PROCESSING SYSTEMS; PROGRAM PROCESSORS; SPEECH RECOGNITION;

DEEP NEURAL NETWORKS; DEVICE ARCHITECTURES; GNU GENERAL PUBLIC LICENSE; GRAPHICS PROCESSING UNITS; LONG SHORT TERM MEMORY; NOISY SPEECH RECOGNITION; PARALLEL IMPLEMENTATIONS; RECURRENT NEURAL NETWORK (RNNS);

RECURRENT NEURAL NETWORKS;

EID: 84930639546     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (13)

1. M. Cernanský. Training recurrent neural network using multistream extended Kalman filter on multicore processor and CUDA enabled graphic processor unit. In Proc. of ICANN, volume 1, pages 381-390, 2009.
2. D. Eck and J. Schmidhuber. Learning the long-term structure of the blues. In Proc. of ICANN, pages 284-289, 2002.
3. J. T. Geiger, F. Weninger, A. Hurmalainen, J. F. Gemmeke, M. Wöllmer, B. Schuller, G. Rigoll, and T. Virtanen. The TUM+TUT+KUL approach to the CHiME Challenge 2013: Multi-stream ASR exploiting BLSTM networks and sparse NMF. In Proc. 2nd CHiME Workshop, pages 25-30, Vancouver, Canada, 2013.
4. F. Gers, J. Schmidhuber, and F. Cummins. Learning to forget: Continual prediction with LSTM. Neural Computation, 12(10):2451-2471, 2000.
5. A. Graves. Supervised Sequence Labelling with Recurrent Neural Networks. PhD thesis, Technische Universität München, 2008.
6. A. Graves. RNNLIB: A recurrent neural network library for sequence learning problems. http://sourceforge.net/projects/rnnl/, 2013.
7. A. Graves, A. Mohamed, and G. Hinton. Speech recognition with deep recurrent neural networks. In Proc. of ICASSP, pages 6645-6649, Vancouver, Canada, 2013.
8. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kingsbury. Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Processing Magazine, 29(6):82-97, 2012.
9. R. Pascanu, C. Gulcehre, K. Cho, and Y. Bengio. How to construct deep recurrent neural networks. In Proc. of ICLR, 2014.
10. T. Schaul, J. Bayer, D. Wierstra, Y. Sun, M. Felder, F. Sehnke, T. Rückstieß, and J. Schmidhuber. PyBrain. Journal of Machine Learning Research, 11:743-746, 2010.
11. M. Sundermeyer, R. Schlüter, and H. Ney. LSTM neural networks for language modeling. In Proc. of INTERSPEECH, Portland, OR, USA, 2012.
12. E. Vincent, J. Barker, S. Watanabe, J. Le Roux, F. Nesta, and M. Matassoni. The second 'CHiME' speech separation and recognition challenge: Datasets, tasks and baselines. In Proc. of ICASSP, pages 126-130, Vancouver, Canada, 2013.
13. M. Wöllmer, M. Kaiser, F. Eyben, F. Weninger, B. Schuller, and G. Rigoll. Fully automatic audiovisual emotion recognition - voice, words, and the face. In T. Fingscheidt and W. Kellermann, editors, Proceedings of Speech Communication; 10. ITG Symposium, pages 1-4, Braunschweig, Germany, 2012.