Training recurrent neural network using multistream extended kalman filter on multicore processor and cuda enabled graphic processor unit

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5768 LNCS, Issue PART 1, 2009, Pages 381-390

  Čerňanský, Michal ^a  

^a SLOVAK UNIVERSITY OF TECHNOLOGY   (Slovakia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL REQUIREMENTS; EXECUTION TIME; GRADIENT BASED ALGORITHM; GRAPHIC PROCESSOR UNITS; MANY-CORE; MODELING ACCURACY; MULTI-CORE PROCESSOR; MULTI-STREAM; TRAINING ALGORITHMS;

BACKPROPAGATION; CELLULAR RADIO SYSTEMS; CONTROL THEORY; REINFORCEMENT LEARNING; SPEECH RECOGNITION; TIME SERIES;

RECURRENT NEURAL NETWORKS;

EID: 70350605683     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-04274-4_40     Document Type: Conference Paper

References (12)

1. Werbos, P.: Backpropagation through time; what it does and how to do it. Proceedings of the IEEE 78, 1550-1560 (1990)
2. Williams, R.J., Zipser, D.: A learning algorithm for continually running fully recurrent neural networks. Neural Computation 1, 270-280 (1989)
3. Williams, R.J.: Some observations on the use of the extended Kalman filter as a recurrent network learning algorithm. Technical Report NU-CCS-92-1, Northeastern University, College of Computer Science, Boston, MA (1992)
4. Čerňanský, M., Beňušková, Ľ.: Simple recurrent network trained by RTRL and extended Kalman filter algorithms. Neural Network World 13(3), 223-234 (2003)
5. Trebatický, P.: Recurrent neural network training with the kalman filter-based techniques. Neural network world 15(5), 471-488 (2005)
6. Feldkamp, L., Prokhorov, D., Eagen, C., Yuan, F.: Enhanced multi-stream Kalman filter training for recurrent networks. In: Suykens, J., Vandewalle, J. (eds.) Nonlinear Modeling: Advanced Black-Box Techniques, pp. 29-53. Kluwer Academic Publishers, Dordrecht (1998)
7. Prokhorov, D.V.: Toyota prius hev neurocontrol and diagnostics. Neural Networks 21, 458-465 (2008)
8. NVIDIA: NVIDIA CUDA programming guide. Technical report (2008)
9. Trebatický, P.: Neural network training with extended kalman filter using graphics processing unit. In: Kůrková, V., Neruda, R., Koutník, J. (eds.) ICANN 2008, Part II. LNCS, vol. 5164, pp. 198-207. Springer, Heidelberg (2008)
10. Prokhorov, D.V.: Kalman filter training of neural networks: Methodology and applications. In: Tutorial on IJCNN 2004, Budapest, Hungary (2004)
11. Elman, J.L.: Finding structure in time. Cognitive Science 14, 179-211 (1990)
12. Elman, J.: Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning 7, 195-225 (1991)