Parallel training of a back-propagation neural network using CUDA

Proceedings - 9th International Conference on Machine Learning and Applications, ICMLA 2010

Volumn , Issue , 2010, Pages 307-312

  Sierra Canto, Xavier ^a   Madera Ramírez, Francisco ^b   Uc Cetina, Víctor ^b  

^a UNIVERSIDAD TECNOLÓGICA METROPOLITANA   (Mexico)

^b UNIVERSIDAD AUTÓNOMA DE YUCATÁN   (Mexico)

Author keywords

Back propagation; CUDA; Neural networks

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BACK PROPAGATION NEURAL NETWORKS; BASIC LINEAR ALGEBRA SUBPROGRAMS; BENCHMARK DATA; CUDA; MACHINE LEARNING SYSTEMS; PARALLEL COMPUTING ARCHITECTURE; PARALLEL TRAINING; TIME-CONSUMING PROCESS;

BACKPROPAGATION ALGORITHMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; LINEAR ALGEBRA; PARALLEL ARCHITECTURES;

NEURAL NETWORKS;

EID: 79952372930     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMLA.2010.52     Document Type: Conference Paper

References (21)

1. F. Bernhard and R. Keriven, "Spiking Neurons on GPUs", International Conference on Computational Science, 2006.
2. C. M. Bishop, "Pattern recognition and machine learning", Springer, New York, NY, USA, 2006.
3. W. M. Caminhas, D. A. G. Vieira and J. A. Vasconcelos, "Parallel layer perceptron", Neurocomputing 55, pp. 771-778, 2003.
4. A. Carpenter, "CUSVM: A CUDA Implementation of Support Vector Classification and Regression", pattern-sonscreen. net/cuSVMDesc.pdf, 2009.
5. S. Che, M. Boyer, J. Meng, D. Tarjan, J. W. Sheaffer and K. Skadron, "A Performance Study of General-Purpose Applications on Graphics Processors Using CUDA", Journal of parallel and distributed computing, 2008.
6. A. Cristea and T. Okamoto, "A parallelization method for neural networks with weak connection design", International Symposium on High Performance Computing, 1997.
7. L. Fausett, "Fundamentals of neural networks architectures, algorithm, and applications", Prentice Hall, New Jersey, USA,1997.
8. T. Harada, "Real-time rigid body simulation on GPU (chapter 29) in GPU Gems 3", Addison Wesley, 2008.
9. S. Haykin, "Neural networks a comprehensive approach", Prentice Hall, New Jersey, USA, 1999.
10. H. Jang, A. Park and K. Jung, "Neural network implementation using CUDA and OpenMP", DICTA '08: Proceedings of the 2008 Digital Image Computing: Techniques and Applications, Washington, DC, USA, 2008.
11. A. Lefohn, J. Kniss and J. Owens, "Implementing efficient parallel data structures on GPUs(chapter 32) in GPU Gems 2", Addison Wesley, 2006.
12. D. L. Ly, V. Paprotski and D. Yen, "Neural Networks on GPUs: Restricted Boltzmann Machines", Technical Report, Department of Electrical and Computer Engineering, University of Toronto, 2008.
13. J. M. Nageswaran, N. Dutt, J. L. Krichmar, A. Nicolau and A. Veidenbaum, "Efficient simulation of large-scale spiking neural networks using CUDA graphics processors", IJCNN'09: Proceedings of the 2009 international joint conference on Neural Networks, Atlanta, Georgia, USA, 2009.
14. S. Oh and K. Jung, "View-Point Insensitive Human Pose Recognition using Neural Network and CUDA", World Academy of Science, Engineering and Technology 60,2009.
15. G. Poli and J. H. Saito, "Parallel Face Recognition Processing using Neocognitron Neural Network and GPU with CUDA High Performance Architecture", Face Recognition, Book edited by: Milos Oravec, ISBN: 978-953-307-060-5, INTECH, 2010.
16. L. Prechelt, "PROBEN1 - a set of neural networks benchmark problems and benchmarking rules", 1994.
17. D. E. Rumelhart and J. L. McClelland, "Parallel distributed processing: Explorations in the microstructure of cognition", MIT Press, Cambrige, 1986.
18. U. Seiffert, "Artificial neural networks on massively parallel computer hardware", European Symposium on Artificial Neural Networks, Bruges, Belgium, April 2002.
19. S. Suresh, S. N. Omkar and V. Mani, "Parallel implementation of back-propagation algorithm in networks of workstations", IEEE Transactions on Parallel and Distributed Systems, 16 (1), pp. 24-34, 2005.
20. R. K. Thulasiram, R. M. Rahman and P. Thulasiraman, "Neural Network Training Algorithms on Parallel Architectures for Finance Applications", International Conference on Parallel Processing Workshops, Kaohsiung, Taiwan, October 2003.
21. R. Uetz and S. Behnke, "Large-scale Object Recognition with CUDA-accelerated Hierarchical Neural Networks", In Proceedings of the 1st IEEE International Conference on Intelligent Computing and Intelligent Systems, 2009.