Parallelization of deep networks

ESANN 2012 proceedings, 20th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning

Volumn , Issue , 2012, Pages 621-626

  De Grazia, Michele De Filippo ^a   Stoianov, Ivilin ^a   Zorzi, Marco ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

FEATURE EXTRACTION; LEARNING SYSTEMS; NEURAL NETWORKS;

COGNITIVE MODEL; COMPUTATIONAL NODES; COMPUTATIONAL REQUIREMENTS; DEEP BELIEF NETWORKS; FEATURE DETECTOR; MULTIPLE LEVELS; PARALLELIZATIONS; STOPPING CRITERIA;

ARTIFICIAL INTELLIGENCE;

EID: 84908651687     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. G. E. Hinton, S. Osindero, and Y. Teh. A fast learning algorithm for deep belief nets. Neural Comput., 18(7):1527–1554, 2006.
2. G. E. Hinton and R. R. Salakhutdinov. Reducing the Dimensionality of Data with Neural Networks. Science, 313(5786):504–507, 2006.
3. I. Stoianov and M. Zorzi. Emergence of a”Visual Number Sense” in Hierarchical Generative Model. Nature Neuroscience, 15:194–196, 2012.
4. P. Färber and K. Asanovic. Parallel neural network training on multi-spert. In IEEE 3rd International Conference on Algorithms and Architectures for Parallel Processing, Melbourne, Australia, December 1997.
5. A. Margaris, S. Souravlas, E. Kotsialos, and M. Roumeliotis. Design and implementation of parallel counterpropagation networks using MPI. Informatica, 18(1):79–102, 2007.
6. J. Fernández, M. Anguita, E. Ros, and J. L. Bernier. SCE Toolboxes for the development of high-level parallel applications. Lecture Notes in Computer Science, 3992:518–525, 2006.
7. B. Ribeiro, R. F. Albrecht, A. Dobnikar, D. W. Pearson, and N. C. Steele. Parallel implementations of feed-forward neural network using MPI and C# on.NET platform. In Proceedings of the International Conference on Adaptive and Natural Computing Algorithms, pages 534–537, Coibra, 2005.
8. A. S. Ahmad, A. Zulianto, and E. Sanjaya. Design and implementation of parallel batchmode neural network on parallel virtual machine. In Industrial Electronic Seminar, 1999.
9. S. Mahapatra, R. N. Mahapatra, and B. N. Chatterji. A parallel formulation of back-propagation learning on distributed memory multiprocessors. Parallel Computing, 22(12):1661–1675, 1997.
10. B. H. V. Topping, A. I. Khan, and A. Bahreininejad. Parallel training of neural networks for finite element mesh decomposition. Computers & Structures, 63(4):693–707, 1997. Computing in Civil and Structural Engineering.
11. C. M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, Inc., New York, NY, USA, 1995.