Design and implementation of parallel counterpropagation networks using MPI

Informatica

Volumn 18, Issue 1, 2007, Pages 79-102

  Margaris, Athanasios ^a   Souravlas, Stavros ^a   Kotsialos, Efthimios ^a   Roumeliotis, Manos ^a  

^a UNIVERSITY OF MACEDONIA   (Greece)

Author keywords

Collective communication; Communicators; Counterpropagation; Message passing interface; Neural networks; Parallel programming; Point to point communications; Process groups; RMA operations

Indexed keywords

EID: 33947377087     PISSN: 08684952     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (24)

1. Boniface, Y., F. Alexandre, S. Vialle (1999). A bridge between two paradigms for parallelism: neural networks and general purpose MIMD computers. In Proceedings of International Joint Conference on Neural Networks, (IJCNN'99). Washington, D.C.
2. Boniface, Y., F. Alexandre, S. Vialle (1999). A library to implement neural networks on mimd machines. In Proceedings of 6th Eurupean Conference on Parallel Processing (EUROPAR '99). Toulouse, France, pp. 935-938.
3. Cropp, W. et al. (1998). MPI - The Complete Reference. Vol. 2. The MPI Extensions. Scientific and Engineering Computational Series, The MIT Press, Massachusetts.
4. Fisher, R.A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7(1), 179-188.
5. Freeman, J., D. Skapura (1991). Neural Networks: Algorithms, Applications, and Programming Techniques. Addison-Wesley Publishing Company.
6. Fuerle, T., E. Schikuta (1997). PAANS - a parallelized artificial neural network simulator. In Proceedings of 4th International Conference on Neural Information Processing (ICONIP'97). Dunedin, New Zeland, Springer Verlag.
7. Haykin, S. (1994). Neural Networks - A Comprehensive Foundation. Prentice Hall.
8. Kumar, V., S. Shekhar, M. Amin (1994). A scalable parallel formulation of the back propagation algorithm for hypercubes and related architectures. IEEE Transactions on Parallel and Distributed Systems, 5(10). pp. 1073-1090.
9. Margaris, A. et al. Development of neural models for the logistic equation, and study of the neural based trajectories in the convergence, periodic, and chaotic regions. Neural, Parallel & Scientific Computations, 9, 221-230.
10. Margaris, A. et al. (2003). Neural workbench: an object oriented neural network simulator. In Proceedings of International Conference on Theory and Applications of Mathematics and Informatics (ICTAMI2003), Acta Universitatis Apulensis. Alba Ioulia, Romania, pp. 309-326.
11. Margaris, A. et al. (2005). Speech frames extraction using neural networks and message passing techniques, 1. In Proceedings of International Conference of Computational Methods in Sciences and Engineering (IC-CMSE 2005). Lecture Series on Computers and Computational Sciences. Brill Academic Publishers. Vol. 4, pp. 384-387.
12. Misra, M. (1992). Implementation of neural networks on parallel architectures. PHD Thesis, University of Southern California.
13. Misra, M. (1997). Parallel environment for implementing neural networks. Neural Computing Surveys, 1, 48-60.
14. Pacheco, P. ( 1997). Parallel Programming with MPI. Morgan Kaufmann Publishers Inc, San Francisco, California.
15. Quoy, M., S. Moga, P. Gaussier, A. Revel (2000). Parallelization of neural networks using PVM. In J. Dongarra, P. Kacsuk and N. Podhorszki (Eds.) Recent Advances in Parallel Virtual Machines and Message Passing Interface. Berlin, pp. 289-296. Lecture Notes on Computer Science, 1908.
16. Scikuta, E. (1997). Structural data parallel neural network simulation. In Proceedings of 11th Annual International Symposium on High Performance Computing Systems (HPCS'97). Winnipeg, Canada.
17. Serbedzija, N. (1996). Simulating artificial neural networks on parallel architectures. Computer, 29(3), 56-63.
18. Schikuta, E., T. Fuerle, H. Wanek (2000). Structural data parallel simulation of neural networks. Journal of System Research and Information Science, 9, 149-172.
19. Snir, M. et al. (1998). MPI - The Complete Reference. Vol. 1. The MPI Core, 2nd edition. Scientific and Engineering Computational Series, The MIT Press, Massachusetts.
20. Standish, R. (1999). Complex Systems Research on Parallel Computers. http://parallel.hpc.unsw.edu.au/rks/docs/parcomplex.
21. Tomsich, P., A. Rauber, D. Merkl (2000). Optimizing the parSOM neural network implementation for data mining with distributed memory systems and cluster computing. In Proceedings of 11th International Workshop on Databases and Expert Systems Applications. Greenwich, London UK. pp. 661-666.
22. Torresen, J. et al. (1994). Parallel back propagation training algorithm for MIMD computer with 2D-torus network. In Proceedings of 3rd Parallel Computing Workshop (PCW'94). Kawasaki, Japan.
23. Torresen, J., S. Tomita (1998). A review of parallel implementation of back propagation neural n-etworks. In N. Sundararajan and P. Saratchandram (Eds.) Parallel Architectures of Artificial Neural Networks. IEEE CS Press.
24. Weigang, L., N. Correia da Silva (1999). A study of parallel neural networks. In Proceedings of International Joint Conference on Neural Networks, Vol. 2. Washington, D.C. pp. 1113-1116.