Mapping of artificial neural networks onto message passing systems

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 26, Issue 6, 1996, Pages 822-835

  Kumar, Mohan J ^a,b   Patnaik, Lalit M ^a,c  

^a IEEE

^b CURTIN UNIVERSITY   (Australia)

^c INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

Artificial neural networks; Backpropagation; Extended hypercube; Multinode broadcast; Multiprocessors; Total exchange

Indexed keywords

BINARY TREE; EXTENDED HYPERCUBE; HYPERCUBE TOPOLOGIES; MESSAGE PASSING SYSTEMS;

ARTIFICIAL INTELLIGENCE; BACKPROPAGATION; COMPUTER ARCHITECTURE; COMPUTER SIMULATION; DATA COMMUNICATION SYSTEMS; MULTIPROCESSING SYSTEMS; TREES (MATHEMATICS);

NEURAL NETWORKS;

EID: 0030394996     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/3477.544296     Document Type: Article

References (23)

1. J. Bailey, "VLSI interconnect structure for neural networks," Oregon Institute of Technology, Klamath Falls, Tech. Rep. CS/E-88027.
2. _, "A program for mapping CNN's to physical architectures," Oregon Institute of Technology, Klamath Falls, Tech. Rep. CS/E-88026.
3. T. Baker, and D. Hammerstrom, "Modifications of neural network models for digital hardware implementation," Oregon Institute of Technology, Klamath Falls, Tech. Rep. CS/E-88035, Dec. 1988.
4. A. G. Barto, C. W. Anderson, and R. S. Sutton, "Synthesis of non linear control surfaces by a layered associative search network," Biol. Cybern. vol. 43, pp. 173-185, 1982.
5. S. T. Chakradhar, M. L. Bushnell, and V. D. Agrawal, "Automatic test generation using neural networks," in Proc. IEEE Int. Conf. Computer-Aided Design, Nov. 1988, pp. 416-419.
6. B. M. Forrest, D. Roweth, N. Stroud, D. J. Wallace, and G. V. Wilson, "Implementing neural network models on parallel computers," Comp. J., vol. 30, no. 5, pp. 413-419, 1987.
7. K. Fukushima, "Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position," Biol. Cybern., vol. 36, pp. 193-202, 1980.
8. K. Fukushima and S. Miyake, "Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position," Pattern Recognit., vol. 15, no. 6, pp. 455-469, 1982.
9. J. Ghosh and K. Hwang, "Mapping neural networks onto message-passing multicomputers," J. Parallel Distr. Comput., vol. 6, pp. 291-330, 1989.
10. K. Hwang and J. Ghosh "Critical issues in mapping neural networks on message-passing multicomputers," in Proc. Int. Symp. Computer Architecture, 1988, pp. 3-11.
11. B. Indurkhya and H. S. Stone, "Optimal partitioning of randomly generated distributed programs," IEEE Trans. Software Eng., vol. SE-12, pp. 483-495. Mar. 1986.
12. T. Ito, K. Fukushima, and S. Miyake, "Realization of a neural network model neocognitron on a hypercube parallel computer," Int. J. High Speed Comput., vol. 2, no. 1, 1990.
13. S. Kung and J. N. Hwang, "A unified systolic architecture for artificial neural networks," J. Parallel Distr. Comput., vol. 6, pp. 358-387, 1989.
14. M. J. Kumar and L. M. Patnaik, "Extended hypercube: A hierarchical interconnection network of hypercubes," IEEE Trans. Parallel Distrib. Syst., vol. 3, no. 1, pp. 45-57, 1992.
15. M. I. Kumar, L. M. Patnaik, and D. K. Prasad, "A transputer based extended hypercube," Microprocess. Microprogr., vol. 29, pp. 225-236, 1990.
16. D. A. Pommerleau, G. S. Gusciora, D. S. Touretzky, and H. T. Kung, "Neural network simulation at warp speed: How we got 17 million connections per second," in Proc. IEEE int. Conf. Neural Networks, July 1988, vol. II, pp. 143-150.
17. Y. Saad and M. H. Schultz, "Topological properties of hypercube," Dept. Computer Science, Yale University, New Haven, CT, Tech. Rep. TR-462, Mar. 1986.
18. B. W. Wah and L.-C. Chu, "Efficient mapping of neural networks on multicomputers," in Proc. Int. Conf. Parallel Processing, 1990, pp. I-234-241.
19. P. D. Wasserman, Neural Computing Theory and Practice. New York: Van Nostrand Reinhold, 1989, p. 230.
20. P. J. Werbos, "Backpropagation through time: What it does and how to do it," Proc. IEEE, vol. 78, pp. 1550-1560, Oct. 1990.
21. M. Witbrook and M. Zagha, "An implementation of backpropagation learning on GF11, a large SIMD parallel computer," Parallel Comput. vol. 14, pp. 329-346, Sept. 1990.
22. H. Yoon, J. H. Nang, and S. R. Maeng, "Parallel simulation of multilayered neural networks on distributed-memory multiprocessors," Microprocess. Microprogr., vol. 29, pp. 185-195, 1990.
23. X. Zhang, M. Mckenna, J. P. Mesirov, and D. L. Waltz, "The backpropagation algorithm on grid and hypercube architectures," Parallel Comput. vol. 14, pp. 317-327, Sept. 1990.