SpiNNaker: Enhanced multicast routing

Parallel Computing

Volumn 45, Issue , 2015, Pages 49-66

  Navaridas, Javier ^a   Luján, Mikel ^a   Plana, Luis A ^a   Temple, Steve ^a   Furber, Steve B ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Low power architecture; Massively parallel processing; Multicast route generation; Neuromimetic architecture; Spiking neural network simulation; Triangular toroidal mesh

Indexed keywords

ALGORITHMS; COMPLEX NETWORKS; COMPUTATIONAL COMPLEXITY; MULTICASTING; NETWORK ARCHITECTURE; NETWORK ROUTING; NEURAL NETWORKS; NEURONS; PARALLEL ARCHITECTURES; TOPOLOGY;

LOW POWER ARCHITECTURE; MASSIVELY PARALLEL PROCESSING; MULTICAST ROUTES; SPIKING NEURAL NETWORK SIMULATIONS; TRIANGULAR TOROIDAL MESH;

LOW POWER ELECTRONICS;

EID: 84939991362     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2015.01.002     Document Type: Article

References (49)

1. N.R. Adiga. et al., An overview of the BlueGene/L supercomputer, in: Proc. of the ACM/IEEE Supercomputing conference (SC'02). Baltimore, MD, USA, 2002, pp. 60:1-60:22.
2. Y. Ajima, Y. Takagi, T. Inoue, S. Hiramoto, T. Shimizu, The tofu interconnect, in: Proc. of the IEEE 19th Annual Symposium on High Performance Interconnects, Santa Clara, CA, USA, 2011, pp. 87-94.
3. S. Alam, R. Barrett, M. Bast, M.R. Fahey, J. Kuehn, C. McCurdy, J. Rogers, P. Roth, R. Sankaran, J.S. Vetter, P. Worley, W. Yu, Early evaluation of IBM BlueGene/P, in: Proc. of the ACM/IEEE Conference on Supercomputing, Austin, TX, USA, 2008, pp. 1-12.
4. R. Ananthanarayanan, S.K. Esser, H.D. Simon, D.S. Modha, The cat is out of the bag: cortical simulations with 109 neurons, 1013 synapses, in: Proc. of Conf. on High Performance Computing Networking, Storage and Analysis, SC '09, New York, NY, USA, 2009, pp. 63:1-63:12.
5. K. Asanovic, J. Beck, J. Feldman, N. Morgan, J. Wawrzynek, A supercomputer for neural computation, in: Proc. 1994 International Conference on Neural Networks (ICNN94), Orlando, FL, pp. 5-9.
6. S. Bhattacharya, G. Elsesser, W.T. Tsai, and D.Z. Du Multicasting in generalized multistage interconnection networks J. Parallel Distrib. Comput. 22 1 1994 80 95
7. T. Binzegger, R.J. Douglas, and K.A. Martin Topology and dynamics of the canonical circuit of cat V1 Neural Networks 22 8 2009 1071 1078
8. Y. Breitbart, M. Garofalakis, B. Jai, C. Martin, R. Rastogi, and A. Silberschatz Topology discovery in heterogeneous IP networks: the NetInventory system Trans. Network. 12 3 2004 401 414
9. S. Coll, F.J. Mora, J. Duato, and F. Petrini Efficient and scalable hardware-based multicast in fat-tree networks IEEE Trans. Parallel Distrib. Syst. 20 9 2009 1285 1298
10. W.J. Dally, B. Towles, Principles and Practices of Interconnection Networks, in: Morgan Kaufmann Series in Computer Architecture and Design, Morgan Kaufmann, 2004.
11. S. Davies, J. Navaridas, F. Galluppi, S. Furber, Population-based routing in the SpiNNaker neuromorphic architecture, in: International Joint Conference on Neural Networks (IJCNN 2012), June 10-15, 2012, Brisbane, Australia, pp. 1-8.
12. S. Davies, C. Patterson, F. Galluppi, A.D. Rast, D. Lester, S.B. Furber, Interfacing real-time spiking I/O with the SpiNNaker neuromimetic architecture, in: 17th International Conference on Neural Information Processing, ICONIP 2010, Sydney, Australia, November 22-25, 2010. Theory and Algorithms Lecture Notes in Comput. Sci., vol. 6443, pp 58-65.
13. A.P. Davison, D. Brüderle, J. Eppler, J. Kremkow, E. Muller, D. Pecevski, L. Perrinet, and P. Yger PyNN: a common interface for neuronal network simulators Front. Neuroinform. 2 2008 11
14. P. Dayan, and L. Abbott Theoretical Neuroscience 2001 MIT Press Cambridge
15. J. Defelipe, H. Markram, and K.S. Rockland The neocortical column Front. Neuroanat. 6 22 2012
16. Defense Sciences Office, Systems of neuromorphic adaptive plastic scalable electronics (SYNAPSE), 2011.
17. T. Elliott, and N. Shadbolt Developmental robotics: manifesto and application Philos. Trans. R. Soc., A 361 2003
18. J. Fieres, J. Schemmel, K. Meier, Realizing biological spiking network models in a configurable wafer-scale hardware system, in: Proc. of the 2008 IEEE International Joint Conference on Neural Networks, Hong Kong, 2008, pp. 969-976.
19. S.B. Furber, S. Temple, A. Brown, On-chip and inter-chip networks for modelling large-scale neural systems, in: Proc. of the International Symposium on Circuits and Systems, ISCAS-2006, Kos, Greece, 2006, pp. 1945-1948.
20. A. Gara, J. Moreira, IBM Blue Gene supercomputer, IBM research report, 2011.
21. P. Hagmann, L. Cammoun, X. Gigandet, R. Meuli, C.J. Honey, V.J. Wedeen, and O. Sporns Mapping the structural core of human cerebral cortex PLoS Biol. 6, 7 2008 e159
22. S. Herculano-Houzel, The human brain in numbers: a linearly scaled-up primate brain, in: Front. Hum. Neurosci., vol. 3, 2009, p. 31.
23. S. Herculano-Houzel, B. Mota, and R. Lent Cellular scaling rules for rodent brains Proc. Natl. Acad. Sci. USA 103 32 2006 12138 12143
24. W.D. Hillis, and L.W. Tucker The CM-5 connection machine: a scalable supercomputer Commun. ACM 36 11 1993 31 40
25. E. Izhikevich Simple model of spiking neurons Trans. Neural Networks 14 2003 1569 1572
26. N.E. Jerger, L.S. Peh, M. Lipasti. Virtual circuit tree multicasting: a case for on-chip hardware multicast support, in: Proc. of the 2008 International Symposium on Computer Architecture, Beijing, 2008, pp. 229-240.
27. X. Jin, S.B. Furber, J.V. Woods, Efficient modelling of spiking neural networks on a scalable chip multiprocessor, in: Proc. of the 2008 International Joint Conference on Neural Networks, Hong Kong, 2008, pp. 2812-2819.
28. C. Koch, and I. Segev Methods in Neuronal Modelling 1989 The MIT Press
29. D.E. Knuth, The Art of Computer Programming, Addison-Wesley, ISBN: 978-0321751041.
30. X. Lin, P.K. McKinley, and L.M. Ni Deadlock-free multicast wormhole routing in 2-D mesh multicomputers IEEE Trans. Parallel Distrib. Syst. 5 8 1994 793 804
31. X. Lin, and L.M. Ni Multicast communication in multicomputer networks IEEE Trans. Parallel Distrib. Syst. 4 10 1993 1105 1117
32. W. Maas, and C.M. Bishop Pulsed Neural Networks 1998 The MIT Press
33. H. Markram The blue brain project Nat. Rev. Neurosci. 7 2 2006 153 160
34. R. Menzel, and M. Giurfa Cognitive architecture of a mini-brain: the honeybee Trends Cognitive Sci. 5 2 2001
35. P. Merolla, J. Arthur, F. Akopyan, N. Imam, R. Manohar, D.S. Modha, A digital neurosynaptic core using embedded crossbar memory with 45 pJ per spike in 45 nm, in: Custom Integrated Circuits Conference, San Jose, CA, 2011.
36. J. Milano, and P. Lembke IBM System Blue Gene Solution: Blue Gene/Q Hardware Overview and Installation Planning 2012 IBM Red Books
37. J. Navaridas, M. Luján, J. Miguel-Alonso, L.A. Plana, S.B. Furber, Understanding the interconnection network of SpiNNaker, in: Proc. of the 23rd International Conference on Supercomputing, York Town Heights, NY, 2009.
38. J. Navaridas, M. Luján, L.A. Plana, J. Miguel-Alonso, S.B. Furber, Analytical assessment of the suitability of multicast communications for the SpiNNaker neuromimetic system, in: IEEE International Conference on High Performance Computing and Communications (HPCC 2012), June 25-27, 2012, Liverpool, United Kingdom, pp 1-8.
39. J. Navaridas, M. Lujan, L. Plana, S. Temple, S. Furber, On generating multicast routes for SpiNNaker, a massively-parallel system for neural net simulation, in: ACM Computing Frontiers 2014, May 20-22, 2014, Cagliari, Italy.
40. D.K. Panda, S. Singal, and R. Kesavan Multidestination message passing in wormhole k-ary n-cube networks with base routing conformed paths IEEE Trans. Parallel Distrib. Syst. 10 1 1999 76 96
41. P. Pfaerber, K. Asanovic, Parallel neural network training on multispert, in: Proc. IEEE Third International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP'97), Melbourne, Vic., 1997, pp. 659-666.
42. A.D. Rast, J. Navaridas, X. Jin, F. Galluppi, L.A. Plana, J. Miguel-Alonso, C. Patterson, M. Luján, and S.B. Furber Managing burstiness and scalability in event-driven models on the SpiNNaker neuromimetic system Int. J. Parallel Prog. 40 6 2011 553 582
43. F. Rosenblatt Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms 1961 Spartan Books Washington
44. A.R. Sadaf, J.A. Kuehn, R.F. Barrett, J.M. Larkin, M.R. Fahey, R. Sankaran, P.H. Worley, Cray XT4: an early evaluation for petascale scientific simulation, in: Proc. of the 2007 ACM/IEEE Conference on Supercomputing, Reno, NV, USA, 2007, pp. 1-12.
45. J.K. Shapiro, J. Kurose, D. Towsley, S. Zabele, Topology discovery service for router-assisted multicast transport, in: IEEE Open Architectures and Network Programming, New York, NY, 2002.
46. A.M. Thomson, and C. Lamy Functional maps of neocortical local circuitry Front. Neurosci. 1 1 2007 19 42
47. Y.C. Tseng, D.K. Panda, and T.H. Lai A trip-based multicasting model in wormhole-routed networks with virtual channels IEEE Trans. Parallel Distrib. Syst. 7 2 1996 138 150
48. L. Wang, Y. Jin, H. Kim, E.J. Kim, Recursive partitioning multicast: a bandwidth-efficient routing for networks-on-chip, in: Proc. of the International Symposium on Networks-on-Chip. Washington, DC, USA, 2009.
49. J. Wu, and S.B. Furber A multicast routing scheme for a universal spiking neural network architecture Comput. J. 53 3 2010 280 288