Compass: A scalable simulator for an architecture for cognitive computing

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

Volumn , Issue , 2012, Pages

  Preissl, Robert ^a   Wong, Theodore M ^a   Datta, Pallab ^a   Flickner, Myron ^a   Singh, Raghavendra ^a   Esser, Steven K ^a   Risk, William P ^a   Simon, Horst D ^b   Modha, Dharmendra S ^a  

^a IBM ALMADEN RESEARCH CENTER   (United States)

^b LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE COMPUTING; COMMUNICATION PRIMITIVES; COMPACT ARCHITECTURE; FUNCTIONAL SIMULATORS; MASSIVELY PARALLELS; NEUROSYNAPTIC CORES; PARALLEL COMPILERS; REAL TIME PERFORMANCE;

NEURONS; PROGRAM PROCESSORS;

NETWORK ARCHITECTURE;

EID: 84877717291     PISSN: 21674329     EISSN: 21674337     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2012.34     Document Type: Conference Paper

References (44)

1. J. von Neumann, The Computer and The Brain. Yale University Press, 1958.
2. D. S. Modha, R. Ananthanarayanan, S. K. Esser, A. Ndirango, A. J. Sherbondy, and R. Singh, "Cognitive computing," Communications of the ACM, vol. 54, no. 8, pp. 62-71, 2011.
3. P. Merolla, J. Arthur, F. Akopyan, N. Imam, R. Manohar, and D. Modha, "A digital neurosynaptic core using embedded crossbar memory with 45pj per spike in 45nm," in Custom Integrated Circuits Conference (CICC), 2011 IEEE, sept. 2011, pp. 1-4.
4. J. Seo, B. Brezzo, Y. Liu, B. Parker, S. Esser, R. Montoye, B. Rajendran, J. Tierno, L. Chang, D. Modha, and D. Friedman, "A 45nm cmos neuromorphic chip with a scalable architecture for learning in networks of spiking neurons," in Custom Integrated Circuits Conference (CICC), 2011 IEEE, sept. 2011, pp. 1-4.
5. N. Imam, F. Akopyan, J. Arthur, P. Merolla, R. Manohar, and D. S. Modha, "A digital neurosynaptic core using event-driven qdi circuits," in ASYNC 2012: IEEE International Symposium on Asynchronous Circuits and Systems, 2012.
6. J. V. Arthur, P. A. Merolla, F. Akopyan, R. Alvarez-Icaza, A. Cassidy, S. Chandra, S. K. Esser, N. Imam, W. Risk, D. Rubin, R. Manohar, and D. S. Modha, "Building block of a programmable neuromorphic substrate: A digital neurosynaptic core," in International Joint Conference on Neural Networks, 2012.
7. J. W. Backus, "Can programming be liberated from the von neumann style? a functional style and its algebra of programs." Communications of the ACM, vol. 21, no. 8, pp. 613-641, 1878.
8. V. B. Mountcastle, Perceptual Neuroscience: The Cerebral Cortex. Harvard University Press, 1998.
9. D. S. Modha and R. Singh, "Network architecture of the long distance pathways in the macaque brain," Proceedings of the National Academy of the Sciences USA, vol. 107, no. 30, pp. 13 485-13 490, 2010. [Online]. Available: http://www.pnas.org/content/107/30/13485.abstract
10. C. Koch, Biophysics of Computation: Information Processing in Single Neurons. Oxford University Press, New York, New York, 1999.
11. R. Ananthanarayanan and D. S. Modha, "Anatomy of a cortical simulator," in Supercomputing 07, 2007.
12. 13 synapses," in Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, ser. SC '09. New York, NY, USA: ACM, 2009, pp. 63:1-63:12. [Online]. Available: http://doi.acm.org/10. 1145/1654059.1654124
13. E. M. Izhikevich, "Which model to use for cortical spiking neurons," IEEE Transactions on Neural Networks, vol. 15, pp. 1063-1070, 2004. [Online]. Available: http://www.nsi.edu/users/izhikevich/publications/ whichmod.pdf
14. H. Markram, "The Blue Brain Project," Nature Reviews Neuroscience, vol. 7, no. 2, pp. 153-160, Feb. 2006. [Online]. Available: http://dx.doi.org/10.1038/nrn1848
15. H. Markram, "The Human Brain Project," Scientific American, vol. 306, no. 6, pp. 50-55, Jun. 2012.
16. R. Brette and D. F. M. Goodman, "Vectorized algorithms for spiking neural network simulation," Neural Comput., vol. 23, no. 6, pp. 1503-1535, 2011. [Online]. Available: http://dx.doi.org/10.1162/NECO-a-00123
17. M. Djurfeldt, M. Lundqvist, C. Johansson, M. Rehn, O. Ekeberg, and A. Lansner, "Brain-scale simulation of the neocortex on the ibm blue gene/l supercomputer," IBM J. Res. Dev., vol. 52, no. 1/2, pp. 31-41, Jan. 2008. [Online]. Available: http://dl.acm.org/citation.cfm?id=1375990.1375994
18. E. M. Izhikevich and G. M. Edelman, "Large-scale model of mammalian thalamocortical systems," Proceedings of the National Academy of Sciences, vol. 105, no. 9, pp. 3593-3598, Mar. 2008. [Online]. Available: http://dx.doi.org/10.1073/pnas.0712231105
19. J. M. Nageswaran, N. Dutt, J. L. Krichmar, A. Nicolau, and A. Veidenbaum, "Efficient simulation of large-scale spiking neural networks using cuda graphics processors," in Proceedings of the 2009 international joint conference on Neural Networks, ser. IJCNN'09. Piscataway, NJ, USA: IEEE Press, 2009, pp. 3201-3208. [Online]. Available: http://dl.acm.org/citation.cfm?id= 1704555.1704736
20. M. M. Waldrop, "Computer modelling: Brain in a box," Nature, vol. 482, pp. 456-458, 2012. [Online]. Available: http://dx.doi.org/10.1038/ 482456a
21. H. de Garis, C. Shuo, B. Goertzel, and L. Ruiting, "A world survey of artificial brain projects, part i: Large-scale brain simulations," Neurocomput., vol. 74, no. 1-3, pp. 3-29, Dec. 2010. [Online]. Available: http://dx.doi.org/10.1016/j.neucom.2010.08.004
22. R. Brette, M. Rudolph, T. Carnevale, M. Hines, D. Beeman, J. M. Bower, M. Diesmann, A. Morrison, P. H. Goodman, A. P. Davison, S. E. Boustani, and A. Destexhe, "Simulation of networks of spiking neurons: A review of tools and strategies," Journal of Computational Neuroscience, vol. 2007, pp. 349-398, 2007. (Pubitemid 47566522)
23. D. Gregor, T. Hoefler, B. Barrett, and A. Lumsdaine, "Fixing Probe for Multi-Threaded MPI Applications," Indiana University, Tech. Rep. 674, Jan. 2009.
24. R. Sinkhorn and P. Knopp, "Concerning nonnegative matrices and doubly stochastic matrices." Pacific Journal of Mathematics, vol. 21, no. 2, pp. 343-348, 1967.
25. A. Marshall and I. Olkin, "Scaling of matrices to achieve specified row and column sums," Numerische Mathematik, vol. 12, pp. 83-90, 1968, 10.1007/BF02170999. [Online]. Available: http://dx.doi.org/10.1007/BF02170999
26. P. Knight, "The sinkhorn-knopp algorithm: convergence and applications," SIAM Journal on Matrix Analysis and Applications, vol. 30, no. 1, pp. 261-275, 2008.
27. R. Kötter, "Online retrieval, processing, and visualization of primate connectivity data from the CoCoMac database," Neuroinformatics, vol. 2, pp. 127-144, 2004. (Pubitemid 41214094)
28. "Cocomac (collations of connectivity data on the macaque brain)," www.cocomac.org.
29. G. Paxinos, X. Huang, and M. Petrides, The Rhesus Monkey Brain in Stereotaxic Coordinates. Academic Press, 2008. [Online]. Available: http://books.google.co.in/books?id=7HW6HgAACAAJ
30. B. G. Kötter R., Reid A.T., "An introduction to the cocomac-paxinos-3d viewer," in The Rhesus Monkey Brain in Stereotaxic Coordinates, G. Paxinos, X.-F. Huang, M. Petrides, and A. Toga, Eds. Elsevier, San Diego., 2008, ch. 4.
31. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol., vol. 160, no. 1, pp. 106-154, 1962.
32. A. Peters and E. G. Jones, Cerebral Cortex. Vol 4. Association and auditory cortices. Springer, 1985.
33. V. B. Mountcastle, "The columnar organization of the neocortex," Brain, vol. 120, no. 4, pp. 701-22, 1997.
34. C. E. Collins, D. C. Airey, N. A. Young, D. B. Leitch, and J. H. Kaas, "Neuron densities vary across and within cortical areas in primates," Proceedings of the National Academy of Sciences, vol. 107, no. 36, pp. 15 927-15 932, 2010.
35. R. A. Haring, M. Ohmacht, T. W. Fox, M. K. Gschwind, D. L. Satterfield, K. Sugavanam, P. W. Coteus, P. Heidelberger, M. A. Blumrich, R. W. Wisniewski, A. Gara, G. L.-T. Chiu, P. A. Boyle, N. H. Chist, and C. Kim, "The IBM Blue Gene/Q Compute Chip," IEEE Micro, vol. 32, pp. 48-60, 2012.
36. D. Chen, N. A. Eisley, P. Heidelberger, R. M. Senger, Y. Sugawara, S. Kumar, V. Salapura, D. L. Satterfield, B. Steinmacher-Burow, and J. J. Parker, "The IBM Blue Gene/Q interconnection network and message unit," in Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, ser. SC '11. New York, NY, USA: ACM, 2011, pp. 26:1-26:10. [Online]. Available: http://doi.acm.org/10.1145/2063384.2063419
37. "The Berkeley UPC Compiler," 2002, http://upc.lbl.gov.
38. R. Nishtala, P. H. Hargrove, D. O. Bonachea, and K. A. Yelick, "Scaling communication-intensive applications on BlueGene/P using one-sided communication and overlap," in Proceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing, ser. IPDPS '09. Washington, DC, USA: IEEE Computer Society, 2009, pp. 1-12. [Online]. Available: http://dx.doi.org/10.1109/IPDPS.2009.5161076
39. D. Bonachea, "GASNet Specification, v1.1," University of California at Berkeley, Berkeley, CA, USA, Tech. Rep., 2002.
40. S. Kumar, G. Dozsa, G. Almasi, P. Heidelberger, D. Chen, M. E. Giampapa, M. Blocksome, A. Faraj, J. Parker, J. Ratterman, B. Smith, and C. J. Archer, "The Deep Computing Messaging Framework: Generalized Scalable Message Passing on the Blue Gene/P Supercomputer," in Proceedings of the 22nd annual international conference on Supercomputing, ser. ICS '08. New York, NY, USA: ACM, 2008, pp. 94-103. [Online]. Available: http://doi.acm.org/10.1145/ 1375527.1375544
41. T. Hoefler, C. Siebert, and A. Lumsdaine, "Scalable Communication Protocols for Dynamic Sparse Data Exchange," in Proceedings of the 2010 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'10). ACM, Jan. 2010, pp. 159-168.
42. D. S. Modha, "A conceptual cortical surface atlas," PLoS ONE, vol. 4, no. 6, p. e5693, 2009.
43. A. J. Sherbondy, R. Ananthanrayanan, R. F. Dougherty, D. S. Modha, and B. A. Wandell, "Think global, act local; projectome estimation with bluematter," in Proceedings of MICCAI 2009. Lecture Notes in Computer Science, 2009.
44. B. L. Jackson, B. Rajendran, G. S. Corrado, M. Breitwisch, G. W. Burr, R. Cheek, K. Gopalakrishnan, S. Raoux, C. T. Rettner, A. G. Schrott, R. S. Shenoy, B. N. Kurdi, C. H. Lam, and D. S. Modha, "Nanoscale electronic synapses using phase change devices," ACM Journal on Emerging Technologies in Computing Systems, forthcoming, 2012.