Scalable multi-precision simulation of spiking neural networks on GPU with OpenCL

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2012, Pages

  Yudanov, Dmitri ^a   Reznik, Leon ^b  

^a ADVANCED MICRO DEVICES   (United States)

^b Rochester Institute of Technology   (United States)

Author keywords

GPU implementation; high precision; OpenCL; spiking neural network simulation

Indexed keywords

GPU IMPLEMENTATION; HIGH PRECISION; OPENCL; SIMULATION METHODS; SIMULATION MODEL; SPIKING NEURAL NETWORKS;

COMPUTER SIMULATION; INTELLIGENT AGENTS;

NEURAL NETWORKS;

EID: 84865066456     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2012.6252440     Document Type: Conference Paper

References (41)

1. V K Pallipuram, M Bhuiyan, and M C Smith, "A comparative study of GPU programming models and architectures using neural networks," The Journal of Supercomputing, pp. 1-46, May 2011.
2. J Hoffmann, K El-Laithy, F Güttler, and M Bogdan, "Simulating biological-inspired spiking neural networks with OpenCL," in Artificial Neural Networks - ICANN 2010, Konstantinos Diamantaras, Ed.: Springer, 2010, vol. 6352/2010, pp. 184-187.
3. C M Thibeault and R V Hoang, "A Novel Multi-GPU Neural Simulator," in BICoB, 2011, pp. 146-151.
4. T Poggio, U Knoblich, and J Mutch, "CNS: a GPU-based framework for simulating cortically-organized networks," Massachusetts Institute of Technology, Computer Science and Artificial Intelligence Laboratory Technical Report 2010.
5. S H Lee and K Skadron, "Highly Parallel Implementation of NeuroJet using GPUs," School of Engineering and Applied Science-University of Virginia, A Technical Report in STS 4020 2010.
6. M Richert, J M Nageswaran, N Dutt, and J L Krichmar, "An Efficient Simulation Environment for Modeling Large-Scale Cortical Processing," Frontiers in Neuroinformatics, vol. 5, 2011.
7. T Nowotny, "Flexible neuronal network simulation framework using code generation for NVidia® CUDA™," BMC Neuroscience, vol. 12, p. P239, July 2011.
8. Z Fountas, D Gamez, and A K Fidjeland, "A neuronal global workspace for human-like control of a computer game character," in 2011 IEEE Conference on Computational Intelligence and Games (CIG), Seoul, 2011, pp. 350-357.
9. D Yudanov, M Shaaban, R Melton, and L Reznik, "GPU-based simulation of spiking neural networks with real-time performance & high accuracy," in The 2010 International Joint Conference on Neural Networks (IJCNN), Barcelona, 2010, pp. 1-8.
10. M Houston and M Mantor. (2011, June) Fusion Developer Summit: AMD Graphics Core Next. [Online]. http://developer.amd.com/afds
11. N A Lesica and B Grothe, "Dynamic spectrotemporal feature selectivity in the auditory midbrain," The Journal of Neuroscience, vol. 28, p. 5412, May 2008.
12. R Azouz and C M Gray, "Cellular mechanisms contributing to response variability of cortical neurons in vivo," The Journal of Neuroscience, vol. 19, pp. 2209-2223, March 1999.
13. C Kayser, N K Logothetis, and S Panzeri, "Millisecond encoding precision of auditory cortex neurons," Proceedings of the National Academy of Sciences, vol. 107, pp. 16976-16981, September 2010.
14. T O Sharpee, C A Atencio, and C E Schreiner, "Hierarchical representations in the auditory cortex," Current Opinion in Neurobiology, vol. 21, no. 5, pp. 761-767, October 2011.
15. M Konishi, "Listening with two ears," Scientific American, vol. 268, pp. 66-73, 1993.
16. N E Schoppa, "Synchronization of olfactory bulb mitral cells by precisely timed inhibitory inputs," Neuron, vol. 49, no. 2, pp. 271-283, January 2006.
17. Z F Mainen and T J Sejnowski, "Reliability of spike timing in neocortical neurons," Science, vol. 268, pp. 1503-1506, June 1995.
18. G Ariav, A Polsky, and J Schiller, "Submillisecond precision of the input-output transformation function mediated by fast sodium dendritic spikes in basal dendrites of CA1 pyramidal neurons," The Journal of neuroscience, vol. 23, p. 7750, August 2003.
19. L M Chalupa, N Berardi, M Caleo, L Galli-Resta, and T Pizzorusso, Cerebral Plasticity: New Perspectives.: MIT Press, 2011.
20. A A George, A M Lyons-Warren, X Ma, and B A Carlson, "A Diversity of Synaptic Filters Are Created by Temporal Summation of Excitation and Inhibition," The Journal of Neuroscience, vol. 31, pp. 14721-14734, October 2011.
21. P Sterne, D MacKay, and S Wills. (2012) The Inference Group. Cavendish Laboratory, Cambridge. [Online]. www.inference.phy.cam.ac.uk/pjs67/sterne-2012- information-recall.pdf
22. R D Stewart and K N Gurney, "Spiking neural network simulation: memory-optimal synaptic event scheduling," Journal of Computational Neuroscience, vol. 30, pp. 1-8, 2011.
23. E Hairer, S P Norsett, and G Wanner, Solving Ordinary Differential Equations I and II.: Springer Verlag, 2010.
24. R Stewart and W Bair, "Spiking neural network simulation: numerical integration with the Parker-Sochacki method," Journal of Computational Neuroscience, vol. 27, no. 1, pp. 115-133, August 2009.
25. A Hanuschkin, S Kunkel, M Helias, A Morrison, and M Diesmann, "A general and efficient method for incorporating precise spike times in globally time-driven simulations," Frontiers in Neuroinformatics, vol. 4, October 2010.
26. E Kofman and S Junco, "Quantized-state systems: a DEVS Approach for continuous system simulation," Transactions of the Society for Computer Simulation International, vol. 18, no. 3, pp. 123-132, September 2001.
27. G L Grinblat, H Ahumada, and E Kofman, "Quantized state simulation of spiking neural networks," SIMULATION, vol. 88, no. 3, pp. 299- 313, March 2011.
28. G Zheng, A Tonnelier, and D Martinez, "Voltage-stepping schemes for the simulation of spiking neural networks," Journal of Computational Neuroscience, vol. 26, no. 3, pp. 409-423, 2009.
29. R Bulirsch and J Stoer, "Numerical treatment of ordinary differential equations by extrapolation methods," Numerische Mathematik, vol. 8, no. 1, pp. 1-13, 1966.
30. G E Parker and J S Sochacki, "Implementing the Picard iteration," Neural, Parallel & Scientific Computations, vol. 4, pp. 97-112, March 1996.
31. B Gaster, D R Kaeli, L Howes, and P Mistry, Heterogeneous Computing with OpenCL.: Morgan Kaufmann Pub, 2011.
32. J Sanders and E Kandrot, CUDA by example: an introduction to general-purpose GPU programming.: Addison-Wesley Professional, 2010.
33. R Arrabales, A Ledezma, and A Sanchis, "Towards conscious-like behavior in computer game characters,", 2009, pp. 217-224.
34. G Martinez, M Gardner, and W Feng, "CU2CL: A CUDA-to-OpenCL Translator for Multi-and Many-Core Architectures," phd thesis 2011.
35. E M Izhikevich, "Simple model of spiking neurons," IEEE Transactions on Neural Networks, vol. 14, pp. 1569-1572, 2003.
36. A Jeffrey and H H Dai, Handbook of mathematical formulas and integrals.: Academic Press, 2008.
37. Algorithms and theory of computation handbook: general concepts and techniques.: Chapman & Hall/CRC, 2010.
38. R Brette et al., "Simulation of networks of spiking neurons: A review of tools and strategies," Journal of Computational Neurscience, vol. 23, no. 3, pp. 349-398, 2007.
39. T Harada and L Howes. (2011, Dec.) Heterogeneous Compute. [Online]. http://www.heterogeneouscompute.org/wordpress/wpcontent/uploads/2011/06/ RadixSort.pdf
40. D G Merrill and A S Grimshaw, "Revisiting sorting for GPGPU stream architectures," in Proceedings of the 19th international conference on Parallel narchitectures and compilation techniques, 2010, pp. 545-546.
41. M Daga, A M Aji, and W Feng, "On the Efficacy of a Fused CPU+GPU Processor (or APU) for Parallel Computing," in Symposium on Application Accelerators in High-Performance Computing, 2011, pp. 141-149.