Configurable hardware integrate and fire neurons for sparse approximation

Neural Networks

Volumn 45, Issue , 2013, Pages 134-143

  Shapero, Samuel ^a   Rozell, Christopher ^a   Hasler, Paul ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

FPAA; Integrate and fire neurons; LCA; Nonlinear optimization; Sparse approximation

Indexed keywords

FPAA; INTEGRATE-AND-FIRE NEURONS; LCA; NON-LINEAR OPTIMIZATION; SPARSE APPROXIMATIONS;

APPROXIMATION ALGORITHMS; IMAGE PROCESSING; LIFE CYCLE; NEURAL NETWORKS; NEURONS; OPTIMIZATION;

SOLUTION MINING;

ARTICLE; CODING; CONTROLLED STUDY; INTEGRATED CIRCUIT; LAB ON A CHIP; MATHEMATICAL COMPUTING; NERVE CELL NETWORK; NERVE CONDUCTION; NONLINEAR SYSTEM; PRIORITY JOURNAL; SIGNAL PROCESSING; SPARSE APPROXIMATION; SPARSE CODING; STATISTICAL CONCEPTS;

FPAA; INTEGRATE AND FIRE NEURONS; LCA; NONLINEAR OPTIMIZATION; SPARSE APPROXIMATION;

ACTION POTENTIALS; ALGORITHMS; ANIMALS; COMPUTERS, ANALOG; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS;

EID: 84880825534     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2013.03.012     Document Type: Article

References (32)

1. Andrecut M. Fast GPU implementation of sparse signal recovery from random projections. Engineering Letters 2009, 17(3):151-158.
2. Bajwa W., Haupt J., Sayeed A., Nowak R. Compressed channel sensing: A new approach to estimating sparse multipath channels. Proceedings of the IEEE 2010, 98(6):1058-1076. 10.1109/JPROC.2010.2042415.
3. Balavoine A., Romberg J., Rozell C. Convergence and rate analysis of neural networks for sparse approximation. IEEE Transactions on Neural Networks and Learning Systems 2012, 23(9):1377-1389.
4. Barlow H.B. Possible principles underlying the transformation of sensory messages. Sensory communication 1961, M.I.T. Press, Cambridge MA. W. Rosenblith (Ed.).
5. Borghi A., Darbon J., Peyronnet S., Chan T.F., Osher S. A simple compressive sensing algorithm for parallel many-core architectures. Journal of Signal Processing Systems 2012, 1-20.
6. Brink S., Nease S., Ramakrishnan S., Wunderlich R., Hasler P., Basu A., et al. A learning-enabled neuron array IC based upon transistor channel models of biological phenomena. IEEE Transactions on Biomedical Circuits and Systems 2013, 7(1):71-81.
7. Candès E.J., Romberg J., Tao T. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on Information Theory 2006, 52(2):489-509. 10.1109/TIT.2005.862083.
8. Chen S., Donoho D., Saunders M. Atomic decomposition by basis pursuit. SIAM Review 2001, 43(1):129-159.
9. Elad, M., Figueiredo, M., & Ma, Y. (2010). On the role of sparse and redundant representations in image processing. In: IEEE proceedings - special issue on applications of sparse representation & compressive sensing, vol.98 (pp. 972-982).
10. Gao P., Benjamin B., Boahen K. Dynamical system guided mapping of quantitative neuronal models onto neuromorphic hardware. IEEE Transactions on CIrcuits and Systems 2012, 59(10):2383-2394.
11. Gerstner W., Kistler W. Spiking neuron models 2002, Cambridge University Press, Cambridge, UK.
12. Haider B., Krause M., Duque A., Yu Y., Touryan J., Mazer J., et al. Synaptic and network mechanisms of sparse and reliable visual cortical activity during nonclassical receptive field stimulation. Neuron 2010, 65(1):107-121.
13. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences 1982, 79(8):2554-2558.
14. Indiveri G., Linares-Barranco B., Hamilton T.J., van Schaik A., Etienne-Cummings R., Delbruck T., et al. Neuromorphic silicon neuron circuits. Frontiers in Neuroscience 2011, 5(73). 10.3389/fnins.2011.00073.
15. Johnson D.H. Point process models of single-neuron discharges. Journal of Computational Neuroscience 1996, 3:275-299.
16. Kim S.-J., Koh K., Lustig M., Boyd S., Gorinevsky D. A interior-point method for large scale l1-regularized least squares. IEEE Journal on Selcted Topics in Signal Processing 2007, 1(4):606-617.
17. Koziol, S., Schlottmann, C., Basu, A., Brink, S., Petre, C., & Degnan, B. et al. (2010). Hardware and software infrastructure for a family of floating-gate based FPAAs. In: Proceedings of the 2010 IEEE international symposium on circuits and systems (pp. 2794-2797).
18. Mattingley J., Boyd S. Real-time convex optimization in signal processing. IEEE Signal Processing Magazine 2010, 27(3):50-61.
19. Mead C. Analog VLSI and neural systems 1989, Addison Wesley.
20. Olshausen B., Field D. Emergence of simple-cell receptive field properties by learning in a sparse code for natural images. Nature 1996, 381:607-609.
21. Olshausen B., Lewicki M., et al. Sparse codes and spikes. Probabilistic models of the brain: perception and neural function 2001, 257-272.
22. Rozell C., Johnson D., Baraniuk R., Olshausen B. Sparse coding via thresholding and local competition in neural circuits. Neural Computation 2008, 20(10):2526-2563.
23. Schemmel, J., Brüderle, D., Meier, K., & Ostendorf, B. (2007). Modeling synaptic plasticity within networks of highly accelerated I&F neurons. In: Proceedings of 2007 IEEE international symposium on circuits and systems (ISCAS) (pp. 3367-3370).
24. Schlottmann C., Hasler P. A highly dense, low power, programmable analog vector-matrix multiplier: the FPAA implementation. IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS) 2011, 1(3):403-411. 10.1109/JETCAS.2011.2165755.
25. Schlottman C., Shapero S., Nease S., Hasler P. A digitally enhanced dynamically reconfigurable analog platform for low-power signal processing. IEEE Journal of Solid-State Circuits 2012, 47(9):2174-2184.
26. Shapero, S., Brüderle, D., Hasler, P., & Rozell, C. (2011). Sparse approximation on a network of locally competitive integrate and fire neurons. In: Computational and synstems neuroscience (COSYNE) conference.
27. Shapero S., Charles A., Rozell C.J., Hasler P. Low power sparse approximation on reconfigurable analog hardware. IEEE Journal of Emerging and Special Topics in Circuits and Systems (JETCAS) 2012, 2(3):530-541.
28. Shapero S., Hasler P. Neuromorphic hardware for rapid sparse coding. Biomedical circuits and systems conference, 2012 2012, 396-399. IEEE.
29. Shapero S., Hasler P. Precise programming and mismatch compensation for low power analog computation on an FPAA. IEEE Transaction on Circuits and Systems I: Regular Papers 2013, 60(3):548-556.
30. Vasanawala S.S., Alley M.T., Hargreaves B.A., Barth R.A., Pauly J.M., Lustig M. Improved pediatric mr imaging with compressive sensing. Radiology 2010, 256:607-616.
31. Wright J., Ma Y., Mairal J., Sapiro G., Huang T., Yan S. Sparse representation for computer vision and pattern recognition. Proceedings of the IEEE 2010, 98(6):1031-1044.
32. Zhu M., Rozell C.J. Sparse coding models demonstrate some non-classical receptive field effects. BMC Neuroscience 2010, 11:21.