Precision constrained stochastic resonance in a feedforward neural network

IEEE Transactions on Neural Networks

Volumn 16, Issue 1, 2005, Pages 250-262

  Mtetwa, Nhamoinesu ^a   Smith, Leslie S ^a  

^a UNIVERSITY OF STIRLING   (United Kingdom)

Author keywords

Fisher information; Leaky integrate and fire (LIF); Limited resolution; Signal to noise ration (SNR); Stochastic resonance (SR)

Indexed keywords

COMPUTER SIMULATION; FIELD PROGRAMMABLE GATE ARRAYS; INFORMATION THEORY; MATHEMATICAL MODELS; OPTIMIZATION; SIGNAL TO NOISE RATIO;

FISCHER INFORMATION; LIMITED RESOLUTION; STOCHASTIC RESONANCE;

FEEDFORWARD NEURAL NETWORKS;

ACTION POTENTIAL; ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BIOMIMETICS; COMPARATIVE STUDY; COMPUTER SIMULATION; EVALUATION; FEEDBACK SYSTEM; HUMAN; METHODOLOGY; NERVE CELL; NERVE CELL NETWORK; PHYSIOLOGY; STATISTICAL MODEL; STATISTICS; SYNAPTIC TRANSMISSION;

ACTION POTENTIALS; ANIMALS; BIOMIMETICS; COMPUTER SIMULATION; FEEDBACK; HUMANS; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; STOCHASTIC PROCESSES; SYNAPTIC TRANSMISSION;

EID: 13844312440     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2004.836195     Document Type: Article

References (53)

1. J. S. Anderson, I. Lampl, D. C. Gillespie, and D. Ferster, "The contribution of noise to contrast invariance of orientation tuning in cat visual cortex," Science, vol. 290, pp. 1968-1972, Dec. 2000.
2. M. Aubury, I. Page, G. Randall, J. Saul, and R. Watts, Handel-C Language Reference Guide. London, U.K.: Oxford Univ. Press, 1996.
3. M. J. Barber and B. K. Dellen, "Noise-induced signal enhancement in heterogeneous neural networks," in Proc. Computational Science - ICCS 2001: Int. Conf., vol. 2074, San Francisco, CA, pp. 996-1000.
4. M. Barbi, S. Chillemi, and A. D. Garbo, "The leaky integrate-and-fire neuron: A useful tool to investigate SR," Chaos Solitons Fractals vol. 11, no. 12, pp. 1273-1275, 2000.
5. R. Benzi, G. Parisi, A. Sutera, and A. Vulpiani, "Stochastic resonance in climatic changes," Tellus, vol. 34, pp. 10-16, 1982.
6. G. Bostock, FPGAs and Programmable LSI. London, U.K.: Butterworth, 1996.
7. A. R. Bulsara and A. Zador, "Threshold detection of wideband signals: A noise induced maximum in the mutual information," Phys. Rev. E, vol. 54, no. 3, pp. 2185-2188, 1996.
8. F. Chapeau-Blondeau, "Noise-enhanced capacity via stochastic resonance in asymmetric binary channel," Phys. Rev. E, vol. 55, no. 4, pp. 2106-2109, 1997.
9. F. Chapeau-Blondeau and X. Godivier, "The theory of stochastic resonance in signal transmission by static nonlinear systems," Phys. Rev. E, vol. 55, pp. 1478-1495, 1997.
10. F. Chapeau-Blondeau, X. Godivier, and N. Chambet, "Stochastic resonance in a neuronal model that transmits spike trains," Phys. Rev. E, vol. 53, pp. 1273-1275, 1996.
11. J. J. Collins, C. C. Chow, A. C. Capela, and T. T. Imhoff, "Aperiodic stochastic resonance," Phys. Rev. E, vol. 54, pp. 5575-5584, 1996.
12. J. J. Collins, C. C. Chow, and T. T. Imhoff, "Aperiodic stochastic resonance in excitable systems," Phys. Rev. E, vol. 52, pp. 3321-3324, 1995.
13. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
14. P. Dayan and L. F. Abbott, Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. Cambridge, MA: MIT Press, 2001.
15. J. K. Douglas, L. Wilkens, E. Pantazelou, and F. Moss, "Noise enhancement of information transfer in crayfish mechanoreceptor by stochastic resonance," Nature, vol. 365, pp. 337-340, 1993.
16. S. Fauve and F. Heslot, "Stochastic resonance in a bistable system," Phys. Lett., vol. 97A, pp. 5-7, 1983.
17. L. Gammaitoni, P. Hanggi, P. Jung, and P. Marchesoni, "Stochastic resonance," Rev. Mod. Phys., vol. 70, pp. 223-287, 1998.
18. Z. Gingl, L. B. Kiss, and F. Moss, "Non-dynamical stochastic resonance: Theory and experiments with white and various colored noise," Europhys. Lett., vol. 29, no. 3, pp. 191-196, 1995.
19. M. A. Glover, A. Hamilton, and L. S. Smith, "Analogue VLSI leaky integrate-and-fire neurons and their use in a sound analysis system," in Proc. Analog Integrated Circuits and Signal Processing, Special Issue: Microelectronics for Bio-Inspired Systems (Selected Papers from MicroNeuro'99 Conference), vol. 30, 1999, pp. 91-100.
20. G. P. Harmer and D. Abbott, "Motion detection and stochastic resonance in noisy environments," Microeletron. J., vol. 32, no. 12, pp. 959-967, 2001.
21. C. Heneghan, C. C. Chow, J. J. Collins, T. T. Imhoff, S. B. Lowen, and M. C. Teich, "Information measure quantifying aperiodic stochastic resonance," Phys. Rev. E., vol. 54, no. 3, pp. R2228-R2231, 1996.
22. T. Hoch, G. Wenning, and K. Obermayer, "Adaptation using local information for maximizing the global cost," Neurocomput., vol. 52-4, pp. 541-546, 2003.
23. N. Hohn and A. N. Burkitt, "Modeling the neural response to speech: Stochastic resonance and coding of vowel-like stimuli," in Proc. IEEE EMBS Conf., 2001, pp. 21-24.
24. M. E. Inchiosa and A. R. Bulsara, "Signal detection statistics for stochastic resonators," Phys. Rev. E, vol. 53, no. 3, pp. 2021-2024, 1996.
25. F. Jaramillo and K. Weisenfeld, "Physiological noise enhances mechanoelectrical trasduction in hair cells," Chaos Solitons Fractals, vol. 11, pp. 1869-1874, 2000.
26. P. E. Kloeden, E. Platen, and H. Schurz, Numerical Solution of SDE Through Computer Experiments. New York: Springer-Verlag, 1997.
27. C. Koch, Biophysics of Computation. NY: Oxford Univ. Press, 1999.
28. Methods in Neural Modeling: From Ions to Networks, second ed., C. Koch and I. Segev, Eds., MIT Press, Cambridge, MA, 1999.
29. J. E. Levin and J. P. Miller, "Broadband neural encoding in the cricket cercal sensory system enhanced by stochastic resonance," Nature, vol. 380, pp. 165-168, Mar. 1996.
30. A. Longtin, A. Bulsara, and F. Moss, "Time-interval sequences in bistable systems and noise-induced transmission of information by sensory neurons," Phys. Rev. Lett., vol. 67, pp. 656-659, 1991.
31. D. G. Luchinsky, R. Mannella, P. V. E. McClintock, and N. G. Stocks, "Stochastic resonance in electrical circuits II. Nonconventional stochastic resonance," IEEE Trans. Circuits Syst. II. Exp. Briefs vol. 46, no. 9, pp. 1215-1224, Sep. 1999.
32. R. Mannela and V. Palleschi, "Fast and precise algorithm for computer simulation of stochastic differential equations," Phys. Rev. A, vol. 40, no. 6, pp. 3381-3386, Sep. 1989.
33. M. D. McDonnell, D. Abbott, and C. E. M. Pearce, "An analysis of noise enhanced information transmission in an array of comparators," Microeletron. J., vol. 33, no. 12, pp. 1079-1089, 2002.
34. S. Mitaim and B. Kosko, "Adaptive stochastic resonance," Proc IEEE: Special Issue on Intelligent Signal Processing, vol. 86, no. 11, pp. 2152-2183, Nov. 1998.
35. T. Mori and S. Kai, "Noise-induced entrainment and stochastic resonance in human brain waves," Phys. Rev. Lett., vol. 88, no. 218101, pp. 1-4, 2002.
36. N. Mtetwa, L. S. Smith, and A. Hussain, "Stochastic resonance and finite resolution in a network of leaky integrate-and-fire neurons," in Proc. Artificial Neural Networks - ICANN '02. Madrid, Spain, Aug. 2002, pp. 117-122.
37. N. Mtetwa, L. S. Smith, and A. Hussain, "Stochastic resonance and finite resolutions in a leaky integrate-and-fire neuron," in Proc. Eur. Symp. Artificial Neural Networks ESANN'02, Bruges, Belgium, pp. 343-348.
38. D. Petracchi, I. C. Gebeshuber, L. J. DeFelice, and A. V. Holden, "Stochastic resonance in biologocal systems," Chaos Solitons Fractals, vol. 11, pp. 1819-1822, 2000.
39. D. Rousseau, F. B. Duan, and F. Chapeau-Blondeau, "Suprathreshold stochastic resonance and noise-enhanced Fisher information in arrays of threshold devices," Phys. Rev. E, vol. 68, no. 3, 2003.
40. H. S. Seung and H. Sompolinsky, "Simple models for reading neuronal population codes," Proc. Nat. Acad. Sci. USA, vol. 90, pp. 10749-10753, 1993.
41. G. M. Shepherd, Neurobiology, 2nd ed. London, U.K.: Oxford Univ. Press, 1988.
42. T. Shimokawa, A. Rogel, K. Pakdaman, and S. Sato, "Stochastic resonance and spike timing in an ensemble of leaky integrate-and-fire neurons model," Phys. Rev. E, vol. 59, no. 3, pp. 3461-3470, Mar. 1999.
43. M. Stemmler, "A single spike suffices: The simplest form of stochastic resonance in model neurons," Network: Computat. Neural Syst., vol. 7, no. 4, pp. 687-716, Nov. 1996.
44. N. G. Stocks, "Suprathreshold stochastic resonance in multilevel threshold systems," Phys. Rev. Lett., vol. 84, pp. 2310-2314, 2000.
45. N. G. Stocks, "Information transmission in parallel arrays of threshold elements: Suprathreshold stochastic resonance," Phy. Rev. E, vol. 63, no. 041114, pp. 1-9, 2001.
46. N. G. Stocks, D. Allinghamm, and R. P. Morse, "The application of suprathreshold stochastic resonance to cochlear implant coding," J. Fluctuation Noise Lett., vol. 2, no. 3, pp. L169-181, 2002.
47. M. Usher and M. Feingold, "Stochastic resonance in the speed of memory retrieval," Biol Cybern., vol. 83, pp. L11-L16, 2000.
48. K. Weisenfeld and F. Moss, "Stochastic resonance and the benefits of noise: From ice ages to the crayfish and squids," Nature, vol. 373, pp. 33-36, 1995.
49. K. Wiesenfeld and F. Jaramillo, "Minireview of stochastic resonance," Chaos, vol. 8, pp. 539-548, 1998.
50. H. A. Wild and T. A. Busey, "Seeing faces in the noise: Stochastic activity in perceptual regions of the brain may influence perception of ambiguous stimuli," Psychonom. Bulletin Rev., 2003, to be published.
51. Virtex 2.5 V Field Programmable Gate Arrays, Xilinx, 1999.
52. L. Zalanyi, F. Bazso, and P. Erdi, "The effect of synaptic depression on stochastic resonance," Neurocomput., vol. 38-40, pp. 459-465, 2001.
53. F. G. Zeng, O. J. Fu, and R. Morse, "Human hearing enhanced by noise," Brain Res., vol. 869, pp. 251-255, 2000.