Stochastic resonance in continuous and spiking neuron models with Levy noise

IEEE Transactions on Neural Networks

Volumn 19, Issue 12, 2008, Pages 1993-2008

  Patel, Ashok ^a   Kosko, Bart ^a  

^a University of Southern California   (United States)

Author keywords

Jump diffusion; Levy noise; Mutual information; Neuron models; Signal detection

Indexed keywords

CIRCUIT RESONANCE; DIFFERENTIAL EQUATIONS; FUNCTIONS; LEARNING ALGORITHMS; MAGNETIC RESONANCE; NEURONS; RANDOM PROCESSES; RESONANCE; SIGNAL DETECTION; SIGNAL PROCESSING;

AND MODELS; BIT COUNTS; BROWNIAN NOISES; DRIFT VELOCITIES; JUMP DIFFUSION; LEVY NOISE; LIPSCHITZ CONDITIONS; MUTUAL INFORMATION; NEURON MODELS; NOISE PROCESSES; SIMULATION RESULTS; SPIKING NEURON MODELS; STOCHASTIC DIFFERENTIAL EQUATIONS; STOCHASTIC RESONANCES; SUB THRESHOLDS; SUBTHRESHOLD SIGNALS; TO MANY;

STOCHASTIC MODELS;

ACTION POTENTIAL; ANIMAL; ARTICLE; BIOLOGICAL MODEL; BIOLOGICAL RHYTHM; COMPUTER SIMULATION; HUMAN; NERVE CELL; NERVE CELL NETWORK; PHYSIOLOGY; STATISTICAL MODEL; STATISTICS; SYNAPTIC TRANSMISSION;

ACTION POTENTIALS; ANIMALS; BIOLOGICAL CLOCKS; COMPUTER SIMULATION; HUMANS; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NERVE NET; NEURONS; STOCHASTIC PROCESSES; SYNAPTIC TRANSMISSION;

EID: 57749092657     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2008.2005610     Document Type: Article

References (91)

1. H. Ahn and R. E. Feldman, "Optimal filtering of Gaussian signals in the presence of Levy noise," SIAM J. Appl. Math., vol. 60, no. 1, pp. 359-369, Nov. 1999.
2. S. Amari, "Neural theory of association and concept formation," Biol. Cybern., vol. 26, pp. 175-185, May 1977.
3. D. Applebaum, Levy Processes and Stochastic Calculus. Cambridge, U.K.: Cambridge Univ. Press, 2004.
4. O. Barndoff-Nielson and N. Shephard, "Non-Gaussian Ornstein-Uhlenbeck-based models and some of their uses in financial economics," J. Roy. Statist. Soc. B, vol. 63, no. 2, pp. 167-241, 2001.
5. S. M. Bezrukov and I. Vodyanov, "Noise-induced enhancement of signal transduction across voltage-dependent ion channels," Nature, vol. 378, no. 6555, pp. 362-364, Nov. 1995.
6. A. R. Bulsara, E. W. Jacobs, T. Zhou, F. Moss, and L. Kiss, "Stochastic resonance in a single neuron model: Theory and analog simulation," J. Theor. Biol., vol. 152, no. 4, pp. 531-555, Oct. 1991.
7. A. R. Bulsara, A. J. Maren, and G. Schmera, "Single effective neuron: Dendritic coupling effect and stochastic resonance," Biol. Cybern. vol. 70, no. 2, pp. 145-156, Dec. 1993.
8. A. R. Bulsara and A. Zador, "Threshold detection of wideband signals: A noise induced maximum in the mutual information," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 54, no. 3, pp. R2185-R2188, Sep. 1996.
9. J. Cao and J. Lu, "Adaptive synchronization of neural networks with and without time-varying delays," Chaos, vol. 16, pp. 013133-1-013133-6, Mar. 2006.
10. J. Cao, Z. Wang, and Y. Sun, "Synchronization in an array of linearly stochastically coupled networks with time delays," Physica A, vol. 385, pp. 718-728, Nov. 2007.
11. F. Chapeau-Blondeau, X. Godivier, and N. Chambet, "Stochastic resonance in a neuron model that transmits spike trains," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 53, no. 1, pp. 1273-1275, Jan. 1996.
12. F. Chapeau-Blondeau and D. Rousseau, "Noise-enhanced performance for an optimal Bayesian estimator," IEEE Trans. Signal Process., vol. 52, no. 5, pp. 1327-1334, May 2004.
13. F. Chapeau-Blondeau, S. Blanchard, and D. Rousseau, "Noise-enhanced fisher information in parallel arrays of sensors with saturation," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 74, pp. 0311021-03110210, Sep. 2006.
14. M. Chatterjee and M. E. Robert, "Noise enhances modulation sensitivity in cochlear implant listeners: Stochastic resonance in a prosthetic sensory system?," J. Assoc. Res. Otolaryngol., vol. 2, no. 2, pp. 159-171, Aug. 2001.
15. M. A. Cohen and S. Grossberg, "Absolute stability of global pattern formation and parallel memory storage by competitive neural networks," IEEE Trans. Syst. Man Cybern., vol. SMC-13, no. 5, pp. 815-826, Sep./Oct. 1983.
16. J. J. Collins, C. C. Chow, A. C. Capela, and T. T. Imhoff, "Aperiodic stochastic resonance in excitable systems," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 52, no. 4, pp. R3321-R3324, Oct. 1995.
17. J. J. Collins, C. C. Chow, A. C. Capela, and T. T. Imhoff, "Aperiodic stochastic resonance," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 54, no. 5, pp. 5575-5584, Nov. 1996.
18. J. J. Collins, T. T. Imhoff, and P. Grigg, "Noise enhanced information transmission in rat SA1 cutaneous mechanoreceptors via aperiodic stochastic resonance," J. Neurophysiol., vol. 76, pp. 642-645, Jul. 1996.
19. R. Cont and P. Tankov, Financial Modelling with Jump Processes. London, U.K.: Chapman and Hall/CRC Press, 2003.
20. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
21. G. Deco and B. Schurmann, "Stochastic resonance in the mutual information between input and output spike trains of noisy central neurons," Physica D, vol. 117, pp. 276-282, Jun. 1998.
22. T. Ditzinger, M. Stadler, D. Struber, and J. A. Kelso, "Noise improves three-dimensional perception: Stochastic resonance and other impacts of noise to the perception of autostereograms," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 62, no. 2, pp. 2566-2575, Aug. 2000.
23. J. K. Douglass, L. Wilkens, E. Pantazelou, and F. Moss, "Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance," Nature, vol. 365, pp. 337-340, Sep. 1993.
24. R. Durrett, Stochastic Calculus: A Practical Introduction. Boca Raton, FL: CRC Press, 1996.
25. R. Durrett, Probability: Theory and Examples. Belmont, CA: Duxbury Press, 2004.
26. R. A. FitzHugh, "Impulses and physiological states in theoretical models of nerve membrane," Biophys. J., vol. 1, pp. 445-466, Jul. 1961.
27. L. Gammaitoni, "Stochastic resonance and the dithering effect in threshold physical systems," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 52, no. 5, pp. 4691-4698, Nov. 1995.
28. W. Gerstner and W. M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge, U.K.: Cambridge Univ. Press, 2002.
29. M. T. Giraudo and L. Sacerdote, "Jump-diffusion processes as models of neuronal activity," BioSystems, vol. 40, no. 1-2, pp. 75-82, 1997.
30. M. Grigoriu, Applied Non-Gaussian Processes. Englewood Cliffs, NJ: Prentice-Hall, 1995.
31. B. S. Gutkin and G. B. Ermentrout, "Dynamics of membrane excitability determine interspike interval variability : A link between spike generation mechanism and cortical spike train statistics," Neural Comput., vol. 10, no. 5, pp. 1047-1065, Jul. 1998.
32. P. Hanggi, "Stochastic resonance in biology: How noise can enhance detection of weak signals and help improve biological information processing," Chemphyschem, vol. 3, pp. 285-290, Mar. 2002.
33. A. Hanssen and T. A. Oigard, "The normal inverse Gaussian distribution: A versatile model for heavy-tailed stochastic processes," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., May 2001, pp. 3985-3988.
34. A. L. Hodgkin and A. F. Huxley, "A quantitative description of membrane current and its application to conduction and excitation in nerve," J. Physiol., vol. 117, pp. 500-540, Aug. 1952.
35. N. Hohn and A. N. Burkitt, "Shot noise in leaky integrate-and-Fire neuron," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 63, pp. 031902-1-031902-11, Mar. 2001.
36. F. C. Hoppensteadt and E. M. Izhikevich, Weakly Connected Neural Networks. New York: Springer-Verlag, pp. 111-142.
37. J. J. Hopfield, "Neural networks with graded response have collective computational properties like those of two-state neurons," Proc. Nat. Acad. Sci., vol. 81, pp. 3088-3092, May 1984.
38. H. Huang and J. Cao, "Exponential stability analysis of uncertain stochastic neural networks with multiple delays," Nonlinear Anal.: Real World Appl., vol. 8, pp. 646-653, Apr. 2007.
39. M. E. Inchiosa, J. W. C. Robinson, and A. R. Bulsara, "Information-theoretic stochastic resonance in noise-floor limited systems: The case for adding noise," Phys. Rev. Lett., vol. 85, pp. 3369-3372, Oct. 2000.
40. F. Jaramillo and K. Wiesenfeld, "Mechanoelectrical transduction assisted by Brownian motion: A role for noise in the auditory system," Nature Neurosci., vol. 1, pp. 384-388, 1998.
41. P. Jung, A. Cornell-Bell, F. Moss, S. Kadar, J.Wang, and K. Showalter, "Noise sustained waves in subexcitable media: From chemical waves to brain waves," Chaos, vol. 8, no. 3, pp. 567-575, Sep. 1998.
42. A. Kalemanova, B. Schmid, and R. Werner, "The normal inverse Gaussian distribution for synthetic CDO pricing," J. Financial Derivatives vol. 14, pp. 80-93, 2007.
43. G. G. Karapetyan, "Application of stochastic resonance in gravitational-wave interferometer," Phys. Rev. D, Part. Fields, vol. 73, pp. 122003-1-122003-9, Jun. 2006.
44. S. A. Kassam, Signal Detection in Non-Gaussian Noise. New York: Springer-Verlag, 1988.
45. S. Kay, "Can detectability be improved by adding noise?," IEEE Signal Process. Lett., vol. 7, no. 1, pp. 8-10, Jan. 2000.
46. E. R. Kandel, J. H. Schwartz, and M. J. Thomas, Principles of Neuroscience, 4th revised ed. New York: McGraw-Hill, 2000, pp. 224-224.
47. A. F. Kohn, "Dendritic transformations on random synaptic inputs as measured from neuron's spike train-modeling and simulation," IEEE Trans. Biomed. Eng., vol. 36, no. 1, pp. 44-54, Jan. 1989.
48. B. Kosko, Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence. Englewood Cliffs, NJ: Prentice-Hall, 1991.
49. B. Kosko, Noise. New York: Viking/Penguin, 2006.
50. B. Kosko and S. Mitaim, "Stochastic resonance in noisy threshold neurons," Neural Netw., vol. 14, no. 6-7, pp. 755-761, Jun. 2003.
51. B. Kosko and S. Mitaim, "Robust stochastic resonance for simple threshold neurons," in Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., Sep. 27, 2004, vol. 70, pp. 031911-1-031911-10.
52. I. Y. Lee, X. Liu, C. Zhou, and B. Kosko, "Noise-enhanced detection of subthreshold signals with carbon nanotubes," IEEE Trans. Nanotechnol., vol. 5, no. 6, pp. 613-627, Nov. 2006.
53. J. E. Levin and J. P. Miller, "Broadband neural encoding in the cricket cercal sensory system enhanced by stochastic resonance," Nature, vol. 380, pp. 165-168, Mar. 1996.
54. B. Lindner, A. Longtin, and A. R. Bulsara, "Analytic expressions for rate and CV of a type I neuron driven by white Gaussian noise," Neural Comput., vol. 15, pp. 1761-1788, Aug. 2003.
55. B. Lindner, J. Garcia-Ojalvo, A. Neiman, and L. Schimansky-Geier, "Effects of noise in excitable systems," Phys. Rep., vol. 392, pp. 321-424, Mar. 2004.
56. A. Longtin, "Autonomous stochastic resonance in bursting neurons," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 55, no. 1, pp. 868-876, Jan. 1997.
57. X. Mao, Stochastic Differential Equations and their Applications. Chichester, U.K.: Horwood, 1997.
58. M. D. McDonnell, N. Stocks, C. E. M. Pearce, and D. Abbott, "Quantization in the presence of large amplitude threshold noise," Fluctuation Noise Lett., vol. 5, no. 3, pp. L457-L468, Sep. 2005.
59. C. Mead, Analog VLSI and Neural Systems. Reading, MA: Addison-Wesley, 1989.
60. S. Mitaim and B. Kosko, "Adaptive stochastic resonance," Proc. IEEE vol. 86, Special Issue on Intelligent Signal Processing, no. 11, pp. 2152-2183, Nov. 1998.
61. S. Mitaim and B. Kosko, "Adaptive stochastic resonance in noisy neurons based on mutual information," IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1526-1540, Nov. 2004.
62. F. Moss, L. M. Ward, and W. G. Sannita, "Stochastic resonance and sensory information processing: A tutorial and review of applications," Clin. Neurophysiol., vol. 115, no. 2, pp. 267-281, Feb. 2004.
63. C. L. Nikias and M. Shao, Signal Processing with Alpha-Stable Distributions and Applications. New York: Wiley, 1995.
64. A. Pacut, "Separation of deterministic and stochastic neurotransmission," in Proc. Int. Joint Conf. Neural Netw., Jul. 2001, vol. 1, pp. 55-60.
65. A. Patel and B.Kosko, "Stochastic resonance in noisy spiking retinal and sensory neuron models," Neural Netw., vol. 18, pp. 467-478, Aug. 2005.
66. A. Patel and B.Kosko, "Mutual-information noise benefits in Brownian models of continuous and spiking neuron models," in Proc. Int. Joint Conf. Neural Netw., Jul. 2006, pp. 2347-2354.
67. O. V. Poliannikov, Y. Bao, and H. Krim, "Levy processes for image modelling," in Proc. IEEE Signal Process. Workshop Higher-Order Statist., Caesarea, Israel, Jun. 14-16, 1999, pp. 233-236.
68. S. I. Resnick, Heavy-Tail Phenomena: Probabilistic and Statistical Modeling. New York: Springer-Verlag, 2007.
69. D. Rousseau, J. Rojas Varela, and F. Chapeau-Blondeau, "Stochastic resonance for nonlinear sensors with saturation," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 67, no. 2, pp. 0211021-02110216, Feb. 2003.
70. D. Rousseau and F. Chapeau-Blondeau, "Neuronal signal transduction aided by noise at threshold and at saturation," Neural Process. Lett., vol. 20, no. 2, pp. 71-83, Nov. 2004.
71. D. Rousseau and F. Chapeau-Blondeau, "Constructive role of noise in signal detection from parallel array of quantizers," Signal Process. vol. 85, no. 3, pp. 571-580, Mar. 2005.
72. D. Rousseau, G. V. Anand, and F. Chapeau-Blondeau, "Noise-enhanced nonlinear detector to improve signal detection in non-Gaussian noise," Signal Process., vol. 86, no. 11, pp. 3456-3465, Nov. 2006.
73. T. Rydberg, "The normal inverse Gaussian Levy processes: Simulation and approximation," Commun. Statist.: Stochastic Models, vol. 13, pp. 887-910, 1997.
74. L. Sacerdote and R. Sirovich, "Multimodality of the interspike interval distribution in a simple jump-diffusion model," Scientiae Mathematicae Japonicae, vol. 58, no. 2, pp. 307-322, Sep. 2003.
75. Y. Sakumara and K. Aihara, "Stochastic resonance and incidence detection in single neuron," Neural Process. Lett., vol. 16, pp. 235-242, Dec. 2002.
76. G. Samorodnitsky and M. S. Taqqu, Stable Non-Gaussian Random Processes: Stochastic Models with Infinite Variance. London, U.K.: Chapman & Hall/CRC Press, 1994.
77. K-I. Sato, Levy Processes and Infinitely Divisible Distributions. Cambridge, U.K.: Cambridge Univ. Press, 1999.
78. W. Schoutens, Levy Processes in Finance: Pricing Financial Derivatives. New York: Wiley, 2003.
79. W. Schoutens, "Exotic options under Levy models: An overview," J. Comput. Appl. Math., vol. 189, no. 1, pp. 526-538, May 2006.
80. R. Segev, M. Benveniste, E. Hulata, N. Cohen, A. Palevski, E. Kapon, Y. Shapira, and E. Ben-Jacob, "Long term behavior of lithographically prepared in vitro neuronal networks," Phys. Rev. Lett., vol. 88, no. 11, pp. 118102-1-118102-4, Mar. 2002.
81. M. F. Shlesinger, G. M. Zaslavskii, and U. Frisch, Eds., "Levy flights and related topics in physics," in Lecture Notes in Physics, ser. 450. Berlin, Germany: Springer-Verlag.
82. O. Sotolongo-Costa, J. C. Antoranz, A. Posadas, F. Vidal, and A. Vazquez, "Lévy flights and earthquakes," Geophys. Res. Lett., vol. 27, pp. 1965-1967, Jul. 2000.
83. W. C. Stacey and D. M. Durand, "Stochastic resonance improves signal detection in hippocampal CA1 neurons," J. Neurophysiol., vol. 83, pp. 1394-1402, Sep. 2001.
84. N. G. Stocks, "Information transmission in parallel threshold arrays: Suprathreshold stochastic resonance," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 63, no. 4, pp. 041114-1-041114-9, Mar. 2001.
85. N. G. Stocks, D. Appligham, and R. P. Morse, "The application of suprathreshold stochastic resonance to cochlear implant coding," Fluctuation Noise Lett., vol. 2, no. 3, pp. L169-L181, Sep. 2002.
86. Y. Sun and J. Cao, "Adaptive lag synchronization of unknown chaotic delayed neural networks with noise perturbations," Phys. Lett. A, Gen. Phys., vol. 364, pp. 277-285, Apr. 2007.
87. Z. Wang, Y. Liu, M. Li, and X. Liu, "Stability analysis for stochastic Cohen-Grossberg neural networks with mixed time delays," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 814-820, May 2006.
88. Z. Wang, Y. Liu, K. Fraser, and X. Liu, "Stochastic stability of uncertain Hopfield neural networks with discrete and distributed delays," Phys. Lett. A, Gen. Phys., vol. 354, no. 4, pp. 288-297, Jun. 2006.
89. K. Wiesenfeld and F. Moss, "Stochastic resonance and the benefits of noise: From ice ages to crayfish and SQUIDS," Nature, vol. 373, pp. 33-36, Jan. 1995.
90. W. Yu and J. Cao, "Synchronization control of stochastic delayed neural network," Physica A, vol. 373, pp. 252-260, Jan. 2007.
91. F. G. Zeng, Q. J. Fu, and R. Morse, "Human hearing enhanced by noise," Brain Res., vol. 869, no. 1-2, pp. 251-255, Jun. 2000.