Stochastic pooling networks: A biologically inspired model for robust signal detection and compression

2008 3rd International Conference on Bio-Inspired Computing: Theories and Applications, BICTA 2008

Volumn , Issue , 2008, Pages 75-81

  McDonnell, Mark D ^a   Amblard, Pierre Olivier ^b   Stocks, Nigel G ^c  

^a UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

^b GIPSA LAB   (France)

^c UNIVERSITY OF WARWICK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC INTENSITY; INFORMATION THEORY; NEURONS; QUALITY ASSURANCE; REDUNDANCY; RELIABILITY; SIGNAL PROCESSING; SIGNAL TRANSDUCTION; STOCHASTIC MODELS; SYSTEMS ENGINEERING;

ANALOG SIGNALS; BIO-INSPIRED; BIOLOGICALLY INSPIRED; COMMON FEATURES; COMPUTING PARADIGMS; CONCEPTUAL FRAMEWORKS; INDIVIDUAL NETWORKS; LOCAL COMPRESSIONS; LOSSY COMPRESSIONS; MUTUAL INFORMATIONS; NETWORK PERFORMANCES; NONLINEAR INTERACTIONS; PROBABILITY OF ERRORS; QUANTIZATION NOISES; RATE DISTORTIONS; ROBUST SIGNAL DETECTIONS; SENSORY NEURONS; SMALL INPUTS;

METROPOLITAN AREA NETWORKS;

EID: 57849099297     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BICTA.2008.4656707     Document Type: Conference Paper

References (43)

1. A. Moini, A. Bouzerdoum, K. Eshraghian, A. Yakovleff, X. T. Nguyen, A. Blanksby, R. Beare, D. Abbott, and R. E. Bogner, "An insect vision based motion detection chip," IEEE Journal of Solid-State Circuits, vol. 32, no. 2, pp. 279-283, 1997.
2. A. C. Coolen and V. D. Prete, "Statistical mechanics beyond the Hopfield model: Solvable problems in neural network theory," Reviews in the Neurosciences, vol. 14, pp. 181-193, 2003.
3. J. M. Benyus, Biomimicry: Innovation Inspired by Nature. Harper Perennial, 1997.
4. E. Altman, P. Dini, D. Miorandi, and D. Schreckling (eds.), "Paradigms and foundations of bionets research," BIONETS Consortium, Tech. Rep. BIONETS//wp2.1/1.0 Deliverable, 2007.
5. P. Forbes, The Gecko's Foot: Bio-inspiration - Engineered from Nature. Fourth Estate, London, 2005.
6. S. B. Laughlin, "Energy as a constraint on the coding and processing of sensory information," Current Optinion in Neurobiology, vol. 11, pp. 475-480, 2001.
7. F. Rieke, D. Warland, R. de Ruyter van Steveninck, and W. Bialek, Spikes: Exploring the Neural Code. MIT Press, Cambridge, MA., 1997.
8. S. Zozor, P. Amblard, and C. Duchêne, "On pooling networks and fluctuation in suboptimal detection framework," Fluctuation and Noise Letters, vol. 7, pp. L39-L60, 2007.
9. P. O. Amblard, S. Zozor, N. G. Stocks, and M. D. McDonnell, "Pooling networks for a discrimination task: noise-enhanced detection," in Proc. SPIE Noise and Fluctuations in Biological, Biophysical, and Biomedical Systems, S. M. Bezrukov, Ed., vol. 6602, 2007, p. 66020S.
10. M. D. McDonnell, "Applying stochastic signal quantization theory to the robust digitization of noisy analog signals," in Applications of Nonlinear Dynamics: Model and Design of Complex Systems, V. In, P. Longhini, and A. Palacios, Eds. Springer, 2009.
11. M. D. McDonnell, N. G. Stocks, and P. O. Amblard, "Stochastic pooling networks," 2008, manuscript submitted to Journal of Statistical Mechanics: Theory and Experiment.
12. N. G. Stocks, D. Allingham, and R. P. Morse, "The application of suprathreshold stochastic resonance to cochlear implant coding," Fluctuation and Noise Letters, vol. 2, no. 3, pp. L169-L181, 2002.
13. M. D. McDonnell, "Signal compression in biological sensory systems: Information theoretic performance limits," in Proc. SPIE BioMEMS and Nanotechnology III, Melbourne, Australia, 4-7 December, D. V. Nicolau, D. Abbott, K. Kalantar-Zadeh, T. D. Matteo, and S. M. Bezrukov, Eds., vol. 6799, 2007, p. 679913.
14. -, "Reliable communication and sensing via parallel redundancy in noisy digital receiverss," in Proc. Australian Communications Theory Workshop (IEEE), Christchurch, New Zealand, Jan 30-Feb 1, 2008, pp. 23-28.
15. F. Martorell, M. D. McDonnell, A. Rubio, and D. Abbott, "Using noise to break the noise barrier in circuits," in Proc. SPIE Smart Structures, Devices, and Systems II, S. F. Al-Sarawi, Ed., vol. 5649, 2005, pp. 53-66.
16. F. Martorell and A. Rubio, "Cell architecture for nanoelectronic design," Microelectronics Journal, vol. 39, pp. 1041-1050, 2008.
17. T. Berger, Z. Zhang, and H. Viswanathan, "The CEO problem," IEEE Transactions on Information Theory, vol. 42, no. 3, pp. 887-902, 1996.
18. K. Liu and A. M. Sayeed, "Type-based decentralized detection in wireless sensor networks," IEEE Transactions on Signal Processing, vol. 55, pp. 1899-1910, 2007.
19. F. Li and J. S. Evans, "Optimal strategies for distributed detection over multiaccess channels," in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, March 31-April 4, 2008, pp. 2417-2420.
20. O. Oliaei, "Stochastic resonance in sigma-delta modulators," Electronics Letters, vol. 39, no. 2, pp. 173-174, 2003.
21. M. D. McDonnell, D. Abbott, and C. Pearce, "Neural mechanisms for analog to digital conversion," in Proc. SPIE BioMEMS and Nanoengineering, D. V. Nicolau, Ed., vol. 5275, 2003, pp. 278-286.
22. T. Nguyen, "Robust data-optimized stochastic analog-to-digital converters," IEEE Transactions on Signal Processing, vol. 55, no. 6, pp. 2735-2740, 2007.
23. N. G. Stocks, "Suprathreshold stochastic resonance in multilevel threshold systems," Physical Review Letters, vol. 84, no. 11, pp. 2310-2313, 2000.
24. T. Hoch, G. Wenning, and K. Obermayer, "Optimal noise-aided signal transmission through populations of neurons," Physical Review E, vol. 68, no. 3, p. 011911, 2003.
25. M. D. McDonnell, N. G. Stocks, C. E. M. Pearce, and D. Abbott, Stochastic Resonance: From Suprathreshold Stochastic Resonance to Stochastic Signal Quantisation. Cambridge University Press, 2008.
26. K. Wiesenfeld and F. Moss, "Stochastic resonance and the benefits of noise: From ice ages to crayfish and SQUIDS," Nature, vol. 373, no. 6509, pp. 33-36, 1995.
27. L. Gammaitoni, P. Hänggi, P. Jung, and F. Marchesoni, "Stochastic resonance," Reviews of Modern Physics, vol. 70, no. 1, pp. 223-287, 1998.
28. B. Kosko, Noise. Viking, 2006.
29. S. Kay, "Can detectability be improved by adding noise?" IEEE Signal Processing Letters, vol. 7, no. 1, pp. 8-10, 2000.
30. H. Chen, P. K. Varshney, S. M. Kay, and J. H. Michels, "Theory of the stochastic resonance effect in signal detection: Part I-fixed detectors," IEEE Transactions on Signal Processing, vol. 55, pp. 3172-3184, 2007.
31. G. P. Harmer, B. R. Davis, and D. Abbott, "A review of stochastic resonance: Circuits and measurement," IEEE Transactions on Instrumentation and Measurement, vol. 51, no. 2, pp. 299-309, 2002.
32. S. Zozor and P.-O. Amblard, "Noise-aided processing: revisiting dithering in a sigma-delta quantizer," IEEE Transactions on Signal Processing, vol. 53, pp. 3202-3210, 2005.
33. S. Mitaim and B. Kosko, "Adaptive stochastic resonance," Proceedings of the IEEE, vol. 86, no. 11, pp. 2152-2183, 1998.
34. L. Gammaitoni, M. Locher, A. Bulsara, P. Hänggi, J. Neff, K. Wiesenfeld, W. Ditto, and M. E. Inchiosa, "Controlling stochastic resonance," Physical Review Letters, vol. 82, no. 23, pp. 4574-4577, 1999.
35. S. Mitaim and B. Kosko, "Adaptive stochastic resonance in noisy neurons based on mutual information," IEEE Transactions on Neural Networks, vol. 15, pp. 1526-1540, 2004.
36. V. Anantharam and V. S. Borkar, "An information theoretic view of stochastic resonance," in Proc. IEEE International Symposium on Information Theory. Nice, France, 2007, pp. 966-970.
37. M. D. McDonnell, N. G. Stocks, and D. Abbott, "Optimal stimulus and noise distributions for information transmission via suprathreshold stochastic resonance," Physical Review E, vol. 75, p. 061105, 2007.
38. M. D. McDonnell, N. G. Stocks, C. E. M. Pearce, and D. Abbott, "Optimal information transmission in nonlinear arrays through suprathreshold stochastic resonance," Physics Letters A, vol. 352, pp. 183-189, 2006.
39. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. Wiley, New York, 2006.
40. M. D. McDonnell, D. Abbott, and C. E. M. Pearce, "An analysis of noise enhanced information transmission in an array of comparators," Microelectronics Journal, vol. 33, no. 12, pp. 1079-1089, 2002.
41. A. Saha, "Private communication," 2007, email received from Aditya Saha, University of Alberta, September 2007.
42. T. Berger and J. D. Gibson, "Lossy source coding," IEEE Transactions on Information Theory, vol. 44, no. 6, pp. 2693-2723, 1998.
43. T. Magesacher, P. Ödling, J. Sayir, and T. Nordström, "Capacity of an extension of Cover's two-look Gaussian channel," in Proc. IEEE International Symposium on Information Theory, Yokohama, Japan. IEEE, 2003, p. 262.