High resolution optimal quantization for stochastic pooling networks

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 6417, Issue , 2007, Pages

  McDonnell, Mark D ^a   Amblard, Pierre Olivier ^b   Stocks, Nigel G ^c   Zozor, Steeve ^b   Abbott, Derek ^a  

^a UNIVERSITY OF ADELAIDE   (Australia)

^b CNRS   (France)

^c UNIVERSITY OF WARWICK   (United Kingdom)

Author keywords

Channel capacity; High resolution quantization; Lossy compression; Neurons; Noise; Optimal quantization; Pooling networks; Stochastic signal quantization; Suprathreshold stochastic resonance

Indexed keywords

ANALOG TO DIGITAL CONVERSION; INFORMATION ANALYSIS; NEUROLOGY; SPURIOUS SIGNAL NOISE; STOCHASTIC CONTROL SYSTEMS; VECTOR QUANTIZATION;

HIGH RESOLUTION QUANTIZATION; LOSSY COMPRESSION; OPTIMAL QUANTIZATION; POOLING NETWORKS; STOCHASTIC SIGNAL QUANTIZATION; SUPRATHRESHOLD STOCHASTIC RESONANCE;

NEURAL NETWORKS;

EID: 34247524209     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.695984     Document Type: Conference Paper

References (48)

1. N. G. Stocks, "Suprathreshold stochastic resonance in multilevel threshold systems," Physical Review Letters 84(11), pp. 2310-2313, 2000.
2. M. D. McDonnell, D. Abbott, and C. E. M. Pearce, "A characterization of suprathreshold stochastic resonance in an array of comparators by correlation coefficient," Fluctuation and Noise Letters 2(3), pp. L205-L220, 2002.
3. L. Gammaitoni, P. Hänggi, P. Jung, and F. Marchesoni, "Stochastic resonance," Reviews of Modern Physics 70(1), pp. 223-287, 1998.
4. F. Moss, L. M. Ward, and W. G. Sannita, "Stochastic resonance and sensory information processing: a tutorial and review of application," Clinical Neurophysiology 115, pp. 267-281, 2004.
5. S. Zozor and P.-O. Amblard, "Noise-aided processing: revisiting dithering in a sigma-delta quantizer," IEEE Transactions on Signal Processing 53, pp. 3202-3210, 2005.
6. N. G. Stocks and R. Mannella, "Generic noise enhanced coding in neuronal arrays," Physical Review E 64, Art. No. 030902(R), 2001.
7. T. Hoch, G. Wenning, and K. Obermayer, "Optimal noise-aided signal transmission through populations of neurons," Physical Review 568(3), Art. No. 011911, 2003.
8. N. G. Stocks, D. Allingham, and R. P. Morse, "The application of suprathreshold stochastic resonance to cochlear implant coding," Fluctuation and Noise Letters 2(3), pp. L169-L181, 2002.
9. D. Allingham, N. G. Stocks, R. P. Morse, and G. F. Meyer, "Noise enhanced information transmission in a model of multichannel cochlear implantation," in Proc. SPIE Fluctuations and Noise in Biological, Biophysical, and Biomedical Systems II, D. Abbott, S. M. Bezrukov, A. Der, and A. Sánchez, eds., 5467, pp. 139-148, 2004.
10. R. P. Morse and N. G. Stocks, "Enhanced cochlear implant coding using multiplicative noise," in Proc. SPIE Fluctuations and Noise in Biological, Biophysical and Biomedical Systems III, N. G. Stocks, D. Abbott, and R. P. Morse, eds., 5841, pp. 23-30, 2005.
11. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression, Kluwer Academic Publishers, 1992.
12. V. K. Madisetti and D. B. Williams, The Digital Signal Processing Handbook, CRC Press, 1999.
13. M. D. McDonnell, D. Abbott, and C. Pearce, "Neural mechanisms for analog to digital conversion," in Proc. SPIE BioMEMS and Nanoengineering, D. V. Nicolau, ed., 5275, pp. 278-286, 2003.
14. P. Rudnick, "Small signal detection in the DIMUS array," The Journal of the Acoustical Society of America 32(7), pp. 871-877, 1960.
15. W. R. Remley, "Some effects of clipping in array processing," The Journal of the Acoustical Society of America 39(4), pp. 702-707, 1966.
16. D. G. Gray, "Private communication." 2006.
17. S. Zozor, P. O. Amblard, and C. Duchêne, "Random quantizers as suboptimal detectors." Submitted to Fluctuation and Noise Letters, 2006.
18. M. Gastpar and M. Vetterli, "Power, spatio-temporal bandwidth, and distortion in large sensor networks," IEEE Journal on Selected Areas in Communications 23(4), pp. 745-754, 2005.
19. A. Ribeiro and G. B. Giannakis, "Bandwidth-constrained distributed estimation for wireless sensor networks - Part I: Gaussian case," IEEE Transactions on Signal Processing 54(3), pp. 1131-1143, 2006.
20. M. Gastpar, M. Vetterli, and P. L. Dragotti, "Sensing reality and communicating bits: a dangerous liaison," IEEE Signal Processing Magazine 14, pp. 70-83, 2006.
21. J.-J. Xiao, A. Ribiero, Z.-Q. Luo, and G. B. Giannakis, "Distributed compression-estimation using wireless sensor networks," IEEE Signal Processing Magazine 14, pp. 27-41, 2006.
22. Q. Zhao, A. Swami, and L. Tong, "The interplay between signal processing and networking in sensor networks," IEEE Signal Processing Magazine 14, pp. 84-93, 2006.
23. Z. Xiong, A. D. Liveris, and S. Cheng, "Distributed source coding for sensor networks," IEEE Signal Processing Magazine 21, pp. 80-94, 2004.
24. Z.-Q. Luo, M. Gastpar, J. Liu, and A. Swami, "Distributed signal processing in sensor networks," IEEE Signal Processing Magazine 14, pp. 14-15, 2006.
25. T. Berger, Z. Zhang, and H. Viswanathan, "The CEO problem," IEEE Transactions on Information Theory 42(3), pp. 887-902, 1996.
26. M. D. McDonnell, N. G. Stocks, and D. Abbott, "Complexity and distortion reduction in quantizers with independently random threshold levels." Submitted to IEEE Transactions on Signal Processing, 2006.
27. N. G. Stocks, "Information transmission in parallel threshold arrays: Suprathreshold stochastic resonance," Physical Review 563(4), Art. No. 041114, 2001.
28. M. D. McDonnell, D. Abbott, and C. E. M. Pearce, "An analysis of noise enhanced information transmission in an array of comparators," Microelectronics Journal 33(12), pp. 1079-1089, 2002.
29. M. D. McDonnell, Theoretical Aspects of Stochastic Signal Quantisation and Suprathreshold Stochastic Resonance. PhD thesis, School of Electrical and Electronic Engineering, The University of Adelaide, Australia, 2006.
30. M. D. McDonnell, N. G. Stocks, and D. Abbott, "High resolution approximations for information transfer and channel capacity in the suprathreshold stochastic resonance model." Submitted to Physical Review E, 2006.
31. P.-O. Amblard, S. Zozor, and O. J. J. Michel, "Networks of the pooling type and optimal quantization," in Proc. 2006 IEEE International Conference on Acoustics, Speech, and Signal Processing, 3, pp. 716-719, 2006.
32. R. D. Yates and D. J. Goodman, Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers, John Wiley and Sons, Inc., second ed., 2005.
33. N. G. Stocks, "Suprathreshold stochastic resonance: An exact result for uniformly distributed signal and noise," Physics Letters A 279(5-6), pp. 308-312, 2001.
34. R. Wong, Asymptotic Approximation of Integrals, Academic Press, 1989.
35. D. E. Dominici, "The inverse of the cumulative standard normal probability function," Integrals, Transforms and Special Functions 14(4), pp. 281-292, 2003.
36. T. M. Cover and J. A. Thomas, Elements of Information Theory, John Wiley and Sons, New York, 1991.
37. J. V. Harrington, "An analysis of the detection of repeated signals in noise by binary integration," IRE Transactions on Information Theory 1(1), pp. 1-9, 1955.
38. C. Knessl, "Integral representations and asymptotic expansions for Shannon and Rényi entropies," Applied Mathematics Letters 11(2), pp. 69-74, 1998.
39. J. N. Kapur and H. K. Kesavan, Entropy Optimization Principles with Applications, Academic Press, 1992.
40. T. Hoch, G. Wenning, and K. Obermayer, "Adaptation using local information for maximizing the global cost," Neurocomputing 52-54, pp. 541-546, 2003.
41. R. Stein, "The information capacity of nerve cells using a frequency code," Biophysics Journal 7, pp. 70-86, 1967.
42. M. Stemmler, "A single spike suffices: The simplest form of stochastic resonance in model neurons," Network: Computation in Neural Systems 7, pp. 687-716, 1996.
43. N. Brunel and J. Nadal, "Mutual information, Fisher information and population coding," Neural Computation 10, pp. 1731-1757, 1998.
44. J. J. Rissanen, "Fisher information and stochastic complexity," IEEE Transactions on Information Theory 42(1), pp. 40-47, 1996.
45. E. L. Lehmann and G. Casella, Theory of Point Estimation, Springer, New York, 1998.
46. M. D. McDonnell, N. G. Stocks, C. E. M. Pearce, and D. Abbott, "Quantization in the presence of large amplitude threshold noise," Fluctuation and Noise Letters 5(3), pp. L457-L468, 2005.
47. M. D. McDonnell, N. G. Stocks, C. E. M. Pearce, and D. Abbott, "Optimal information transmission in nonlinear arrays through suprathreshold stochastic resonance," Physics Letters A 352, pp. 183-189, 2006.
48. W. Feller, An Introduction to Probability and its Application, Wiley, 1968.