Noise benefits in quantizer-array correlation detection and watermark decoding

IEEE Transactions on Signal Processing

Volumn 59, Issue 2, 2011, Pages 488-505

  Patel, Ashok ^a   Kosko, Bart ^a  

^a University of Southern California   (United States)

Author keywords

Maximum likelihood (ML) detection; Neyman Pearson (NP) detection; noise benefits; nonlinear correlation detectors; quantizer arrays; quantizer noise; scale family noise; stochastic resonance; watermark decoding

Indexed keywords

MAXIMUM-LIKELIHOOD DETECTION; NEYMAN-PEARSON; NOISE BENEFITS; NON-LINEAR CORRELATIONS; QUANTIZERS; SCALE-FAMILY NOISE; STOCHASTIC RESONANCES; WATERMARK DECODING;

CIRCUIT RESONANCE; CORRELATORS; DECODING; DETECTORS; DIGITAL WATERMARKING; MAGNETIC RESONANCE; MAXIMUM LIKELIHOOD; PROBABILITY; STOCHASTIC SYSTEMS; WATERMARKING;

SIGNAL DETECTION;

EID: 78651369533     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2010.2091409     Document Type: Article

References (85)

1. H. Chen, P. K. Varshney, S. M. Kay, and J. H. Michels, "Theory of stochastic resonance effects in signal detection: Part I-Fixed detectors," IEEE Trans. Signal Process., vol. 55, pp. 3172-3184, Jul. 2007.
2. M. Guerriero, P.Willett, S. Marano, and V. Matta, "Speedier sequential tests via stochastic resonance," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process. ICASSP , 4, 2008, pp. 3901-3904.
3. S. Kay, "Can detectability be improved by adding noise?," IEEE Signal Process. Lett., vol. 7, pp. 8-10, Jan. 2000.
4. B. Kosko, Noise. New York: Viking/Penguin, 2006.
5. M. D. McDonnell and D. Abbott, "What is stochastic resonance? definitions, misconceptions, debates, and its relevance to biology," PLoS Computat. Biol., vol. 5, no. 5, p. E1000348, May 2009.
6. S. Mitaim and B. Kosko, "Adaptive stochastic resonance," Proc. IEEE, vol. 86, pp. 2152-2183, 1998.
7. A. Patel and B. Kosko, "Stochastic resonance in noisy spiking retinal and sensory neuron models," Neural Netw., vol. 18, no. 5-6, pp. 467-478, 2005. (Pubitemid 43186565)
8. A. Patel and B. Kosko, "Optimal noise benefits in Neyman-Pearson and inequality-constrained statistical signal detection," IEEE Trans. Signal Process., vol. 57, pp. 1655-1669, 2009.
9. D. Rousseau and F. Chapeau-Blondeau, "Constructive role of noise in signal detection from parallel array of quantizers," Signal Process., vol. 85, no. 3, pp. 571-580, Mar. 2005.
10. N. G. Stocks, "Information transmission in parallel threshold arrays: Suprathreshold stochastic resonance," Phys. Rev. E, vol. 63, no. 4, p. 041114, Mar. 2001.
11. A. R. Bulsara and A. Zador, "Threshold detection of wideband signals: A noise-induced maximum in the mutual information," Phys. Rev. E, vol. 54, no. 3, pp. R2185-R2188, Sep. 1996.
12. A. Patel and B. Kosko, "Error-probability noise benefits in threshold neural signal detection," Neural Netw., vol. 22, no. 5-6, pp. 697-706, Jul./Aug. 2009.
13. D. Rousseau, G. V. Anand, and F. Chapeau-Blondeau, "Noise-enhanced nonlinear detector to improve signal detection in non-Gaussian noise," Signal Process., vol. 86, no. 11, pp. 3456-3465, Nov. 2006.
14. A. A. Saha and G. V. Anand, "Design of detectors based on stochastic resonance," Signal Process., vol. 83, no. 6, pp. 1193-1212, 2003.
15. P.-O. Amblard, S. Zozor,M.D.McDonnell, and N. G. Stocks, "Pooling networks for a discrimination task: Noise-enhanced detection," Proc. SPIE, vol. 6602, no. 1, pp. 66020S-1-12, 2007.
16. L. Gammaitoni, "Stochastic resonance and the dithering effect in threshold physical systems," Phys. Rev. E, vol. 52, no. 5, pp. 4691-4698, Nov. 1995.
17. P. Hänggi, "Stochastic resonance in biology," Chem. Phys. Chem., vol. 3, pp. 285-290, 2002.
18. I. Y. Lee, X. Liu, C. Zhou, and B. Kosko, "Noise-enhanced detection of subthreshold signals with carbon nanotubes," IEEE Trans. Nanotechnol., vol. 5, pp. 613-627, Nov. 2006.
19. A. Patel and B.Kosko, "Stochastic resonance in continuous and spiking neuron models with Levy noise," IEEE Trans. Neural Netw., vol. 19, pp. 1993-2008, Dec. 2008.
20. D. Applebaum, "Extending stochastic resonance for neuron models to general Levy noise," IEEE Trans. Neural Netw., vol. 20, pp. 1993-1995, Dec. 2009.
21. W. C. Stacey and D. M. Durand, "Stochastic resonance improves signal detection in hippocampal CA1 neurons," J. Neurophysiol., vol. 83, pp. 1394-1402, 2000.
22. N. Stocks, D. Appligham, and R. Morse, "The application of suprathreshold stochastic resonance to cochlear implant coding," Fluctuation and Noise Lett., vol. 2, pp. L169-L181, 2002.
23. K. Wiesenfeld and F. Moss, "Stochastic resonance and the benefits of noise: From ice ages to crayfish and squid," Nature (London), vol. 373, p. 33, 1995.
24. A. Benerjee, P. Burlina, and R. Chellappa, "Adaptive target detection in foliage-penetrating SAR images using alpha-stable models," IEEE Trans. Image Process., vol. 8, pp. 1823-1831, Dec. 1999.
25. M. Bouvet and S. C. Schwartz, "Comparison of adaptive and robust receivers for signal detection in ambient underwater noise," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-37, no. 4, p. 621, 1989.
26. A. Briassouli, P. Tsakalides, and A. Stouraitis, "Hidden messages in heavy-tails: DCT-domain watermark detection using alpha-stable models," IEEE Trans. Multimedia, vol. 7, pp. 700-715, 2005.
27. S. Kay, J.Michels, H. Chen, and P. Varshney, "Reducing probability of decision error using stochastic resonance," IEEE Signal Process. Lett. , vol. 13, no. 11, pp. 695-698, Nov. 2006.
28. H. Chen, P. K. Varshney, S. M. Kay, and J. H. Michels, "Noise enhanced nonparametric detection," IEEE Trans. Inf. Theory, vol. 55, pp. 499-506, 2009.
29. M. D. McDonnell, N. G. Stocks, and D. Abbott, "Optimal stimulus and noise distributions for information transmission via suprathreshold stochastic resonance," Phys. Rev. E, vol. 75, no. 6, pp. 061 105-+, 2007.
30. S. Zozor and P.-O. Amblard, "Stochastic resonance in locally optimal detectors," IEEE Trans. Signal Process., vol. 51, no. 12, pp. 3177-3181, Dec. 2003.
31. F. Chapeau-Blondeau and D. Rousseau, "Noise-enhanced performance for an optimal Bayesian estimator," IEEE Trans. Signal Process., vol. 52, pp. 1327-1334, May 2004.
32. D. C. Munson, "A note on Lena," IEEE Trans. Image Process., vol. 5, p. 3, 1996.
33. J. R. Hernandez, A. Member, F. Perez-Gonzalez, M. Amado, and O. Pérez-gonzález, "DCT-domain watermarking techniques for still images: Detector performance analysis and a new structure," IEEE Trans. Image Process., vol. 9, pp. 55-68, 2000.
34. M. Thompson, D. Halverson, and G. Wise, "Robust detection in nominally Laplace noise," IEEE Trans. Commun., vol. 42, pp. 1651-1660, 1994.
35. D. Middleton, "Non-Gaussian noise models in signal processing for telecommunications: New methods and results for class a and class B noise models," IEEE Trans. Inf. Theory, vol. 45, pp. 1129-1149, May 1999.
36. S. M. Saberali, H. Amindavar, and J. Ritcey, "Blind detection in symmetric non-Gaussian noise with unknown pdf using maximum entropy method with moment generating function constraints," Signal Process., vol. 90, no. 3, pp. 891-899, 2010.
37. N. G. Stocks, "Suprathreshold stochastic resonance in multilevel threshold systems," Phys. Rev. Lett., vol. 84, no. 11, pp. 2310-2313, Mar. 2000.
38. M. D. McDonnell, N. G. Stocks, C. E. M. Pearce, and D. Abbott, Stochastic Resonance: From Suprathreshold Stochastic Resonance to Stochastic Signal Quantization. Cambridge, U.K.: Cambridge University Press, 2008.
39. M. Grigoriu, Applied Non-Gaussian Processes. Englewood Cliffs, NJ: Prentice-Hall, 1995.
40. C. L. Nikias and M. Shao, Signal Processing With Alpha-Stable Distributions and Applications. New York: Wiley-Intersci., 1995.
41. ,R. J. Adler,R. E. Feldman, and M. S. Taqqu, Eds., A Practical Guide to Heavy Tails: Statistical Techniques and Applications. Boston, MA: Birkhauser, 1998.
42. A. Achim, S. Member, A. Bezerianos, and P. Tsakalides, "Novel Bayesian multiscale method for speckle removal in medical ultrasound images," IEEE Trans. Med. Imag., vol. 20, pp. 772-783, 2001.
43. P. G. Georgiou, S. Member, P. Tsakalides, and C. Kyriakakis, "Alphastable modeling of noise and robust time-delay estimation in the presence of impulsive noise," IEEE Trans. Multimedia, vol. 1, pp. 291-301, 1999.
44. W. Willinger, M. S. Taqqu, R. Sherman, and D. V. Wilson, "Selfsimilarity through high-variability: Statistical analysis of ethernet lan traffic at the source level," IEEE/ACM Trans. Netw., vol. 5, pp. 71-86, 1997.
45. G. Tsihrintzis and C. Nikias, "Performance of optimum and suboptimum receivers in the presence of impulsive noise modeled as an alpha-stable process," IEEE Trans. Commun., vol. 43, pp. 904-914, Mar. 1995.
46. S. Zozor, J.-M. Brossier, and P.-O. Amblard, "A parametric approach to suboptimal signal detection in α-stable noise," IEEE Trans. Signal Process., vol. 54, pp. 4497-4509, Dec. 2006.
47. S. Ambike, J. Ilow, and D. Hatzinakos, "Detection for binary transmission in a mixture of Gaussian noise and impulsive noise modeled as an alpha-stable process," IEEE Signal Process. Lett., vol. 1, no. 3, pp. 55-57, Mar. 1994.
48. E. L. Lehmann and J. P. Romano, Testing Statistical Hypotheses, 3rd ed. New York: Springer, 2008.
49. C. Brown and A. Zoubir, "A nonparametric approach to signal detection in impulsive interference," IEEE Trans. Signal Process., vol. 48, no. 9, pp. 2665-2669, Sep. 2000.
50. C. Brown, "Score functions for locally suboptimum and locally suboptimum rank detection in alpha-stable interference," in Proc. 11th IEEE Signal Process. Workshop on Statist. Signal Process. (SSP), 2001, pp. 58-61.
51. E. Kuruoglu, W. Fitzgerald, and P. Rayner, "Near optimal detection of signals in impulsive noise modeled with a symmetric α-stable distribution," IEEE Commun. Lett., vol. 2, no. 10, pp. 282-284, Oct. 1998.
52. X. Li, L. Jin, and S.Wang, "A simplified non-Gaussian mixture model for signal lo detection in α-stable interference," in Proc. 2008 Congress on Image and Signal Process., 2008, vol. 5, pp. 403-407.
53. G. Casella and R. Berger, Statistical Inference. Pacific Grove, CA: Duxbury Resource Center, 2001.
54. B. Hayes, "Randomness as a resource," Amer. Scientist, vol. 89, no. 4, pp. 300-304, 2001.
55. M. Epstein, L. Hars, R. Krasinski, M. Rosner, and H. Zheng, "Design and implementation of a true random number generator based on digital circuit artifacts," Lecture Notes in Comput. Sci., vol. 2779, pp. 152-165, 2003.
56. N. Kimura and S. Latifi, "A survey on data compression in wireless sensor networks," in Proc. Int. Conf. Inf. Technol.: Coding and Comput. (ITCC'05)-Vol. II, 2005, pp. 8-13.
57. H. C. Papadopoulos, G. W. Wornell, and A. V. Oppenheim, "Lowcomplexity digital encoding strategies for wireless sensor networks," Proc. ICASSP98, pp. 3273-3276, 1998.
58. J. Nolan, "Numerical calculation of stable densities and distribution functions," Commun. Statist., vol. 13, pp. 759-774, 1997.
59. J. Proakis and M. Salehi, Digital Communications, 5th ed. NewYork: McGraw-Hill, 2008.
60. S. Nadarajah, "A generalized normal distribution," J. Appl. Statist., vol. 32, no. 7, pp. 685-694, Sep. 2005.
61. Y. Bazi, L. Bruzzone, and F. Melgani, "Image thresholding based on the EM algorithm and the generalized Gaussian distribution," Pattern Recogn., vol. 40, no. 2, pp. 619-634, 2007.
62. M. Do and M. Vetterli, "Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance," IEEE Trans. Image Process., vol. 11, no. 2, pp. 146-158, Feb. 2002.
63. S. Gazor and W. Zhang, "Speech probability distribution," IEEE Signal Process. Lett., vol. 10, no. 7, pp. 204-207, Jul. 2003.
64. R. Krupinski and J. Purczynski, "Approximated fast estimator for the shape parameter of generalized Gaussian distribution," Signal Process., vol. 86, no. 2, pp. 205-211, 2006.
65. Q. Cheng and T. Huang, "An additive approach to transform-domain information hiding and optimum detection structure," IEEE Trans. Multimedia, vol. 3, no. 3, pp. 273-284, Sep. 2001.
66. A. Nikolaidis and I. Pitas, "Asymptotically optimal detection for additive watermarking in the DCT and DWT domains," IEEE Trans. Image Process., vol. 12, no. 5, pp. 563-571, May 2003.
67. J. Wang, G. Liu, Y. Dai, J. Sun, Z. Wang, and S. Lian, "Locally optimum detection for Barni's multiplicative watermarking in DWT domain," Signal Process., vol. 88, no. 1, pp. 117-130, 2008.
68. A. C. Bovik, The Essential Guide to Image Processing. New York: Academic , 2009.
69. G. V. D. Wouwer, P. Scheunders, and D. V. Dyck, "Statistical texture characterization from discrete wavelet representations," IEEE Trans. Image Process., vol. 8, pp. 592-598, 1999.
70. P. Billingsley, Probability and Measure, 3rd ed. New York: Wiley- Intersci., 1995.
71. M. Barni, F. Bartolini, V. Cappellini, and A. Piva, "A DCT-domain system for robust image watermarking," Signal Process., vol. 66, no. 3, pp. 357-372, 1998.
72. I. J. Cox, M. L. Miller, J. A. Bloom, J. Fridrich, and T. Kalker, DigitalWatermarking and Steganography, 2nd ed. Boston, MA: Morgan Kaufmann, 2007.
73. M. Arnold, S. D. Wolthusen, and M. Schmucker, Techniques and Applications of DigitalWatermarking and Content Protection. Dedham, MA: Artech House, 2003.
74. B. Furht and D. Kirovski, Multimedia Security Handbook. Boca Raton, FL: CRC, 2005.
75. G. Langelaar, I. Setyawan, and R. Lagendijk, "Watermarking digital image and video data. A state-of-the-art overview," IEEE Signal Process. Mag., vol. 17, no. 5, pp. 20-46, Sep. 2000.
76. A. J. Ahumada and H. A. Peterson, B. E. Rogowitz, Ed., "Luminancemodel- based DCT quantization for color image compression," in Proc. Soc. Photo-Opt. Instrum. Eng. (SPIE) Conf. Ser., Aug. 1992, vol. 1666, pp. 365-374.
77. S. Sun and P. Qui, "Algorithm for digital watermarking based on parameter- induced stochastic resonance," J. Commun., vol. 88, no. 8, pp. 48-55, 2005.
78. S. Sun and B. Lei, "On an aperiodic stochastic resonance signal processor and its application in digital watermarking," Signal Process., vol. 88, no. 8, pp. 2085-2094, 2008.
79. F. Duan, D. Abbott, and F. M. C. Chapeau-Blondeau, "The application of saturating detectors to a DCT-domain watermarking scheme," Fluctuation and Noise Lett., vol. 8, no. 1, pp. L65-L79, 2008.
80. F. Duan and B. Xu, "Parameter-induced stochastic resonance and baseband binary PAM signals transmission over an awgn channel," I. J. Bifurc. Chaos, vol. 13, no. 2, pp. 411-425, 2003.
81. G.Wu and Z. Qiu, "A novel watermarking scheme based on stochastic resonance," in Proc. 8th Int. Conf. Signal Process., 2006, vol. 2.
82. S. Baudry, J. Delaigle, B. Sankur, B. Macq, and H. Maitre, "Analysis of error correction strategies for typical communication channels in watermarking," Signal Process., vol. 81, pp. 1239-1250, 2001.
83. D. Jones, The Theory of Generalized Functions, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 1982.
84. G. B. Folland, Real Analysis: Modern Techniques and Their Applications, 2nd ed. New York: Wiley-Interscience, 1999.
85. W. Rudin, Principles of Mathematical Analysis, 3rd ed. New York: McGraw-Hill, 1976.