Asymptotic design of quantizers for decentralized MMSE estimation

IEEE Transactions on Signal Processing

Volumn 55, Issue 11, 2007, Pages 5485-5496

  Marano, Stefano ^a   Matta, Vincenzo ^a   Willett, Peter ^b  

^a UNIVERSITY OF SALERNO   (Italy)

^b University of Connecticut   (United States)

Author keywords

Distributed estimation; High resolution quantization; Multiterminal inference

Indexed keywords

CODING ERRORS; DECODING; ERROR ANALYSIS; MEAN SQUARE ERROR;

DISTRIBUTED ESTIMATION; HIGH-RESOLUTION QUANTIZATION; MINIMUM MEAN SQUARE ERROR; MULTI-TERMINAL INFERENCE;

ENCODING (SYMBOLS);

EID: 36249020809     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2007.898755     Document Type: Article

References (34)

1. T. Berger, "Decentralized estimation and decision theory," presented at the IEEE 7th Spring Workshop Inf. Theory, Mt. Kisco, NY, Sep. 1979. 2
2. T. Berger, "Optimum quantizers and permutation codes," IEEE Trans. Inf. Theory, vol. IT-18, no. 6, pp. 759-765, Nov. 1972.
3. T. Berger, "Minimum entropy quantizers and permutation codes," IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 149-157, Mar. 1982.
4. T. Berger, Z. Zhang, and H. Viswanathan, "The CEO problem," IEEE Trans. Inf. Theory, vol. 42, no. 3, pp. 887-902, May 1996.
5. J. Chen, X. Zhang, T. Berger, and S. Wickler, "An upper bound on the sum-rate distortion function and its corresponding rate allocation schemes for the CEO problem," IEEE J. Sel. Areas Commun., vol. 22, no. 6, pp. 977-987, Aug. 2004.
6. T. Cover and J. Thomas, Elements of Information Theory. New York: Wiley, 1991.
7. R. L. Dobrushin and B. S. Tsybakov, "Information transmission with additional noise," IRE Trans. Inf. Theory, vol. IT-8, no. 5, pp. 293-304, Jul. 1962.
8. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression Norwell, MA: Kluwer, 1992.
9. W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Eds., Markov Chain Monte Carlo in Practice. London, U.K.: Chapman & Hall, 1995.
10. H. Gish and J. N. Pierce, "Asymptotically efficient quantizing," IEEE Trans. Inf. Theory, vol. IT-14, no. 5, pp. 676-683, Sep. 1968.
11. P. Ishwar, R. Puri, S. S. Pradhan, and K. Ramchandran, "On rate-constrained distributed estimation in unreliable sensor networks," IEEE J. Sel. Areas Commun., vol. 23, no. 4, pp. 765-775, Apr. 2005.
12. T. Fine, "Optimal mean square quantization of a noisy input," IEEE Trans. Inf. Theory, vol. IT-11, no. 2, pp. 293-294, Apr. 1965.
13. T. J. Flynn and R. M. Gray, "Encoding of correlated observations," IEEE Trans. Inf. Theory, vol. IT-33, no. 6, pp. 773-787, Nov. 1987.
14. A. Gersho, "Asymptotically optimal block quantization," IEEE Trans. Inf. Theory, vol. IT-25, no. 4, pp. 373-380, Jul. 1979.
15. T. S. Han and S. Amari, "Statistical inference under multiterminal data compression," IEEE Trans. Inf. Theory, vol. 44, no. 6, pp. 2300-2324, Oct. 1998.
16. P. M. Lee, Bayesian Statistics: An Introduction. Oxford, U.K.: Oxford Univ. Press, 1989.
17. V. Matta, "Multitermial inference and sensor networks," Ph.D. dissertation, Dept. Inf. Electr. Eng. (DIIIE), Univ. Salerno, Salerno, Italy, Apr. 2005.
18. Y. Oohama, "The rate-distortion function for the quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol. 44, no. 3, pp. 1057-1070, May 1998.
19. H. V. Poor, An Introduction to Signal Detection and Estimation, 2nd ed. New York: Springer-Verlag, 1994.
20. H. V. Poor, "Fine quantization in signal detection and estimation," IEEE Trans. Inf. Theory, vol. 34, no. 5, pp. 960-972, Sep. 1988.
21. D. Rebollo-Monedero, S. Rane, and B. Girod, "Wyner-Ziv quantization and transform coding of noisy sources at high rates," in Proc. 38th Asilomar Conf. Signals, Syst, Comput., Nov. 7-10, 2004, vol. 2, pp. 2084-2088.
22. D. J. Sakrison, "Source encoding in the presence of random disturbance," IEEE Trans. Inf. Theory, vol. IT-14, no. 1, pp. 165-166, Jan. 1968.
23. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inf. Theory, vol. IT- 19, no. 4, pp. 471-480, Jul. 1973.
24. J. N. Tsitsiklis, "Decentralized detection by a large number of sensors," Math. Control Signals Syst., vol. 1, pp. 167-182, 1988.
25. H. L. Van Trees, Detection, Estimation and Modulation Theory. New York: Wiley, 2001, pt. 1.
26. H. Viswanathan and T. Berger, "The quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol. 43, no. 5, pp. 1549-1559, Sep.1997.
27. H. Viswanathan and R. Zamir, "On the whiteness of high-resolution quantization errors," IEEE Trans. Inf. Theory, vol. IT-47, no. 5, pp. 2029-2038, Jul. 2001.
28. E. Weinstein and A. J. Weiss, "A general class of lower bounds in parameter estimation," IEEE Trans. Inf. Theory, vol. IT-34, no. 2, pp. 338-342, Mar. 1988.
29. H. S. Witsenhausen, "Indirect rate distortion problems," IEEE Trans. Inf. Theory, vol. IT-26, no. 5, pp. 518-521, Sep. 1980.
30. J. K. Wolf and J. Ziv, "Transmission of noisy information to a noisy receiver with minimum distortion," IEEE Trans. Inf. Theory, vol. IT-16, no. 4, pp. 406-411, Jul. 1970.
31. H. Yamamoto and K. Itoh, "Source coding theory for multiterminal communication systems with a remote source," Trans. Inst. Electr. Eng. Jpn. C, vol. E-63, no. 10, pp. 700-706, Oct. 1980.
32. R. Zamir and T. Berger, "Multiterminal source coding with high resolution," IEEE Trans. Inf. Theory, vol. IT-45, no. 1, pp. 106-117, Jan. 1999.
33. Z. Zhang and T. Berger, "Estimation via compressed information," IEEE Trans. Inf. Theory, vol. 34, no. 2, pp. 198-211, Mar. 1988.
34. J. Ziv, "On universal quantization," IEEE Trans. Inf. Theory, vol. IT-31, no. 3, pp. 344-347, May 1985.