High-rate vector quantization for detection

IEEE Transactions on Information Theory

Volumn 49, Issue 8, 2003, Pages 1951-1969

  Gupta, Riten ^a   Hero, Alfred O ^b  

^a NORTHROP GRUMMAN CORPORATION   (United States)

^b University of Michigan   (United States)

Author keywords

Area under the curve (AUC); Binary hypothesis testing; Chernoff information; Compression; Discrimination; Error exponents; Receiver operating characteristic (ROC)

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; ASYMPTOTIC STABILITY; ERROR ANALYSIS; ITERATIVE METHODS; SIGNAL DISTORTION; SIGNAL RECEIVERS; SIGNAL TO NOISE RATIO; VECTOR QUANTIZATION;

BINARY HYPOTHESIS TESTING; CHERNOFF INFORMATION; LOG-LIKELIHOOD RATIO; RECEIVER OPERATING CHARACTERISTIC;

SIGNAL DETECTION;

EID: 0042766887     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2003.814482     Document Type: Article

References (49)

1. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Boston, MA: Kluwer, 1992.
2. R. M. Gray and D. L. Neuhoff, "Quantization," IEEE Trans. Inform. Theory, vol. 44, pp. 2325-2383, Oct. 1998.
3. S. A. Kassam, "Optimum quantization for signal detection," IEEE Trans. Commun., vol. COM-25, pp. 479-484, May 1977.
4. H. V. Poor, and J. B. Thomas, "Applications of Ali-Silvey distance measures in the design of generalized quantizers," IEEE Trans. Commun., vol. COM-25, pp. 893-900, Sept. 1977.
5. H. V. Poor, "A companding approximation for the statistical divergence of quantized data," in Proc. IEEE Conf. Decision and Control, San Antonio, TX, Dec. 1983.
6. ____, "Fine quantization in signal detection and estimation-part I," IEEE Trans. Inform. Theory, vol. 34, pp. 960-972, Sept. 1988.
7. G. R. Benitz and J. A. Bucklew, "Asymptotically optimal quantizers for detection of i.i.d. data," IEEE Trans. Inform. Theory, vol. 35, pp. 316-325, Mar. 1989.
8. B. Picinbono and P. Duvaut, "Optimum quantization for detection," IEEE Trans. Commun., vol. 36, pp. 1254-1258, Nov. 1988.
9. J. N. Tsitsiklis, "Extremal properties of likelihood ratio quantizers," IEEE Trans. Commun., vol. 41, pp. 550-558, Apr. 1993.
10. T. J. Flynn and R. M. Gray, "Encoding of correlated observations," IEEE Trans. Inform. Theory, vol. IT-33, pp. 773-787, Nov. 1987.
11. M. Longo, T. D. Lookabaugh, and R. M. Gray, "Quantization for decentralized hypothesis testing under communication constraints," IEEE Trans. Inform. Theory, vol. 36, pp. 241-255, Mar. 1990.
12. K. Oehler and R. M. Gray, "Combining image compression and classification using vector quantization," IEEE Trans. Pattern Anal. Machine Intell., vol. 17, pp. 461-473, May 1995.
13. K. O. Perlmutter et al., "Bayes risk weighted vector quantization with posterior estimation for image compression and classification," IEEE Trans. Image Processing, vol. 5, pp. 347-360, Feb. 1996.
14. S. Jana and P. Moulin, "Optimal design of transform coders for image classification," in Proc. Conf. Information Sciences and Systems, Baltimore, MD, Mar. 1999.
15. A. Jain, P. Moulin, M. I. Miller, and K. Ramchandran, "Information-theoretic bounds on target recognition performance based on degraded image data," manuscript, to be published.
16. R. M. Gray, "Quantization, classification, and density estimation," in Proc. IEEE Information Theory Workshop on Detection, Estimation, Classification, and Imaging, Santa Fe, NM, Feb. 1999.
17. P. Zador, "Development and evaluation of procedures for quantizing multivariate distributions," Ph.D. dissertation, Stanford Univ., Stanford, CA, 1963.
18. A. Gersho, "Asymptotically optimal block quantization," IEEE Trans. Inform. Theory, vol. IT-25, pp. 373-380, July 1979.
19. S. Na and D. L. Neuhoff, "Bennet's integral for vector quantizers," IEEE Trans. Inform. Theory, vol. 41, pp. 886-900, July 1995.
20. R. Zamir and M. Feder, "On lattice quantization noise," IEEE Trans. Inform. Theory, vol. 42, pp. 1152-1159, July 1996.
21. Y. Yamada, S. Tazaki, and R. M. Gray, "Asymptotic performance of block quantizers with difference distortion measures," IEEE Trans. Inform. Theory, vol. IT-26, pp. 6-14, Jan. 1980.
22. W. Gardner and B. Rao, "Theoretical analysis of the high-rate vector quantization of LPC parameters," IEEE Trans. Speech Audio Processing, vol. 3, pp. 367-381, Sept. 1995.
23. J. Li, N. Chadda, and R. M. Gray, "Asymptotic performance of vector quantizers with a perceptual distortion measure," IEEE Trans. Inform. Theory, vol. 45, pp. 1082-1091, May 1999.
24. T. Linder, R. Zamir, and K. Zeger, "High-resolution source coding for nondifference distortion measures: Multidimensional companding," IEEE Trans. Inform. Theory, vol. 45, pp. 548-561, Mar. 1999.
25. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inform. Theory, vol. IT-19, pp. 471-480, July 1973.
26. R. Gupta, "Quantization strategies for low-power communications," Ph.D. dissertation, Univ. Michigan, Ann Arbor, MI, 2001.
27. E. L. Lehmann, Testing Statistical Hypotheses. New York: Wiley, 1959.
28. R. Blahut, Principles and Practice of Information Theory. Reading, MA: Addison-Wesley, 1987.
29. T. Cover and J. Thomas, Elements of Information Theory. New York: Wiley, 1987.
30. J. A. Bucklew, Large Deviation Techniques in Decision, Simulation, and Estimation. New York: Wiley, 1990.
31. A. Dembo and O. Zeitouni, Large Deviation Techniques and Applications. Berlin, Germany: Springer-Verlag, 1998.
32. H. L. Van-Trees, Detection, Estimation, and Modulation Theory: Part I. New York: Wiley, 1968.
33. D. M. Green and J. A. Swets, Signal Detection Theory and Psychophysics. New York: Wiley, 1966.
34. F. Provost and T. Fawcett, "Robust classification for imprecise environments," Machine Learning J., vol. 42, no. 3, pp. 203-231, Mar. 2001.
35. P. M. Altham, "A nonparametric measure of signal discriminability," Brit. J. Math. Statist. Psychol., vol. 26, pp. 1-12, 1973.
36. D. Bamber, "The area above the ordinal dominance graph and the area below the receiver operating characteristic graph," J. Math. Psychol., vol. 12, pp. 387-415, 1975.
37. C. E. Metz, "Basic principles of ROC analysis," Seminars Nucl. Med., vol. 8, no. 4, pp. 283-298, 1978.
38. J. A. Swets and R. M. Pickett, Evaluation of Diagnostic Systems: Methods From Signal Detection Theory. New York: Kluwer/Academic, 1982.
39. A. Bradley, "The use of the area under the roc curve in the evaluation of machine learning algorithms," Pattern Recogn., vol. 30, no. 7, pp. 1145-1159, 1997.
40. J. A. Hanley and B. J. McNeil, "The meaning and use of the area under a receiver operator characteristic (ROC) curve," Radiology, vol. 143, pp. 29-36, 1982.
41. H. H. Barrett, C. K. Abbey, and E. Clarkson, "Objective assessment of image quality. III. ROC metrics, ideal observers, and likelihood-generating functions," J. Opt. Soc. Amer., vol. 15, no. 6, pp. 1520-1535, June 1998.
42. J. Shapiro, "Bounds on the area under the ROC curve," J. Opt. Soc. Amer., vol. 16, pp. 53-57, Jan. 1999.
43. Y. Linde, A. Buzo, and R. M. Gray, "An algorithm for vector quantizer design," IEEE Trans. Commun., vol. COM-28, pp. 84-95, Jan. 1980.
44. K. Sayood, Introduction to Data Compression. San Mateo, CA: Morgan-Kaufman, 1996.
45. P. W. Moo, "Asymptotic analysis of lattice-based quantization," Ph.D. dissertation, Univ. Michigan, Ann Arbor, MI, 1998.
46. J. A. Bucklew, "Two results on the asymptotic performance of quantizers," IEEE Trans. Inform. Theory, vol. IT-30, pp. 341-348, Mar. 1984.
47. J. A. Bucklew and G. L. Wise, "Multidimensional asymptotic quantization theory with rth power distortion measures," IEEE Trans. Inform. Theory, vol. IT-28, pp. 239-247, Mar. 1982.
48. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.
49. T. Kragh and A. O. Hero, "Emission tomography from compressed data," in Proc. Asilomar Conf. Signals, Systems and Computers, Pacific Grove, CA, Nov. 2002, [Online]. Available: http://www.eecs.umich.edu/hero/image_proc.html.