Bayes risk error is a Bregman divergence

IEEE Transactions on Signal Processing

Volumn 59, Issue 9, 2011, Pages 4470-4472

  Varshney, Kush R ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Bayesian hypothesis testing; Bregman divergence; quantization; signal detection

Indexed keywords

BAYES RISK; BAYESIAN HYPOTHESIS; BREGMAN DIVERGENCES; DISTORTION MEASURES; LIKELIHOOD RATIO TESTS; PRIOR PROBABILITY; QUANTIZATION;

STATISTICAL TESTS;

ERROR DETECTION;

EID: 80051711965     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2011.2159500     Document Type: Article

References (21)

1. H. L.Van Trees, Detection, Estimation, and Modulation Theory. New York: Wiley, 1968.
2. K. R. Varshney and L. R. Varshney, "Quantization of prior probabilities for hypothesis testing," IEEE Trans. Signal Process., vol. 56, no. 10, pp. 4553-4562, Oct. 2008.
3. K. R. Varshney, "Frugal hypothesis testing and classification," Ph.D. thesis, Mass. Inst. Technol., Cambridge, MA, 2010.
4. L. M. Bregman, "The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming," USSR Comp. Math. Math. Phys., vol. 7, no. 3, pp. 200-217, 1967.
5. A. Banerjee, X. Guo, and H. Wang, "On the optimality of conditional expectation as a Bregman predictor," IEEE Trans. Inf. Theory, vol. 51, no. 7, pp. 2664-2669, Jul. 2005. (Pubitemid 41136414)
6. A. Banerjee, S. Merugu, I. S. Dhillon, and J. Ghosh, "Clustering with Bregman divergences," J. Mach. Learn. Res., vol. 6, pp. 1705-1749, Oct. 2005.
7. R. A.Wijsman, "Continuity of the Bayes risk," Ann. Math. Statist., vol. 41, no. 3, pp. 1083-1085, Jun. 1970.
8. M. H. DeGroot, Optimal Statistical Decisions. Hoboken, NJ:Wiley-Interscience, 2004.
9. A. V. Trushkin, "Sufficient conditions for uniqueness of a locally optimal quantizer for a class of convex error weighting functions," IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 187-198, Mar. 1982.
10. F. Nielsen and R. Nock, "Sided and symmetrized Bregman centroids," IEEE Trans. Inf. Theory, vol. 55, no. 6, pp. 2882-2904, Jun. 2009.
11. R. Sibson, "Information radius," Probab. Theory Rel., vol. 14, no. 2, pp. 149-160, Jun. 1969.
12. B. A. Frigyik, S. Srivastava, and M. R. Gupta, "Functional Bregman divergence and Bayesian estimation of distributions," IEEE Trans. Inf. Theory, vol. 54, no. 11, pp. 5130-5139, Nov. 2008.
13. J. Li, N. Chaddha, and R. M. Gray, "Asymptotic performance of vector quantizers with a perceptual distortion measure," IEEE Trans. Inf. Theory, vol. 45, no. 4, pp. 1082-1091, May 1999.
14. M. Collins, R. E. Schapire, and Y. Singer, "Logistic regression, Adaboost and Bregman distances," Mach. Learn., vol. 48, no. 1-3, pp. 253-285, Jul. 2002. (Pubitemid 34247580)
15. N. Murata, T. Takenouchi, T. Kanamori, and S. Eguchi, "Information geometry of U-boost and Bregman divergence," Neural Comput., vol. 16, no. 5, pp. 1437-1481, Jul. 2004. (Pubitemid 38740017)
16. M. D. Reid and R. C. Williamson, "Information, divergence and risk for binary experiments," J. Mach. Learn. Res., vol. 12, pp. 731-817, Mar. 2011.
17. J. B. Rhim, L. R. Varshney, and V. K. Goyal, "Collaboration in distributed hypothesis testing with quantized prior probabilities," in Proc. Data Compression Conf., Snowbird, UT, Mar. 2011, pp. 303-312.
18. K. R. Varshney and L. R. Varshney, "Multilevel minimax hypothesis testing," in Proc. IEEE Stat. Signal Process. Workshop, Nice, France, Jun. 2011, pp. 109-112.
19. L. R. Varshney, "Unreliable and resource-constrained decoding," Ph.D. thesis, Mass. Inst. Technol., Cambridge, MA, 2010.
20. L. R. Varshney, J. B. Rhim, K. R. Varshney, and V. K. Goyal, "Categorical decision making by people, committees, and crowds," in Proc. Inf. Theory Appl. Workshop, La Jolla, CA, Feb. 2011.
21. J. B. Rhim, L. R. Varshney, and V. K. Goyal, "Conflict in distributed hypothesis testing with quantized prior probabilities," in Proc. Data Compression Conf., Snowbird, UT, Mar. 2011, pp. 313-322.