An information-geometric characterization of chernoff information

IEEE Signal Processing Letters

Volumn 20, Issue 3, 2013, Pages 269-272

  Nielsen, Frank ^a  

^a SONY COMPUTER SCIENCE LABORATORIES INC   (Japan)

Author keywords

Bregman divergence; Chernoff information; exponential families; information fusion; information geometry

Indexed keywords

BAYESIAN DECISION RULE; BINARY HYPOTHESIS TESTING; BISECTION SEARCH; BREGMAN DIVERGENCES; CHERNOFF DISTANCE; CHERNOFF INFORMATION; CLOSED-FORM EXPRESSION; CLOSED-FORM FORMULAE; DISTRIBUTION PARAMETERS; EXPONENTIAL FAMILY; GAUSSIANS; INFORMATION GEOMETRY; MULTINOMIALS; OPTIMIZATION PROBLEMS; PROBABILITY OF ERRORS; STATISTICAL MANIFOLDS; STATISTICAL SIGNAL PROCESSING; SYMMETRIC DISTANCES;

GEODESY; INFORMATION FUSION; INFORMATION THEORY; OPTIMIZATION; SIGNAL PROCESSING; STATISTICAL TESTS;

GEOMETRY;

EID: 84873697820     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2013.2243726     Document Type: Article

References (16)

1. L. D. Brown, Fundamentals of Statistical Exponential Families: With Applications in Statistical Decision Theory. Hayworth,CA,USA: Inst. Math. Statist., 1986.
2. H. Chernoff, "A measure of asymptotic efficiency for tests of a hypothesis based on the sum of observations," Ann. Math. Statist., vol. 23, pp. 493-507, 1952.
3. T.M. Cover and J.A. Thomas, Elements of Information Theory. New York, NY, USA: Wiley-Interscience, 1991.
4. S. J. Julier, "An Empirical study into the use of Chernoff information for robust, distributed fusion ofGaussian mixturemodels," in Int. Conf. Information Fusion, 2006, pp. 1-8.
5. F. Calderero and F.Marques, "Region merging techniques using information theory statistical measures," Trans. Image Process., vol. 19, no. 6, pp. 1567-1586, 2010.
6. S. Konishi, A. L. Yuille, J. M. Coughlan, and S. C. Zhu, "Statistical edge detection: Learning and evaluating edge cues," IEEE Trans. Patt. Anal. Mach. Intell., vol. 25, pp. 57-74, 2003.
7. A. Bhattacharyya, "On a measure of divergence between two statistical populations defined by their probability distributions," Bull. Calcutta Math. Soc., vol. 35, pp. 99-110, 1943.
8. T. Kailath, "The divergence and Bhattacharyya distance measures in signal selection," IEEE Trans. Commun., vol. 15, no. 1, pp. 52-60, 1967.
9. S. Amari and H. Nagaoka, A.M. Society, Ed.,Methods of Information Geometry. Oxford, U.K.: Oxford Univ. Press, 2000.
10. V. Garcia, F. Nielsen, and R. Nock, "Hierarchical Gaussian mixture model," in IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), 2010, pp. 4070-4073.
11. D. C. Brody, "A note on exponential families of distributions," J. Phys. A: Math. Gen., vol. 40, p. 691, 2007.
12. F. Nielsen and S. Boltz, "The Burbea-Rao and Bhattacharyya centroids," IEEE Trans. Inf. Theory, vol. 57, no. 8, pp. 5455-5466, 2011.
13. R. T. Rockafeller, Convex Analysis. Princeton, NJ, USA: Princeton Univ. Press, 1970.
14. A. Banerjee, S. Merugu, I. S. Dhillon, and J. Ghosh, "Clustering with Bregman divergences," J. Mach. Learn. Res., vol. 6, pp. 1705-1749, 2005.
15. D. H. Johnson and S. Sinanovic, Symmetrizing the Kullback-Leibler Distance, 2001, Tech. Rep.
16. J.-D. Boissonnat, F. Nielsen, and R. Nock, "Bregman Voronoi diagrams," Discr. Comput. Geom., vol. 44, no. 2, pp. 281-307, 2010.