Sharper Lower Bounds for Discrimination Information in Terms of Variation

IEEE Transactions on Information Theory

Volumn 21, Issue 1, 1975, Pages 99-100

  Toussaint, Godfried T ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

PROBABILITY - RANDOM PROCESSES;

INFORMATION THEORY;

EID: 0016428806     PISSN: 00189448     EISSN: 15579654     Source Type: Journal    
DOI: 10.1109/TIT.1975.1055311     Document Type: Article

References (13)

1. V. A. Volkonskij and Ju. A. Rozanov, “Some limit theorems for random functions—I,” (English Trans.), Theory Prob. Appl. (USSR), vol. 4, pp. 178–197, 1959.
2. M. S. Pinsker, Information and Information Stability of Random Variables and Processes, (in Russian). Moscow: Izv. Akad. Nauk, 1960.
3. I. Csiszar, “A note on Jensen's inequality,” Studia Sci. Math. Hung., vol. 1, pp. 185–188, 1966.
4. H. P. McKean, Jr., “Speed of approach to equilibrium for Kac's caricature of a Maxwellian gas,” Arch. Ration. Mech. Anal., vol. 21, pp. 343–367, 1966.
5. I. Csiszar, “Information-type measures of difference of probability distributions and indirect observations,” Studia Sci. Math. Hung., vol. 2, pp. 299–318, 1967.
6. J. H. B. Kemperman, “On the optimum rate of transmitting information,” Ann. Math. Statist., vol. 40, pp. 2156–2177, 1969.
7. S. Kullback, “A lower bound for discrimination information in terms of variation,” IEEE Trans. Inform. Theory (Corresp.), vol. IT-13, pp. 126–127, Jan. 1967.
8. ——, “Correction to a lower bound for discrimination information in terms of variation,” IEEE Trans. Inform. Theory (Corresp.) vol. IT-16, p. 652, Sept. 1970.
9. I. Vajda, “Note on discrimination information and variation,” IEEE Trans. Inform. Theory (Corresp.), vol. IT-16, pp. 771–773, Nov. 1970.
10. O. Krafft and N. Schmitz, “A note on Hoeffding's inequality,” J. Amer. Stat. Ass., vol. 64, pp. 907–912, Sept. 1969.
11. G. T. Toussaint, “Comments on the divergence and Bhattacharyya distance measures in signal selection,” IEEE Trans. Comm. Technol. (Corresp.), vol. COM-20, p. 485, June 1972.
12. S. Kullback, Information Theory and Statistics. New York: Wiley, 1959.
13. G. T. Toussaint, “On the divergence between two distributions and the probability of misclassification of several decision rules,” in Proc. 2nd Inter. Joint Conf. Pattern Recognition, Copenhagen, Denmark, Aug. 1974, pp. 27–34.