Relative information of type s, Csiszár's f -divergence, and information inequalities

Information Sciences

Volumn 166, Issue 1-4, 2004, Pages 105-125

  Taneja, Inder Jeet ^a   Kumar, Pranesh ^b  

^a FEDERAL UNIVERSITY OF SANTA CATARINA   (Brazil)

^b UNIVERSITY OF NORTHERN BRITISH COLUMBIA   (Canada)

Author keywords

2 divergence; Csisz r's f divergence; Hellinger's discrimination; Information inequalities; Relative information; Relative information of type s

Indexed keywords

GRAPH THEORY; PARAMETER ESTIMATION; PROBABILITY; PROBLEM SOLVING; QUALITY CONTROL; TREES (MATHEMATICS);

CSISZAR'S F-DIVERGENCE; HELLINGER'S DISCRIMINATION; INFORMATION INEQUALITIES; RELATIVE INFORMATION; RELATIVE INFORMATION OF TYPE S;

DATA PROCESSING;

EID: 4944260835     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2003.11.002     Document Type: Article

References (22)

1. Bhattacharyya A. Some analogues to the amount of information and their uses in statistical estimation. Sankhya. 8:1946;1-14.
2. P. Cerone, S.S. Dragomir, F. Österreicher, Bounds on extended f -divergences for a variety of classes, RGMIA Research Report Collection, 6(1), Article 7, 2003.
3. Csiszár I. Information type measures of differences of probability distribution and indirect observations. Studia Math. Hungarica. 2:1967;299-318.
4. Csiszár I., Körner J. Information Theory: Coding Theorems for Discrete Memoryless Systems. 1981;Academic Press, New York.
5. S.S. Dragomir, Some inequalities for the Csiszár Φ -divergence, Inequalities for Csiszár f -Divergence in Information Theory. Available from < http://rgmia.vu.edu.au/monographs/csiszar.htm >.
6. S.S. Dragomir, A converse inequality for the Csiszár Φ -divergence, Inequalities for Csiszár f -Divergence in Information Theory. Available from < http://rgmia.vu.edu.au/monographs/csiszar.htm >.
7. S.S. Dragomir, Some inequalities for (m,M) -convex mappings and applications for the Csiszár Φ -divergence in information theory, Inequalities for Csiszár f -Divergence in Information Theory. Available from < http://rgmia.vu.edu.au/monographs/csiszar.htm >.
8. S.S. Dragomir, Upper and lower bounds for Csiszár f -divergence in terms of the Kullback-Leibler distance and applications, Inequalities for Csiszár f -Divergence in Information Theory. Available from < http://rgmia.vu.edu.au/monographs/csiszar.htm >.
9. S.S. Dragomir, Upper and lower bounds for Csiszár f -divergence in terms of Hellinger discrimination and applications, Inequalities for Csiszár f -Divergence in Information Theory. Available from < http://rgmia.vu.edu.au/monographs/csiszar.htm >.
10. Hellinger E. Neue Begründung der Theorie der quadratischen Formen von unendlichen vielen Veränderlichen. J. Reine Aug. Math. 136:1909;210-271.
11. Jeffreys H. An invariant form for the prior probability in estimation problems. Proc. Roy. Soc. Lond., Ser. A. 186:1946;453-461.
12. Kullback S., Leibler R.A. On information and sufficiency. Ann. Math. Stat. 22:1951;79-86.
13. F. Liese, I. Vajda, Convex Statistical Decision Rules, Teubner-Texte zur Mathematick, Band 95, Leipzig, 1987.
14. Pearson K. On the Criterion that a given system of deviations from the probable in the case of correlated system of variables is such that it can be reasonable supposed to have arisen from random sampling. Philos. Mag. 50:1900;157-172.
15. F. Österreicher, Csiszár's f -Divergence, Basic Properties, pre-print, 2002. Available from < http://rgmia.vu.edu.au >.
16. Rényi A. On measures of entropy and information. Proc. 4th Berk. Symp. Math. Stat. Probl. vol. 1:1961;547-561 University of California Press.
17. Sharma B.D., Autar R. Relative information function and their type. (α,β) generalizations Metrika. 21:1974;41-50.
18. Taneja I.J. Some contributions to information Theory - I (a survey: on measures of information). J. Comb. Inf. Syst. Sci. (India). 4:1979;253-274.
19. Taneja I.J. On generalized information measures and their applications. Hawkes P.W. Advances in Electronics and Electron Physics. 76:1989;327-413 Academic Press, USA.
20. Taneja I.J. New developments in generalized information measures. Hawkes P.W. Advances in Imaging and Electron Physics. 91:1995;37-135.
21. I.J. Taneja, Generalized Information Measures and their Applications, 2001. On line book: http://www.mtm.ufsc.br/~taneja/book/book.html.
22. Vajda I. Theory of Statistical Inference and Information. 1989;Kluwer Academic Press, London.