Further results on generalized conditional entropies

RAIRO - Theoretical Informatics and Applications

Volumn 49, Issue 1, 2015, Pages 67-92

  Rastegin, Alexey E ^a  

^a IRKUTSK STATE UNIVERSITY   (Russian Federation)

Author keywords

Entropy rate; Error probability; Fano inequality; Index of coincidence; R nyi entropy; Tsallis Havrda Charv t entropy

Indexed keywords

QUANTUM OPTICS; SIGNAL THEORY;

CONDITIONAL ENTROPY; ENTROPY RATES; ERROR PROBABILITIES; FANO INEQUALITY; FOUNDATIONS OF QUANTUM MECHANICS; INDEX OF COINCIDENCE; MIN-ENTROPY; OF QUANTUM-INFORMATION;

ENTROPY;

EID: 84924787374     PISSN: None     EISSN: 28047346     Source Type: Journal    
DOI: 10.1051/ita/2014029     Document Type: Article

References (45)

1. N. Alon and J.H. Spencer, The Probabilistic Method, 3rd edition. John Wiley & Sons, Hoboken (2008).
2. D. Bacon and W. van Dam, Recent progress in quantum algorithms. Commun. ACM 53 (2010) 84-93.
3. M. Ben-Bassat and J. Raviv, Rényi's entropy and error probability. IEEE Trans. Inf. Theory 24 (1978) 324-331.
4. I. Bengtsson and K. Życzkowski, Geometry of Quantum States: An Introduction to Quantum Entanglement. Cambridge University Press, Cambridge (2006).
5. S.L. Braunstein and C.M. Caves, Information-theoretic Bell inequalities. Phys. Rev. Lett. 61 (1988) 662-665.
6. F. Buscemi, M.J.W. Hall, M. Ozawa and M.M. Wilde, Noise and disturbance in quantum measurements: An information-theoretic approach. Phys. Rev. Lett. 112 (2014) 050401.
7. C. Cachin, Entropy measures and unconditional security in cryptography. Ph.D. thesis, Swiss Federal Institute of Technology, Zürich (1997).
8. R. Chaves and T. Fritz, Entropic approach to local realism and noncontextuality. Phys. Rev. A 85 (2012) 032113.
9. R. Chaves and T. Fritz, Entropic inequalities and marginal problems. IEEE Trans. Inf. Theory 59 (2013) 803-817.
10. I. Csiszár, Information-type measures of difference of probability distributions and indirect observations. Studia Sci. Math. Hungar. 2 (1967) 299-318.
11. I. Csiszár, Axiomatic characterizations of information measures. Entropy 10 (2008) 261-273.
12. T.M. Cover and J.A. Thomas, Elements of Information Theory. John Wiley & Sons, New York (1991).
13. Z. Daróczy, Generalized information functions. Inform. Control 16 (1970) 36-51.
14. Z. Daróczy, Inequalities for some infinite series. Acta Math. Hungar. 75 (1997) 5-8.
15. D. de Falco and D. Tamascelli, An introduction to quantum annealing. RAIRO: ITA 45 (2011) 99-116.
16. D. Erdogmus and J.C. Principe, Lower and upper bounds for misclassification probability based on Rényi's information. J. VLSI Signal Process. 37 (2004) 305-317.
17. R.M. Fano, Transmission of Information: A Statistical Theory of Communications. MIT Press and John Wiley & Sons, New York (1961).
18. M. Feder and N. Merhav, Relations between entropy and error probability. IEEE Trans. Inf. Theory 40 (1994) 259-266.
19. S. Furuichi, Information-theoretical properties of Tsallis entropies. J. Math. Phys. 47 (2006) 023302.
20. M. Gell-Mann and C. Tsallis, Nonextensive Entropy - Interdisciplinary Applications. Oxford University Press, Oxford (2004).
21. I.M. Georgescu, S. Ashhab and F. Nori, Quantum simulation. Rev. Mod. Phys. 86 (2014) 153-185.
22. L. Golshani, E. Pasha and G. Yari, Some properties of Rényi entropy and Rényi entropy rate. Inf. Sci. 179 (2009) 2426-2433.
23. P. Harremoës and F. Topsøe, Inequalities between entropy and index of coincidence derived from information diagrams. IEEE Trans. Inf. Theory 47 (2001) 2944-2960.
24. J. Havrda and F. Charvát, Quantification methods of classification processes: concept of structural α-entropy. Kybernetika 3 (1967) 30-35.
25. F. Hiai, M. Mosonyi, D. Petz and C. Bény, Quantum f-divergences and error correction. Rev. Math. Phys. 23 (2011) 691-747.
26. S.-W. Ho and S. Verdú, On the interplay between conditional entropy and error probability. IEEE Trans. Inf. Theory 56 (2011) 5930-5942.
27. S.-W. Ho and R.W. Yeung, On the discontinuity of the Shannon information measures. IEEE Trans. Inf. Theory 55 (2009) 5362-5374.
28. P. Jizba and T. Arimitsu, The world according to Rényi: thermodynamics of multifractal systems. Ann. Phys. 312 (2004) 17-59
29. R. Kamimura, Minimizing α-information for generalization and interpretation. Algorithmica 22 (1998) 173-197.
30. S. Kullback and R. A. Leibler, On information and sufficiency. Ann. Math. Stat. 22 (1951) 79-86.
31. H. Maassen and J.B. M. Uffink, Generalized entropic uncertainty relations. Phys. Rev. Lett. 60 (1988) 1103-1106.
32. A.W. Marshall, I. Olkin and B.C. Arnold, Inequalities: Theory of Majorization and Its Applications, 2nd edition. Springer-Verlag, New York (2011).
33. M. Matíc, C.E.M. Pearce and J. Pěcaríc, On an inequality for the entropy of a probability distribution. Acta Math. Hungar. 85 (1999) 345-349.
34. J. Radhakrishnan, An entropy proof of Brégman's theorem. J. Comb. Theory Ser. A 77 (1997) 161-164.
35. A.E. Rastegin, Convexity inequalities for estimating generalized conditional entropies from below. Kybernetika 48 (2012) 242-253
36. A.E. Rastegin, Bounds of the Pinsker and Fannes types on the Tsallis relative entropy. Math. Phys. Anal. Geom. 16 (2013) 213-228.
37. A.E. Rastegin, Uncertainty relations for MUBs and SIC-POVMs in terms of generalized entropies. Eur. Phys. J. D 67 (2013) 269.
38. A.E. Rastegin, Tests for quantum contextuality in terms of q-entropies. Quantum Inf. Comput. 14 (2014) 0996-1013.
39. A. Rényi, On measures of entropy and information, in Proc. of the 4th Berkeley Symposium on Mathematical Statistics and Probability, edited by J. Neyman. University of California Press, Berkeley CA (1961) 547-561.
40. A. Rényi, Statistics and information theory. Studia Sci. Math. Hungar. 2 (1967) 249-256.
41. W. Shitong and F.L. Chung, Note on the equivalence relationship between Rényi-entropy based and Tsallis-entropy based image thresholding. Pattern Recognit. Lett. 26 (2005) 2309-2312.
42. A. Teixeira, A. Matos and L. Antunes, Conditional Rényi entropies. IEEE Trans. Inf. Theory 58 (2012) 4273-4277.
43. C. Tsallis, Possible generalization of Boltzmann-Gibbs statistics. J. Stat. Phys. 52 (1988) 479-487.
44. I. Vajda, Bounds of the minimal error probability on checking a finite or countable number of hypotheses. Problemy Peredači Informacii 4 (1968) 9-19, (in Russian); translated as Probl. Inf. Transm. 4 (1968) 6-14.
45. K. Życzkowski, Rényi extrapolation of Shannon entropy. Open Sys. Inf. Dyn. 10 (2003) 297-310, corrigendum in arXiv:quant-ph/0305062v2.