Properties of classical and quantum Jensen-Shannon divergence

Physical Review A - Atomic, Molecular, and Optical Physics

Volumn 79, Issue 5, 2009, Pages

  Briët, Jop ^a   Harremoës, Peter ^a  

^a CWI   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

DIVERGENCE MEASURES; JENSEN DIVERGENCE; JENSEN-SHANNON DIVERGENCE; KULLBACK DIVERGENCES; METRIC SPACES; PURE STATE; RELATIVE ENTROPY; TOTAL VARIATION; TRACE DISTANCES;

HILBERT SPACES; INFORMATION THEORY; METRIC SYSTEM; QUANTUM OPTICS; SET THEORY; TOPOLOGY;

PROBABILITY DISTRIBUTIONS;

EID: 66049090714     PISSN: 10502947     EISSN: 10941622     Source Type: Journal    
DOI: 10.1103/PhysRevA.79.052311     Document Type: Article

References (51)

1. D. M. Endres and J. E. Schindelin, IEEE Trans. Inf. Theory 49, 1858 (2003). 10.1109/TIT.2003.813506
2. R. G. Gallager, Information Theory and Reliable Communication (Wiley, New York, 1968).
3. J. Lin and S. K. M. Wong, Int. J. Gen. Syst. 17, 73 (1990). 10.1080/03081079008935097
4. J. Lin, IEEE Trans. Inf. Theory 37, 145 (1991). 10.1109/18.61115
5. F. Topsøe, IEEE Trans. Inf. Theory 46, 1602 (2000). 10.1109/18.850703
6. R. Sibson, Z. Wahrscheinlichkeitstheor. Verwandte Geb. 14, 149 (1969). 10.1007/BF00537520
7. A. K. C. Wong and M. You, IEEE Trans. Pattern Anal. Mach. Intell. PAMI-7, 599 (1985). 10.1109/TPAMI.1985.4767707
8. O. A. Rosso, H. A. Larrondo, M. T. Martin, A. Plastino, and M. A. Fuentes, Phys. Rev. Lett. 99, 154102 (2007). 10.1103/PhysRevLett.99.154102
9. R. El-Yaniv, S. Fine, and N. Tishby, Agnostic Classification of Markovian Sequences, NIPS (MIT Press, Cambridge, MA, 1997), pp. 465-471.
10. J. Burbea and C. R. Rao, IEEE Trans. Inf. Theory 28, 489 (1982). 10.1109/TIT.1982.1056497
11. A. Rényi, Proceedings of Fourth Berkeley Symposium on Mathematical Statistics and Probability (University of California Press, Berkeley, 1961), Vol. 1, pp. 547-561.
12. J. H. Havrda and F. Charvat, Kybernetika 3, 30 (1967).
13. C. Tsallis, J. Stat. Phys. 52, 479 (1988). 10.1007/BF01016429
14. J. Lindhard and V. Nielsen, K. Dan. Vidensk. Selsk. Mat. Fys. Medd. 38, 1 (1971).
15. J. Aczél and Z. Daróczy, On Measures of Information and Their Characterization, Mathematics in Science and Engineering Vol. 115 (Academic, New York, 1975).
16. M. Figueiredo, A. Martins, and P. Aguiarz, IEEE Information Theory Workshop, 2008 (unpublished), pp. 298-302.
17. A. Martins, P. Aguiar, and M. Figueiredo (unpublished).
18. A. F. T. Martins, M. A. T. Figueiredo, P. M. Q. Aguiar, N. A. Smith, and E. P. Xing, in Proceedings of the 25th International Conference on Machine Learning (ICML '08), edited by, A. McCallum, and, S. Roweis, (Omnipress, Madison, WI, 2008), pp. 640-647.
19. A. F. T. Martins, M. A. T. Figueiredo, P. M. Q. Aguiar, N. A. Smith, and E. P. Xing, Carnegie Mellon University Technical Report No. CMU-ML-08-106, 2008 (unpublished).
20. W. K. Wootters, Phys. Rev. D 23, 357 (1981). 10.1103/PhysRevD.23.357
21. S. L. Braunstein and C. M. Caves, Phys. Rev. Lett. 72, 3439 (1994). 10.1103/PhysRevLett.72.3439
22. J. Lee, M. S. Kim, and A. Brukner, Phys. Rev. Lett. 91, 087902 (2003). 10.1103/PhysRevLett.91.087902
23. A. P. Majtey, P. W. Lamberti, M. T. Martin, and A. Plastino, Eur. Phys. J. D 32, 413 (2005). 10.1140/epjd/e2005-00005-1
24. P. W. Lamberti, A. P. Majtey, A. Borras, M. Casas, and A. Plastino, Phys. Rev. A 77, 052311 (2008). 10.1103/PhysRevA.77.052311
25. B. Schumacher and M. D. Westmoreland, in Quantum Computation and Quantum Information: A Millennium Volume, Contemporary Mathematics, edited by, S. Lomonaco, and, H. E. Brandt, (American Mathematical Society, Providence, 2002).
26. A. P. Majtey, P. W. Lamberti, and D. P. Prato, Phys. Rev. A 72, 052310 (2005). 10.1103/PhysRevA.72.052310
27. P. W. Lamberti, M. Portesi, and J. Sparacino, e-print arXiv:0807.0583.
28. I. J. Schoenberg, Ann. Math. 36, 724 (1935). 10.2307/1968654
29. I. J. Schoenberg, Trans. Am. Math. Soc. 44, 522 (1938). 10.2307/1989894
30. T. Cover and J. A. Thomas, Elements of Information Theory (Wiley, New York, 1991).
31. A. S. Holevo, Probl. Inf. Transm. 9, 110 (1973).
32. A. S. Holevo, IEEE Trans. Inf. Theory 44, 269 (1998). 10.1109/18.651037
33. B. Schumacher and M. D. Westmoreland, Phys. Rev. A 56, 131 (1997). 10.1103/PhysRevA.56.131
34. B. Fuglede and F. Topsøe, Proceedings of 2004 International Symposium on Information Theory, 2004 (unpublished), p. 31.
35. F. Topsøe, Stud. Sci. Math. Hung. 2, 291 (1967).
36. F. Topsøe, Entropy 3, 162 (2001). 10.3390/e3030162
37. B. Schumacher, Phys. Rev. A 51, 2738 (1995). 10.1103/PhysRevA.51.2738
38. B. Schumacher and M. D. Westmoreland, Phys. Rev. A 64, 042304 (2001). 10.1103/PhysRevA.64.042304
39. M. J. Donald, Math. Proc. Cambridge Philos. Soc. 101, 363 (1987). 10.1017/S030500410006672X
40. M. Nielsen and I. L. Chuang, Quantum Computation and Quantum Information (Cambridge University Press, Cambridge, England, 2000).
41. This deviates from the notation used in. We do this for the sake of consistency with regard to the notation for probability distributions.
42. M. Ohya and D. Petz, Quantum Entropy and Its Use, Texts and Monographs in Physics (Springer-Verlag, Berlin, 1993).
43. M. Laurent and M. Deza, Geometry of Cuts and Metrics (Springer-Verlag, Berlin, 1997).
44. L. M. Blumenthal, Theory and Applications of Distance Geometry (Oxford University Press, London, 1953).
45. C. Berg, J. P. R. Christensen, and P. Ressel, Harmonic Analysis on Semigroups (Springer-Verlag, New York, 1984).
46. K. Menger, Géométrie Générale (Gauthier-Villars, Paris, 1954).
47. A. E. Nussbaum, J. Anal. Math. 25, 277 (1972). 10.1007/BF02790041
48. B. Fuglede, Exp. Math. 23, 23 (2005).
49. The calculation of the Taylor expansion involves a lot of computations but are easily performed using MAPLE or similar symbol manipulation program.
50. D. Petz, Quantum Information Theory and Quantum Statistics (Springer, Berlin, 2008).
51. H. Klauck, A. Nayak, A. Ta-Shma, and D. Zuckerman, IEEE Trans. Inf. Theory 53, 1970 (2007). 10.1109/TIT.2007.896888