Generalized statistics framework for rate distortion theory

Physica A: Statistical Mechanics and its Applications

Volumn 388, Issue 12, 2009, Pages 2337-2353

  Venkatesan, R C ^a   Plastino, A ^b  

^a Systems Research Corporation   (India)

^b UNIVERSIDAD NACIONAL DE LA PLATA   (Argentina)

Author keywords

Additive duality; Compression information; Distortion compression plane; Generalized Tsallis statistics; Nonextensive alternating minimization algorithm; Rate distortion

Indexed keywords

IMAGE CODING; SIGNAL DISTORTION;

ALTERNATING MINIMIZATION; ALTERNATING MINIMIZATION ALGORITHMS; LOSSY COMPRESSIONS; NONEXTENSIVE STATISTICS; RATE DISTORTION-THEORY; RATE DISTORTIONS; TSALLIS STATISTICS; VARIATIONAL PRINCIPLES;

ELECTRIC DISTORTION;

EID: 63749116085     PISSN: 03784371     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physa.2009.02.003     Document Type: Article

References (45)

1. Tsallis C. J. Stat. Phys. 542 (1988) 479
2. In: Gell-Mann M., and Tsallis C. (Eds). Nonextensive Entropy-Interdisciplinary Applications (2004), Oxford University Press, Oxford
3. Cover T., and Thomas J. Elements of Information Theory (1991), John Wiley & Sons, New York, NY
4. Berger T. Rate Distortion Theory (1971), Prentice-Hall, Englewood Cliffs, NJ
5. Rose K., Gurewitz E., and Fox G.C. Phys. Rev. Lett. 65 (1990) 945
6. Rose K. Proc. IEEE 86 11 (1999) 2210
7. N. Tishby, F.C. Pereira, W. Bialek, The information bottleneck method, in: Proceedings of the 37th Annual Allerton Conference on Communication, Control and Computing, Urbana, IL, 1999, pp. 368-377
8. Blahut R.E. IEEE Trans. Inform. Theory IT18 (1972) 460
9. Csiszár I., and Tusnády G. Statist. Decisions 1 (1984) 205
10. Landsberg P.T., and Vedral V. Phys. Lett. A 247 (1998) 211
11. Yamano T. Phys. Rev. E 63 (2001) 046105
12. Furuichi S. J. Math. Phys. 47 (2006) 023302
13. Furuichi S. Linear Algebra Appl. 418 (2006) 821
14. Suyari H. IEEE Trans. Inform. Theory 50 8 (2004) 1783
15. Yamano T. Physica A 305 (2002) 190
16. R.C. Venkatesan, Nonextensive variational principles for rate distortion theory and the information bottleneck method, in: Proceedings IEEE Symposium on the Foundations of Computational Intelligence, FOCI, Honolulu, HW, 2007, pp. 509-515
17. Curado E.M.F., and Tsallis C. J. Phys. A 24 (1991) L69
18. Tsallis C., Mendes R.S., and Plastino A.R. Physica A 261 (1998) 534
19. Martínez S., Nicolás F., Pennini F., and Plastino A. Physica A 286 (2000) 489
20. Lenzi E.K., Mendes R.S., and da Silva L.R. Physica A 280 (2000) 337
21. Ferri G.L., Martinez S., and Plastino A. J. Stat. Mech. Theory Exp. 2005 04 (2005) P04009
22. Wada T., and Scarfone A.M. Eur. Phys. J. B 47 (2005) 557
23. Bashkirov A.G. Physica A 340 (2004) 153
24. Di Sisto R.P., Martinez S., Orellana R.B., Plastino A.R., and Plastino A. Physica A 265 (1999) 590
25. Abe S. Phys. Rev. E 66 4 (2002) 046134
26. Yamano T. Phys. Lett. A 329 (2004) 268
27. Wada T., and Scarfone A.M. Phys. Lett. A 235 (2005) 351
28. Naudts J. Physica A 316 (2002) 323
29. Naudts J. Physica A 340 (2004) 32
30. Tsallis C. Phys. Rev. E 58 (1998) 1442
31. Borland L., Plastino A., and Tsallis C. J. Math. Phys. 39 (1998) 6490
32. Borges E. Physica A 340 (2004) 95
33. Furuichi S. IEEE Trans. Inform. Theory 51 (2005) 3638
34. Abe S., and Bagçi G.B. Phys. Rev. E 71 (2005) 016139
35. Daróczy Z. Inf. Control 16 (1970) 36
36. Li M., and Vitanyi P. An Introduction to Kolmogorov Complexity and Its Applications (1997), Springer Verlag, New York, NY
37. Kaniadakis G., Lissia M., and Scarfone A.M. Phys. Rev. E 71 (2005) 048128
38. Dukkipati A., Narasimha Murty M., and Bhatnagar S. Physica A 361 (2006) 124
39. McLachlan G.J., and Krishnan T. The EM Algorithm and Extensions (1996), John Wiley & Sons, New York, NY
40. Mackay D.J.C. Information Theory Inference and Learning Algorithms (2003), Cambridge University Press, Cambridge, UK
41. Rose K. IEEE Trans. Inform. Theory 40 6 (1994) 1939
42. Banerjee A., Merugu S., Dhillon I., and Ghosh J. J. Mach. Learn. Res. (JMLR) 6 (2005) 1705
43. Neal R.M., and Hinton G.E. A view of the EM algorithm that justifies incremental, sparse, and other variants. In: Jordan M.I. (Ed). Learning in Graphical Models (1998), Kluwer Academic Publishers, Dordrecht 355-368
44. Azoury K.S., and Warmuth M.K. Mach. Learn. 43 3 (2001) 211
45. Naudts J. Rev. Math. Phys. 16 (2004) 809