The constrained entropy and cross-entropy functions

Physica A: Statistical Mechanics and its Applications

Volumn 334, Issue 3-4, 2004, Pages 444-458

  Niven, Robert K ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Information theory; Kullback Leibler cross entropy; Shannon entropy; Statistical mechanics; Thermodynamics; Tsallis entropy

Indexed keywords

FUNCTIONS; OPTIMIZATION; PROBABILITY; PROBLEM SOLVING; STATISTICAL MECHANICS;

INFORMATION THEORIES; KULLBACK-LEIBLER CROSS-ENTROPY; SHANNON ENTROPY; TSALLIS ENTROPY;

ENTROPY;

EID: 0742268380     PISSN: 03784371     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physa.2003.11.011     Document Type: Article

References (19)

1. Shannon C.E. Bell Syst. Tech. J. 27:1948;379, 623.
2. Kullback S., Leibler R.A. Ann. Math. Stat. 22:1951;79.
3. Kullback S. Information Theory and Statistics. 1959;Wiley, NY.
4. Jaynes E.T. Phys. Rev. 106:1957;620.
5. Tribus M. J. Appl. Mech. Trans. ASME. 28:1961;1.
6. Tribus M. Thermostatics and Thermodynamics. 1961;D. Van Nostrand Co. Inc. Princeton, NJ.
7. Kapur J.N., Kesevan H.K. Entropy Optimization Principles with Applications. 1992;Academic Press, Inc. Boston, MA.
8. Young J.F. Information Theory. 1971;Butterworths, London, UK.
9. Yaglom A.M., Yaglom I.M. Probability and Information. 1983;D. Reidel Publishing Co., Kluwer Academic Publishers, Dordrecht, Netherlands.
10. Arndt C. Information Measures: Information and its Description in Science and Engineering. 2001;Springer, Berlin.
11. Tsallis C. J. Stat. Phys. 52(1/2):1988;479.
12. Tsallis C., Mendes R.S., Plastino A.R. Physica A. 261:1998;534.
13. Curado E.M.F., Tsallis C. J. Phys. A: Math. Gen. 24:1991;L69. corrigendum 24 (1991) 3187; 25 (1992) 1019.
14. dos Santos R.J.V. J. Math. Phys. 38(8):1997;4104.
15. Tsallis C. Braz. J. Phys. 29(1):1999;1.
16. Atkins P.W. Physical Chemistry. 2nd Edition:1982;Oxford University Press, Oxford. (Chapter 20, Appendix A1).
17. Zwillinger D. CRC Standard Mathematical Tables and Formulae. 2003;Chapman & Hall/CRC Press, Boca Raton, FL.
18. Gaveau B., Martinás K., Moreau M. J. Tóth, Physica A. 305:2002;445.
19. Weinstock R. Calculus of Variations, with Applications to Physics and Engineering. 1974;Dover Publications, Inc. NY.