On some entropy functionals derived from Rényi information divergence

Information Sciences

Volumn 178, Issue 12, 2008, Pages 2489-2506

  Bercher, J F ^a  

^a UNIV PARIS SUD   (France)

Author keywords

Maximum entropy principle; Nonextensivity; R nyi divergences; R nyi entropy; Tsallis distributions

Indexed keywords

NUMERICAL METHODS; PROBABILITY DISTRIBUTIONS; PROBLEM SOLVING; STATISTICS;

ENTROPY FUNCTIONALS; OPTIMUM DISTRIBUTIONS; TSALLIS DISTRIBUTIONS;

INFORMATION SCIENCE;

EID: 41749090011     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2008.02.003     Document Type: Article

References (38)

1. Asadi M., and Bayramoglu I. The mean residual life function of a k-out-of-n structure at the system level. IEEE Transactions on Reliability 55 (2006) 314-318
2. Banerjee A., Merugu S., Dhillon I.S., and Ghosh J. Clustering with Bregman divergences. Journal of Machine Learning Research 6 (2005) 1705-1749
3. Baraniuk R., Flandrin P., Janssen A., and Michel O. Measuring time-frequency information content using the Rényi entropies. IEEE Transactions on Information Theory 47 (2001) 1391-1409
4. Bashkirov A.G. On maximum entropy principle, superstatistics, power-law distribution and Rényi parameter. Physica A 340 (2004) 153-162
5. Basseville M. Distance measures for signal processing and pattern recognition. Signal Processing 18 (1989) 349-369
6. Beck C. Generalized statistical mechanics of cosmic rays. Physica A 331 (2004) 173-181
7. Bhandari D., and Pal N.R. Some new information measures for fuzzy sets. Information Sciences 67 (1993) 209-228
8. Cebrian A.C., Denuit M., and Lambert P. Generalized pareto fit to the society of actuaries' large claims database. North American Actuarial Journal 7 (2003) 18-36
9. Csiszár I. Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems. Annals of Statistics 19 (1991) 2032-2066
10. Csiszár I. Generalized cutoff rates and Rényi's information measures. IEEE Transactions on Information Theory 41 (1995) 26-34
11. Ellis R.S. Entropy, Large Deviations, and Statistical Mechanics. Grundlehren der mathematischen Wissenschaften vol. 271 (1985), Springer-Verlag
12. Esteban M.D. Divergence statistics based on entropy functions and stratified sampling. Information Sciences 87 (1995) 185-203
13. Golan A., and Perloff J.M. Comparison of maximum entropy and higher-order entropy estimators. Journal of Econometrics 107 (2002) 195-211
14. Grendar M., and Grendar M. Maximum entropy method with non-linear moment constraints: challenges. AIP Conference Proceedings (2004)
15. He Y., Hamza A., and Krim H. A generalized divergence measure for robust image registration. IEEE Transactions on Signal Processing 51 (2003) 1211-1220 see also Acoustics, Speech, and Signal Processing
16. Jaynes E.T. Information theory and statistical mechanics. Physical Review 108 (1957) 171
17. Jaynes E.T. On the rationale of maximum entropy methods. Proceedings of the IEEE 70 (1982) 939-952
18. Jizba P., and Arimitsu T. The world according to Rényi: thermodynamics of multifractal systems. Annals of Physics 312 (2004) 17-59
19. Krishnamachari A., moy Mandal V., and Karmeshu. Study of dna binding sites using the Rényi parametric entropy measure. Journal of Theoretical Biology 227 (2004) 429-436
20. Kullback S. Information Theory and Statistics (1959), Wiley, New York
21. LaCour B. Statistical characterization of active sonar reverberation using extreme value theory. IEEE Journal of Oceanic Engineering 29 (2004) 310-316
22. Mayoral M.M. Rényi's entropy as an index of diversity in simple-stage cluster sampling. Information Sciences 105 (1998) 101-114
23. Molina I., and Morales D. Rényi statistics for testing hypotheses in mixed linear regression models. Journal of Statistical Planning and Inference 137 (2007) 87-102
24. Montfort M.A.J.V., and Witter J.V. Generalized Pareto distribution applied to rainfall depths. Hydrological Sciences Journal 31 (1986) 151-162
25. Nadarajah S., and Zografos K. Formulas for Rényi information and related measures for univariate distributions. Information Sciences 155 (2003) 119-138
26. Nadarajah S., and Zografos K. Expressions for Rényi and Shannon entropies for bivariate distributions. Information Sciences 170 (2005) 173-189
27. Nanda A.K., and Maiti S.S. Rényi information measure for a used item. Information Sciences 177 (2007) 4161-4175
28. Naudts J. Dual description of nonextensive ensembles. Chaos, Solitons, & Fractals 13 (2002) 445-450
29. Neemuchwala H., Hero A., and Carson P. Image matching using alpha-entropy measures and entropic graphs. Signal Processing 85 (2005) 277-296
30. Nock R., and Nielsen F. On weighting clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 28 (2006) 1223-1235
31. G.A. Raggio, On equivalence of thermostatistical formalisms, 1999. .
32. Rényi A. On Measures of Entropy and Information (1961), University of California Press, Berkeley, CA
33. Song K.-S. Rényi information, loglikelihood and an intrinsic distribution measure. Journal of Statistical Planning and Inference 93 (2001) 51-69
34. Tsallis C. Possible generalization of Boltzmann-Gibbs statistics. Journal of Statistical Physics 52 (1988) 479-487
35. Tsallis C. Entropic nonextensivity: a possible measure of complexity. Chaos, Solitons, & Fractals 13 (2002) 371-391
36. Tsallis C., Mendes R.S., and Plastino A.R. The role of constraints within generalized nonextensive statistics. Physica A 261 (1998) 534-554
37. Vignat C., Hero A., and Costa J.A. About closedness by convolution of the Tsallis maximizers. Physica A 340 (2004) 147-152
38. Vinga S., and Almeida J.S. Rényi continuous entropy of DNA sequences. Journal of Theoretical Biology 231 (2004) 377-388