On scale and concentration invariance in entropies

Information Sciences

Volumn 152, Issue SUPPL, 2003, Pages 139-144

  Knockaert, Luc ^a  

^a IMEC   (Belgium)

Author keywords

Information; Invariance; R nyi entropy; Shannon entropy

Indexed keywords

DATA PROCESSING; ENTROPY; MATHEMATICAL TECHNIQUES;

SHANNON ENTROPY;

CRYPTOGRAPHY;

EID: 0038036652     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0020-0255(03)00058-6     Document Type: Article

References (8)

1. A. Rényi, On measures of entropy and information, in: Proc. 4th Berkeley Symp. Math. Stat. and Prob., vol. 1, 1961, pp. 547-561.
2. Cachin C. Entropy Measures and Unconditional Security in Cryptography. 1997;Hartung-Gorre Verlag, Konstanz.
3. Knockaert L. Comments on "resolution in time-frequency" IEEE Trans. Signal Process. 12:2000;3585.
4. Baraniuk R.-G., Flandrin P., Janssen A.J.E.M., Michel O. Measuring time-frequency information content using the Rényi entropies. IEEE Trans. Inf. Theory. 4:2001;1391-1409.
5. Mayoral M.-M. Rényi's entropy as an index of diversity in simple-stage cluster sampling. Inf. Sci. 105:1998;101-114.
6. Dembo A., Cover T.-M., Thomas J.-A. Information theoretic inequalities. IEEE Trans. Inf. Theory. 6:1991;1501-1518.
7. Basseville M. Distance measures for signal processing and pattern recognition. Signal Process. 18:1989;349-369.
8. Tsallis C. Possible generalization of Boltzmann-Gibbs statistics. J. Stat. Phys. 52:1988;479-487.