Rényi's divergence and entropy rates for finite alphabet Markov sources

IEEE Transactions on Information Theory

Volumn 47, Issue 4, 2001, Pages 1553-1561

  Rached, Z ^a   Alajaji, F ^a   Campbell, L L ^a  

^a QUEEN S UNIVERSITY   (Canada)

Author keywords

Kullback Leibler divergence rate; Nonnegative matrices; Perron Frobenius theory; R nyi's divergence and entropy rates; Shannon and Hartley entropy rates; Time invariant Markov sources

Indexed keywords

CALCULATIONS; ENCODING (SYMBOLS); MARKOV PROCESSES; MATRIX ALGEBRA; NUMERICAL METHODS; OPTIMAL SYSTEMS; PROBABILITY DISTRIBUTIONS; SET THEORY; THEOREM PROVING;

FINITE ALPHABET MARKOV SOURCES; HARTLEY ENTROPY RATES; KULLBACK-LEIBLER DIVERGENCE RATE; NONNEGATIVE MATRIX; PERRON-FROBENIUS THEORY; RENYI DIVERGENCE RATES; RENYI ENTROPY RATES; SHANNON ENTROPY RATES; TIME INVARIANT MARKOV SOURCES;

INFORMATION THEORY;

EID: 0035333562     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.923736     Document Type: Letter

References (23)

1. An inequality on guessing and its application to sequential decoding
2. Rényi's entropy and the probability of error
3. The Rényi redundancy of generalized Huffman codes
4. A coding theorem and Rényi's entropy
5. Csiszár's cutoff rates for arbitrary discrete sources
6. Generalized cutoff rates and Rényi's information measures
7. Error exponents of modulo-additive noise channels with side information at the transmitter
8. Buffer overflow in variable length coding of fixed rate sources
9. Asymptotic rate of discrimination for Markov processes
10. On the α-divergence rate for Markov-dependent hypotheses
11. Using Rényi entropies to measure uncertainty in search problems
12. Rényi's entropy rate for discrete Markov sources
13. On measures of entropy and information
14. On some inequalities and generalized entropies: A unified approach