The reliability functions of the general source with fixed-length coding

IEEE Transactions on Information Theory

Volumn 46, Issue 6, 2000, Pages 2117-2132

  Sun Han, Te ^a  

^a UNIVERSITY OF ELECTRO COMMUNICATIONS   (Japan)

Author keywords

Countably infinite alphabet; Fixed length source coding; General source; Information spectrum; Information spectrum slicing; Large deviation; Reliability function

Indexed keywords

PROBABILITY; RELIABILITY; SIGNAL ENCODING; SPECTRUM ANALYSIS;

FIXED-LENGTH SOURCE CODING;

INFORMATION THEORY;

EID: 0034271988     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.868482     Document Type: Article

References (17)

1. T. S. Han and S. Verdu, Approximation theory of output statistics, IEEE Trans. Inform. Theory, vol. 39, pp. 752-772, May 1993.
2. G. Longo and A. Sgarro, The source coding revisited: A combinatorial approach, IEEE Trans. Inform. Theory, vol. IT-25, pp. 544-548, Sept. 1979.
3. I. Csiszâr and G. Longo, On the error exponent for source coding and for testing simple statistical hypotheses, Studio Sci. Math. Hangar., vol. 6, pp. 181-191, 1971.
4. L. D. Davisson, G. Longo, and A. Sgarro, The error exponent for the noiseless encoding of finite ergodic Markov sources, IEEE Trans. Inform. Theory, vol. IT-27, pp. 431-438, July 1981.
5. S. Verdü and T. S. Han, The role of the asymptotic equipartition property in noiseless source coding, IEEE Trans. Inform. Theory, vol. 43, pp. 847-857, May 1997.
6. N. Merhav, Universal coding with minimum probability of codeword length overflow, IEEE Trans. Inform. Theory, vol. 37, pp. 556-563, May 1991.
7. J. A. Bucklew, Large Deviation Techniques in Decision, Simulation and Estimation. New York: Wiley, 1990.
8. A. Dembo and O. Zeitouni, Large Deviations Techniques and Applications. Boston, MA: Jones and Bartlett, 1993.
9. S. Verdü and T. S. Han, A general formula for channel capacity, IEEE Trans. Inform. Theory, vol. 40, pp. 1147-1157, July 1994.
10. I. Csiszâr and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
11. S. Natarajan, Large deviations, hypotheses testing, and source coding for finite Markov chains, IEEE Trans. Inform. Theory, vol. IT-31, pp. 360-365, May 1985.
12. T. S. Han, An information-spectrum approach to source coding theorems with a fidelity criterion, IEEE Trans. Inform. Theory, vol. 43, pp. 1145-1164, July 1997.
13. _, An information-spectrum approach to capacity theorems for the general multiple-access channel, IEEE Trans. Inform. Theory, vol. 44, pp. 2773-2795, Nov. 1998.
14. _, Information-Spectrum Methods in Information Theory (in Japanese). Tokyo, Japan: Baifukan , 1998.
15. _, Basic Considerations on Large Deviation Theorems," (in Japanese), Univ. Electro-Commun., Chofu, Tokyo, Japan, IS Tech. Reps. UEC-IS-1998-4, Oct. 1998.
16. Y Steinberg and S. Verdü, Simulation of random processes and ratedistortion theory, IEEE Trans. Inform. Theory, vol. 42, pp. 63-86, Jan. 1996.
17. O. Uchida and T. S. Han, The optimal overflow and underflow probabilities with variable-length coding for the general source, Probl. Inform. Transm., 1999.