On the ε-Entropy and the Rate-Distortion Function of Certain Non-Gaussian Processes

IEEE Transactions on Information Theory

Volumn 20, Issue 4, 1974, Pages 517-524

  Binia, Jacob ^a   Zakai, Moshe ^b   Ziv, Jacob ^b  

^a RAFAEL   (Israel)

^b TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION THEORY;

EID: 0016082573     PISSN: 00189448     EISSN: 15579654     Source Type: Journal    
DOI: 10.1109/TIT.1974.1055249     Document Type: Article

References (21)

1. T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression. Englewood Cliffs, N.J.: Prentice-Hall, 1970.
2. C. E. Shannon and W. Weaver, The Mathematical Theory of Communication. Urbana, Ill.: Univ. of Illinois Press, 1949.
3. C. E. Shannon, “Coding theorems for a discrete source with a fidelity criterion,” IRE Nat. Conv. Rec., pt. 4. pp. 142–163, 1959.
4. A. M. Gerrish and P. M. Schultheiss, “Information rates of non-Gaussian processes,” IEEE Trans. Inform. Theory, vol. IT-10, pp. 265–271. Oct. 1964.
5. Y. N. Lin'kov, “Evaluation of ε-entropy of random variables for small ε,” Probl. Peredach. Inform., vol. 1, p. 12, Apr.-June 1965.
6. A. N. Kolmogorov, “On the Shannon theory of information transmission in the case of continuous signals,” IRE Trans. Inform. Theory, vol. IT-2, pp. 102–108, Dec. 1956.
7. M. S. Pinsker, “Gaussian sources,” Probl. Peredach. Inform., vol. 14, pp. 59–100, 1963.
8. S. Ihara, “On ε-entropy of equivalent Gaussian processes,” Nagoya Math. J., vol. 37, pp. 121–130, 1970.
9. J. Binia, M. Zakai, and J. Ziv, “Bounds on the ε -entropy of Wiener and RC processes,” IEEE Trans. Inform. Theory (Corresp.), vol. IT-19, pp. 359–362, May 1973.
10. J. Binia, “On the ε-entropy of certain Gaussian processes,” IEEE Trans. Inform. Theory, vol. IT-20, pp. 190–196, Mar. 1974.
11. A. V. Skorokhod, Studies in the Theory of Random Processes. Reading, Mass.: Addison-Wesley, 1965, ch. 4.
12. T. Kailath, “The structure of Radon-Nikodym derivatives with respect to Wiener and related measures,” Ann. Math. Statist., vol. 42, no. 3, pp. 1054–1067.
13. T. E. Duncan, “Evaluation of likelihood functions,” Inform. Contr., vol. 13, pp. 62–74, 1968.
14. M. S. Pinsker, Information and Information Stability of Random Variables and Processes. New York: Holden-Day, 1964.
15. A. N. Kolmogorov, “Theory of transmission of information,” Amer. Math. Soc. Transl., ser. 2, vol. 33, pp. 291–321.
16. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
17. M. S. Pinsker, “Communication sources,” Probl. Peredach. Inform., vol. 14, pp. 5–20, 1963.
18. A. M. Yaglom, “On the equivalence and perpendicularity of two Gaussian probability measures in function space,” in Proc. Symp. Time Series Analysis. New York: Wiley, 1963, pp. 327–346.
19. K. Kazi, “On the ε -entropy of diffusion processes,” Ann. Inst. Statist. Math., vol. 21, pp. 347–356, 1969.
20. I. M. Gelfand and A. M. Yaglom, “Calculation of the amount of information about a random function contained in another such function,” Amer. Math. Soc. Transl., ser. 2. vol. 13, pp. 199–246.
21. M. Zakai and J. Ziv, “Lower and upper bounds on the optimal filtering error of certain diffusion processes,” IEEE Trans. Inform. Theory, vol. IT-18, pp. 325–331, May 1972.