Directed information, causal estimation, and communication in continuous time

Final Proceedings of the 2009 7th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks, WiOpt 2009

Volumn , Issue , 2009, Pages

  Kim, Young Han ^a   Permuter, Haim H ^b   Weissman, Tsachy ^c,d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^c STANFORD UNIVERSITY   (United States)

^d TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ADDITIVE WHITE GAUSSIAN NOISE; CHANNEL NOISE; CONTINUOUS TIME; DIRECTED INFORMATION; DISCRETE-TIME; ESTIMATION PROBLEM; FUNDAMENTAL LIMITS; MINIMUM MEAN-SQUARED ERROR ESTIMATIONS; MUTUAL INFORMATIONS; OPERATIONAL INTERPRETATION; POISSON CHANNEL; RELIABLE COMMUNICATION; STOCHASTIC PROCESS; TARGET SIGNALS;

CONTINUOUS TIME SYSTEMS; ESTIMATION; GAUSSIAN NOISE (ELECTRONIC); MEAN SQUARE ERROR; RANDOM PROCESSES; STOCHASTIC SYSTEMS; WHITE NOISE; WIRELESS TELECOMMUNICATION SYSTEMS;

AD HOC NETWORKS;

EID: 74349102687     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.4108/ICST.WIOPT2009.6538     Document Type: Conference Paper

References (26)

1. J. Massey, "Causality, feedback and directed information," Proc. Int. Symp. Inf. Theory Applic. (ISITA-90), pp. 303-305, 1990.
2. G. Kramer, "Directed information for channels with feedback," Ph.D. Dissertation, Swiss Federal Institute of Technology (ETH) Zurich, 1998.
3. -, "Feedback strategies for a class of two-user multiple-access channels," IEEE Trans. Inf. Theory, vol. IT-45, no. 6, pp. 2054-2059, 1999.
4. S. Tatikonda and S. Mitter, "The capacity of channels with feedback," IEEE Trans. Inf. Theory, vol. IT-55, no. 1, pp. 323-349, Jan 2009.
5. Y.-H. Kim, "A coding theorem for a class of stationary channels with feedback," IEEE Trans. Inf. Theory., vol. 25, pp. 1488-1499, April, 2008.
6. H. H. Permuter, T. Weissman, and A. J. Goldsmith, "Finite state channels with time-invariant deterministic feedback," IEEE Trans. Inf. Theory, vol. IT-55, no. 2, pp. 644-662, 2009.
7. Y.-H. Kim, "Feedback capacity of stationary Gaussian channels," 2006, submitted to IEEE Trans. Inform. Theory. Availble at arxiv.org/pdf/cs.IT/ 0602091.
8. H. H. Permuter, P. Cuff, B. V. Roy, and T. Weissman, "Capacity of the trapdoor channel with feedback," IEEE Trans. Inf. Theory, vol. IT-54, no. 7, pp. 3150-3165, 2008.
9. G. Kramer, "Capacity results for the discrete memoryless network," IEEE Trans. Inf. Theory, vol. IT-49, pp. 4-21, 2003.
10. S. P. R. Venkataramanan, "Source coding with feed-forward: Rate-distortion theorems and error exponents for a general source," IEEE Trans. Inf. Theory, vol. 53, no. 6, pp. 2154-2179, 2007.
11. S. Pradhan, "On the role of feedforward in gaussian sources: Point-to-point source coding and multiple description source coding," IEEE Trans. Inf. Theory, vol. 53, no. 1, pp. 331-349, 2007.
12. H. H. Permuter, Y.-H. Kim, and T. Weissman, "On directed information and gambling," in Proc. International Symposium on Information Theory (ISIT), Toronto, Canada, 2008.
13. Y.-H. Kim, H. H. Permuter, and T. Weissman, "An interpretation of directed information in gambling, portfolio theory and data compression," 2009, in preparation.
14. -, "Directed information and causal estimation in continuous time," in Proc. IEEE International Symp. Inf. Theory, Seoul, Korea, 2009.
15. -, "Directed information in continuous time," 2009, in preparation.
16. A. Kolmogorov, "On the shannon theory of information transmission in the case of continuous signals," Information Theory, IRE Transactions on, vol. 2, no. 4, pp. 102-108, December 1956.
17. M. S. Pinsker, Information and Information Stability of Random Variables and Processes. Moskva: Izv. Akad. Nauk, 1960, in Russian.
18. T. E. Duncan, "On the calculation of mutual information," SIAM J. Appl. Math., vol. 19, pp. 215-220, 1970.
19. A. Cohen, N. Merhav, and T. Weissman, "Scanning and sequential decision making for multidimensional data, Part II: noisy data," IEEE Trans. Inf. Theory, vol. IT-54, no. 12, pp. 5609-5631, Dec. 2008.
20. D. Guo, S. Shamai, and S. Verdú, "Mutual Information and Minimum Mean-Square Error in Gaussian Channels," IEEE Trans. Inf. Theory, vol. IT-51, no. 4, pp. 1261-1283, April 2005.
21. T. T. Kadota, M. Zakai, and J. Ziv, "Capacity of a continuous memoryless channel with feedback," IEEE Trans. Inf. Theory, vol. IT-17, pp. 372-378, 1971.
22. -, "Mutual information of the white Gaussian channel with and without feedback," IEEE Trans. Inf. Theory, vol. IT-17, pp. 368-371, 1971.
23. R. S. Liptser and A. N. Shiryaev, Statistics of Random Processes II. Applications, 2nd ed. Springer, 2001.
24. P. Brémaud, Point Processes and Queues: Martingale Dynamics, 1st ed. New York: Springer-Verlag, 1981.
25. S. Ihara, "Coding theorems for a continuous-time gaussian channel with feedback," IEEE Transactions on Information Theory, vol. 40, no. 6, pp. 2041-2044, 1994.
26. -, Information Theory for Continuous Systems. River Edge, NJ: World Scientific. 1993.