Mutual information and conditional mean estimation in Poisson channels

IEEE Transactions on Information Theory

Volumn 54, Issue 5, 2008, Pages 1837-1849

  Guo, Dongning ^a   Shamai, Shlomo ^b   Verdú, Sergio ^c  

^a Northwestern University   (United States)

^b TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^c Princeton University   (United States)

Author keywords

Mutual information; Nonlinear filtering; Optimal estimation; Point process; Poisson process; Smoothing

Indexed keywords

ALGORITHMS; ESTIMATION; NONLINEAR FILTERING; POISSON DISTRIBUTION; RANDOM PROCESSES; STATISTICS;

CONTINUOUS-TIME SETTING; GAUSSIAN CHANNELS; INPUT-OUTPUT MUTUAL INFORMATION; LOGARITHMIC FUNCTION; OPTIMAL ESTIMATION; POINT PROCESS; POISSON CHANNELS;

COMMUNICATION CHANNELS (INFORMATION THEORY);

EID: 43749104456     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2008.920206     Document Type: Article

References (38)

1. D. Guo, S. Shamai (Shitz), and S. Verdú, "Mutual information and minimum mean-square error in Gaussian channels," IEEE Trans. Inf. Theory, vol. 51, no. 4, pp. 1261-1282, Apr. 2005.
2. S. Verdú, "Poisson communication theory," Invited talk in the International Technion Communication Day in Honor of Israel Bar-David, Mar. 1999.
3. I. Bar-David, "Communication under the Poisson regime," IEEE Trans. Inf. Theory, vol. IT-15, no. 1, pp. 31-37, Jan. 1969.
4. P. Brémaud, Point Processes and Queues. New York: Springer-Verlag, 1981.
5. R. S. Liptser and A. N. Shiryaev, Statistics of Random Processes II: Applications, 2nd ed. Berlin, Germany: Springer-Verlag, 2001.
6. D. L. Snyder, "Filtering and detection for doubly stochastic Poisson processes," IEEE Trans. Inf. Theory, vol. IT-18, no. 1, pp. 91-102, Jan. 1972.
7. T. Kailath, "A general likelihood-ratio formula for random signals in Gaussian noise," IEEE Trans. Inf. Theory, vol. IT-15, no. 3, pp. 350-361, May 1969.
8. T. E. Duncan, "On the calculation of mutual information," SIAM J. Appl. Math., vol. 19, pp. 215-220, Jul. 1970.
9. Y. M. Kabanov, "The capacity of a channel of the Poisson type," Theory of Probab. Its Applic., vol. 23, pp. 143-147, 1978.
10. M. H. A. Davis, "Capacity and cutoff rate for Poisson-type channels," IEEE Trans. Inf. Theory, vol. IT-26, no. 6, pp. 710-715, Nov. 1980.
11. A. D. Wyner, "Capacity and error exponent for the direct detection photon channel - Parts I and II," IEEE Trans. Inform. Theory, vol. 34, no. 6, pp. 1449-1471, Nov. 1988.
12. S. Verdú, "The exponential distribution in information theory," Probl. Inf. Transm., vol. 32, pp. 86-95, 1996.
13. A. S. Bedekar, "On the information about message arrival times required for in-order decoding," in Proc. IEEE Int. Symp. Information Theory Washington, DC, Jun. 2001, p. 227.
14. S. Shamai (Shitz) and A. Lapidoth, "Bounds on the capacity of a spectrally constrained Poisson channel," IEEE Trans. Inf. Theory, vol. 39, no. 1, pp. 19-29, Jan. 1993.
15. A. Lapidoth and S. M. Moser, "Bounds on the capacity of the discrete-time Poisson channel," in Proc. 41st Annu. Allerton Conf. Communication, Control, and Computing, Monticello, IL, Oct. 2003, pp. 201-210.
16. A. Lapidoth and S. Shamai (Shitz), "The Poisson multiple-access channel," IEEE Trans. Inf. Theory, vol. 44, no. 2, pp. 488-501, Mar. 1998.
17. A. Lapidoth, I. E. Telatar, and R. Urbanke, "On wide-band broadcast channels," IEEE Trans. Inf. Theory, vol. 49, no. 12, pp. 3250-3258, Dec. 2003.
18. S. M. Haas and J. H. Shapiro, "Capacity of wireless optical communications," IEEE J. Sel. Areas Commun., vol. 21, no. 8, pp. 1346-1357, Oct. 2003.
19. K. Chakraborty and P. Narayan, "The Poisson fading channel," IEEE Trans. Inf. Theory, vol. 53, no. 7, pp. 2349-2364, Jul. 2007.
20. S. I. Bross and S. Shamai (Shitz), "Capacity and decoding rules for the Poisson arbitrarily varying channel," IEEE Trans. Inf. Theory, vol. 49, no. 11, pp. 3076-3093, Nov. 2003.
21. P. Narayan and D. L. Snyder, "Signal set design for band-limited memoryless multiple-access channels with soft decision demodulation," IEEE Trans. Inf. Theory, vol. IT-33, no. 4, pp. 539-556, Jul. 1987.
22. S. Verdú, "Multiple access channels with point-process observations: Optimum demodulation," IEEE Trans. Inf. Theory, vol. IT-32, no. 5, pp. 642-651, Sep. 1986.
23. D. Guo, S. Shamai (Shitz), and S. Verdú, "Mutual information and conditional mean estimation in Poisson channels," in Proc. IEEE Information Theory Workshop, San Antonio, TX, 2004, pp. 265-270.
24. D. Guo, S. Shamai (Shitz), and S. Verdú, "Additive non-Gaussian noise channels: Mutual information and conditional mean estimation," in Proc. IEEE Int. Symp. Information Theory, Adelaide, Australia, Sep. 2005, pp. 719-723.
25. D. Palomar and S. Verdú, "Representation of mutual information via input estimates," IEEE Trans. Inf. Theory, vol. 53, no. 2, pp. 453-470, Feb. 2007.
26. C. Méasson, R. Urbanke, A. Montanari, and T. Richardson, "Life above threshold: From list decoding to area theorem and MSE," in Proc. IEEE Information Theory Workshop, San Antonio, TX, 2004.
27. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York: Wiley, 2006.
28. M. Madiman, O. Johnson, and I. Kontoyiannis, "Fisher information, compound Poisson approximation, and the Poisson channel," in Proc. IEEE Int. Symp. Information Theory, Nice, France, Jun. 2007, pp. 976-980.
29. G. L. Fillmore and G. Lachs, "Information rates for photocount detection systems," IEEE Trans. Inf. Theory, vol. IT-15, no. 4, pp. 465-468, Jul. 1969.
30. S. Shamai (Shitz), "Capacity of a pulse amplitude modulated direct detection photon channel," Proc. Inst. Elec. Eng., vol. 137, pp. 424-430, Dec. 1990.
31. A. Segall, "Recursive estimation from discrete-time point processes," IEEE Trans. Inf. Theory, vol. IT-22, no. 4, pp. 422-431, Jul. 1976.
32. J. H. V. Schuppen, "Filtering, prediction and smoothing for counting process observations, a martingale approach," SIAM J. Appl. Math. vol. 32, pp. 552-570, May 1977.
33. R. K. Boel and V. E. Benes, "Recursive nonlinear estimation of a diffusion acting as the rate of an observed Poisson process," IEEE Trans. Inf. Theory, vol. IT-26, no. 5, pp. 561-575, Sep. 1980.
34. V. Krishnamurthy and R. J. Elliott, "Filters for estimating Markov modulated Poisson processes and image-based tracking," Automatica vol. 33, no. 5, pp. 821-833, 1997.
35. J. Evans and V. Krishnamurthy, "Exact filters for doubly stochastic AR models with conditionally Poisson observations," IEEE Trans. Inf. Theory, vol. 44, no. 3, pp. 794-798, Apr. 1999.
36. H. L. Royden, Real Analysis. New York: Macmillan, 1988.
37. D. L. Snyner and M. I. Miller, Random Point Processes in Time and Space, 2nd ed. New York: Springer-Verlag, 1991.
38. J. Bertoin, Lévy Processes. Cambridge, U.K.: Cambridge Univ. Press, 1996.