Information capacity in the weak-signal approximation

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 82, Issue 2, 2010, Pages

  Kostal, Lubomir ^a  

^a INSTITUTE OF PHYSIOLOGY   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE EXPRESSIONS; CHANNEL PROPERTY; CHANNELS WITH MEMORY; CONTINUOUS INPUT; DISCRETE-TIME; INFORMATION CAPACITIES; INFORMATION TRANSFERS; INPUT CORRELATION; MEMORYLESS CHANNELS; MODEL SYSTEM; MUTUAL INFORMATIONS; NOISE CORRELATION; OPTIMALITY CONDITIONS; SIGNAL APPROXIMATION; SIGNAL CONDITION;

CHANNEL CAPACITY; COVARIANCE MATRIX;

FISHER INFORMATION MATRIX;

EID: 77956113639     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.82.026115     Document Type: Article

References (48)

1. T. M. Cover and J. A. Thomas, Elements of Information Theory (Wiley, New York, 1991). 10.1002/0471200611
2. S. Verdu, IEEE Trans. Inf. Theory 44, 2057 (1998). 10.1109/18.720531
3. C. H. Bennett and P. W. Shor, IEEE Trans. Inf. Theory 44, 2724 (1998). 10.1109/18.720553
4. N. J. Cerf, J. Clavareau, C. Macchiavello, and J. Roland, Phys. Rev. A 72, 042330 (2005). 10.1103/PhysRevA.72.042330
5. R. G. Gallager, Information Theory and Reliable Communication (Wiley, New York, USA, 1968).
6. M. D. McDonnell and A. P. Flitney, Phys. Rev. E 80, 060102 (R) (2009). 10.1103/PhysRevE.80.060102
7. P. Mitra and J. B. Stark, Nature (London) 411, 1027 (2001). 10.1038/35082518
8. K. S. Turitsyn, S. A. Derevyanko, I. V. Yurkevich, and S. K. Turitsyn, Phys. Rev. Lett. 91, 203901 (2003). 10.1103/PhysRevLett.91.203901
9. J. J. Atick, Network Comput. Neural Syst. 3, 213 (1992). 10.1088/0954-898X/3/2/009
10. A. Borst and F. E. Theunissen, Nat. Neurosci. 2, 947 (1999). 10.1038/14731
11. S. B. Laughlin, Z. Naturforsch. C 36, 910 (1981).
12. M. D. McDonnell and N. G. Stocks, Phys. Rev. Lett. 101, 058103 (2008). 10.1103/PhysRevLett.101.058103
13. L. Kostal, P. Lansky, and J.-P. Rospars, PLOS Comput. Biol. 4, e1000053 (2008). 10.1371/journal.pcbi.1000053
14. F. Rieke, R. de Ruyter van Steveninck, D. Warland, and W. Bialek, Spikes: Exploring the Neural Code (MIT Press, Cambridge, 1997).
15. R. Stein, Biophys. J. 7, 797 (1967). 10.1016/S0006-3495(67)86623-2
16. J. Dauwels, in Proc. of the 26th Symposium on Inf. Theory in the BENELUX, edited by, J. Cardinal,,, N. Cerf,,, O. Delgrange, (Werkgemeenschap voor Informatie- en Communicatietheorie, Brussels, Belgium, 2005), pp. 221-228.
17. S. Ikeda and J. H. Manton, Neural Comput. 21, 1714 (2009). 10.1162/neco.2009.05-08-792
18. J. G. Smith, Inf. Control. 18, 203 (1971). 10.1016/S0019-9958(71)90346-9
19. R. W. Yeung, Information Theory and Network Coding (Springer-Verlag, Berlin, 2008).
20. R. J. McEliece, The Theory of Information and Coding (Cambridge University Press, Cambdridge, England, 2002). 10.1017/CBO9780511606267
21. J. M. Bernardo, J. R. Stat. Soc. Ser. B (Methodol.) 41, 113 (1979).
22. N. Brunel and J.-P. Nadal, Neural Comput. 10, 1731 (1998). 10.1162/089976698300017115
23. B. S. Clarke and A. R. Barron, IEEE Trans. Inf. Theory 36, 453 (1990). 10.1109/18.54897
24. L. Kostal and P. Lansky, Phys. Rev. E 81, 050901 (R) (2010). 10.1103/PhysRevE.81.050901
25. P. E. Greenwood, L. M. Ward, D. F. Russell, A. Neiman, and F. Moss, Phys. Rev. Lett. 84, 4773 (2000). 10.1103/PhysRevLett.84.4773
26. R. B. Ash, Information Theory (Dover, New York, 1965).
27. S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory (Prentice Hall, New Jersey, 1993).
28. S. Kullback, Information Theory and Statistics (Dover, New York, 1968).
29. M. Salicrú and I. J. Taneja, Inf. Sci. (N.Y.) 72, 251 (1993). 10.1016/0020-0255(93)90093-2
30. S. I. Amari and H. Nagaoka, Methods of Information Geometry (Amer. Math. Soc., Providence, USA, 2007).
31. J. J. Rissanen, IEEE Trans. Inf. Theory 42, 40 (1996). 10.1109/18.481776
32. M. Kendall, A. Stuart, and J. K. Ord, The Advanced Theory of Statistics (Charles Griffin, London, 1983), Vol. 3.
33. Consider for example the matrix (2 - 1 - 1 - 1 2 - 1 - 1 - 1 2), which is positive-semidefinite, while (1 - 1 - 1 - 1 1 - 1 - 1 - 1 1) is not. If the desired covariance matrix cannot be formed from Eq., then C high is less than as given by Eq..
34. R. A. Horn and C. R. Johnson, Matrix analysis (Cambridge University Press, New York, 1985).
35. S. Verdu, IEEE Trans. Inf. Theory 36, 1019 (1990). 10.1109/18.57201
36. R. C. Dorf, The Electrical Engineering Handbook (CRC Press, Boca Raton, USA, 1997).
37. G. D. Forney and G. Ungerboeck, IEEE Trans. Inf. Theory 44, 2384 (1998). 10.1109/18.720542
38. J. Huang and S. P. Meyn, IEEE Trans. Inf. Theory 51, 2336 (2005). 10.1109/TIT.2005.850108
39. D. R. Cox and N. Reid, Biometrika 91, 729 (2004). 10.1093/biomet/91.3.729
40. M. W. Levine, Biol. Cybern. 65, 459 (1991). 10.1007/BF00204659
41. D. E. McKeegan, Brain Res. 929, 48 (2002). 10.1016/S0006-8993(01)03376-5
42. C. Pouzat and A. Chaffiol, J. Neurosci. Methods 181, 119 (2009). 10.1016/j.jneumeth.2009.01.037
43. G. N. Reeke and A. D. Coop, Neural Comput. 16, 941 (2004). 10.1162/089976604773135050
44. S. Shinomoto, K. Shima, and J. Tanji, Neural Comput. 15, 2823 (2003). 10.1162/089976603322518759
45. M. Carandini, PLoS Biol. 2, e264 (2004). 10.1371/journal.pbio.0020264
46. P. E. Greenwood and P. Lansky, Biol. Cybern. 92, 199 (2005). 10.1007/s00422-005-0545-3
47. B. C. Sutradhar and P. Kumar, Appl. Math. Lett. 16, 317 (2003). 10.1016/S0893-9659(03)80051-4
48. M. Abramowitz and I. A. Stegun, Handbook of Mathematical Functions, With Formulas, Graphs, and Mathematical Tables (Dover, New York, 1965).