Statistical mechanics of lossy compression for non-monotonic multilayer perceptrons

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2008, Pages 509-513

  Cousseau, Florent ^a   Mimura, Kazushi ^b   Okada, Masato ^a  

^a UNIVERSITY OF TOKYO   (Japan)

^b HIROSHIMA CITY UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

BOOLEAN MESSAGES; CODE LENGTHS; COMMITTEE MACHINES; INTERNATIONAL SYMPOSIUM; LOSSY COMPRESSIONS; LOSSY DATA COMPRESSION; MULTI-LAYER PERCEPTRONS; NON-MONOTONIC; PERCEPTRON; REPLICA METHOD; SHANNON BOUND; TREE-LIKE NETWORKS;

ARTIFICIAL INTELLIGENCE; CYBERNETICS; INFORMATION THEORY; MECHANICS; NEURAL NETWORKS; PATTERN RECOGNITION SYSTEMS; SPEED; STATISTICAL MECHANICS; STATISTICAL METHODS; TECHNICAL PRESENTATIONS; TRANSFER FUNCTIONS;

DATA COMPRESSION;

EID: 52349087992     PISSN: 21578101     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2008.4595038     Document Type: Conference Paper

References (16)

1. N. Sourlas, Nature, 339, 693 (1989).
2. A. Montanari and N. Sourlas, Eur. Phys. J. B, 18, 107 (2000).
3. T. Tanaka and M. Okada, IEEE Trans, Inform. Theory, 51, 2, 700 (2005).
4. T. Murayama and M. Okada, J. Phys. A: Math. Gen., 36, 11123 (2003).
5. T. Hosaka, Y. Kabashima and H. Nishimori, Phys. Rev. E, 66, 066126 (2002).
6. K. Mimura and M. Okada, Phvs. Rev. E, 74, 046108 (2006).
7. C. E. Shannon, Bell Syst. Tech. J., 27, 379 (1948).
8. R. Gallager, IRE Trans, on Info. Theory, 1968, IT-8, pp. 21-28
9. T.J. Richardson, R.L. Urbanke, IEEE Trans. Inform. Theory, 2001, 47(2):638-656
10. C. E. Shannon, IRE Nat. Conv. Rec., 4, 142 (1959).
11. Y. Matsunaga, H. Yamamoto, IEEE Trans. Inform. Theory, 2003, 49(9):2225-2229
12. E. Martinian, M. Wainwright, Data Compression Conference, 2006
13. T. Hosaka, Y. Kabashima, Physica A, 2006, 365, pp. 113119
14. T. M Cover and J. A. Thomas, Elements of Information Theory (Wiley, New York, 1991).
15. W. Krauth and M. Mézard, J. Phys. (France), 50, 3057 (1989).
16. J. R. L. de Almeida and D. J. Thouless, J. Phys. A: Math. Gen., 11, 5, 983 (1978).