Using information theory to study efficiency and capacity of computers and similar devices

Information (Switzerland)

Volumn 1, Issue 1, 2010, Pages 3-12

  Ryabko, Boris ^a  

^a SIBERIAN STATE UNIVERSITY OF TELECOMMUNICATIONS AND INFORMATION SCIENCES   (Russian Federation)

Author keywords

Channel capacity; Computer capacity; Computer efficiency; Information theory; Shannon entropy

Indexed keywords

INFORMATION THEORY;

EFFICIENCY;

EID: 84862835004     PISSN: None     EISSN: 20782489     Source Type: Journal    
DOI: 10.3390/info1010003     Document Type: Article

References (14)

1. Papadimitriou, C.H. Computational Complexity; Addison-Wesley: New York, NY, USA, 1996.
2. Kolmogorov, A.N. Three approaches to the quantitative definition of information. Probl. Inform. Transm. 1965, 1, 3–11.
3. Li, M.; Vitanyi, P. An Introduction to Kolmogorov Complexity and Its Applications, 2nd edition; Springer-Verlag: New York, NY, USA, 1997.
4. Knuth, D.E. MMIX: A RISC Computer for the New Millennium. In The Art of Computer Programming; Addison-Wesley: New York, NY, USA, 2005; Volume 1, Fascicle 1.
5. Shannon, C.E. A mathematical theory of communication. Bell Sys. Tech. J. 1948, 27, 379–423, 623–656.
6. Tanenbaum, A.S. Structured Computer Organization; Prentice Hall PTR: Upper Saddle River, NJ, USA, 2005.
7. Cover, T.M.; Thomas, J.A. Elements of Information Theory; Wiley: Hoboken, NJ, USA, 2006.
8. Csiszár, I. Simple proofs of some theorems on noiseless channels. Inform. Contr. 1969, 14, 285–298.
9. Doty, D. Dimension extractors and optimal decompression. Theory Comput. Syst. 2008, 43, 425–463.
10. Fortnow, L.; Lutz, J.H. Prediction and dimension J. Comput. Syst. Sci. 2005, 70, 570–589.
11. Lind, D.; Marcus, B. An Introduction to Symbolic Dynamics and Coding; Cambridge University Press: Cambridge, UK, 1996.
12. Ryabko, B.Ya. Noiseless coding of combinatorial sources, Hausdorff dimension, and Kolmogorov complexity. Prob. Inform. Transm. 1986, 22, 170-179.
13. Knuth, D.E. Fundamental Algorithms. In The Art of Computer Programming; Addison-Wesley: New York, NY, USA, 1968; Volume 1.
14. Krichevsky, R. Universal Compression and Retrieval; Kluwer Academic Publishers: Dordrecht, Netherlands, 1993.