Random Texts Exhibit Zipfs-Law-Like Word Frequency Distribution

IEEE Transactions on Information Theory

Volumn 38, Issue 6, 1992, Pages 1842-1845

  Li, Wentian ^a  

^a ROCKEFELLER UNIVERSITY   (United States)

Author keywords

power law distribution; random texts; Statistical linguistics; Zipfs law

Indexed keywords

INFORMATION THEORY; RANDOM PROCESSES;

NATURAL LANGUAGES; RANDOM TEXTS; ZIPF'S LAW;

LINGUISTICS;

EID: 0026953429     PISSN: 00189448     EISSN: 15579654     Source Type: Journal    
DOI: 10.1109/18.165464     Document Type: Article

References (13)

1. G. Zipf, Selective Studies and the Principle of Relative Frequency in Language. Cambridge, MA: MIT Press, 1932.
2. Human Behavior and the Principle of Least-Effort. Reading, MA: Addison-Wesley, 1965.
3. The Psychobiology of Language: An Introduction to Dynamic Philology. Cambridge MA: MIT Press, 1965).
4. H. Kucera and W. Nelson Francis, Computational Analysis of Present-Day American English. Providence, RI: Brown Univ., 1967.
5. B. Mandelbrot, The Fractal Geometry of Nature. New York: Freeman, 1982.
6. Fractuals: Form, Chance and Dimension. New York: Freeman, 1977.
7. Les objects Fractal: Forme, Hasard et Dimension. Flammarion, 1975.
8. G. Miller, “Introduction,” in The Psycho-Biology of Language: An Introduction to Dynamic Philology. Cambridge, MA: MIT Press, 1965.
9. B. Mandelbrot, “An informational theory of the statistical structure of language,” in Communication Theory, W. Jackson, Ed. Betterworths, 1953.
10. H. A. Raimi, “The peculiar distribution of first digits,” Scientific Amer., vol. 221, no. 6, pp. 109-115, Dec. 1969.
11. M. Gell-Mann, unpublished notes.
12. P. Manneville, “Intermittency, self-similarity and 1/f spectrum in dissipative dynamical systems,” Le Journal De Physique, vol. 41, no. 11, pp. 1235-1243, 1980.
13. W. Li, “Mutual information functions of natural language texts,” Sante Fe Inst, preprint 89-009, 1989.