Size-dependent word frequencies and translational invariance of books

Physica A: Statistical Mechanics and its Applications

Volumn 389, Issue 2, 2010, Pages 330-341

  Bernhardsson, Sebastian ^a   da Rocha, Luis Enrique Correa ^a   Minnhagen, Petter ^a  

^a UMEÅ UNIVERSITY   (Sweden)

Author keywords

Random book transformation; Text evolution models; Word frequency distributions

Indexed keywords

PHYSICS;

EVOLUTION MODELS; FUNCTIONAL FORMS; PRECISE DETERMINATIONS; RANDOM BOOK TRANSFORMATION; RANDOMLY DISTRIBUTED; SIZE TRANSFORMATIONS; TRANSLATIONAL INVARIANCE; WORD FREQUENCIES;

LINGUISTICS;

EID: 70349728767     PISSN: 03784371     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physa.2009.09.022     Document Type: Article

References (17)

1. Zipf G. Selective Studies and the Principle of Relative Frequency in Language (1932), Harvard University Press, Cambridge, Massachusetts
2. Zipf G. The Psycho-biology of Language: An Introduction to Dynamic Philology (1935), Mifflin Company, Boston, Massachusetts
3. Zipf G. Human Behavior and the Principle of Least Effort (1949), Addison-Wesley, Reading, Massachusetts
4. Mitzenmacher M. A brief history of generative models for power law and lognormal distributions. Internet Math. 1 (2003) 226
5. Baayen R.H. Word Frequency Distributions (2001), Kluwer Academic Publisher, Dordrecht, The Netherlands
6. Simon H. On a class of skew distribution functions. Biometrika 42 (1955) 425
7. Newman M.E.J. Power laws, Pareto distributions and Zipf's law. Contemp. Physics 46 (2005) 323
8. Mandelbrot B. An Informational Theory of the Statistical Structure of Languages (1953), Butterworth, Woburn, Massachusetts
9. Miller G.A. Some effects of intermittent silence. Am. J. Psychol. 70 (1957) 311
10. Li W. Random texts exhibit Zipf's-law-like word frequency distribution. IEEE Trans. Inf. Theory 38 (1992) 1842
11. Gonçalves L.L., and Gonçalves L.B. Fractal power in literary English. Physica A 360 (2006) 557
12. http://www.gutenberg.org/catalog/
13. Dorogotsev S., and Mendes J. Language as an evolving word web. Proc. R. Soc. Lond. Ser. B 268 (2001) 2603
14. Masucci A., and Rodgers G. Networks properties of written human language. Phys. Rev. E 74 (2006) 26102
15. Barabási A.-L., Albert R., and Jeong H. Emergence of scaling in random networks. Science 286 (1999) 509
16. Newman M., Barabási A.-L., and Watts D. The Structure and Dynamics of Networks (2006), Princeton University Press, Princeton and Oxford
17. S. Bernhardsson, L.E.C. da Rocha, P. Minnhagen, The meta book and size-dependent properties of written language, preprint (arxiv:0909.4385v1) (2009)