Deviation of Zipf's and Heaps' laws in human languages with limited dictionary sizes

Scientific Reports

Volumn 3, Issue , 2013, Pages

  Lü, Linyuan ^a,b   Zhang, Zi Ke ^a,c   Zhou, Tao ^d  

^a HANGZHOU NORMAL UNIVERSITY   (China)

^b UNIVERSITY OF FRIBOURG   (Switzerland)

^c BEIJING COMPUTATIONAL SCIENCE RESEARCH CENTER   (China)

^d UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN; HUMAN EXPERIMENT; LANGUAGE; MODEL; THEORETICAL MODEL; WRITING;

EID: 84879187660     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep01082     Document Type: Article

References (44)

1. Hawkins, J. A. & Gell-Mann, M. The Evolution of Human Languages (Addison-Wesley, Reading, Massachusetts, 1992).
2. Caplan, D. Language: Structure, Processing and Disorders (MIT Press, Cambidge, 1994).
3. Lightfoot, D. The Development of Language: Acquisition, Changes and Evolution (Blackwell, Oxford, 1999).
4. Nowak, M. A. & Krakauer, D. C. The evolution of language. Proc. Natl. Acad. Sci. U.S.A. 96, 8028-8033 (1999).
5. Cancho, R. F. i. & Solé, R. V. The small world of human language. Proc. R. Soc. Lond. B 268, 2261-2265 (2001).
6. Nowak, M. A., Komarova, N. L. & Niyogi, P. Computational and evolutionary aspects of language. Nature 417, 611-617 (2002).
7. Hauser, M. D., Chomsky, N. & Fitch, W. T. The faculty of language: What is it, who has it, and how did it evolve? Science 298, 1569-1579 (2002).
8. Abrams, D. & Strogatz, S. H. Modelling the dynamics of language death. Nature 424, 900 (2003).
9. Lieberman, E., Michel, J.-B., Jackson, J., Tang, T. & Nowak, M. A. Quantifying the evolutionary dynamics of language. Nature 449, 713-716 (2007).
10. Lambiotte, R., Ausloos, M. & Thelwall, M. Word statistics in Blogs and RSS feeds: Towards empirical universal evidence. J. Informetrics 1, 277 (2007).
11. Petersen, A. M., Tenenbaum, J., Havlin, S. & Stanley, H. E. Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word Death. Sci. Rep. 2, 313 (2012)
12. Gao, J., Hu, J., Mao, X. & Perc, M. Culturomics meets random fractal theory: insights into long-range correlations of social and natural phenomena over the past two centuries. J. R. Soc. Interface 9, 1956-1964 (2012).
13. Zipf, G. K. Behavior and the Principal of Least Effort (Addison-Wealey, Cambridge, MA, 1949).
14. Heaps, H. S. Information Retrieval-Computational and Theoretical Aspects (Academic Press, 1978).
15. Kanter, I. & Kessler, D. A. Markov processes: linguistics and Zipf 's law. Phys. Rev. Lett. 74, 4559-4562 (1995).
16. Cancho, R. F. i. & Solé, R. V. Least effort and the origins of scaling in human language. Proc. Natl. Acad. Sci. U.S.A. 100, 788-791 (2002).
17. Gelbukh, A. & Sidorov, G. Zipf and Heaps Laws' coefficients depend on language. Lect. Notes Comput. Sci. 2004, 332-335 (2001).
18. Serrano, M. A., Flammini, A. & Menczer, F. Modeling statistical properties of written text. PLoS ONE 4, e5372 (2009).
19. Cattuto, C., Loreto, V. & Pietronero, L. Semiotic dynamics and collaborative tagging. Proc. Natl. Acad. Sci. U.S.A. 104, 1461-1464 (2007).
20. Cattuto, C., Barrat, A., Baldassarri, A., Schehr, G. & Loreto, V. Collective dynamics of social annotation. Proc. Natl. Acad. Sci. U.S.A. 106, 10511-10515 (2009).
21. Zhang, Z.-K., Lü, L., Liu, J.-G. & Zhou, T. Empirical analysis on a keyword-based semantic system. Eur. Phys. J. B 66, 557-561 (2008).
22. Lansey, J. C. & Bukiet, B. Internet Search Result Probabilities: Heaps' Law and Word Associativity. J. Quant. Linguistics 16, 40-66 (2009).
23. Zhang, H.-Y. Discovering power laws in computer programs. Inf. Process. Manage. 45, 477-483 (2009).
24. Simon, H. A. On a class of skew distribution function. Biometrika 42, 425-440 (1955).
25. Simkin, M. V. & Roychowdhury, V. P. Re-inventing Willis. Phys. Rep. 502, 1-35 (2011).
26. Dorogovtsev, S. N. & Mendes, J. F. F. Languague as an evolving word web. Proc. R. Soc. Lond. B 268, 2603-2606 (2001).
27. Zanette, D. H. & Montemurro, M. A. Dynamics of text generation with realistic Zipf 's distribution. J. Quant. Linguistics 12, 29-40 (2005).
28. Cattuto, C., Loreto, V. & Servedio, V. D. P. A Yule-Simon process with memory. Europhys. Lett. 76, 208-214 (2006).
29. Ebeling, W. & Pöschel, T. Entropy and long-range correlations in literary English. Europhys. Lett. 26, 241-246 (1994).
30. Kleinberg, J. Bursty and hierarchical structure in streams. Data Min. Knowl. Disc. 7, 373-397 (2003).
31. Altmann, E. G., Pierrehumbert, J. B. & Motter, A. E. Beyong word frequency: Bursts, lulls, and scaling in the temporal distributions of words. PLoS ONE 4, e7678 (2009).
32. Wang, D.-H., Li, M.-H. & Di, Z.-R. Ture reason for Zipf 's law in language. Physica A 358, 545-550 (2005).
33. Lü, L., Zhang, Z.-K. & Zhou, T. Zipf 's law lwads to Heaps' law: Analyzing their relation in finite-size systems. PLoS ONE 5, e14139 (2010).
34. Eliazar, I. The growth statistics of Zipfian ensembles: Beyond Heaps' law. Physica A 390, 3189-3203 (2011).
35. Bernhardsson, S., da Rocha, L. E. C. & Minnhagen, P. The meta book and sizedependent properties of written language. New J. Phys. 11, 123015 (2009).
36. Goldstein, M. L., Morris, S. A. & Yen, G. G. Problems with fitting to the power-law distribution. Eur. Phys. J. B 41, 255-258 (2004).
37. Clauset, A., Shalizi, C. R. & Newman, M. E. J. Power-law distributions in empirical data. SIAM Rev. 51, 661-703 (2009).
38. Barabási, A.-L. & Albert, R. Emergence of scaling in random networks. Science 286, 509-512 (1999).
39. Bak, P., Tang, C. & Wiesenfeld, K. Self-organized criticality. Phys. Rev. A 38, 364-374 (1988).
40. Barabási, A.-L. The origin of bursts and heavy tails in human dynamics. Nature 435, 207-211 (2005).
41. Kim, B. J. & Park, S. M. Distribution of Korean family names. Physica A 347, 683-694 (2005).
42. Pigolotti, S., Flammini, A., Marsili, M. & Martian, A. Species lifetime distribution for simple models of ecologies. Proc. Natl. Acad. Sci. U.S.A. 102, 15747-15751 (2005).
43. Dorogovtsev, S. N. & Mendes, J. F. F. Effect of the accelerating growth of communications networks on their structure. Phys. Rev. E 63, 025101(R) (2001).
44. Jeong, H., Neda, Z. & Barabási, A.-L. Measuring preferential attachment for evolving networks. Europhys. Lett. 61, 567-572 (2003).