Maximum entropy, word-frequency, Chinese characters, and multiple meanings

PLoS ONE

Volumn 10, Issue 5, 2015, Pages

  Yan, Xiaoyong ^a,b   Minnhagen, Petter ^c  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^c UMEÅ UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

ENTROPY; HUMAN; HUMAN EXPERIMENT; LANGUAGE; MODEL; PREDICTION; THEORETICAL MODEL; CHINA; SEMANTICS; WRITING;

CHINA; ENTROPY; HUMANS; LANGUAGE; MODELS, THEORETICAL; SEMANTICS; WRITING;

EID: 84946585291     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0125592     Document Type: Article

References (37)

1. Singh S. The code book. New York: Random House; 2002.
2. Estroup JB. Les Gammes Sténographiques. 4th ed. Paris: Institut Stenographique de France; 1916.
3. Zipf GK. Selective studies of the principle of relative frequency in language. Cambridge: Harvard University Press; 1932.
4. Zipf GK. The psycho-biology of language: an introduction to dynamic philology. Boston: Mifflin; 1935.
5. Zipf GK. Human bevavior and the principle of least effort. Reading, MA: Addison-Wesley; 1949.
6. Mandelbrot B. An informational theory of the statistical structure of languages. Woburn: Butterworth; 1953.
7. Li W. Random texts exhibit Zipf's-law-like word frequency distribution. IEEE T Inform Theory. 1992; 38: 1842-1845. doi: 10.1109/18.165464
8. Baayen RH. Word frequency distributions. Dordrecht: Kluwer Academic; 2001.
9. i Cancho RF, Solé RV. Least effort and the origins of scaling in human language. Proc Natl Acad Sci USA. 2003; 100: 788-791. doi: 10.1073/pnas.0335980100
10. Montemurro MA. Beyond the Zipf-Mandelbrot law in quantitative linguistics. Physica A. 2001; 300: 567-578. doi: 10.1016/S0378-4371(01)00355-7
11. Simon H. On a class of skew distribution functions. Biometrika. 1955; 42: 425-440. doi: 10.2307/2333389
12. Kanter I, Kessler DA. Markov processes: linguistics and Zipf's Law. Phys Rev Lett. 1995; 74: 4559-4562. doi: 10.1103/PhysRevLett.74.4559 PMID: 10058537
13. Dorogovtsev SN, Mendes JFF. Languague as an evolving word web. Proc R Soc Lond B. 2001; 268: 2603-2606. doi: 10.1098/rspb.2001.1824
14. Zanette DH, Montemurro MA. Dynamics of text generation with realistic Zipf's distribution. J Quant Linguistics. 2005; 12: 29-40. doi: 10.1080/09296170500055293
15. Wang DH, Li MH, Di ZR. Ture reason for Zipf's law in language. Physica A. 2005; 358: 545-550. doi: 10.1016/j.physa.2005.04.021
16. Masucci A, Rodgers G. Networks properties of written human language. Phys Rev E. 2006; 74: 26102. doi: 10.1103/PhysRevE.74.026102
17. Cattuto C, Loreto V, Servedio VDP. A Yule-Simon process with memory. Europhys Lett. 2006; 76: 208-214. doi: 10.1209/epl/i2006-10263-9
18. Lü L, Zhang Z-K, Zhou T. Deviation of Zipf's and Heaps' laws in human languages with limited dictionary sizes. Sci Rep. 2013; 3: 1082. doi: 10.1038/srep01082 PMID: 23378896
19. Zhao KH. Physics nomenclature in China. Am J Phys. 1990; 58: 449-452. doi: 10.1119/1.16476
20. Rousseau R, Zhang Q. Zipf's data on the frequency of Chinese words revisited. Scientometrics. 1992; 24: 201-220. doi: 10.1007/BF02017909
21. Shtrikman S. Some comments on Zipf's law for the Chinese language. J Inf Sci. 1994; 20: 142-143. doi: 10.1177/016555159402000208
22. Ha LQ, Sicilia-Garcia EI, Ming J, Smith FJ. Extension of Zipf's law to words and phrases. Proc 19th Intl Conf Comput Linguistics. 2002: 315-320.
23. Bernhardsson S, da Rocha LEC, Minnhagen P. Size dependent word frequencies and the translational invariance of books. Physica A. 2010; 389: 330-341. doi: 10.1016/j.physa.2009.09.022
24. Bernhardsson S, da Rocha LEC, Minnhagen P. The meta book and size-dependent properties of written language. New J Phys. 2009; 11: 123015. doi: 10.1088/1367-2630/11/12/123015
25. Miller GA. Some effects of intermittance silence. Am J Psychol. 1957; 70: 311-314. doi: 10.2307/1419346 PMID: 13424784
26. Bernhardsson S, Baek SK, Minnhagen P. A paradoxical property of the monkey book. J Stat Mech. 2011; 7: PO7013. doi: 10.1088/1742-5468/2011/07/P07013
27. Baek SK, Bernhardsson S, Minnhagen P. Zipf's law unzipped. New J Phys. 2011; 13: 043004. doi: 10. 1088/1367-2630/13/4/043004
28. Bokma F, Baek SK, Minnhagen P. 50 years of inordinate fondness. Syst biol. 2013: syt067.
29. Clauset A, Shalizi CR and Newman MEJ. Power-law distributions in empirical data. SIAM Rev. 2009; 51: 661-703. doi: 10.1137/070710111
30. Visser M. Zipf's law, power laws and maximum entropy. New J Phys. 2013; 15: 043021. doi: 10.1088/1367-2630/15/4/043021
31. Lee SH, Bernhardsson S, Holme P, Kim BJ, Minnhagen P. Neutral theory of chemical reaction networks. New J Phys. 2012; 14: 033032. doi: 10.1088/1367-2630/14/3/033032
32. Baek SK, Minnhagen P, Kim BJ. The ten thousand Kims. New J Phys. 2011; 13: 073036. doi: 10.1088/1367-2630/13/7/073036
33. Zipf GK. The meaning-frequency relationship of words. J Gen Psychol. 1945; 33: 251-256. doi: 10. 1080/00221309.1945.10544509 PMID: 21006715
34. Reder L, Anderson JR, Bjork RA. A semantic interpretation of encoding specificity. J Exp Psychol. 1974; 102: 648-656. doi: 10.1037/h0036115
35. i Cancho RF. The variation of Zipf's law in human language. Eur Phys J B. 2005; 44: 249-257. doi: 10. 1140/epjb/e2005-00121-8
36. Manin DY. Zipf's law and avoidance of excessive synonymy. Cognitive Sci. 2008; 32: 1075-1098. doi: 10.1080/03640210802020003
37. Yan X, Fan Y, Di Z, Havlin S, Wu J. Efficient learning strategy of Chinese characters based on network approach. PLoS ONE. 2013; 8: e69745. doi: 10.1371/journal.pone.0069745 PMID: 23990887