Fitting ranked linguistic data with two-parameter functions

Entropy

Volumn 12, Issue 7, 2010, Pages 1743-1764

  Li, Wentian ^a   Miramontes, Pedro ^b   Cocho, Germinal ^b  

^a FEINSTEIN INSTITUTE FOR MEDICAL RESEARCH   (United States)

^b UNIVERSIDAD NACIONAL AUTÓNOMA DE MÉXICO   (Mexico)

Author keywords

Beta function; Letter frequency distribution; Model selection; Regression; Weighting; Word frequency distribution; Word spacing distribution; Zipf's law

Indexed keywords

EID: 77956411919     PISSN: None     EISSN: 10994300     Source Type: Journal    
DOI: 10.3390/e12071743     Document Type: Article

References (48)

1. Zipf, G.K. The Psycho-Biology of Languages; Houghton-Mifflin: Boston, MA, USA, 1935.
2. Herdan, G. The Advanced Theory of Language as Choice and Chance; Springer: Berlin, Germany, 1966.
3. Heaps, H.S. Information Retrieval: Computational and Theoretical Aspects; Academic Press: Orlando, FL, USA, 1978.
4. Menzerath, P. Die Architektonik des Deutschen Wortschatzes; Dümmler: Bonn, Germany, 1954.
5. Altmann, G. Prolegomena to Menzerath's law. Glottometrika 1980, 2, 1-10.
6. Baayen, R.H. Word Frequency Distribution; Kluwer Academic Publishers: Doredrecht, The Netherlands, 2001.
7. Mansilla, R.; Köppen, E.; Cocho, G.; Miramontes, P. On the behavior of journal impact factor rank-order distribution. J. Informetrics 2007, 1, 155-160.
8. Naumis, G.G.; Cocho, G. Tail universalities in rank distributions as an algebraic problem: The beta-like function. Physica A 2008, 387, 84-96.
9. Yule, G.U. A mathematical theory of evolution, based on the conclusions of Dr. J. C. Willis, F.R.S. Phil. Tran. Royal Soc. London B 1925, 213, 21-87.
10. Martindale, C.; Gusein-Zade, S.M.; McKenzie, D.; Borodovsky, M.Y. Comparison of equations describing the ranked frequency distributions of graphemes and phonemes. J. Quant. Linguist. 1996, 3, 106-112.
11. Mandelbrot, B. An information theory of the statistical structure of language. In Proceedings of Symposium on Application Communication Theory, Butterworth, London, UK, 22-26 September 1952; pp. 486-500.
12. Li, W. Random texts exhibit Zipf's-law-like word frequency distribution. IEEE Trans. Inf. Theory 1992, 38, 1842-1845.
13. Gusein-Zade, S.M. On the frequency of meeting of key words and on other ranked series. Sci. Tech. Inf. Ser.2Inf. Process. Syst. 1987, 1, 28-32.
14. Weibull, W. A statistical distribution function of wide applicability. J. Appl. Mech. 1951, 18, 292-297.
15. Akaike, H. A new look at statistical model identification. IEEE Trans. Automat. Control 1974, 19, 716-722.
16. Venables, W.N.; Ripley, B.D. Modern Applied Statistics with S-PLUS, 2nd Edition; Springer-Verlap: New York, NY, USA, 1999.
17. David, H.A.; Nagaraja, H.N. Order Statistics, 3rd Edition; Wiley-Interscience: Malden, MA, USA, 2003.
18. Miller, G.A. Introduction. In The Psycho-Biology of Languages; MIT Press: Cambridge UK, 1965.
19. Rapoport A. Rank-size relations. In International Encyclopedia of Statistics; Kruskal, H., Tanur, J.M., Eds.; The Free Press: New York, NY, USA, 1978; Volume 2, pp. 847-854.
20. Kamecke, U. Testing the rank size rule hypothesis with an efficient estimator. J. Urban Econ. 1990, 27, 222-231.
21. Urzua, C.M. A simple and efficient test for Zipf's law. Econ. Lett. 2000, 66, 257-260.
22. Rousseau, R. George Kingsley Zipf: Life, ideas, his law and informatics. Glottometrics 2002, 3, 11-18.
23. Li, W. Zipf's law everywhere. Glottometrics2002, 5, 14-21.
24. Evert, S. A simple LNRE model for random character sequences. In Proceedings of Actes des 7es Journes Internationales d'Analyse Statistique des Donnes Textuelles (JADT), Louvain-la-Neuve, Belgium, 10-12 March 2004; pp. 411-422.
25. Lotka, A.J. The frequency distribution of scientific productivity. J. Washington Acad. Sci. 1926, 16, 317-323.
26. Kleinbaum, D.G.; Klein, M. Survival Analysis: A Self-Learning Text, 2nd Edition; Springer: New York, NY, USA, 2005.
27. Gusein-Zade, S.M. On the frequency distribution of letters in the Russian language. Probl. Peredachi Informatsii 1988, 24, 102-107 (in Russian).
28. Borodovsky, M.Y.; Gusein-Zade, S.M. A general rule for ranged series of codon frequencies in different genomes. J. Biomol. Struct. Dyn. 1989, 6, 1001-1012.
29. Nabeshima, T.; Gunji, T.P. Zipf's law in phenograms and Weibull distribution in ideograms: Comparison of English with Japanese. BioSystems2004, 73, 131-139.
30. Altmann, E.G.; Pierrehumbert, J.B.; Motter, A.E. Beyond word frequency: Bursts, lulls, and scaling in the temporal distributions of words. PLoS One 2009, 4, e7678.
31. Shannon, C.E. Prediction and entropy of printed English. Bell Sys. Tech. J.1951, 29, 50-64.
32. Richardson, M.; Gabrosek, J,; Reischman, D.; Curtiss, P. Morse code, scrabble, and the alphabet. J. Stat. Educ. 2004, 12, Avialable at: http://www.amstat.org/publications/jse/v12n3/richardson.html (accessed 6 April 2010).
33. Jernigan, R.W. A photographic view of cumulative distribution functions. J. Stat. Educ. 2008, 16, Avialable at: http://www.amstat.org/publications/jse/v16n1/jernigan.html (accessed 6 April 2010).
34. Martínez-Mekler, G.; Martínez, R.A.; Beltrán del Río, M.; Mansilla, R.; Miramontes, P.; Cocho, G. Universality of rank-ordering distributions in the arts and sciences. PLoS One 2009, 4, e4791.
35. Ortuño, M.; Carpena, P.; Bernaola-Galván, P.; Muñoz, E.; Somoza, A.M. Keyword detection in natural languages and DNA. Phys. Rev. E2002, 57, 759-764.
36. Carpena, P.; Bernaola-Galván, P.; Hackenberg, M.; Coronado, A.V.; Oliver, J.L. Level statistics of words: Finding keywords in literary texts and symbolic sequences. Europhys. Lett. 2009, 79, 035102.
37. Li, W. Statistical properties of open reading frames in complete genome sequences. Comput. Chem. 1999, 15, 283-301.
38. McCoy, M.W.; Allen, A.P.; Gillooly, J.F. The random nature of genome architecture: Predicting open reading frame distributions. PLoS One2009, 4, e6456.
39. Carpena, P.; Bernaola-Galván, P.; Román-Roldán, R.; Oliver, J.L. A simple and species-independent coding measure. Gene 2002, 300, 97-104.
40. Manaris, B.; Pellicoro, L.; Pothering, G.; Hodges, H. Investigating Esperanto's statistical proportions relative to other languages using neural networks and Zipf's law. In Proceedings of the 2006 IASTED International Conference on Artificial Intelligence and Applications (AIA 2006), Innsbruck, Austria, 13-16 February 2006; ACTA Press: Anaheim, CA, USA, 2006; pp. 102-108.
41. Davis M. A Frequency Dictionary of Spanish: Core Vocabulary for Leaners; Routledge: New York, NY, USA, 2006.
42. Ferrer i Cancho, R.; Sole, R.V. Two regimes in the frequency of words and the origins of complex lexicons: Zipf's law revisited. J. Quant. Linguist. 2001, 8, 165-173.
43. Ha, L.Q.; Sicilia-Garcia, E.I.; Maing, J.; Smith, F.J. Extension of Zipf's law to word and character n-grams for English and Chinese. J. Comp. Linguist. Chin. Lang. Process. 2003, 8, 77-102.
44. Li, W.; Freudenberg, J. Two-parameter characterization of chromosome-scale recombination rate. Genome Res. 2009, 19, 2300-2307.
45. Li, W. The-more-the-better and the-less-the-better. Bioinformatics 2006, 22, 2187-2188.
46. Baayen, R.H. Analyzing Linguistic Data-A Practical Introduction to Statistics Using R; Cambridge University Press: Cambridge, UK, 2008.
47. Evert, S.; Baroni, M. zipfR: Word frequency distributions in R. In Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, Prague, Czech Republic, 25-27 June 2007; Association for Computational Linguistics: Morristown, NJ, USA, 2007; pp. 29-32.
48. Ryan, T.P. Modern Regression Methods; John Wiley & Sons: New York, NY, USA, 1997.