Universal entropy of word ordering across linguistic families

PLoS ONE

Volumn 6, Issue 5, 2011, Pages

  Montemurro, Marcelo A ^a   Zanette, Damián H ^b  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b INSTITUTO BALSEIRO   (Argentina)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CONTROLLED STUDY; ENTROPY; GRAMMAR; LANGUAGE ABILITY; LANGUAGE PROCESSING; LINGUISTICS; SEMANTICS; STATISTICAL MODEL; HUMAN; LANGUAGE; STATISTICS;

ENTROPY; HUMANS; LANGUAGE; LINGUISTICS; MODELS, STATISTICAL;

EID: 79955930352     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0019875     Document Type: Article

References (35)

1. Maynard Smith J, Szathmáry E, (1995) The major transitions in evolution Oxford; New York W.H. Freeman Spektrum pp. xiv,-346.
2. Nowak MA, Komarova NL, Niyogi P, (2002) Computational and evolutionary aspects of language Nature 417: 611-617.
3. Darwin C, (1859) On the origin of species by means of natural selection, or the preservation of favoured races in the struggle for life London Murray, J.
4. Atkinson QD, Meade A, Venditti C, Greenhill SJ, Pagel M, (2008) Languages evolve in punctuational bursts Science 319: 588.
5. Ruhlen M, (1994) The origin of language: tracing the evolution of the mother tongue New York Wiley pp. xi, 239.
6. Lewis MP, (2009) Ethnologue: Languages of the World Dallas, Tex. SIL International: Online version: http://www.ethnologue.com/.
7. Gray RD, Atkinson QD, (2003) Language-tree divergence times support the Anatolian theory of Indo-European origin Nature 426: 435-439.
8. Greenberg JH, (1969) Language Universals: A Research Frontier. Science 166: 473-478.
9. Greenberg JH, (1963) Universals of language; report of a conference held at Dobbs Ferry, New York, April 13-15, 1961 Cambridge, Mass M.I.T. Press pp. x-269.
10. Chomsky N, (1965) Aspects of the theory of syntax Cambridge M.I.T. Press.
11. Nowak MA, Plotkin JB, Jansen VA, (2000) The evolution of syntactic communication Nature 404: 495-498.
12. Miestamo M, Sinnemäki K, Karlsson F, (2008) Language complexity: typology, contact, change Amsterdam; Philadelphia John Benjamins Pub. Co.
13. Zanette D, (2008) Playing by numbers Nature 453: 988-989.
14. Peng CK, Buldyrev SV, Goldberger AL, Havlin S, Sciortino F, et al. (1992) Long-range correlations in nucleotide sequences. Nature 356: 168-170.
15. Cover TM, Thomas JA, (2006) Elements of information theory Hoboken, N.J. Wiley-Interscience pp. xxiii 748.
16. Shannon CE, (1951) Prediction and Entropy of Printed English Bell System Technical Journal 30: 50-64.
17. Cover TM, King RC, (1978) Convergent Gambling Estimate of Entropy of English Ieee Transactions on Information Theory 24: 413-421.
18. Teahan WJ, Cleary JG, (1996) The entropy of English using PPM-based models Dcc '96- Data Compression Conference, Proceedings pp. 53-62.
19. Kontoyiannis I, Algoet PH, Suhov YM, Wyner AJ, (1998) Nonparametric entropy estimation for stationary processes and random fields, with applications to English text IEEE Transactions on Information Theory 44: 1319-1327.
20. Zipf GK, (1935) The psycho-biology of language; an introduction to dynamic philology Boston Houghton Mifflin Company.
21. Ebeling W, Neiman A, (1995) Long-Range Correlations between Letters and Sentences in Texts Physica A 215: 233-241.
22. Ebeling W, Poschel T, (1994) Entropy and Long-Range Correlations in Literary English Europhysics Letters 26: 241-246.
23. Ziv J, Lempel A, (1977) Universal Algorithm for Sequential Data Compression Ieee Transactions on Information Theory 23: 337-343.
24. Ziv J, Lempel A, (1978) Compression of Individual Sequences Via Variable-Rate Coding Ieee Transactions on Information Theory 24: 530-536.
25. Gao Y, Kontoyiannis I, Bienenstock E, (2008) Estimating the Entropy of Binary Time Series: Methodology, Some Theory and a Simulation Study Entropy 10: 71-99.
26. Zanette DH, Montemurro MA, (2005) A stochastic model of text generation with realistic Zipf's distribution Journal of Quantitative Linguistics 12: 29-40.
27. Alvarez-Lacalle E, Dorow B, Eckmann JP, Moses E, (2006) Hierarchical structures induce long-range dynamical correlations in written texts Proc Natl Acad Sci U S A 103: 7956-7961.
28. Buldyrev SV, Goldberger AL, Havlin S, Mantegna RN, Matsa ME, et al. (1995) Long-range correlation properties of coding and noncoding DNA sequences: GenBank analysis Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics 51: 5084-5091.
29. Peng CK, Buldyrev SV, Havlin S, Simons M, Stanley HE, et al. (1994) Mosaic organization of DNA nucleotides. Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics 49: 1685-1689.
30. Kantelhardt JW, (2001) Detecting long-range correlations with detrended fluctuation analysis Physica A 295: 441-453.
31. Hollander M, Wolfe DA, (1999) Nonparametric statistical methods New York Wiley pp. xiv, 787.
32. Heaps HS, (1978) Information retrieval, computational and theoretical aspects New York Academic Press.
33. Abramowitz M, Stegun IA, (1964) Handbook of mathematical functions with formulas, graphs, and mathematical tables Washington U.S. Govt. Print. Off pp. xiv,-1046.
34. Montemurro MA, Pury P, (2002) Long-range fractals correlations in literary corpora. Fractals 10: 451.
35. Wyner AD, Ziv J, (1989) Some Asymptotic Properties of the Entropy of a Stationary Ergodic Data Source with Applications to Data-Compression. Ieee Transactions on Information Theory 35: 1250-1258.