Constant conditional entropy and related hypotheses

Journal of Statistical Mechanics: Theory and Experiment

Volumn 2013, Issue 7, 2013, Pages

  Ferrer I Cancho, Ramon ^a   Dȩbowski, Łukasz ^b   Moscoso Del Prado Martín, Fermín ^c  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

^b INSTITUTE OF COMPUTER SCIENCE   (Poland)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

exact results; scaling in socio economic systems

Indexed keywords

EID: 84881528722     PISSN: None     EISSN: 17425468     Source Type: Journal    
DOI: 10.1088/1742-5468/2013/07/L07001     Document Type: Article

References (22)

1. Levy R and Jaeger T F 2007 Speakers optimize information density through syntactic reduction Proc. 20th Annual Conf. on Neural Information Processing Systems
2. Genzel D and Charniak E 2002 Entropy rate constancy in text Proc. 40th Annual Mtg of the Association for Computational Linguistics (ACL-02) pp 199-206
3. Jaeger T F 2010 Redundancy and reduction: speakers manage syntactic information density Cogn. Psych. 61 23
4. Maurits L, Perfors A A and Navarro D 2010 Why are some word orders more common than others? A uniform information density account Advances in Neural Information Processing Systems vol 23 ed J Lafferty pp 1585-93
5. Shannon C 1951 Prediction and entropy of printed English Bell Syst. Tech. J. 30 50
6. Hilberg W 1990 Der bekannte Grenzwert der redundanzfreien Information in Texten - eine Fehlinterpretation der Shannonschen Experimente? Frequenz 44 243
7. Ebeling W and Pöschel T 1994 Entropy and long-range correlations in literary English Europhys. Lett. 26 241 (Pubitemid 24783103)
8. Schmitt A O and Herzel H 1997 Estimating the entropy of DNA sequences J. Theor. Biol. 188 369 (Pubitemid 27491571)
9. Rao R 2010 Probabilistic analysis of an ancient undeciphered script IEEE Comput. 43 76
10. Cover T M and Thomas J A 2006 Elements of Information Theory 2nd edn (New York: Wiley)
11. Montemurro M and Pury P A 2002 Long-range fractal correlations in literary corpora Fractals 10 451 (Pubitemid 36177540)
12. Alvarez-Lacalle E, Dorow B, Eckmann J-P and Moses E 2006 Hierarchical structures induce long-range dynamical correlations in written texts Proc. Nat. Acad. Sci. 103 7956 (Pubitemid 43801035)
13. Moscoso del Prado Martín F 2011 The universal 'shape' of human languages: spectral analysis beyond speech PLoS ONE at press
14. Altmann E A, Cristadoro G and Esposti M D 2012 On the origin of long-range correlations in texts Proc. Nat. Acad. Sci. USA 109 11582
15. Moscoso del Prado Martín F, Kostić Alexandar and Baayen R H 2004 Putting the bits together: an information theoretical perspective on morphological processing Cognition 94 1 (Pubitemid 39070421)
16. Ferrer-i-Cancho R and Díaz-Guilera A 2007 The global minima of the communicative energy of natural communication systems J. Stat. Mech. P06009
17. Dȩbowski Ł 2011 On the vocabulary of grammar-based codes and the logical consistency of texts IEEE Trans. Inf. Theory 57 4589
18. Herdan G 1964 Quantitative Linguistics (London: Butterworths)
19. Zipf G K 1949 Human Behaviour and the Principle of Least Effort (Cambridge, MA: Addison-Wesley)
20. Ferrer i Cancho R 2005 Zipf's law from a communicative phase transition Eur. Phys. J. B 47 449 (Pubitemid 41563613)
21. Prokopenko M, Ay N, Obst O and Polani D 2010 Phase transitions in least-effort communications J. Stat. Mech. P11025
22. Dȩbowski Ł 2011 Excess entropy in natural language: present state and perspectives Chaos 21 037105