Decoding least effort and scaling in signal frequency distributions

Physica A: Statistical Mechanics and its Applications

Volumn 345, Issue 1-2, 2005, Pages 275-284

  Ferrer i Cancho, Ramon ^a,b  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b UNIVERSITÀ DI ROMA LA SAPIENZA   (Italy)

Author keywords

Animal communication; Human language; Scaling; Zipf's law

Indexed keywords

BIOCOMMUNICATIONS; FREQUENCIES; PROBABILITY; SIGNAL ENCODING; SIGNAL PROCESSING; SIGNAL RECEIVERS;

COMMUNICATION FRAMEWORK; HUMAN LANGUAGE; SCALING; ZIPF'S LAW;

COMMUNICATION SYSTEMS;

EID: 8344232338     PISSN: 03784371     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physa.2004.06.158     Document Type: Article

References (41)

1. MA. Nowak, D.C. Krakauer, The evolution of language, Proc. Natl. Acad. Sci. USA 96 (1999) 8028-8033.
2. M.A. Nowak, J.B. Plotkin, D.C. Krakauer, The evolutionary language game, J. Theor. Biol. 200 (1999) 147-162.
3. R.M. Seyfarth, D. Cheney, P. Marier, Vervet monkey alarm calls: semantic communication in a free-ranging primate, Anim. Beha. 28 (1980) 1070-1094.
4. Y. Ravin, C. Leacock (Eds.), Polysemy, Theoretical and Computational Approaches, Oxford University Press, New York, 2000.
5. M.D. Hauser, The Evolution of Communication, MIT Press, Cambridge, MA, 1996.
6. S.R. Ellis, R.J. Hitchcock, The emergence of Zipf's law: spontaneous encoding by users of a command language, IEEE Trans. Syst. Man Cybern. 16 (3) (1986) 423-427.
7. J.D. Burgos, Fractal representation of the immune b cell repertoire, BioSystems 39 (1996) 19-24.
8. J.D. Burgos, P. Moreno-Tovar, Zipf-scaling behavior in the immune system, BioSystems 39 (1996) 227-232.
9. R.B. Ash, Information Theory, Wiley, New York, 1965.
10. G.K. Zipf, Human Behaviour and the Principle of Least Effort. An Introduction to Human Ecology, Hafner reprint, New York, 1972, first ed.: Addison-Wesley, Cambridge, MA, 1949.
11. V.K. Balasubrahmanyan, S. Naranan, Quantitative linguistics and complex system studies, J. Quant. Linguistics 3 (3) (1996) 177-228.
12. R. Ferrer i Cancho, R.V. Solé, Two regimes in the frequency of words and the origin of complex lexicons: Zipf's law revisited, J. Quant. Linguistics 8 (3) (2001) 165-173.
13. Frequencies obtained from A. Kilgarriffs word-frequency list of the British National corpus, (http:// www.itri.brighton.ac.uk/~Adam.Kilgarriff/bnc- readme.html).
14. R. Ferrer i Cancho, Core and peripheral lexicon through word length optimization, IEEE Trans. Inform. Theory, submitted.
15. J.F. Michell, Who Wrote Shakespeare?, Thames & Hudson, Slovenia, 1999.
16. Statistics performed on the bash history file of an anonymous experienced user at the Complex Systems Lab.
17. R. Ferrer i Cancho, R.V. Sole, Least effort and the origins of scaling in human language, Proc. Natl. Acad. Sci. USA 100 (2003) 788-791.
18. B. Mandelbrot, An informational theory of the statistical structure of language, in: W. Jackson (Ed.), Communication Theory, Butterworths, London, 1953, p. 486.
19. H.A. Simon, On a class of skew distribution functions, Biometrika 42 (1955) 425-440.
20. G.A. Miller, Some effects of intermittent silence, Am. J. Psychol. 70 (1957) 311-314.
21. J.S. Nicolis, Chaos and Information Processing, World Scientific, Singapore, 1991.
22. W. Li, Random texts exhibit Zipf's-law-like word frequency distribution, IEEE Trans. Inform. Theory 38 (6) (1992) 1842-1845.
23. S. Naranan, V. Balasubrahmanyan, Models for power-law relations in linguistics and information science, J. Quant. Linguistics 5 (1-2) (1998) 35-61.
24. P. Harremoës, F. Topsøe, Zipf's law, hyperbolic distributions and entropy loss, in: IEEE International Symposium on Information Theory, 2002, in press.
25. W. Li, Letters to the editor, Complexity 3 (1998) 9-10; A.A. Tsonis, C. Schultz, P.A. Tsonis, comments to "Zipf's law and the structure and evolution of languages", Complexity 2 (5) (1997) 12-13.
26. W. Li, Letters to the editor, Complexity 3 (1998) 9-10; A.A. Tsonis, C. Schultz, P.A. Tsonis, comments to "Zipf's law and the structure and evolution of languages", Complexity 2 (5) (1997) 12-13.
27. M.A. Montemurro, Beyond the Zipf-Mandelbrot law in quantitative linguistics, Physica A 300 (2001) 567-578 cond-mat/0104066.
28. L. Pietronero, E. Tosatti, V. Tosatti, A. Vespignani, Explaining the uneven distribution of number in nature: the laws of Benford and Zipf, Physica A 293 (2001) 297-304.
29. S. Denisov, Fractal binary sequences: Tsallis thermodynamics and the Zipf's law, Phys. Lett. A 235 (1997) 447-451.
30. A.G. Bashkirov, A.V. Vityazev, Information entropy and power-law distribution for chaotic systems, Physica A 277 (2000) 136-145.
31. J. Binney, N. Dowrick, A. Fisher, M. Newman, The Theory of Critical Phenomena. An Introduction to the Renormalization Group, Oxford University Press, New York, 1992.
32. J.N. Kapur, Maximum Entropy Models in Science and Engineering, Wiley, New Delhi, 1989 (Ch. Maximum-entropy discrete univariate probability distributions, pp. 30-43).
33. E.W. Montroll, M.F. Shlesinger, Maximum entropy formalism, fractals, scaling phenomena, and 1/f noise: a tale of tails, J. Stat. Phys. 32 (1983) 209-230.
34. H. Haken, Synergetics - An Introduction: Nonequilibrium Phase Transitions & Self-Organization in Physics, Chemistry & Biology, Springer, New York, 1979.
35. S. Naranan, Statistical laws in information science, language and system of natural numbers: some striking similarities, J. Sci. Ind. Res. 51 (1992) 736-755.
36. S. Naranan, V. Balasubrahmanyan, Information theoretic models in statistical linguistics - part I: a model for word frequencies, Curr. Sci. 63 (1992) 261-269.
37. T.M. Cover, J.A. Thomas, Elements of Information Theory, Wiley, New York, 1991.
38. R. Suzuki, P.L. Tyack, J. Buck, The use of Zipf's law in animal communication analysis, Anim. Beha., accepted.
39. N. Chomsky, Aspects of the Theory of Syntax, MIT Press, Cambridge, MA, 1965.
40. D. Bickerton, Language and Species, Chicago University Press, Chicago, 1990.
41. R. Jackendoff, Patterns in this Mind, Basic Books, New York, 1994.