Word lengths are optimized for efficient communication

Proceedings of the National Academy of Sciences of the United States of America

Volumn 108, Issue 9, 2011, Pages 3526-3529

  Piantadosi, Steven T ^a   Tily, Harry ^a   Gibson, Edward ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Information theory; Rational analysis

Indexed keywords

ARTICLE; INTERPERSONAL COMMUNICATION; LANGUAGE; PRIORITY JOURNAL;

COMMUNICATION; HUMANS; LANGUAGE; MODELS, STATISTICAL;

EID: 79952769973     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1012551108     Document Type: Article

References (43)

1. Zipf G (1936) The Psychobiology of Language (Routledge, London).
2. Zipf G (1949) Human Behavior and the Principle of Least Effort (Addison-Wesley, New York).
3. Sigurd B, Eeg-Olofsson M, van de Weijer J (2004) Word length, sentence length and frequency-Zipf revisited. Studia Linguistica 58:37-52.
4. Strauss U, Grzybek P, Altmann G (2006)Word length and word frequency. Contributions to the Science of Text and Language: Text, Speech and Language Technology, Vol. 31, ed Grzybek P (Springer, Berlin), pp 277-294.
5. Grzybek P (2006) History and methodology of word length studies. Contributions to the Science of Text and Language: Text, Speech and Language Technology, Vol. 31, ed Grzybek P (Springer, Berlin), pp 15-90.
6. Manin D (2006) Experiments on predictability of word in context and information rate in natural language. J Inform Processes 6:229-236.
7. Aylett M, Turk A (2004) The smooth signal redundancy hypothesis: A functional explanation for relationships between redundancy, prosodic prominence, and duration in spontaneous speech. Lang Speech 47:31-56. (Pubitemid 39015925)
8. Jaeger TF (2006) Redundancy and syntactic reduction in spontaneous speech. PhD thesis (Stanford University, Stanford, CA).
9. Levy R, Jaeger TF (2007) Speakers optimize information density through syntactic reduction. Advances in Neural Information Processing Systems 19, eds Schölkopf B, Platt J, Hoffman T (MIT Press, Cambridge, MA), pp 849-856.
10. Jaeger TF (2010) Redundancy and reduction: Speakers manage syntactic information density. Cognit Psychol 61:23-62.
11. Piantadosi S, Tily H, Gibson E (2009) The Communicative Lexicon Hypothesis. The 31st Annual Meeting of the Cognitive Science Society (CogSci09) (Cognitive Science Society, Austin, TX), pp 2582-2587.
12. Frank AF, Jaeger TF (2008) Speaking rationally: Uniform information density as an optimal strategy for language production. The 31st Annual Meeting of the Cognitive Science Society, eds Love BC, McRae K, Sloutsky VM (Cognitive Science Society, Austin, TX), pp 939-944.
13. van Son R, Pols L (2003) How efficient is speech? Proc Inst Phonetic Sci 25:171-184.
14. Cohen Priva U (2008) Using information content to predict phone deletion. Proceedings of the 27th West Coast Conference on Formal Linguistics, eds Abner N, Bishop J (Cascadilla Proceedings Project, Somerville, MA), pp 90-98.
15. Altmann G, Steedman M (1988) Interaction with context during human sentence processing. Cognition 30:191-238.
16. Altmann G, Garnham A, Dennis Y (1992) Avoiding the garden path: Eye movements in context. J Mem Lang 31:685-712.
17. Tanenhaus MK, Spivey-Knowlton MJ, Eberhard KM, Sedivy JC (1995) Integration of visual and linguistic information in spoken language comprehension. Science 268:1632-1634.
18. Spivey MJ, Tanenhaus MK (1998) Syntactic ambiguity resolution in discourse: Modeling the effects of referential context and lexical frequency. J Exp Psychol Learn Mem Cogn 24:1521-1543. (Pubitemid 126528696)
19. Kaiser E, Trueswell JC (2004) The role of discourse context in the processing of a flexible word-order language. Cognition 94:113-147.
20. Grodner D, Gibson E, Watson D (2005) The influence of contextual contrast on syntactic processing: evidence for strong-interaction in sentence comprehension. Cognition 95:275-296. (Pubitemid 40395235)
21. Frazier L (1979) On Comprehending Sentences: Syntactic Parsing Strategies (Univ of Connecticut, Storrs, CT).
22. Jurafsky D (1996) A probabilistic model of lexical and syntactic access and disambiguation. Cogn Sci 20:137-194.
23. Gibson E (1998) Linguistic complexity: Locality of syntactic dependencies. Cognition 68:1-76.
24. McDonald SA, Shillcock RC (2003) Eye movements reveal the on-line computation of lexical probabilities during reading. Psychol Sci 14:648-652. (Pubitemid 37550872)
25. Frisson S, Rayner K, Pickering MJ (2005) Effects of contextual predictability and transitional probability on eye movements during reading. J Exp Psychol Learn Mem Cogn 31:862-877. (Pubitemid 41677495)
26. Levy R (2008) Expectation-based syntactic comprehension. Cognition 106:1126-1177.
27. Gahl S, Garnsey S (2004) Knowledge of grammar, knowledge of usage: Syntactic probabilities affect pronunciation variation. Language 80:748-775. (Pubitemid 41424786)
28. Tily H, et al. (2009) Syntactic probabilities affect pronunciation variation in spontaneous speech. Lang Cognition 1:147-165.
29. Trueswell J, Tanenhaus M, Garnsey S (1994) Semantic influences on parsing: Use of thematic role information in syntactic ambiguity resolution. J Mem Lang 33:285-318.
30. Altmann GT, Kamide Y (1999) Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition 73:247-264.
31. Kamide Y, Altmann G, Haywood S (2003) The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements. J Mem Lang 49:133-156. (Pubitemid 36802720)
32. Clear J (1993) The British National Corpus (MIT Press, Cambridge, MA).
33. Koehn P (2005) Europarl: A parallel corpus for statistical machine translation. Proceedings of the 10th Machine Translation Summit (MT Summit) (Asia-Pacific Association for Machine Translation, Aichi, Japan), pp 79-86.
34. Baayen HR, Piepenbrock R, Gulikers L (1995) The CELEX Lexical Database. (Release 2) (Univ of Pennsylvania, Philadelphia).
35. Lieberman P (1963) Some effects of semantic and grammatical context on the production and perception of speech. Lang Speech 6:172-187.
36. Jespersen O (1922) Language: Its Nature, Development, and Origin (Henry Holt, New York).
37. Fowler C, Housum J (1987) Talkers signaling of new and old words in speech and listeners' perception and use of the distinction. J Mem Lang 25:489-504.
38. Gregory M, Raymond W, Bell A, Fosler-Lussier E, Jurafsky D (1999) The effects of collocational strength and contextual predictability in lexical production. Chicago Linguistics Society 35 (CLS-99) (Univ of Chicago, Chicago), pp 151-166.
39. Demberg V, Keller F (2008) Data from eye-tracking corpora as evidence for theories of syntactic processing complexity. Cognition 109:193-210.
40. Brants T, Franz A (2009) Web 1T 5-Gram, 10 European Languages, Version 1 (Linguistic Data Consortium, Philadelphia).
41. Tiedmann J (2009) News from OPUS - a collection of multilingual parallel corpora with tools and interfaces. Recent Advances in Natural Language Processing, eds Nicolov N, Bontcheva K, Angelova G, Mitkov R (John Benjamins, Amsterdam), Vol V, pp 237-248.
42. Stolcke A (2002) SRILM - an extensible language modeling toolkit. Proceedings of the Seventh International Conference on Spoken Language Processing (ICSLP/Interspeech, Denver), Vol 3, pp 901-904.
43. Chen SF, Goodman J (1999) An empirical study of smoothing techniques for language modeling. Comput Speech Lang 13:359-393.