Entropy Rate Constancy in Text

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 2002-July, Issue , 2002, Pages 199-206

  Genzel, Dmitriy ^a   Charniak, Eugene ^a  

^a Brown Univerity   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ENTROPY RATES; LANGUAGE GENERATION;

ENTROPY;

EID: 85035979432     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. M. P. Aylett. 1999. Stochastic suprasegmentals: Relationships between redundancy, prosodic structure and syllabic duration. In Proceedings of ICPhS-99, San Francisco.
2. E. Charniak. 2001. A maximum-entropy-inspired parser. In Proceedings of ACL-2001, Toulouse.
3. J. T. Goodman. 2001. A bit of progress in language modeling. Computer Speech and Language, 15:403-434.
4. I. Kontoyiannis, P. H. Algoet, Yu. M. Suhov, and A.J. Wyner. 1998. Nonparametric entropy estimation for stationary processes and random fields, with applications to English text. IEEE Trans. Inform. Theory, 44:1319-1327, May.
5. I. Kontoyiannis. 1996. The complexity and entropy of literary styles. NSF Technical Report No. 97, Department of Statistics, Stanford University, June. [unpublished, can be found at the author's web page].
6. R. Kuhn and R. De Mori. 1990. A cache-based natural language model for speech reproduction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(6):570-583.
7. M. P. Marcus, B. Santorini, and M. A. Marcinkiewicz. 1993. Building a large annotated corpus of English: the Penn treebank. Computational Linguistics, 19:313-330.
8. J. B. Plotkin and M. A. Nowak. 2000. Language evolution and information theory. Journal of Theoretical Biology, pages 147-159.
9. C. E. Shannon. 1948. A mathematical theory of communication. The Bell System Technical Journal, 27:379-423, 623-656, July, October.