Revisiting the predictability of language: Response completion in social media

EMNLP-CoNLL 2012 - 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Proceedings of the Conference

Volumn , Issue , 2012, Pages 1489-1499

  Pang, Bo ^a   Ravi, Sujith ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC RESPONSE; LARGE-SCALE DATASET; NEWS ARTICLES; NOVEL APPLICATIONS; ON-LINE SETTING; SOCIAL MEDIA; USER-GENERATED; USER-GENERATED CONTENT;

MOBILE DEVICES;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84883397833     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Regina Barzilay and Mirella Lapata. 2005. Modeling local coherence: An entity-based approach. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL'05.
2. David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent dirichlet allocation. Journal of Machine Learning Research, 3:993-1022.
3. Peter F. Brown, Vincent J. Della Pietra, Robert L. Mercer, Stephen A. Della Pietra, and Jennifer C. Lai. 1992. An estimate of an upper bound for the entropy of English. Comput. Linguist., 18:31-40.
4. Ivan Bulyko, Mari Ostendorf, and Andreas Stolcke. 2003. Getting more mileage from web text sources for conversational speech language modeling using class-dependent mixtures. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: companion Volume of the Proceedings of HLT-NAACL 2003-short papers - Volume 2, NAACL-Short '03, pages 7-9.
5. Thomas M. Cover and Roger C. King. 1978. A convergent gambling estimate of the entropy of English. IEEE Transactions on Information Theory, 24:413-421.
6. Steve Farmer, Richard Sproat, and Michael Witzel. 2004. The collapse of the Indus-script thesis: The myth of a literate Harappan civilization. Electronic Journal of Vedic Studies, 11:379-423 and 623-656.
7. Yijue How and Min-Yen Kan. 2005. Optimizing predictive text entry for short message service on mobile phones. In Proceedings of the Human Computer Interfaces International (HCII).
8. Christina L. James and Kelly M. Reischel. 2001. Text input for mobile devices: comparing model prediction to actual performance. In Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '01, pages 365-371, New York, NY, USA. ACM.
9. Henry Kucera and W. Nelson Francis. 1967. Computational analysis of present-day American English. Brown University Press.
10. I. Scott MacKenzie and R. William Soukoreff. 2002. Text entry for mobile computing: Models and methods, theory and practice. Human-Computer Interaction, 17(2-3):147-198.
11. Qiaozhu Mei and Kenneth Church. 2008. Entropy of search logs: how hard is search? with personalization? with backoff? In Proceedings of the international conference on Web search and web data mining, WSDM '08, pages 45-54.
12. Hamid Moradi, Jerzy W. Grzymalabusse, and James A. Roberts. 1998. Entropy of english text: experiments with humans and a machine learning system based on rough sets. Information Sciences, 104:31-47.
13. Petteri Nurmi, Andreas Forsblom, Patrik Floréen, Peter Peltonen, and Petri Saarikko. 2009. Predictive text input in a mobile shopping assistant: methods and interface design. In Proceedings of the 14th international conference on Intelligent user interfaces, IUI '09, pages 435-438, New York, NY, USA. ACM.
14. Rajesh P. N. Rao, Nisha Yadav, Mayank N. Vahia, Hrishikesh Joglekar, R. Adhikari, and Iravatham Mahadevan. 2009. Entropic evidence for linguistic structure in the Indus script. Science.
15. Alan Ritter, Colin Cherry, and William B. Dolan. 2011. Data-driven response generation in social media. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 583-593.
16. Ronald Rosenfeld. 2000. Two decades of statistical language modeling: Where do we go from here? Proceedings of the IEEE, 88.
17. Claude E. Shannon. 1948. A mathematical theory of communication. Bell System Technical Journal, 27:379-423 and 623-656.
18. Claude E. Shannon. 1951. Prediction and entropy of printed English. Bell System Technical Journal, 30:50-64.
19. W. J. Teahan and John G. Cleary. 1996. The entropy of English using PPM-based models. In In Data Compression Conference, pages 53-62. IEEE Computer Society Press.
20. Joseph Weizenbaum. 1966. Eliza: a computer program for the study of natural language communication between man and machine. Commun. ACM, 9:36-45.
21. D. Yavuz. 1978. Zipf's law and entropy (Corresp.). IEEE Transactions on Information Theory, 20:650.
22. Xing Yi and James Allan. 2009. A comparative study of utilizing topic models for information retrieval. In Proceedings of the European Conference on IR Research on Advances in Information Retrieval, pages 29-41.