Smoothing techniques for adaptive online language models: Topic tracking in tweet streams

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2011, Pages 422-429

  Lin, Jimmy ^a   Snow, Rion ^a   Morgan, William ^a  

^a TWITTER INC   (United States)

Author keywords

Stream processing; Tdt; Twitter

Indexed keywords

COMPUTATIONAL LINGUISTICS; MODELING LANGUAGES; SOCIAL NETWORKING (ONLINE);

LANGUAGE MODEL; MICRO-BLOGGING SERVICES; ONLINE LANGUAGES; SHORT TEXTS; SIMPLE++; SMOOTHING TECHNIQUES; STREAM PROCESSING; TDT; TOPIC TRACKING; TWITTER;

BASEBALL;

EID: 80052647541     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2020408.2020476     Document Type: Conference Paper

References (22)

1. J. Allan. Topic Detection and Tracking: Event-Based Information Organization. Kluwer Academic Publishers, Dordrecht, The Netherlands, 2002.
2. S. Asur and B. A. Huberman. Predicting the future with social media. Technical Report HPL-2010-53, HP Laboratories, 2010.
3. S. Asur, B. A. Huberman, G. Szabo, and C. Wang. Trends in social media: Persistence and decay. Technical report, HP Laboratories, 2011.
4. E. Bakshy, J. M. Hofman, W. A. Mason, and D. J. Watts. Everyone's an influencer: Quantifying influence on Twitter. In Proceedings of the Fourth ACM International Conference on Web Search and Data Mining (WSDM 2011), pages 65-74, Hong Kong, China, 2011.
5. T. Brants, A. C. Popat, P. Xu, F. J. Och, and J. Dean. Large language models in machine translation. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 858-867, Prague, Czech Republic, 2007.
6. M. Cha, H. Haddadi, F. Benevenuto, and K. P. Gummadi. Measuring user influence in Twitter: The million follower fallacy. In Proceedings of the 4th International AAAI Conference on Weblogs and Social Media (ICWSM 2010), pages 10-17, Washington, D.C., 2010.
7. S. F. Chen and J. Goodman. An empirical study of smoothing techniques for language modeling. In Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics (ACL 1996), pages 310-318, Santa Cruz, California, 1996.
8. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Çetintemel, Y. Xing, and S. B. Zdonik. Scalable distributed stream processing. In Proceedings of the First Biennial Conference on Innovative Data Systems Research (CIDR 2003), Asilomar, California, 2003.
9. A. Goyal, H. Daumé, and S. Venkatasubramanian. Streaming for large scale NLP: Language modeling. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 512-520, Boulder, Colorado, 2009.
10. D. J. Hopkins and G. King. A method of automated nonparametric content analysis for social science. American Journal of Political Science, 54(1):229-247, 2010.
11. D. Jurafsky and J. H. Martin. Speech and Language Processing. Pearson, Upper Saddle River, New Jersey, 2009.
12. H. Kwak, C. Lee, H. Park, and S. Moon. What is Twitter, a social network or a news media? In Proceedings of the 19th International World Wide Web Conference (WWW 2010), pages 591-600, Raleigh, North Carolina, 2010.
13. K. Lerman and R. Ghosh. Information contagion: An empirical study of the spread of news on Digg and Twitter social networks. In Proceedings of the 4th International AAAI Conference on Weblogs and Social Media (ICWSM 2010), pages 90-97, Washington, D.C., 2010.
14. A. Levenberg and M. Osborne. Stream-based randomised language models for SMT. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing (EMNLP 2009), pages 756-764, Singapore, 2009.
15. X. Liu, S. Zhang, F. Wei, and M. Zhou. Recognizing named entities in tweets. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HLT 2011), Portland, Oregon, 2011.
16. S. Muthukrishnan. Data streams: Algorithms and applications. Foundations and Trends in Computer Science, 1(2), 2005.
17. B. O'Connor, R. Balasubramanyan, B. R. Routledge, and N. A. Smith. From Tweets to polls: Linking text sentiment to public opinion time series. In Proceedings of the 4th International AAAI Conference on Weblogs and Social Media (ICWSM 2010), pages 122-129, Washington, D.C., 2010.
18. S. Petrovíc, M. Osborne, and V. Lavrenko. Streaming first story detection with application to Twitter. In Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT/NAACL 2010), pages 181-189, Los Angeles, California, 2010.
19. D. Ramage, S. Dumais, and D. Liebling. Characterizing microblogs with topic models. In Proceedings of the 4th International AAAI Conference on Weblogs and Social Media (ICWSM 2010), pages 130-137, Washington, D.C., 2010.
20. A. Ritter, C. Cherry, and B. Dolan. Unsupervised modeling of Twitter conversations. In Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT/NAACL 2010), pages 172-180, Los Angeles, California, 2010.
21. D. M. Romero, B. Meeder, and J. Kleinberg. Differences in the mechanics of information diffusion across topics: Idioms, political hashtags, and complex contagion on Twitter. In Proceedings of the 20th International World Wide Web Conference (WWW 2011), pages 695-704, Hyderabad, India, 2011.
22. J. Weng, E.-P. Lim, J. Jiang, and Q. He. TwitterRank: Finding topic-sensitive influential Twitterers. In Proceedings of the Third ACM International Conference on Web Search and Data Mining (WSDM 2010), pages 261-270, New York, New York, 2010.