Building a large-scale corpus for evaluating event detection on twitter

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2013, Pages 409-418

  McMinn, Andrew J ^a   Moshfeghi, Yashar ^a   Jose, Joemon M ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Crowdsourcing; Event detection; Mechanical turk; Reproducibility; Social media; Test collection; Twitter corpus

Indexed keywords

CROWDSOURCING; EVENT DETECTION; MECHANICAL TURKS; REPRODUCIBILITIES; SOCIAL MEDIA; TEST COLLECTION; TWITTER CORPUS;

KNOWLEDGE MANAGEMENT; SOCIAL NETWORKING (ONLINE);

INFORMATION RETRIEVAL SYSTEMS;

EID: 84889566730     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2505515.2505695     Document Type: Conference Paper

References (22)

1. TDT 2004: Annotation manual, 2004.
2. C. C. Aggarwal and K. Subbian. Event detection in social streams. In SDM'12, pages 624-635, 2012.
3. J. Allan. Topic detection and tracking: event-based information organization, Volume 12. Springer, 2002.
4. G. Amati, G. Amodeo, M. Bianchi, A. Celi, C. Nicola, M. Flammini, C. Gaibisso, G. Gambosi, and G. Marcone. Fub, iasi-cnr, univaq at trec 2011. In TREC 2011. 2011.
5. H. Becker, D. Iter, M. Naaman, and L. Gravano. Identifying content for planned events across social media sites. In WSDM'12, pages 533-542, 2012.
6. H. Becker, M. Naaman, and L. Gravano. Beyond trending topics: Real-world event identification on twitter. In ICWSM'11, pages 438-441, 2011.
7. F. Benevenuto, G. Magno, T. Rodrigues, and V. Almeida. Detecting spammers on twitter. In CEAS'10, Volume 6, 2010.
8. D. Boyd, S. Golder, and G. Lotan. Tweet, tweet, retweet: Conversational aspects of retweeting on twitter. In HICSS'10, pages 1-10, 2010.
9. M. Hu, S. Liu, F. Wei, Y. Wu, J. Stasko, and K.-L. Ma. Breaking news on twitter. In CHI'12, pages 2751-2754, 2012.
10. R. Li, K. H. Lei, R. Khadiwala, and K. C.-C. Chang. Tedas: A twitter-based event detection and analysis system. Data Engineering, International Conference on, 0:1273-1276, 2012.
11. R. McCreadie, I. Soboroff, J. Lin, C. Macdonald, I. Ounis, and D. McCullough. On building a reusable twitter corpus. In SIGIR'12, pages 1113-1114, 2012.
12. I. Ounis, C. Macdonald, J. Lin, and I. Soboroff. Overview of the trec-2011 microblog track. In TREC 2011, 2011.
13. S. Petrović, M. Osborne, and V. Lavrenko. Streaming first story detection with application to twitter. In HLT'10, pages 181-189, 2010.
14. S. Petrović, M. Osborne, and V. Lavrenko. Using paraphrases for improving first story detection in news and twitter. In NAACL HLT'12, pages 338-346, 2012.
15. F. Pukelsheim. The three sigma rule. The American Statistician, 48(2): pp. 88-91, 1994.
16. J. J. Randolph. Free-Marginal Multirater Kappa (multirater K [free]): An Alternative to Fleiss' Fixed-Marginal Multirater Kappa. In Joensuu University Learning and Instruction Symposium, 2005.
17. T. Sakaki, M. Okazaki, and Y. Matsuo. Earthquake shakes twitter users: real-time event detection by social sensors. In WWW'10, pages 851-860, 2010.
18. T. H. Van Duc, T. Demeester, J. Deleu, P. Demeester, and C. Develder. Ugent participation in the microblog track 2012. In TREC 2012, 2012.
19. J. Weng and B.-S. Lee. Event detection in twitter. In ICWSM'11, 2011.
20. Y. Yang, T. Pierce, and J. Carbonell. A study of retrospective and on-line event detection. In SIGIR'98, pages 28-36, 1998.
21. Q. Zhao, P. Mitra, and B. Chen. Temporal and information flow based event detection from social text streams. In AAAI'07, pages 1501-1506, 2007.
22. X. Zhao and J. Jiang. An empirical comparison of topics in twitter and traditional media. Singapore Management University School of Information Systems Technical paper series., 10:2011, 2011.