Cluster-discovery of Twitter messages for event detection and trending

Journal of Computational Science

Volumn 6, Issue , 2015, Pages 47-57

  Kaleel, Shakira Banu ^a   Abhari, Abdolreza ^a  

^a RYERSON UNIVERSITY   (Canada)

Author keywords

Cluster discovery; Data mining; Event detection; Event trending; Locality sensitive hashing; Term frequency inverse document frequency; Web social networking

Indexed keywords

CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; DATA MINING; SOCIAL NETWORKING (ONLINE); TEXT PROCESSING;

CLUSTER-DISCOVERY; EVENT DETECTION; EVENT TRENDING; LOCALITY SENSITIVE HASHING; TERM FREQUENCY-INVERSE DOCUMENT FREQUENCIES;

IMAGE RETRIEVAL;

EID: 84918585858     PISSN: 18777503     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jocs.2014.11.004     Document Type: Article

References (52)

1. Morris M.R., Teevan J., Panovich K. What do people ask their social networks, and why? A survey study of status message and behavior. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2010, 1739-1748.
2. Allan J., Lavrenko V., Malin D., Swan R. Detections, bounds, and timelines: UMass and TDT-3. Proceedings of Topic Detection and Tracking Workshop 2000, 167-174.
3. Fiscus J.G., Doddington G.R. Topic Detection and Tracking 2002, 17-31. Kluwer Academic Publishers, Norwell, MA, USA. J. Allan (Ed.).
4. Karen W. Celebrating #Twitter7 2013, March, Available at: https://blog.twitter.com/2013/celebrating-twitter7.
5. Lin J., Ryaboy D. Scaling big data mining infrastructure: the Twitter experience. SIGKDD Explor. Newsl. 2013, 14(April):6-19.
6. Mishne G., Dalton J., Li Z., Sharma A., Lin J. Fast data in the era of big data: Twitter's real-time related query suggestion architecture. Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data 2013, 1147-1158.
7. Allan J. Topic Detection and Tracking 2002, 1-16. Kluwer Academic Publishers, Norwell, MA, USA. J. Allan (Ed.).
8. Yang Y., Pierce T., Carbonell J. A study of retrospective and on-line event detection. Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 1998, 28-36.
9. Packer H.S., Samangooei S., Hare J.S., Gibbins N., Lewis P.H. Event detection using Twitter and structured semantic query expansion. Proceedings of the 1st International Workshop on Multimodal Crowd Sensing 2012, 7-14.
10. Sakaki T., Okazaki M., Matsuo Y. Earthquake shakes Twitter users: real-time event detection by social sensors. Proceedings of the 19th International Conference on World Wide Web 2010, 851-860.
11. Petrovic S., Osborne M., Lavrenko V. Streaming first story detection with application to Twitter. Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics 2010, 181-189.
12. Kaleel S.B., AlMeshary M., Abhari A. Event detection and trending in multiple social networking sites. Proceedings of the 16th Communications & Networking Symposium 2013, 5:1-5:5.
13. A conversation with Harold Camping, Prophesier of Judgment Day. New York Magazine 2011, May.
14. Goffard C. Harold Camping is at the Heart of a Mediapocalypse 2011, May, Available at: http://articles.latimes.com/2011/may/21/local/la-me-rapture-20110521.
15. Family Radio The end of the world is here! Holy god will bring judgement day on May 21, 2011 2011, May, Available: http://web.archive.org/web/20110608223300/http://www.familyradio.com/graphical/literature/judgment/judgment.html.
16. Twitter REST API v1.1 Resources 2014, Available at: https://dev.twitter.com/docs/api/1.1.
17. Facebook Quickstart for Graph API 2014, Available at: https://developers.facebook.com/docs/graph-api/quickstart/.
18. Bollen J., Mao H., Zeng X. Twitter mood predicts the stock market. J. Comput. Sci. 2011, 2:1-8.
19. Choi H., Varian H. Predicting the present with Google trends. Econ. Rec. 2012, 88:2-9.
20. Preis T., Moat H.S., Stanley H.E. Quantifying trading behavior in financial markets using Google Trends. Sci. Rep. 2013, 3.
21. Manning C.D., Raghavan P., Schutze H. Introduction to Information Retrieval 2008, Cambridge University Press, New York, NY, USA.
22. Cutting D.R., Karger D.R., Pedersen J.O., Tukey J.W. Scatter/gather: a cluster-based approach to browsing large document collections. Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 1992, 318-329.
23. Brants T., Chen F., Farahat A. A system for new event detection. Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2003, 330-337.
24. Parikh R., Karlapalem K. ET: events from tweets. Proceedings of the 22nd International Conference on World Wide Web Companion 2013, 613-620.
25. Sriram B., Fuhry D., Demir E., Ferhatosmanoglu H., Demirbas M. Short text classification in Twitter to improve information filtering. Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval 2010, 841-842.
26. Sankaranarayanan J., Samet H., Teitler B.E., Lieberman M.D., Sperling J. TwitterStand: news in tweets. Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems 2009, 42-51.
27. Ozdikis O., Senkul P., Oguztuzun H. Semantic expansion of hashtags for enhanced event detection in Twitter. Proceedings of the 1st International Workshop on Online Social Systems 2012.
28. Ahmed A., Ho Q., Eisenstein J., Xing E., Smola A.J., Teo C.H. Unified analysis of streaming news. Proceedings of the 20th International Conference on World Wide Web 2011, 267-276.
29. Becker H., Naaman M., Gravano L. Beyond trending topics: real-world event identification on Twitter. Proceeding of the 5th International AAAI Conference on Weblogs and Social Media (ICWSM 11) 2011, July, AAAI Press.
30. Indyk P., Motwani R. Approximate nearest neighbors: towards removing the curse of dimensionality. Proceedings of the 30th Annual ACM Symposium on Theory of Computing 1998, 604-613.
31. Weber R., Schek H., Blott S. A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. Proceedings of the 24th International Conference on very Large Data Bases 1998, 194-205.
32. Petrovic S. Real-Time Event Detection in Massive Streams 2012, PhD Dissertation, Institute for Language, Cognition and Computation, School of Informatics, University of Edinburgh, UK.
33. Indyk P., Motwani R., Raghavan P., Vempala S. Locality-preserving hashing in multidimensional spaces. Proceedings of the 29th Annual ACM Symposium on Theory of Computing 1997, 618-625.
34. Dasgupta A., Kumar R., Sarlos T. Fast locality-sensitive hashing. Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA 2011, 1073-1081.
35. Slaney M., Casey M. Locality-sensitive hashing for finding nearest neighbors. IEEE Signal Process. Mag. 2008, 25(March):128-131.
36. Datar M., Immorlica N., Indyk P., Mirrokni V.S. Locality-sensitive hashing scheme based on p-stable distributions. Proceedings of the 20th Annual Symposium on Computational Geometry 2004, 253-262.
37. Sharifi B., Hutton M., Kalita J.K. Experiments in microblog summarization. Proceedings of the 2010 IEEE Second International Conference on Social Computing 2010, 49-56.
38. Yardi S., Boyd D. Tweeting from the Town Square: Measuring Geographic Local Networks 2010.
39. Naaman M., Becker H., Gravano L. Hip and trendy: characterizing emerging trends on Twitter. J. Am. Soc. Inf. Sci. Technol. 2011, 62(May):902-918.
40. Kwak H., Lee C., Park H., Moon S. What is Twitter, a social network or a news media?. Proceedings of the 19th International Conference on World Wide Web 2010, 591-600.
41. Cvijikj I.P., Michahelles F. Monitoring trends on Facebook. Proceedings of the 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing 2011, 895-902.
42. Salton G., McGill M.J. Introduction to Modern Information Retrieval 1986, McGraw-Hill, Inc., New York, NY, USA.
43. Russell M.A. Mining the Social Web: Analyzing Data from Facebook, Twitter, LinkedIn, and Other Social Media Sites 2011, O'Reilly Media, Inc.
44. Broder A. On the resemblance and containment of documents. Proceedings of the Compression and Complexity of Sequences 1997 1997, 21.
45. Li H. LSH: Theory and Application. JDL Seminar on Large-Scale Indexing and Search 2010, Available at: http://www.haoli.me/uploads/9/0/6/7/9067538/jdl-lsh_seminar_lh.pdf.
46. Charikar M.S. Similarity estimation techniques from rounding algorithms. Proceedings of the 34th Annual ACM Symposium on Theory of Computing 2002, 380-388.
47. Ravichandran D., Pantel P., Hovy E. Randomized algorithms and NLP: using locality sensitive hash function for high speed noun clustering. Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics 2005, 622-629.
48. Goodrich M.T., Tamassia R., Goldwasser M.H. Data Structures and Algorithms in Python 2013, Wiley Publishing.
49. Fredkin E. "Trie Memory" Communication of the ACM September 1960, vol. 3:490-499.
50. Kamath K.Y., Caverlee J. Content-based crowd retrieval on the real-time web. Proceedings of the 21st ACM International Conference on Information and Knowledge Management 2012, 195-204.
51. Goorha S., Ungar L. Discovery of significant emerging trends. Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2010, 57-64.
52. Uden L., Wang L.S.L., Rodrguez J.M.C., Yang H., Ting I. The 8th International Conference on Knowledge Management in Organizations: Social and Big Data Computing for Knowledge Management 2013, Springer Publishing Company, Incorporated.