Scaling DBSCAN-like algorithms for event detection systems in Twitter

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 10048 LNCS, Issue , 2016, Pages 356-373

  Capdevila, Joan ^a,b   Pericacho, Gonzalo ^a   Torres, Jordi ^a,b   Cerquides, Jesús ^c  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

^b BARCELONA SUPERCOMPUTING CENTER   (Spain)

^c ARTIFICIAL INTELLIGENCE RESEARCH INSTITUTE IIIA CSIC   (Spain)

Author keywords

Apache Spark; Data clustering; DBSCAN; Event detection; MapReduce; Parallel algorithm; Twitter

Indexed keywords

COMPUTER ARCHITECTURE; MULTIPROCESSING SYSTEMS; NETWORK ARCHITECTURE; PARALLEL ALGORITHMS; PARALLEL ARCHITECTURES; SOCIAL NETWORKING (ONLINE);

DATA CLUSTERING; DBSCAN; EVENT DETECTION; MAP-REDUCE; TWITTER;

CLUSTERING ALGORITHMS;

EID: 85007209099     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-319-49583-5_27     Document Type: Conference Paper

References (26)

1. Wong, W., Neill, D.: Tutorial on event detection. In: Special Interest Group on Knowledge Discovery and Data Mining (SIGKDD) (2009)
2. Kulldorff, M., Athas, W., Feurer, E., Miller, B., Key, C.: Am. J. Publ. Health 88(9), 1377-1380 (1998)
3. Yu, Z.: Tutorial on location-based social networks. In: Proceedings of the 21st International Conference on World wide web (WWW) (2012)
4. Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes Twitter users: real-time event detection by social sensors. In: Proceedings of the 19th International Conference on World Wide Web (WWW) (2010)
5. Lee, R., Sumiya, K.: Measuring geographical regularities of crowd behaviors for Twitter-based geo-social event detection. In: Proceedings of the 2nd ACMSIGSPATIAL International Workshop on Location Based Social Networks (LBSN) (2010)
6. Newman, N.: Mainstream media and the distribution of news in the age of social discovery. Reuters Institute for the Study of Journalism, University of Oxford (2011)
7. Stelter, B., Cohen, N.: Citizen Journalists Provided Glimpses of Mumbai Attacks. (2008). http://www.nytimes.com/2008/11/30/world/asia/30twitter.html
8. Atefeh, F., Khreich, W.: A survey of techniques for event detection in Twitter. Comput. Intell. 1, 132-164 (2015)
9. Becker, H., Naaman, M., Gravano, L.: Beyond trending topics: real-world event identification on Twitter. In: Proceedings of the Fifth International Conference on Weblogs and Social Media (2011)
10. Ester, M., Kriegel, H., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Kdd, vol. 96(34) (1996)
11. Gomide, J., Veloso, A., Meira, W., Almeida, V., Benevenuto, F., Ferraz, F., Teixeira, M.: Dengue surveillance based on a computational model of spatiotemporal locality of Twitter. In: Proceedings of the 3rd International Web Science Conference (2011)
12. Tamura, K., Ichimura, T.: Density-based spatiotemporal clustering algorithm for extracting bursty areas from georeferenced documents. In: IEEE International Conference on Systems, Man, and Cybernetics (SMC) (2013)
13. Birant, D., Kut, A.: ST-DBSCAN: an algorithm for clustering spatial-temporal data. Data and Knowledge Engineering (2007)
14. Singh, S.: Spatial temporal analysis of social media data. Master Thesis at Technische Universität München (2015)
15. Capdevila, J., Cerquides, J., Nin, J., Torres, J.: Tweet-SCAN: an event discovery technique for geo-located tweets. In: Artificial Intelligence Research and Development - Proceedings of the 18th International Conference of the Catalan Association for Artificial Intelligence (2015)
16. Capdevila, J., Cerquides, J., Nin, J., Torres, J.: Tweet-SCAN: An event discovery technique for geo-located tweets. Pattern Recognition Letters. Available online 25 August (2016)
17. Blei, D.: Probabilistic topic models. Commun. ACM. 55(4), 77-84 (2012)
18. Li, L., Goodchild, M., Xu, B.: Spatial, temporal, and socioeconomic patterns in the use of Twitter and Flickr. Cartography Geogr. Inf. Sci. 40, 261-277 (2013)
19. Zaharia, M., Chowdhury, M., Franklin, M., Shenker, S., Stoica, I.: Spark: cluster computing with working sets. In: Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing (2010)
20. Sander, J., Ester, M., Kriegel, H., Xu, X.: Density-based clustering in spatial databases: the algorithm GDBSCAN and its applications. Data Mining Knowl. Discov. 2(2), 169-194 (1998)
21. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51, 107-113 (2008)
22. He, Y., Tan, H., Luo, W., Feng, S., Fan, J.: MR-DBSCAN: a scalable MapReducebased DBSCAN algorithm for heavily skewed data. Front. Comput. Sci. 8, 83-99 (2014)
23. Cordova, I., Moh, T.S.: DBSCAN on resilient distributed datasets. In: International Conference on High Performance Computing Simulation (HPCS), pp. 531-540 (2015)
24. Meagher, D.: Octree Encoding: A New Technique for the Representation, Manipulation and Display of Arbitrary 3-D Objects by Computer. Electrical and Systems Engineering Department Rensseiaer Polytechnic Institute Image Processing Laboratory (1980)
25. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825-2830 (2011)
26. Amigό, E., Gonzalo, J., Artiles, J., Verdejo, F.: A comparison of extrinsic clustering evaluation metrics based on formal constraints. Inf. Retrieval 12(4), 461-486 (2009)