Twitter data laid almost bare: An insightful exploratory analyser

Expert Systems with Applications

Volumn 90, Issue , 2017, Pages 501-517

  Xiao, Xin ^a   Attanasio, Antonio ^a   Chiusano, Silvia ^a   Cerquitelli, Tania ^a  

^a POLITECNICO DI TORINO   (Italy)

Author keywords

Apache spark; Association rules; Cluster analysis; Social networks; Text spatio temporal distance; Tweets

Indexed keywords

ASSOCIATION RULES; BEHAVIORAL RESEARCH; CLUSTER ANALYSIS; DATA MINING; DECISION MAKING; SOCIAL NETWORKING (ONLINE);

ASSOCIATION RULE ANALYSIS; ASSOCIATION RULE DISCOVERY; EXPERIMENTAL EVALUATION; INNOVATIVE METHOD; ON-LINE COMMUNITIES; SIGNIFICANT PATTERNS; SPATIO TEMPORAL; TWEETS;

DATA ACQUISITION;

EID: 85028650209     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2017.08.017     Document Type: Article

References (41)

1. Agrawal, R., Imielinski, T., Swami, A., Mining association rules between sets of items in large databases. Sigmod conference, 1993, 207–216.
2. Arcaini, P., Bordogna, G., Ienco, D., Sterlacchini, S., User-driven geo-temporal density-based exploration of periodic and not periodic events reported in social networks. Information Science 340:C (2016), 122–143.
3. Baralis, E., Cerquitelli, T., Chiusano, S., Grimaudo, L., Xiao, X., Analysis of twitter data using a multiple-level clustering strategy. Model and data engineering, 2013, Springer, 13–24.
4. Bernabe-Moreno, J., Tejeda-Lorente, A., Porcel, C., Herrera-Viedma, E., A new model to quantify the impact of a topic in a location over time with social media. Expert Systems with Applications 42:7 (2015), 3381–3395, 10.1016/j.eswa.2014.11.067.
5. Bouttier, J., Francesco, P.D., Guitter, E., Geodesic distance in planar graphs. Nuclear Physics B 663:3 (2003), 535–567, 10.1016/S0550-3213(03)00355-9.
6. Bud (2014). Bud light on twitter. http://t.co/Kj69El7MRE.
7. Cagliero, L., Cerquitelli, T., Garza, P., Grimaudo, L., Twitter data analysis by means of strong flipping generalized itemsets. Journal of Systems and Software 94 (2014), 16–29.
8. Capdevila, J., Pericacho, G., Torres, J., Cerquides, J., Scaling dbscan-like algorithms for event detection systems in twitter. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), 10048 LNCS, 2016, 356–373.
9. Cunha, T., Soares, C., Mendes Rodrigues, E., Tweeprofiles: Detection of spatio-temporal patterns on twitter. Luo, X., Yu, J.X., Li, Z., (eds.), 2014, Springer International Publishing, Cham, 123–136).
10. Dasgupta, S.S., Natarajan, S., Kaipa, K.K., Bhattacherjee, S.K., Viswanathan, A., Sentiment analysis of facebook data using hadoop based open source technologies. 2015 ieee international conference on data science and advanced analytics (dsaa), 2015, 1–3.
11. Di Corso, E., Cerquitelli, T., Ventura, F., Self-tuning techniques for large scale cluster analysis on textual data collections. Proceedings of the symposium on applied computing SAC ’17, 2017, ACM, New York, NY, USA, 771–776, 10.1145/3019612.3019661.
12. Ester, M., Kriegel, H.-P., Sander, J., Wimmer, M., Xu, X., Incremental clustering for mining in a data warehousing environment. Proceedings of the 24rd international conference on very large data bases VLDB ’98, 1998, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 323–333.
13. Ester, M., Kriegel, H.-P., Sander, J., Xu, X., A density-based algorithm for discovering clusters a density-based algorithm for discovering clusters in large spatial databases with noise. Proceedings of the second international conference on knowledge discovery and data mining KDD’96, 1996, AAAI Press, 226–231.
14. García-Gavilanes, R., Kaltenbrunner, A., Sáez-Trumper, D., Baeza-Yates, R., Aragón, P., Laniado, D., Who are my audiences? a study of the evolution of target audiences in microblogs. Aiello, L.M., McFarland, D., (eds.), 2014, Springer International Publishing, 561–572.
15. Godfrey, D., Johns, C., Meyer, C., Race, S., & Sadek, C. (2014). A case study in text mining: Interpreting twitter data from world cup tweets. arXiv preprint arXiv:1408.5427,.
16. Han, J., Pei, J., Yin, Y., Mining frequent patterns without candidate generation. In SIGMOD’00, Dallas, TX, 2000.
17. Hubert, L., Arabie, P., Comparing partitions. Journal of Classification 2:1 (1985), 193–218, 10.1007/BF01908075.
18. Ikeda, K., Hattori, G., Ono, C., Asoh, H., Higashino, T., Twitter user profiling based on text and community mining for market analysis. Knowledge-Based Systems 51 (2013), 35–47, 10.1016/j.knosys.2013.06.020.
19. Jenkins, T. (2014). World cup 2014: Fans get bitten by the luis suarez bug - in pictures. https://www.theguardian.com/football/gallery/2014/jun/26/world-cup-2014-luis-suarez-advert-bite.
20. Jing, L., Ng, M.K., Huang, J.Z., An entropy weighting k-means algorithm for subspace clustering of high-dimensional sparse data. IEEE Transactions on Knowledge and Data Engineering 19:8 (2007), 1026–1041.
21. Kim, J.W., Kim, D., Keegan, B., Kim, J.H., Kim, S., Oh, A., Social media dynamics of global co-presence during the 2014 fifa world cup. Proceedings of the 33rd annual acm conference on human factors in computing systems, 2015, ACM, 2623–2632.
22. Kim, T., Huerta-Canepa, G., Park, J., Hyun, S.J., Lee, D., What's happening: Finding spontaneous user clusters nearby using twitter. Privacy, security, risk and trust (passat) and 2011 ieee third inernational conference on social computing (socialcom), 2011 ieee third international conference on, 2011, IEEE, 806–809.
23. Lee, C.H., Mining spatio-temporal information on microblogging streams using a density-based online clustering method. Expert Systems with Applications 39:10 (2012), 9623–9641.
24. Lee, R., Wakamiya, S., Sumiya, K., Exploring geospatial cognition based on location-based social network sites. World Wide Web 18:4 (2015), 845–870.
25. Lloret, E., Balahur, A., Gómez, J.M., Montoyo, A., Palomar, M., Towards a unified framework for opinion retrieval, mining and summarization. Journal of Intelligent Information Systems 39:3 (2012), 711–747.
26. Manning, C.D., Raghavan, P., Schütze, H., et al. Introduction to information retrieval. 1, 2008, Cambridge university press Cambridge.
27. Pang-Ning, T., Steinbach, M., Kumar, V., Introduction to data mining. 2006, Addison-Wesley.
28. Phelan, O., Mccarthy, K., Smyth, B., Using twitter to recommend real-time topical news. Proceedings of the third ACM conference on recommender systems, 2009, ACM, 385–388.
29. Rabiger, S., Spiliopoulou, M., A framework for validating the merit of properties that predict the influence of a twitter user. Expert Systems with Applications 42:5 (2015), 2824–2834, 10.1016/j.eswa.2014.11.006.
30. Rand, W.M., Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association 66:336 (1971), 846–850, 10.1080/01621459.1971.10482356.
31. Robertson, S., Understanding inverse document frequency: On theoretical arguments for idf. Journal of Documentation 60:5 (2004), 503–520, 10.1108/00220410410560582.
32. Saito, K., Ohara, K., Kimura, M., Motoda, H., Change point detection for burst analysis from an observed information diffusion sequence of tweets. Journal of Intelligent Information Systems 44:2 (2015), 243–269.
33. Sakai, T., Tamura, K., Kotozaki, S., Hayashida, T., Kitakami, H., Real-time local topic extraction using density-based adaptive spatiotemporal clustering for enhancing local situation awareness. 2015 7th international joint conference on knowledge discovery, knowledge engineering and knowledge management (ic3k), 01, 2015, 203–210.
34. Salton, G., Wong, A., Yang, C.S., A vector space model for automatic indexing. Commun. ACM 18:11 (1975), 613–620.
35. Steiger, E., Resch, B., Zipf, A., Exploration of spatiotemporal and semantic clusters of twitter data using unsupervised neural networks. International Journal of Geographucal Information Science 30:9 (2016), 1694–1716, 10.1080/13658816.2015.1099658.
36. Steinbach, M., Karypis, G., Kumar, V., A comparison of document clustering techniques. Kdd workshop on text mining, 2000.
37. Thomas, K., Grier, C., Song, D., Paxson, V., Suspended accounts in retrospect: An analysis of twitter spam. Proceedings of the 2011 acm sigcomm conference on internet measurement conference, 2011, ACM, 243–258.
38. Vicient, C., Moreno, A., Unsupervised topic discovery in micro-blogging networks. Expert Systems with Applications 42:1718 (2015), 6472–6485, 10.1016/j.eswa.2015.04.014.
39. Yang, M.-C., Rim, H.-C., Identifying interesting twitter contents using topical analysis. Expert Systems with Applications 41:9 (2014), 4330–4336, 10.1016/j.eswa.2013.12.051.
40. Yu, Y., Wang, X., World cup 2014 in the twitter world: A big data analysis of sentiments in u.s. sports fans’ tweets. Computers in Human Behavior 48 (2015), 392–400.
41. Zaharia, M., Chowdhury, M., Franklin, M.J., Shenker, S., Stoica, I., Spark: Cluster computing with working sets. Proceedings of the 2nd usenix conference on hot topics in cloud computing HotCloud’10, 2010, USENIX Association, Berkeley, CA, USA 10–10.