Geo-located community detection in Twitter with enhanced fast-greedy optimization of modularity: the case study of typhoon Haiyan

International Journal of Geographical Information Science

Volumn 29, Issue 2, 2015, Pages 258-279

  Bakillah, Mohamed ^a,b   Li, Ren Yu ^a   Liang, Steve H L ^a  

^a UNIVERSITY OF CALGARY   (Canada)

^b UNIVERSITY OF HEIDELBERG   (Germany)

Author keywords

fast greedy optimization of modularity; geo located communities; social media; spatial clustering; Twitter

Indexed keywords

ALGORITHM; CLUSTER ANALYSIS; INTERNET; MASS MEDIA; MEDIA ROLE; NATURAL DISASTER; SOCIAL NETWORK; SPATIAL ANALYSIS; TYPHOON HAIYAN 2013;

EID: 84925641326     PISSN: 13658816     EISSN: 13623087     Source Type: Journal    
DOI: 10.1080/13658816.2014.964247     Document Type: Article

References (80)

1. Arenas, A., Díaz-Guilera, A., and Pérez-Vicente, C.J., 2006. Synchronization reveals topological scales in complex networks. Physical Review Letters, 96 (11), 114102. doi:10.1103/PhysRevLett.96.114102
2. Arenas, A., et al., 2007. Size reduction of complex networks preserving modularity. New Journal of Physics, 9 (6), 176. doi:10.1088/1367-2630/9/6/176
3. Bakillah, M. and Liang, S.H.L., 2012. Discovering sensor services with social network analysis and expanded SQWRL. In: S. Di Martino, A. Peron, and T. Tezuka, eds. Proceedings of the 11th international conference on web and wireless geographical information systems (W2GIS), April 2012. Naples: Springer Verlag, 221–238.
4. Bakillah, M., et al., 2007. Mapping between dynamic ontologies in support of geospatial data integration for disaster management. In: J. Li, S. Zlatanova, and A.G. Fabbri, eds. Geomatics solutions for disaster management. Berlin: Springer, 201–224.
5. Bakillah, M., et al., 2014. A dynamic and context-aware semantic mediation service for discovering and fusion of heterogeneous sensor data. Journal of Spatial Information Science, 6, 155–185.
6. Batagelj, V. and Zaveršnik, M., 2011. Fast algorithms for determining (generalized) core groups in social networks. Advances in Data Analysis and Classification, 5 (2), 129–145. doi:10.1007/s11634-010-0079-y
7. Bishop, C.M., 2006. Pattern recognition and machine learning. New York: Springer-Verlag.
8. Blondel, V.D., et al., 2008. Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment, 2008, P10008. doi:10.1088/1742-5468/2008/10/P10008
9. British Broadcasting Corporation (BBC), 2013a. Philippines Typhoon Haiyan: ‘Storm surge crushed all of these buildings’ [online]. Available from: http://www.bbc.com/news/world-asia-24890795 [Accessed 6June 2014].
10. British Broadcasting Corporation (BBC), 2013b. Typhoon Haiyan: thousands feared dead in Philippines [online]. Available from: http://www.bbc.com/news/world-asia-24887337 [Accessed 6June 2014].
11. British Broadcasting Corporation (BBC), 2013c. Typhoon Haiyan death toll rises over 5,000 [online]. Available from: http://www.bbc.com/news/world-asia-25051606 [Accessed 6June 2014].
12. Cao, F., et al., 2006. Density-based clustering over an evolving data stream with noise. In: J. Ghosh, et al., eds. Proceedings of the 6th SIAM international conference on data mining, 20–22April Bethesda, MD. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM), 328–339.
13. Carvalho, A.X.Y., et al., 2009. Spatial hierarchical clustering. Revista Brasileira de Biometria, 27 (3), 411–442.
14. Chang, W., Zeng, D., and Chen, H., 2008. A stack-based prospective spatio-temporal data analysis approach. Decision Support Systems, 45, 697–713. doi:10.1016/j.dss.2007.12.008
15. Charlton, M.E., 2006. A mark 1 geographical analysis machine for the automated analysis of point data sets: twenty years on. In: P.F. Fisher, ed. Classics from IJGIS: twenty years of the international journal of geographical information science and systems. Boca Raton, FL: CRC Press, 35–40.
16. Chen, J., Zaiane, O.R., and Goebel, R., 2009. Local community identification in social networks. In: International conference on advances in social networks analysis and mining (ASONAM), 20–22July 2009. Athens: IEEE, 237–242.
17. Chen, M., Jin, X., and Shen, D., 2011. Short text classification improved by learning multi-granularity topics. In: T. Walsh, ed. Proceedings of the 22nd international joint conference on artificial intelligence (IJCAI), July 2011. Barcelona: AAAI Press, 1778–1781.
18. Chiu, C., Hsu, M., and Wang, E., 2006. Understanding knowledge sharing in virtual communities: an integration of social capital and social cognitive theories. Decision Support Systems, 42, 1872–1888. doi:10.1016/j.dss.2006.04.001
19. Clauset, A., Newman, M.E.J., and Moore, C., 2004. Finding community structure in very large networks. Physical Review E, 70, 6. doi:10.1103/PhysRevE.70.066111
20. Conley, J., Gahegan, M., and Macgill, J., 2005. A genetic approach to detecting clusters in point data sets. Geographical Analysis, 37 (3), 286–314. doi:10.1111/j.1538-4632.2005.00617.x
21. Crooks, A., et al., 2013. #Earthquake: twitter as a distributed sensor system. Transactions in GIS, 17 (1), 124–147. doi:10.1111/j.1467-9671.2012.01359.x
22. Culotta, A., 2010. Towards detecting influenza epidemics by analyzing Twitter messages. In: KDD workshop on social media analytics. New York: ACM, 115–122.
23. De Meo, P., et al., 2014. Mixing local and global information for community detection in large networks. Journal of Computer and System Sciences, 80 (1), 72–87. doi:10.1016/j.jcss.2013.03.012
24. Donath, W. and Hoffman, A., 1973. Lower bounds for the partitioning of graphs. IBM Journal of Research and Development, 17 (5), 420–425. doi:10.1147/rd.175.0420
25. Duch, J. and Arenas, A., 2005. Community detection in complex networks using extremal optimization. Physical Review E, 72, 27104. doi:10.1103/PhysRevE.72.027104
26. Expert, P., et al., 2011. Uncovering space-independent communities in spatial networks. Proceedings of the National Academy of Sciences, 108 (19), 7663–7668. doi:10.1073/pnas.1018962108
27. Fernandez, A. and Gomez, S., 2008. Solving non-uniqueness in agglomerative hierarchical clustering using multidendrograms. Journal of Classification, 25, 43–65. doi:10.1007/s00357-008-9004-x
28. Fortunato, S., 2010. Community detection in graphs. Physics Reports, 486, 75–174. doi:10.1016/j.physrep.2009.11.002
29. Fortunato, S., Latora, V., and Marchiori, M., 2004. Method to find community structures based on information centrality. Physical Review E, 70, 56104. doi:10.1103/PhysRevE.70.056104
30. Freeman, L.C., 1977. A set of measures of centrality based on betweenness. Sociometry, 40, 35–41. doi:10.2307/3033543
31. Girvan, M. and Newman, M.E.J., 2002. Community structure in social and biological networks. Proceedings of the National Academy of Sciences, 99 (12), 7821–7826. doi:10.1073/pnas.122653799
32. Glass, A.G. and Mantel, N., 1969. Lack of time-space clustering of childhood leukemia in Los Angeles County, 1960–1964. Cancer Research, 29 (11), 1995–2001.
33. Hagar, C., 2009. The information and social needs of Cumbrian farmers during the UK 2001 foot and mouth disease outbreak and the role of information and communication technologies. In: M. Döring and B. Nerlich, eds. The socio-cultural impact of foot and mouth disease in the UK in 2001: experiences and analyses. Manchester University Press.
34. Hastings, M.B., 2006. Community detection as an inference problem. Physical Review E, 74, 035102. doi:10.1103/PhysRevE.74.035102
35. Kannan, R., Vempala, S., and Vetta, A., 2004. On clusterings: good, bad and spectral. Journal of the Acm, 51 (3), 497–515. doi:10.1145/990308.990313
36. Kaufman, L. and Rousueeuw, P., 1990. Finding groups in data: an introduction to cluster analysis. In: Wiley series in probability and mathematical statistics. Applied probability and statistics. Vol. 1. New York: John Wiley and Sons. doi:10.1002/9780470316801
37. Khan, G., et al., 2009. Application and integration of lattice data analysis, network K-functions, and geographic information system software to study ice-related crashes. Transportation Research Record: Journal of the Transportation Research Board, 2136, 67–76. doi:10.3141/2136-08
38. Kisilevich, S., et al., 2010. Spatio-temporal clustering: a survey. In: O. Maimon and L. Rokach, eds. Data mining and knowledge discovery handbook. Berlin: Springer.
39. Li, X., Hu, W., and Hu, W., 2006. A coarse-to-fine strategy for vehicle motion trajectory clustering. In: International conference on pattern recognition (ICPR), August 2006. Hong Kong: IEEE, 591–594.
40. Liu, P., Zhou, D., and Wu, N., 2007. Varied density based spatial clustering of application with noise. In: Proceedings of IEEE conference ICSSSM. New York: IEEE, 528–531.
41. Martin, E., et al., 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of KDD. Palo Alto, CA: AAAI, 226–231.
42. Mennis, J., 2010. Multidimensional map algebra: design and implementation of a spatio-temporal GIS processing language. Transactions in GIS, 14 (1), 1–21. doi:10.1111/j.1467-9671.2009.01179.x
43. Mooney, P. and Corcoran, P., 2013. Understanding the roles of communities in volunteered geographic information projects. In: J.M. Krisp, ed. Progress in location-based services. Berlin: Springer, 357–371.
44. Mountrakis, G. and Gunson, K., 2009. Multi-scale spatiotemporal analyses of moose–vehicle collisions: a case study in northern Vermont. Ijgis, 23, 1389–1412.
45. Murata, T., 2010. Detecting communities in social networks. In: B. Furht, ed. Handbook of social network technologies and applications. New York: Springer, 269–280.
46. Nakaya, T. and Yano, K., 2010. Visualising crime clusters in a space-time cube: an exploratory data-analysis approach using space-time kernel density estimation and scan statistics. Transactions in GIS, 14 (3), 223–239. doi:10.1111/j.1467-9671.2010.01194.x
47. Nanopoulos, A., Theodoridis, Y., and Manolopoulos, Y., 2001. C2P: clustering based on closest pairs. In: P.M.G. Apers, et al., eds. Proceedings of VLDB. San Francisco, CA: Morgan Kaufmann, 331–340.
48. Newman, M.E.J., 2004a. Detecting community structure in networks. The European Physical Journal B – Condensed Matter, 38, 321–330. doi:10.1140/epjb/e2004-00124-y
49. Newman, M.E.J., 2004b. Fast algorithm for detecting community structure in networks. Physical Review E, 69, 66133. doi:10.1103/PhysRevE.69.066133
50. Newman, M.E.J. and Girvan, M., 2004. Finding and evaluating community structure in networks. Physical Review E, 69 (2), 26113. doi:10.1103/PhysRevE.69.026113
51. Openshaw, S., et al., 1987. A mark 1 geographical analysis machine for the automated analysis of point data sets. Ijgis, 1 (4), 335–358.
52. Palla, G., et al., 2005. Uncovering the overlapping community structure of complex networks in nature and society. Nature, 435 (7043), 814–818. doi:10.1038/nature03607
53. Papadopoulos, S., et al., 2011. Cluster-based landmark and event detection for tagged photo collections. IEEE Multimedia, 18 (1), 52–63. doi:10.1109/MMUL.2010.68
54. Papadopoulos, S., et al., 2012. Community detection in social media performance and application considerations. Data Mining and Knowledge Discovery, 24, 515–554. doi:10.1007/s10618-011-0224-z
55. Parimala, M., Lopez, D., and Senthilkumar, N.C., 2001. A survey on density based clustering algorithms for mining large spatial databases. International Journal of Advanced Science and Technology, 31 (1), 59–66.
56. Pei, T., et al., 2010. Windowed nearest neighbor method for mining spatio-temporal clusters in the presence of noise. Ijgis, 24, 925–948.
57. Phan, X.-H., Nguyen, L.-M., and Horiguchi, S., 2008. Learning to classify short and sparse text & web with hidden topics from large-scale data collections. In: Proceedings of 17th WWW, April 2008. New York: ACM, 91–100.
58. Pons, P. and Latapy, M., 2005. Computing communities in large networks using random walks. In: P. Yolum, et al., eds. Computer and information sciences. Berlin: Springer, 284–293.
59. Pozdnoukhov, A. and Kaiser, C., 2011. Space-time dynamics of topics in streaming text. In: Proceedings of the 3rd ACM SIGSPATIAL international workshop on location-based social networks. New York: ACM, 1–8.
60. Raghavan, U.N., Albert, R., and Kumara, S., 2007. Near linear time algorithm to detect community structures in large-scale networks. Physical Review E, 76, 036106.
61. Rasheduzzaman Chowdhury, A.K.M. and Asikur Rahman, M.D., 2010. An efficient method for subjectively choosing parameter k automatically in VDBSCAN. In: V. Mahadevan and Z. Jianhong, eds. Proceedings of Computer and Automation Engineering (ICCAE) 2010, 26–28 February Singapore. Singapore: IEEE, 38–41.
62. Reichardt, J. and Bornholdt, S., 2006. Statistical mechanics of community detection. Physical Review A, 74, 016110.
63. Rhouma, D. and Romdhane, L.B., 2014. An efficient algorithm for community mining with overlap in social networks. Expert Systems with Applications, 41 (9), 4309–4321.
64. Sahoo, A.K., 2013. ADCA: advanced density based clustering algorithm for spatial database system. International Journal of Computer Science and Mobile Computing, 2 (7), 41–47.
65. Sakaki, T., Okazaki, M., and Matsuo, Y., 2010. Earthquake shakes Twitter users: real-time event detection by social sensors. In: Proceedings of the 19th international conference on WWW, Raleigh, NC. New York: ACM, 851–860.
66. Schaeffer, S.E., 2007. Graph clustering. Computer Science Review, 1 (1), 27–64. doi:10.1016/j.cosrev.2007.05.001
67. Shklovski, I., Palen, L., and Sutton, J., 2008. Finding community through information and communication technology during disaster events. In: CSCW’08, 8–12November 2008 San Diego, CA. New York: ACM, 127–136.
68. Smith, P.G., et al., 1976. Epidemiology of childhood leukaemia in greater London: a search for evidence of transmission assuming a possibly long latent period. British Journal of Cancer, 33 (1), 1–8. doi:10.1038/bjc.1976.1
69. Šubelj, L. and Bajec, M., 2014. Group detection in complex networks: an algorithm and comparison of the state of the art. Physica A: Statistical Mechanics and Its Applications, 397, 144–156. doi:10.1016/j.physa.2013.12.003
70. Vieweg, S., et al., 2010. Microblogging during two natural hazards events: what twitter may contribute to situational awareness. In: Proceedings of the 28th international conference on human factors in computing systems, Atlanta, USA. New York: ACM, 1079–1088.
71. Vragovic, I. and Louis, E., 2006. Network community structure and loop coefficient method. Physical Review E, 74, 016105. doi:10.1103/PhysRevE.74.016105
72. Walsh, F. and Pozdnoukhov, A., 2011. Spatial structure and dynamics of urban communities. In: Proceedings of the 2011 workshop on pervasive urban applications, 12–15 June San Francisco, CA. Unpublished.
73. Walther, M. and Kaisser, M., 2013. Geo-spatial event detection in the twitter stream. In: P. Serdyukov, et al., eds. Advances in information retrieval. Berlin: Springer, 356–367.
74. Wang, X., et al., 2010. Discovering overlapping groups in social media. In: IEEE international conference on data mining, 13–17December 2010. Sydney: IEEE, 569–578.
75. Ward, J.H.J., 1963. Hierarchical grouping to optimize an objective function. Journal of the American Statistical Association, 58, 236–244. doi:10.1080/01621459.1963.10500845
76. Xie, J., Kelley, S., and Szymanski, B., 2013. Overlapping community detection in networks: the state of the art and comparative study. ACM Computing Surveys, 45 (4), 1–35. doi:10.1145/2501654.2501657
77. Xu, R. and Wunsch II, D., 2005. Survey of clustering algorithms. IEEE Transactions on Neural Networks, 16 (3), 645–678. doi:10.1109/TNN.2005.845141
78. Yang, B. and Liu, J., 2008. Discovering global network communities based on local centralities. ACM Transactions on the Web (TWEB), 2 (1), 1–32. doi:10.1145/1326561.1326570
79. Zhang, T., Ramakrishnan, R., and Livny, M., 1996. BIRCH: an efficient data clustering method for very large databases. In: J. Widom, ed. Proceedings of ACM SIGMOD. New York: ACM, 103–114.
80. Zhang, Y., Wu, Y., and Yang, Q., 2012. Community discovery in Twitter based on user interests. Journal of Computational Information Systems, 8 (3), 991–1000.