Twitter location (Sometimes) matters: Exploring the relationship between georeferenced tweet content and nearby feature classes

Journal of Spatial Information Science

Volumn 9, Issue 2014, 2014, Pages 1-36

  Hahmann, Stefan ^a   Purves, Ross S ^b   Burghardt, Dirk ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Correlation between location and content; Data mining; Mobile microblogging; Natural language processing; OpenStreetMap; Twitter

Indexed keywords

EID: 84920016528     PISSN: None     EISSN: 1948660X     Source Type: Journal    
DOI: 10.5311/JOSIS.2014.9.185     Document Type: Article

References (73)

1. AHERN, S., NAAMAN, M., NAIR, R., AND YANG, J. H.-I. World explorer: Visualizing aggregate data from unstructured text in geo-referenced collections. In Proc. 7th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL) (New York, NY and USA, 2007), ACM, pp. 1-10. doi:10.1145/1255175.1255177.
2. ANDRIENKO, G., ANDRIENKO, N., BOSCH, H., ERTL, T., FUCHS, G., JANKOWSKI, P., AND THOM, D. Thematic patterns in georeferenced tweets through spacetime visual analytics. Computing in Science and Engineering 15, 3 (2013), 72-82. doi:10.1109/MCSE.2013.70.
3. ANDROUTSOPOULOS, I., KOUTSIAS, J., CHANDRINOS, K. V., AND SPYROPOULOS, C. D. An experimental comparison of naive Bayesian and keyword-based anti-spam filtering with personal e-mail messages. In Proc 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) (2000), ACM, pp. 160-167. doi:10.1145/345508.345569.
4. ASUR, S., AND HUBERMAN, B. A. Predicting the future with social media. In Proc. IEEE.WIC.ACM International Conference on Web Intelligence and Intelligent Agent Technology (2010), N. Cercone, Ed., vol. 1, IEEE, pp. 492-499. doi:10.1109/WI-IAT.2010.63.
5. BERGER, A. L., DELLA PIETRA, S., AND DELLA PIETRA, V. J. A maximum entropy approach to natural language processing. Computational Linguistics 22, 1 (1996), 39-71.
6. BIEMANN, C., BORDAG, S., HEYER, G., QUASTHOFF, U., AND WOLFF, C. Languageindependent methods for compiling monolingual lexical data. In Computational Linguistics and Intelligent Text Processing, A.Gelbukh, Ed., vol. 2945 of Lecture Notes in Computer Science. Springer, Berlin, 2004, pp. 217-228. doi:10.1007/978-3-540-24630-5_27.
7. BIRD, S., KLEIN, E., AND LOPER, E. Natural language processing with Python, 1 ed. O'Reilly, Cambridge,MA, 2009.
8. BOLLEN, J.,MAO, H., AND ZENG, X. Twittermood predicts the stock market. Journal of Computational Science 2, 1 (2011), 1-8. doi:10.1016/j.jocs.2010.12.007.
9. CALLISON-BURCH, C., AND DREDZE, M. Creating speech and language data with amazon's mechanical turk. In Proc. NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk (CSLDAMT) (2010), ACL, pp. 1-12.
10. CARSTENSEN, K.-U., EBERT, C., EBERT, C., JEKAT, S., KLABUNDE, R., AND LANGER, H. Computerlinguistik und Sprachtechnologie: Eine Einführung, 3 ed. Spektrum, Heidelberg, 2010.
11. CAUMANNS, J. A fast and simple stemming algorithm for German words. PhD thesis, Freie Universität, Berlin, 1999.
12. CHENG, Z., CAVERLEE, J., AND LEE, K. You are where you Tweet: A content-based approach to geo-locating twitter users. In Proc. 19th ACM International Conference on Information and Knowledge Management (CIKM) (2010), J. Huang, Ed., ACM, pp. 759-768. doi:10.1145/1871437.1871535.
13. CIULLA, F., MOCANU, D., BARONCHELLI, A., GONCALVES, B., PERRA, N., AND VESPIGNANI, A. Beating the news using social media: The case study of American Idol. EPJ Data Science 1, 1 (2012), 8. doi:10.1140/epjds8.
14. CONGER, A. J. Integration and generalization of kappas for multiple raters. Psychological Bulletin 88, 2 (1980), 322-328. doi:10.1037/0033-2909.88.2.322.
15. CRAMPTON, J. W., GRAHAM, M., POORTHUIS, A., SHELTON, T., STEPHENS, M., WILSON, M.W., AND ZOOK, M. Beyond the geotag: Situating "big data" and leveraging the potential of the geoweb. Cartography and Geographic Information Science 40, 2 (2013), 130-139. doi:10.1080/15230406.2013.777137.
16. CRANDALL, D. J., BACKSTROM, L., HUTTENLOCHER, D., AND KLEINBERG, J. Mapping theWorld's photos. In Proc. 18th International Conference onWorldWideWeb (2009), J. Quemada and G. León, Eds., ACM, pp. 761-770. doi:10.1145/1526709.1526812.
17. CRAWFORD, C. How informative is Twitter? http:sblog.textwise.com/2010/01/08/how-informative-is-twitter/, 2010. Accessed 04.01.2013.
18. CRYSTAL, D. A Dictionary of Linguistics and Phonetics, 2nd ed. The Language Library. Blackwell, Oxford, 1985.
19. DE LONGUEVILLE, B., SMITH, R. S., AND LURASCHI, G. "OMG, from here, I can see the flames!": A use case of mining location based social networks to acquire spatio-temporal data on forest fires. In Proc. 2009 International Workshop on Location Based Social Networks (LBSN) (2009), X. Zhou, Ed., ACM, pp. 73-80. doi:10.1145/1629890.1629907.
20. DOWNS, J. S., HOLBROOK, M. B., SHENG, S., AND CRANOR, L. F. Are your participants gaming the system? In Proc. 28th SIGCHI Conference onHuman Factors in Computing Systems (CHI) (2010), E.Mynatt, D. Schoner, G. Fitzpatrick, S.Hudson, K. Edwards, and T. Rodden, Eds., pp. 2399-2402. doi:10.1145/1753326.1753688.
21. DUNNING, T. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics 19, 1 (1993), 61-74.
22. FLEISS, J. L. Measuring nominal scale agreement among many raters. Psychological Bulletin 76, 5 (1971), 378-382. doi:10.1037/h0031619.
23. GAYO-AVELLO, D. No, you cannot predict elections with Twitter. IEEE Internet Computing 16, 6 (2012), 91-94. doi:10.1109/MIC.2012.137.
24. GELBUKH, A., Ed. Computational Linguistics and Intelligent Text Processing: Proceedings of 5th International Conference CICLing (Berlin and Heidelberg, 2004), vol. 2945 of Lecture Notes in Computer Science, Springer.
25. GOODCHILD, M. F. Citizens as sensors: The world of volunteered geography. Geo-Journal 69, 4 (2007), 211-221. doi:10.1007/s10708-007-9111-y.
26. GRAHAM, M., AND SHELTON, T. Geography and the future of big data, big data and the future of geography. Dialogues in Human Geography 3, 3 (2013), 255-261. doi:10.1177/2043820613513121.
27. HAMP, B., FELDWEG, H., ET AL. Germanet-a lexical-semantic net for German. In Proc. ACL Workshop Automatic Information Extraction and Building of Lexical Semantic Resources for NLP Applications (1997), pp. 9-15.
28. HAN, B., AND BALDWIN, T. Lexical normalisation of short text messages: Makn sens a #twitter. In Proc. 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (HLT) (2011), vol. 1, ACL, pp. 368-378.
29. HECHT, B., HONG, L., SUH, B., AND CHI, E. H. Tweets from Justin Bieber's heart: The dynamics of the location field in user profiles. In Proc. SIGCHI Conference on Human Factors in Computing Systems (CHI) (2011), D. Tan, Ed., ACM, pp. 237-246. doi:10.1145/1978942.1978976.
30. HERFORT, B., ALBUQUERQUE, J. D., SCHELHORN, S.-J., AND ZIPF, A. Exploring the geographical relations between social media and flood phenomena to improve situational awareness. In Connecting a Digital Europe Through Location and Place, J. Huerta, S. Schade, and C. Granell, Eds., Lecture Notes in Geoinformation and Cartography. Springer, Berlin, 2014, pp. 55-71. doi:10.1007/978-3-319-03611-3_4.
31. HOLLENSTEIN, L., AND PURVES, R. Exploring place through user-generated content: Using Flickr tags to describe city cores. Journal of Spatial Information Science 1, 1 (2010), 21-48. doi:10.5311/JOSIS.2010.1.3.
32. JAVA, A., SONG, X., FININ, T., AND TSENG, B. Why we Twitter: Understanding microblogging usage and communities. In Proc. 9th WebKDD and 1st SNA-KDD 2007 Workshop on Web Mining and Social Network Analysis (2007), ACM Press, pp. 56-65. doi:10.1145/1348549.1348556.
33. JUNGHERR, A., JÜRGENS, P., AND SCHOEN, H. Why the Pirate Partywon the German election of 2009 or the trouble with predictions: A response to Tumasjan, A., Sprenger, T. O., Sander, P. G.,&Welpe, I. M. "Predicting elections with Twitter. Social Science Computer Review 30, 2 (2012), 229-234. doi:10.1177/0894439311404119.
34. KENT, J. D., AND CAPELLO, H. T. Spatial patterns and demographic indicators of effective social media content during the Horsethief Canyon fire of 2012. Cartography and Geographic Information Science 40, 2 (2013), 78-89.
35. KITCHIN, R. Big data and human geography: Opportunities, challenges and risks. Dialogues in Human Geography 3, 3 (2013), 262-267. doi:10.1177/2043820613513388.
36. KITTUR, A., CHI, E. H., AND SUH, B. Crowdsourcing user studies with Mechanical Turk. In Proc. 26th SIGCHI Conference on Human Factors in Computing Systems (CHI) (2008), M. Czerwinski, A. Lund, and D. Tan, Eds., ACM, pp. 453-456. doi:10.1145/1357054.1357127.
37. KUN-LIN LIU, WU-JUN LI, AND MINYI GUO. Emoticon smoothed language models for Twitter sentiment analysis. In Proc. 26th AAAI Conference on Artificial Intelligence (2012). http:swww.aaai.org/ocs/index.php/AAAI/AAAI12/paper/view/5083.
38. LAMPOS, V., AND CRISTIANINI, N. Nowcasting events from the social web with statistical learning. ACM Transactions on Intelligent Systems and Technology 3, 4 (2012), 72:1-72:22. doi:10.1145/2337542.2337557.
39. LANDIS, J. R., AND KOCH, G. G. The measurement of observer agreement for categorical data. Biometrics 33, 1 (1977), 159-174. doi:10.2307/2529310.
40. LEE, R., AND SUMIYA, K. Measuring geographical regularities of crowd behaviors for Twitter-based geo-social event detection. In Proc. 2nd ACM SIGSPATIAL International Workshop on Location Based Social Networks (LBSN) (2010), X. Zhou andW.-C. Lee, Eds., ACM, pp. 1-10. doi:10.1145/1867699.1867701.
41. LEETARU, K. H.,WANG, S., CAO, G., PADMANABHAN, A., AND SHOOK, E. Mapping the global Twitter heartbeat: The geography of Twitter. First Monday 18, 5 (2013). doi:10.5210/fm.v18i5.4366.
42. LEWIS, D. D. Naive (Bayes) at forty: The independence assumption in information retrieval. In Proc. Machine Learning (ECML), C. Nédellec and C. Rouveirol, Eds., vol. 1398 of Lecture Notes in Computer Science. Springer, Berlin, 1998, pp. 4-15. doi:10.1007/BFb0026666.
43. LI, L., GOODCHILD, M. F., AND XU, B. Spatial, temporal, and socioeconomic patterns in the use of Twitter and Flickr. Cartography and Geographic Information Science 40, 2 (2013), 61-77. doi:10.1080/15230406.2013.777139.
44. MATTMANN, C. A., AND ZITTING, J. L. Tika in action. Manning, Shelter Island, NY, 2012.
45. MCCALLUM, A. K. MALLET: A machine learning for language toolkit. http:smallet. cs.umass.edu, 2002.
46. METAXAS, P. T., AND MUSTAFARAJ, E. Social media and the elections. Science 338, 6106 (2012), 472-473. doi:10.1126/science.1230456.
47. NEIS, P., ZIELSTRA, D., AND ZIPF, A. The street network evolution of crowdsourced maps: OpenStreetMap in Germany 2007-2011. Future Internet 4, 1 (2011), 1-21.
48. NEIS, P., ZIELSTRA, D., ZIPF, A., AND STRUCK, A. Empirische Untersuchungen zur Datenqualität von OpenStreetMap-Erfahrungen aus zwei Jahren Betrieb mehrerer OSM-Online-Dienste. In Symposium für Angewandte Geoinformatik (2010).
49. NIGAM, K., LAFFERTY, J., AND MCCALLUM, A. Using maximum entropy for text classification. In Proc. Workshop on Machine Learning for Information Filtering (1999), pp. 61-67.
50. OPENSTREETMAP WIKI. Map features. http:swiki.openstreetmap.org/wiki/Map Features, 2014. Accessed 2.10.2014.
51. PANG, B., AND LEE, L. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2, 1-2 (2008), 1-135. doi:10.1561/1500000011.
52. PANG, B., LEE, L., AND VAITHYANATHAN, S. Thumbs up? sentiment classification using machine learning techniques. In Proc. ACL Conference on Empirical Methods in Natural Language Processing (EMNLP) (2002), vol. 10, ACL, pp. 79-86. doi:10.3115/1118693.1118704.
53. QUASTHOFF, U., RICHTER, M., AND BIEMANN, C. Corpus portal for search in monolingual corpora. In Proc. 5th International Conference on Language Resources and Evaluation (2006), N. Calzolari, Ed., pp. 1799-1802.
54. SAKAKI, T., OKAZAKI, M., AND MATSUO, Y. Earthquake shakes Twitter users: Real-time event detection by social sensors. In Proc. 19th International Conference on World Wide Web (WWW) (2010), M. Rappa and P. Jones, Eds., ACM, pp. 851-860. doi:10.1145/1772690.1772777.
55. SCHARKOW, M. Automatische Inhaltsanalyse und maschinelles Lernen. epubli, Berlin, 2012.
56. SCHULZ, A., HADJAKOS, A., PAULHEIM, H., NACHTWEY, J., AND MÜHLHÄUSER, M. A multi-indicator approach for geolocalization of Tweets. In Proc. 7th International AAAI Conference on Weblogs and Social Media (2013).
57. SHANNON, C. E. A mathematical theory of communication. The Bell System Technical Journal 27 (1948), 379-423.
58. SHANNON, C. E., AND WEAVER, W. The mathematical theory of communication. University of Illinois Press, Urbana, 1949.
59. SIGNORINI, A., SEGRE, A. M., AND POLGREEN, P. M. The use of Twitter to track levels of disease activity and public concern in the US during the influenza A H1N1 pandemic. PLoS ONE 6, 5 (2011), e19467. doi:10.1371/journal.pone.0019467.
60. STAMS, W., AND KLIPPEL, A. Landmarke. In Lexikon der Kartographie und Geomatik, J. Bollmann andW. G. Koch, Eds., vol. 2. Spektrum, Heidelberg, 2002, p. 95.
61. THELWALL, M., BUCKLEY, K., AND PALTOGLOU, G. Sentiment in Twitter events. Journal of the American Society for Information Science and Technology 62, 2 (2011), 406-418. doi:10.1002/asi.21462.
62. TUMASJAN, A., SPRENGER, T. O., SANDNER, P. G., AND WELPE, I. M. Predicting elections with Twitter: What 140 characters reveal about political sentiment. In Proc. Fourth International AAAI Conference onWeblogs and SocialMedia (2010),M.Hearst, Ed., AAAI Press, pp. 178-185.
63. TURNEY, P. D. Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews. In Proc. 40th Annual Meeting on Association for Computational Linguistics (ACL) (2002), ACL, pp. 417-424. doi:10.3115/1073083.1073153.
64. VERMA, S., VIEWEG, S. E., CORVEY, W. J., LEYSIA, P., MARTIN, J. H., PALMER, M., SCHRAM, A., AND ANDERSON, K. M. Natural language processing to the rescue? Extracting "situational awareness" Tweets during mass emergency. In Proc. Fifth International AAAI Conference on Weblogs and Social Media (2011), N. Nicolov and J. G. Shanahan, Eds., AAAI Press, pp. 385-392.
65. VICKERY, G., AND WUNSCH-VINCENT, S. Participative Web and user-created content: Web 2.0, wikis, and social networking. Organisation for Economic Co-operation and Development, Paris, 2007.
66. VICKUS, G. Point of interest. In Lexikon der Kartographie und Geomatik, J. Bollmann and W. G. Koch, Eds., vol. 2. Spektrum, Heidelberg, 2002, p. 228.
67. WING, B. P., AND BALDRIDGE, J. Simple supervised document geolocation with geodesic grids. In Proc. 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (HLT) (New York, NY and USA, 2011), D. Lin, Ed., vol. 1, ACL, pp. 955-964.
68. XU, C., WONG, D. W., AND YANG, C. Evaluating the "geographical awareness" of individuals: An exploratory analysis of Twitter data. Cartography and Geographic Information Science 40, 2 (2013), 103-115. doi:10.1080/15230406.2013.776212.
69. YE, M., JANOWICZ, K., MÜLLIGANN, C., AND LEE, W.-C. What you are is when you are. In Proc. 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (2011), I. Cruz and D. Agrawal, Eds., ACM, pp. 102-111. doi:10.1145/2093973.2093989.
70. YU, H., AND HATZIVASSILOGLOU, V. Towards answering opinion questions. In Proc. Conference on Empirical Methods in Natural Language Processing (EMNLP) (2003), M. Collins and M. Steedman, Eds., pp. 129-136. doi:10.3115/1119355.1119372.
71. ZHAO, D., AND ROSSON, M. B. How and why people Twitter. In Proc. ACM International Conference on Supporting Group Work (2009), S. Teasley, E. Havn, W. Prinz, and W. Lutters, Eds., ACM, pp. 243-252. doi:10.1145/1531674.1531710.
72. ZHAO, W. X., JIANG, J.,WENG, J.,HE, J., LIM, E.-P., YAN, H., AND LI, X. Comparing Twitter and traditional media using topic models. In Proc. 33rd European Conference on Advances in Information Retrieval (ECAIR) (2011), P. Clough, C. Foley, G. Cathal, G. J. Jones, W. Kraaij, H. Lee, and V. Murdoch, Eds., Springer, pp. 338-349.
73. ZISGEN, J., AND JUDEX, M. Nutzung von Volunteered Geographic Information (VGI) und moderner Technologien zur Verbesserung des Lagebildes. In Web 2.0 und Social Media in Hochwassermanagement und Katastrophenschutz (2013), A. Zipf and R. Leiner, Eds.