Event prediction with learning algorithms - A study of events surrounding the Egyptian revolution of 2011 on the basis of micro blog data

Policy and Internet

Volumn 7, Issue 2, 2015, Pages 159-184

  Boecking, Benedikt ^a   Hall, Margeret ^b   Schneider, Jeff ^a  

^a Carnegie Mellon University   (United States)

^b KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

Arab Spring; classification; event prediction; machine learning; modeling; politics; Twitter data

Indexed keywords

EID: 84930476731     PISSN: None     EISSN: 19442866     Source Type: Journal    
DOI: 10.1002/poi3.89     Document Type: Review

References (56)

1. Anderson, L., 2011. " Demystifying the Arab Spring: Parsing the Differences Between Tunisia, Egypt, and Libya." Foreign Affairs 90 (3): 2-7.
2. Asur, S., and B.A. Huberman, 2010. "Predicting the Future With Social Media." In Proceedings of the 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology Vol. 1 of WI-IAT '10. Washington, DC: IEEE Computer Society, 492-99.
3. Atefeh, F., and, W. Khreich,. 2013. " A Survey of Techniques for Event Detection in Twitter." Computational Intelligence 31 (1): 132-64.
4. Becker, H., M. Naaman, and L. Gravano. 2011. "Beyond Trending Topics: Real-World Event Identification on Twitter." In Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media. http://www.aaai.org/ocs/index.php/ICWSM/ICWSM11/paper/viewFile/2745Hila/3207.
5. Bird, S., E. Klein, and, E. Loper, 2009. Natural Language Processing With Python, 1st ed. Sebastopol, CA: O'Reilly Media, Inc.
6. Blei, D.M., and J. Lafferty, 2009. "Topic Models." In Text Mining: Classification, Clustering, and Applications, eds. A. Srivastava and M. Sahami. London: Taylor & Francis.
7. Blei, D.M., A.Y. Ng, and M.I. Jordan. 2003. "Latent Dirichlet Allocation." The Journal of Machine Learning Research 3: 993-1022.
8. boyd, d., and K. Crawford, 2011. "Six Provocations for Big Data." In A Decade in Internet Time: Symposium on the Dynamics of the Internet and Society. http://ssrn.com/abstract=1926431
9. Choudhary, A., W. Hendrix, K. Lee, D. Palsetia, and, W.-K. Liao,. 2012. " Social Media Evolution of the Egyptian Revolution." Communications of the ACM 55 (5): 74-80.
10. Chung, J., and E. Mustafaraj. 2011. "Can Collective Sentiment Expressed on Twitter Predict Political Elections?" In Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence. http://www.aaai.org/ocs/index.php/AAAI/AAAI11/paper/viewFile/3549%26lt%3B/4126.
11. Compton, R., C. Lee, J. Xu, L. Artieda-Moncada, T.-C. Lu, L. Silva, and, M. Macy,. 2014. " Using Publicly Visible Social Media to Build Detailed Forecasts of Civil Unrest." Security Informatics 3 (4). http://link.springer.com/article/10.1186/s13388-014-0004-6.
12. Compton, R., T.-C. Lu, L. De Silva, and, M. Macy,. 2013." Detecting Future Social Unrest in Unprocessed Twitter Data: Emerging Phenomena and Big Data." In Proceedings of the 2013 IEEE International Conference on Intelligence and Security Informatics (ISI). IEEE, 56-60.
13. Conover, M.D., G. Goncalves, J. Ratkiewicz, A. Flammini, and F. Menczer. 2011. "Predicting the Political Alignment of Twitter Users." In Proceedings of the 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust (PASSAT) and 2011 IEEE Third International Conference on Social Computing (SocialCom). IEEE, 192-99.
14. Cortes, C., and, V. Vapnik,. 1995. "Support-Vector Networks." Machine Learning 20 (3): 273-97.
15. Garcia-Herranz, M., E. Moro, M. Cebrian, N.A. Christakis, and, J.H. Fowler,. 2014. " Using Friends as Sensors to Detect Global-Scale Contagious Outbreaks." PLoS ONE 9 (4): e92413.
16. González-Bailõn, S., N. Wang, A. Rivero, J. Borge-Holthoefer, and, Y. Moreno,. 2014. " Assessing the Bias in Samples of Large Online Networks." Social Networks 38: 16-27.
17. Griffiths, T.L., and M. Steyvers. 2004. "Finding Scientific Topics." Proceedings of the National Academy of Sciences 101 (Suppl 1): 5228-35.
18. Halko, N., P.G. Martinsson, and, J.A. Tropp,. 2011. " Finding Structure With Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions." SIAM Review 53 (2): 217-88.
19. Hammond, J., and, N.B. Weidmann,. 2014. " Using Machine-Coded Event Data for the Micro-Level Study of Political Violence." Research & Politics 1 (2). http://rap.sagepub.com/content/1/2/2053168014539924.
20. Higham, N.J., 2002. " Computing the Nearest Correlation Matrixa Problem From Finance." IMA Journal of Numerical Analysis 22 (3): 329-43.
21. Hua, T., C.T. Lu, N. Ramakrishnan, F. Chen, J. Arredondo, D. Mares, and, K. Summers,. 2013. " Analyzing Civil Unrest Through Social Media." Computer 46 (12): 80-4.
22. Kalampokis, E., E. Tambouris, and, K. Tarabanis,. 2013. " Understanding the Predictive Power of Social Media." Internet Research 23 (5): 544-59.
23. Khondker, H.H., 2011. " Role of the New Media in the Arab Spring." Globalizations 8 (5): 675-79.
24. Kohavi, R., 1995. "A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection." In Proceedings of the 14th International Joint Conference on Artificial Intelligence-Vol. 2, IJCAI'95. San Francisco, CA: Morgan Kaufmann Publishers Inc., 1137-43.
25. Leetaru, K., and P. Schrodt. 2013. "GDELT: Global Data on Events, Language, and Tone, 1979-2012." Paper presented at the International Studies Association Annual Conference, April, San Francisco, CA.
26. Li, R., K.H. Lei, R. Khadiwala, and, K.C.-C. Chang,. 2012. " TEDAS: A Twitter-Based Event Detection and Analysis System." In Proceedings of the 2012 IEEE 28th International Conference on Data Engineering (ICDE), 1273-76. http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6228186.
27. Lotan, G., E. Graeff, M. Ananny, D. Gaffney, I. Pearce, and, d. boyd,. 2011. " The Arab Spring-The Revolutions Were Tweeted: Information Flows During the 2011 Tunisian and Egyptian Revolutions." International Journal of Communication 5 (0). http://ijoc.org/index.php/ijoc/article/view/1246/643.
28. McCallum, A.K., 2002. "MALLET: A Machine Learning for Language Toolkit." http://mallet.cs.umass.edu.
29. Mendoza, M., B. Poblete, and, C. Castillo,. 2010. "Twitter Under Crisis: Can We Trust What We RT?" In Proceedings of the First Workshop on Social Media Analytics, SOMA '10, New York, NY: ACM, 71-9.
30. Mitchell, T.M., 1997. Machine Learning, 1 ed. New York, NY: McGraw-Hill, Inc.
31. Petrovic, S., M. Osborne, and, V. Lavrenko,. 2010. "Streaming First Story Detection With Application to Twitter." In Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, HLT '10. Stroudsburg, PA: Association for Computational Linguistics, 181-89.
32. Poczos, B., L. Xiong, D.J. Sutherland, and J. Schneider. 2012. "Nonparametric Kernel Estimators for Image Classification." In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2989-96. http://dx.doi.org/10.1109/CVPR.2012.6248028.
33. Popescu, A.-M., and, M. Pennacchiotti,. 2010. "Detecting Controversial Events From Twitter." In Proceedings of the 19th ACM International Conference on Information and Knowledge Management', CIKM '10. New York, NY: ACM, 1873-76.
34. Popescu, A.-M., M. Pennacchiotti, and, D. Paranjpe,. 2011. "Extracting Events and Event Descriptions From Twitter." In Proceedings of the 20th International Conference Companion on World Wide Web, WWW '11. New York, NY: ACM, 105-6.
35. Porter, M.F. 2001. "Snowball: A Language for Stemming Algorithms." http://snowball.tartarus.org/texts/introduction.html.
36. Puniyani, K., J. Eisenstein, S. Cohen, and, E.P. Xing,. 2010. "Social Links From Latent Topics in Microblogs." In Proceedings of the NAACL HLT 2010 Workshop on Computational Linguistics in a World of Social Media, WSA '10. Stroudsburg, PA: Association for Computational Linguistics, 19-20.
37. Qu, Y., C. Huang, P. Zhang, and, J. Zhang,. 2011. "Microblogging After a Major Disaster in China: A Case Study of the 2010 Yushu Earthquake." In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, CSCW '11. New York, NY: ACM, 25-34.
38. Racette, M.P., C.T. Smith, M.P. Cunningham, T.A. Heekin, J.P. Lemley, and R.S. Mathieu. 2014. "Improving Situational Awareness for Humanitarian Logistics Through Predictive Modeling." In Proceedings of the Systems and Information Engineering Design Symposium (SIEDS), 2014. IEEE, 334-39.
39. Ramakrishnan, N., P. Butler, S. Muthiah, N. Self, R. Khandpur, P. Saraf, W. Wang, et al., 2014. "'Beating the News' With Embers: Forecasting Civil Unrest Using Open Source Indicators." In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '14. New York, NY: ACM, 1799-808.
40. Russell, M.A., 2011. Mining the Social Web: Analyzing Data From Facebook, Twitter, LinkedIn, and Other Social Media Sites, 1 ed. Sebastopol, CA: O'Reilly Media, Inc.
41. Ruths, D., and, J. Pfeffer,. 2014. "Social Media for Large Studies of Behavior." Science 346 (6213): 1063-64.
42. Sakaki, T., M. Okazaki, and, Y. Matsuo,. 2010. "Earthquake Shakes Twitter Users: Real-Time Event Detection by Social Sensors." In Proceedings of the 19th International Conference on World Wide Web', WWW '10. New York, NY: ACM, 851-60.
43. Sankaranarayanan, J., H. Samet, B.E. Teitler, M.D. Lieberman, and, J. Sperling,. 2009. "Twitterstand: News in Tweets." In Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS '09. New York, NY: ACM, 42-51.
44. Schölkopf, B., and A.J. Smola. 2001. Learning With Kernels: Support Vector Machines, Regularization, Optimization and Beyond. Cambridge, MA: MIT Press.
45. Sriram, B., D. Fuhry, E. Demir, H. Ferhatosmanoglu, and, M. Demirbas,. 2010. "Short Text Classification in Twitter to Improve Information Filtering." In Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '10. New York, NY: ACM, 841-42.
46. Starbird, K., J. Maddock, M. Orand, P. Achterman, and R.M. Mason, 2014. "Rumors, False Flags, and Digital Vigilantes: Misinformation on Twitter After the 2013 Boston Marathon Bombing." In Proceedings of the iConference 2014, 654-62. https://www.ideals.illinois.edu/handle/2142/47257.
47. Starbird, K., and L. Palen, 2010. "Pass It On?: Retweeting in Mass Emergency." In Proceedings of the 7th International ISCRAM Conference. Seattle: International Community on Information Systems for Crisis Response and Management. http://www.researchgate.net/publication/228512367-Pass-It-On-Retweeting-in-Mass-Emergency.
48. Starbird, K., and, L. Palen, 2011. "Voluntweeters: Self-Organizing by Digital Volunteers in Times of Crisis." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '11. New York, NY: ACM, 1071-80.
49. Starbird, K., and, L. Palen,. 2012. "(How) Will the Revolution be Retweeted?: Information Diffusion and the 2011 Egyptian Uprising." In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, CSCW '12. New York, NY: ACM, 7-16.
50. Steyvers, M., and T. Griffiths. 2007. "Probabilistic Topic Models." Handbook of latent semantic analysis. Psychology Press 427 (7): 424-40.
51. Taghva, K., R. Elkhoury, and, J. Coombs,. 2005. " Arabic Stemming Without a Root Dictionary." In Proceedings of the International Conference on Information Technology: Coding and Computing, 2005, ITCC 2005. IIEEE: 152-57, Vol. 1.
52. Tang, J., Z. Meng, X. Nguyen, Q. Mei, and M. Zhang. 2014. "Understanding the Limiting Factors of Topic Modeling via Posterior Contraction Analysis." In Proceedings of the 31st International Conference on Machine Learning. JMLR, 190-98. http://jmlr.org/proceedings/papers/v32/tang14.pdf.
53. Vieweg, S., A.L. Hughes, K. Starbird, and L. Palen. 2010. "Microblogging During Two Natural Hazards Events: What Twitter May Contribute to Situational Awareness." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '10. New York, NY: ACM, 1079-88.
54. Wolfsfeld, G., E. Segev, and, T. Sheafer,. 2013. "Social Media and the Arab Spring: Politics Comes First." The International Journal of Press/Politics 18 (2): 115-37.
55. Xu, J., T.C. Lu, R. Compton, and D. Allen. 2014. "Civil Unrest Prediction: A Tumblr-Based Exploration." In Social Computing, Behavioral-Cultural Modeling and Prediction, eds. W. Kennedy, N. Agarwal, and S. Yang, Vol. 8393 of Lecture Notes in Computer Science. Switzerland: Springer International Publishing, 403-11.
56. Yao, L., D. Mimno, and, A. McCallum,. 2009. Efficient Methods for Topic Model Inference on Streaming Document Collections." In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '09. New York, NY: ACM, 937-46.