Knowledge-based tweet classification for disease sentiment monitoring

Studies in Computational Intelligence

Volumn 639, Issue , 2016, Pages 425-454

  Ji, Xiang ^a   Chun, Soon Ae ^b   Geller, James ^a  

^a University Heights   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Computational intelligence; Public health concern monitoring; Sentiment analysis; Social data analytics

Indexed keywords

EID: 84961590039     PISSN: 1860949X     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-319-30319-2_17     Document Type: Chapter

References (60)

1. Brownstein, J.S., Freifeld, C.C., Reis, B.Y., Mandl, K.D.: Surveillance sans frontieres: internetbased emerging infectious disease intelligence and the HealthMap project. PLoSMed. 5, e151 (2008)
2. Collier, N., Doan, S.: Syndromic classification of Twitter messages. Electron. Healthc. 91, 186–195 (2012)
3. Signorini, A., Segre, A.M., Polgreen, P.M.: The use of Twitter to track levels of disease activity and public concern in the U.S. during the influenza A H1N1 pandemic. PloS One 6, e19467 (2011)
4. Aramaki, E., Maskawa, S., Morita, M.: Twitter catches the flu: detecting influenza epidemics using Twitter. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 1568–1576 (2011)
5. Lampos, V., Cristianini, N.: Tracking the flu pandemic by monitoring the Social Web. In: Proceedings of 2nd International Workshop on Cognitive Information Processing, pp. 411–416 (2010)
6. ReutersNews. http://www.reuters.com/article/2014/10/18/us-health-ebola-usa-idUSKCN0I61BO20141018
7. Zhu, X., Wu, S., Miao, D., Li, Y.: Changes in emotion of the Chinese public in regard to the SARS period. Soc. Behav. Personal. 36, 447–454 (2008)
8. Guardian News. http://www.guardian.co.uk/world/2011/mar/17/chinese-panic-buy-saltjapan
9. Ginsberg, J., Mohebbi, M.H., Patel, R.S., Brammer, L., Smolinski, M.S., Brilliant, L.:Detecting influenza epidemics using search engine query data. Nature 457, 1012–1014 (2009)
10. Twitter. http://www.twitter.com
11. Twitter Documentation. https://dev.twitter.com/docs
12. Ji, X., Chun, S.A., Wei, Z., Geller, J.: Twitter sentiment classification for measuring public health concerns. Soc. Netw. Anal. Min. 5, 1–25 (2015)
13. Zhang, L., Ghosh, R., Dekhil, M., Hsu, M., Liu, B.: Combining lexicon-based and learningbased methods for Twitter sentiment analysis (2011)
14. Liu, B., Zhang, L.: A survey of opinion mining and sentiment analysis. Mining Text Data, pp. 415–463 (2012)
15. Mohammad, S.M., Kiritchenko, S., Zhu, X.: NRC-Canada: Building the state-of-the-art in sentiment analysis of tweets (2013). arXiv preprint arXiv:1308.6242
16. Saif, H., Fernandez, M., He, Y., Alani, H.: Evaluation datasets for twitter sentiment analysis. In: Proceedings of 1st Workshop on Emotion and Sentiment in Social and Expressive Media (2013)
17. Sha, Y., Yan, J., Cai, G.: Detecting public sentiment over PM2.5 pollution hazards through analysis of Chinese microblog. In: The 11th International Conference on Information Systems for Crisis Response and Management, pp. 722–726 (2014)
18. Ji, X., Chun, S.A., Geller, J.: Monitoring public health concerns using Twitter sentiment classifications. In: Proceedings of IEEE International Conference on Healthcare Informatics, pp. 335–344 (2013)
19. Liben Nowell, D., Kleinberg, J.: The link prediction problem for social networks. J. Am. Soc. Inf. Sci. Technol. 58, 1019–1031 (2007)
20. Hollnagel, E., Woods, D.D.: Cognitive systems engineering: new wine in new bottles. Int. J. Man Mach. Stud. 18, 583–600 (1983)
21. Schriml, L.M., Arze, C., Nadendla, S., Chang, Y.W.W., Mazaitis, M., Felix, V., Feng, G., Kibbe, W.A.: Disease Ontology: a backbone for disease semantic integration. Nucleic Acids Res. 40(D1), D940–D946 (2012)
22. List of ICD-9 Codes. https://en.wikipedia.org/wiki/List_of_ICD-9_codes_001%E2%80%93139:_infectious_and_parasitic_diseases
23. Chun, S., Geller, J.: Evaluating ontologies based on the naturalness of their preferred terms. In: Proceedings of the 41st Annual International Conference on System Sciences, pp. 238–238 (2008)
24. Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5, 1–167 (2012)
25. Riloff, E., Wiebe, J.: Learning extraction patterns for subjective expressions. In: Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, pp. 105–112 (2003)
26. Hansen, L.K., Arvidsson, A., Nielsen, F.Å., Colleoni, E., Etter, M.: Good friends, bad newsaffect and virality in twitter. Future information technology, pp. 34–43. Springer, Berlin (2011)
27. Esuli, A., Sebastiani, F.: Sentiwordnet: a publicly available lexical resource for opinion mining. In: Proceedings of LREC, pp. 417–422 (2006)
28. Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2, 1–135 (2008)
29. Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, vol. 10, pp. 79–86 (2003)
30. Mishne, G.: Experiments with mood classification in blog posts. In: Proceedings of ACM SIGIR 2005 Workshop on Stylistic Analysis of Text for Information Access (2005)
31. Wilson, T., Wiebe, J., Hoffmann, P.: Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of Human Language Technologies Conference on Empirical Methods in Natural Language Processing, pp. 347–354 (2005)
32. Johansson, F., Brynielsson, J., Quijano, M.N.: Estimating citizen alertness in crises using social media monitoring and analysis. In: Proceedings of European Intelligence and Security Informatics Conference, pp. 189–196 (2012)
33. Brynielsson, J., Johansson, F., Jonsson, C., Westling, A.: Emotion classification of socialmedia posts for estimating people’s reactions to communicated alert messages during crises. Secur. Inf. 3, 1–11 (2014)
34. Saif, H., Fernández, M., Alani, H.: Automatic stopword generation using contextual semantics for sentiment analysis of Twitter. In: Proceedings of 13th International Semantic Web Conference (2014)
35. Refaee, E., Rieser, V.: An Arabic twitter corpus for subjectivity and sentiment analysis. In: Proceedings of the Ninth International Conference on Language Resources and Evaluation, pp. 2268–2273 (2014)
36. Saif, H., He, Y., Alani, H.: Semantic sentiment analysis of Twitter. The Semantic Web-ISWC, pp. 508–524 (2012)
37. Barbosa, L., Feng, J.: Robust sentiment detection on Twitter from biased and noisy data. In: Proceedings of the 23rd International Conference on Computational Linguistics, pp. 36–44 (2010)
38. Bifet, A., Frank, E.: Sentiment knowledge discovery in twitter streaming data. In: Proceedings of the 13th International Conference on Discovery Science, pp. 1–15. Springer (2010)
39. Pak, A., Paroubek, P.: Twitter as a corpus for sentiment analysis and opinion mining. In: Proceedings of the Seventh Conference on International Language Resources and Evaluation, pp. 1320–1326 (2010)
40. Jiang, L., Yu, M., Zhou, M., Liu, X., Zhao, T.: Target-dependent twitter sentiment classification. In: Proceedings of the 49th AnnualMeeting of the Association for Computational Linguistics: Human Language Technologies, vol. 1, pp. 151–160 (2011)
41. Zhou, Z., Zhang, X., Sanderson, M.: Sentiment analysis on twitter through topic-based lexicon expansion. Databases Theory and Applications, pp. 98–109. Springer International Publishing, Switzerland (2014)
42. Fukunaga, K.: Introduction to Statistical Pattern Recognition, 2nd edn. Academic Press, New York (1990)
43. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20, 273–297 (1995)
44. Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines. ACMTrans. Interact. Intell. Syst. 2, 1–27 (2011)
45. Salathe, M., Khandelwal, S.: Assessing vaccination sentiments with online socialmedia: implications for infectious disease dynamics and control. PLoS Comput. Biol. 7, e1002199 (2011)
46. Zhuang, L., Jing, F., Zhu, X.-Y.: Movie review mining and summarization. In: Proceedings of the 15th ACM International Conference on Information and Knowledge Management, pp. 43–50 (2006)
47. Chew, C., Eysenbach, G.: Pandemics in the age of Twitter: content analysis of Tweets during the 2009 H1N1 outbreak. PloS One 5, e14118 (2010)
48. O’Connor, B., Balasubramanyan, R., Routledge, B.R., Smith, N.A.: From tweets to polls: Linking text sentiment to public opinion time series. In: Proceedings of International Conference on Weblogs and Social Media, pp. 122–129 (2010)
49. Wiebe, J., Riloff, E.: Creating subjective and objective sentence classifiers from unannotated texts. In: Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing, pp. 486–497 (2005)
50. Wilson, T., Wiebe, J.: Annotating opinions in the world press. In: Proceedings of 4th SIGdial Meeting on Discourse and Dialogue, pp. 13–22 (2003)
51. Twitter 4J. http://twitter4j.org/en/
52. Profanity List. http://web.njit.edu/xj25/eosds_beta/files/profanity_list.txt
53. FCC Guide. http://www.fcc.gov/guides/obscenity-indecency-and-profanity
54. News Stopwords. http://web.njit.edu/xj25/eosds_beta/files/news_stopwords.txt
55. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. SIGKDD Explor. Newsl. 11, 10–18 (2009)
56. Fleiss, J.L.: Measuring nominal scale agreement among many raters. Psychol. Bull. 76, 378–382 (1971)
57. Bruns, A., Stieglitz, S.: Twitter data: what do they represent? Inf. Technol. 56, 240–245 (2014)
58. Morstatter, F., Pfeffer, J., Liu, H., Carley, K.M.: Is the sample good enough? comparing data from twitter’s streaming api with twitter’s firehose (2013). arXiv preprint arXiv:1306.5204
59. Mislove, A., Lehmann, S., Ahn, Y.-Y., Onnela, J.-P., Rosenquist, J.N.: Understanding the demographics of Twitter users. In: Proceedings of the 5th InternationalAAAIConference onWeblogs and Social Media, pp. 554–557 (2011)
60. Broersma, M., Graham, T.: Twitter as a news source: how Dutch and British newspapers used tweets in their news coverage, 2007–2011. Journal. Pract. 7, 446–464 (2013)