Twitter sentiment classification for measuring public health concerns

Social Network Analysis and Mining

Volumn 5, Issue 1, 2015, Pages 1-25

  Ji, Xiang ^a   Chun, Soon Ae ^b   Wei, Zhi ^a   Geller, James ^a  

^a University Heights   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Automatic sentiment labeling; Measure of concern; Public health; Sentiment analysis; Sentiment classification; Social analytics; Twitter mining

Indexed keywords

EPIDEMIOLOGY; HEALTH; LEARNING SYSTEMS; PUBLIC HEALTH; SOCIAL NETWORKING (ONLINE); STATISTICAL TESTS;

BAYES CLASSIFIER; COMMUNICABLE DISEASE; MEASURE OF CONCERN; SENTIMENT ANALYSIS; SENTIMENT CLASSIFICATION; SOCIAL ANALYTICS; SURVEILLANCE SYSTEMS; TRAINING AND TESTING;

CLASSIFICATION (OF INFORMATION);

EID: 84947296805     PISSN: 18695450     EISSN: 18695469     Source Type: Journal    
DOI: 10.1007/s13278-015-0253-5     Document Type: Article

References (75)

1. Agarwal A, Xie B, Vovsha I, Rambow O, Passonneau R (2011) Sentiment analysis of Twitter data. In: Proceedings of the Workshop on Languages in Social Media. Portland, Oregon, pp 30–38
2. Aramaki E, Maskawa S, Morita M (2011) Twitter catches the flu: detecting influenza epidemics using Twitter. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing. Edinburgh, United Kingdom, pp 1568–1576
3. Artman H, Brynielsson J, Johansson BJE, Trnka J (2011) Dialogical Emergency Management and Strategic Awareness in Emergency Communication. In: Proceedings of the 8th International ISCRAM Conference
4. Barbieri F, Saggion H (2014) Modelling Irony in Twitter. In: Proceedings of the Student Research Workshop at the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp 56–64
5. Barbosa L, Feng J (2010) Robust sentiment detection on Twitter from biased and noisy data. In: Proceedings of the 23rd International Conference on Computational Linguistics, Beijing, China, pp 36–44
6. Berger J (2011) Arousal increases social transmission of information. Psychol Sci 22(7):891–893
7. Bifet A, Frank E (2010) Sentiment knowledge discovery in twitter streaming data. In: Discovery Science, 2010. Springer, pp 1–15
8. Brownstein JS, Freifeld CC, Reis BY, Mandl KD (2008) Surveillance Sans Frontieres: internet-based emerging infectious disease intelligence and the HealthMap project. PLoS Med 5(7):e151
9. Bruns A, Stieglitz S (2014) Twitter data: What do they represent? It Inf Technol 56(5):240–245
10. Brynielsson J, Johansson F, Jonsson C, Westling A (2014) Emotion classification of social media posts for estimating people’s reactions to communicated alert messages during crises. Security Inf 3(1):1–11
11. Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):1–27
12. Chew C, Eysenbach G (2010) Pandemics in the age of Twitter: content analysis of Tweets during the 2009 H1N1 outbreak. PLoS One 5(11):e14118
13. Collier N, Doan S (2012) Syndromic Classification of Twitter Messages. In: Kostkova P, Szomszor M, Fowler D (eds) Electronic Healthcare. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 91. pp 186–195
14. Cortes C, Vapnik V (1995) Support-Vector Networks. Mach Learn 20(3):273–297
15. Culotta A (2010a) Detecting influenza outbreaks by analyzing Twitter messages. arXiv:10074748
16. Culotta A (2010) Towards detecting influenza epidemics by analyzing Twitter messages. In: Proceedings of the First Workshop on Social Media Analytics. Washington D.C., District of Columbia, pp 115–122
17. DCP (2014) Disease Control Priorities Project. http://www.dcp-3.org/dcp2
18. Discover (2014) Stem Cells Shed Light on Treatments for Bipolar Disorder. http://blogs.discovermagazine.com/d-brief/2014/03/26/stem-cells-shed-light-on-treatments-for-bipolar-disorder/-U-wKD4BdXN8
19. FederalCommunicationsCommittee (2014) Obscenity, Indecency and Profanity Guide. http://www.fcc.gov/guides/obscenity-indecency-and-profanity
20. Fleiss JL (1971) Measuring nominal scale agreement among many raters. Psychol Bull 76(5):378
21. FoxNews (2014a) Company Recalls Several Food Products Due to Listeria. http://fox8.com/2014/03/23/several-nationally-distributed-food-products-recalled-due-to-listeria/
22. FoxNews (2014b) Food Fear: Hummus, Dips from Target, Giant Eagle, Trader Joe’s Recalled. http://fox8.com/2014/05/20/food-fear-hummus-dips-from-target-giant-eagle-trader-joes-recalled/
23. Fukunaga K (1990) Introduction to statistical pattern recognition, 2nd edn
24. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L (2009) Detecting influenza epidemics using search engine query data. Nature 457(7232):1012–1014
25. Go A, Bhayani R, Huang L (2009) Twitter Sentiment Classification using Distant Supervision. Technical Report
26. Guardian (2011) Chinese panic-buy salt over Japan nuclear threat. http://www.guardian.co.uk/world/2011/mar/17/chinese-panic-buy-salt-japan
27. Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. SIGKDD Explor Newsl 11(1):10–18
28. Heath C (1996) Do people prefer to pass along good or bad news? Valence and relevance of news as predictors of transmission propensity. Organ Behav Hum Decis Process 68(2):79–94
29. Independent (2014) Malaysia Airlines flight MH17 crash. http://www.independent.co.uk/news/world/europe/malaysia-airlines-plane-crash-boeing-jet-carrying-295-people-crashes-in-ukraine-9612882.html
30. Ji X (2014a) Profanity Filter Word List. http://web.njit.edu/~xj25/eosds_beta/files/profanity_list.txt
31. Ji X (2014b) Stopwords. http://web.njit.edu/~xj25/eosds_beta/files/news_stopwords.txt
32. Ji X, Chun SA, Geller J (2012) Epidemic outbreak and spread detection system based on twitter data. In: Proceedings of the First international conference on Health Information Science, Beijing, China. pp 152–163
33. Ji X, Chun SA, Geller J (2013) Monitoring Public Health Concerns Using Twitter Sentiment Classifications. In: Proceedings of IEEE International Conference on Healthcare Informatics. Philadelphia
34. Jiang L, Yu M, Zhou M, Liu X, Zhao T (2011) Target-dependent twitter sentiment classification. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, vol. 1. pp 151–160
35. Johansson F, Brynielsson J, Quijano MN (2012)Estimating citizen alertness in crises using social media monitoring and analysis. In: Intelligence and Security Informatics Conference (EISIC). pp 189–196
36. Kiritchenko S, Zhu X, Mohammad SM (2014) Sentiment analysis of short informal texts. J Artif Intell Res:723–762
37. Kouloumpis E, Wilson T, Moore J (2011) Twitter sentiment analysis: the good the bad and the omg! Icwsm 11:538–541
38. Lampos V, Cristianini N (2010) Tracking the flu pandemic by monitoring the Social Web. In: Proceedings of IEEE International Conference on Digital Ecosystems and Technologies. pp 411–416
39. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics:159–174
40. Liben Nowell D, Kleinberg J (2007) The link prediction problem for social networks. J Am Soc Inform Sci Technol 58(7):1019–1031
41. Liu B, Zhang L (2012) A survey of opinion mining and sentiment analysis. In: Mining Text Data. pp 415–463
42. Mishne G (2005) Experiments with mood classification in blog posts. In: Proceedings of ACM SIGIR 2005 workshop on stylistic analysis of text for information access
43. Mislove A, Lehmann S, Ahn Y-Y, Onnela J-P, Rosenquist JN (2011) Understanding the Demographics of Twitter Users. In: Proceedings of the 5th International AAAI Conference on Weblogs and Social Media (ICWSM’11). pp 554–557
44. Mohammad SM, Kiritchenko S, Zhu X (2013) NRC-Canada: building the state-of-the-art in sentiment analysis of tweets. arXiv:13086242
45. Morstatter F, Pfeffer J, Liu H, Carley KM (2013) Is the sample good enough? Comparing data from twitter’s streaming api with twitter’s firehose. arXiv:13065204
46. O’Connor B, Balasubramanyan R, Routledge BR, Smith NA (2010) From tweets to polls: Linking text sentiment to public opinion time series. In: Proceedings of International Conference on Weblogs and Social Media. pp 122–129
47. Pak A, Paroubek P (2010) Twitter as a Corpus for Sentiment Analysis and Opinion Mining. In: Proceedings of the Seventh conference on International Language Resources and Evaluation LREC’10, Valletta, Malta
48. Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends Inf Retr 2(1–2):1–135
49. Pang B, Lee L, Vaithyanathan S (2002) Thumbs up?: sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 conference on Empirical methods in natural language processing-vol. 10. pp 79–86
50. Pennebaker J, Francis M (1999) Linguistic Inquiry and Word Count. Lawrence Erlbaum (citeulike-article-id:2863249)
51. Piskorski J, Tanev H, Balahur A (2013) Exploiting Twitter for Border Security-Related Intelligence Gathering. In: European Intelligence and Security Informatics Conference (EISIC). pp 239–246
52. Quintilien, Butler HE (1953) The Institutio Oratoria of Quintilian. With an English Translation by HE Butler
53. Refaee E, Rieser V (2014) An Arabic twitter corpus for subjectivity and sentiment analysis. In: Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14), Reykjavik, Iceland
54. Reuters (2014) Americans ‘can’t give into hysteria or fear’ over Ebola: Obama. http://www.reuters.com/article/2014/10/18/us-health-ebola-usa-idUSKCN0I61BO20141018
55. Reyes A, Rosso P, Veale T (2013) A multidimensional approach for detecting irony in twitter. Lang Resour Eval 47(1):239–268
56. Riloff E, Wiebe J (2003) Learning extraction patterns for subjective expressions. In: Proceedings of the 2003 conference on Empirical methods in natural language processing. pp 105–112
57. Saif H, He Y, Alani H (2012) Semantic sentiment analysis of twitter. In: The Semantic Web–ISWC 2012. pp 508–524
58. Saif H, Fernandez M, He Y, Alani H (2013) Evaluation datasets for twitter sentiment analysis. In: Proceedings of 1st Workshop on Emotion and Sentiment in Social and Expressive Media (ESSEM) in Conjunction with AI* IA Conference, Turin, Italy
59. Saif H, Fernández M, Alani H (2014) Automatic stopword generation using contextual semantics for sentiment analysis of Twitter. In: Proceedings of CEUR Workshop
60. Salathe M, Khandelwal S (2011) Assessing vaccination sentiments with online social media: implications for infectious disease dynamics and control. PLoS Comput Biol 7(10)
61. Sha Y, Yan J, Cai G (2014) Detecting Public Sentiment Over PM2.5 Pollution Hazards through analysis of Chinese Microblog. In: ISCRAM: The 11th International Conference on Information Systems for Crisis Response and Management
62. Signorini A, Segre AM, Polgreen PM (2011) The use of Twitter to track levels of disease activity and public concern in the U.S. during the influenza A H1N1 pandemic. PLoS One 6(5):e19467
63. Stieglitz S, Dang-Xuan L (2013) Emotions and information diffusion in social media—sentiment of microblogs and sharing behavior. J Manag Inf Syst 29(4):217–248
64. Twitter (2014a) Twitter. http://en.wikipedia.org/wiki/Twitter
65. Twitter (2014b) Twitter Developers Documentation. https://dev.twitter.com/docs
66. Twitter4J (2014) Twitter4J. http://twitter4j.org/en/
67. Utsumi A (1996) A unified theory of irony and its computational formalization. In: Proceedings of the 16th conference on Computational linguistics, vol. 2. Association for Computational Linguistics, pp 962–967
68. Wiebe J, Riloff E (2005) Creating subjective and objective sentence classifiers from unannotated texts. In: Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing. Mexico City, Mexico, pp 486–497
69. Wiegand M, Balahur A, Roth B, Klakow D, Montoyo A (2010) A survey on the role of negation in sentiment analysis. In: Proceedings of the workshop on negation and speculation in natural language processing. pp 60–68
70. Wilson T, Wiebe J (2003) Annotating opinions in the World Press. In: Proceedings of SIGdial-03. pp 13–22
71. Wilson T, Wiebe J, Hoffmann P (2005) Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis. In: Proceedings of Human Language Technologies Conference/Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP 2005)
72. Zhang L, Ghosh R, Dekhil M, Hsu M, Liu B (2011) Combining lexicon-based and learning-based methods for Twitter sentiment analysis
73. Zhou Z, Zhang X, Sanderson M (2014) Sentiment Analysis on Twitter through Topic-Based Lexicon Expansion. In: Databases Theory and Applications. pp 98–109
74. Zhu X, Wu S, Miao D, Li Y (2008) Changes in emotion of the Chinese public in regard to the SARS period. Social Behav Personal 36(4):447
75. Zhuang L, Jing F, Zhu XY (2006) Movie review mining and summarization. In: Proceedings of the 15th ACM international conference on Information and knowledge management. pp 43–50