From social media to public health surveillance: Word embedding based clustering method for twitter classification

Conference Proceedings - IEEE SOUTHEASTCON

Volumn 0, Issue , 2017, Pages

  Dai, Xiangfeng ^a   Bikdash, Marwan ^a   Meyer, Bradley ^a  

^a NORTH CAROLINA A AND T STATE UNIVERSITY   (United States)

Author keywords

Big data; Clustering Process; Machine learning; Natural Language Processing; Public Health; Similarity Measure; Social Network; Surveillance; Twitter; Unsupervised Classification; Word Embeddings; Word2Vec

Indexed keywords

CLASSIFICATION (OF INFORMATION); CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; EMBEDDINGS; INFORMATION RETRIEVAL; MONITORING; NATURAL LANGUAGE PROCESSING SYSTEMS; PUBLIC HEALTH; SEMANTICS; SOCIAL NETWORKING (ONLINE);

CLUSTERING PROCESS; EMBEDDINGS; LANGUAGE PROCESSING; MACHINE-LEARNING; NATURAL LANGUAGE PROCESSING; NATURAL LANGUAGES; SIMILARITY MEASURE; SOCIAL NETWORK; SURVEILLANCE; TWITTER; UNSUPERVISED CLASSIFICATION; WORD EMBEDDING; WORD2VEC;

BIG DATA;

EID: 85019673559     PISSN: 10910050     EISSN: 1558058X     Source Type: Conference Proceeding    
DOI: 10.1109/SECON.2017.7925400     Document Type: Conference Paper

References (56)

1. H. Achrekar, A. Gandhe, R. Lazarus, S. Yu and B. Liu, "Predicting Flu Trends using Twitter Data, " in Computer Communications Workshops (INFOCOM WKSHPS), 2011 IEEE Conferenceon, pp. 702-707, 2011
2. R. Agrawal, A. Kadadi, X. Dai and F. Andres, "Challenges and opportunities with big data visualization", In Proceedings of the 7th International Conference on Management of computational and collective intElligence in Digital EcoSystems (pp. 169-173). ACM. 2015
3. Aldous, David J. "Exchangeability and related topics. " Ecole dete de Probabilites de Saint-Flour XIII-1983. Springer Berlin Heidelberg, 1985. 1-198.
4. Y. Bengio, H. Schwenk, "Neural probabilistic language models", In Innovations in Machine Learning, 2006
5. CDC, "Overview of Influenza Surveillance in the United States, " [online] Nov 2016, http://www. cdc. gov/flu/weekly/overview. htm (Accessed: 21 Nov 2016)
6. C. Chew and G. Eysenbach, "Pandemics in the age of twitter: Content analysis of tweets during the 2009 h1n1 outbreak, " PLoS ONE, 2013
7. N. Collier, N. Son and N. Nguyen, "OMG U got flu? Analysis of shared health messages for bio-surveillance", Journal of Biomedical Semantics, 2011
8. E. Cambria, B. Schuller, Y. Xia and C. Havasi, "New avenues in opinion mining and sentiment analysis", IEEE Intelligent Systems, 28(2):15-21, 2013
9. ter to Examine Smoking Behavior and Perceptions of Emerging Tobacco Products, " Journal of Medical Internet Research, 2013
10. R. Collobert, J. Weston, L. Bottou, M. Karlen, K, Kavukcuoglu, "Natural language processing (almost) from scratch", Journal of Machine Learning Research, 2011
11. A. Culotta, "Detecting influenza outbreaks by analyzing Twitter messages" in Proc. 2010 Conf. on Knowledge Discovery and Data Mining, 2010
12. X. Dai and M. Bikdash, "Hybrid Classification for Tweets Related to Infection with Influenza, " Proceedings of the IEEE SoutheastCon 2015, April 9-12, 2015, Fort Lauderdale, Florida, 2015
13. X. Dai and M. Bikdash, "Trend Analysis of Fragmented Time Series for mHealth Apps: Hypothesis Testing Based Adaptive Spline Filtering Method with Importance Weighting", IEEE Access, 2017
14. X. Dai and M. Bikdash, "Distance-based Outliers Method for Detecting Disease Outbreaks using Social Media", Proceedings of the IEEE SoutheastCon 2016, Norfolk, VA, 2016
15. S. Doan, B. Vo, and N. Collier, "An analysis of Twitter messages in the 2011 Tohoku Earthquake", eHealth 2011 Conference, Spain, 2011
16. A. Eiji, S. Maskawa, and M. Morita. "Twitter catches the flu: detecting influenza epidemics using Twitter. " In Proceedings of the conference on empirical methods in natural language processing, pp. 1568-1576. Association for Computational Linguistics, 2011
17. M. Faruqui, D. Jesse, K. Sujay, "Retrofitting word vectors to semantic lexicons. " arXiv preprint arXiv:1411. 4166 2014.
18. E. Gabrilovich and S. Markovitch, "Overcoming the Brittleness Bottleneck using Wikipedia: Enhancing Text
19. E. Gabrilovich and S. Markovitch, "Wikipedia-based Semantic Interpretation for Natural Language Processing, " Journal of Artificial Intelligence Research, 2009
20. S. Gershman and T. Joshua. "Phrase similarity in humans and machines. " In Proceedings of the 37th Annual Conference of the Cognitive Science Society. 2015.
21. J. Ginsberg, M. Mohebbi, R. Patel, L. Brammer, M. Smolinski, and L. Brilliant, "Detecting influenza epidemics using search engine query data", Nature, 457(7232):1012-1014, 2008.
22. Y. Goldberg, O. Levy, "word2vec Explained: deriving Mikolov et al. 's negative-sampling word-embedding method", arXiv preprint arXiv:1402. 3722, 2014
23. Categorization with Encyclopedic Knowledge", Proceedings of the Twenty-First National Conference on Artificial Intelligence, 2006
24. G. Coppersmith, C. Harman and M. Dredze, "Measuring Post Traumatic Stress Disorder in Twitter, " AAAI Publications, Eighth International AAAI Conference on Weblogs and Social Media, 2014
25. Google word2vec. https://code. google. com/archive/p/word2vec/ (Accessed: 25 Oct. 2016)
26. S. Hassan, Y. He and H. Alani. "Semantic sentiment analysis of twitter. " International Semantic Web Conference. Springer Berlin Heidelberg, 2012.
27. N. Heaivilin, Gerbert B, Page JE and Gibbs JL., "Public health surveillance of dental pain via Twitter", J Dent Res. 2011 Sep;90(9):1047-51. doi: 10. 1177/0022034511415273. Epub, 2011
28. J. Huang, R. Kornfield, G. Szczypka and S. Emery, "A cross-sectional examination of marketing of electronic cigarettes on Twitter, " Tobacco Control, 2014
29. H. Kanayama and T. Nasukawa, "Fully automatic lexicon expansion for domain-oriented sentiment analysis, " Proceeding EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, Pages 355-363, 2006.
30. N. Kanhabua and W. Nejd, "Understanding the diversity of tweets in the time of outbreaks, " WWW '13, pp. 1335-1342, 2013
31. M. Krieck, J. Dreesman, L. Otrusina and K. Denecke, "A new age of public health: Identifying disease outbreaks by analyzing tweets", Proceedings of Health WebScience Workshop, ACM Web Science Conference, 2011
32. V. Lampos and N. Cristianini. "Tracking the flu pandemic by monitoring the Social Web, " In 2nd IAPR Workshop on Cognitive Information Processing (CIP 2010), pp. 411-416, 2010
33. L. Maaten and G. Hinton, "Visualizing High-Dimensional Data Using t-SNE", Journal of Machine Learning Research, 9(Nov):2579-2605, 2008
34. T. Mikolov, K. Chen, G. Corrado and J. Dean, "Efficient Estimation of Word Representations in Vector Space", ICLRWorkshop, 2013
35. T. Mikolov, S. Sutskever, C. Kai, S. Greg and D. Dean. "Distributed representations of words and phrases and their compositionality. " In Advances in neural information processing systems, pp. 3111-3119. 2013.
36. C. Manning, P. Raghavan and H. Schütze, An Introduction to Information Retrieval, Online edition, Cambridge University Press, 2009
37. Myslin M, Zhu SH, Chapman W and Conway M., "Using Twit
38. B. Ofoghi, M. Mann, K. Verspoor. Towards early discovery of salient health threats: A social media emotion classification technique. InPacific Symposium on Biocomputing. Pacific Symposium on Biocomputing 2016 (Vol. 21, p. 504).
39. K. Prier, M. Smith, C. Giraud-Carrier and C. Hanson, "Identifying health-related topics on twitter: an exploration of tobacco-related tweets as a test topic, " Proceeding SBP'11 Proceedings of the 4th international conference on Social computing, behavioral-cultural modeling and prediction, Pages 18-25, 2011. x
40. M. Paul and M. Dredze, "You Are What You Tweet: Analyzing Twitter for Public Health", AAAI Publications, Fifth International AAAI Conference on Weblogs and Social Media, 2011
41. A. Passos and J. Wainer, "Wordnet-based metrics do not seem to help document clustering", Proceedings of the of the II Workshop on Web and Text Intelligente, Brazil, 2009
42. J. Pennington, R. Socher and C. Manning, "GloVe: Global Vectors for-Word Representation", Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014
43. A. Vo and C. Ock, "Assessing Vaccination Sentiments with Online Social Media: Implications for Infectious Disease Dynamics and Control, " PLoS Comput Biol. 2011
44. J. West, P. Hall, C. Hanson, K. Prier, C. Giraud-Carrier, E. Neeley and M. Barnes, "Temporal variability of problem drinking on Twitter", Open Journal of Preventive Medicine, 2012.
45. World Health Organization, "Influenza fact sheet, " [online] March 2014, http://www. who. int/mediacentre/factsheets/fs211/en/ (Accessed: 1 Jan 2016)
46. D. Scanfeld, Scanfeld V and Larson EL., "Dissemination of health information through social networks: twitter and antibiotics", Am J Infect Control. 2010
47. Scikit-learn, Machine Learning in Python, http://scikit-learn. org/stable/ (Accessed: 10 Nov. 2016)
48. M. Salathe and S. Khandelwal, "Sentiment classification: A Combination of PMI, sentiWordNet and fuzzy function, " Proceeding ICCCI'12 Proceedings of the 4th international conference on Computational Collective Intelligence: technologies and applications-Volume Part II, Pages 373-382, 2012
49. A. Signorini, A. Segre1 and P. Polgreen, "The Use of Twitter to Track Levels of Disease Activity and Public Concern in the U. S. during the Influenza A H1N1 Pandemic, " PLoS ONE, 2011
50. R. Soebiyanto, F. Adimi and R. Kiang, "Modeling and predicting seasonal influenza transmission in warm regions using climatological parameters", PLoS One, 2010
51. M. Sofean and K. Denecke, "Medical Case-Driven Classification of Microblogs: Characteristics and Annotation, " IHI'12, Miami, Florida, USA, 2012
52. M. Speriosu, S. Nikita, S. Upadhyay and J. Baldridge. "Twitter polarity classification with label propagation over lexical links and the follower graph. " In Proceedings of the First workshop on Unsupervised Learning in NLP, pp. 53-63. Association for Computational Linguistics, 2011.
53. Twitter, Inc., "Twitter usage, " [online] 2015, https://about. twitter. com/company (Accessed: 1 Jan 2016)
54. J, Xiang, S. Chun and J. Geller. "Knowledge-Based Tweet Classification for Disease Sentiment Monitoring. " In Sentiment Analysis and Ontology Engineering, pp. 425-454. Springer International Publishing, 2016.
55. L. Yu, H. Karl, P. Blunsom and S. Pulman. "Deep learning for answer sentence selection. " arXiv preprint arXiv:1412. 1632 2014.
56. Q. Yuan; E. Nsoesie; B. Lv; G. Peng; R. Chunara and J. Brownstein, "Monitoring influenza epidemics in china with search query from baidu, " PLoS ONE, 2013