Enhancing feature selection using word embeddings: The case of flu surveillance

26th International World Wide Web Conference, WWW 2017

Volumn , Issue , 2017, Pages 695-704

  Lampos, Vasileios ^a   Zou, Bin ^a   Cox, Ingemar J ^a,b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Computational health; Feature selection; Gaussian processes; Influenza like illness; Regularised regression; Search query logs; Syndromic surveillance; User generated content; Word embeddings

Indexed keywords

CLASSIFICATION (OF INFORMATION); DISEASES; INFORMATION RETRIEVAL; MONITORING; ONLINE SYSTEMS; SEMANTICS; SOCIAL NETWORKING (ONLINE);

EMBEDDINGS; GAUSSIAN PROCESSES; INFLUENZA-LIKE ILLNESS; REGULARISED REGRESSION; SEARCH QUERIES; SYNDROMIC SURVEILLANCE; USER-GENERATED CONTENT;

FEATURE EXTRACTION;

EID: 85018417855     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3038912.3052622     Document Type: Conference Paper

References (63)

1. S. Amir, R. Astudillo, W. Ling, et al. INESC-ID: A Regression Model for Large Scale Twitter Sentiment Lexicon Induction. In Proc. of SemEval’15, pages 613–618, 2015.
2. E. Aramaki, S. Maskawa, and M. Morita. Twitter Catches The Flu: Detecting Influenza Epidemics using Twitter. In Proc. of EMNLP’11, pages 1568–1576, 2011.
3. P. Barberá. Birds of the Same Feather Tweet Together: Bayesian Ideal Point Estimation Using Twitter Data. Polit. Anal., 23(1):76–91, 2014.
4. D. Beck, T. Cohn, C. Hardmeier, and L. Specia. Learning Structural Kernels for Natural Language Processing. Trans. Assoc. Comput. Linguist., 3:461–473, 2015.
5. Z. Bitvai and T. Cohn. Non-Linear Text Regression with a Deep Convolutional Neural Network. In Proc. of ACL’15, pages 180–185, 2015.
6. Z. Bitvai and T. Cohn. Predicting Peer-to-Peer Loan Rates Using Bayesian Non-Linear Regression. In Proc. of AAAI’15, pages 2203–2209, 2015.
7. J. Bollen, H. Mao, and X. Zeng. Twitter mood predicts the stock market. J. Comput. Sci., 2(1):1–8, 2011.
8. J. S. Brownstein, C. C. Freifeld, and L. C. Madoff. Digital Disease Detection — Harnessing the Web for Public Health Surveillance. N. Engl. J. Med., 360(21):2153–2157, 2009.
9. A. D. Bull. Convergence Rates of Efficient Global Optimization Algorithms. J. Mach. Learn. Res., 12:2879–2904, 2011.
10. H. Choi and H. Varian. Predicting the Present with Google Trends. Economic Record, 88:2–9, 2012.
11. M. D. Choudhury, M. Gamon, S. Counts, and E. Horvitz. Predicting Depression via Social Media. In Proc. of ICWSM’13, pages 128–137, 2013.
12. T. Cohn, D. Preotiuc-Pietro, and N. Lawrence. Gaussian Processes for Natural Language Processing. In Proc. of ACL’14: Tutorials, pages 1–3, 2014.
13. T. Cohn and L. Specia. Modelling Annotator Bias with Multi-task Gaussian Processes: An Application to Machine Translation Quality Estimation. In Proc. of ACL’13, pages 32–42, 2013.
14. N. Collier, N. T. Son, and N. M. Nguyen. OMG U got flu? Analysis of shared health messages for bio-surveillance. J. Biomed. Semant., 2(5):1–10, 2011.
15. A. Culotta. Towards Detecting Influenza Epidemics by Analyzing Twitter Messages. In Proc. of the Workshop on Social Media Analytics, pages 115–122, 2010.
16. A. Culotta. Lightweight methods to estimate influenza rates and alcohol sales volume from Twitter messages. Lang. Resour. Eval., 47(1):217–238, 2013.
17. S. Doan, L. Ohno-Machado, and N. Collier. Enhancing Twitter Data Analysis with Simple Semantic Filtering: Example in Tracking Influenza-Like Illnesses. In Proc. of the 2nd International IEEE Conference on Healthcare Informatics, Imaging and Systems Biology, pages 62–71, 2012.
18. D. Duvenaud. Automatic Model Construction with Gaussian Processes. Ph.D. Thesis, University of Cambridge, 2014.
19. K. Ganchev, K. Hall, R. McDonald, and S. Petrov. Using search-logs to improve query tagging. In Proc. of ACL’12, pages 238–242, 2012.
20. J. Ginsberg, M. H. Mohebbi, R. S. Patel, et al. Detecting influenza epidemics using search engine query data. Nature, 457(7232):1012–1014, 2009.
21. Y. Goldberg. A Primer on Neural Network Models for Natural Language Processing. arXiv Preprint arXiv:1510.00726, 2015.
22. I. Guyon and A. Elisseeff. An Introduction to Variable and Feature Selection. J. Mach. Learn. Res., 3:1157–1182, 2003.
23. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer, 2009.
24. W. R. Hobbs, M. Burke, N. A. Christakis, and J. H. Fowler. Online social integration is associated with reduced mortality risk. Proc. Natl. Acad. Sci. U.S.A., 113(46):12980–12984, 2016.
25. A. E. Hoerl and R. W. Kennard. Ridge regression: biased estimation for nonorthogonal problems. Technometrics, 12:55–67, 1970.
26. M. Iyyer, V. Manjunatha, J. Boyd-Graber, and H. Daumé III. Deep Unordered Composition Rivals Syntactic Methods for Text Classification. In Proc. of ACL’15, pages 1681–1691, 2015.
27. M. Joshi, D. Das, K. Gimpel, and N. A. Smith. Movie Reviews and Revenues: An Experiment in Text Regression. In Proc. of NAACL’10, pages 293–296, 2010.
28. A. D. I. Kramer, J. E. Guillory, and J. T. Hancock. Experimental evidence of massive-scale emotional contagion through social networks. Proc. Natl. Acad. Sci. U.S.A., 111(24):8788–8790, 2014.
29. A. Lamb, M. J. Paul, and M. Dredze. Separating Fact from Fear: Tracking Flu Infections on Twitter. In Proc. of NAACL’13, pages 789–795, 2013.
30. V. Lampos. Flu Detector: Estimating influenza-like illness rates from online user-generated content. arXiv Preprint arXiv:1612.03494, 2016.
31. V. Lampos, N. Aletras, J. K. Geyti, B. Zou, and I. J. Cox. Inferring the Socioeconomic Status of Social Media Users based on Behaviour and Language. In Proc. of ECIR’16, pages 689–695, 2016.
32. V. Lampos, N. Aletras, D. Preotiuc-Pietro, and T. Cohn. Predicting and Characterising User Impact on Twitter. In Proc. of EACL’14, pages 405–413, 2014.
33. V. Lampos and N. Cristianini. Tracking the flu pandemic by monitoring the Social Web. In Proc. of the 2nd International Workshop on Cognitive Information Processing, pages 411–416, 2010.
34. V. Lampos and N. Cristianini. Nowcasting Events from the Social Web with Statistical Learning. ACM Trans. Intell. Syst. Technol., 3(4):1–22, 2012.
35. V. Lampos, A. C. Miller, S. Crossan, and C. Stefansen. Advances in nowcasting influenza-like illness rates using search query logs. Sci. Rep., 5(12760), 2015.
36. V. Lampos, D. Preotiuc-Pietro, and T. Cohn. A user-centric model of voting intention from Social Media. In Proc. of ACL’13, pages 993–1003, 2013.
37. V. Lampos, E. Yom-Tov, R. Pebody, and I. J. Cox. Assessing the impact of a health intervention via user-generated Internet content. Data Min. Knowl. Discov., 29(5):1434–1457, 2015.
38. D. Lazer, R. Kennedy, G. King, and A. Vespignani. The Parable of Google Flu: Traps in Big Data Analysis. Science, 343(6176):1203–1205, 2014.
39. O. Levy and Y. Goldberg. Dependency-Based Word Embeddings. In Proc. of ACL’14, pages 302–308, 2014.
40. O. Levy and Y. Goldberg. Linguistic Regularities in Sparse and Explicit Word Representations. In Proc. of CoNLL’14, pages 171–180, 2014.
41. O. Levy, Y. Goldberg, and I. Dagan. Improving Distributional Similarity with Lessons Learned from Word Embeddings. Trans. Assoc. Comput. Linguist., 3:211–225, 2015.
42. B. Matérn. Spatial Variation. Springer, 1986.
43. T. Mikolov, K. Chen, G. S. Corrado, and J. Dean. Efficient Estimation of Word Representations in Vector Space. In Proc. of the ICLR, Workshop Track, pages 1–12, 2013.
44. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed Representations of Words and Phrases and their Compositionality. In Advances in NIPS 26, pages 3111–3119, 2013.
45. D. R. Olson, K. J. Konty, M. Paladini, et al. Reassessing Google Flu Trends Data for Detection of Seasonal and Pandemic Influenza: A Comparative Epidemiological Study at Three Geographic Scales. PLoS Comput. Biol., 9(10), 10 2013.
46. O. Owoputi, B. O’Connor, C. Dyer, et al. Improved Part-of-Speech Tagging for Online Conversational Text with Word Clusters. In Proc. of NAACL’13, pages 380–390, 2013.
47. M. Paşca and B. Van Durme. Weakly-Supervised Acquisition of Open-Domain Classes and Class Attributes from Web Documents and Query Logs. In Proc. of ACL’08, pages 19–27, 2008.
48. G. Park, H. A. Schwartz, J. C. Eichstaedt, et al. Automatic personality assessment through social media language. J. Pers. Soc. Psychol., 108(6):934–952, 2015.
49. M. J. Paul and M. Dredze. You Are What You Tweet: Analyzing Twitter for Public Health. In Proc. of ICWSM’11, pages 265–272, 2011.
50. P. M. Polgreen, Y. Chen, D. M. Pennock, F. D. Nelson, and R. A. Weinstein. Using Internet Searches for Influenza Surveillance. Clin. Infect. Dis., 47(11):1443–1448, 2008.
51. D. Preotiuc-Pietro, V. Lampos, and N. Aletras. An analysis of the user occupational class through Twitter content. In Proc. of ACL’15, pages 1754–1764, 2015.
52. D. Preotiuc-Pietro, S. Volkova, V. Lampos, Y. Bachrach, and N. Aletras. Studying User Income through Language, Behaviour and Affect in Social Media. PLoS ONE, 10(9):e0138717, 2015.
53. D. Rao, D. Yarowsky, A. Shreevats, and M. Gupta. Classifying Latent User Attributes in Twitter. In Proc. of the 2nd International Workshop on Search and Mining User-generated Contents, pages 37–44, 2010.
54. C. E. Rasmussen and C. K. I. Williams. Gaussian Processes for Machine Learning. MIT Press, 2006.
55. H. A. Schwartz, J. C. Eichstaedt, M. L. Kern, et al. Personality, gender, and age in the language of social media: The Open-Vocabulary approach. PLoS ONE, 8(9):e73791, 2013.
56. A. Signorini, A. M. Segre, and P. M. Polgreen. The Use of Twitter to Track Levels of Disease Activity and Public Concern in the U.S. during the Influenza A H1N1 Pandemic. PLoS ONE, 6(5):e19467, 2011.
57. R. Tibshirani. Regression Shrinkage and Selection via the Lasso. J. R. Stat. Soc. Series B Stat. Methodol., 58(1):267–288, 1996.
58. M.-F. Tsai and C.-J. Wang. Financial Keyword Expansion via Continuous Word Vector Representations. In Proc. of EMNLP’14, pages 1453–1458, 2014.
59. S. Yang, M. Santillana, and S. C. Kou. Accurate estimation of influenza epidemics using Google search data via ARGO. Proc. Natl. Acad. Sci. U.S.A., 112(47):14473–14478, 2015.
60. T. Yano, N. A. Smith, and J. D. Wilkerson. Textual Predictors of Bill Survival in Congressional Committees. In Proc. of NAACL’12, pages 793–802, 2012.
61. P. Zhao and B. Yu. On model selection consistency of Lasso. J. Mach. Learn. Res., 7:2541–2563, 2006.
62. B. Zou, V. Lampos, R. Gorton, and I. J. Cox. On Infectious Intestinal Disease Surveillance Using Social Media Content. In Proc. of the 6th International Conference on Digital Health, pages 157–161, 2016.
63. H. Zou and T. Hastie. Regularization and variable selection via the elastic net. J. R. Stat. Soc. Series B Stat. Methodol., 67(2):301–320, 2005.