Multi-task learning improves disease models from web search

The Web Conference 2018 - Proceedings of the World Wide Web Conference, WWW 2018

Volumn , Issue , 2018, Pages 87-96

  Zou, Bin ^a   Lampos, Vasileios ^a   Cox, Ingemar ^a,b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Disease surveillance; Gaussian processes; Multi task learning; Regularized regression; User generated content; Web search

Indexed keywords

HEALTH; INFORMATION RETRIEVAL; LEARNING SYSTEMS; MULTI-TASK LEARNING; SEARCH ENGINES; WEBSITES;

DISEASE MODELS; DISEASE SURVEILLANCE; GAUSSIAN PROCESSES; HEALTH SYSTEMS; LINEAR AND NONLINEAR MODELS; MEAN ABSOLUTE ERROR; SHORT TIME INTERVALS; TRAINING MODEL;

DATA REDUCTION;

EID: 85060313367     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3178876.3186050     Document Type: Conference Paper

References (56)

1. A. H. Abdulnabi, G. Wang, J. Lu, and K. Jia. 2015. Multi-Task CNN Model for Attribute Prediction. IEEE Transactions on Multimedia 17, 11 (2015), 1949-1959.
2. A. Argyriou, T. Evgeniou, and M. Pontil. 2006. Multi-Task Feature Learning. In Proceedings of Advances in Neural Information Processing Systems 19.
3. A. Argyriou, T. Evgeniou, and M. Pontil. 2008. Convex Multi-Task Feature Learning. Machine Learning 73, 3 (2008), 243-272.
4. B. Bakker and T. Heskes. 2003. Task Clustering and Gating for Bayesian Multitask Learning. Journal of Machine Learning Research 4 (2003), 83-99.
5. E. Bakshy, S. Messing, and L. A. Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239 (2015), 1130-1132.
6. J. Baxter. 2000. AModel of Inductive Bias Learning. Journal of Artificial Intelligence Research 12, 1 (2000), 149-198.
7. D. Beck, T. Cohn, and L. Specia. 2014. Joint Emotion Analysis via Multi-task Gaussian Processes. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 1798-1803.
8. S. Ben-David and R. Schuller. 2003. Exploiting Task Relatedness for Multiple Task Learning. In Proceedings of the 16th Annual Conference on Learning Theory and 7th Kernel Workshop. 567-580.
9. A. Benton, M. Mitchell, and D. Hovy. 2017. Multitask Learning for Mental Health Conditions with Limited Social Media Data. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics. 152-162.
10. S. Bickel, J. Bogojeska, T. Lengauer, and T. Scheffer. 2008. Multi-Task Learning for HIV Therapy Screening. In Proceedings of the 25th International Conference on Machine Learning. 56-63.
11. E. V. Bonilla, K. M. A. Chai, and C. K. I. Williams. 2007. Multi-task Gaussian Process Prediction. In Proceedings of Advances in Neural Information Processing Systems 20. 153-160.
12. R. Caruana. 1993. Multitask Learning: A Knowledge-based Source of Inductive Bias. In Proceedings of the 10th International Conference on Machine learning. 41-48.
13. R. Caruana. 1998. Multitask Learning. In Learning to Learn. Springer, 95-133.
14. M. De Choudhury, M. Gamon, S. Counts, and E. Horvitz. 2013. Predicting Depression via Social Media. In Proceedings of the 7th International AAAI Conference on Weblogs and Social Media. 128-137.
15. T. Cohn and L. Specia. 2013. Modelling Annotator Bias with Multi-task Gaussian Processes: An Application to Machine Translation Quality Estimation. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics. 32-42.
16. R. Collobert and J. Weston. 2008. A Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning. In Proceedings of the 25th International Conference on Machine Learning. 160-167.
17. A. Culotta. 2010. Towards Detecting Influenza Epidemics by Analyzing Twitter Messages. In Proceedings of the 1st Workshop on Social Media Analytics. 115-122.
18. R. Durichen, M. A. F. Pimentel, L. Clifton, A. Schweikard, and D. A. Clifton. 2014. Multi-task Gaussian process Models for Biomedical Applications. In Proceedings of the 2014 IEEE-EMBS International Conference on Biomedical and Health Informatics. 492-495.
19. S. Emrani, A. McGuirk, andW. Xiao. 2017. Prognosis and Diagnosis of Parkinson's Disease Using Multi-Task Learning. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1457-1466.
20. T. Evgeniou and M. Pontil. 2004. Regularized Multi-Task Learning. In Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 109-117.
21. H. Gil de Zúñiga, N. Jung, and S. Valenzuela. 2012. Social Media Use for News and Individuals' Social Capital, Civic Engagement and Political Participation. Journal of Computer-Mediated Communication 17, 3 (2012), 319-336.
22. J. Ginsberg, M. H. Mohebbi, R. S. Patel, L. Brammer, M. S. Smolinski, and L. Brilliant. 2009. Detecting Influenza Epidemics using Search Engine Query Data. Nature 457, 7232 (2009), 1012-1014.
23. T. Hastie, R. Tibshirani, and J. Friedman. 2009. The Elements of Statistical Learning Data Mining, Inference, and Prediction, Second Edition. Springer.
24. A. E. Hoerl and R. W. Kennard. 1970. Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics 12, 1 (1970), 55-67.
25. M. Kosinski, D. Stillwell, and T. Graepel. 2013. Private Traits and Attributes are Predictable from Digital Records of Human Behavior. Proceedings of the National Academy of Sciences 110, 15 (2013), 5802-5805.
26. A. D. I. Kramer, J. E. Guillory, and J. T. Hancock. 2014. Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences 111, 24 (2014), 8788-8790.
27. V. Lampos, N. Aletras, D. Preotiuc-Pietro, and T. Cohn. 2014. Predicting and Characterising User Impact on Twitter. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics. 405-413.
28. V. Lampos and N. Cristianini. 2010. Tracking the flu pandemic by monitoring the Social Web. In Proceedings of the 2nd International Workshop on Cognitive Information Processing. 411-416.
29. V. Lampos and N. Cristianini. 2012. Nowcasting Events from the SocialWeb with Statistical Learning. ACM Transactions on Intelligent Systems and Technology 3, 4 (2012), 1-22.
30. V. Lampos, T. De Bie, and N. Cristianini. 2010. Flu Detector-Tracking Epidemics on Twitter. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases. 599-602.
31. V. Lampos, A. C. Miller, S. Crossan, and C. Stefansen. 2015. Advances in nowcasting influenza-like illness rates using search query logs. Scientific Reports 5, 12760 (2015).
32. V. Lampos, D. Preotiuc-Pietro, and T. Cohn. 2013. A user-centric model of voting intention from social media. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics. 993-1003.
33. V. Lampos, E. Yom-Tov, R. Pebody, and I. J. Cox. 2015. Assessing the Impact of a Health Intervention via User-generated Internet Content. Data Mining and Knowledge Discovery 29, 5 (2015), 1434-1457.
34. V. Lampos, B. Zou, and I. J. Cox. 2017. Enhancing Feature Selection Using Word Embeddings: The Case of Flu Surveillance. In Proceedings of the 26th International Conference on World Wide Web. 695-704.
35. S. Lee, J. Zhu, and E. P. Xing. 2010. Adaptive Multi-task Lasso: With Application to eQTL Detection. In Proceedings of the 23rd International Conference on Neural Information Processing Systems. 1306-1314.
36. J. Liu, S. Ji, and J. Ye. 2009. Multi-task Feature Learning via Efficient ℓ2,1-Norm Minimization. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. 339-348.
37. P. Liu, X. Qiu, and X. Huang. 2016. Recurrent Neural Network for Text Classification with Multi-task Learning. In Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2873-2879.
38. M. Lukasik, T. Cohn, and K. Bontcheva. 2015. Classifying Tweet Level Judgements of Rumours in Social Media. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 2590-2595.
39. A. M. Manago, T. Taylor, and P. M. Greenfield. 2012. Me and my 400 friends: The anatomy of college students' Facebook networks, their communication patterns, and well-being. Developmental Psychology 48, 2 (2012), 369-380.
40. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. 2013. Distributed Representations of Words and Phrases and Their Compositionality. In Proceedings of Advances in Neural Information Processing Systems 26. 3111-3119.
41. S. J. Pan and Q. Yang. 2010. A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering 22, 10 (2010), 1345-1359.
42. M. J. Paul, M. Dredze, and D. Broniatowski. 2014. Twitter Improves Influenza Forecasting. PLOS Currents Outbreaks (2014).
43. P. M. Polgreen, Y. Chen, D. M. Pennock, F. D. Nelson, and R. A. Weinstein. 2008. Using Internet Searches for Influenza Surveillance. Clinical Infectious Diseases 47, 11 (2008), 1443-1448.
44. D. Preotiuc-Pietro, V. Lampos, and N. Aletras. 2015. An analysis of the user occupational class through Twitter content. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics. 1754-1764.
45. C. E. Rasmussen and C. K. I. Williams. 2006. Gaussian Processes for Machine Learning. MIT Press.
46. H. A. Schwartz et al. 2013. Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach. PLoS ONE 8, 9 (2013), e73791.
47. J. Shaman and A. Karspeck. 2012. Forecasting Seasonal Outbreaks of Influenza. Proceedings of the National Academy of Sciences 109, 50 (2012), 20425-20430.
48. R. Tibshirani. 1996. Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society 58, 1 (1996), 267-288.
49. H.Wackernagel. 2013. Multivariate Geostatistics: An Introduction with Applications. Springer.
50. M. Wagner, V. Lampos, E. Yom-Tov, R. Pebody, and I. J. Cox. 2017. Estimating the Population Impact of a New Pediatric Influenza Vaccination Program in England Using Social Media Content. Journal of Medical Internet Research 19, 12 (2017), e416.
51. W. Zhang, R. Li, T. Zeng, Q. Sun, S. Kumar, J. Ye, and S. Ji. 2015. Deep Model Based Transfer and Multi-Task Learning for Biological Image Analysis. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1475-1484.
52. Z. Zhang, P. Luo, C. C. Loy, and X. Tang. 2014. Facial Landmark Detection by Deep Multi-task Learning. 94-108.
53. L. Zhao, Q. Sun, J. Ye, F. Chen, C.-T. Lu, and N. Ramakrishnan. 2015. Multi-Task Learning for Spatio-Temporal Event Forecasting. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1503-1512.
54. J. Zhou, J. Liu, V. A. Narayan, and J. Ye. 2012. Modeling Disease Progression via Fused Sparse Group Lasso. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1095-1103.
55. B. Zou, V. Lampos, R. Gorton, and I. J. Cox. 2016. On Infectious Intestinal Disease Surveillance using Social Media Content. In Proceedings of the 6th International Conference on Digital Health. 157-161.
56. H. Zou and T. Hastie. 2005. Regularization and Variable Selection via the Elastic Net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67, 2 (2005), 301-320.