Multitask learning for mental health conditions with limited social media data

15th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2017 - Proceedings of Conference

Volumn 1, Issue , 2017, Pages 152-162

  Benton, Adrian ^a   Mitchell, Margaret ^b   Hovy, Dirk ^c  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b MICROSOFT RESEARCH   (United States)

^c UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; FORECASTING; HEALTH; LINEARIZATION; POPULATION STATISTICS;

FEED FORWARD; LIMITED DATA; MENTAL HEALTH; MENTAL STATE; MULTITASK LEARNING; ONLINE USERS; SOCIAL MEDIA DATUM; TASK MODELS;

DEEP LEARNING;

EID: 85021693604     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/e17-1015     Document Type: Conference Paper

References (40)

1. Jalal S Alowibdi, Ugo A Buy, and Philip Yu. 2013. Empirical evaluation of profile characteristics for gender classification on twitter. In Machine Learning and Applications (ICMLA), 2013 12th International Conference on, volume 1, pages 365-369. IEEE.
2. Robert N. Anderson. 2001. Deaths: leading causes for 1999. Centers for Disease Control and Prevention, National Center for Health Statistics.
3. Leon Bottou. 2012. Stochastic gradient tricks. Neural Networks, Tricks of the Trade, Reloaded, pages 430- 445.
4. Rich Caruana, Shumeet Baluja, Tom Mitchell, et al. 1996. Using the future to" sort out" the present: Rankprop and multitask learning for medical risk evaluation. Advances in neural information processing systems, pages 959-965.
5. Rich Caruana. 1993. Multitask learning: A knowledge-based source of inductive bias. In Proceedings of the Tenth International Conference on Machine Learning, pages 41-48. Citeseer.
6. Rich Caruana. 1996. Algorithms and applications for multitask learning. In ICML, pages 87-95. Citeseer.
7. Morgane Ciot, Morgan Sonderegger, and Derek Ruths. 2013. Gender Inference of Twitter Users in Non- English Contexts. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, Wash, pages 18-21.
8. Ronan Collobert, Jason Weston, Ĺeon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12(Aug):2493-2537.
9. Glen Coppersmith, Mark Dredze, Craig Harman, and Kristy Hollingshead. 2015a. From adhd to sad: Analyzing the language of mental health on twitter through self-reported diagnoses. In Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, pages 1-10.
10. Glen Coppersmith, Mark Dredze, Craig Harman, Kristy Hollingshead, and Margaret Mitchell. 2015b. Proceedings of the 2nd workshop on computational linguistics and clinical psychology: From linguistic signal to clinical reality. pages 31-39. Association for Computational Linguistics.
11. Glen Coppersmith, Ryan Leary, Eric Whyne, and Tony Wood. 2015c. Quantifying suicidal ideation via language usage on social media. In Joint Statistics Meetings Proceedings, Statistical Computing Section, JSM.
12. Glen Coppersmith, Kim Ngo, Ryan Leary, and Anthony Wood. 2016. Proceedings of the third workshop on computational lingusitics and clinical psychology. pages 106-117. Association for Computational Linguistics.
13. John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12(Jul):2121-2159.
14. Yoav Goldberg. 2015. A primer on neural network models for natural language processing. arXiv preprint arXiv:1510.00726.
15. Sumit Goswami, Sudeshna Sarkar, and Mayur Rustagi. 2009. Stylometric analysis of bloggers' age and gender. In Third International AAAI Conference on Weblogs and Social Media.
16. Dirk Hovy. 2015. Demographic factors improve classification performance. In Proceedings of ACL, pages 752-762.
17. Xiaolei Huang, Xin Li, Tianli Liu, David Chiu, Tingshao Zhu, and Lei Zhang. 2015. Topic model for identifying suicidal ideation in chinese microblog. In Proceedings of the 29th Pacific Asia Conference on Language, Information and Computation, pages 553-562.
18. Zachary C Lipton, David C Kale, Charles Elkan, and Randall Wetzell. 2016. Learning to diagnose with lstm recurrent neural networks. In Proceedings of ICLR.
19. Wendy Liu and Derek Ruths. 2013. What's in a name? Using first names as features for gender inference in Twitter. In Analyzing Microtext: 2013 AAAI Spring Symposium.
20. Paul Mcnamee and James Mayfield. 2004. Character n-gram tokenization for european language text retrieval. Information retrieval, 7(1-2):73-97.
21. Margaret Mitchell, Kristy Hollingshead, and Glen Coppersmith. 2015. Quantifying the language of schizophrenia in social media. In Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, pages 11-20, Denver, Colorado, June 5. Association for Computational Linguistics.
22. Dong Nguyen, Noah A Smith, and Carolyn P Rose. 2011. Author age prediction from text using linear regression. In Proceedings of the 5th ACLHLT Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, pages 115-123. Association for Computational Linguistics.
23. Dong Nguyen, Dolf Trieschnigg, A. Seza Dogrüoz, Rilana Gravel, Mariet Theune, Theo Meder, and Franciska De Jong. 2014. Predicting Author Gender and Age from Tweets: Sociolinguistic Theories and Crowd Wisdom. In Proceedings of COLING 2014.
24. Greg Park, H Andrew Schwartz, Johannes C Eichstaedt, Margaret L Kern, David J Stillwell, Michal Kosinski, Lyle H Ungar, and Martin EP Seligman. 2015. Automatic personality assessment through social media language. Journal of Personality and Social Psychology.
25. Ted Pedersen. 2015. Proceedings of the 2nd workshop on computational linguistics and clinical psychology: From linguistic signal to clinical reality. pages 46-53. Association for Computational Linguistics.
26. Barbara Plank and Dirk Hovy. 2015. Personality traits on twitter-or-how to get 1, 500 personality tests in a week. In Proceedings of the 6th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pages 92-98.
27. Daniel Preoţiuc-Pietro, Johannes Eichstaedt, Gregory Park, Maarten Sap, Laura Smith, Victoria Tobolsky, Hansen Andrew Schwartz, and Lyle H Ungar. 2015. The role of personality, age and gender in tweeting about mental illnesses. In Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, NAACL.
28. Daniel Preotiuc-Pietro, Vasileios Lampos, and Nikolaos Aletras. 2015a. An analysis of the user occupational class through twitter content. In ACL.
29. Daniel Preoţiuc-Pietro, Svitlana Volkova, Vasileios Lampos, Yoram Bachrach, and Nikolaos Aletras. 2015b. Studying user income through language, behaviour and affect in social media. PloS one, 10(9):e0138717.
30. Sara Rosenthal and Kathleen McKeown. 2011. Age prediction in blogs: A study of style, content, and online behavior in pre-and post-social media generations. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pages 763- 772. Association for Computational Linguistics.
31. Alexander M Rush, David Sontag, Michael Collins, and Tommi Jaakkola. 2010. On dual decomposition and linear programming relaxations for natural language processing. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pages 1-11. Association for Computational Linguistics.
32. Ruchita Sarawgi, Kailash Gajulapalli, and Yejin Choi. 2011. Gender attribution: Tracing stylometric evidence beyond topic and genre. In Proceedings of the Fifteenth Conference on Computational Natural Language Learning, pages 78-86. Association for Computational Linguistics.
33. Hansen Andrew Schwartz, Johannes C Eichstaedt, Lukasz Dziurzynski, Margaret L Kern, Eduardo Blanco, Michal Kosinski, David Stillwell, Martin EP Seligman, and Lyle H Ungar. 2013a. Toward personality insights from language exploration in social media. In AAAI Spring Symposium: Analyzing Microtext.
34. Hansen Andrew Schwartz, Johannes C Eichstaedt, Margaret L Kern, Lukasz Dziurzynski, Stephanie M Ramones, Megha Agrawal, Achal Shah, Michal Kosinski, David Stillwell, Martin EP Seligman, et al. 2013b. Personality, gender, and age in the language of social media: The open-vocabulary approach. PloS one, 8(9).
35. Andrew H. Schwartz, Johannes Eichstaedt, L. Margaret Kern, Gregory Park, Maarten Sap, David Stillwell, Michal Kosinski, and Lyle Ungar. 2014. Proceedings of the workshop on computational linguistics and clinical psychology: From linguistic signal to clinical reality. pages 118-125. Association for Computational Linguistics.
36. Anders Søgaard and Yoav Goldberg. 2016. Deep multi-task learning with low level tasks supervised at lower layers. In The 54th Annual Meeting of the Association for Computational Linguistics, page 231.
37. Charles Sutton, Andrew McCallum, and Khashayar Rohanimanesh. 2007. Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data. Journal of Machine Learning Research, 8(Mar):693-723.
38. Svitlana Volkova, Theresa Wilson, and David Yarowsky. 2013. Exploring demographic language variations to improve multilingual sentiment analysis in social media. In Proceedings of EMNLP, pages 1815-1827.
39. Svitlana Volkova, Glen Coppersmith, and Benjamin Van Durme. 2014. Inferring user political preferences from streaming communications. In Proceedings of the 52nd annual meeting of the ACL, pages 186-196.
40. Svitlana Volkova, Yoram Bachrach, Michael Armstrong, and Vijay Sharma. 2015. Inferring latent user properties from texts published in social media (demo). In Proceedings of the Twenty-Ninth Conference on Artificial Intelligence (AAAI), Austin, TX, January.