Assessing suicide risk and emotional distress in Chinese social media: A text mining and machine learning study

Journal of Medical Internet Research

Volumn 19, Issue 7, 2017, Pages

  Cheng, Qijin ^a   Li, Tim Mh ^b   Kwok, Chi Leung ^a   Zhu, Tingshao ^c   Yip, Paul Sf ^a  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

^c INSTITUTE OF PSYCHOLOGY   (China)

Author keywords

Chinese; Machine learning; Natural language; Psychological stress; Social media; Suicide

Indexed keywords

ADOLESCENT; ADULT; ASIAN CONTINENTAL ANCESTRY GROUP; DATA MINING; FEMALE; HUMAN; LINGUISTICS; MACHINE LEARNING; MALE; MENTAL STRESS; PROCEDURES; PSYCHOLOGY; SOCIAL MEDIA; SUICIDE; UTILIZATION; YOUNG ADULT;

ADOLESCENT; ADULT; ASIAN CONTINENTAL ANCESTRY GROUP; DATA MINING; FEMALE; HUMANS; LINGUISTICS; MACHINE LEARNING; MALE; SOCIAL MEDIA; STRESS, PSYCHOLOGICAL; SUICIDE; YOUNG ADULT;

EID: 85026446386     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.7276     Document Type: Article

References (54)

1. Wang CW, Chan CL, Yip PS. Suicide rates in China from 2002 to 2011: An update. Soc Psychiatry Psychiatr Epidemiol 2014 Jun;49(6):929-941. [doi: 10.1007/s00127-013-0789-5] [Medline: 24240568]
2. World Health Organization. Preventing suicide: A global imperative. Geneva: World Health Organization; 2014.
3. Bruffaerts R, Demyttenaere K, Hwang I, Chiu WT, Sampson N, Kessler RC, et al. Treatment of suicidal people around the world. Br J Psychiatry 2011 Jul;199(1):64-70 [FREE Full text] [doi: 10.1192/bjp.bp.110.084129] [Medline: 21263012]
4. Michelmore L, Hindley P. Help-seeking for suicidal thoughts and self-harm in young people: A systematic review. Suicide Life Threat Behav 2012 Oct;42(5):507-524. [doi: 10.1111/j.1943-278X.2012.00108.x] [Medline: 22889130]
5. Fu KW, Liu KY, Yip PS. Predictive validity of the Chinese version of the Adult Suicidal Ideation Questionnaire: Psychometric properties and its short version. Psychol Assess 2007 Dec;19(4):422-429. [doi: 10.1037/1040-3590.19.4.422] [Medline: 18085934]
6. Bagge C, Osman A. The Suicide Probability Scale: norms and factor structure. Psychol Rep 1998 Oct;83(2):637-638. [doi: 10.2466/pr0.1998.83.2.637] [Medline: 9819937]
7. Crawford JR, Henry JD. The Depression Anxiety Stress Scales (DASS): normative data and latent structure in a large non-clinical sample. Br J Clin Psychol 2003 Jun;42(Pt 2):111-131. [doi: 10.1348/014466503321903544] [Medline: 12828802]
8. Henry JD, Crawford JR. The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. Br J Clin Psychol 2005 Jun;44(Pt 2):227-239. [doi: 10.1348/014466505X29657] [Medline: 16004657]
9. Harris KM, Syu JJ, Lello OD, Chew YL, Willcox CH, Ho RH. The ABC's of suicide risk assessment: Applying a tripartite approach to individual evaluations. PLoS One 2015 Jun 1;10(6):e0127442 [FREE Full text] [doi: 10.1371/journal.pone.0127442] [Medline: 26030590]
10. Essau CA. Frequency and patterns of mental health services utilization among adolescents with anxiety and depressive disorders. Depress Anxiety 2005;22(3):130-137. [doi: 10.1002/da.20115] [Medline: 16175563]
11. Rickwood DJ, Deane FP, Wilson CJ. When and how do young people seek professional help for mental health problems? Med J Aust 2007 Oct 1;187(7 Suppl):S35-S39. [Medline: 17908023]
12. Zachrisson HD, Rödje K, Mykletun A. Utilization of health services in relation to mental health problems in adolescents: A population based survey. BMC Public Health 2006 Feb 16;6:34 [FREE Full text] [doi: 10.1186/1471-2458-6-34] [Medline: 16480522]
13. Harris KM, Goh MT. Is suicide assessment harmful to participants? Findings from a randomized controlled trial. Int J Ment Health Nurs 2017 Apr;26(2):181-190. [doi: 10.1111/inm.12223] [Medline: 27083774]
14. Cheng Q, Chang SS, Yip PS. Opportunities and challenges of online data collection for suicide prevention. The Lancet 2012 May 26;379(9830):e53-e54. [doi: 10.1016/S0140-6736(12)60856-3]
15. Westerlund M, Hadlaczky G, Wasserman D. The representation of suicide on the Internet: Implications for clinicians. J Med Internet Res 2012 Sep 26;14(5):e122 [FREE Full text] [doi: 10.2196/jmir.1979] [Medline: 23010086]
16. Sueki H. The association of suicide-related Twitter use with suicidal behaviour: A cross-sectional study of young internet users in Japan. J Affect Disord 2015 Jan 01;170:155-160. [doi: 10.1016/j.jad.2014.08.047] [Medline: 25240843]
17. Mok K, Jorm AF, Pirkis J. Suicide-related Internet use: A review. Aust N Z J Psychiatry 2015 Aug;49(8):697-705. [doi: 10.1177/0004867415569797] [Medline: 25698810]
18. Fu KW, Cheng Q, Wong PW, Yip PS. Responses to a self-presented suicide attempt in social media: A social network analysis. Crisis 2013 Jan 01;34(6):406-412 [FREE Full text] [doi: 10.1027/0227-5910/a000221] [Medline: 23871954]
19. Ma J, Zhang W, Harris K, Chen Q, Xu X. Dying online: Live broadcasts of Chinese emerging adult suicides and crisis response behaviors. BMC Public Health 2016 Aug 11;16(1):774 [FREE Full text] [doi: 10.1186/s12889-016-3415-0] [Medline: 27515312]
20. China Internet Watch. 2017. Weibo monthly active users grew to 313M in Q4 2016 URL: Https://www. chinainternetwatch.com/19847/weibo-q4-2016/ [accessed 2017-03-31] [WebCite Cache ID 6pN3uOUde]
21. Statista. 2017. Number of monthly active Twitter users worldwide from 1st quarter 2010 to 4th quarter 2017 (in millions) URL: Https://www.statista.com/statistics/282087/number-of-monthly-active-twitter-users/ [accessed 2017-03-31] [WebCite Cache ID 6pN4GbLTv]
22. Cheng Q, Kwok CL, Zhu T, Guan L, Yip PS. Suicide communication on social media and its psychological mechanisms: An examination of Chinese microblog users. Int J Environ Res Public Health 2015 Sep 11;12(9):11506-11527 [FREE Full text] [doi: 10.3390/ijerph120911506] [Medline: 26378566]
23. Pennebaker JW, Mehl MR, Niederhoffer KG. Psychological aspects of natural language use: Our words, our selves. Annu Rev Psychol 2003;54:547-577. [doi: 10.1146/annurev.psych.54.101601.145041] [Medline: 12185209]
24. Braithwaite SR, Giraud-Carrier C, West J, Barnes MD, Hanson CL. Validating machine learning algorithms for Twitter data against established measures of suicidality. JMIR Ment Health 2016 May 16;3(2):e21 [FREE Full text] [doi: 10.2196/mental.4822] [Medline: 27185366]
25. O'Dea B, Wan S, Batterham PJ, Calear AL, Paris C, Christensen H. Detecting suicidality on Twitter. Internet Interv 2015 May;2(2):183-188. [doi: 10.1016/j.invent.2015.03.005]
26. Choudhury MD, Gamon M, Counts S, Horvitz E. Predicting Depression via Social Media. In: Proceedings of The 7th International AAAI Conference on Weblogs and Social Media. Redmond, WA: Association for the Advancement of Artificial Intelligence; 2013 Presented at: The 7th International AAAI Conference on Weblogs and Social Media; 2013; Boston, USA URL: Https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/icwsm-13.pdf
27. Lv M, Li A, Liu T, Zhu T. Creating a Chinese suicide dictionary for identifying suicide risk on social media. PeerJ 2015 Dec 15;3:e1455 [FREE Full text] [doi: 10.7717/peerj.1455] [Medline: 26713232]
28. Huang X, Li X, Liu T, Chiu D, Zhu T, Zhang L. Topic Model for Identifying Suicidal Ideation in Chinese Microblog. Stroudsburg: Association for Computational Linguistics; 2015 Presented at: The 29th Pacific Asia Conference on Language, Information and Computation; 2015 Oct 30-Nov 1; Shanghai, China URL: Https://pdfs.semanticscholar.org/3669/ f95b0a3224c62d4ddfcebc174dee613e07fc.pdf
29. Homan CM, Johar R, Liu T, Lytle M, Silenzio V, Alm CO. Toward Macro-Insights for Suicide Prevention: Analyzing Fine-Grained Distress at Scale. Stroudsburg: Association for Computational Linguistics; 2014 Presented at: Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality; 2014 June 27; Baltimore, Maryland, USA URL: Http://www.aclweb.org/anthology/W14-3213
30. Burnap P, Colombo W, Scourfield J. Machine classification and analysis of suicide-related communication on twitter. New York: ACM; 2015 Presented at: 26th ACM Conference on Hypertext and Social Media; 2015 Sep 1-4; Guzelyurt, Northern Cyprus URL: Http://dl.acm.org/citation.cfm?id=2791023
31. Kumar M, Dredze M, Coppersmith G, Choudhury MD. Detecting changes in suicide content manifested in social media following celebrity suicides. New York: ACM; 2015 Presented at: 26th ACM Conference on Hypertext & Social Media; 2015 Sep 1-4; Guzelyurt, Northern Cyprus URL: Http://www.munmund.net/pubs/ht15-WertherEffect.pdf
32. Guan L, Hao B, Cheng Q, Yip PS, Zhu T. Identifying Chinese microblog users with high suicide probability using internet-based profile and linguistic features: Classification model. JMIR Ment Health 2015 May 12;2(2):e17. [doi: 10.2196/mental.4227]
33. Huang C, Chung C, Hui N, Lin Y, Seih Y, Chen W. The development of the Chinese linguistic inquiry and word count dictionary. Chin J Psychol 2012 Jun 01;54(2):185-201. [doi: 10.6129/CJP.2012.5402.04]
34. Zhang L, Huang X, Liu T, Li A, Chen Z, Zhu T. Using linguistic features to estimate suicide probability of Chinese microblog users. In: Human Centered Computing. Switzerland: Springer; 2014 Presented at: International Conference on Human Centered Computing; 2014 Nov 27-29; Phnom Penh, Cambodia p. 549-559 URL: Https://link.springer.com/chapter/10.1007/ 978-3-319-15554-8-45 [doi: 10.1007/978-3-319-15554-8-45]
35. Pennebaker JW, Boyd RL, Jordan K, Blackburn K. The development and psychometric properties of LIWC2015. Austin, TX: University of Texas at Austin; 2015.
36. Liang Y, Yang L. Study on reliability and validity of the suicide probability scale. China J Health Psychol 2010;2:225-227 [FREE Full text]
37. Tatman SM, Greene AL, Karr LC. Use of the Suicide Probability Scale (SPS) with adolescents. Suicide Life Threat Behav 1993;23(3):188-203. [Medline: 8249031]
38. Gong X, Xie X, Xu R, Luo Y. Psychometric properties of the Chinese versions of DASS-21 in Chinese college students. Chin J Clin Psychol 2010;18(4):443-446.
39. Tseng H, Chang P, Andrew G, Jurafsky D, Manning C. A Conditional Random Field Word Segmenter for Sighan Bakeoff 2005. Stroudsburg: Association for Computational Linguistics; 2005 Presented at: The fourth SIGHAN workshop on Chinese language processing; 2005 Oct 14-15; Jeju Island, Korea URL: Http://www.aclweb.org/anthology/I/I05/I05-3027. pdf
40. Tausczik YR, Pennebaker JW. The psychological meaning of words: LIWC and computerized text analysis methods. J Lang Soc Psychol 2010;29(1):24-54. [doi: 10.1177/0261927X09351676]
41. Tan S, Zhang J. An empirical study of sentiment analysis for chinese documents. Expert Syst Appl 2008 May;34(4):2622-2629. [doi: 10.1016/j.eswa.2007.05.028]
42. Meyer D, Dimitriadou E, Hornik K, Weingessel A, Leisch F, Chang C. Ugrad. 2015. Misc Functions of the Department of Statistics. Probability Theory Group (Formerly: E1071), TU Wien URL: Http://ugrad.stat.ubc.ca/R/library/e1071/html/ 00Index.html [accessed 2017-05-31] [WebCite Cache ID 6qrpmznPA]
43. Cawley GC, Talbot NL. Efficient leave-one-out cross-validation of kernel fisher discriminant classifiers. Pattern Recognit 2003 Nov;36(11):2585-2592. [doi: 10.1016/S0031-3203(03)00136-5]
44. Cawley GC, Talbot NL. Efficient approximate leave-one-out cross-validation for kernel logistic regression. Mach Learn 2008 Jun;71(2):243-264. [doi: 10.1007/s10994-008-5055-9]
45. ZDIC 2015 [in Chinese]. URL: Http://www.zdic.net/ [accessed 2017-06-05] [WebCite Cache ID 6qzEdlSGe]
46. Li TM, Chau M, Yip PS, Wong PW. Temporal and computerized psycholinguistic analysis of the blog of a Chinese adolescent suicide. Crisis 2014 May;35(3):168-175. [doi: 10.1027/0227-5910/a000248] [Medline: 24698727]
47. Stirman SW, Pennebaker JW. Word use in the poetry of suicidal and nonsuicidal poets. Psychosom Med 2001;63(4):517-522. [Medline: 11485104]
48. O'Dea B, Larsen ME, Batterham PJ, Calear AL, Christensen H. A linguistic analysis of suicide-related Twitter posts. Crisis 2017 Feb 23:1-11. [doi: 10.1027/0227-5910/a000443] [Medline: 28228065]
49. Zhang S, Wu X, Feng Y. An analysis of cultural differences in Chinese and English first-person Deixis from the perspective of pragmatic empathy. Theory and Practice in Language Studies 2013 Oct 01;3(10):1868-1872. [doi: 10.4304/tpls.3.10.1868-1872]
50. Canetto SS, Lester D. Love and achievement motives in women's and men's suicide notes. J Psychol 2002 Sep;136(5):573-576. [doi: 10.1080/00223980209605552] [Medline: 12431040]
51. Hull-Blanks EE, Kerr BA, Robinson Kurpius SE. Risk factors of suicidal ideations and attempts in talented, at-risk girls. Suicide Life Threat Behav 2004;34(3):267-276. [doi: 10.1521/suli.34.3.267.42782] [Medline: 15385181]
52. Klibert J, Langhinrichsen-Rohling J, Luna A, Robichaux M. Suicide proneness in college students: Relationships with gender, procrastination, and achievement motivation. Death Stud 2011 Aug;35(7):625-645. [Medline: 24501841]
53. Lewis SA, Johnson J, Cohen P, Garcia M, Velez CN. Attempted suicide in youth: Its relationship to school achievement, educational goals, and socioeconomic status. J Abnorm Child Psychol 1988 Aug;16(4):459-471. [Medline: 3221034]
54. Agrawal PK, Alvi AS, Bamnote GR. Natural Language-Based Self-learning Feedback Analysis System. In: Proceedings of the Second International Conference on Computer and Communication Technologies. New Delhi: Springer; 2015 Presented at: The Second International Conference on Computer and Communication Technologies; 2015 Jul 24-26; Hyderabad, India.