Prediction models for suicide attempts and deaths: A systematic review and simulation

JAMA Psychiatry

Volumn 76, Issue 6, 2019, Pages 642-651

  Belsher, Bradley E ^a,b   Smolenski, Derek J ^a   Pruitt, Larry D ^a   Bush, Nigel E ^a   Beech, Erin H ^a   Workman, Don E ^a,b   Morgan, Rebecca L ^c   Evatt, Daniel P ^a,b   Tucker, Jennifer ^a   Skopp, Nancy A ^a  

^a Defense Health Agency   (United States)

^b UNIFORMED SERVICES UNIVERSITY OF THE HEALTH SCIENCES   (United States)

^c MCMASTER UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DIAGNOSTIC ACCURACY; HIGH RISK PATIENT; HUMAN; MORTALITY; PREDICTION; PREDICTIVE VALUE; REVIEW; RISK ASSESSMENT; SUICIDE; SUICIDE ATTEMPT; SYSTEMATIC REVIEW; ALGORITHM; SUICIDAL IDEATION; THEORETICAL MODEL;

ALGORITHMS; HUMANS; MODELS, THEORETICAL; SUICIDAL IDEATION; SUICIDE; SUICIDE, ATTEMPTED;

EID: 85062951275     PISSN: 2168622X     EISSN: None     Source Type: Journal    
DOI: 10.1001/jamapsychiatry.2019.0174     Document Type: Review

References (47)

1. Armed Forces Health Surveillance Center. Numbers and proportions of US military members in treatment for mental disorders over time, active component, January 2000-September 2013. MSMR. 2014; 21 (5): 2-7. 24885876
2. Corr WP III. Suicides and suicide attempts among active component members of the US Armed Forces, 2010-2012; methods of self-harm vary by major geographic region of assignment. MSMR. 2014; 21 (10): 2-5. 25357138
3. Anglemyer A, Miller ML, Buttrey S, Whitaker L. Suicide rates and methods in active duty military personnel, 2005 to 2011: a cohort study. Ann Intern Med. 2016; 165 (3): 167-174. doi: 10.7326/M15-2785 27272476
4. Pruitt LD, Smolenski DJ, Bush NE, Skopp NA, Hoyt TV, Grady BJ. Department of Defense Suicide Event Report: Calendar Year 2015 Annual Report. Washington, DC: Department of Defense; 2016.
5. Schoenbaum M, Kessler RC, Gilman SE,; Army STARRS Collaborators. Predictors of suicide and accident death in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS): results from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). JAMA Psychiatry. 2014; 71 (5): 493-503. doi: 10.1001/jamapsychiatry.2013.4417 24590048
6. Pruitt LD, Smolenski DJ, Bush NE, Skopp NA, Edwards-Stewart A, Hoyt TV. Department of Defense Suicide Event Report: Calendar Year 2016 Annual Report. Washington, DC: Department of Defense; 2017.
7. VA National Suicide Data Report: 2005-2015. Washington, DC: US Department of Veterans Affairs; 2018.
8. Supporting our veterans during their transition from uniformed service to civilian life. Federal Register. 2018; 83 (9): 1513-1514.
9. Franklin JC, Ribeiro JD, Fox KR, Risk factors for suicidal thoughts and behaviors: a meta-analysis of 50 years of research. Psychol Bull. 2017; 143 (2): 187-232. doi: 10.1037/bul0000084 27841450
10. Runeson B, Odeberg J, Pettersson A, Edbom T, Jildevik Adamsson I, Waern M. Instruments for the assessment of suicide risk: a systematic review evaluating the certainty of the evidence. PLoS One. 2017; 12 (7): e0180292. doi: 10.1371/journal.pone.0180292
11. Carter G, Milner A, McGill K, Pirkis J, Kapur N, Spittal MJ. Predicting suicidal behaviours using clinical instruments: systematic review and meta-analysis of positive predictive values for risk scales. Br J Psychiatry. 2017; 210 (6): 387-395. doi: 10.1192/bjp.bp.116.182717 28302700
12. LeFevre ML; US Preventive Services Task Force. Screening for suicide risk in adolescents, adults, and older adults in primary care: US Preventive Services Task Force recommendation statement. Ann Intern Med. 2014; 160 (10): 719-726. doi: 10.7326/M14-0589 24842417
13. The Joint Commission. Detecting and treating suicide ideation in all settings. Sentinel Event Alert. 2016; 56 (56): 1-7. 26915165
14. Hogan MF, Grumet JG. Suicide prevention: an emerging priority for health care. Health Aff (Millwood). 2016; 35 (6): 1084-1090. doi: 10.1377/hlthaff.2015.1672 27269026
15. Walkup JT, Townsend L, Crystal S, Olfson M. A systematic review of validated methods for identifying suicide or suicidal ideation using administrative or claims data. Pharmacoepidemiol Drug Saf. 2012; 21 (suppl 1): 174-182. doi: 10.1002/pds.2335 22262604
16. Wang Y, Kung LA, Byrd TA. Big data analytics: understanding its capabilities and potential benefits for healthcare organizations. Technol Forecast Soc Change. 2018; 126: 3-13. doi: 10.1016/j.techfore.2015.12.019
17. Pokorny AD. Prediction of suicide in psychiatric patients: report of a prospective study. Arch Gen Psychiatry. 1983; 40 (3): 249-257. doi: 10.1001/archpsyc.1983.01790030019002 6830404
18. MacKinnon DR, Farberow NL. An assessment of the utility of suicide prediction. Suicide Life Threat Behav. 1976; 6 (2): 86-91. 941207
19. Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009; 6 (7): e1000097. doi: 10.1371/journal.pmed.1000097 19621072
20. Ban JW, Emparanza JI, Urreta I, Burls A. Design characteristics influence performance of clinical prediction rules in validation: a meta-epidemiological study. PLoS One. 2016; 11 (1): e0145779. doi: 10.1371/journal.pone.0145779 26730980
21. Whiting PF, Rutjes AW, Westwood ME,; QUADAS-2 Group. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011; 155 (8): 529-536. doi: 10.7326/0003-4819-155-8-201110180-00009 22007046
22. Streiner DL. Diagnosing tests: using and misusing diagnostic and screening tests. J Pers Assess. 2003; 81 (3): 209-219. doi: 10.1207/S15327752JPA8103-03 14638445
23. Choi SB, Lee W, Yoon JH, Won JU, Kim DW. Ten-year prediction of suicide death using Cox regression and machine learning in a nationwide retrospective cohort study in South Korea. J Affect Disord. 2018; 231: 8-14. doi: 10.1016/j.jad.2018.01.019 29408160
24. Kessler RC, Hwang I, Hoffmire CA, Developing a practical suicide risk prediction model for targeting high-risk patients in the Veterans Health Administration. Int J Methods Psychiatr Res. 2017; 26 (3): e1575. doi: 10.1002/mpr.1575 28675617
25. McCarthy JF, Bossarte RM, Katz IR, Predictive modeling and concentration of the risk of suicide: implications for preventive interventions in the US Department of Veterans Affairs. Am J Public Health. 2015; 105 (9): 1935-1942. doi: 10.2105/AJPH.2015.302737
26. Simon GE, Johnson E, Lawrence JM, Predicting suicide attempts and suicide deaths following outpatient visits using electronic health records. Am J Psychiatry. 2018; 175 (10): 951-960. doi: 10.1176/appi.ajp.2018.17101167 29792051
27. Kessler RC, Warner CH, Ivany C,; Army STARRS Collaborators. Predicting suicides after psychiatric hospitalization in US Army soldiers: the Army Study To Assess Risk and rEsilience in Servicemembers (Army STARRS). JAMA Psychiatry. 2015; 72 (1): 49-57. doi: 10.1001/jamapsychiatry.2014.1754 25390793
28. Kessler RC, Stein MB, Petukhova MV,; Army STARRS Collaborators. Predicting suicides after outpatient mental health visits in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Mol Psychiatry. 2017; 22 (4): 544-551. doi: 10.1038/mp.2016.110 27431294
29. Amini P, Ahmadinia H, Poorolajal J, Moqaddasi Amiri M. Evaluating the high risk groups for suicide: a comparison of logistic regression, support vector machine, decision tree and artificial neural network. Iran J Public Health. 2016; 45 (9): 1179-1187. 27957463
30. Barak-Corren Y, Castro VM, Javitt S, Predicting suicidal behavior from longitudinal electronic health records. Am J Psychiatry. 2017; 174 (2): 154-162. doi: 10.1176/appi.ajp.2016.16010077 27609239
31. DelPozo-Banos M, John A, Petkov N, Using neural networks with routine health records to identify suicide risk: feasibility study. JMIR Ment Health. 2018; 5 (2): e10144. doi: 10.2196/10144 29934287
32. Karmakar C, Luo W, Tran T, Berk M, Venkatesh S. Predicting risk of suicide attempt using history of physical illnesses from electronic medical records. JMIR Ment Health. 2016; 3 (3): e19. doi: 10.2196/mental.5475 27400764
33. Nock MK, Millner AJ, Joiner TE, Risk factors for the transition from suicide ideation to suicide attempt: Results from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). J Abnorm Psychol. 2018; 127 (2): 139-149. doi: 10.1037/abn0000317 29528668
34. Tran T, Luo W, Phung D, Risk stratification using data from electronic medical records better predicts suicide risks than clinician assessments. BMC Psychiatry. 2014; 14: 76-84. doi: 10.1186/1471-244X-14-76 24628849
35. Walsh CG, Ribeiro JD, Franklin JC. Predicting risk of suicide attempts over time through machine learning. Clin Psychol Sci. 2017; 5 (3): 457-469. doi: 10.1177/2167702617691560
36. Galfalvy HC, Oquendo MA, Mann JJ. Evaluation of clinical prognostic models for suicide attempts after a major depressive episode. Acta Psychiatr Scand. 2008; 117 (4): 244-252. doi: 10.1111/j.1600-0447.2008.01162.x 18321353
37. Hartl TL, Rosen C, Drescher K, Lee TT, Gusman F. Predicting high-risk behaviors in veterans with posttraumatic stress disorder. J Nerv Ment Dis. 2005; 193 (7): 464-472. doi: 10.1097/01.nmd.0000168238.13252.b3 15985841
38. Ilgen MA, Downing K, Zivin K, Exploratory data mining analysis identifying subgroups of patients with depression who are at high risk for suicide. J Clin Psychiatry. 2009; 70 (11): 1495-1500. doi: 10.4088/JCP.08m04795 20031094
39. Motto JA, Bostrom AG. Models of suicide risk: nice persons. Crisis. 1990; 11 (2): 37-47. 2076616
40. Centers for Disease Control and Prevention. Welcome to WISQARS. http://www.cdc.gov/injury/wisqars. Accessed February 6, 2019.
41. Grimes DA, Schulz KF. Uses and abuses of screening tests. Lancet. 2002; 359 (9309): 881-884. doi: 10.1016/S0140-6736(02)07948-5 11897304
42. Mulder R, Newton-Howes G, Coid JW. The futility of risk prediction in psychiatry. Br J Psychiatry. 2016; 209 (4): 271-272. doi: 10.1192/bjp.bp.116.184960 27698212
43. Nelson HD, Denneson LM, Low AR, Suicide risk assessment and prevention: a systematic review focusing on veterans. Psychiatr Serv. 2017; 68 (10): 1003-1015. doi: 10.1176/appi.ps.201600384 28617209
44. Mustafa RA, Wiercioch W, Cheung A, Decision making about healthcare-related tests and diagnostic test strategies: paper 2: a review of methodological and practical challenges. J Clin Epidemiol. 2017; 92: 18-28. doi: 10.1016/j.jclinepi.2017.09.003 28916488
45. Joint Action Plan for Supporting Veterans During Their Transition From Uniformed Service to Civilian Life. Washington, DC: US Department of Veterans Affairs; 2018.
46. VA REACH VET initiative helps save veterans lives: program signals when more help is needed for at-risk veterans press release. Washington DC: US Department of Veterans Affairs; April 3, 2017.
47. Tucker RP, Tackett MJ, Glickman D, Reger MA. Ethical and practical considerations in the use of a predictive model to trigger suicide prevention interventions in healthcare settings published online January 18, 2018. Suicide Life Threat Behav. doi: 10.1111/sltb.12431