Predicting suicide attempts and suicide deaths following outpatient visits using electronic health records

American Journal of Psychiatry

Volumn 175, Issue 10, 2018, Pages 951-960

  Simon, Gregory E ^a,b,c,d,e   Johnson, Eric ^a,b,c,d,e   Lawrence, Jean M ^a,b,c,d,e   Rossom, Rebecca C ^a,b,c,d,e   Ahmedani, Brian ^a,b,c,d,e   Lynch, Frances L ^a,b,c,d,e   Beck, Arne ^a,b,c,d,e   Waitzfelder, Beth ^a,b,c,d,e   Ziebell, Rebecca ^a,b,c,d,e   Penfold, Robert B ^a,b,c,d,e   Shortreed, Susan M ^a,b,c,d,e  

^a KAISER PERMANENTE   (United States)

^b HealthPart ners Institute   (United States)

^c DENVER HEALTH AND HOSPITAL AUTHORITY   (United States)

^d CENTER FOR HEALTH RESEARCH   (United States)

^e Center for Health Research   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ADULT; AGED; ELECTRONIC HEALTH RECORD; FEMALE; HUMAN; MALE; MIDDLE AGED; OUTPATIENT; PSYCHOLOGICAL MODEL; PSYCHOLOGY; QUESTIONNAIRE; RISK FACTOR; SUICIDE ATTEMPT; VALIDATION STUDY; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; ELECTRONIC HEALTH RECORDS; FEMALE; HUMANS; MALE; MIDDLE AGED; MODELS, PSYCHOLOGICAL; OUTPATIENTS; RISK FACTORS; SUICIDE, ATTEMPTED; SURVEYS AND QUESTIONNAIRES; YOUNG ADULT;

EID: 85052966067     PISSN: 0002953X     EISSN: 15357228     Source Type: Journal    
DOI: 10.1176/appi.ajp.2018.17101167     Document Type: Article

References (49)

1. Kochanek KD, Murphy SL, Xu JQ, et al: NCHS Data Brief: Mortality in the United States, 2016. Hyattsville, Md, National Center for Health Statistics, 2017
2. Centers for Disease Control and Prevention: Web-Based Injury Statistics Query and Reporting System (WISQARS), Nonfatal Injury Reports, 2000-2014. https://webappa.cdc.gov/sasweb/ncipc/nfirates.html
3. Ahmedani BK, Simon GE, Stewart C, et al: Health care contacts in the year before suicide death. J Gen Intern Med 2014; 29: 870-877
4. Ahmedani BK, Stewart C, Simon GE, et al: Racial/ethnic differences in health care visits made before suicide attempt across the United States. Med Care 2015; 53:430-435
5. Patient Safety Advisory Group: Detecting and treating suicidal ideation in all settings. Chicago, Joint Commission Sentinel Event Alerts, 2016, issue 56 (https://www.jointcommission.org/assets/1/18/SEA-56-Suicide.pdf )
6. Franklin JC, Ribeiro JD, Fox KR, et al: Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychol Bull 2017; 143:187-232
7. Simon GE, Coleman KJ, Rossom RC, et al: Risk of suicide attempt and suicide death following completion of the Patient Health Questionnaire depression module in community practice. J Clin Psychiatry 2016; 77:221-227
8. McCarthy JF, Bossarte RM, Katz IR, et al: Predictive modeling and concentration of the risk of suicide: Implications for preventive interventions in the US Department of Veterans Affairs.AmJ Public Health 2015; 105:1935-1942
9. Kessler RC, Warner CH, Ivany C, et al: Predicting suicides after psychiatric hospitalization in US Army soldiers: The Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). JAMA Psychiatry 2015; 72:49-57
10. Walsh CG, Ribeiro JD, Franklin JC: Predicting risk of suicide attempts over time through machine learning. Clin Psychol Sci 2017; 5: 457-469
11. McCoy TH Jr, Castro VM, Roberson AM, et al: Improving prediction of suicide and accidental death after discharge from general hospitals with natural language processing. JAMA Psychiatry 2016; 73:1064-1071
12. Kessler RC, Stein MB, Petukhova MV, et al: Predicting suicides after outpatient mental health visits in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Mol Psychiatry 2017; 22:544-551
13. Barak-Corren Y, Castro VM, Javitt S, et al: Predicting suicidal behavior from longitudinal electronic health records. Am J Psychiatry 2017; 174:154-162
14. Ross TR, Ng D, Brown JS, et al: The HMO Research Network Virtual Data Warehouse: A public data model to support collaboration. EGEMS (Wash DC) 2014; 2:1049
15. Charlson M, Szatrowski TP, Peterson J, et al: Validation of a combined comorbidity index. J Clin Epidemiol 1994; 47:1245-1251
16. Kroenke K, Spitzer RL, Williams JB, et al: The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: A systematic review. Gen Hosp Psychiatry 2010; 32:345-359
17. Lu CY, Stewart C, Ahmed AT, et al: How complete are E-codes in commercial plan claims databases? Pharmacoepidemiol Drug Saf 2014; 23:218-220
18. Stewart C, Crawford PM, Simon GE: Changes in coding of suicide attempts or self-harm with transition from ICD-9 to ICD-10. Psychiatr Serv 2017; 68:215
19. Bakst SS, Braun T, Zucker I, et al: The accuracy of suicide statistics: Are true suicide deaths misclassified? Soc Psychiatry Psychiatr Epidemiol 2016; 51:115-123
20. Cox KL, Nock MK, Biggs QM, et al: An examination of potential misclassification of army suicides: Results from the Army Study to Assess Risk and Resilience in Servicemembers. Suicide Life Threat Behav 2017; 47:257-265
21. Tibshirani R: Regression shrinkage and selection via the lasso. J R Stat Soc B 1996; 58:267-288
22. Hastie T, Tibshirani R, Friedman J: The Elements of Statistical Learning, 2nd ed. New York, Springer, 2009
23. Kass RE, Raftery AE: Bayes factors. JAmStat Assoc 1995; 90:773-795
24. Egan JP: Signal Detection Theory and ROC Analysis. New York, Springer Academic Press, 1975
25. Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29-36
26. Bradley AP: The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit 1997; 30: 1145-1159
27. Friedman J, Hastie T, Tibshirani R: Regularization paths for generalized linearmodels via coordinate descent. J Stat Softw2010; 33:1-22
28. Weston S: Foreach looping construct for R, R Package, version 1.4.3, 2015
29. Han B, Compton WM, Gfroerer J, et al: Mental health treatment patterns among adults with recent suicide attempts in the United States. Am J Public Health 2014; 104:2359-2368
30. Simon GE, Shortreed SM, Johnson E, et al: Between-visit changes in suicidal ideation and risk of subsequent suicide attempt. Depress Anxiety 2017; 34:794-800
31. Olfson M, Marcus SC, Bridge JA: Focusing suicide prevention on periods of high risk. JAMA 2014; 311:1107-1108
32. Brown GK, Ten Have T, Henriques GR, et al: Cognitive therapy for the prevention of suicide attempts: A randomized controlled trial. JAMA 2005; 294:563-570
33. Comtois KA, Linehan MM: Psychosocial treatments of suicidal behaviors: A practice-friendly review. J Clin Psychol 2006; 62: 161-170
34. Dreiseitl S, Ohno-Machado L: Logistic regression and artificial neural network classification models: Amethodology review. J Biomed Inform 2002; 35:352-359
35. Kessler RC, Hwang I, Hoffmire CA, et al: Developing a practical suicide risk prediction model for targeting high-risk patients in the VeteransHealthAdministration. IntJMethodsPsychiatrRes 2017;26:26
36. Adkins DE: Machine learning and electronic health records: A paradigm shift. Am J Psychiatry 2017; 174:93-94
37. HEDIS Depression Measures Specified for Electronic Clinical Data Systems. http://www.ncqa.org/HEDISQualityMeasurement/HEDISLearningCollaborative/HEDISDepressionMeasures.aspx
38. Frizzell JD, Liang L, Schulte PJ, et al: Prediction of 30-day all-cause readmissions inpatients hospitalizedfor heart failure: Comparison of machine learning and other statistical approaches. JAMA Cardiol 2017; 2:204-209
39. Taylor RA, Pare JR, Venkatesh AK, et al: Prediction of in-hospital mortality in emergency department patients with sepsis: A local big data-driven, machine learning approach. Acad Emerg Med 2016; 23: 269-278
40. Frost DW, Vembu S, Wang J, et al: Using the electronic medical record to identify patients at high risk for frequent emergency department visits and high system costs. Am J Med 2017; 130:601. e17-601.e22
41. Lip GY: Canwepredict stroke in atrial fibrillation? Clin Cardiol 2012; 35(suppl 1):21-27
42. Rana JS, Tabada GH, Solomon MD, et al: Accuracy of the atherosclerotic cardiovascular risk equation in a large contemporary, multiethnic population. J Am Coll Cardiol 2016; 67:2118-2130
43. Cabitza F, Rasoini R, Gensini GF: Unintended consequences of machine learning in medicine. JAMA 2017; 318:517-518
44. Chen JH, Asch SM: Machine learning and prediction in medicine: Beyond the peak of inflated expectations. N Engl J Med 2017; 376: 2507-2509
45. Obermeyer Z, Emanuel EJ: Predicting the future: Big data, machine learning, and clinical medicine. N Engl J Med 2016; 375:1216-1219
46. Posner K, BrownGK, Stanley B, et al: The Columbia-Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults.AmJ Psychiatry 2011; 168:1266-1277
47. Rossom RC, Simon GE, Beck A, et al: Facilitating action for suicide prevention by learning health care systems. Psychiatr Serv 2016; 67: 830-832
48. Hogan MF, Grumet JG: Suicide prevention: An emerging priority for health care. Health Aff (Millwood) 2016; 35:1084-1090
49. Miller IW, Camargo CA, Jr., Arias SA, et al. Suicide prevention in an emergency department population: The ED-SAFE study. JAMA Psychiatry 2017; 74:563-570