Predicting Risk of Suicide Attempts Over Time Through Machine Learning

Clinical Psychological Science

Volumn 5, Issue 3, 2017, Pages 457-469

  Walsh, Colin G ^a   Ribeiro, Jessica D ^b   Franklin, Joseph C ^b  

^a VANDERBILT UNIVERSITY MEDICAL CENTER   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

Author keywords

classification; prediction; prevention; suicide prevention

Indexed keywords

EID: 85019953955     PISSN: 21677026     EISSN: 21677034     Source Type: Journal    
DOI: 10.1177/2167702617691560     Document Type: Article

References (43)

1. Amalakuhan B., Kiljanek L., Parvathaneni A., Hester M., Cheriyath P., Fischman D., (2012). A prediction model for COPD readmissions: Catching up, catching our breath, and improving a national problem. Journal of Community Hospital Internal Medicine Perspectives, 2, 1–7.
2. Austin P. C., Lee D. S., Steyerberg E. W., Tu J. V., (2012). Regression trees for predicting mortality in patients with cardiovascular disease: What improvement is achieved by using ensemble-based methods? Biometrical Journal, 54, 657–673. http://doi.org/10.1002/bimj.201100251
3. Bentley K. H., Franklin J. C., Ribeiro J. D., Kleiman E. M., Fox K. R., Nock M. K., (2016). Anxiety and its disorders as risk factors for suicidal thoughts and behaviors: A meta-analytic review. Clinical Psychology Review, 43, 30–46. http://doi.org/10.1016/j.cpr.2015.11.008
4. Centers for Disease Control and Prevention. (2016). Injury prevention & control: Data & statistics (WISQARS). Retrieved from https://www.cdc.gov/injury/wisqars/
5. Cha C. B., Najmi S., Park J. M., Finn C. T., Nock M. K., (2010). Attentional bias toward suicide-related stimuli predicts suicidal behavior. Journal of Abnormal Psychology, 119, 616–622. http://doi.org/10.1037/a0019710
6. Chang B. P., Franklin J. C., Ribeiro J. D., Fox K. R., Bentley K. H., Kleiman E. M., Nock M. K., (2016). Biological risk factors for suicidal behaviors: A meta-analysis. Translational Psychiatry, 6, 887.
7. Deeks J. J., (2011). Analysing data and undertaking meta-analyses. In Cochrane handbook for systematic reviews of interventions (Version 5.1.0, updated March 2011). Retrieved from http://handbook.cochrane.org/chapter_9/9_analysing_data_and_undertaking_meta_analyses.htm
8. Delgado-Gomez D., Blasco-Fontecilla H., Sukno F., Socorro Ramos-Plasencia M., Baca-Garcia E., (2012). Suicide attempters classification: Toward predictive models of suicidal behavior. Neurocomputing, 92, 3–8. http://doi.org/10.1016/j.neucom.2011.08.033
9. Fox K. R., Franklin J. C., Ribeiro J. D., Kleiman E. M., Bentley K. H., Nock M. K., (2015). Meta-analysis of risk factors for nonsuicidal self-injury. Clinical Psychology Review, 42, 156–167. http://doi.org/10.1016/j.cpr.2015.09.002
10. Franklin J. C., Ribeiro J. D., Fox K. R., Bentley K. H., Kleiman E. M., Huang X... Nock M. K., (2017). Psychological Bulletin, 143, 187–232.
11. Futoma J., Morris J., Lucas J., (2015). A comparison of models for predicting early hospital readmissions. Journal of Biomedical Informatics, 56, 229–238. http://doi.org/10.1016/j.jbi.2015.05.016
12. Harrell F. E., Jr., (2006). Regression modeling strategies. New York, NY: Springer.
13. Harrell F. E., Jr. Slaughter J. C., (2001). Introduction to biostatistics for biomedical research. Retrieved from data.vanderbilt.edu/biosproj/CI2/handouts.pdf
14. Hastie T., Tibshirani R., Friedman J. H., (2001). The elements of statistical learning: Data mining, inference, and prediction. New York, NY: Springer.
15. Kessler R. C., Stein M. B., Petukhova M. V., Bliese P., Bossarte R. M., Bromet E. J.,.. Keilp J., (2016). Predicting suicides after outpatient mental health visits in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Molecular Psychiatry. Advance online publication. http://doi.org/10.1038/mp.2016.110
16. Kessler R. C., van Loo H. M., Wardenaar K. J., Bossarte R. M., Brenner L. A., Cai T.,.. Zaslavsky A. M., (2016). Testing a machine-learning algorithm to predict the persistence and severity of major depressive disorder from baseline self-reports. Molecular Psychiatry. Advance online publication. http://doi.org/10.1038/mp.2015.198
17. Kotsiantis S. B., (2007). Supervised machine learning: A review of classification techniques. Informatica, 31, 249–268.
18. Malley J. D., Kruppa J., Dasgupta A., Malley K. G., Ziegler A., (2011). Probability machines. Methods of Information in Medicine, 51, 74–81. http://doi.org/10.3414/ME00-01-0052
19. Mann J., Ellis S., Waternaux C., Liu X., (2008). Classification trees distinguish suicide attempters in major psychiatric disorders: A model of clinical decision making. Journal of Clinical Psychiatry, 69, 23–31.
20. Miao Y., Francisco S., Boscardin W. J., Francisco S., Francisco S., (2013). SAS Global Forum 2013: Statistics and data analysis. Estimating Harrell’s optimism on predictive indices using bootstrap samples. Retrieved from http://support.sas.com/resources/papers/proceedings13/504-2013.pdf.
21. Neeleman J., (2001). A continuum of premature death. Meta-analysis of competing mortality in the psychosocially vulnerable. International Journal of Epidemiology, 30, 154–162. http://doi.org/10.1093/ije/30.1.154
22. O’Connor R. C., (2011). Towards an integrated motivational–volitional model of suicidal behaviour. In O’Connor R. C., Platt S., Gordon J., (Eds.), International handbook of suicide prevention: Research, policy and practice (pp. 181–198). New York, NY: Wiley.
23. Pedregosa F., Varoquaux G., Gramfort A., Michel V., Thirion B., Grisel O... Duchesnay É., (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning and Research, 12, 2825–2830.
24. Perez F., Granger B. E., (2007). IPython: A system for interactive scientific computing. Computing in Science and Engineering, 9(3), 21–29. http://doi.org/10.1109/MCSE.2007.53
25. Pope G. C., Kautter J., Ellis R. P., Ash A. S., Ayanian J. Z., Lezzoni L. I.,.. Robst L., (2006). Risk adjustment of Medicare capitation payments using the CMS-HCC model. Health Care Finance Review, 25, 119–141.
26. R Development Core Team. (2012). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
27. Ribeiro J. D., Franklin J. C., Fox K. R., Bentley K. H., Kleiman E. M., Chang B. P., Nock M. K., (2016a). Self-injurious thoughts and behaviors as risk factors for future suicide ideation, attempts, and death: A meta-analysis of longitudinal studies. Psychological Medicine, 46, 225–236. http://doi.org/10.1017/S0033291715001804
28. Ribeiro J. D., Franklin J. C., Fox K. R., Bentley K. H., Kleiman E. M., Chang B. P., Nock M. K., (2016b). Suicide as a complex classification problem: Machine learning and related techniques can advance suicide prediction. Psychological Medicine, 46, 2009–2010.
29. Ribeiro J. D., Pease J. L., Gutierrez P. M., Silva C., Bernert R. A., Rudd M. D., Joiner T. E., (2012). Sleep problems outperform depression and hopelessness as cross-sectional and longitudinal predictors of suicidal ideation and behavior in young adults in the military. Journal of Affective Disorders, 136, 743–750. http://doi.org/10.1016/j.jad.2011.09.049
30. Robertson S., (2004). Understanding inverse document frequency: On theoretical arguments for IDF. Journal of Documentation, 60, 503–520. http://doi.org/10.1108/00220410410560582
31. Roden D., Pulley J., Basford M., Bernard G., Clayton E., Balser J., Masys D., (2008). Development of a large-scale de-identified DNA biobank to enable personalized medicine. Clinical Pharmacology & Therapeutics, 84, 362–369. http://doi.org/10.1038/clpt.2008.89
32. Rubin D. B., (2004). Multiple imputation for nonresponse in surveys (Vol. 81). New York, NY: John Wiley.
33. Rudd M. D., Berman A. L., Joiner T. E., Nock M. K., Silverman M. M., Mandrusiak M.,.. Witte T., (2006). Warning signs for suicide: Theory, research, and clinical applications. Suicide and Life-Threatening Behavior, 36, 255–262. http://doi.org/10.1521/suli.2006.36.3.255
34. Schwarz D. F., König I. R., Ziegler A., (2010). On safari to random Jungle: A fast implementation of random forests for high-dimensional data. Bioinformatics, 26, 1752–1758. http://doi.org/10.1093/bioinformatics/btq257
35. Shepard D. S., Gurewich D., Lwin A. K., Reed G. A., Silverman M. M., (2016). Suicide and suicidal attempts in the United States: Costs and policy implications. Suicide and Life-Threatening Behavior, 46, 352–362. http://doi.org/10.1111/sltb.12225
36. Singh G. K., (2003). Area deprivation and widening inequalities in US mortality, 1969–1998. American Journal of Public Health, 93, 1137–1143.
37. Smith G. C. S., Seaman S. R., Wood A. M., Royston P., White I. R., (2014). Correcting for optimistic prediction in small data sets. American Journal of Epidemiology, 180, 318–324. doi:10.1093/aje/kwu140.
38. Van Calster B., Vickers A., Pencina M., Baker S. G., Timmerman D., Steyerberg E., (2013). Evaluation of markers and risk prediction models: Overview of relationships between NRI and decision-analytic measures. Medical Decision Making, 33, 490–501. http://doi.org/10.1016/j.biotechadv.2011.08.021.Secreted
39. van der Walt S., Colbert S. C., Varoquaux G., (2011). The NumPy array: A structure for efficient numerical computation. Computing in Science and Engineering, 13(2), 22–30. http://doi.org/10.1109/MCSE.2011.37
40. Wenzel A., Beck A. T., (2008). A cognitive model of suicidal behavior: Theory and treatment. Applied and Preventive Psychology, 12, 189–201. http://doi.org/10.1016/j.appsy.2008.05.001
41. World Health Organization. (2016). Suicide data. Geneva, Switzerland: Author.
42. Wright M. N., Ziegler A., (2015). Ranger: A fast implementation of random forests for high dimensional data in C++ and R. Retrieved from https://arxiv.org/pdf/1508.04409.pdf
43. Xu H., Stenner S. P., Doan S., Johnson K. B., Waitman L. R., Denny J. C., (2010). MedEx: A medication information extraction system for clinical narratives. Journal of the American Medical Informatics Association, 17, 19–24. http://doi.org/10.1197/jamia.M3378