Predicting suicidal behaviours using clinical instruments: Systematic review and meta-analysis of positive predictive values for risk scales

British Journal of Psychiatry

Volumn 210, Issue 6, 2017, Pages 387-395

  Carter, Gregory ^a   Milner, Allison ^b,c   McGill, Katie ^a   Pirkis, Jane ^c   Kapur, Nav ^d   Spittal, Matthew J ^c  

^a UNIVERSITY OF NEWCASTLE   (Australia)

^b DEAKIN UNIVERSITY   (Australia)

^c UNIVERSITY OF MELBOURNE   (Australia)

^d UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMUTILATION; CLINICAL ASSESSMENT TOOL; DIAGNOSTIC ACCURACY; EFFECT SIZE; FOLLOW UP; HUMAN; MENTAL HEALTH; META ANALYSIS; PREDICTIVE VALUE; PUBLISHING; REVIEW; SENSITIVITY AND SPECIFICITY; SUICIDAL BEHAVIOR; SUICIDE; SYSTEMATIC REVIEW; PSYCHOLOGICAL RATING SCALE; PSYCHOLOGY; STATISTICS AND NUMERICAL DATA; SUICIDE ATTEMPT;

HUMANS; PREDICTIVE VALUE OF TESTS; PSYCHIATRIC STATUS RATING SCALES; SELF-INJURIOUS BEHAVIOR; SUICIDE; SUICIDE, ATTEMPTED;

EID: 85020074775     PISSN: 00071250     EISSN: 14721465     Source Type: Journal    
DOI: 10.1192/bjp.bp.116.182717     Document Type: Review

References (103)

1. Meehan J, Kapur N, Hunt IM, Turnbull P, Robinson J, Bickley H, et al. Suicide in mental health in-patients and within 3 months of discharge. Br J Psychiatry 2006; 188: 129-34.
2. Owens D, Horrocks J, House A. Fatal and non-fatal repetition of self-harm. Systematic review. Br J Psychiatry 2002; 181: 193-9.
3. Berman AL, Silverman MM. Suicide risk assessment and risk formulation. Part II: Suicide risk formulation and the determination of levels of risk. Suicide Life Threat Behav 2014; 44: 432-43.
4. Beck AT, Ward CH, Mendelson MM, Mock JJ, Erbaugh JJ. An inventory for measuring depression. Arch Gen Psychiatry 1961; 4: 561-71.
5. Patterson WM, Dohn HH, Bird J, Patterson GA. Evaluation of suicidal patients: The SAD PERSONS scale. Psychosomatics 1983; 24: 343-9.
6. Carroll BJ. The dexamethasone suppression test for melancholia. Br J Psychiatry 1982; 140: 292-304.
7. Carroll BJ, Greden JF, Feinberg M. Suicide, neuroendocrine dysfunction and CSF 5-HIAA concentrations in depression. Recent Advances in Neuropsychopharmacology (eds B Angrist, GD Burrows, M Lader, O Lingjaerde, G Sedvall, D Wheatley): 307-13. Pergamon, 1981.
8. Cooper J, Kapur N, Dunning J, Guthrie E, Appleby L, Mackway-Jones K. A clinical tool for assessing risk after self-harm. Ann Emerg Med 2006; 48: 459-66.
9. Spittal MJ, Pirkis J, Miller M, Carter G, Studdert DM. The Repeated Episodes of Self-Harm (RESH) score: a tool for predicting risk of future episodes of selfharm by hospital patients. J Affect Disord 2014; 161: 36-42.
10. Claassen CA, Harvilchuck-Laurenson JD, Fawcett J. Prognostic models to detect and monitor the near-term risk of suicide: state of the science. Am J Prevent Med 2014; 47 (suppl 2): S181-5.
11. Office of the Surgeon General and National Action Alliance for Suicide Prevention. 012 National Strategy for Suicide Prevention: Goals and Objectives for Action. Department of Health and Human Services (HHS), 2012.
12. Ryan CJ, Large MM. Suicide risk assessment: where are we now? Med J Australia 2013; 198: 462-3.
13. National Institute for Health and Care Excellence. NICE Guidelines Self-Harm: Longer-Term Management (CG 133). NICE, 2011.
14. Attia J. Moving beyond sensitivity and specificity: using likelihood ratios to help interpret diagnostic tests. Aust Prescr 2003; 26: 111-3.
15. Freedenthal S. Assessing the wish to die: a 30-year review of the Suicide Intent Scale. Arch Suicide Res 2008; 12: 277-98.
16. Warden S, Spiwak R, Sareen J, Bolton JM. The SAD PERSONS scale for suicide risk assessment: a systematic review. Arch Suicide Res 2014; 18: 313-26.
17. Quinlivan L, Cooper J, Davies L, Hawton K, Gunnell D, Kapur N. Which are the most useful scales for predicting repeat self-harm? A systematic review evaluating risk scales using measures of diagnostic accuracy. BMJ Open 2016; 6: e009297.
18. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 2009; 339; b2700.
19. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011; 155: 529-36.
20. Stijnen T, Hamza TH, Ozdemir P. Random effects meta-analysis of event outcome in the framework of the generalized linear mixed model with applications in sparse data. Stat Med 2010; 29: 3046-67.
21. Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Statist Softw 2010; 36: 1-48.
22. R Core Team. A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, 2015.
23. Beck AT, Steer RA, Kovacs M, Garrison B. Hopelessness and eventual suicide: a 10-year prospective study of patients hospitalized with suicidal ideation. Am J Psychiatry 1985; 142: 559-63.
24. Beck AT, Brown G, Steer RA. Prediction of eventual suicide in psychiatric inpatients by clinical ratings of hopelessness. J Consult Clin Psychol 1989; 57: 309-10.
25. Beck AT, Brown G, Berchick RJ, Stewart BL, Steer RA. Relationship between hopelessness and ultimate suicide: a replication with psychiatric outpatients. Am J Psychiatry 1990; 147: 190-5.
26. Beck AT, Brown GK, Steer RA, Dahlsgaard KK, Grisham JR. Suicide ideation at its worst point: a predictor of eventual suicide in psychiatric outpatients. Suicide Life Threat Behav 1999; 29: 1-9.
27. Bilen K, Ponzer S, Ottosson C, Castren M, Owe-Larsson B, Ekdahl K, et al. Can repetition of deliberate self-harm be predicted? A prospective multicenter study validating clinical decision rules. J Affect Disord 2013; 149: 253-8.
28. Bilen K, Ponzer S, Ottosson C, Castren M, Pettersson H. Deliberate self-harm patients in the emergency department: who will repeat and who will not? Validation and development of clinical decision rules. Emerg Med J 2013; 30: 650-6.
29. Bolton JM, Spiwak R, Sareen J. Predicting suicide attempts with the SAD PERSONS scale: a longitudinal analysis. J Clin Psychiatry 2012; 73: e735-41.
30. Brown GK, Beck AT, Steer RA, Grisham JR. Risk factors for suicide in psychiatric outpatients: a 20-year prospective study. J Consult Clin Psychology 2000; 68: 371-7.
31. Buglass D, McCulloch JW. Further suicidal behaviour: the development and validation of predictive scales. Br J Psychiatry 1970; 116: 483-91.
32. Buglass D, Horton J. A scale for predicting subsequent suicidal behaviour. Br J Psychiatry 1974; 124: 573-8.
33. Carter GL, Clover KA, Bryant JL, Whyte IM. Can the Edinburgh Risk of Repetition Scale predict repetition of deliberate self-poisoning in an Australian clinical setting? Suicide Life-Threat Behav 2002; 32: 230-9.
34. Cohen E, Motto JA, Seiden RH. An instrument for evaluating suicide potential: a preliminary study. Am J Psychiatry 1966; 122: 886-91.
35. Colman I, Newman SC, Schopflocher D, Bland RC, Dyck RJ. A multivariate study of predictors of repeat parasuicide. Acta Psychiatr Scand 2004; 109: 306-12.
36. Corcoran P, Kelleher MJ, Kelley HS, Byrne S, Burke U, Williamson E. A preliminary statistical model for identifying repeaters of parasuicide. Arch Suicide Res 1997; 3: 65-74.
37. Erdman HP, Greist JH, Gustafson DH, Taves JE, Klein MH. Suicide risk prediction by computer interview: a prospective study. J Clin Psychiatry 1987; 48: 464-7.
38. Garzotto N, Siani R, Tansella CZ, Tansella M. Cross-validation of a predictive scale for subsequent suicidal behaviour in an Italian sample. Br J Psychiatry 1976; 128: 137-40.
39. Harriss L, Hawton K, Zahl D. Value of measuring suicidal intent in the assessment of people attending hospital following self-poisoning or selfinjury. Br J Psychiatry 2005; 186: 60-6.
40. Hartl TL, Rosen C, Drescher K, Lee TT, Gusman F. Predicting high-risk behaviors in veterans with posttraumatic stress disorder. J Nerv Ment Dis 2005; 193: 464-72.
41. Hawton K, Fagg J. Repetition of attempted suicide: the performance of the Edinburgh predictive scales in patients in Oxford. Arch Suicide Res 1995; 1: 261-72.
42. Hendin H, Al Jurdi RK, Houck PR, Hughes S, Turner JB. Role of intense affects in predicting short-term risk for suicidal behavior: a prospective study. J Nerv Ment Dis 2010; 198: 220-5.
43. Huth-Bocks AC, Kerr DCR, Ivey AZ, Kramer AC, King CA. Assessment of psychiatrically hospitalized suicidal adolescents: self-report instruments as predictors of suicidal thoughts and behavior. J Am Acad Child Adolesc Psychiatry 2007; 46: 387-95.
44. Klonsky ED, Kotov R, Bakst S, Rabinowitz J, Bromet EJ. Hopelessness as a predictor of attempted suicide among first admission patients with psychosis: a 10-year cohort study. Suicide Life Threat Behav 2012; 42: 1-10.
45. Kreitman N, Foster J. The construction and selection of predictive scales, with special reference to parasuicide. Br J Psychiatry 1991; 159: 185-92.
46. Kurz A, Möller HJ, Torhorst A, Lauter H. Validation of six risk scales for suicide attempters. In Current Issues of Suicidology (eds HJ Möller, A Schmidtke, R Welz): 174-8. Springer, 1988.
47. Larzelere RE, Smith GL, Batenhorst LM, Kelly DB. Predictive validity of the Suicide Probability Scale among adolescents in group home treatment. J Am Acad Child Adolesc Psychiatry 1996; 35: 166-72.
48. Motto JA, Heilbron DC. Development and validation of scales for estimation of suicide risk. In Suicidology: Contemporary Developments (ed. ES Schneidman): 169-99. Grune & Stratton, 1976.
49. Motto JA, Heilbron DC, Juster RP. Development of a clinical instrument to estimate suicide risk. Am J Psychiatry 1985; 142: 680-6.
50. Myers ED. Predicting repetition of deliberate self-harm: a review of the literature in the light of a current study. Acta Psychiatr Scand 1988; 77: 314-9.
51. Naud H, Daigle MS. Predictive validity of the Suicide Probability Scale in a male inmate population. J Psychopathol Behav Assess 2010; 32: 333-42.
52. Nimeus A, Traskman-Bendz L, Alsen M. Hopelessness and suicidal behavior. J Affect Disord 1997; 42: 137-44.
53. Nimeus A, Alsen M, Traskman-Bendz L. The Suicide Assessment Scale: an instrument assessing suicide risk of suicide attempters. Eur Psychiatry 2000; 15: 416-23.
54. Nimeus A, Alsen M, Traskman-Bendz L. High suicidal intent scores indicate future suicide. Arch Suicide Res 2002; 6: 211-9.
55. Nock MK, Park JM, Finn CT, Deliberto TL, Dour HJ, Banaji MR. Measuring the suicidal mind: implicit cognition predicts suicidal behavior. Psychol Sci 2010; 21: 511-7.
56. Ojehagen A, Danielsson M, Traskman-Bendz L. Deliberate self-poisoning: treatment follow-up of repeaters and nonrepeaters. Acta Psychiatr Scand 1992; 85: 370-5.
57. Pallis DJ, Gibbons JS, Pierce DW. Estimating suicide risk among attempted suicides: II. Efficiency of predictive scales after the attempt. Br J Psychiatry 1984; 144: 139-48.
58. Perry AE, Gilbody S. Detecting and predicting self-harm behaviour in prisoners: a prospective psychometric analysis of three instruments. Soc Psychiatry Psychiatr Epidemiol 2009; 44: 853-61.
59. Petrie K, Chamberlain K, Clarke D. Psychological predictors of future suicidal behaviour in hospitalized suicide attempters. Br J Clin Psychol 1988; 27: 247-57.
60. Pokorny AD. Prediction of suicide in psychiatric patients: report of a prospective study. Arch Gen Psychiatry 1983; 40: 249-57.
61. Randall JR, Rowe BH, Colman I. Emergency department assessment of selfharm risk using psychometric questionaires. Can J Psychiatry 2012; 57: 21-8.
62. Randall JR, Rowe BH, Dong KA, Nock MK, Colman I. Assessment of self-harm risk using implicit thoughts. Psychol Assess 2013; 25: 714-21.
63. Roaldset JO, Linaker OM, Bjorkly S. Predictive validity of the MINI Suicidal Scale for self-harm in acute psychiatry: a prospective study of the first year after discharge. Arch Suicide Res 2012; 6: 287-302.
64. Sanchez-Gistau V, Baeza I, Arango C, Gonzalez-Pinto A, de la Serna E, Parellada M, et al. Predictors of suicide attempt in early-onset, first-episode psychoses: a longitudinal 24-month follow-up study. J Clin Psychiatry 2013; 74: 61-8.
65. Sapyta J, Goldston DB, Erkanli A, Daniel SS, Heilbron N, Mayfield, A et al. Evaluating the predictive validity of suicidal intent and medical lethality in youth. J Consult Clin Psychology 2012; 80: 222-31.
66. Saunders K, Brand F, Lascelles K, Hawton K. The sad truth about the SADPERSONS Scale: an evaluation of its clinical utility in self-harm patients. Emerg Med J 2013; 31: 796-8.
67. Siani R, Garzotto N, Zimmermann Tansella C, Tansella M. Predictive scales for parasuicide repetition: further results. Acta Psychiatr Scand 1979; 59: 17-23.
68. Sidley GL, Calam R, Wells A, Hughes T, Whitaker K. The prediction of parasuicide repetition in a high-risk group. Br J Clin Psychol 1999; 38: 375-86.
69. Steeg S, Kapur N, Webb R, Applegate E, Stewart SLK, Hawton K, et al. The development of a population-level clinical screening tool for self-harm repetition and suicide: the ReACT Self-Harm Rule. Psychol Med 2012; 42: 2383-94.
70. Waern M, Sjostrom N, Marlow T, Hetta J. Does the Suicide Assessment Scale predict risk of repetition? A prospective study of suicide attempters at a hospital emergency department. Eur Psychiatry 2010; 25: 421-6.
71. Yaseen ZS, Kopeykina I, Gutkovich Z, Bassirnia A, Cohen LJ, Galynker II. Predictive validity of the Suicide Trigger Scale (STS-3) for post-discharge suicide attempt in high-risk psychiatric inpatients. PLoS One 2014; 9: e86768.
72. Yen S, Shea MT, Walsh Z, Edelen MO, Hopwood CJ, Markowitz JC, et al. Self-harm subscale of the Schedule for Nonadaptive and Adaptive Personality (SNAP): predicting suicide attempts over 8 years of follow-up. J Clin Psychiatry 2011; 72: 1522-8.
73. Asberg M, Traskman L, Thoren P. 5-HIAA in the cerebrospinal fluid: a biochemical suicide predictor? Arch Gen Psychiatry 1976; 33: 1193-7.
74. Asberg M, Nordstrom P, Traskman-Bendz L. Biological factors in suicide. In Suicide (ed. A Roy): 47-71. Williams and Wilkins, 1986.
75. Black DW, Monahan PO, Winokur G. The relationship between DST results and suicidal behavior. Ann Clin Psychiatry 2002; 14: 83-8.
76. Boza RA, Milanes FJ, Llorente M, Reisch J, Slater VL, Garrigo L. The DST and suicide among depressed alcoholic patients. Am J Psychiatry 1988; 145: 266-7.
77. Coryell W, Young E, Carroll B. Hyperactivity of the hypothalamic-pituitaryadrenal axis and mortality in major depressive disorder. Psychiatry Res 2006; 142: 99-104.
78. De Leo D, Pellegrini C, Serraiotto L, Magni G, De Toni R. Assessment of severity of suicide attempts: a trial with the dexamethasone suppression test and 2 rating scales. Psychopathol 1986; 19: 186-91.
79. Edman G, Asberg M, Levander S, Schalling D. Skin conductance habituation and cerebrospinal fluid 5-hydroxyindoleacetic acid in suicidal patients. Arch Gen Psychiatry 1986; 43: 586-92.
80. Galfalvy H, Huang YY, Oquendo MA, Currier D, Mann JJ. Increased risk of suicide attempt in mood disorders and TPH1 genotype. J Affect Disord 2009; 115: 331-8.
81. Jokinen J, Carlborg A, Martensson B, Forslund K, Nordstrom AL, Nordstrom P. DST non-suppression predicts suicide after attempted suicide. Psychiatry Res 2007; 150: 297-303.
82. Jokinen J, Nordstrom AL, Nordstrom P. CSF 5-HIAA and DST non-suppression - orthogonal biologic risk factors for suicide in male mood disorder inpatients. Psychiatry Res 2009; 165: 96-102.
83. Nordstrom P, Samuelsson M, Asberg M, Traskman-Bendz L, Aberg-Wistedt A, Nordin C, et al. CSF 5-HIAA predicts suicide risk after attempted suicide. Suicide Life Threat Behav 1994; 24: 1-9.
84. Plocka-Lewandowska M, Araszkiewicz A, Rybakowski JK. Dexamethasone suppression test and suicide attempts in schizophrenic patients. Eur Psychiatry 2001; 16: 428-31.
85. Roy A, Agren H, Pickar D, Linnoila M, Doran AR, Cutler NR, et al. Reduced CSF concentrations of homovanillic acid and homovanillic acid to 5-hydroxyindoleacetic acid ratios in depressed patients: relationship to suicidal behavior and dexamethasone nonsuppression. Am J Psychiatry 1986; 143: 1539-45.
86. Roy A, de Jong J, Linnoila M. Cerebrospinal fluid monoamine metabolites and suicidal behavior in depressed patients: a 5-year follow-up study. Arch Gen Psychiatry 1989; 46: 609-12.
87. Targum SD, Rosen L, Capodanno AE. The dexamethasone suppression test in suicidal patients with unipolar depression. Am J Psychiatry 1983; 140: 877-9.
88. Yerevanian BI, Feusner JD, Koek RJ, Mintz J. The dexamethasone suppression test as a predictor of suicidal behavior in unipolar depression. J Affect Dis 2004; 83: 103-8.
89. Samuelsson M, Jokinen J, Nordstrom A-L, Nordstrom P. CSF 5-HIAA, suicide intent and hopelessness in the prediction of early suicide in male high-risk suicide attempters. Acta Psychiatr Scand 2006; 113: 44-7.
90. Lau J, Ioannidis JPA, Terrin N, Schmid CH, Olkin I. The case of the misleading funnel plot. BMJ 2006; 333: 597-600.
91. Rosen A. Detection of suicidal patients: an example of some limitations in the prediction of infrequent events. J Consult Psychology 1954; 18: 397-403.
92. Carroll R, Metcalfe C, Gunnell D. Hospital presenting self-harm and risk of fatal and non-fatal repetition: systematic review and meta-analysis. PLoS One 2014; 9: e89944.
93. Mitchell AJ. Sensitivity x PPV is a recognized test called the clinical utility index (CUI+). Eur J Epidemiol 2011; 26: 251-2.
94. Guthrie E, Kapur N, Mackway-Jones K, Chew-Graham C, Moorey J, Mendel E, et al. Randomised controlled trial of brief psychological intervention after deliberate self poisoning. BMJ 2001; 323: 135-7.
95. Gunnell D, Hawton K, Ho D, Evans J, O'Connor S, Potokar J, et al. Hospital admissions for self harm after discharge from psychiatric inpatient care: cohort study. BMJ 2008; 337: a2278.
96. Hetrick SE, Robinson J, Spittal MJ, Carter G. Effective psychological and psychosocial approaches to reduce repetition of self-harm: a systematic review, meta-analysis and meta-regression. BMJ Open 2016; 6: e011024.
97. Goldacre M, Seagroatt V, Hawton K. Suicide after discharge from psychiatric inpatient care. Lancet 1993; 342: 283-6.
98. Goodwin FK, Jamison KR. Manic-Depressive Illness. Oxford University Press, 1990.
99. National Health and Medical Research Council. Clinical Practice Guideline for the Management of Borderline Personality Disorder. National Health and Medical Research Council, 2012.
100. Hawton K, Witt KG, Taylor Salisbury TL, Arensman E, Gunnell D, Hazell P, et al. Psychosocial interventions for self-harm in adults. Cochrane Database Syst Rev 2016; 5: CD012189.
101. Milner AJ, Carter G, Pirkis J, Robinson J, Spittal MJ. Letters, green cards, telephone calls and postcards: systematic and meta-analytic review of brief contact interventions for reducing self-harm, suicide attempts and suicide. Br J Psychiatry 2015; 206: 184-90.
102. Macaskill P, Gatsonis C, Deek JJ, Harbord RM, Takwoingi Y. Analysing and presenting results. In Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 1.0 (eds JJ Deeks, PM Bossuyt, C Gatsonis): 4-59. Cochrane Collaboration, 2010.
103. Bossuyt P, Davenport C, Deeks J, Hyde C, Leeflang M, Scholten R. Interpreting results and drawing conclusions. In Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 0.9 (eds JJ Deeks, PM Bossuyt, C Gatsonis): 3-31. Cochrane Collaboration, 2013.