A comparative study of violence risk assessment tools: A systematic review and metaregression analysis of 68 studies involving 25,980 participants

Clinical Psychology Review

Volumn 31, Issue 3, 2011, Pages 499-513

  Singh, Jay P ^a   Grann, Martin ^b   Fazel, Seena ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b KAROLINSKA INSTITUTE   (Sweden)

Author keywords

Area under curve; Crime; Forensic; Meta analysis; Risk assessment; Violence

Indexed keywords

AGE; CHECKLIST; CLINICAL ASSESSMENT TOOL; COMPARATIVE STUDY; CRIMINAL JUSTICE; FOLLOW UP; HUMAN; INFORMATION PROCESSING; JUVENILE; MENTAL HEALTH SERVICE; META ANALYSIS; MULTIVARIATE ANALYSIS; PRACTICE GUIDELINE; PREDICTIVE VALIDITY; PREDICTIVE VALUE; PSYCHOPATHY; QUALITY CONTROL; REGRESSION ANALYSIS; REVIEW; RISK; RISK ASSESSMENT; SCREENING; SEX DIFFERENCE; STUDY DESIGN; SYSTEMATIC REVIEW; VIOLENCE;

CRIME; HUMANS; REGRESSION ANALYSIS; RISK ASSESSMENT; VIOLENCE;

EID: 79952250542     PISSN: 02727358     EISSN: 18737811     Source Type: Journal    
DOI: 10.1016/j.cpr.2010.11.009     Document Type: Review

References (99)

1. ÆgisdÓttir S., White M.J., Spengler P.M., Maugherman A.S., Anderson L.A., Cook R.S., et al. The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. Counseling Psychologist 2006, 34:341-382.
2. American Psychiatric Association Practice guideline for the treatment of patients with schizophrenia 2004, American Psychiatric Association, Arlington, VA.
3. Andrews D.A., Bonta J. LSI-R: The Level of Service Inventory-Revised 1995, Multi-Health Systems, Toronto, ON.
4. Bauer A., Rosca P., Khawalled R., Gruzniewski A., Grinshpoon A. Dangerousness and risk assessment: The state of the art. Israel Journal of Psychiatry and Related Sciences 2003, 40:182-190.
5. Bhui H.S. Race, racism and risk assessment: Linking theory to practice with Black mentally disordered offenders. Probation Journal 1999, 46:171-181.
6. BjØrkly S. Prediction of aggression in psychiatric patients: A review of prospective prediction studies. Clinical Psychology Review 1995, 15:475-502.
7. Blair P.R., Marcus D.K., Boccaccini M.T. Is there an allegiance effect for assessment instruments? Actuarial risk assessment as an exemplar. Clinical Psychology 2008, 15:346-360.
8. Boer D.P., Hart S.D., Kropp P.R., Webster C.D. Manual for the Sexual Violence Risk-20. Professional guidelines for assessing risk of sexual violence 1997, Simon Fraser University, Mental Health, Law, and Policy Institute, Burnaby, BC.
9. Bonta J. Offender risk assessment: Guidelines for selection and use. Criminal Justice and Behavior 2002, 29:355-379.
10. Borum R., Bartel P., Forth A. Manual for the structured assessment of violence risk in youth (SAVRY) 2002, University of South Florida, Tampa.
11. Borum R., Bartel P., Forth A. Manual for the structured assessment of violence risk in youth (SAVRY): Version 1.1 2003, University of South Florida, Tampa.
12. Bossuyt P.M., Reitsma J.B., Bruns D.E., Gatsonis C.A., Glaziou P.P., Irwig L.M., et al. Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative. British Medical Journal 2003, 326:41-44.
13. Caldwell R.A., Bogat G.A., Davidson W.S. The assessment of child abuse potential and the prevention of child abuse and neglect: A policy analysis. American Journal of Community Psychology 1988, 16:609-624.
14. Campbell M., French S., Gendreau P. Assessing the utility of risk assessment tools and personality measures in the prediction of violent recidivism for adult offenders (Cat. No. PS3-1/2007-4E-PDF) 2007, Department of Safety and Emergency Preparedness, Ottawa, ON.
15. Cleckley H. The mask of sanity 1941, C.V. Mosby, St. Louis.
16. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960, 20:37-46.
17. Cohen J. Statistical power analysis for the behavioral sciences 1988, 281-285. Erlbaum, Hillsdale, NJ. 2nd ed.
18. Cottle C.C., Lee R.J., Heilbrun K. The prediction of criminal recidivism in juveniles: A meta-analysis. Criminal Justice and Behavior 2001, 28:367-394.
19. Daniels, B. A. (2005). Sex offender risk assessment: Evaluation and innovation. Unpublished doctoral dissertation, Widener University, Chester, PA.
20. de Vogel V., de Ruiter C., Hildebrand M., Bos B., van de Ven P. Type of discharge and risk of recidivism measured by the HCR-20: A retrospective study in a Dutch sample of treated forensic psychiatric patients. International Journal of Forensic Mental Health 2004, 3:149-165.
21. Deeks J.J. Systematic reviews of evaluation of diagnostic and screening tests. Systematic reviews in health care: Meta-analysis in context 2001, BMJ Publishing Groups, London. M. Egger, G.D. Smith, D.G. Altman (Eds.).
22. DeMatteo D., Edens J.F. The role and relevance of the Psychopathy Checklist - Revised in court: A case law survey of U.S. courts (1991-2004). Psychology, Public Policy, and Law 2006, 12:214-241.
23. Dernevick M., Beck A., Grann M., Hogue T., McGuire J. The use of psychiatric and psychological evidence in the assessment of terrorist offenders. Journal of Forensic Psychiatry and Psychology 2010, 20:508-515.
24. Deville W.L., Buntinx F., Bouter L.M., Montori V.M., de Vet H.C.W., van der Windt D.A.W.N., et al. Conducting systematic reviews of diagnostic studies: Didactic guidelines. BMC Medical Research Methodology 2002, 2:1-13.
25. Doren D.M. Evaluating sex offenders: A manual for civil commitments and beyond 2002, Sage, Thousand Oaks, CA.
26. Douglas K.S., Cox D.N., Webster C.D. Violence risk assessment: Science and practice. Legal and Criminological Psychology 1999, 4:149-184.
27. Douglas K.S., Webster C.D. The HCR-20 violence risk assessment scheme: Concurrent validity in a sample of incarcerated offenders. Criminal Justice and Behavior 1999, 26:3-19.
28. Edens J.F. Misuses of the Hare Psychopathy Checklist - Revised in court. Journal of Interpersonal Violence 2001, 16:1082-1093.
29. Edens J., Campbell J. Identifying youths at risk for institutional misconduct: A meta-analytic investigation of the Psychopathy Checklist measures. Psychological Services 2007, 4:13-27.
30. Edens J., Campbell J.S., Weir J.M. Youth psychopathy and criminal recidivism: A meta-analysis of the Psychopathy Checklist measures. Law and Human Behavior 2007, 31:53-75.
31. Edens J., Skeem J., Cruise K., Cauffman E. The assessment of juvenile psychopathy and its association with violence: A critical review. Behavioral Sciences and the Law 2001, 19:53-80.
32. Editorial Should protocols for observational research be registered?. Lancet 2010, 375:348.
33. Fazel S., Sjöstedt G., LÅngström N., Grann M. Risk factors for criminal recidivism in older sexual offenders. Sexual Abuse: A Journal of Research and Treatment 2006, 18:159-167.
34. Federal Bureau of Investigation Uniform crime reports for the United States 2002, US Government Printing Office, Washington, DC.
35. Fujii D., Tokioka A., Lichton A., Hishinuma E. Ethnic differences in violence risk prediction of psychiatric inpatients using the Historical Clinical Risk Management - 20. Psychiatric Services 2005, 56:711-716.
36. Gendreau P., Goggin C., Little T. Predicting adult offender recidivism: What works! (Cat. No. JS4-1/1996-7E) 1996, Public Works and Government Services Canada, Ottawa, ON.
37. Gendreau P., Goggin C., Smith P. Cumulating knowledge: How meta-analysis can serve the needs of correctional clinicians and policy-makers 2000, Correctional Service of Canada, Ottawa, ON.
38. Gendreau P., Goggin C., Smith P. Is the PCL-R really the " unparalleled" measure of offender risk?: A lesson in knowledge cumulation. Criminal Justice and Behavior 2002, 29:397-426.
39. Glas A.S., Lijmer J.G., Prins M.H., Bonsel G.J., Bossuyt P.M.M. The diagnostic odds ratio: A single indicator of test performance. Journal of Clinical Epidemiology 2003, 56:1129-1135.
40. Guy, L. (2008). Performance indicators of the structured professional judgment approach for assessing risk for violence to others: A meta-analytic survey. Unpublished doctoral dissertation, Simon Fraser University, Burnaby, BC.
41. Guy L., Edens J.F., Anthony C., Douglas K.S. Does psychopathy predict institutional misconduct among adults? A meta-analytic investigation. Journal of Consulting and Clinical Psychology 2005, 73:1056-1064.
42. Hanson R.K. What do we know about sex offender risk assessment?. Psychology, Public Policy, and Law 1998, 4:50-72.
43. Hanson R.K., Morton-Bourgon K. Predictors of sexual recidivism: An updated meta-analysis (Cat. No. PS3-1/2004-2E-PDF) 2004, Public Works and Government Services Canada, Ottawa, ON.
44. Hanson R.K., Morton-Bourgon K. The accuracy of recidivism risk assessments for sexual offenders: A meta-analysis (Cat. No. PS4-36/2007E) 2007, Public Safety and Emergency Preparedness, Ottawa, ON.
45. Hanson R.K., Morton-Bourgon K. The accuracy of recidivism risk assessments for sexual offenders: A meta-analysis of 118 prediction studies. Psychological Assessment 2009, 21:1-21.
46. Hanson R.K., Thornton D. Static-99: Improving actuarial risk assessments for sex offenders (User Report 99-02) 1999, Department of the Solicitor General of Canada, Ottawa, ON.
47. Hare R.D. The Hare Psychopathy Checklist-Revised (PCL-R) 1991, Multi-Health Systems, North Tonawanda, NY.
48. Hare R.D. The Hare Psychopathy Checklist - Revised 2003, Multi-Health Systems, Toronto, ON. 2nd ed.
49. Harris A.J.R., Phenix A., Hanson R.K., Thornton D. Static-99 coding rules: Revised 2003 2003, Solicitor General Canada, Ottawa, ON.
50. Heilbrun K. Prediction versus management models relevant to risk assessment: The importance of legal decision-making context. Law and Human Behavior 1997, 21:347-359.
51. Higgins J.P.T., Deeks J.J., Altman D.G. Special topics in statistics. Cochrane handbook for systematic reviews of interventions 2008, 521. Wiley, London. J. Higgins, S. Green (Eds.).
52. Higgins J., Thompson S. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 2002, 21:1539-1558.
53. Higgins J., Thompson S., Deeks J., Altman D. Measuring inconsistency in meta-analyses. British Medical Journal 2003, 327:557-560.
54. Higgins N., Watts D., Bindman J., Slade M., Thornicroft G. Assessing violence risk in general adult psychiatry. Psychiatric Bulletin 2005, 29:131-133.
55. Honest H., Khan K.S. Reporting of measures of accuracy in systematic reviews of diagnostic literature. BMC Health Services Research 2002, 2:1-4.
56. Hoptman M.J., Yates K.F., Patalinjug M.B., Wack R.C., Convit A. Clinical prediction of assaultive behavior among male psychiatric patients at a maximum-security forensic facility. Psychiatric Services 1999, 50:1461-1466.
57. Kemshall H. Risk assessment and management of known sexual and violent offenders: A review of current issues 2001, Home Office, London.
58. Khiroya R., Weaver T., Maden T. Use and perceived utility of structured violence risk assessments in English medium secure forensic units. Psychiatrist 2009, 33:129-132.
59. Kropp P.R., Hart S.D., Webster C.D., Eaves D. Manual for the Spousal Assault Risk Assessment guide 1994, British Columbia Institute on Family Violence, Vancouver, BC.
60. Kropp P.R., Hart S.D., Webster C.D., Eaves D. Manual for the Spousal Assault Risk Assessment guide 1995, British Columbia Institute on Family Violence, Vancouver, BC. 2nd ed.
61. Kropp P.R., Hart S.D., Webster C.D., Eaves D. Spousal Assault Risk Assessment guide (SARA) 1999, Multi-Health Systems, Toronto.
62. LÅngström N. Accuracy of actuarial procedures for assessment of sexual offender recidivism risk may vary across ethnicity. Sexual Abuse: A Journal of Research and Treatment 2004, 16:107-120.
63. Lawson W.B., Yesavage J.A., Werner P.A. Race, violence, and psychopathology. Journal of Clinical Psychiatry 1984, 45:294-297.
64. Leistico A., Salekin R., DeCoster J., Rogers R. A large-scale meta-analysis relating the Hare measures of psychopathy to antisocial conduct. Law and Human Behavior 2008, 32:28-45.
65. Lidz C.W., Mulvey E.P., Gardner W. The accuracy of predictions of violence to others. Journal of the American Medical Association 1993, 269:1007-1011.
66. Maden A. Practical application of structured risk assessment. British Journal of Psychiatry 2001, 178:479.
67. McCann, K. (2006). A meta-analysis of the predictors of sexual recidivism in juvenile sexual offenders. Unpublished master's thesis. Simon Fraser University, Burnaby, BC.
68. McNiel D.E., Binder R.L. Correlates of accuracy in the assessment of psychiatric inpatients' risk of violence. American Journal of Psychiatry 1995, 152:901-906.
69. Mercado C.C., Ogloff J.R.P. Risk and the preventive detention of sex offenders in Australia and the United States. International Journal of Law and Psychiatry 2007, 30:49-59.
70. Moher D., Liberati A., Tetzlaff J., Altman D.G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine 2009, 6:e1000097.
71. Moses L.E., Littenberg B., Shapiro D. Combining independent studies of a diagnostic test into a summary ROC curve: Data-analytical approaches and some additional considerations. Statistics in Medicine 1993, 12:1293-1316.
72. Mossman D. Assessing predictions of violence: Being accurate about accuracy. Journal of Consulting and Clinical Psychology 1994, 62:783-792.
73. Mossman D. Commentary: Assessing the risk of violence - Are " accurate" predictions useful?. Journal of the American Academy of Psychiatry and the Law 2000, 28:272-281.
74. National Institute for Health and Clinical Excellence Schizophrenia: Core interventions in the treatment and management of schizophrenia in primary and secondary care 2009, National Institute for Health and Clinical Excellence, London.
75. Quinsey V.L., Harris G.T., Rice M.E., Cormier C.A. Violent offenders: Appraising and managing risk 1998, American Psychological Association, Washington, DC.
76. Quinsey V.L., Harris G.T., Rice M.E., Cormier C.A. Violent offenders: Appraising and managing risk 2006, American Psychological Association, Washington, DC. 2nd ed.
77. Ransohoff D.F., Feinstein A.R. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. New England Journal of Medicine 1978, 299:926-930.
78. Rosenthal R. Parametric measures of effect size. The handbook of research synthesis 1994, Sage, New York, NY. H. Cooper, L.V. Hedges (Eds.).
79. Ruscio J. A probability-based measure of effect size: Robustness to base rates and other factors. Psychological Methods 2008, 13:19-30.
80. Salekin R.T., Rogers R., Sewell K.W. A review and meta-analysis of the Psychopathy Checklist and Psychopathy Checklist-Revised: Predictive validity of dangerousness. Clinical Psychology: Science and Practice 1996, 3:203-215.
81. SBU Riskbedömningar inom psykiatrin. Kan vÅld i samhÄllet förutsÄgas? [Risk assessments in psychiatry. Is it possible to predict community violence?]. Stockholm: Swedish Council on Health Technology Assessment (SBU) 2005.
82. Schwalbe C.S. Risk assessment for juvenile justice: A meta-analysis. Law and Human Behavior 2007, 31:449-462.
83. Schwalbe C.S. A meta-analysis of juvenile justice risk assessment instruments: Predictive validity by gender. Criminal Justice and Behavior 2008, 35:1367-1381.
84. Schwalbe C.S., Fraser M.W., Day S.H., Arnold E.M. North Carolina Assessment of Risk (NCAR): Reliability and predictive validity with juvenile offenders. Journal of Offender Rehabilitation 2004, 40:1-22.
85. Seto M. Is more better? Combining actuarial risk scales to predict recidivism among adult sex offenders. Psychological Assessment 2005, 17:156-167.
86. Singh J.P., Fazel S. Forensic risk assessment: A metareview. Criminal Justice and Behavior 2010, 37:965-988.
87. Sjöstedt G., Grann M. Risk assessment: What is being predicted by actuarial prediction instruments?. International Journal of Forensic Mental Health 2002, 1:179-183.
88. Skeem J., Edens J.F., Camp J., Colwell L.H. Are there ethnic differences in levels of psychopathy? A meta-analysis. Law and Human Behavior 2004, 28:505-527.
89. Smith P., Cullen F.T., Latessa E.J. Can 14, 737 women be wrong? A meta-analysis of the LSI-R and recidivism for female offenders. Criminology and Public Policy 2009, 8:183-208.
90. Sreenivasan S., Kirkish P., Garrick T., Weinberger L.E., Phenix A. Actuarial risk assessment models: A review of critical issues related to violence and sex-offender recidivism assessments. Journal of American Academy of Psychiatry and the Law 2000, 28:438-448.
91. StataCorp Stata statistical software: Release 10 2007, StataCorp LP, College Station, TX.
92. Swets J.A., Dawes R.M., Monahan J. Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest: A Journal of the American Psychological Society 2000, 1:1-26.
93. Thompson S.G., Higgins J.P.T. How should meta-regression analyses be undertaken and interpreted?. Statistics in Medicine 2002, 21:1559-1573.
94. Vess J. Sex offender risk assessment: Consideration of human rights in community protection legislation. Legal and Criminological Psychology 2008, 13:245-256.
95. Walters G. Predicting institutional adjustment and recidivism with the Psychopathy Checklist factor scores: A meta-analysis. Law and Human Behavior 2003, 27:541-558.
96. Wang E.W., Diamon P.M. Empirically identifying factors related to violence risk in corrections. Behavioral Sciences and the Law 1999, 17:377-389.
97. Webster C.D., Douglas K.S., Eaves D., Hart S.D. HCR-20: Assessing risk for violence (version 2) 1997, Simon Fraser University, Mental Health, Law, and Policy Institute, Burnaby, BC.
98. Webster C.D., Eaves D., Douglas K.S., Wintrup A. The HCR-20 scheme: The assessment of dangerousness and risk 1995, Mental Health, Law, and Policy Institute, and Forensic Psychiatric Services Commission of British Columbia, Vancouver, BC.
99. Young S. Risk assessment tools for children in conflict with the law 2009, Irish Youth Justice Service, Dublin, Retrieved December 2, 2008 from http://www.iyjs.ie/en/IYJS/Literature %20Review%20-%Risk%20Assessment.pdf/Files/Literature%20Review%20%20Risk%20Assessment.pdf.