The efficacy of violence prediction: A meta-analytic comparison of nine risk assessment tools

Psychological Bulletin

Volumn 136, Issue 5, 2010, Pages 740-767

  Yang, Min ^a   Wong, Stephen C P ^a   Coid, Jeremy ^b  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^b QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Meta analysis; Multilevel models; Risk assessment; Violent outcome

Indexed keywords

ARTICLE; COMPARATIVE STUDY; FEMALE; HUMAN; MALE; META ANALYSIS; METHODOLOGY; PREDICTIVE VALUE; PSYCHOLOGIC TEST; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; REPRODUCIBILITY; RISK ASSESSMENT; STANDARD; VIOLENCE;

FEMALE; HUMANS; MALE; PREDICTIVE VALUE OF TESTS; PSYCHOLOGICAL TESTS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; VIOLENCE;

EID: 77956536832     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0020473     Document Type: Article

References (143)

1. Adams J. Risk 1995, UCL Press, London.
2. Diagnostic and statistical manual of mental disorders 1980, American Psychiatric Association, Author, Washington, DC. 3rd ed.
3. Diagnostic and statistical manual of mental disorders 1994, American Psychiatric Association, Author, Washington, DC. 4th ed.
4. Andrews D.A. The psychology of criminal conduct and effective treatment. What works: Reducing reoffending, guidelines from research and practice 1995, 3-34. Wiley, Chichester, United Kingdom. J. McGuire (Ed.).
5. Andrews D.A., Bonta J. Level of Service Inventory-Revised 1995, Multi-Health Systems, Toronto.
6. Andrews D.A., Bonta J. The psychology of criminal conduct 1998, Anderson, Cincinnati, OH. 2nd ed.
7. Andrews D.A., Bonta J. The psychology of criminal conduct 2003, Anderson, Cincinnati, OH. 3rd ed.
8. Andrews D.A., Bonta J. The psychology of criminal conduct 2006, Anderson, Cincinnati, OH. 4th ed.
9. Andrews D.A., Bonta J. The psychology of criminal conduct 2010, Anderson, Cincinnati, OH. 5th ed.
10. Andrews D.A., Bonta J., Hoge R.D. Classification for effective rehabilitation: Rediscovering psychology. Criminal Justice and Behavior 1990, 17:19-52.
11. Andrews D.A., Bonta J., Wormith J.S. The recent past and near future of risk and/or need assessment. Crime and Delinquency 2006, 52:7-22. doi: 10.1177/0011128705281756.
12. Andrews D.A., Bonta J., Wormith J.S. The Level of Service (LS) assessment of adults and older adolescents. Handbook of violence risk assessment 2009, 199-225. Springer, Routledge, NY. R.K. Otto, K.S. Douglas (Eds.).
13. Andrews D.A., Zinger I., Hoge R.D., Bonta J., Gendreau P., Cullen F.T. Does correctional treatment work? A clinically relevant and psychologically informed meta-analysis. Criminology 1990, 28:369-404. doi: 10.1111/j.1745-9125.1990.tb01330.x.
14. Arboleda-Florez J., Stuart H. The future for risk research. Journal of Forensic Psychiatry 2000, 11:506-509. doi: 10.1080/09585180010002696.
15. Belfrage H., Fransson G., Strand S. Prediction of violence using the HCR-20: A prospective study in two maximum-security correctional institutions. Journal of Forensic Psychiatry 2000, 11:167-175. doi: 10.1080/095851800362445.
16. Boer D., Hart S., Kropp P., Webster D.R. Manual for the Sexual Violence Risk-20: Professional guidelines for assessing risk of sexual violence 1998, Psychological Assessment Resources, Lutz, FL.
17. Bonta J., Harman W.G., Hann R.G., Cormier R.B. The prediction of recidivism among federally sentenced offenders: A re-validation of the SIR scale. Canadian Journal of Criminology 1996, 38:61-79. Retrieved from http://www.ccja-acjp.ca/en/cjc.html.
18. Borum R. Improving the clinical practice of violence risk assessment: Technology, guidelines, and training. American Psychologist 1996, 51:945-956. doi: 10.1037/0003-066X.51.9.945; PMID:8819363.
19. Buchanan A. Risk of violence by psychiatric patients: Beyond the "actuarial versus clinical" assessment debate. Psychiatric Services 2008, 59:184-190. doi: 10.1176/appi.ps.59.2.184.
20. Campbell M., French S., Gendreau P. The prediction of violence in adult offenders: A meta-analytic comparison of instruments and methods of assessment. Criminal Justice and Behavior 2009, 36:567-590. doi: 10.1177/0093854809333610.
21. Cleckley H. The mask of sanity 1941, Mosby, St Louis, MO.
22. Cleckley H. The mask of sanity 1976, Mosby, St Louis, MO. 5th ed.
23. Cohen J. Statistical power analysis for the behavioral sciences 1988, Erlbaum, Hillsdale, NJ. 2nd ed.
24. Coid J., Yang M., Ullrich S., Zhang T., Sizmur S., Roberts C., Farrington D., Rogers R.D. Gender differences in structured risk assessment: Comparison of the accuracy of five instruments. Journal of Consulting and Clinical Psychology 2009, 77:337-348. doi: 10.1037/a0015155; PMID:19309193.
25. Coie J.D., Watt N.F., West S.G., Hawkins J.D., Asarnow J.R., Markman H.J., Ramey S.L., Shure M.B., Long B. The science of prevention: A conceptual framework and some directions for a national research program. American Psychologist 1993, 48:1013-1022. doi: 10.1037/0003-066X.48.10.1013; PMID:8256874.
26. Cooke D.J., Michie C. Refining the concept of psychopathy: Towards a hierarchical model. Psychological Assessment 2001, 13:171-188. doi: 10.1037/1040-3590.13.2.171;PMID:11433793.
27. Cooke D.J., Michie C., Ryan J. Evaluating risk for violence: A preliminary study of the HCR-20, PCL-R and VRAG in a Scottish prison sample (Scottish Prison Service Occasional Papers No.5/2001) 2002, Scottish Prison Service, Edinburgh, Scotland.
28. Copas J., Marshall P. The Offender Group Reconviction Scale: The statistical reconviction score for use by probation officers. Journal of the Royal Statistical Society 1998, 47(C):159-171. doi: 10.1111/1467-9876.00104.
29. Craig L.A., Beech A., Browne K.D. Cross-validation of the Risk Matrix 2000 Sexual and Violent scales. Journal of Interpersonal Violence 2006, 21:612-633. doi: 10.1177/0886260506286876; PMID:16574636.
30. D'Silva K., Duggan C., McCarthy L. Does treatment really make psychopaths worse? A review of the evidence. Journal of Personality Disorders 2004, 18:163-177.
31. Dahle K.P. Strengths and limitations of actuarial prediction of criminal reoffence in a German prison sample: A comparative study of LSI-R, HCR-20 and PCL-R. International Journal of Law and Psychiatry 2006, 29:431-442. doi: 10.1016/j.ijlp.2006.03.001; PMID:16780950.
32. Dawes R., Faust D., Meehl P. Clinical versus actuarial judgment. Science 1989, 243:1668-1674. doi: 10.1126/science.2648573; PMidID:2648573.
33. de Vogel V., de Ruiter C., de Hildebrand M., Bos B., van de Ven P. Type of discharge and risk of recidivism measured by the HCR-20: A retrospective study in a Dutch sample of treated forensic psychiatric patients. International Journal of Forensic Mental Health 2004, 3:149-165. Retrieved from http://www.iafmhs.org.
34. De Vries Robbe, M., Weenink, A., & de Vogel, V. (2006, June). Dynamic risk assessment: A pilot study comparing the VRS to the HCR-20. Paper presented at the meeting of the International Association of Forensic Mental Health Services, Amsterdam, the Netherlands.
35. Dearwater S.R., Coben J.H., Campbell J.C., Nah G., Glass N., McLoughlin E., Bekemeier B. Prevalence of intimate partner abuse in women treated at community hospital emergency departments. Journal of the American Medical Association 1998, 280:433-438. doi: 10.1001/jama.280.5.433; PMID:9701078.
36. Dolan M., Fullam R. The validity of the Violence Risk Scale second edition (VRS-2) in a British forensic inpatient sample. Journal of Forensic Psychiatry and Psychology 2007, 18:381-393. doi: 10.1080/14789940701489390: PMCID:1443148.
37. Douglas K.S., Reeves K.A. Historical-Clinical-Risk Management-20 (HCR-20) violence risk assessment scheme: Rationale, application, and empirical overview. Handbook of violence risk assessment 2009, 147-185. Routledge, New York. R.K. Otto, K.S. Douglas (Eds.).
38. Douglas K., Skeem J. Violence risk assessment: Getting specific about being dynamic. Psychology, Public Policy, and Law 2005, 11:347-383. doi: 10.1037/1076-8971.11.3.347.
39. Douglas K.S., Ogloff J.R.P., Nicholls T.L., Grant I. Assessing risk for violence among psychiatric patients: The HCR-20 violence risk assessment scheme and the Psychopathy Checklist: Screening version. Journal of Consulting and Clinical Psychology 1999, 67:917-930. doi: 10.1037/0022-006X.67.6.917; PMID:10596513.
40. Douglas K.S., Yeomans M., Boer D.P. Comparative validity analysis of multiple measures of violence risk in a sample of criminal offenders. Criminal Justice and Behavior 2005, 32:479-510. doi: 10.1177/0093854805278411.
41. Doyle M., Dolan M. Predicting community violence from patients discharged from mental health services. British Journal of Psychiatry 2006, 189:520-526. doi: 10.1192/bjp.bp.105.021204; PMID:17139036.
42. Doyle M., Dolan M., McGovern J. The validity of North American risk assessment tools in predicting in-patient violent behavior in England. Legal and Criminological Psychology 2002, 7:141-154. doi: 10.1348/135532502760274756.
43. Edens J.F., Campbell J.S., Weir J.M. Youth psychopathy and criminal recidivism: A meta-analysis of the Psychopathy Checklist measures. Law and Human Behavior 2007, 31:53-75. doi: 10.1007/s10979-006-9019-y; PMID:17019617.
44. Edens J.F., Poythress N.G., Lilienfeld G.O. Identifying inmates at risk for disciplinary infractions: A comparison of two measures of psychopathy. Behavioral Sciences and the Law 1999, 17:435-443. doi: 10.1002/(SICI)1099-0798(199910/12)17:4<435::AID-BSL356>3.0.CO;2-Z.
45. Edens J.F., Skeem J.L., Douglas K.S. Incremental validity analyses of the Violence Risk Appraisal Guide and the Psychopathy Checklist: Screening version in a civil psychiatric sample. Assessment 2006, 13:368-374. doi: 10.1177/1073191105284001; PMID:16880286.
46. Farrington D.P., Ohlin L., Wilson J.Q. Understanding and controlling crime 1986, Springer Verlag, New York.
47. Gendreau P., Goggin C., Smith P. Is the PCL-R really the "unparalleled" measure of offender risk? A lesson in knowledge cumulation. Criminal Justice and Behavior 2002, 29:397-426. doi: 10.1177/0093854802029004004.
48. Gendreau P., Little T., Goggin C. A meta-analysis of the predictors of adult offender recidivism: What works. Criminology 1996, 34:557-607. doi: 10.1111/j.1745-9125.1996.tb01220.x.
49. Glover A.J.J., Nicholson D.E., Hemmati T., Bernfeld G.A., Quinsey V.L. A comparison of predictors of general and violent recidivism among high-risk federal offenders. Criminal Justice and Behavior 2002, 29:235-249. doi: 10.1177/0093854802029003001.
50. Goldstein H. Multilevel statistical models 2003, Arnold, London. 3rd ed.
51. Goldstein H., Yang M., Tuner R.M., Omar R.Z., Thompson S. Meta-analysis using multilevel models with an application to the study of class size effects. Applied Statistics 2000, 49(3):399-412. doi: 10.1111/1467-9876.00200.
52. Grann M., Belfrage H., Tengström A. Actuarial assessment of risk for violence-Predictive validity of the VRAG and the historical part of the HCR-20. Criminal Justice and Behavior 2000, 27:97-114. doi: 10.1177/0093854800027001006.
53. Gray N.S., Fitzgerald S., Taylor J., MacCulloch M.J., Snowden R.J. Predicting future reconviction in offenders with intellectual disabilities: The predictive efficacy of VRAG, PCL-R, and HCR-20. Psychological Assessment 2007, 19:474-479. doi: 10.1037/1040-3590.19.4.474; PMID:18085940.
54. Gray N.S., Hill C., McGleish A., Timmons D., MacCulloch M.J., Snowden R.J. Prediction of violence and self-harm in mentally disordered offenders: A prospective study of the efficacy of HCR-20, PCL-R, and psychiatric symptomatology. Journal of Consulting and Clinical Psychology 2003, 71:443-451. doi: 10.1037/0022-006X.71.3.443; PMID:12795569.
55. Greenland S. Quantitative methods in the review of epidemiologic literature. Epidemiology Review 1987, 9:1-30. PMID: 3678409.
56. Grevatt M., Thomas-Peter B., Hughes G. Violence, mental disorder and risk assessment: Can structured clinical assessments predict the short-term risk of inpatient violence?. Journal of Forensic Psychiatry and Psychology 2004, 15:278-292. doi: 10.1080/1478994032000199095.
57. Grisso T., Appelbaum P.S. Structuring the debate about ethical predictions of future violence. Law and Human Behavior 1993, 17:482-485. doi: 10.1007/BF01044381; PMid:11659733.
58. Grove W.M., Meehl P.E. Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psychology, Public Policy, and Law 1996, 2:293-323. doi: 10.1037/1076-8971.2.2.293.
59. Guy L.S., Edens J.F., Anthony C., Douglas K.S. Does psychopathy predict institutional misconduct among adults? A meta-analytic investigation. Journal of Consulting and Psychology 2005, 73:1056-1064. doi: 10.1037/0022-006X.73.6.1056; PMid:16392979.
60. Haapanen R.A. Selective incapacitation and the serious offender: A longitudinal study of criminal career patterns 1990, Springer-Verlag, New York.
61. Hanson R.K., Bussière M.T. Predicting relapse: A meta-analysis of sexual offender recidivism studies. Journal of Consulting and Clinical Psychology 1998, 66:348-362. doi: 10.1037/0022-006X.66.2.348; PMID:9583338.
62. Hanson R.K., Harris A.J.R., Scott T., Helmus L. Assessing the risk of sex offenders on community supervision (User Report No. 2007-05) 2007, Public Safety and Emergency Preparedness Canada, Ottawa, Ontario, Canada.
63. Hanson R.K., Morton-Bourgon K. Predictors of sexual recidivism: An updated meta-analysis (User Report 2004-02) 2004, Public Safety and Emergency Preparedness Canada, Ottawa, Ontario, Canada.
64. Hanson R.K., Thornton D. Static 99: Improving actuarial risk assessments for sex offenders (User Report 99-02) 1999, Department of the Solicitor General of Canada, Ottawa, Ontario, Canada.
65. Hanson R.K., Thornton D. Improving risk assessments for sex offenders: A comparison of three actuarial scales. Law and Human Behavior 2000, 24:119-136. doi: 10.1023/A:1005482921333; PMID:10693322.
66. Hare R.D. The Hare Psychopathy Checklist-Revised 1991, Multi-Health Systems, Toronto.
67. Hare R.D. The Hare Psychopathy Checklist-Revised 2003, Multi-Health Systems, Toronto. 2nd ed.
68. Hare R.D., Harpur T.J., Hakstian A.R., Forth A.E., Hart S.D., Newman J.P. The Revised Psychopathy Checklist: Reliability and factor structure. Psychological Assessment 1990, 2:338-341. doi: 10.1037/1040-3590.2.3.338.
69. Harris G.T., Rice M.E., Quinsey V.L. Violent recidivism of mentally disordered offenders: The development of a statistical prediction instrument. Criminal Justice and Behavior 1993, 20:315-335. doi: 10.1177/0093854893020004001.
70. Hart S., Cox D., Hare R. The Hare Psychopathy Checklist: Screening Version (PCL:SV) 1995, Multi-Health Systems, Toronto.
71. Heilbrun K., Yasuhara K., Shah S. Violence risk assessment tools: Overview and clinical analysis. Handbook of violence risk assessment 2009, 1-18. Routledge, New York. R.K. Otto, K.S. Douglas (Eds.).
72. Hildebrand M., de Ruiter C., de Vogel V. Psychopathy and sexual deviance in treated rapists: Association with sexual and nonsexual recidivism. Sexual Abuse: A Journal of Research and Treatment 2004, 16:1-24. doi: 10.1177/107906320401600101.97;PMID:15017823.
73. Hilton N.Z., Harris G.T., Rice M.E. Predicting violence by serious wife assaulters. Journal of Interpersonal Violence 2001, 16:408-423. doi: 10.1177/088626001016005002.
74. Hirschi T., Gottfredson M. Age and the explanation of crime. American Journal of Sociology 1983, 89:552-584.
75. Hoge R., Andrews D. Youth Level of Service/Case Management Inventory 2002, Multi-Health Systems, Toronto.
76. Hudson S.M., Wales D.S., Bakker L., Ward T. Dynamic risk factors: The Kia Marama evaluation. Sexual Abuse: A Journal of Research and Treatment 2002, 14:103-119. doi: 10.1177/107906320201400203;PMID:11961886.
77. Hunter J.E., Schmidt F.L. Fixed effects vs. random effects meta-analysis models: Implications for cumulative research knowledge. International Journal of Selection and Assessment 2000, 8:275-298. doi: 10.1111/1468-2389.00156.
78. Hunter J.E., Schmidt F.L. Methods of meta-analysis: Correcting error and bias in research findings 2004, Sage, London. 2nd ed.
79. Kemshall H. Understanding risk in criminal justice 2003, Open University Press, Philadelphia, PA.
80. Kemshall H., Maguire M. Public protection, partnership and risk penalty in the multiagency risk management of sexual and violent offenders. Punishment & Society 2001, 3:237-264. doi: 10.1177/14624740122228311.
81. Kowalski R.M., Limber S.P., Patricia W., Agatston P.W. Cyber bullying: Bullying in the digital age 2007, Blackwell, Malden, MA.
82. Kraemer H.C., Kazdin A.E., Offord D.R., Kessler R.C., Jensen P.S., Kupfer D.J. Coming to terms with the terms of risk. Archives of General Psychiatry 1997, 54:337-343. PMID:9107150.
83. Kroner D.G., Loza W. Evidence for the efficacy of self-report in predicting nonviolent and violent criminal recidivism. Journal of Interpersonal Violence 2001, 16:168-177. doi: 10.1177/088626001016002005.
84. Kroner D.G., Mills J.F. The accuracy of five risk appraisal instruments in predicting institutional misconduct and new convictions. Criminal Justice and Behavior 2001, 28:471-489. doi: 10.1177/009385480102800405.
85. Kroner D.G., Mills J.F., Reddon J.R. A coffee can, factor analysis, and prediction of antisocial behavior: The structure of criminal risk. International Journal of Law and Psychiatry 2005, 28:360-374. doi: 10.1016/j.ijlp.2004.01.011; PMID:15936077.
86. Leyland A., Goldstein H. Multilevel modelling of health statistics 2001, Wiley, New York.
87. Lipsey M.W., Wilson D.B. Effective intervention for serious juvenile offenders: A synthesis of research. Serious and violent juvenile offenders: Risk factors and successful interventions 1998, 313-345. Sage, Thousand Oaks, CA. R. Loeber, D.P. Farrington (Eds.).
88. Litwack T.R. On the ethics of dangerousness assessments. Law and Human Behavior 1993, 17:479-482. doi: 10.1007/BF01044380;PMID:11659732.
89. Loza W., Green K. The Self-Appraisal Questionnaire, a self-report measure for predicting recidivism versus clinician-administered measures: A 5-year follow-up study. Journal of Interpersonal Violence 2003, 18:781-797. doi: 10.1177/0886260503253240.
90. Loza W., Loza-Fanous A. The effectiveness of the self-appraisal questionnaire in predicting offenders' postrelease outcome, a comparison study. Criminal Justice and Behavior 2001, 28:105-121. doi: 10.1177/0093854801028001005.
91. Maden A. Treating violence: A guide to risk management in mental health 2007, Oxford University Press, Oxford, United Kingdom.
92. Maden T., Tyrer P. Dangerous and severe personality disorders: A new personality concept from the United Kingdom. Journal of Personality Disorders 2003, 17:489-496. doi: 10.1521/pedi.17.6.489.25356; PMID:14744075.
93. McDermott B.E., Edens J.F., Quanbeck C.D., Busse D., Scott C.L. Examining the role of static and dynamic risk factors in the prediction of inpatient violence: Variable- and person-focused analysis. Law and Human Behavior 2008, 32:325-338. doi: 10.1007/s10979-007-9094-8; PMID:17597388.
94. McGuire J. A review of effective interventions for reducing aggression and violence. Philosophical Transactions of the Royal Society 2008, 363:2483-2622. doi: 10.1098/rstb.2008.0035;PMID:18467276;PMCID:2606715.
95. Meehl P.E., Rosen A. Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. Psychological Bulletin 1955, 52:194-216. doi: 10.1037/h0048070.
96. Mills J.F., Kroner D.G. The effect of discordance among violence and general recidivism risk estimates on predictive accuracy. Criminal Behaviour and Mental Health 2006, 16:155-166. doi: 10.1002/cbm.623.
97. Mills J.F., Kroner D.G., Hemmati T. The validity of violence risk estimates: An issue of item performance. Psychological Services 2007, 4:1-12.
98. Monahan J. Predicting violent behavior: An assessment of clinical techniques 1981, Sage, Beverly Hills, CA.
99. Monahan J., Steadman H. Violence and mental disorder: Developments in risk assessment 1994, University of Chicago Press, Chicago.
100. Monahan J., Steadman H., Silver E., Appelbaum P., Robbins P., Mulvey E., Banks S. Rethinking risk assessment: The MacArthur study of mental disorder and violence 2001, Oxford University Press, New York.
101. Morrissey C., Hogue T., Mooney C.A., Johnston S., Hollin C., Lindsay W.R., Taylor J.L. Predictive validity of the PCL-R in offenders with intellectual disability in a high secure hospital setting: Institutional aggression. Journal of Forensic Psychiatry & Psychology 2007, 18:1-15. doi: 10.1080/08990220601116345; PMCID:1443148.
102. Mullen P. Forensic mental health. British Journal of Psychiatry 2000, 176:307-311. doi: 10.1192/bjp.176.4.307;PMid:10827876.
103. FBI Academy, National Center for the Analysis of Violent Crime, Critical Incident Response Group FBI Academy. (n.d.). The school shooter: A threat assessment perspective. Retrieved March 18, 2009, from http://www.fbi.gov/publications/school/school2.pdf.
104. Nicholls T.L. Violence risk assessments with female NCRMD acquittees: Validity of the HCR-20 and PCL:SV. Dissertation Abstracts International: Section B. Sciences and Engineering 2004, 64:8-B.
105. Nicholls T.L., Ogloff J.R., Douglas K.S. Assessing risk for violence among male and female civil psychiatric patients: The HCR-20, PCL:SV, and VSC. Behavioral Sciences and the Law 2004, 22:127-158. doi: 10.1002/bsl.579.
106. Nuffield J. Parole decision-making in Canada: Research towards decision guidelines 1982, Supply and Services Canada, Ottawa, Ontario, Canada.
107. O'Donohue W., Fisher J.E., Hayes S.C. Cognitive behavior therapy: Applying empirically supported techniques in your practice 2003, Wiley, Hoboken, NJ.
108. Ogloff J.R.P. Psychopathy/antisocial personality disorder conundrum. Australian and New Zealand Journal of Psychiatry 2006, 40:519-528. PMID:16756576.
109. Olver M., Wong S.C.P. Psychopathy, sexual deviance, and recidivism among different types of sex offenders. Sexual Abuse: A Journal of Research and Treatment 2006, 18:65-82. doi: 10.1177/107906320601800105; PMID:16763759.
110. Olver M., Wong S.C.P. Therapeutic responses of psychopathic sexual offenders: Treatment attrition, therapeutic change, and long-term recidivism. Journal of Consulting and Clinical Psychology 2009, 77:328-336. doi: 10.1037/a0015001; PMid:19309191.
111. Olver M.E., Wong S.C.P., Nicholaichuk T., Gordon A. The validity and reliability of the Violence Risk Scale-Sexual Offender version: Assessing sex offender risk and evaluating therapeutic change. Psychological Assessment 2007, 19:318-329. doi: 10.1037/1040-3590.19.3.318; PMID:17845123.
112. Poythress N.G. Avoiding negligent release: Contemporary clinical and risk management strategies. American Journal of Psychiatry 1992, 147:994-997. Retrieved from http://ajp.psychiatryonline.org/.
113. Price R.K., Spitznagel E.L., Downey T.J., Meyer D.J., Risk N.K., El-Ghazzawy O.G. Applying artificial neural network models to clinical decision making. Psychological Assessment 2000, 12:40-51. doi: 10.1037/1040-3590.12.1.40; PMID:10752362.
114. Quinsey V.L., Harris G.T., Rice M.E., Cormier C.A. Violent offenders: Appraising and managing risk 1998, American Psychological Association, Washington, DC, doi: 10.1037/10304-000.
115. Rasbash J., Browne W., Goldstein H., Yang M., Plewis I., Healy M., Lewis T. A user's guide to MLwiN 2000, Institute of Education, University of London, London.
116. Rice M.E., Harris G.T. Comparing effect sizes in follow-up studies: ROC area, Cohen's d, and r. Law and Human Behavior 2005, 29:615-620. doi: 10.1007/s10979-005-6832-7;PMID:16254746.
117. Rice N., Carr-Hill R., Dixon P., Sutton M. The influence of households on drinking behaviour: A multilevel analysis. Social Science and Medicine 1998, 46:971-979. doi: 10.1016/S0277-9536(97)10017-X.
118. Salekin R.T., Rogers R., Sewell K.W. A review and meta-analysis of the Psychopathy Checklist and Psychopathy Checklist-Revised: Predictive validity of dangerousness. Clinical Psychology: Science and Practice 1996, 3:203-215. doi: 10.1111/j.1468-2850.1996.tb00071.x.
119. Sampson R., Raudenbush S., Earls F. Neighborhoods and violent crime: A multilevel study of collective efficacy. Science 1997, 277(5328):918-924. doi: 10.1126/science.277.5328.918; PMID:9252316.
120. Schwalbe C. Risk assessment for juvenile justice: A meta-analysis. Law and Human Behavior 2007, 31:449-462. doi: 10.1007/s10979-006-9071-7;PMID:17211688.
121. Skeem J.L., Mulvey E.P. Psychopathy and community violence among civil psychiatric patients: Results from the MacArthur Violence Risk Assessment Study. Journal of Consulting and Clinical Psychology 2001, 69:358-374. doi: 10.1037/0022-006X.69.3.358; PMID:11495166.
122. Snowden R.J., Gray N.S., Taylor J., MacCulloch M.J. Actuarial prediction of violent recidivism in mentally disordered offenders. Psychological Medicine 2007, 37:1539-1549. doi: 10.1017/S0033291707000876;PMID:17537287.
123. Stadtland C., Hollweg M., Kleindienst N., Dietl J., Reich R., Nedopil N. Risk assessment and prediction of violent and sexual recidivism in sex offenders: Long-term predictive validity of four risk assessment instruments. Journal of Forensic Psychiatry & Psychology 2005, 16:92-108. doi: 10.1080/1478994042000270247;PMCID:1443148.
124. Steadman H.J., Silver E., Monahan J., Appelbaum P.S., Robbins P.C., Mulvey E.P., Banks S. A classification tree approach to the development of actuarial violence risk assessment tools. Law and Human Behavior 2000, 24:83-100. doi: 10.1023/A:1005478820425;PMID:10693320.
125. Tengström A. Long-term predictive validity of historical factors in two risk assessment instruments in a group of violent offenders with schizophrenia. Nordic Journal of Psychiatry 2001, 55:243-249. doi: 10.1080/080394801681019093.
126. Thornton D. Scoring guide for Risk Matrix 2000.9/SVC 2007, Retrieved from http://www.cfcp.bham.ac.uk/Extras/SCORING%20GUIDE%20FOR%20RISK%20MATRIX%202000.9-%20SVC%20-%20(ver.%20Feb%202007).pdf.
127. Tuner R.M., Omar R.Z., Yang M., Goldstein H., Thompson S.G. Random effects meta-analysis with binary outcomes using multilevel models. Statistics in Medicine 2000, 19:3417-3432. Retrieved from http://www3.interscience.wiley.com/journal/2988/home.
128. Von Korff M., Koepsell T., Curry S., Diehr P. Multi-level analysis in epidemiological research on health behaviors and outcomes. American Journal of Epidemiology 1992, 135:1077-1082. PMID: 1632420.
129. Walters G.D. Predicting criminal justice outcomes with the Psychopathy Checklist and Lifestyle Criminality Screening Form: A meta-analytic comparison. Behavioral Sciences and the Law 2003, 21:89-102. doi: 10.1002/bsl.519.
130. Walters G.D. Predicting institutional adjustment and recidivism with the Psychopathy Checklist factors scores: A meta-analysis. Law and Human Behavior 2003, 27:541-558. doi: 10.1023/A:1025490207678PMid:14593797.
131. Walters G.D. Risk-appraisal versus self-report in the prediction of criminal justice outcomes: A meta-analysis. Criminal Justice and Behavior 2006, 33:279-304. doi: 10.1177/0093854805284409.
132. Walters G.D., White T.W., Denney D. The Lifestyle Criminality Screening Form: Preliminary data. Criminal Justice and Behavior 1991, 18:406-418. doi: 10.1177/0093854891018004003.
133. Warren J.I., South S.C., Burnette M.L., Rogers A., Friend R., Bale R., Van Patten I. Understanding the risk factors for violence and criminality in women: The concurrent validity of the PCL-R and HCR-20. International Journal of Law and Psychiatry 2005, 28:269-289. doi: 10.1016/j.ijlp.2003.09.012; PMID:15923037.
134. Webster C.K., Douglas D.E., Eaves D., Hart D. HCR-20 assessing risk for violence: Version II 1997, Mental Health, Law & Policy Institute, Simon Fraser University, Burnaby, British Columbia, Canada.
135. Wong S., Gordon A. The Violence Risk Scale. Bulletin of the International Society for Research on Aggression 2001, 23:16-20. Retrieved from http://www.israsociety.com.
136. Wong S.C.P., Gordon A. Violence Risk Scale 2003, Available from the authors, Department of Psychology, University of Saskatchewan, Saskatoon, Saskatchewan, Canada S7N 5A5.
137. Wong S.C.P., Gordon A. The validity and reliability of the Violence Risk Scale: A treatment-friendly violence risk assessment tool. Psychology, Public Policy, and Law 2006, 12:279-309. doi: 10.1037/1076-8971.12.3.279.
138. Wong S.C.P., Gordon A., Gu D. The assessment and treatment of violence-prone forensic clients: An integrated approach. British Journal of Psychiatry 2007, 190:566-574. doi: 10.1192/bjp.190.5.s66;PMid:17470945.
139. Wong S., Hare R. Guidelines for a psychopathy treatment program 2005, Multi-Health Systems, Toronto.
140. International statistical classification of diseases and related health problems 1990, World Health Organization, Author, Geneva, Switzerland. 10th Rev.
141. Wormith S., Olver M., Stevenson H., Girard L. The long-term prediction of offender recidivism using diagnostic, personality, and risk/need approaches to offender assessment. Psychological Services 2007, 4:287-305. doi: 10.1037/1541-1559.4.4.287.
142. Yang M., Heath A., Goldstein H. Multilevel models for repeated binary outcomes: Attitudes and vote over the electoral cycle. Journal of Royal Statistical Society 2000, 163A(1):49-62. http://www.rss.org.uk/main.asp?page=1711.
143. Yang M., Liu Y.Y., Coid W.J. Applying neural networks and other statistical models to the classification of serious offenders and the prediction of recidivism: Research summary 2010, Ministry of Justice, Great Britain, London, Retrieved from www.justice.gov.uk/publications/research.htm.