Reevaluating interrater reliability in offender risk assessment

Crime and Delinquency

Volumn 58, Issue 1, 2012, Pages 147-163

  van der Knaap, Leontien M ^a   Leenarts, Laura E W ^b   Born, Marise Ph ^c   Oosterveld, Paul ^d  

^a TILBURG UNIVERSITY   (Netherlands)

^b VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^c ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^d Methodologie   (Netherlands)

Author keywords

interrater reliability; offender assessment; recidivism assessment scales (RISc); risk

Indexed keywords

EID: 84856648206     PISSN: 00111287     EISSN: 1552387X     Source Type: Journal    
DOI: 10.1177/0011128710382347     Document Type: Article

References (39)

1. Adviesbureau Van Montfoort & Reclassering Nederland. RISc versie 1.0. Recidive Inschattings Schalen. Handleiding. Harderwijk, Netherlands: Flevodruk; 2004.
2. Andrews D. A.The Level of Supervision Inventory (LSI): Report on the assessment and evaluation project. Toronto, Ontario, Canada: Ministry of Correctional Services; 1982.
3. Andrews D. A.Enhancing adherence to risk-need-responsivity: Making quality a matter of policy.Criminology & Public Policy. 2006;5:595-602.
4. Andrews D. A.,Bonta J.Rehabilitating criminal justice policy and practice.Psychology, Public Policy, and Law. 2010;16:39-55.
5. Andrews D. A.,Bonta J.,Hoge R. D.Classification for effective rehabilitation: Rediscovering psychology.Criminal Justice and Behavior. 1990;17:19-52.
6. Andrews D. A.,Bonta J. L.,Wormith J. S.Level of Service/Case Management Inventory (LS/CMI): An offender assessment system. Toronto, Ontario, Canada: Multi-Health Systems; 2004.
7. Andrews D. A.,Bonta J. L.,Wormith J. S.The recent past and near future of risk and/or need assessment.Crime & Delinquency. 2006;52:7-27.
8. Andrews D. A.,Dowden C.The risk-need-responsivity model of assessment and human service in prevention and corrections: Crime-prevention jurisprudence.Canadian Journal of Criminology and Criminal Justice. 2007;49:439-464.
9. Andrews D. A.,Zinger I.,Hoge R. D.,Bonta J.,Gendreau P.,Cullen F. T.Does correctional treatment work? A clinically relevant and psychologically informed meta-analysis.Criminology. 1990;28:369-404.
10. Austin J.How much risk can we take? The misuse of risk assessment in corrections.Federal Probation. 2006;70:58-63.
11. BairdC. (2009). A question of evidence: A critique of risk assessment models used in the justice system (Special report to the National Council on Crime and Delinquency). Madison, WI: National Council on Crime and Delinquency. Retrieved from http://nccd-crc.issuelab.org/research.
12. Bonta J.Offender risk assessment: Guidelines for selection and use.Criminal Justice and Behavior. 2002;29:355-379.
13. Bonta J.Offender risk assessment and sentencing.Canadian Journal of Criminology and Criminal Justice. 2007;49:519-529.
14. Born M. Ph.Het meten van prestatiegerichtheid. Een situatie-response vragenlijst. Free University: Amsterdam; 1995.
15. BrennanT.DieterichW.EhretB. (2007). Research synthesis: Reliability and validity of COMPAS. Traverse City, MI: Northpointe. Retrieved from http://www.northpointeinc.com/docs.aspx.
16. Brennan T.,Dieterich W.,Ehret B.Evaluating the predictive validity of the COMPAS risk and needs assessment system.Criminal Justice and Behavior. 2009;36:21-40.
17. Cohen J.A coefficient of agreement for nominal scales.Educational and Psychological Measurement. 1960;20:37-46.
18. Cullen F. T.,Gendreau P.From nothing works to what works: Changing professional ideology in the 21st century.The Prison Journal. 2001;81:313-338.
19. DebidinM. (Ed.). (2009). A compendium of research and analysis on the Offender Assessment System (OASys) 2006-2009. London, England: Ministry of Justice. Retrieved from http://www.justice.gov.uk/publications/research.htm.
20. Di Placido C.,Simon T. L.,Witte T. D.,Gu D.,Wong S. C. P.Treatment of gang members can reduce recidivism and institutional misconduct.Law and Human Behavior. 2006;30:93-114.
21. Dowden C.,Andrews D. A.What works for female offenders: A meta-analytic review.Crime & Delinquency. 1999;45:438-452.
22. Flores A. W.,Lowenkamp C. T.,Smith P.,Latessa E. J.Validating the Level of Service Inventory-Revised on a sample of federal probationers.Federal Probation. 2006;70:44-48.
23. French S. A.,Gendreau P.Reducing prison misconducts: What works!.Criminal Justice and Behavior. 2006;33:185-218.
24. Hanson R. K.,Bourgon G.,Helmus L.,Hodgson S.The principles of effective correctional treatment also apply to sexual offenders: A meta-analysis.Criminal Justice and Behavior. 2009;36:865-891.
25. Hanson R. K.,Morton-Bourgon K. E.The accuracy of recidivism risk assessments for sexual offenders: A meta-analysis of 118 prediction studies.Psychological Assessment. 2009;21:1-21.
26. Hollin C. R. Risk-needs assessment and allocation to offender programmes. Offender rehabilitation and treatment: Effective programmes to reduce re-offending. McGuire J., ed. Chichester, England: Wiley; 2002:309-332.
27. Howard P.,Clark D.,Garnham N.Evaluation and validation of the Offender Assessment System (OASys). London, England: OASys Central Research Unit; 2003.
28. Howard P.,Clark D.,Garnham N.An evaluation of the Offender Assessment System (OASys) in three pilots 1999-2001. London, England: Home Office; 2006.
29. Landis J. R.,Koch G. G.The measurement of observer agreement for categorical data.Biometrics. 1977;33:159-174.
30. Lawlis G. F.,Lu E.Judgment of counseling process: Reliability, agreement, and error.Psychological Bulletin. 1972;78:17-20.
31. Lindell M. K.,Brandt C. J.Assessing interrater agreement on the job relevance of a test: A comparison of the CVI, T, rWG(J), and r*WG(J) indexes.Journal of Applied Psychology. 1999;84:640-647.
32. Lowenkamp C. T.,Latessa E. J.,Holsinger A. M.The risk principle in action: What have we learned from 13,676 offenders and 97 correctional programs?.Crime & Delinquency. 2006;52:77-93.
33. McGuire J.Criminal sanctions versus psychologically based interventions with offenders: A comparative empirical analysis.Psychology, Crime & Law. 2002;8:183-208.
34. MortonS. (2009). Inter-rater reliability of OASys. In DebidinM. (Ed.), A compendium of research and analysis on the Offender Assessment System (OASys) 2006-2009 (pp. 56-77). London, England: Ministry of Justice. Retrieved from http://www.justice.gov.uk/publications/research.htm.
35. Ogloff J. R. P.,Davis M. R.Advances in offender assessment and rehabilitation: Contributions of the risk-needs-responsivity approach.Psychology, Crime & Law. 2004;10:229-242.
36. Tinsley H. E. A.,Weiss D. J.Interrater reliability and agreement of subjective judgments.Journal of Counseling Psychology. 1975;22:358-374.
37. Ward T.,Melser J.,Yates P. M.Reconstructing the Risk-Need-Responsivity model: A theoretical elaboration and evaluation.Aggression and Violent Behavior. 2007;12:208-228.
38. Wong S. C. P.,Gordon A.,Gu D.Assessment and treatment of violence-prone forensic clients: An integrated approach.British Journal of Psychiatry, 190. 2007; (Suppl. 49): s66-s74.
39. Wormith J. S.,Olver M. E.,Stevenson H. E.,Girard L.The long-term prediction of offender recidivism using diagnostic, personality, and risk/need approaches to offender assessment.Psychological Services. 2007;4:287-305.