Even Highly Correlated Measures Can Add Incrementally to Predicting Recidivism Among Sex Offenders

Assessment

Volumn 19, Issue 4, 2012, Pages 442-461

  Babchishin, Kelly M ^a,b   Hanson, R Karl ^a   Helmus, Leslie ^b  

^a PUBLIC SAFETY CANADA   (Canada)

^b CARLETON UNIVERSITY   (Canada)

Author keywords

calibration; incremental validity; predictive accuracy; risk assessment; sex offenders

Indexed keywords

ADULT; ARTICLE; CALIBRATION; COMPARATIVE STUDY; EUROPE; FORENSIC PSYCHIATRY; HUMAN; MALE; META ANALYSIS; NEW ZEALAND; NORTH AMERICA; PRISONER; PROPORTIONAL HAZARDS MODEL; PSYCHOLOGIC TEST; PSYCHOLOGICAL ASPECT; RECEIVER OPERATING CHARACTERISTIC; RECURRENT DISEASE; REPRODUCIBILITY; RISK ASSESSMENT; SEXUAL CRIME;

ADULT; CALIBRATION; EUROPE; FORENSIC PSYCHIATRY; HUMANS; MALE; NEW ZEALAND; NORTH AMERICA; PRISONERS; PROPORTIONAL HAZARDS MODELS; PSYCHOLOGICAL TESTS; RECURRENCE; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; ROC CURVE; SEX OFFENSES;

EID: 84868669048     PISSN: 10731911     EISSN: 15523489     Source Type: Journal    
DOI: 10.1177/1073191112458312     Document Type: Article

References (97)

1. *Allan M.,Grace R. C.,Rutherford B.,Hudson S. M.Psychometric assessment of dynamic risk factors for child molesters.Sexual Abuse: A Journal of Research and Treatment. 2007;19:347-367.
2. Allison P. D.Event history analysis: Regression for longitudinal event data. Beverly Hills, CA: Sage; 1984:.
3. Altman D. G.,Vergouwe Y.,Royston P.,Moons K. G.Prognosis and prognostic research: Validating a prognostic model.British Medical Journal. 2008;338:1432-1435.
4. Archer R. P.,Buffington-Vollum J. K.,Stredny R. V.,Handel R. W.A survey of psychological test use patterns among forensic psychologists.Journal of Personality Assessment. 2006;87:84-94.
5. Babchishin K. M.Risk ratios for Static-99/R and Static-2002/R. Paper presented at 30th Annual Research and Treatment Conference of the Association for the Treatment of Sexual Abusers; 2011Toronto, Ontario, Canada; 2011.
6. BabchishinK. M.HansonR. K. (2009). Improving our talk: Going beyond "low," "moderate" and "high" in risk communication. Crime Scene, 16, 11-14. Retrieved from http://www.cjsw.ac.uk/cjsw/files/Hanson%202009.pdf.
7. Babchishin K. M.,Hanson R. K.,Helmus L.The RRASOR, Static-99R, and Static-2002R all add incrementally to the prediction of recidivism among sex offenders. Ottawa, Ontario: Public Safety Canada; 2011:.
8. Bandos A. I.,Rockette H. E.,Gur D.A permutation test sensitive to differences in areas for comparing ROC curves from a paired design.Statistics in Medicine. 2005;24:2873-2893.
9. Barbaree H. E.,Langton C. M.,Peacock E. J.Different actuarial risk measures produce different risk rankings for sexual offenders.Sexual Abuse: A Journal of Research and Treatment. 2006a;18:423-440.
10. Barbaree H. E.,Langton C. M.,Peacock E. J.The factor structure of static actuarial items: Its relation to prediction.Sexual Abuse: A Journal of Research and Treatment. 2006b;18:207-226.
11. Begg C. B.Advances in statistical methodology for diagnostic medicine in the 1980's.Statistics in Medicine. 1991;10:1887-1895.
12. *Bengtson S.Is newer better? A cross-validation of the Static-2002 and the Risk Matrix 2000 in a Danish sample of sexual offenders.Psychology, Crime & Law. 2008;14:85-106.
13. *Bigras J.La prédiction de la récidive chez les délinquants sexuels.Dissertations Abstracts International: Section B. 2007;68 (09):.
14. Blanton H.,Jaccard J.Arbitrary metrics in psychology.American Psychologist. 2006;61:27-41.
15. *BoerA. (2003). Evaluating the Static-99 and Static-2002 risk scales using Canadian sexual offenders (Unpublished master's thesis). University of Leicester, England
16. *BontaJ.YessineA. K. (2005). Recidivism data for 124 released sexual offenders from the offenders identified in The National Flagging System: Identifying and responding to high-risk, violent offenders (User Rep. 2005-04). Ottawa, Ontario: Public Safety and Emergency Preparedness Canada. Unpublished raw data.
17. Braun T. M.,Alonzo T. A.A modified sign test for comparing paired ROC curves.Biostatistics. 2008;9:364-372.
18. *Brouillette-Alarie S.,Proulx J.Poster presented at the Annual Conference for the Association for the Treatment of Sexual Abusers; 2008Atlanta, GA; 2008.
19. Cohen J.The earth is round (p &.05).American Psychologist. 1994;49:997-1003.
20. *CortoniF.NunesK. L. (2007). Assessing the effectiveness of the National Sexual Offender Program (Research Rep. No. R-183). Ottawa, Ontario: Correctional Service of Canada. Retrieved from http://www.csc-scc.gc.ca/text/rsrch/reports/r183/r183-eng.shtml.
21. Cronbach L. J.,Meehl P. E.Construct validity in psychological tests.Psychological Bulletin. 1955;52:281-302.
22. Cureton E. E.Validity, reliability, and baloney.Educational and Psychological Measurement. 1950;10:94-96.
23. Delong E. R.,Delong D. M.,Clarke-Pearson D. L.Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach.Biometrics. 1988;44:837-845.
24. Doren D. M.Evaluating sex offenders: A manual for civil commitments and beyond. Thousands Oak, CA: Sage; 2002:.
25. Doren D.Toward a multidimensional model for sexual recidivism risk.Journal of Interpersonal Violence. 2004;19:835-856.
26. *EherR.RettenbergerM.SchillingF.PfafflinF. (2009). Data from sex offenders released from prison in Austria. Unpublished raw data.
27. Embretson S. E.Construct validity: A universal validity system or just another test evaluation procedure?.Educational Researcher. 2007;36:449-455.
28. Measuring psychological constructs: Advances in model-based approaches. Embretson S. E., ed. Washington, DC: American Psychological Association; 2010:.
29. *EppersonD. L. (2003). Validation of the MnSOST-R, Static-99, and RRASOR with North Dakota prison and probation samples. Unpublished Technical Assistance Report, North Dakota Division of Parole and Probation.
30. Gail M. H.,Pfeiffer R. M.On criteria for evaluating models of absolute risk.Biostatistics. 2005;6:227-239.
31. Grzybowski M.,Younger J. G.Statistical methodology: III. Receiver Operating Characteristics (ROC) curves.Academic Emergency Medicine. 1997;4:818-826.
32. *HaagA. M. (2005). Recidivism data from 198 offenders detained until their warrant expiry date. In Do psychological interventions impact on actuarial measures: An analysis of the predictive validity of the Static-99 and Static-2002 on a re-conviction measure of sexual recidivism (UMI No. NR05662). Dissertations Abstracts International, Section B, 66(08), 4531B. Unpublished raw data.
33. Hanley J. A.,Hajian-Tilaki K. O.Sampling variability of nonparametric estimates of the areas under receiver operating characteristic curves: An update.Academic Radiology. 1997;4:49-58.
34. Hanley J. A.,McNeil B. J.A method of comparing the areas under ROC curves derived from same cases.Radiology. 1983;148:839-843.
35. HansonR. K. (1997). The development of a brief actuarial scale for sex offender recidivism (User Rep. No. 1997-04). Ottawa, Ontario: Department of the Solicitor General of Canada. Retrieved from http://www.publicsafety.gc.ca/res/cor/rep/cprmindex-eng.aspx#a97.
36. Hanson R. K.Twenty years of progress in violence risk assessment.Journal of Interpersonal Violence. 2005;20:212-217.
37. Hanson R. K.The psychological assessment of risk for crime and violence.Canadian Psychology. 2009;50:172-182.
38. Hanson R. K.,Babchishin K. M.,Helmus L.,Thornton D.Quantifying the relative risk of sex offenders: Risk ratios for Static-99R. 2012;:.
39. Hanson R. K.,Bussière M. T.Predicting relapse: A meta-analysis of sexual offender recidivism studies.Journal of Consulting and Clinical Psychology. 1998;66:348-362.
40. *HansonR. K.HarrisA. J. R.ScottT.HelmusL. (2007). Assessing the risk of sexual offenders on community supervision: The dynamic supervision project (Corrections Research User Rep. No. 2007-05). Ottawa, Ontario: Public Safety Canada. Retrieved from http://www.publicsafety.gc.ca/res/cor/rep/_fl/crp2007-05-en.pdf.
41. Hanson R. K.,Helmus L.,Thornton D.Predicting recidivism among sexual offenders: A multi-site study of Static-2002.Law and Human Behavior. 2010;34:198-211.
42. Hanson R. K.,Lloyd C. D.,Helmus L.,Thornton D.Developing non-arbitrary metrics for risk communication: Percentile ranks for the Static-99/R and Static-2002/R sexual offender risk tools.International Journal of Forensic Mental Health. 2012;11:9-23.
43. Hanson R. K.,Morton-Bourgon K. E.The characteristics of persistent sexual offenders: A meta-analysis of recidivism studies.Journal of Consulting and Clinical Psychology. 2005;73:1154-1163.
44. Hanson R. K.,Morton-Bourgon K. E.The accuracy of recidivism risk assessments for sexual offenders: A meta-analysis of 118 prediction studies.Psychological Assessment. 2009;21:1-21.
45. Hanson R. K.,Thornton D.Improving risk assessments for sex offenders: A comparison of three actuarial scales.Law and Human Behavior. 2000;24:119-136.
46. HansonR. K.ThorntonD. (2003). Notes on the development of Static-2002. (Corrections Research User Rep. No. 2003-01). Ottawa, Ontario: Department of the Solicitor General of Canada. Retrieved from http://www.publicsafety.gc.ca/res/cor/rep/2003-01-not-sttc-eng.aspx.
47. *HarkinsL.BeechA. R. (2007). Examining the effectiveness of sexual offender treatment using risk band analysis. Unpublished manuscript.
48. Harrell F. E.,Lee K. L.,Mark D. B.Tutorial in biostatistics multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors.Statistics in Medicine. 1996;15:361-387.
49. Harris A. J. R.,Hanson R. K.Clinical, actuarial, and dynamic risk assessment of sexual offenders: Why do things keep changing?.Journal of Sexual Aggression. 2010;16:296-310.
50. HarrisA. J. R.PhenixA.HansonR. K.ThorntonD. (2003). Static-99 coding rules: Revised 2003. Ottawa, Ontario: Department of the Solicitor General of Canada. Retrieved from http://www.publicsafety.gc.ca/res/cor/rep/_fl/2003-03-stc-cde-eng.pdf.
51. Hedges L. V.The handbook of research synthesis. Cooper H.Hedges L. V., ed. New York, NY: Russell Sage; 1994:285-299.
52. Hedges L. V.,Olkin I.Statistical methods for meta-analysis. New York, NY: Academic Press; 1985:.
53. Hedges L. V.,Vevea J. L.Fixed- and random-effects models in meta-analysis.Psychological Methods. 1998;3:486-504.
54. HelmusL. (2009). Re-norming Static-99 recidivism estimates: Exploring base rate variability across sex offender samples (Master's thesis). Available from ProQuest Dissertations and Theses database. (UMI No. MR58443). Retrieved from http://www.static99.org/pdfdocs/helmus2009-09static-99normsmathesis.pdf.
55. Helmus L.,Hanson R. K.,Thornton D.,Babchishin K. M.,Harris A. J. R.Absolute recidivism rates predicted by Static-99R and Static-2002R sex offender risk assessment tools vary across samples: A meta-analysis.Criminal Justice and Behavior. 2012;39:1148-1171.
56. Helmus L.,Thornton D.,Hanson R. K.,Babchishin K. M.Improving the predictive accuracy of Static-99 and Static-2002 with older sex offenders: Revised age weights.Sexual Abuse: A Journal of Research and Treatment. 2012;24:64-101.
57. *Hill A.,Habermann N.,Klusmann D.,Berner W.,Briken P.Criminal recidivism in sexual homicide perpetrators.International Journal of Offender Therapy and Comparative Criminology. 2008;52:5-20.
58. Horst P.The role of the predictor variables which are independent of the criterion.Social Science Research Council. 1941;48:431-436.
59. Horton N. J.,Switzer S. S.Statistical methods in the journal.New England Journal of Medicine. 2005;353:1977-1979.
60. Hosmer D. W.,Lemeshow S.Applied logistic regression. 2000). Applied logistic regression (2nd ed.). New York, NY: Wiley.New York, NY: Wiley; 2000:.
61. Humphreys L. G.,Swets J. A.Comparison of predictive validities measured with biserial correlations and ROCs of signal detection theory.Journal of Applied Psychology. 1991;76:316-321.
62. Jackson R. L.,Hess D. T.Evaluation for civil commitment of sex offenders: A survey of experts.Sexual Abuse: A Journal of Research and Treatment. 2007;19:409-448.
63. *Johansen S. H.Accuracy of predictions of sexual offense recidivism: A comparison of actuarial and clinical methods.Dissertations Abstracts International, Section B. 2007;68 (03):.
64. *Knight R. A.,Thornton D.Evaluating and improving risk assessment schemes for sexual recidivism: A long-term follow-up of convicted sexual offenders. 2007;:.
65. *Långström N.Accuracy of actuarial procedures for assessment of sexual offender recidivism risk vary across ethnicity.Sexual Abuse: A Journal of Research and Treatment. 2004;16:107-120.
66. Le C. T.,Lindgren B. R.Construction and comparison of two receiving operating characteristic curves derived from the same sample.Biometrical Journal. 1995;37:869-877.
67. Lloyd M. D.Incremental validity of commonly-used risk assessment measures in predicting serious sexual recidivism.Dissertation Abstracts International: Section B. Sciences and Engineering. 2008;69 (9): 5784.
68. McGrath R. J.,Cumming G. F.,Burchard B. L.,Zeoli S.,Ellerby E.Current practices and emerging trends in sexual abuser management: The Safer Society 2009 North American Survey. Brandon, VT: Safer Society Press; 2010:.
69. Meehl P. E.Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis: University of Minnesota Press; 1954:.
70. Mills J. F.,Kroner D. G.The effect of discordance among violence and general recidivism risk estimates on predictive accuracy.Criminal Behaviour and Mental Health. 2006;16:155-166.
71. *Nicholaichuk T. Paper presented at the Annual Research and Treatment Conference of the Association for the Treatment of Sexual Abusers; 2001San Antonio, TX; 2001.
72. Nunnally J. C.,Bernstein I. H.Psychometric theory. 1994). Psychometric theory (3rd ed.) New York, NY: McGraw-Hill.New York, NY: McGraw-Hill; 1994:.
73. Paulhus D. L.,Robins R. W.,Trzesniewski K. H.,Tracy J. L.Two replicable suppressor situations in personality research.Multivariate Behavioral Research. 2004;39:303-328.
74. PhenixA.DorenD.HelmusL.HansonR. K.ThorntonD. (2009). Coding rules for Static-2002. Ottawa, Ontario: Public Safety Canada. Retrieved from http://www.publicsafety.gc.ca/res/cor/rep/sttc-2002-eng.aspx.
75. Pintea S.,Moldovan R.Journal of Cognitive and Behavioral Psychotherapies. analysis: Fundamentals and applications in clinical psychology; 2009:49-66.
76. Rice M. E.,Harris G. T.Violent recidivism: Assessing predictive validity.Journal of Consulting and Clinical Psychology. 1995;63:737-748.
77. Rice M. E.,Harris G. T.Comparing effect sizes in follow-up studies: ROC area, Cohen's.d r. Law and Human Behavior. 2005;29:615-620.
78. Robin X.,Turck N.,Hainard A.,Tiberti N.,Lisacek F.,Sanchez J.-C.,Müller M.pROC: An open-source package for R and S+ to analyze and compare ROC curves.BMC Bioinformatics. 2011;12:77.
79. Rockhill B.,Byrne C.,Rosner B.,Louie M. M.,Colditz G.Breast cancer risk prediction with a log-incidence model: Evaluation of accuracy.Journal of Clinical Epidemiology. 2003;56:856-861.
80. Sasieni P. D.Handbook of epidemiology. Athrens W.Pigeot I., ed. Heidelberg, Germany: Springer; 2005:693-728.
81. Schmidt F. L.,Oh I.,Hayes T. L.Fixed- versus random-effects models in meta-analysis: Model properties and an empirical comparison of differences in results.British Journal of Mathematical and Statistical Psychology. 2009;62:97-128.
82. Seto M. C.Is more better? Combining actuarial risk scales to predict recidivism among adult sex offenders.Psychological Assessment. 2005;17:156-167.
83. Stalans L. J.,Hacker R.,Talbot M. E.Comparing non-violent, other-violent, and domestic batterer sex offenders: Predictive accuracy of risk assessments on sexual recidivism.Criminal Justice and Behavior. 2010;37:613-628.
84. Swets J. A.Measuring the accuracy of diagnostic systems.Science. 1988;240:1285-1293.
85. Swets J. A.,Dawes R. M.,Monahan J.Psychological science can improve diagnostic decisions.Psychological Science in the Public Interest -. 2000;1:1.
86. *Swinburne Romine R.,Dwyer S. M.,Mathiowetz C.,Thomas M.Poster presented at the Conference for the Association for the Treatment of Sexual Abusers; 2008Atlanta, GA; 2008.
87. *Ternowski D. R.Sex offender treatment: An evaluation of the Stave Lake Correctional Centre Program.Dissertations Abstracts International: Section B. 2004;66 (06): 3428.
88. Thornton D.Paper presented at the annual Research and Treatment Conference of the Association for the Treatment of Sexual Abusers; 2010Phoenix, AZ; 2010.
89. Tzelgov J.,Henik A.Suppression situations in psychological research: Definitions, implications, and applications.Psychological Bulletin. 1991;109:524-536.
90. Vickers A. J.,Cronin A. M.,Begg C. B.One statistical test is sufficient for assessing new predictive markers.BMC Medical Research Methodology. 2011;11 (13): 1-7.
91. Vrieze S. I.,Grove W. M.Multidimensional assessment of criminal recidivism: Problems, pitfalls, and proposed solutions.Psychological Assessment. 2010;22:382-395.
92. Walters G. D.Taking the next step: Combining incrementally valid indicators to improve recidivism prediction.Assessment. 2011;18:227-233.
93. Welsh J. L.,Schmidt F.,McKinnon L.,Chattha H. K.,Meyers J. R.A comparative study of adolescent risk assessment instruments: Predictive and incremental validity.Assessment. 2008;15:104-115.
94. *WilsonR. J.CortoniF.VermaniM. (2007). Circles of support and accountability: A national replication of outcome findings (Rep. No. R-185). Ottawa, Ontario: Correctional Service of Canada. Retrieved from http://www.csc-scc.gc.ca/text/rsrch/reports/r185/r185-eng.shtml.
95. *Wilson R. J.,Picheca J. E.,Prinzo M.Evaluating the effectiveness of professionally-facilitated volunteerism in the community-based management of high-risk sexual offenders: Part two-A comparison of recidivism rates.The Howard Journal. 2007;46:327-337.
96. Yang M.,Wong S. C. P.,Coid J.The efficacy of violence prediction: A meta-analytic comparison of nine risk assessment tools.Psychological Bulletin. 2010;136:740-767.
97. Zweig M. H.,Campbell G.Clinical Chemistry. plots: A fundamental evaluation tool in clinical medicine; 1993:561-577.