Reliability of risk assessment measures used in sexually violent predator proceedings

Psychological Assessment

Volumn 24, Issue 4, 2012, Pages 944-953

  Miller, Cailey S ^a   Kimonis, Eva R ^a   Otto, Randy K ^a   Kline, Suzonne M ^b   Wasserman, Adam L ^b  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b Florida Department of Children and Families   (United States)

Author keywords

Interrater reliability; Risk assessment; Sexually violent predator

Indexed keywords

ADULT; ARTICLE; COMPARATIVE STUDY; CONTROLLED STUDY; CORRELATION COEFFICIENT; HUMAN; INTERRATER RELIABILITY; MAJOR CLINICAL STUDY; MALE; MINNESOTA SEX OFFENDER SCREENING TOOL REVISED; PSYCHOLOGIC ASSESSMENT; PSYCHOPATHY CHECKLIST REVISED; RISK ASSESSMENT; SEXUAL CRIME; SEXUAL VIOLENCE; STATIC-99;

ADULT; HUMANS; MALE; MIDDLE AGED; PSYCHIATRIC STATUS RATING SCALES; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; SEX OFFENSES;

EID: 84874454173     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0028411     Document Type: Article

References (46)

1. Barbaree, H. E., Seto, M. C., Langton, C. M., & Peacock, E. J. (2001). Evaluating the predictive accuracy of six risk assessment instruments for adult sex offenders. Criminal Justice and Behavior, 28, 490-521. doi: 10.1177/009385480102800406
2. Bartosh, D. L., Garby, T., Lewis, D., & Gray, S. (2003). Differences in the predictive validity of actuarial risk assessments in relation to sex offender type. International Journal of Offender Therapy and Comparative Criminology, 47, 422-438. doi:10.1177/0306624X03253850
3. Blair, P., Marcus, D., & Boccaccini, M. T. (2008). Is there an allegiance effect for assessment instruments? Actuarial risk assessment as an exemplar. Clinical Psychology: Science and Practice, 15, 346-360. doi: 10.1111/j.1468-2850.2008.00147.x
4. Boccaccini, M. T., Turner, D. T., & Murrie, D. C. (2008). Do some evaluators report consistently higher or lower scores on the PCL-R? Findings from a statewide sample of sexually violent predator evaluations. Psychology, Public Policy, and Law, 14, 262-283. doi:10.1037/a0014523
5. Bradley, M. A., & Epperson, D. L. (2001). [Inter-rater reliability study of the MnSOST-R]. Unpublished raw data.
6. Cooke, D. J., & Michie, C. (2001). Refining the construct of psychopathy: Towards a hierarchical model. Psychological Assessment, 13, 171-188. doi:10.1037/1040-3590.13.2.171
7. DeMatteo, D., & Edens, J. F. (2006). The role and relevance of the Psychopathy Checklist-Revised in court: A case law survey of U.S. courts (1991-2004). Psychology, Public Policy, and Law, 12, 214-241. doi:10.1037/1076-8971.12.2.214
8. DeMatteo, D., Edens, J. F., & Hart, A. (2010). The use of measures of psychopathy in violence risk assessment. In R. K. Otto & K. S. Douglas (Eds.), Handbook of violence risk assessment (pp. 19-40). New York, NY: Routledge/Taylor & Francis.
9. Edens, J. F., Boccaccini, M. T., & Johnson, D. W. (2010). Inter-rater reliability of the PCL-R total and factor scores among psychopathic sex offenders: Are personality features more prone to disagreement than behavioral features? Behavioral Sciences & the Law, 28(1), 106-119. doi:10.1002/bsl.918
10. Epperson, D. L., Kaul, J. D., Hout, S., Hesselton, D., & Alexander, W. (1998). Minnesota Sex Offender Screening Tool-Revised (MnSOST-R). St. Paul, MN: Minnesota Department of Corrections. Retrieved from http://www.psychology.iastate.edu
11. Epperson, D. L., Kaul, J. D., Hout, S., Hesselton, D., & Alexander, W. (2003). Minnesota Sex Offender Screening Tool-Revised (MnSOST-R) technical paper: Development, validation, and recommended risk level cut scores. St. Paul, MN: Minnesota Department of Corrections. Retrieved from http://www.psychology.iastate.edu
12. Grann, M., Langstrom, N., Tengstrom, A., & Stalenheim, E. G. (1998). Reliability of file-based retrospective ratings of psychopathy with the PCL-R. Journal of Personality Assessment, 70, 416-426.
13. Hanson, R. K. (2001). Age and sexual recidivism: A comparison of rapists and child molesters (User Report 2001-01). Ottawa, Ontario, Canada: Department of the Solicitor General of Canada.
14. Hanson, R. K., & Morton-Bourgon, K. E. (2005). The characteristics of persistent sexual offenders: A meta-analysis of recidivism studies. Journal of Consulting and Clinical Psychology, 73, 1154-1163. doi:10.1037/0022-006X.73.6.1154
15. Hanson, R. K., & Morton-Bourgon, K. E. (2007). The accuracy of recidivism risk assessments for sexual offenders: A meta-analysis. Ottawa, Ontario, Canada: Department of the Solicitor General of Canada.
16. Hanson, R. K., & Thornton, D. (2000). Static-99: Improving actuarial risk assessments for sex offenders (User Report 99-02). Ottawa, Ontario, Canada: Department of the Solicitor General of Canada.
17. Hanson, R. K., & Thornton, D. (2002). Notes on the development of Static-2002. Ottawa, Ontario, Canada: Department of the Solicitor General of Canada.
18. Hare, R. D. (1991). Manual for the Hare Psychopathy Checklist-Revised. Toronto, Ontario, Canada: Multi-Health Systems.
19. Hare, R. D. (2003). Manual for the Hare Psychopathy Checklist-Revised (2nd ed.). Toronto, Ontario, Canada: Multi-Health Systems.
20. Hare, R. D., & Neumann, C. S. (2006). The PCL-R assessment of psychopathy: Development, structural properties, and new directions. In C. J. Patrick (Ed.), Handbook of psychopathy (pp. 58-106). New York, NY: Guilford Press.
21. Harris, A., Phenix, A., Hanson, R. K., & Thornton, D. T. (2003). Static-99 Coding Rules Revised-2003. Retrieved from http://sgc.gc.ca
22. Harris, G. T., Rice, M. E., Quinsey, V. L., Lalumiere, M. L., Boer, D., & Lang, C. (2003). A multisite comparison of actuarial risk instruments for sex offenders. Psychological Assessment, 15, 413-425. doi:10.1037/1040-3590.15.3.413
23. Hemphill, J. F., Templeman, R., Wong, S., & Hare, R. D. (1998). Psychopathy and crime: Recidivism and criminal careers. In D. Cooke, A. Forth, & R. D. Hare (Eds.), Psychopathy: Theory, research, and implications for society (pp. 375-398). Dordrecht, the Netherlands: Kluwer Academic.
24. Jackson, R. L., & Hess, D. T. (2007). Evaluation for civil commitment of sex offenders: A survey of experts. Sex Abuse, 19, 425-448.
25. Jackson, R. L., Rogers, R., & Shuman, D. W. (2004). The adequacy and accuracy of sexually violent predator evaluations: Contextualized risk assessment in clinical practice. International Journal of Forensic Mental Health, 3, 115-129.
26. Jackson, R., Schneider, J., & Travia, T. (2009). Sex Offender Civil Commitment Network SOCCPN annual survey of sex offender civil commitment programs. Retrieved from http://soccpn.org/images/Annual_survey_2009_final_10.09.pdf
27. Janus, E. S., & Prentky, R. (2003). Forensic use of actuarial risk assessment with sex offenders: Accuracy, admissibility, and accountability. American Criminal Law Review, 40, 1443-1499.
28. Jimmy Ryce Involuntary Civil Commitment for Sexually Violent Predators' Treatment and Care Act, ch. 98-64, § 24, 1998 Fla. Laws 445, 455 (codified at FLA. STAT. §§ 916.31-.49 [Supp. 1998]) (effective Jan. 1, 1999).
29. Langton, C. M., Barbaree, H. E., Seto, M. S., Peacock, E. J., Harkins, L., & Hansen, K. T. (2007). Actuarial assessment for reoffense among adult sex offenders: Evaluating the predictive accuracy of the STATIC-2002 and five other instruments. Criminal Justice and Behavior, 34, 37-59. doi:10.1177/0093854806291157
30. Leistico, A., Salekin, R., DeCoster, J., & Rogers, R. (2008). A large-scale meta-analysis related Hare measures of psychopathy to antisocial conduct. Law and Human Behavior, 32, 28-45. doi:10.1007/s10979-007-9096-6
31. Levenson, J. S. (2004a). Reliability of sexually violent predator civil commitment criteria in Florida. Law and Human Behavior, 28, 357-368. doi:10.1023/B:LAHU.0000039330.22347.ad
32. Levenson, J. S. (2004b). Sexual predator civil commitment: A comparison of selected and released offenders. International Journal of Offender Therapy and Comparative Criminology, 48, 638-648. doi:10.1177/0306624X04265089
33. Miller, H. A., Amenta, A. E., & Conroy, M. A. (2005). Sexually violent predator evaluations: Empirical evidence, strategies for professionals, and research directions. Law and Human Behavior, 29, 29-54. doi: 10.1007/s10979-005-1398-y
34. Mossman, D. (1999). "Hired guns," "whores," and "prostitutes": Case law references to clinicians of ill repute. Journal of the American Academy of Psychiatry and the Law, 27, 414-425.
35. Murrie, D. C., Boccaccini, M. T., Johnson, J. T., & Janke, C. (2008). Does interrater (dis)agreement on Psychopathy Checklist scores in sexually violent predator trials suggest partisan allegiance in forensic evaluations? Law and Human Behavior, 32, 352-362. doi:10.1007/s10979-007-9097-5
36. Murrie, D. C., Boccaccini, M. T., Turner, D. B., Meeks, M., Woods, C., & Tussey, C. (2009). Rater (dis)agreement on risk assessment measures in sexually violent predator proceedings: Evidence of adversarial allegiance in forensic evaluation? Psychology, Public Policy, and Law, 15, 19-53. doi:10.1037/a0014897
37. Nunnally, J. C., & Bernstein, J. H. (1994). Psychometric theory. New York, NY: McGraw Hill.
38. Otto, R. K., & Heilbrun, K. (2002). The practice of forensic psychology: A look toward the future in light of the past. American Psychologist, 57, 5-18. doi:10.1037/0003-066X.57.1.5
39. Poythress, N. G., Skeem, J. L., & Lilienfeld, S. O. (2006). Associations among early abuse, dissociation, and psychopathy in an offender sample. Journal of Abnormal Psychology, 115, 288-297. doi:10.1037/0021-843X.115.2.288
40. Salekin, R. T., Rogers, R., & Sewell, K. W. (1996). A review and meta-analysis of the Psychopathy Checklist and Psychopathy Checklist- Revised: Predictive validity of dangerousness. Clinical Psychology: Science and Practice, 3, 203-215. doi:10.1111/j.1468-2850 .1996.tb00071.x
41. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428. doi: 10.1037/0033-2909.86.2.420
42. Sjöstedt, G., & Långström, N. (2002). Assessment of risk for criminal recidivism among rapists: A comparison of four different measures. Psychology, Crime & Law, 8(1), 25-40. doi:10.1080/10683160208401807
43. Walsh, T., & Walsh, Z. (2006). The evidentiary introduction of Psychopathy Checklist-Revised-assessed psychopathy in U.S. courts: Extent and appropriateness. Law and Human Behavior, 30, 493-507. doi:10.1007/s10979-006-9042-z
44. Walters, G. D. (2003). Predicting institutional adjustment and recidivism with the psychopathy checklist factor scores: A meta-analysis. Law and Human Behavior, 27, 541-558. doi:10.1023/A:1025490207678
45. Walters, G. D., Knight, R. A., Grann, M., & Dahle, K. (2008). Incremental validity of the Psychopathy Checklist facet scores: Predicting release outcome in six samples. Journal of Abnormal Psychology, 117, 396- 405. doi:10.1037/0021-843X.117.2.396
46. Wollert, R. (2006). Low base rates limit expert certainty when current actuarials are used to identify sexually violent predators: An application of Bayes's theorem. Psychology, Public Policy, and Law, 12(1), 56-85. doi:10.1037/1076-8971.12.1.56