Rater Differences in Psychopathy Measure Scoring and Predictive Validity

Law and Human Behavior

Volumn 39, Issue 4, 2015, Pages 321-331

  Harris, Paige B ^a   Boccaccini, Marcus T ^a   Murrie, Daniel C ^b  

^a SAM HOUSTON STATE UNIVERSITY   (United States)

^b UNIVERSITY OF VIRGINIA   (United States)

Author keywords

evaluator differences; PCL R; PCL:SV; psychopathy; rater agreement

Indexed keywords

ADOLESCENT; ADULT; ANTISOCIAL PERSONALITY DISORDER; FEMALE; HUMAN; MALE; OBSERVER VARIATION; PSYCHOLOGICAL INTERVIEW; PSYCHOLOGICAL RATING SCALE; REPRODUCIBILITY; RISK ASSESSMENT; YOUNG ADULT;

ADOLESCENT; ADULT; ANTISOCIAL PERSONALITY DISORDER; FEMALE; HUMANS; INTERVIEW, PSYCHOLOGICAL; MALE; OBSERVER VARIATION; PSYCHIATRIC STATUS RATING SCALES; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; YOUNG ADULT;

EID: 84937073756     PISSN: 01477307     EISSN: 1573661X     Source Type: Journal    
DOI: 10.1037/lhb0000115     Document Type: Article

References (29)

1. Ake v. Oklahoma. 470 U. S. 68. (1986). Bobko, P., Roth, P. L., & Bobko, C. (2001). Correcting the effect size of d for range restriction and unreliability. Organizational Research Methods, 4, 46-61. http://dx. doi. org/10. 1177/109442810141003
2. Boccaccini, M. T., Murrie, D. C., Rufino, K. A., & Gardner, B. O. (2014). Evaluator differences in Psychopathy Checklist-Revised factor and facet scores. Law and Human Behavior, 38, 337-345. http://dx. doi. org/ 10. 1037/lbh0000069
3. Boccaccini, M. T., Turner, D. B., & Murrie, D. C. (2008). Do some evaluators report consistently higher or lower PCL-R scores than others Findings from a statewide sample of sexually violent predators evaluations. Psychology, Public Policy, and Law, 14, 262-283. http://dx. doi. org/10. 1037/a0014523
4. Boccaccini, M. T., Turner, D. B., Murrie, D. C., & Rufino, K. A. (2012). Do PCL-R scores from state or defense experts best predict future misconduct among civilly committed sex offenders? Law and Human Behavior, 36, 159-169. http://dx. doi. org/10. 1037/h0093949
5. Edens, J. F., Boccaccini, M. T., & Johnson, D. W. (2010). Inter-rater reliability of the PCL-R total and factor scores among psychopathic sex offenders: Are personality features more prone to disagreement than behavioral features? Behavioral Sciences & the Law, 28, 106-119. http://dx. doi. org/10. 1002/bsl. 918
6. Hare, R. D. (2003). Psychopathy Checklist-Revised (2nd ed.): technical manual. Toronto, Ontario, Canada: Multi-Health Systems.
7. Hart, S. D., Cox, D. N., & Hare, R. D. (1995). The Hare Psychopathy Checklist: Screening Version (PCL:SV). Toronto, Ontario, Canada: Multi-Heath Systems.
8. Hedges, L. V. (1981). Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128. http://dx. doi. org/10. 2307/1164588
9. Laurell, J., Belfrage, H., & Hellström, A. (2010). Facets on the psychopathy checklist screening version and instrumental violence in forensic psychiatric patients. Criminal Behaviour and Mental Health, 20, 285-294. http://dx. doi. org/10. 1002/cbm. 779
10. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
11. Lloyd, C. D., Clark, H. J., & Forth, A. E. (2010). Psychopathy, expert testimony, and indeterminate sentences. Exploring the relationship between Psychopathy Checklist Revised testimony and trial outcome in Canada. Legal and Criminological Psychology, 15, 323-339. http://dx. doi. org/10. 1348/135532509X468432
12. MacArthur Research Network. (2005, September). Macarthur violence risk assessment data. Retrieved from http://www. macarthur. virginia. edu/ risk. html
13. McDermott, P. A., Watkins, M. W., & Rhoad, A. M. (2014). Whose IQ is it-Assessor bias variance in high-stakes psychological assessment. Psychological Assessment, 26, 207-214. http://dx. doi. org/10. 1037/ a0034832
14. Miller, A. K., Rufino, K. A., Boccaccini, M. T., Jackson, R. L., & Murrie, D. C. (2011). On individual differences in person perception: Raters' personality traits relate to their psychopathy checklist-revised scoring tendencies. Assessment, 18, 253-260. http://dx. doi. org/10. 1177/ 1073191111402460
15. Miller, C. S., Kimonis, E. R., Otto, R. K., Kline, S. M., & Wasserman, A. L. (2012). Reliability of risk assessment measures used in sexually violent predator proceedings. Psychological Assessment, 24, 944-953. http://dx. doi. org/10. 1037/a0028411
16. Monahan, J., Steadman, H., Silver, E., Appelbaum, P., Robbins, P., Mulvey, E.,. Banks, S. (2001). Rethinking Risk Assessment: The Mac-Arthur Study of Mental Disorder and Violence. New York, NY: New York: Oxford University Press.
17. Morey, L. C. (1991). Personality Assessment Inventory (PAI). Odessa, FL: Psychological Assessment Resources Inc.
18. Murrie, D. C., Boccaccini, M. T., Caperton, J., & Rufino, K. (2012). Field validity of the Psychopathy Checklist-Revised in sex offender risk assessment. Psychological Assessment, 24, 524-529. http://dx. doi. org/ 10. 1037/a0026015
19. Murrie, D. C., Boccaccini, M. T., Guarnera, L., & Rufino, K. A. (2013). Are forensic experts biased by the side that retained them? Psychological Science, 24, 1889-1897. http://dx. doi. org/10. 1177/ 0956797613481812
20. Murrie, D. C., Boccaccini, M. T., Zapf, P. A., Warren, J. I., & Henderson, C. E. (2008). Clinician variation in findings of competence to stand trial. Psychology, Public Policy, and Law, 14, 177-193. http:// dx. doi. org/10. 1037/a0013578
21. Murrie, D. C., & Warren, J. I. (2005). Clinician variation in rates of legal sanity opinions: Implications for self-monitoring. Professional Psychology: Research and Practice, 36, 519-524. http://dx. doi. org/10. 1037/ 0735-7028. 36. 5. 519
22. Pedersen, L., Kunz, C., Rasmussen, K., & Elsass, P. (2010). Psychopathy as a risk factor for violent recidivism: Investigating the Psychopathy Checklist Screening Version (PCL:SV) and the Comprehensive Assessment of Psychopathic Personality (CAPP) in a forensic psychiatry setting. The International Journal of Forensic Mental Health, 9, 308-315. http://dx. doi. org/10. 1080/14999013. 2010. 526681
23. Rufino, K. A., Boccaccini, M. T., & Guy, L. S. (2011). Scoring subjectivity and item performance on measures used to assess violence risk: The PCL-R and HCR-20 as exemplars. Assessment, 18, 453-463. http://dx. doi. org/10. 1177/1073191110378482
24. Rufino, K. A., Boccaccini, M. T., Hawes, S. W., & Murrie, D. C. (2012). When experts disagreed, who was correct A comparison of PCL-R scores from independent raters and opposing forensic experts. Law and Human Behavior, 36, 527-537. http://dx. doi. org/10. 1037/h0093988
25. Skeem, J. L., & Mulvey, E. P. (2001). Psychopathy and community violence among civil psychiatric patients: Results from the MacArthur Violence Risk Assessment Study. Journal of Consulting and Clinical Psychology, 69, 358-374. http://dx. doi. org/10. 1037/0022-006X. 69. 3. 358
26. Sturup, J., Edens, J. F., Sörman, K., Karlberg, D., Fredriksson, B., & Kristiansson, M. (2014). Field reliability of the Psychopathy Checklist-Revised among life sentenced prisoners in Sweden. Law and Human Behavior, 38, 315-324. http://dx. doi. org/10. 1037/lhb0000063
27. Walters, G. D., Knight, R. A., Grann, M., & Dahle, K. P. (2008). Incremental validity of the Psychopathy Checklist facet scores: Predicting release outcome in six samples. Journal of Abnormal Psychology, 117, 396-405. http://dx. doi. org/10. 1037/0021-843X. 117. 2. 396
28. Wechsler, D. (2003). Wechsler Intelligence Scale for Children (4th ed.). San Antonio, TX: Psychological Corporation.
29. Zapf, P. A., Hubbard, K. L., Cooper, V. G., Wheeles, M. C., & Ronan, K. A. (2004). Have the courts abdicated their responsibility for determination of competency to stand trial to clinicians? Journal of Forensic Psychology Practice, 4, 27-44. http://dx. doi. org/10. 1300/J158v 04n01-02