How reliable are psychopathy checklist-revised scores in Canadian criminal trials? A case law review

Psychological Assessment

Volumn 27, Issue 2, 2015, Pages 447-456

  Edens, John F ^a   Cox, Jennifer ^b   Smith, Shannon Toney ^a   DeMatteo, David ^c   Sörman, Karolina ^a,d  

^a TEXAS A AND M UNIVERSITY   (United States)

^b UNIVERSITY OF ALABAMA   (United States)

^c DREXEL UNIVERSITY COLLEGE OF MEDICINE   (United States)

^d KAROLINSKA INSTITUTE   (Sweden)

Author keywords

Criminals; Field reliability; Forensic assessment; Interrater reliability; Psychopathy checklist revised

Indexed keywords

ARTICLE; CANADA; CASE STUDY; CONTROLLED STUDY; CRIMINAL BEHAVIOR; CRIMINAL JUSTICE; CRIMINAL LAW; FORENSIC SCIENCE; HUMAN; MEDICOLEGAL ASPECT; PSYCHOPATHY CHECKLIST REVISED SCORE; RELIABILITY; SCORING SYSTEM; SEXUAL CRIME; ADULT; ANTISOCIAL PERSONALITY DISORDER; CHECKLIST; FORENSIC PSYCHIATRY; MALE; MIDDLE AGED; OBSERVER VARIATION; PERSONALITY ASSESSMENT; PRISONER; PSYCHOLOGY; PSYCHOMETRY; REPRODUCIBILITY; RISK ASSESSMENT; STATISTICS AND NUMERICAL DATA; VALIDATION STUDY; VIOLENCE;

ADULT; ANTISOCIAL PERSONALITY DISORDER; CANADA; CHECKLIST; COMMITMENT OF MENTALLY ILL; DANGEROUS BEHAVIOR; FORENSIC PSYCHIATRY; HUMANS; MALE; MIDDLE AGED; OBSERVER VARIATION; PERSONALITY ASSESSMENT; PRISONERS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; SEX OFFENSES; VIOLENCE;

EID: 84930757798     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000048     Document Type: Article

References (65)

1. Acheson, S. K., & Payne, J. W. (2005). Review of the Psychopathy Checklist-Revised. In B. S. Plake, J. C. Impara, & R. A. Spies (Eds.), Sixteenth mental measurements yearbook (2nd ed.). Lincoln, NE: Buros Institute of Mental Measurements.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing (4th ed.). Washington, DC: American Educational Research Association.
3. American Psychological Association. (2002). Ethical principles of psychologists and code of conduct. American Psychologist, 57, 1060-1073. http://dx.doi.org/10.1037/0003-066X.57.12.1060
4. American Psychological Association. (2013). Specialty guidelines for forensic psychology. American Psychologist, 68, 7-19. http://dx.doi.org/10.1037/a0029889
5. Archer, R. P., Buffington-Vollum, J. K., Stredny, R. V., & Handel, R. W. (2006). A survey of psychological test use patterns among forensic psychologists. Journal of Personality Assessment, 87, 84-94. http://dx.doi.org/10.1207/s15327752jpa8701_07
6. Boccaccini, M. T., Murrie, D. C., Rufino, K. A., & Gardner, B. O. (2014). Evaluator differences in Psychopathy Checklist-Revised factor and facet scores. Law and Human Behavior, 38, 337-345. http://dx.doi.org/10.1037/lhb0000069
7. Boccaccini, M. T., Turner, D. T., & Murrie, D. C. (2008). Do some evaluators report consistently higher or lower scores PCL-R scores than others? Findings from a statewide sample of sexually violent predator evaluations. Psychology, Public Policy, and Law, 14, 262-283. http://dx.doi.org/10.1037/a0014523
8. Brigham, J. C. (1999). What is forensic psychology, anyway? Law and Human Behavior, 23, 273-298. http://dx.doi.org/10.1023/A:1022304414537
9. Cooke, D. J., Hart, S., Logan, C., & Michie, C. (2012). Explicating the construct of psychopathy: Development and validation of a conceptual model, the Comprehensive Assessment of Psychopathic Personality (CAPP). The International Journal of Forensic Mental Health, 11, 242-252. http://dx.doi.org/10.1080/14999013.2012.746759
10. Cooke, D. J., & Michie, C. (2001). Refining the construct of psychopathy: Towards a hierarchical model. Psychological Assessment, 13, 171-188. http://dx.doi.org/10.1037/1040-3590.13.2.171
11. DeMatteo, D., & Edens, J. F. (2006). The role and relevance of the Psychopathy Checklist-Revised in court: A case law survey of U.S. courts (1991-2004). Psychology, Public Policy, and Law, 12, 214-241. http://dx.doi.org/10.1037/1076-8971.12.2.214
12. DeMatteo, D., Edens, J. F., Galloway, M., Cox, J., Smith, S. T., & Formon, D. (2014). The role and reliability of the Psychopathy Checklist-Revised in U.S. sexually violent predator evaluations: A case law survey. Law and Human Behavior, 38, 248-255. http://dx.doi.org/10.1037/lhb0000059
13. DeMatteo, D., Edens, J. F., Galloway, M., Cox, J., Smith, S. T., Koller, J. P., & Bersoff, B. (2014). Investigating the role of the Psychopathy Checklist-Revised in United States case law. Psychology, Public Policy, and Law, 20, 96-107. http://dx.doi.org/10.1037/a0035452
14. Douglas, K. S., Hart, S. D., Webster, C. D., & Belfrage, H. (2013). HCR-20V3 Historical, Clinical, Risk Management (Version 3): Professional guidelines for evaluating risk of violence. Burnaby, Canada: Mental Health, Law, and Policy Institute, Simon Fraser University.
15. Edens, J. F., Boccaccini, M. T., & Johnson, D. W. (2010). Inter-rater reliability of the PCL-R total and factor scores among psychopathic sex offenders: Are personality features more prone to disagreement than behavioral features? Behavioral Sciences & the Law, 28, 106-119. http://dx.doi.org/10.1002/bsl.918
16. Edens, J. F., & Cox, J. (2012). Examining the prevalence, role and impact of evidence regarding antisocial personality, sociopathy and psychopathy in capital cases: A survey of defense team members. Behavioral Sciences & the Law, 30, 239-255. http://dx.doi.org/10.1002/bsl.2009
17. Edens, J. F., Magyar, M. S., & Cox, J. (2013). Taking psychopathy measures "out of the lab" and into the legal system: Some practical concerns. In K. Kiehl & W. Sinnott-Armstrong (Eds.), Handbook on psychopathy and law (pp. 250-272). New York, NY: Oxford University Press.
18. Edens, J. F., Marcus, D. K., Lilienfeld, S. O., & Poythress, N. G., Jr. (2006). Psychopathic, not psychopath: Taxometric evidence for the dimensional structure of psychopathy. Journal of Abnormal Psychology, 115, 131-144. http://dx.doi.org/10.1037/0021-843X.115.1.131
19. Edens, J. F., & Petrila, J. (2006). Legal and ethical issues in the assessment and treatment of psychopathy. In C. Patrick (Ed.), Handbook of psychopathy (pp. 573-588). New York, NY: Guilford Press.
20. Farkas, G., DeLeon, P., & Newman, R. (1997). Sanity examiner certification: An evolving national agenda. Professional Psychology: Research and Practice, 28, 73-76. http://dx.doi.org/10.1037/0735-7028.28.1.73
21. Frost, L. E., de Camara, R. L., & Earl, T. R. (2006). Training, certification, and regulation of forensic evaluators. Journal of Forensic Psychology Practice, 6, 77-91. http://dx.doi.org/10.1300/J158v06n02_06
22. Guay, J. P., Ruscio, J., Knight, R. A., & Hare, R. D. (2007). A taxometric analysis of the latent structure of psychopathy: Evidence for dimensionality. Journal of Abnormal Psychology, 116, 701-716. http://dx.doi.org/10.1037/0021-843X.116.4.701
23. Guy, L. S., Edens, J. F., Anthony, C., & Douglas, K. S. (2005). Does psychopathy predict institutional misconduct among adults? A metaanalytic investigation. Journal of Consulting and Clinical Psychology, 73, 1056-1064. http://dx.doi.org/10.1037/0022-006X.73.6.1056
24. Hare, R. D. (1991). The Hare Psychopathy Checklist-Revised manual. North Tonawanda, NY: Multi-Health Systems.
25. Hare, R. D. (1998). The Hare PCL-R: Some issues concerning its use and misuse. Legal and Criminological Psychology, 3, 99-119. http://dx.doi.org/10.1111/j.2044-8333.1998.tb00353.x
26. Hare, R. D. (2003). The Hare Psychopathy Checklist-Revised manual (2nd ed.). North Tonawanda, NY: Multi-Health Systems.
27. Hare, R. D., & McPherson, L. M. (1984). Violent and aggressive behavior by criminal psychopaths. International Journal of Law and Psychiatry, 7, 35-50. http://dx.doi.org/10.1016/0160-2527(84)90005-0
28. Hare, R. D., & Neumann, C. S. (2010). The role of antisociality in the psychopathy construct: Comment on Skeem and Cooke (2010). Psychological Assessment, 22, 446-454. http://dx.doi.org/10.1037/a0013635
29. Harris, G. T., Rice, M. E., & Cormier, C. A. (2013). Research and clinical scoring of the psychopathy checklist can show good agreement. Criminal Justice and Behavior, 40, 1349-1362. http://dx.doi.org/10.1177/0093854813492959
30. Heilbrun, K. (1992). The role of psychological testing in forensic assessment. Law and Human Behavior, 16, 257-272. http://dx.doi.org/10.1007/BF01044769
31. Kennealy, P. J., Hicks, B. M., & Patrick, C. J. (2007). Validity of factors of the Psychopathy Checklist-Revised in female prisoners: Discriminant relations with antisocial behavior, substance abuse, and personality. Assessment, 14, 323-340. http://dx.doi.org/10.1177/1073191107305882
32. Leistico, A. M., Salekin, R. T., DeCoster, J., & Rogers, R. (2008). A large-scale meta-analysis relating the hare measures of psychopathy to antisocial conduct. Law and Human Behavior, 32, 28-45. http://dx.doi.org/10.1007/s10979-007-9096-6
33. Levenson, J. S. (2004). Reliability of sexually violent predator civil commitment criteria in Florida. Law and Human Behavior, 28, 357-368. http://dx.doi.org/10.1023/B:LAHU.0000039330.22347.ad
34. Lloyd, C. D., Clark, H. J., & Forth, A. E. (2010). Psychopathy, expert testimony, and indeterminate sentences: Exploring the relationship between Psychopathy Checklist-Revised testimony and trial outcome in Canada. Legal and Criminological Psychology, 15, 323-339. http://dx.doi.org/10.1348/135532509X468432
35. McDermott, P. A., Alterman, A. I., Cacciola, J. S., Rutherford, M. J., Newman, J. P., & Mulholland, E. M. (2000). Generality of Psychopathy Checklist-Revised factors over prisoners and substance-dependent patients. Journal of Consulting and Clinical Psychology, 68, 181-186. http://dx.doi.org/10.1037/0022-006X.68.1.181
36. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749. http://dx.doi.org/10.1037/0003-066X.50.9.741
37. Miller, C. S., Kimonis, E. R., Otto, R. K., Kline, S. M., & Wasserman, A. L. (2012). Reliability of risk assessment measures used in sexually violent predator proceedings. Psychological Assessment, 24, 944-953. http://dx.doi.org/10.1037/a0028411
38. Murrie, D. C., Boccaccini, M. T., Guarnera, L. A., & Rufino, K. A. (2013). Are forensic experts biased by the side that retained them? Psychological Science, 24, 1889-1897. http://dx.doi.org/10.1177/0956797613481812
39. Murrie, D. C., Boccaccini, M. T., Johnson, J. T., & Janke, C. (2008). Does interrater (dis)agreement on Psychopathy Checklist scores in sexually violent predator trials suggest partisan allegiance in forensic evaluations? Law and Human Behavior, 32, 352-362. http://dx.doi.org/10.1007/s10979-007-9097-5
40. Murrie, D. C., Boccaccini, M., Turner, D., Meeks, M., Woods, C., & Tussey, C. (2009). Rater (dis)agreement on risk assessment measures in sexually violent predator proceedings: Evidence of adversarial allegiance in forensic evaluation? Psychology, Public Policy, and Law, 15, 19-53. http://dx.doi.org/10.1037/a0014897
41. Murrie, D. C., Boccaccini, M., Zapf, P., Warren, J., & Henderson, C. (2008). Clinician variation in findings of competence to stand trial. Psychology, Public Policy, and Law, 14, 177-193. http://dx.doi.org/10.1037/a0013578
42. Neumann, C. S., Johansson, P. T., & Hare, R. D. (2013). The Psychopathy Checklist-Revised (PCL-R), low anxiety, and fearlessness: A structural equation modeling analysis. Personality Disorders: Theory, Research, and Treatment, 4, 129-137. http://dx.doi.org/10.1037/a0027886
43. Nicholson, R. A., & Norwood, S. (2000). The quality of forensic psychological assessments, reports, and testimony: Acknowledging the gap between promise and practice. Law and Human Behavior, 24, 9-44. http://dx.doi.org/10.1023/A:1005422702678
44. Patrick, C. J., Fowles, D. C., & Krueger, R. F. (2009). Triarchic conceptualization of psychopathy: Developmental origins of disinhibition, boldness, and meanness. Development and Psychopathology, 21, 913-938. http://dx.doi.org/10.1017/S0954579409000492
45. Poythress, N. G., Lilienfeld, S. O., Skeem, J. L., Douglas, K. S., Edens, J. F., Epstein, M., & Patrick, C. J. (2010). Using the PCL-R to help estimate the validity of two self-report measures of psychopathy with offenders. Assessment, 17, 206-219. http://dx.doi.org/10.1177/1073191109351715
46. Poythress, N. G., & Petrila, J. (2010). PCL-R Psychopathy: Threats to sue, peer review, and potential implications for science and law: A commentary. The International Journal of Forensic Mental Health, 9, 3-10. http://dx.doi.org/10.1080/14999013.2010.483346
47. Quinsey, V. L., Harris, G. T., Rice, M. E., & Cormier, C. A. (1998). Violent offenders: Appraising and managing risk. Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10304-000
48. Rice, M. E., Harris, G. T., & Lang, C. (2013). Validation of and revision to the VRAG and SORAG: The Violence Risk Appraisal Guide-Revised (VRAG-R). Psychological Assessment, 25, 951-965. http://dx.doi.org/10.1037/a0032878
49. Rufino, K. A., Boccaccini, M. T., & Guy, L. S. (2011). Scoring subjectivity and item performance on measures used to assess violence risk: The PCL-R and HCR-20 as exemplars. Assessment, 18, 453-463. http://dx.doi.org/10.1177/1073191110378482
50. Rufino, K. A., Boccaccini, M. T., Hawes, S. W., & Murrie, D. C. (2012). When experts disagreed, who was correct? A comparison of PCL-R scores from independent raters and opposing forensic experts. Law and Human Behavior, 36, 527-537. http://dx.doi.org/10.1037/h0093988
51. R. v. Clancy, 2007 O. J. 3145 (August 16, 2007).
52. R. v. Fleming (D. P.), 2001 N. J. 12 (January 16, 2001).
53. R. v. McCallum, 2007 O. J. 5415 (December 17, 2007).
54. R. v. Nowdlak, 2005 N.U.C.J. 17 (September 9, 2005).
55. R. v. Paxton, 2013, ABQB 750 (December 19, 2013).
56. R. v. Tremblay (J. G.), 2000, A. R. 938 (August 3, 2000).
57. R. v. V. M., 2003 O. J. 436 (February 7, 2003).
58. Singh, J. P., Grann, M., & Fazel, S. (2011). A comparative study of violence risk assessment tools: A systematic review and metaregression analysis of 68 studies involving 25,980 participants. Clinical Psychology Review, 31, 499-513. http://dx.doi.org/10.1016/j.cpr.2010.11.009
59. Skeem, J. L., & Cooke, D. J. (2010a). Is criminal behavior a central component of psychopathy? Conceptual directions for resolving the debate. Psychological Assessment, 22, 433-445. http://dx.doi.org/10.1037/a0008512
60. Skeem, J. L., & Cooke, D. J. (2010b). One measure does not a construct make: Directions toward reinvigorating psychopathy research-Reply to Hare and Neumann (2010). Psychological Assessment, 22, 455-459. http://dx.doi.org/10.1037/a0014862
61. Sturup, J., Edens, J. F., Sörman, K., Karlberg, D., Fredriksson, B., & Kristiansson, M. (2014). Field reliability of the Psychopathy Checklist-Revised among life sentenced prisoners in Sweden. Law and Human Behavior, 38, 315-324. http://dx.doi.org/10.1037/lhb0000063
62. Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124-1131. http://dx.doi.org/10.1126/science.185.4157.1124
63. Viljoen, J. L., McLachlan, K., & Vincent, G. M. (2010). Assessing violence risk and psychopathy in juvenile and adult offenders: A survey of clinical practices. Assessment, 17, 377-395. http://dx.doi.org/10.1177/1073191109359587
64. Webster, C., Douglas, K., Eaves, D., & Hart, S. (1997). HCR-20: Assessing risk for violence, version 2. Burnaby, Canada: Mental Health, Law, and Policy Institute, Simon Fraser University.
65. Yang, M., Wong, S. C. P., & Coid, J. (2010). The efficacy of violence prediction: A meta-analytic comparison of nine risk assessment tools. Psychological Bulletin, 136, 740-767. http://dx.doi.org/10.1037/a0020473