Multirater Reliability of the Historical, Clinical, and Risk Management-20

Assessment

Volumn 21, Issue 1, 2014, Pages 15-27

  Penney, Stephanie R ^a   McMaster, Robert ^a   Wilkie, Treena ^a  

^a CENTRE FOR ADDICTION AND MENTAL HEALTH   (Canada)

Author keywords

HCR 20; interrater reliability; structured professional judgment; violence risk assessment

Indexed keywords

ADULT; ARTICLE; CANADA; COOPERATION; EXPERT WITNESS; FEMALE; FORENSIC PSYCHIATRY; HCR-20; HUMAN; INTERDISCIPLINARY COMMUNICATION; INTERRATER RELIABILITY; MALE; MENTAL HOSPITAL; OBSERVER VARIATION; PATIENT CARE; PERSONALITY TEST; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; REPRODUCIBILITY; RISK ASSESSMENT; RISK MANAGEMENT; STATISTICS; STRUCTURED PROFESSIONAL JUDGMENT; VALIDATION STUDY; VIOLENCE; VIOLENCE RISK ASSESSMENT;

HCR-20; INTERRATER RELIABILITY; STRUCTURED PROFESSIONAL JUDGMENT; VIOLENCE RISK ASSESSMENT;

ADULT; COMMITMENT OF MENTALLY ILL; COOPERATIVE BEHAVIOR; EXPERT TESTIMONY; FEMALE; FORENSIC PSYCHIATRY; HOSPITALS, PSYCHIATRIC; HUMANS; INTERDISCIPLINARY COMMUNICATION; MALE; OBSERVER VARIATION; ONTARIO; PATIENT CARE TEAM; PERSONALITY ASSESSMENT; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; RISK MANAGEMENT; VIOLENCE;

EID: 84897668213     PISSN: 10731911     EISSN: 15523489     Source Type: Journal    
DOI: 10.1177/1073191113514107     Document Type: Article

References (55)

1. Baca-García E.,Blanco C.,Sáiz-Ruiz J.,Rico F.,Diaz-Sastre C.,Cicchetti D. V.Assessment of reliability in the clinical evaluation of depressive symptoms among multiple investigators in a multicenter clinical trial.Psychiatry Research. 2001;102:163-173.
2. Belfrage H.Implementing the HCR-20 scheme for risk assessment in a forensic psychiatric hospital: Integrating research and clinical practice.The Journal of Forensic Psychiatry. 1998;9:328-338.
3. Bengtson S.,Pedersen L.Implementation of evidence-based practices in forensic psychiatric clinical practice in Denmark: Are we there?.Scandinavian Journal of Forensic Science. 2008;2:48-53.
4. Boccaccini M. T.,Turner D. B.,Murrie D. C.Do some evaluators report consistently higher or lower PCL-R scores than others? Findings from a statewide sample of sexually violent predator evaluations.Psychology, Public Policy, and Law. 2008;14:262-283.
5. Boccaccini M. T.,Turner D. B.,Murrie D. C.,Rufino K. A.Do PCL-R scores from state or defense experts best predict future misconduct among civilly committed sex offenders?.Law and Human Behavior. 2012;36:159-169.
6. Bono J. E.,Hooper A. C.,Yoon D. J.Impact of rater personality on transformational and transactional leadership ratings.The Leadership Quarterly. 2012;23:132-145.
7. Borum R.,Bartel P.,Forth A.Manual for the Structured Assessment for Violence Risk in Youth (SAVRY). Odessa, FL: Psychological Assessment Resources; 2006:.
8. Cicchetti D.,Fontana A.,Showalter D.Evaluating the reliability of multiple assessments of PTSD symptomatology: Multiple examiners, one patient.Psychiatry Research. 2009;166:269-280.
9. Cicchetti D. V.,Lord C.,Koenig K.,Klin A.,Volkmar F. R.Reliability of the ADI-R: Multiple examiners evaluate a single case.Journal of Autism and Developmental Disorders. 2008;38:764-770.
10. Cicchetti D. V.,Showalter D.,Rosenheck R.A new method for assessing interexaminer agreement when multiple ratings are made on a single subject: Applications to the assessment of neuropsychiatric symptomatology.Psychiatry Research. 1997;72:51-63.
11. Cicchetti D. V.,Volkmar F.,Klin A.,Showalter D.Diagnosing autism using ICD-10 criteria: A comparison of neural networks and standard multivariate procedures.Child Neuropsychology. 1995;1:26-37.
12. Connolly J. J.,Kavanagh E. J.,Viswesvaran C.The convergent validity between self and observer ratings of personality: A meta-analytic review.International Journal of Selection and Assessment. 2007;15:110-117.
13. Cooke D. J.,Michie C.,Ryan J.Evaluating risk for violence: A preliminary study of the HCR-20, PCL-R and VRAG in a Scottish prison sample. Edinburgh, United Kingdom:; 2001:.
14. Dernevik M.Preliminary findings on reliability and validity of the historical-clinical-risk assessment in a forensic psychiatric setting.Psychology, Crime & Law. 1998;4:127-137.
15. de Vogel V.,de Ruiter C.Differences between clinicians and researchers in assessing risk of violence in forensic psychiatric patients.The Journal of Forensic Psychiatry & Psychology. 2004;15:145-164.
16. de Vogel V.,de Ruiter C.Structured professional judgment of violence risk in forensic clinical practice: A prospective study into the predictive validity of the Dutch HCR-20.Psychology, Crime & Law. 2006;12:321-336.
17. DouglasK. S.BlanchardA. J. E.GuyL. S.ReevesK. A.WeirJ. (2010). HCR-20 violence risk assessment scheme: Overview and annotated bibliography. Retrieved November 21, 2013, from http://kdouglas.files.wordpress.com/2007/10/hcr-20-annotated-biblio-sept-2010.pdf.
18. Douglas K. S.,Cox D. N.,Webster C. D.Violence risk assessment: Science and practice.Legal and Criminological Psychology. 1999;4:149-184.
19. Douglas K. S.,Hart S. D.,Webster C. D.,Belfrage H.HCR-V3: Professional guidelines for evaluating risk of violence. Burnaby, BC: Mental Health, Law, and Policy Institute, Simon Fraser University; 2013:.
20. Douglas K. S.,Ogloff J. D.,Hart S. D.Evaluation of a model of violence risk assessment among forensic psychiatric patients.Psychiatric Services. 2003;54:1372-1378.
21. Douglas K. S.,Yeomans N.,Boer D. P.Comparative validity analysis of multiple measures of violence risk in a sample of criminal offenders.Criminal Justice and Behaviour. 2005;32:479-510.
22. Edens J. F.,Boccaccini M. T.,Johnson D. W.Inter-rater reliability of the PCL-R total and factor scores among psychopathic sex offenders: Are personality features more prone to disagreement than behavioral features?.Behavioral Sciences & the Law. 2010;28:106-119.
23. Epperson D. L.,Kaul J. D.,Hout S.,Hesselton D.,Alexander W.Minnesota Sex Offender Screening Tool-Revised (MnSOST-R). St. Paul, MN: Minnesota Department of Corrections; 1998:.
24. Farrington D. P.,Jolliffe D.,Johnston L.Assessing violence risk: A framework for practice. Paisley: Risk Management Authority Scotland; 2008:.
25. Fazel S.,Singh J. P.,Doll H.,Grann M.Use of risk assessment instruments to predict violence and antisocial behaviour in 73 samples involving 24,827 people: Systematic review and meta-analysis.British Medical Journal. 2012;345:1-12.
26. Fleiss J. L.The design and analysis of clinical experiments. New York: Wiley; 1986:.
27. Gray N.,Fitzgerald S.,Taylor J.,MacCulloch M.,Snowden R.Predicting future reconviction in offenders with intellectual disabilities: The predictive efficacy of VRAG, PCL-SV, and the HCR-20.Psychological Assessment. 2007;19:474-479.
28. Gray N. S.,Taylor J.,Snowden R. J.Predicting violence using structured professional judgment in patients with different mental and behavioral disorders.Psychiatric Research. 2011;187:248-253.
29. Hanson R. K.,Thornton D.Static-99: Improving actuarial risk assessments for sex offenders. Ottawa, ON: Department of the Solicitor General of Canada; 2000:.
30. Hare R. D.The Hare Psychopathy Checklist-Revised. 2003). The Hare Psychopathy Checklist-Revised (2nd ed.). Toronto, ON: Multi-Health Systems.Toronto, ON: Multi-Health Systems; 2003:.
31. Homant R. J.,Kennedy D. B.Subjective factors in the judgment of insanity.Criminal Justice and Behavior. 1987;14:38-61.
32. Konold T. R.,Glutting J. J.ADHD and method variance: A latent variable approach applied to a nationally representative sample of college freshman.Journal of Learning Disabilities. 2008;41:405-416.
33. Levenson J. S.Reliability of sexually violent predator civil commitment criteria in Florida.Law and Human Behavior. 2004;28:357-368.
34. Lloyd C. D.,Clark H. J.,Forth A. E.Psychopathy, expert testimony and indeterminate sentences: Exploring the relationship between Psychopathy Checklist-Revised testimony and trial outcome in Canada.Legal and Criminological Psychology. 2010;15:323-339.
35. McGraw K. O.,Wong S. P.Forming inferences about some intraclass correlation coefficients.Psychological Methods. 1996;1:30-46.
36. McNiel D.,Chamberlain J.,Weaver C.,Hall S.,Fordwood S.,Binder R.Impact of clinical training on violence risk assessment.American Journal of Psychiatry. 2008;165:195-200.
37. McNiel D. E.,Eisner J. P.,Binder R. L.The relationship between aggressive attributional style and violence by psychiatric patients.Journal of Consulting and Clinical Psychology. 2003;71:399-403.
38. Miller A. K.,Rufino K. A.,Boccaccini M. T.,Jackson R. L.,Murrie D. C.On individual differences in person perception: Raters' personality traits relate to their psychopathy checklist-revised scoring tendencies.Assessment. 2011;18:253-260.
39. Miller C. S.,Kimonis E. R.,Otto R. K.,Kline S. M.,Wasserman A. L.Reliability of risk assessment measures used in sexually violent predator proceedings.Psychological Assessment. 2012;24:944-953.
40. Monahan J.Predicting violent behavior: An assessment of clinical techniques. Beverly Hills, CA: Sage; 1981:.
41. Murrie D. C.,Boccaccini M. T.,Johnson J. T.,Janke C.Does interrater (dis)agreement on Psychopathy Checklist scores in sexually violent predator trials suggest partisan allegiance in forensic evaluations?.Law and Human Behavior. 2008;32:352-362.
42. Murrie D. C.,Boccaccini M. T.,Turner D. B.,Meeks M.,Woods C.,Tussey C.Rater (dis)agreement on risk assessment measures in sexually violent predator proceedings: Evidence of adversarial allegiance in forensic evaluation?.Psychology, Public Policy, and Law. 2009;15:19-53.
43. Nunnally J. C.,Bernstein I. H.Psychometric theory. 1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.New York, NY: McGraw-Hill; 1994:.
44. O'Shea L. E.,Mitchell A. E.,Picchioni M. M.,Dickens G. L.Moderators of the predictive efficacy of the Historical, Clinical and Risk Management-20 for aggression in psychiatric facilities: Systematic review and meta-analysis.Aggression and Violent Behavior. 2013;18:255-270.
45. Pedersen L.,Rasmussen K.,Elsass P.Risk assessment: The value of structured professional judgments.International Journal of Forensic Mental Health. 2010;9:74-81.
46. Pilgrim J. A.,Mellers J. D.,Boothby H. A.,Mann A. H.Inter-rater and temporal reliability of the standardized assessment of personality and the influence of informant characteristics.Psychological Medicine. 1993;23:779-786.
47. Quinsey V. L.,Harris G. T.,Rice M. E.,Cormier C. A.Violent offenders: Appraising and managing risk. Washington, DC: American Psychological Association; 1998:.
48. Rufino K.,Boccaccini M.T.,Guy L.Scoring subjectivity and item performance on measures used to assess violence risk: The PCL-R and HCR-20 as exemplars.Assessment. 2011;18:453-463.
49. Rufino K. A.,Boccaccini M. T.,Hawes S.,Murrie D. C.When experts disagreed, who was correct? A comparison of PCL-R scores from independent raters and opposing forensic experts.Law and Human Behavior. 2012;36:527-537.
50. Shrout P. E.,Fleiss J. L.Intraclass correlations: Uses in assessing rater reliability.Psychological Bulletin. 1979;86:420-428.
51. Telles L. E. B.,Day V. P.,Folino J. O.,Taborda J. G. V.Reliability of the Brazilian version of HCR-20 assessing risk for violence.Revista Brasileira De Psiquiatria. 2009;31:253-256.
52. Vincent G. M.,Guy L. S.,Fusco S. L.,Gershenson B. G.Field reliability of the SAVRY with juvenile probation officers: Implications for training.Law and Human Behavior. 2011;36:225-236.
53. Volkmar F.R.,Cicchetti D.V.,Dykens E.,Sparrow S.S.,Leckman J.F.,Cohen D.J.An evaluation of the Autism Behavior Checklist.Journal of Autism and Developmental Disorders. 1988;18:81-97.
54. Webster C. D.,Douglas K. S.,Eaves D.,Hart S. D.HCR-20: Assessing risk for violence. Burnaby, BC: Mental Health, Law, and Policy Institute, Simon Fraser University; 1997:.
55. Webster C. D.,Eaves D.,Douglas K. S.,Wintrup A.The HCR-20 scheme: The assessment of dangerousness and risk. Burnaby, BC: Mental Health, Law, and Policy Institute, Simon Fraser University; 1995:.