Inter-Rater and Test-Retest Reliability, Internal Consistency, and Factorial Structure of the Instrument for Forensic Treatment Evaluation

Journal of Forensic Psychology Practice

Volumn 14, Issue 2, 2014, Pages 127-144

  Schuringa, Erwin ^a   Spreen, Marinus ^a,b   Bogaerts, Stefan ^a,c  

^a Research Department of Forensic Psychiatric Center Dr S van Mesdag   (Netherlands)

^b NHL STENDEN UNIVERSITY OF APPLIED SCIENCES   (Netherlands)

^c TILBURG UNIVERSITY   (Netherlands)

Author keywords

instrument for forensic treatment evaluation; internal consistency; reliability; routine outcome monitoring

Indexed keywords

ADULT; AGED; ARTICLE; BEHAVIOR; COGNITIVE THERAPY; EQUIPMENT; FACTORIAL ANALYSIS; HOSPITALIZATION; HUMAN; INSTRUMENT FOR FORENSIC TREATMENT EVALUATION; INTERNAL CONSISTENCY; INTERRATER RELIABILITY; MAJOR CLINICAL STUDY; MENTAL PATIENT; RECIDIVISM; RISK ASSESSMENT; RISK MANAGEMENT; TEST RETEST RELIABILITY; VALIDITY;

EID: 84898606611     PISSN: 15228932     EISSN: 15229092     Source Type: Journal    
DOI: 10.1080/15228932.2014.897536     Document Type: Article

References (50)

1. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
2. Andrews, D. A., & Bonta, J. (1995). The level of service inventory-Revised user's manual. Toronto, Ontario: Multi-Health System.
3. Andrews, D. A., & Bonta, J. (2010). Rehabilitating criminal justice policy and practice. Psychology, Public Policy, and Law, 16, 39-55. doi:10.1037/a0018362
4. Andrews, D. A., Bonta, J., & Hoge, R. D. (1990). Classification for effective rehabilitation: Rediscovering psychology. Criminal Justice and Behavior, 17, 19-52. doi:10.1177/0093854890017001004
5. Andrews, D. A., Bonta, J., & Wormith, J. S. (2006). The recent past and near future of risk and/or need assessment. Crime & Delinquency, 52, 7-27. doi:10.1177/0011128705281756
6. Bo, S., Abu-Akel, A., Kongerslev, M., Haahr, U. H., & Simonsen, E. (2011). Risk factors for violence among patients with schizophrenia. Clinical Psychology Review, 31, 711-726. doi:10.1016/j.cpr.2011.03.002
7. Bogaerts, S., Vanheule, S., & DeClercq, F. (2005). Recalled parental bonding, adult attachment style, and personality disorders in child molesters: A comparative study. The Journal of Forensic Psychiatry & Psychology, 16, 445-458. doi:10.1080/14789940500094524
8. de Ruiter, C., & Nicholls, T. L. (2011). Protective factors in forensic mental health: A new frontier. International Journal of Forensic Mental Health, 10, 160-170. doi:10.1080/14999013.2011.600602
9. Desmarais, S. L., Nicholls, T. L., Wilson, C. M., & Brink, J. (2012). Using dynamic risk and protective factors to predict inpatient aggression: Reliability and validity of START. Psychological Assessment, 24, 685-700. doi: 10.1037/a0026668
10. Desmet, M., Vanheule, S., Groenvynck, H., Verhaeghe, P., Vogel, J., & Bogaerts, S. (2007). The Depressive Experiences Questionnaire. An inquiry into the different scoring procedures. European Journal of Psychological Assessment, 23, 89-98. doi:10.1027/1015-5759.23.2.89
11. de Vogel, V., de Vries, R. M., de Ruiter, C., & Bouman, Y. H. A. (2011). Assessing protective factors in forensic psychiatric practice: Introducing the SAPROF. International Journal of Forensic Mental Health, 10, 171-177. doi:10.1080/14999013.2011.600230
12. Douglas, K. S., Hart, S. D., Webster, C. D., & Belfrage, H. (2013). HCR-20V3: Assessing risk of violence-User guide. Burnaby, Canada: Mental Health, Law, and Policy Institute, Simon Fraser University.
13. Douglas, K. S., & Kropp, P. R. (2002). A prevention-based paradigm for violence risk assessment: Clinical and research applications. Criminal Justice and Behavior, 29, 617-658. doi:10.1177/009385402236735
14. Douglas, K. S., & Skeem, J. L. (2005). Violence risk assessment: Getting specific about being dynamic. Psychology, Public Policy, and Law, 11, 347-383. doi:10.1037/1076-8971.11.3.347
15. Doyle, M., & Dolan, M. (2006). Predicting community violence from patients discharged from mental health services. The British Journal of Psychiatry: The Journal of Mental Science, 189, 520-526. doi:10.1192/bjp.bp.105.021204
16. Field, A. (2009). Discovering statistics using SPSS (and sex and drugs and rock 'n' roll). Los Angeles, CA: Sage.
17. Gendrau, P., Little, T., & Goggin, C. (1996). A meta-analysis of the predictors of adult offender recidivism: What works! Criminology, 34, 575-608. doi:10.1111/j.1745-9125.1996.tb01220.x
18. Gunderman, R. B., & Chan, S. (2013). The 13-point Likert scale: A breakthrough in educational assessment. Academic Radiology, 20, 1466-1467. doi:10.1016/j.acra.2013.04.010
19. Hanson, R. K., & Harris, A. J. R. (2000). Where should we intervene? Dynamic predictors of sexual offense recidivism. Criminal Justice and Behavior, 27, 6-35. doi:10.1177/0093854800027001002
20. Hildebrand, M., Hesper, B. L., Spreen, M., & Nijman, H. L. I. (2005). De waarde van gestructureerde risicotaxatie en van de diagnose psychopathie: een onderzoek naar de betrouwbaarheid van de HCR-20, HKT-30 en PCL-r 2005. [The value of structured risk assessment and of the diagnosis psychopathy: A study into the reliability of the HCR-20, HKT-30 and PCL-r 2005]. Utrecht, The Netherlands: Expertisecentrum Forensische Psychiatrie.
21. Hodge, D. R., & Gillespie, D. (2003). Phrase completions: An alternative to Likert scales. Social Work Research, 27, 45-54. doi:10.1093/swr/27.1.45
22. Hodgins, S., & Riaz, M. (2011). Violence and phases of illness: Differential risk and predictors. European Psychiatry, 26, 518-524. doi:10.1016/j.eurpsy.2010.09.006
23. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174. doi:10.2307/2529310
24. Leung, S.-O. (2011). A comparison of psychometric properties and normality in 4-, 5-, 6-, and 11-point Likert scales. Journal of Social Service Research, 37, 412-421. doi:10.1080/01488376.2011.580697
25. Lewis, K., Olver, M. E., & Wong, S. C. (2013). The Violence Risk Scale: Predictive validity and linking changes in risk with violent recidivism in a sample of high-risk offenders with psychopathic traits. Assessment, 20, 150-64. doi:10.1177/1073191112441242
26. Michel, S. F., Riaz, M., Webster, C., Hart, S. D., Levander, S., Muller-Isberner, R. J. Hodgins, S. (2013). Using the HCR-20 to predict aggressive behavior among men with schizophrenia living in the community: Accuracy of prediction, general and forensic settings, and dynamic risk factors. International Journal of Forensic Mental Health, 12, 1-13. doi:10.1080/14999013.2012.760182
27. Nederlof, A. F., Muris, P., & Hovens, J. E. (2011). Threat/control-override symptoms and emotional reactions to positive symptoms as correlates of aggressive behavior in psychotic patients. The Journal of Nervous and Mental Disease, 199, 342-347. doi:10.1097/NMD.0b013e3182175167
28. Olver, M. E., & Wong, S. C. P. (2011). A comparison of static and dynamic assessment of sexual offender risk and need in a treatment context. Criminal Justice and Behavior, 38, 113-126. doi:10.1177/0093854810389534
29. Pearse, N. (2011). Deciding on the scale granularity of response categories of Likert type scales: The case of a 21-point scale. Electronic Journal of Business Research Methods, 9, 159-171.
30. Pejtersen, J. H., Bjorner, J. B., & Hasle, P. (2010). Determining minimally important score differences in scales of the Copenhagen Psychosocial Questionnaire. Scandinavian Journal of Public Health, 38, 33-41. doi:10.1177/1403494809347024
31. Slade, M., Beck, A., Bindman, J., Thornicroft, G., & Wright, S. (1999). Routine clinical outcome measures for patients with severe mental illness: CANSAS and HoNOS. The British Journal of Psychiatry: The Journal of Mental Science, 174, 404-8. doi:10.1192/bjp.174.5.404
32. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428. doi:10.1037//0033-2909.86.2.420.
33. Stein, G. S. (1999). Usefulness of the Health of the Nation Outcome Scales. The British Journal of Psychiatry: The Journal of Mental Science, 174, 375-377. doi:10.1192/bjp.174.5.375
34. Streiner, D. L. (2003). Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment, 80, 99-103. doi:10.1207/S15327752JPA8001_18
35. Terwee, C. B., Bot, S. D. M., de Boer, B. M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, de Vet, V. H. C. W. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60, 34-42. doi:10.1016/j.jclinepi.2006.03.012
36. Tinsley, H. E., & Tinsley, D. J. (1987). Uses of factor analysis in counseling psychology research. Journal of Counseling Psychology, 34, 414-424. doi:10.1037//0022-0167.34.4.414
37. van Marle, H. J. C. (2002). The Dutch Entrustment Act: Its principles and innovations. International Journal of Forensic Mental Health, 1, 83-92. doi:10.1080/14999013.2002.10471163
38. van Nieuwenhuizen, C., Bogaerts, S., de Ruijter, E. A. W., Bongers, I. L., Coppens, M., & Meijers, S. (2011). TBS-behandeling geprofileerd: Een gestructureerde casussenanalyse. [Profiling TBS-treatment: a structured cases analysis]. Tilburg: Geestelijke Gezondheidszorg Eindhoven.
39. Vess, J. (2001). Development and implementation of a functional skills measure for forensic psychiatric inpatients. Journal of Forensic Psychiatry, 12, 592-609. doi:10.1080/09585180110092001
40. Vitacco, M. J., Gonsalves, V., Tomony, J., Smith, B. E. R., & Lishner, D. A. (2012). Can standardized measures of risk predict inpatient violence? Combining static and dynamic variables to improve accuracy. Criminal Justice and Behavior, 39, 589-606. doi:10.1177/0093854812436786
41. Wakeling, H. C., Freemantle, N., Beech, A. R., & Elliott, I. A. (2011). Identifying predictors of recidivism in a large sample of United Kingdom sexual offenders: A prognostic model. Psychological Services, 8, 307-318. doi:10.1037/a0025516
42. Webster, C. D., Douglas, K. S., Eaves, D., & Hart, S. D. (1997). HCR-20. Assessing risk for violence, Version 2. Burnaby, British Columbia, Canada: Simon Fraser University, Mental Health, Law and Policy Institute.
43. Webster, C. D., Martin, M. L., Brink, J., Nicholls, T. L., & Middleton, C. (2004). Short Term Assessment of Risk and Treatability: An evaluation and planning guide. Hamilton, Ontario-Port Coquitlam, British Columbia: St. Joseph's Healthcare-Forensic Psychiatric Services Commission.
44. Webster, C. D., Nicholls, T. L., Martin, M. L., Desmarais, S. L., & Brink, J. (2006). Short-term assessment of risk and treatability: The case for a new structured professional judgment scheme. Behavioral Sciences & the Law, 24, 747-766. doi:10.1002/bsl.737
45. Willems, M., Emons, W. H. M., Bogaerts, S., & Spreen, M. (in revision). The psychometric characteristics of the HKT-R risk assessment scheme: An evaluation of factorial structure, reliability, and inter-rater reliability. Criminal Justice & Behavior.
46. Wing, J. K., Beevor, A. S., Curtis, R. H., Park, S. B., Hadden, S., & Burns, A. (1998). Health of the Nation Outcome Scales. Research and development. The British Journal of Psychiatry: The Journal of Mental Science, 172, 11-18. doi:10.1192/bjp.172.1.11
47. Wong, S. C. P., & Gordon, A. (2006). The validity and reliability of the Violence Risk Scale: A treatment-friendly violence risk assessment tool. Psychology, Public Policy, and Law, 12, 279-309. doi:10.1037/1076-8971.12.3.279
48. Wong, S. C. P., Gordon, A., & Gu, D. (2007). Assessment and treatment of violence-prone forensic clients: An integrated approach. British Journal of Psychiatry, 190, 66-74. doi:10.1192/bjp.190.5.s66
49. Workgroup Risk Assessment Forensic Psychiatry. (2002). Manual HKT-30, version 2002. The Hague: Dutch Justice Department.
50. Yang, M., Wong, S. C., & Coid, J. (2010). The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools. Psychological Bulletin, 136, 740-767. doi:10.1037/a0020473