Assessment of Multiple Risk Outcomes, Strengths, and Change with the START:AV: A Short-Term Prospective Study with Adolescent Offenders

International Journal of Forensic Mental Health

Volumn 11, Issue 3, 2012, Pages 165-180

  Viljoen, Jodi L ^a   Beneteau, Jennifer L ^a   Gulbransen, Erik ^a   Brodersen, Etta ^a   Desmarais, Sarah L ^b   Nicholls, Tonia L ^c   Cruise, Keith R ^d  

^a SIMON FRASER UNIVERSITY   (Canada)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^d FORDHAM UNIVERSITY   (United States)

Author keywords

dynamic; risk assessment; self harm; strengths; substance abuse; suicide; victimization; violence

Indexed keywords

EID: 84869396112     PISSN: 14999013     EISSN: 19329903     Source Type: Journal    
DOI: 10.1080/14999013.2012.737407     Document Type: Article

References (85)

1. Abidin, Z. 2011, November. Prospective Validation Cohort Study of structured professional judgement instruments START and SAPROF in forensic mental health services, Killarney, Ireland: College of Psychiatry of Ireland Winter Conference.
2. American Psychological Association. 2006. Evidence-based practice in psychology. American Psychologist, 61(4): 271-285. doi:10.1037/0003-066X.61.4.271
3. American Psychological Association. 2007. Guidelines for Psychological Practice With Girls and Women. American Psychologist, 62(9): 949-979. doi:10.1037/0003-066X.62.9.949
4. American Psychological Association Task Force on Evidence-Based Practice for Children and Adolescents. 2008. Disseminating evidence-based practice for children and adolescents: A systems approach to enhancing care, Washington, DC: American Psychological Association.
5. Archer, R. P., Simonds-Bisbee, E. C., Spiegel, D. R., Handel, R. W. and Elkins, D. E. 2010. Validity of the Massachusetts Youth Screening Instrument-2 (MAYSI-2) scales in juvenile justice settings. Journal of Personality Assessment, 92(4): 337CA-348. doi:10.1080/00223891. 2010.482009
6. Archer, R. P., Stredny, R. V., Mason, J. A. and Arnau, R. C. 2004. An examination and replication of the psychometric properties of the Massachusetts Youth Screening Instrument-Second Edition (MAYSI-2) among adolescents in detention settings. Assessment, 11: 290-302. doi:10.1177/1073191104269863
7. Baron, R. M. and Kenny, D. A. 1986. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal Of Personality And Social Psychology, 51(6): 1173-1182. doi:10.1037/0022-3514.51.6.1173
8. Bauer, S., Lambert, M. J. and Nielsen, S. 2004. Clinical significance methods: A comparison of statistical techniques. Journal of Personality Assessment, 82(1): 60-70. doi:10.1207/s15327752jpa8201_11
9. Becker, D. F. and Grilo, C. M. 2007. Prediction of suicidality and violence in hospitalized adolescents: Comparisons by sex. The Canadian Journal of Psychiatry / La Revue Canadienne De Psychiatrie, 52(9): 572-580. Retrieved fromhttp://cat.inist.fr/?aModele=afficheN&cpsidt= 19138858
10. Blair, R. and Lawson, S. B. 1982. Another look at the robustness of the product-moment correlation coefficient to population non-normality. Florida Journal of Educational Research, 24: 11-15. Retrieved fromhttp://psycnet.apa.org/psycinfo/1983-20165-001
11. Borum, R. 2003. Managing at-risk juvenile offenders in the community: Putting evidence-based principles into practice. Journal of Contemporary Criminal Justice, 19(1): 114-137. doi:10.1177/1043986202239745
12. Borum, R., Bartel, P. and Forth, A. 2006. Manual for the Structured Assessment of Violence Risk in Youth (SAVRY), Odessa, FL: Psychological Assessment Resources.
13. Bosworth, K. and Espelage, D. 1995. Teen Conflict Survey, Bloomington, IN: Center for Adolescent Studies, Indiana University. (Unpublished)
14. Braithwaite, E., Charette, Y., Crocker, A. G. and Reyes, A. 2010. The predictive validity of clinical ratings of the Short-Term Assessment of Risk and Treatability (START). The International Journal of Forensic Mental Health, 9(4): 271-281. doi:10.1080/14999013.2010.534378
15. Brame, R., Fagan, J., Piquero, A. R., Schubert, C. A. and Steinberg, L. 2004. Criminal Careers of Serious Delinquents in Two Cities. Youth Violence And Juvenile Justice, 2(3): 256-272. doi:10.1177/1541204004265877
16. Brausch, A. M. and Gutierrez, P. M. 2010. Differences in Non-Suicidal Self-Injury and Suicide Attempts in Adolescents. Journal of Youth And Adolescence, 39(3): 233-242. doi:10.1007/s10964-009-9482-0
17. Calverley, D., Cotter, A. and Halla, E. 2010. Youth custody and community services in Canada, 2008/2009. Juristat, Catalogue no. 85-002-X, Vol. 30, no. 1. Ottawa, Statistics Canada, Canadian Centre for Justice Statistics. Retrieved fromhttp://www.statcan.gc.ca/pub/85-002-x/2010001/article/11147-eng.pdf
18. Carolina Population Center. 1999. National Longitudinal Study of Adolescent Health Wave II Adolescent In-Home Questionnaire Code Book Carolina Population Center, University of North Carolina at Chapel Hill. Available at: http://www.cpc.unc.edu/projects/addhealth/codebooks/wave2
19. Chu, C., Thomas, S. M., Ogloff, J. P. and Daffern, M. 2011. The predictive validity of the Short-Term Assessment of Risk and Treatability (START) in a secure forensic hospital: Risk factors and strengths. The International Journal of Forensic Mental Health, 10(4): 337-345. doi:10.1080/14999013.2011.629715
20. Cicchetti, D. V. and Sparrow, S. A. 1981. Developing criteria for establishing inter-rater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86(2): 127-137. Retrieved fromhttp://psycnet.apa.org/psycinfo/1982-00095-001
21. Cohen, J. 1988. Statistical power analysis for the behavioral sciences (2nd ed.), Mahwah, NJ: Lawrence Erlbaum.
22. Costa, P. T. and McCrae, R. R. 1988. Personality in adulthood: A six-year longitudinal study of self-reports and spouse ratings on the NEO Personality Inventory. Journal of Personality And Social Psychology, 54(5): 853-863. doi:10.1037/0022-3514.54.5.853
23. de Ruiter, C. and Nicholls, T. L. 2011. Protective factors in forensic mental health: A new frontier. The International Journal of Forensic Mental Health, 10(3): 160-170. doi:10.1080/14999013.2011.600602
24. Desmarais, S. L., Nicholls, T. L., Wilson, C. M. and Brink, J. 2012. Using dynamic risk and protective factors to predict inpatient aggression: Reliability and validity of START assessments. Psychological Assessment, doi:10.1037/a0026668
25. Desmarais, S. L., Sellers, B. G., Viljoen, J. L., Cruise, K. R., Nicholls, T. L. and Dvoskin, J. 2012. Pilot implementation and preliminary evaluation of START:AV assessments in secure juvenile correctional facilities. International Journal of Forensic Mental Health, 11(3), 150-164. doi: 10.1080/14999013.2012.737405
26. de Vogel, V., de Ruiter, C., Bouman, Y. and de Vries Robbé, M. 2009. SAPROF. Guidelines for the assessment of protective factors for violence risk. English Version, Utrecht, The Netherlands: Forum Educatief.
27. de Vries Robbé, M., de Vogel, V. and de Spa, E. 2011. Protective factors for violence risk in forensic psychiatric patients: A retrospective validation study of the SAPROF. The International Journal of Forensic Mental Health, 10(3): 178-186. doi:10.1080/14999013.2011.600232
28. Donovan, J. E. and Jessor, R. 1985. Structure of problem behavior in adolescence and young adulthood. Journal Of Consulting And Clinical Psychology, 53(6): 890-904. doi:10.1037/0022-006X.53.6.890
29. Douglas, K. S. and Skeem, J. L. 2005. Violence risk assessment: Getting specific about being dynamic. Psychology, Public Policy, And Law, 11(3): 347-383. doi:10.1037/1076-8971.11.3.347
30. Douglas, K. S., Skeem, J. L. and Nicholson, E. 2011. "Research methods in violence risk assessment". In Research methods in forensic psychology, Edited by: Rosenfeld, B., Penrod, S. D., Rosenfeld, B. and Penrod, S. D. 325-346. Hoboken, NJ: John Wiley & Sons.
31. Doyle, M., Lewis, G. and Brisbane, M. 2008. Implementing the Short-term Assessment of Risk and Treatability (START) in a forensic mental health service. Psychiatric Bulletin, 32(11): 406-408. doi:10.1192/pb.bp.108.019794
32. Duncan, T. E., Duncan, S. C. and Strycker, L. A. 2006. An introduction to latent variable growth curve modeling: Concepts, issues, and applications (2nd ed.), Mahwah, NJ: Lawrence Erlbaum.
33. George, D. and Mallery, P. 2003. SPSS for Windows step by step: A simple guide and reference. 11.0 update (4th ed.), Boston: Allyn & Bacon.
34. Gray, N. S., Benson, R., Craig, R., Davies, H., Fitzgerald, S., Huckle, P. and Snowden, R. J. 2011. The Short-Term Assessment of Risk and Treatability (START): A prospective study of inpatient behavior. The International Journal of Forensic Mental Health, 10(4): 305-313. doi:10.1080/14999013.2011.631692
35. Gray, N. S., Hill, C., McGleish, A., Timmons, D., MacCulloch, M. J. and Snowden, R. J. 2003. Prediction of violence and self-harm in mentally disordered offenders: A prospective study of the efficacy of HCR-20, PCL-R, and psychiatric symptomatology. Journal of Consulting And Clinical Psychology, 71(3): 443-451. doi:10.1037/0022-006X.71.3.443
36. Grisso, T. 1998. Forensic evaluation of juveniles, Sarasota, FL: Professional Resource Press/Professional Resource Exchange.
37. Grisso, T. and Barnum, R. 2003. Massachusetts Youth Screening Instrument-Version User's manual and technical report., Sarasota, FL: Professional Resource Press.
38. Grisso, T., Barnum, R., Fletcher, K. E., Cauffman, E. and Peuschold, D. 2001. Massachusetts Youth Screening Instrument for mental health needs of juvenile justice youths. Journal of the American Academy of Child and Adolescent Psychiatry, 40: 541-548. doi:10.1097/00004583-200105000-00013
39. Hoge, R., Andrews, D. A. and Leschied, A. 2011. Youth Level of Service/Case Management Inventory 2.0: YLS/CMI 2.0 Manual, Toronto, Canada: Multi-Health Systems.
40. Holmbeck, G. N. 1997. Toward terminological, conceptual, and statistical clarity in the study of mediators and moderators: Examples from the child-clinical and pediatric psychology literatures. Journal of Consulting and Clinical Psychology, 65(4): 599-610. doi:10.1037/0022-006X.65.4.599
41. Hsu, L. M. 1989. Reliable changes in psychotherapy: Taking into account regression toward the mean. Behavioral Assessment, 11(4): 459-467. Retrieved fromhttp://web.ebscohost.com
42. Huizinga, D., Esbensen, F. and Weiher, A. 1991. Are there multiple pathways to delinquency? Denver youth survey. Journal of Criminal Law and Criminology, 82: 83-118. Retrieved fromhttp://heinonline.org/HOL/Page?handle=hein.journals/jclc82&div=13& g_sent=1&collection=journals
43. Jacobson, N. S. and Truax, P. 1991. Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1): 12-19. doi:10.1037/0022-006X.59.1.12
44. Kirk, D. S. 2006. Examining the Divergence Across Self-report and Official Data Sources on Inferences About the Adolescent Life-course of Crime. Journal of Quantitative Criminology, 22(2): 107-129. doi:10.1007/s10940-006-9004-0
45. Knight, G. P., Little, M., Losya, S. H. and Mulvey, E. P. 2004. The self-report of offending among serious juvenile offenders: Cross-gender, cross-ethnic/race measurement equivalence. Youth Violence and Juvenile Justice, 2: 273-295. doi:10.1177/1541204004265878
46. Kooyman, I., Dean, K., Harvey, S. and Walsh, E. 2007. Outcomes of public concern in schizophrenia. The British Journal of Psychiatry. Supplement, 50: 29-36. doi:10.1192/bjp.191.50.s29
47. Kowalski, C. J. 1972. On the Effects of Non-normality on the Distribution of the Sample Product-moment Correlation Coefficient. Journal of The Royal Statistical Society: Series C (Applied Statistics), 21(1): 1 Retrieved fromhttp://www.jstor.org/stable/pdfplus/2346598.pdf?acceptTC=true
48. Kroppan, E., Nesset, M. B., Nonstad, K., Pedersen, T. W., Almvik, R. and &Palmstierna, T. 2011. Implementation of the Short Term Assessment of Risk and Treatability (START) in a forensic high secure unit. The International Journal of Forensic Mental Health, 10(1): 7-12. doi:10.1080/14999013.2011.552368
49. Lodewijks, H. B., de Ruiter, C. and Doreleijers, T. H. 2010. The impact of protective factors in desistance from violent reoffending: A study in three samples of adolescent offenders. Journal of Interpersonal Violence, 25(3): 568-587. doi:10.1177/0886260509334403
50. Lunnen, K. M. and Ogles, B. M. 1998. A multiperspective, multivariable evaluation of reliable change. Journal of Consulting and Clinical Psychology, 66(2): 400-410. doi:10.1037/0022-006X.66.2.400
51. Maasen, G. H. 2001. The unreliable change of reliable change indices. Behaviour Research And Therapy, 39(4): 495-498. doi:10.1016/S0005-7967(00)00029-2
52. MacCallum, R. C., Zhang, S., Preacher, K. J. and Rucker, D. D. 2002. On the practice of dichotomization of quantitative variables. Psychological Methods, 7(1): 19-40. doi:10.1037/1082-989X.7.1.19
53. Marsden, J., Eastwood, B., Wright, C., Bradbury, C., Knight, J. and Hammond, P. 2011. How best to measure change in evaluations of treatment for substance use disorder. Addiction, 106(2): 294-302. doi:10.1111/j.1360-0443.2010.03143.x
54. McGraw, K. O. and Wong, S. P. 1996. Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1): 30-46. doi:10.1037/1082-989X.1.1.30
55. Morris, R. E., Harrison, E. A., Knox, G. W. and Tromanhauser, E. 1995. Health risk behavioral survey from 39 juvenile correctional facilities in the United States. Journal of Adolescent Health, 17(6): 334-344. doi:10.1016/1054-139X(95)00098-D
56. Mossman, D. 1994. Further comments on portraying the accuracy of violence predictions. Law and Human Behavior, 18(5): 587-593. doi:10.1007/BF01499177
57. Muehlenkamp, J. J., Cowles, M. L. and Gutierrez, P. M. 2010. Validity of the Self-Harm Behavior Questionnaire with diverse adolescents. Journal of Psychopathology And Behavioral Assessment, 32(2): 236-245. doi:10.1007/s10862-009-9131-7
58. Multisite Violence Prevention Project. 2004. Description of Measures: Cohort-wide student survey, 2004a, Atlanta, GA: Available from the Centers for Disease Control and Prevention, National Center for Injury Prevention and Control. (Unpublished)
59. Nicholls, T. L., Brink, J., Desmarais, S. L., Webster, C. D. and Martin, M. 2006. The Short-Term Assessment of Risk and Treatability (START): A prospective validation study in a forensic psychiatric sample. Assessment, 13(3): 313-327. doi:10.1177/1073191106290559
60. Nicholls, T. L., Viljoen, J. L., Cruise, K. R., Desmarais, S. L. and Webster, C. D. 2010. Short-Term Assessment of Risk and Treatability: Adolescent Version (START:AV) (abbreviated manual), Coquitlam, Canada: BC Mental Health and Addiction Services.
61. Nock, M. K., Holmberg, E. B., Photos, V. I. and Michel, B. D. 2007. Self-Injurious Thoughts and Behaviors Interview: Development, reliability, and validity in an adolescent sample. Psychological Assessment, 19(3): 309-317. doi:10.1037/1040-3590.19.3.309
62. Nock, M., Joiner, T., Gordon, K., Lloyd-Richardson, E. and Prinstein, M. 2006. Non-suicidal self-injury among adolescents: diagnostic correlates and relation to suicide attempts. Psychiatry Research, 144(1): 65-72. doi:10.1016/j.psychres.2006.05.010
63. Nonstad, K., Nesset, M. B., Kroppan, E., Pedersen, T. W., Nøttestad, J. a., Almvik, R. and Palmstierna, T. 2010. Predictive validity and other psychometric properties of the Short-Term Assessment of Risk and Treatability (START) in a Norwegian high secure hospital. The International Journal of Forensic Mental Health, 9(4): 294-299. doi:10.1080/14999013.2010.534958
64. Nunnally, J. C. 1967. Psychometric theory, New York, NY US: McGraw-Hill.
65. Ogles, B. M., Lunnen, K. M. and Bonesteel, K. 2001. Clinical significance: History, application, and current practice. Clinical Psychology Review, 21(3): 421-446. doi:10.1016/S0272-7358(99)00058-6
66. Olver, M. E., Stockdale, K. C. and Wormith, J. 2009. Risk assessment with young offenders: A meta-analysis of three assessment measures. Criminal Justice and Behavior, 36(4): 329-353. doi:10.1177/0093854809331457
67. Osbourne, J. W. 2002. Notes on the use of data transformation. Practical Assessment, Research & Evaluation, 8(6) Retrieved fromhttp://pareonline.net/getvn.asp?v=8&n=6
68. Penn, J. V., Esposito, C. L., Schaeffer, L. E., Fritz, G. K. and Spirito, A. 2003. Suicide attempts and self-mutilative behavior in a juvenile correctional facility. Journal of the American Academy Of Child & Adolescent Psychiatry, 42(7): 762-769. doi:10.1097/01.CHI.0000046869.56865.46
69. Penney, S. R., Lee, Z. and Moretti, M. M. 2010. Gender differences in risk factors for violence: An examination of the predictive validity of the Structured Assessment of Violence Risk in Youth. Aggressive Behavior, 36(6): 390-404. doi:10.1002/ab.20352
70. Prentky, R. and Righthand, S. 2003. Juvenile Sex Offender Assessment Protocol II (J-SOAP-II) manual, Washington, DC: U.S. Department of Justice, Office of Justice Programs, Office of Juvenile Justice and Delinquency Prevention. Retrieved fromhttps://www.ncjrs.gov/pdffiles1/ojjdp/202316.pdf
71. Rennie, C. E. and Dolan, M. C. 2010. The significance of protective factors in the assessment of risk. Criminal Behaviour and Mental Health, 20(1): 8-22. doi:10.1002/cbm.750
72. Royal College of Psychiatrists. 2008. Rethinking risk to others in mental health services: Final report of a scoping group, London, UK: Royal College of Psychiatrists. College report CR150
73. Search Institute. 2004. Developmental assets profile. Preliminary user manual, Minneapolis, MN: Search Institute.
74. Spice, A., Viljoen, J. L., Gretton, H. M. and Roesch, R. 2010. Psychological assessment for adult sentencing of juvenile offenders: An evaluation of the RSTI and the SAVRY. The International Journal of Forensic Mental Health, 9(2): 124-137. doi:10.1080/14999013.2010. 501846
75. Viljoen, S., Nicholls, T., Greaves, C., de Ruiter, C. and Brink, J. 2011. Resilience and successful community reintegration among female forensic psychiatric patients: A preliminary investigation. Behavioral Sciences & the Law, 29(5): 752-770. doi:10.1002/bsl.1001
76. Viljoen, J., Beneteau, J., Brodersen, E., Gulbransen, E., Cruise, K., Nicholls, T., Desmarais, S. and Douglas, K. 2012, April. Assessing Protective Factors in Adolescent Offenders: A Comparison of the SAVRY, YLS/CMI, and START:AV Paper presented at the International Association of Forensic Mental Health Services Conference, Miami, FL
77. Viljoen, J. L., Cruise, K. R., Nicholls, T. L., Desmarais, S. and Webster, C. D. 2012. Taking stock and taking steps: The case for an adolescent version of the Short-Term Assessment of Risk and Treatability International Journal of Forensic Mental Health,11(3), 135-149. doi: 10.1080/14999013.2012.737406
78. Vincent, G. M., Guy, L. S., Fusco, S. L. and Gershenson, B. G. 2012. Field reliability of the SAVRY with juvenile probation officers: Implications for training. Law And Human Behavior, 36(3): 225-236. doi:10.1037/h0093974
79. Webster, C. D., Douglas, K. S., Eaves, D. and Hart, S. D. 1997. HCR-20. Assessing the risk of violence. Version 2, Burnaby, Canada: Simon Fraser University and Forensic Psychiatric Services Commission of British Columbia.
80. Webster, C. D. and Hucker, S. J. 2007. Violence risk: Assessment and management, New York: John Wiley & Sons.
81. Webster, C. D., Martin, M.-L., Brink, J., Nicholls, T. L. and Desmarais, S. L. 2009. Manual for the Short-Term Assessment of Risk and Treatability (START), Port Coquitlam, BC Canada: British Columbia Mental Health and Addiction Services. (Version 1.1)
82. Webster, C. D., Martin, M. L., Brink, J., Nicholls, T. L. and Middleton, C. 2004. Manual for the Short-Term Assessment of Risk and Treatability (START), Version 1.0 (consultation ed.) St. Joseph's Healthcare Hamilton: Ontario, Canada-Forensic Psychiatric Services Commission: Port Coquitlam, British Columbia, Canada
83. Webster, C. D., Nicholls, T. L., Martin, M., Desmarais, S. L. and Brink, J. 2006. Short-Term Assessment of Risk and Treatability (START): The Case for a New Structured Professional Judgment Scheme. Behavioral Sciences & the Law, 24(6): 747-766. doi:10.1002/bsl. 737
84. Wilson, C. M., Desmarais, S. L., Nicholls, T. L. and Brink, J. 2010. The role of client strengths in assessments of violence risk using the Short-Term Assessment of Risk and Treatability (START). The International Journal of Forensic Mental Health, 9(4): 282-293. doi:10.1080/14999013.2010.534694
85. Wise, E. 2004. Methods for analyzing psychotherapy outcomes: a review of clinical significance, reliable change, and recommendations for future directions. Journal of Personality Assessment, 82(1): 50-59. doi:10.1207/s15327752jpa8201_10