Sources of variability in estimates of predictive validity: A specification with level of service general risk and need

Criminal Justice and Behavior

Volumn 38, Issue 5, 2011, Pages 413-432

  Andrews, D A ^a   Bonta, James ^b   Wormith, J Stephen ^c   Guzzo, Lina ^d   Brews, Albert ^e   Rettinger, Jill ^f   Rowe, Rob ^g  

^a CARLETON UNIVERSITY   (Canada)

^b PUBLIC SAFETY CANADA   (Canada)

^c UNIVERSITY OF SASKATCHEWAN   (Canada)

^d Community Safety and Correctional Services ^*  (Canada)

^e Correctional Service of Canada ^*  (Canada)

^f University Partnership Centre   (Canada)

^g Family Court Clinic ^*  (Canada)

Author keywords

female offenders; recidivism; risk and need factors; variability in validity estimates

Indexed keywords

EID: 79953849216     PISSN: 00938548     EISSN: 15523594     Source Type: Journal    
DOI: 10.1177/0093854811401990     Document Type: Article

References (73)

1. Andrews, D.A. (1982). The Level of Supervision Inventory (LSI): The first follow-up. Toronto, Canada: Ontario Ministry of Correctional Services.
2. Andrews, D.A. (2010). [Meta-analytic summaries of Level of Service risk and need and ongoing compilation of Level of Service data sets]. For most recent versions, contact Jim.Bonta@ps.gc.ca.
3. Andrews, D.A., & Bonta, J. (1995). Level of Service Inventory-Revised. Toronto, Canada: Multi-Health Systems.
4. Andrews, D.A., & Bonta, J. (2010). The psychology of criminal conduct (5th ed.). Newark, NJ: LexisNexis/ Matthew Bender.
5. Andrews, D.A., Bonta, J., & Wormith, J.S. (2004). The Level of Service/Case Management Inventory (LS/CMI). Toronto, Canada: Multi-Health Systems.
6. Andrews, D.A., Bonta, J., & Wormith, S.J. (2006). The recent past and near future of risk/need assessment. Crime & Delinquency, 52, 7-27.
7. Andrews, D.A., Bonta, J., & Wormith, S.J. (2008). Level of Service/Risk-Need-Responsivity. Toronto, Canada: Multi-Health Systems.
8. Andrews, D.A., Bonta, J., & Wormith, S.J. (2010). The Level of Service (LS) assessment of adults and older adolescents. In R. K. Otto & K. Douglas (Eds.), Handbook of violence risk assessment tools (pp. 199-225). New York, NY: Routledge.
9. Andrews, D.A., & Dowden, C. (2005). Managing correctional treatment for reduced recidivism: A meta-analytic review of program integrity. Legal and Criminological Psychology, 10, 173-187.
10. Andrews, D.A., Guzzo, L., Raynor, P., Rowe, R., Rettinger, L.J., Brews, A., & Wormith, J.S. (in press). Are the major risk/ need factors predictive of both female and male reoffending? A test with the eight domains of the Level of Service/Case Management Inventory. International Journal of Offender Therapy and Comparative Criminology.
11. Andrews, D.A., & Robinson, D. (1984). The Level of Supervision Inventory: Second report. Toronto, Canada: Ontario Ministry of Correctional Services.
12. Andrews, D.A., Robinson, D., & Hoge, R.D. (1984). Manual for the Youth Level of Service Inventory. Ottawa, Canada: Carleton University, Department of Psychology.
13. Andrews, D.A., & Wormith, J.S. (1989). Personality and crime: Knowledge destruction and construction in criminology. Justice Quarterly, 6, 289-309.
14. Barnoski, B., & Aos, S. (2003). Washington's Offender Accountability Act: An analysis of the Department of Corrections' risk assessment. Olympia: Washington State Institute for Public Policy.
15. Blanchette, K., & Brown, S.L. (2006). The assessment and treatment of women offenders. Chichester, UK: Wiley.
16. Bonta, J. & Motiuk, L.L. (1986). Use of the Level of Supervision Inventory for assessing incarcerated offenders. Paper presented at the 94th Annual Convention of the American Psychological Association, Washington, August, 1986.
17. Bonta, J. & Motiuk, L.L. (1990). Classification to halfway houses: A quasi-experimental evaluation. Criminology, 28, 497-506.
18. Bonta, J., Motiuk, L.L., & Ker, K. (1985). The Level of Supervision Inventory (LSI) among incarcerated offenders. Report # 1. Toronto: Ontario Ministry of Correctional Service.
19. Brews, A. (2009). The Level of Service Inventory and female offenders: Addressing issues of reliability and validity (Unpublished MA thesis). University of Saskatchewan, Saskatoon.
20. Costigan, S. (1999). Critical evaluation of the long-term validity of the risk/need assessment and its young offender typology (Unpublished MA thesis). Lakehead University, Thunder Bay, Ontario, Canada.
21. Coulson, G., Ilacqua, G., Nutbrown, V., Giulekas, D., & Cudjoe, F. (1996). Predictive validity of the LSI for incarcerated female offenders. Criminal Justice and Behavior, 23, 427-439.
22. Fanelli, D. (2009). How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data. Retrieved fromhttp://www.ncbi.nlm.nih.gov/pmc/articles/PMC2685008/pdf/pone.0005738.pdf.
23. Flores, A., Lowenkamp, C., Holsinger, A., & Latessa, E. (2006). Predicting outcome with the Level of Service Inventory- Revised: The importance of implementation integrity. Journal of Criminal Justice, 34, 523-529.
24. Folsom, J., & Atkinson, J.L. (2007). The generalizability of the LSI-R and the CAT to the prediction of recidivism in female offenders. Criminal Justice and Behavior, 34, 1044-1056.
25. Gendreau, P., & Andrews, D.A. (2001). The Correctional Program Assessment Inventory 2000 (CPAI 2000). Saint John, Canada: University of New Brunswick.
26. Girard, L., & Wormith, J.S. (2004). The predictive validity of the Level of Service Inventory-Ontario Revision on general and violent recidivism among various offender groups. Criminal Justice and Behavior, 31, 150-181.
27. Goggin, C., & Gendreau, P. (2004). The Empress new clothes: The tale of a theory in spite of the data (Unpublished manuscript). Centre for Criminal Justice Studies, University of New Brunswick, Saint John, Canada.
28. Gossner, D., & Wormith, J.S. (2007). The prediction of recidivism among young offenders in Saskatchewan. Canadian Journal of Police and Security Services, 5, 70-82.
29. Greiner, L., Brown, S., & Jennings, V. (2008). Criminal attitudes in young female offenders: A psychometric evaluation. In Proceedings of the 2007 North American Correctional and Criminal Justice Psychology Conference (pp. 149-152). Ottawa, Canada: Public Safety Canada.
30. Hannah-Moffat, K. (2004). Gendering risk at what cost: Negotiations of gender and risk in Canadian women's prisons. Feminism and Psychology, 14, 243-249.
31. Hannah-Moffat, K. (2009). Gridlock or mutability: Reconsidering "gender" and risk assessment. Criminology and Public Policy, 8, 209-219.
32. Harris, G.T., Rice, M.E., & Quinsey, V.L. (2009). Allegiance or fidelity: A clarifying reply. Clinical Psychology: Science and Practice, 17, 82-89.
33. Hoge, R.D., & Andrews, D.A. (2002). Youth Level of Service/Case Management Inventory (YLS/CMI). Toronto, Canada: Multi-Health Systems.
34. Holsinger, A.M., Lowenkamp, C.T., Latessa, E.J. (2006). Exploring the validity of the Level of Service Inventory-Revised with Native American offenders. Journal of Criminal Justice, 34, 331-337.
35. Holtfreter, K., & Cupp, R. (2007). Gender and risk assessment: The empirical status of the LSI-R for women. Journal of Contemporary Criminal Justice, 23, 363-382.
36. Holtfreter, K., Reisig, M.D., & Morash, M. (2004). Poverty, state capital, and recidivism among women offenders. Criminology & Public Policy, 3, 185-208.
37. Hsu, C.-I., Caputi, P., & Byrne, M. K. (2009). The Level of Service Inventory-Revised (LSI-R): A useful risk assessment measure for Australian offenders? Criminal Justice and Behavior, 36, 728-740.
38. Hunter, J.E., & Schmidt, F.L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
39. Kirkpatrick, B.L. (1999). Exploratory research of female risk prediction and LSI-R. Corrections Compendium, 24, 1-17.
40. Laosa, L.M. (1991). The cultural context of construct validity and the ethics of generalizability. Early Childhood Research Quarterly, 6, 313-321.
41. Lipsey, M.W. (1999). Can rehabilitative program reduce the recidivism of juvenile offenders? An inquiry into the effectiveness of practical programs. Virginia Journal of Social Policy and the Law, 6, 611-641.
42. Lipsey, M.W. (2009). The primary factors that characterize effective interventions with juvenile offenders: A meta-analytic overview. Victims and Offenders, 4, 124-147.
43. Lowenkamp, C.T., Holsinger, A.M., & Latessa, E.J. (2001). Risk/need assessment, offender classification, and the role of childhood abuse. Criminal Justice and Behavior, 28, 543-563.
44. Lowenkamp, C.T., Latessa, E.J., & Holsinger, A.M. (2006). The risk principle in action: What have we learned from 13,676 offenders and 97 correctional programs? Crime & Delinquency, 52, 77-93.
45. Luong, D., & Wormith, J.S. (in press). Applying risk/need assessment in probation practices and its impact on the recidivism of young offenders. Criminal Justice and Behavior.
46. McConnell, B.A. (1996). The prediction of federal female recidivism with the Level of Service Inventory. BSc thesis submitted to the Department of Psychology, Queens University, Kingston, Ontario, Canada.
47. McGuire, J. (2002). Integrating findings from research reviews. In J. McGuire (Ed.), Offender rehabilitation and treatment: Effective programmes and policies to reduce reoffending (pp. 3-38). Chichester, UK: Wiley.
48. O'Keefe, M.L., Klebe, K., & Hromas, D.G. (1998). Validation of the Level of Supervision Inventory (LSI) for community-based offenders in Colorado: Phase 2. Colorado Springs: Colorado Department of Corrections.
49. Olver, M.E., Stockdale, K.C., & Wormith, J.S. (2009). Risk assessment with young offenders: A meta-analysis of three assessment measures. Criminal Justice and Behavior, 36, 329-353.
50. Onifade, E., Davidson, W., Livsey, S., Turke, G., Horton, C., Malinowski, J.,Wimberly, D. (2008). Risk assessment: Identifying patterns of risk in young offenders with the Youth Level of Service/Case Management Inventory. Journal of Criminal Justice, 36, 165-173.
51. Palmer, E.J., & Hollin, C.R. (2007). The Level of Service Inventory-Revised with English women prisoners: A needs and reconviction analysis. Criminal Justice and Behavior, 34, 971-984.
52. Petrosino, A., & Soydan, H. (2005). The impact of program developers as evaluators on criminal recidivism: Results from meta-analyses of experimental and quasi-experimental research. Journal of Experimental Criminology, 1, 435-450.
53. Quinsey, V.L., Harris, G.T., Rice, M.E., & Cormier, C.A. (1998). Violent offenders: Appraising and managing risk. Washington, DC; American Psychological Association.
54. Raynor, P. (2007). Risk and need assessment in British probation: The contribution of the LSI-R. Psychology, Crime, and Law, 13, 125-138.
55. Rector, B., Wormith, J.S., & Banks, D. (2007, June). Predictive validity of the LS-SK youth edition. Paper presented at the NACCJ Conference, Ottawa, Canada.
56. Reisig, M.D., Holtfretter, K., & Morash, M. (2006). Assessing recidivism risk across female pathways to crime. Justice Quarterly, 23, 384-405.
57. Rettinger, L.J. (1998). A recidivism follow-up study investigating risk and need within a sample of provincially sentenced women (Unpublished doctoral dissertation). Carleton University, Ottawa, Canada.
58. Rettinger, J. & Andrews, D.A. (2010). General risk/need, gender-specificity and the recidivism of female offenders. Criminal Justice and Behavior, 37, 29-46.
59. Reynolds, K. (2008). Level of Service Inventory: Ontario revision. A sample of female offenders (Unpublished master's thesis). Nipissing University, Ontario, Canada.
60. Rice, M.E., & Harris, G.T. (2005). Comparing effect sizes in follow-up studies: ROC area, Cohen's d and r. Law and Human Behavior, 29, 615-620.
61. Robertson, S. (1998). Assessing procriminal sentiments in young offenders: A comprehensive examination of the psychometric properties of a battery of attitudinal scales (Unpublished master's thesis). Carleton University, Ottawa, Canada. (Data set employed with the permission of Dr. Ian Shields, Psychologist, Regional Detention Centre, Ottawa, Canada).
62. Rowe, R. (2002.) Assessment of high risk young offenders (Unpublished doctoral dissertation). Carleton University, Ottawa, Canada.
63. Rowe, R. (2009, June). Gender informed proximal antecedents to criminal offending in a young offender sample. Paper presented at the annual convention of the Canadian Psychological Association, Montreal, Canada.
64. Schmidt, F., Hoge, R.D., & Gomes, L. (2005). Reliability and validity analyses of the Youth Level of Service/Case Management Inventory. Criminal Justice and Behavior, 32, 329-344.
65. Schwalbe, C.S. (2008). A meta-analysis of juvenile justice risk assessment instruments: Predictive validity by gender. Criminal Justice and Behavior, 35, 1367-1381.
66. Shields, I.W. (1993). The use of the Young Offender-Level of Service Inventory (YO-LSI) with adolescents. IARCA Journal, 5, 10-26.
67. Smith, P., Cullen, F.T., & Latessa, E.J. (2009). Can 14,373 women be wrong? A meta-analysis of the LSI-R and recidivism for female offenders. Criminology and Public Policy, 8, 183-208.
68. van de Ven, J.T.C. (2004). Assessment of risk and need factors and service use in diverted youth (Unpublished doctoral dissertation). Carleton University, Ottawa, Canada.
69. Van Voorhis, P., Salisbury, E., Bauman, A., & Wright, E. (2007). Gender responsive risk/needs assessment: Final report. Report prepared for the Maui CARE Project. Cincinnati, OH: University of Cincinnati, Criminal Justice Research Center.
70. Van Voorhis, P., Salisbury, E., Wright, E., & Bauman, A. (2008). Achieving accurate pictures of risk and identifying gender responsive needs: Two new assessments for women offenders. Cincinnati, OH: University of Cincinnati, Criminal Justice Research Center.
71. Vose, B., Cullen, F.T., & Smith, P. (2008). The empirical status of the Level of Service Inventory. Federal Probation, 72, 22-29.
72. Wright, E., Van Voorhis, P., Bauman, A., & Salisbury, S. (2008). Gender-responsive Risk/Needs Assessment final report. Report prepared for the Minnesota Department of Corrections and the Advisory Task Force on the Woman and Juvenile Female Offender in Corrections. Cincinnati, OH: University of Cincinnati, Criminal Justice Research Center.
73. Yang, M., Wong, S.C.P., & Coid, J. (2010). The effect of violence prediction: A meta-analytic comparison of nine risk assessment tools. Psychological Bulletin, 136, 740-767.