Evaluating the Predictive Validity of the Compas Risk and Needs Assessment System

Criminal Justice and Behavior

Volumn 36, Issue 1, 2009, Pages 21-40

  Brennan, Tim ^a   Dieterich, William ^a   Ehret, Beate ^a  

^a Public Management Inc   (United States)

Author keywords

area under the curve (AUC); COMPAS; criminogenic needs; predictive validity; probation; risk assessment; survival analysis

Indexed keywords

EID: 84992838075     PISSN: 00938548     EISSN: None     Source Type: Journal    
DOI: 10.1177/0093854808326545     Document Type: Article

References (99)

1. Aalen, O.O. (1978). Nonparametric inference for a family of counting processes. Annals of Statistics, 6, 701-726.
2. Andrews, D.A., & Bonta, J. (1995). The Level of Service Inventory-Revised. Toronto: Multi-Health Systems.
3. Andrews, D.A., & Bonta, J. (1998). The psychology of criminal conduct (2nd ed.). Cincinnati, OH: Anderson.
4. Andrews, D.A., Bonta, J., & Wormith, J.S. (2004). The Level of Service/Case Management Inventory (LS/CMI). Toronto: Multi-Health Systems.
5. Andrews, D.A., Bonta, J., & Wormith, J.S. (2006). The recent past and near future of risk and/or needs assessment. Crime & Delinquency, 52, 7-27.
6. Aos, S., & Barnoski, R. (2003). Washington's offender accountability act: An analysis of the Department of Correction's risk assessment (Document No. 03-12-1202). Washington, DC: Washington Institute for Public Policy.
7. Austin, J. (1983). Assessing the new generation of prison classification models. Crime & Delinquency, 29, 561-576.
8. Bandura, A., Barbaranelli, C., Caprara, G.V., & Pastorelli, C. (1996). Mechanisms of moral disengagement in the exercise of moral agency. Journal of Personality and Social Psychology, 71, 364-374.
9. Barbaree, H.E., Seto, M., Langton, C.M., & Peacock, E.J. (2001). Evaluating the predictive accuracy of six risk assessment instruments for adult sex offenders. Criminal Justice and Behavior, 28, 490-521.
10. Barnoski, R. (2006). Sex offender sentencing in Washington State: Predicting recidivism based on the LSI-R. Retrieved January 20, 2008 from http://www.wsipp.wa.gov/rtpfiles/06-02-1201.pdf.
11. Barnoski, R., & Aos, S. (2003). ‘Washington's offender accountability act: An analysis of the Department of Corrections’ risk assessment (Document No. 03-12-1202). Olympia: Washington State Institute for Public Policy.
12. Barnoski, R., & Drake, E.K. (2007). ‘Washington's Offender Accountability Act: Department of Corrections’ static risk assessment. Olympia: Washington State Institute for Public Policy.
13. Bennett, R.R., & Morabito, M.S. (2005, November). Institutional social support and crime: A cross-national investigation. Paper presented at the annual meeting of the American Society of Criminology, Toronto, Canada.
14. Blackburn, R., & Coid, J.W. (1998). Psychopathy and the dimensions of personality in violent offenders. Personality and Individual Differences, 25, 129-145.
15. Blanchette, K., & Brown, S.L. (2006). The assessment and treatment of women offenders: An integrative perspective. New York: John Wiley.
16. Bloom, B. (2000). Beyond recidivism: Perspectives on evaluation of programs for female offenders in community corrections. In M. McMahon (Ed.), Assessment to assistance: Programs for women in community corrections (pp. 107-138). Latham, MD: American Correctional Association.
17. Bonta, J. (1996). Risk-needs assessment and treatment. In A. T. Harland (Ed.), Choosing correctional options that work: Defining the demand and evaluating the supply (pp. 18-32). Thousand Oaks, CA: Sage.
18. Bonta, J. (2002). Risk needs assessment: Guidelines for selection and use. Criminal Justice and Behavior, 29, 355-379.
19. Boothby, J.L., & Clements, C.B. (2000). A national survey of correctional psychologists. Criminal Justice and Behavior, 27, 715-731.
20. Brennan, T. (1987). Classification: An overview of selected methodological issues. In D. M. Gottfredson & M. Tonry (Eds.), Prediction and classification: Criminal justice decision making (pp. 201-248). Chicago: University of Chicago Press.
21. Brennan, T. (2008a). Explanatory diversity among female delinquents: Examining taxonomic heterogeneity. In R. Zaplin (Ed.), Female crime and delinquency: Critical perspectives and effective interventions (pp. 197-232). Boston: Jones and Bartlett.
22. Brennan, T. (2008b). Institutional assessment and classification of female offenders: From robust beauty to person-centered assessment. In R. Zaplin (Ed.), Female crime and delinquency: Critical perspectives and effective interventions (pp. 283-322). Boston: Jones and Bartlett.
23. Brennan, T., Breitenbach, M., & Dieterich, W. (2008). Towards an explanatory taxonomy of adolescent delinquents: Identifying several social-psychological profiles. Journal of Quantitative Criminology, 24, 179-203.
24. Brennan, T., Dieterich, W., & Oliver, W. (2004). The COMPAS scales: Normative data for males and females. Community and incarcerated samples. Traverse City, MI: Northpointe Institute for Public Management.
25. Brennan, T., Dieterich, W., & Oliver, W. (2007). COMPAS: Correctional offender management for alternative sanctioning. Technical manual and psychometric report (V. 5.01). Traverse City, MI: Northpointe Institute for Public Management.
26. Brennan, T., Wells, D., & Alexander, J. (2004). Enhancing prison classification systems: The emerging role of management information systems. Washington, DC: U.S. Department of Justice, National Institute of Corrections.
27. Clements, C.B. (1996). Offender classification: Two decades of progress. Criminal Justice and Behavior, 23, 121-143.
28. Coleman, J.S. (1990). Foundations of social theory. Cambridge, MA: Harvard University Press.
29. Cooke, D.J., Forth, A.E., & Hare, R.D. (1996). Psychopathy: Theory, research and implications for society. Dordrecht, Netherlands: NATO Science Series.
30. Cullen, F., & Agnew, R. (2003). Criminological theory: Past to present. Los Angeles: Roxbury.
31. Dahle, K.P. (2006). Strengths and limitations of actuarial prediction of criminal re-offence in a German prison sample: A comparative study of LSI-R, HCR-20 and PCL-R. International Journal of Law and Psychiatry, 29(5), 431-442.
32. Dawes, R.M. (1979). The robust beauty of improper linear models in decision models. American Psychologist, 34, 571-582.
33. Elliott, D.S., Huizinga, D., & Ageton, S.S. (1985). Explaining delinquency and drug use. Beverly Hills, CA: Sage.
34. Ellis, L., & Walsh, A. (1997). Gene-based evolutionary theories in criminology. Criminology, 35, 229-276.
35. Estroff, S., Zimmer, C., Lachicotte, W., & Benoit, J. (1994). The influence of social networks and social support on violence by persons with serious mental illness. Hospital and Community Psychiatry, 45, 669-679.
36. Eysenck, S., & Eysenck, H. (1978). Impulsiveness and venturesomeness: Their position in a dimensional system of personality description. Psychological Reports, 43, 1247-1255.
37. Farr, K.A. (2000). Classification for female inmates: Moving forward. Crime & Delinquency, 46, 3-17.
38. Farrington, D. (1991). Childhood aggression and adult violence: Early precursors and later life outcomes. In D. Pepler & K. Rubin (Eds.), The development and treatment of childhood aggression (pp. 5-29). Hillsdale, NJ: Lawrence Erlbaum.
39. Farrington, D.P. (2003). Developmental and life course criminology: Key theoretical and empirical issues. Criminology, 41, 221-255.
40. Farrington, D.P., Jolliffe, D., Loeber, R., Stouthamer-Loeber, M., & Kalb, L.M. (2001). The concentration of offenders in families, and family criminality in the prediction of boys' delinquency. Journal of Adolescence, 24, 579-596.
41. Farrington, D.P., & West, D.J. (1993). Criminal, penal, and life histories of chronic offenders: Risk and protective factors and early identification. Criminal Behaviour and Mental Health, 3, 492-523.
42. Fass, T.L., Heilbrun, K., DeMatteo, D., & Fretz, R. (2008). The LSI-R and the COMPAS: Validation on two risk-needs tools. Criminal Justice and Behavior, 35, 1095-1108.
43. Flores, A.W., Lowenkamp, C.T., Smith, P., & Latessa, E.J. (2006). Validating the Level of Service Inventory-Revised on a sample of federal probationers. Federal Probation, 70(2), 44-48.
44. Gendreau, P., Little, T., & Goggin, C. (1996). A meta-analysis of the predictors of adult offender recidivism: What works! Criminology, 34, 575-607.
45. Glaser, D. (1987). Classification for risk. In D. M. Gottfredson & M. Tonry (Eds.), Prediction and classification: Criminal justice decision making (pp. 249-292). Chicago: University of Chicago Press.
46. Gottfredson, M.R., & Hirschi, T. (1990). A general theory of crime. Stanford, CA: Stanford University Press.
47. Gottfredson, S.D. (1987). Prediction: An overview of selected methodological issues. In D. M. Gottfredson & M. Tonry (Eds.), Prediction and classification: Criminal justice decision making (pp. 21-52). Chicago: University of Chicago Press.
48. Grann, M., Belfrage, H., & Tengstrom, A. (2000). Actuarial assessment of risk for violence: Predictive validity of the VRAG and the historical part of the HCR-20. Criminal Justice and Behavior, 27, 97-114.
49. Grove, W.M., & Meehl, P.E. (1996). Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psychology, Public Policy and Law, 2, 293-323.
50. Hagen, J. (1998). Life course capitalization and adolescent behavioral development. In R. Jessor (Ed.), New perspectives on adolescent risk behavior. Cambridge, MA: Cambridge University Press.
51. Hannah-Moffatt, K., & Shaw, M. (2001). Taking risks: Incorporating gender and culture into classification and assessment of federally sentenced women in Canada. Ottawa, Ontario: Status of Women Canada.
52. Hardyman, P., & Van Voorhis, P. (2004). Developing gender-specific classification systems for women offenders. Washington, DC: U.S. Department of Justice, National Institute of Corrections.
53. Hare, R.D. (1991). The Hare Psychopathy Checklist-Revised. Toronto: Multi-Health Systems.
54. Harrell, F.E., Califf, R.M., Pryor, D.B., Lee, K.L., & Rosati, R.A. (1982). Evaluating the yield of medical tests. Journal of the American Medical Association, 247, 2543-2546.
55. Harris, P.W., & Jones, P.R. (1999). Differentiating delinquent youths for program planning and evaluation. Criminal Justice and Behavior, 26, 403-434.
56. Hastie, R., & Dawes, R.M. (2001). Rational choice in an uncertain world: The psychology of judgment and decision-making. Thousand Oaks, CA: Sage.
57. Hirschi, T. (1969). Causes of delinquency. Berkeley: University of California Press.
58. Hoffman, P.B. (1994). Twenty years of operational use of a risk prediction instrument: The United States Parole Commission's Salient Factor Score. Journal of Criminal Justice, 22, 477-494.
59. Holtfreter, K., & Cupp, R. (2007). Gender and risk assessment: The empirical status of the LSI-R for women. Journal of Contemporary Criminal Justice, 23, 363-382.
60. Jones, P.R. (1996). Risk prediction in criminal justice. In A. T. Harland (Ed.), Choosing correctional options that work (pp. 33-68). Thousand Oaks, CA: Sage.
61. Kalbfleisch, J.D., & Prentice, R.L. (2002). The statistical analysis of failure time data (2nd ed.). New York: John Wiley.
62. Kroner, D.G., Stadtland, M., Eidt, M., & Nedopil, N. (2007). The validity of the Violence Risk Appraisal Guide (VRAG) in predicting criminal recidivism. Criminal Behaviour and Mental Health, 17, 89-100.
63. Lilienfeld, S.O., & Andrews, B.P. (1996). Development and preliminary validation of a self-report measure of psychopathic personality traits in a non-criminal population. Journal of Personality Assessment, 66, 488-524.
64. Lipsey, M.W., & Derzon, J.H. (1998). Predictors of violent or serious delinquency in adolescence and early adulthood: A synthesis of longitudinal research. In R. Loeber & D. P. Farrington (Eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (pp. 86-105). Thousand Oaks, CA: Sage.
65. Lösel, F. (1995). The efficacy of correctional treatment: A review and synthesis of meta-evaluations. In J. McGuire (Ed.), What works: Reducing re-offending (pp. 79-111). Chichester, UK: Wiley.
66. Lykken, D.T. (1995). The antisocial personalities. Mahwah, NJ: Lawrence Erlbaum.
67. Marcus, B. (2003). An empirical examination of the construct validity of two alternative self-control measures. Educational and Psychological Measurement, 63, 674-706.
68. Marris, P. (1987). Loss and change. New York: Pantheon.
69. McNaughton, C. (2007, September). Life on the edge: Substance abuse and homelessness-Escape, resistance or deviance. Paper presented at the annual meeting of the British Society of Criminology, Glasgow, UK.
70. Mealey, L. (1995). The sociobiology of sociopathy: An integrated evolutionary model. Behavioral and Brain Sciences, 18, 523-599.
71. Meier, S. (2002). Bridging case conceptualization, assessment and intervention. Thousand Oaks, CA: Sage.
72. Millon, T., & Davis, R.D. (1997). The place of assessment in clinical science. In T. Millon (Ed.), The Millon inventories: Clinical and personality assessment (pp. 3-22). New York: Guilford.
73. Mossman, D. (1994). Assessing predictions of violence: Being accurate about accuracy. Journal of Consulting and Clinical Psychology, 62, 783-792.
74. National Council on Crime and Delinquency. (2006). Correctional Assessment and Intervention System. Retrieved March 28, 2007, from http://www.nccd-crc.org/nccd/n_index_main.html.
75. National Institute of Justice. (1999). Annual report on drug use among adult and juvenile arrestees (1998). Arrestee Drug Abuse Monitoring Program (ADAM). Washington, DC: Author.
76. National Research Council. (1993). Understanding and preventing violence (A. J. Reiss & J. A. Roth, Eds.). Washington, DC: National Academy Press.
77. Nelson, W. (1972). Theory and applications of hazard plotting for censored failure data. Technometrics, 14, 945-965.
78. Northpointe Institute for Public Management. (1996). COMPAS [Computer software]. Traverse City, MI: Author.
79. Osgood, D., Wayne, J.K., Wilson, J.G., Bachman, P., O'Malley, G., & Johnston, L.D. (1996). Routine activities and individual deviant behavior. American Sociological Review, 61, 635-655.
80. Palmer, T. (1992). The re-emergence of correctional intervention. Newbury Park, CA: Sage.
81. Parker, J., & Asher, S. (1987). Peer relations and later personal adjustment: Are low accepted children at risk? Psychological Bulletin, 102, 357-389.
82. Quinsey, V.L., Harris, G.T., Rice, M.E., & Cormier, C.A. (1998). Violent offenders: Appraising and managing risk. Washington, DC: American Psychological Association.
83. Reisig, M.D., Holtfreter, K., & Morash, M. (2006). Assessing recidivism risk across female pathways to crime. Justice Quarterly, 23, 384-405.
84. Salisbury, E.J., Van Voorhis, P., & Wright, E. (2006, November). Construction and validation of a gender responsive risk/needs instrument for women offenders in Missouri and Maui. Paper presented at the annual conference of the American Society of Criminology, Los Angeles.
85. Sampson, R.J., & Lauritsen, J. (1994). Deviant lifestyles proximity to crime and the offender-victim link in personal violence. Journal of Research in Crime and Delinquency, 27, 7-40.
86. Sampson, R.J., Raudenbush, S., & Earls, F. (1997). Neighborhoods and violent crime: A multilevel study of collective efficacy. Science, 277, 918-924.
87. Solomon, A., Johnson, K.D., Travis, J., & McBride, E. (2004). From prison to work: The employment dimensions of prisoner reentry. Washington, DC: Urban Institute.
88. Stalans, L.J., Yarnold, P.R., Seng, M., Olsen, D., & Repp, M. (2004). Identifying three types of violent offenders and predicting their recidivism and performance while on probation: A classification tree analysis. Law and Human Behavior, 26, 253-271.
89. Stevenson, H.C. (1998). Raising safe villages: Cultural-ecological factors that influence the emotional adjustment of adolescents. Journal of Black Psychology, 24, 44-59.
90. Tape, T.G. (2003). Interpreting diagnostic tests: The area under the ROC curve. Unpublished report, University of Nebraska Medical Center, Omaha.
91. Thornberry, T., Huizinga, D., & Loeber, R. (Eds.). (1995). The prevention of serious delinquency and violence: Implications from the program of research on the causes and correlates of delinquency. Sourcebook on serious, violent and chronic juvenile offenders. Thousand Oaks, CA: Sage.
92. Van Voorhis, P. (1994). Psychological classification of the adult male prison inmate. Albany: State University of New York Press.
93. Walters, G.D. (1995). The Psychological Inventory of Criminal Thinking Styles: Part I. Reliability and preliminary validity. Criminal Justice and Behavior, 22, 307-325.
94. Ward, T., & Brown, M. (2004). The good lives model and conceptual issues in offender rehabilitation. Psychology, Crime and Law, 10, 243-257.
95. Ward, T., & Stewart, C. (2003). Criminogenic needs and human needs: A theoretical model. Psychology, Crime and Law, 9, 125-143.
96. Warren, M.Q., & Hindelang, M.J. (1979). Differential explanation of offender behavior. In H. Toch (Ed.), Psychology of crime and criminal justice (pp. 166-182). Prospect Heights, IL: Waveland Press.
97. Widiger, T.A., & Lynum, D.R. (1998). Psychopathy and the five-factor model of personality. In T. Millon, E. Simonsen, M. Birkett-Smith, & R. Davis (Eds.), Psychopathy: Antisocial, criminal and violent behavior (pp. 171-186). New York: Guilford.
98. Wormith, J.S. (2001, July). Assessing offender assessment: Contributing to effective correctional treatment. The ICCA Journal, pp. 12-23.
99. Zhang, S., Farabee, D., & Roberts, R. (2007, October). Predicting parolee risk of recidivism. Paper presented at the 66th semi-annual meeting of the Association for Criminal Justice Research, Sacramento, CA.