RISK, RACE, AND RECIDIVISM: PREDICTIVE BIAS AND DISPARATE IMPACT*

Criminology

Volumn 54, Issue 4, 2016, Pages 680-712

  Skeem, Jennifer L ^a   Lowenkamp, Christopher T ^b  

^a University of California at Berkeley   (United States)

^b Administrative Office of the US Courts Probation and Pretrial Services Office   (United States)

Author keywords

disparities; race; risk assessment; sentencing; test bias

Indexed keywords

EID: 84996921112     PISSN: 00111384     EISSN: 17459125     Source Type: Journal    
DOI: 10.1111/1745-9125.12123     Document Type: Article

References (95)

1. Administrative Office of the U.S. Courts. 2011. An Overview of the Federal Post Conviction Risk Assessment. http://www.uscourts.gov/file/2749/download
2. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. 2014. The Standards for Educational and Psychological Testing. Washington, DC: AERA Publications.
3. American Law Institute. 2014. Model Penal Code: Sentencing (Tentative Draft No. 3). Philadelphia, PA: American Law Institute.
4. Arnold, Hugh. 1982. Moderator variables: A clarification of conceptual, analytic, and psychometric issues. Organizational Behavior and Human Performance 29:143–74.
5. Arnold, John, and Laura Arnold. 2015. Fixing justice in America. Politico Magazine. http://www.politico.com/magazine/story/2015/03/criminal-justice-reform-coalition-for-public-safety-116057.html.
6. Berk, Richard. 2009. The role of race in forecasts of violent crime. Race and Social Problems 1:231–42.
7. Blumstein, Alfred. 1993. Racial disproportionality of US prison populations revisited. University of Colorado Law Review 64:743–60.
8. Blumstein, Alfred, Jacqueline Cohen, Susan E. Martin, and Michael H. Tonry. 1983. Research on Sentencing: The Search for Reform, Volume I. Washington, DC: National Academy Press.
9. Brennan, Tim, William Dieterich, and Beate Ehret. 2009. Evaluating the predictive validity of the COMPAS risk and needs assessment system. Criminal Justice and Behavior 36:21–40.
10. Bureau of Labor Statistics. 2013. Marriage and divorce: Patterns by gender, race, and educational attainment. http://www.bls.gov/opub/mlr/2013/article/marriage-and-divorce-patterns-by-gender-race-and-educational-attainment.htm.
11. Carson, Elizabeth. 2015. Prisoners in 2014. Washington, DC: Bureau of Justice Statistics. http://www.bjs.gov/index.cfm?ty=pbdetailandiid=5387.
12. Cleary, T. Anne. 1968. Test bias: Prediction of grades of Negro and white students in integrated colleges. Journal of Educational Measurement 5:115–24.
13. Cohen, Jacob. 1988. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum.
14. Cohen, Thomas H., Christopher T. Lowenkamp, and Scott W. VanBenschoten. 2016. Does change in risk matter? Criminology & Public Policy. http://ssrn.com/abstract=2621267. doi: 10.1111/1745-9133.12190
15. Cohen, Thomas H., and Scott VanBenschoten. 2014. Does the risk of recidivism for supervised offenders improve over time? Examining changes in the dynamic risk characteristics for offenders under federal supervision. Federal Probation 78:41–52.
16. Cook, Daniel. 2015. CCMATCH: Stata module to randomly match cases and controls based on specified criteria. Version 1.3. http://www.Danielecook.com.
17. Desmarais, Sarah, Kiersten Johnson, and Jay Singh. 2016. Performance of recidivism risk assessment instruments in U.S. correctional settings. Psychological Services. Epub ahead of print. doi: 10.1037/ser0000075.
18. Durose, Matthew, Alexia Cooper, and Howard Snyder. 2014. Recidivism of Prisoners Released in 30 States in 2005: Patterns from 2005 to 2010. Washington, DC: Bureau of Justice Statistics.
19. Elek, Warren, and Pamela Casey. 2015. Using Risk and Needs Assessment Information at Sentencing: Observations from Ten Jurisdictions. Williamsburg, VA: National Center for State Courts. http://www.ncsc.org/~/media/Microsites/Files/CSI/RNA%202015/Final%20PEW%20Report%20updated%2010-5-15.ashx.
20. Ender, Philip. 2011. Binary_mediation: Command to Compute Indirect Effect with Binary Mediator and/or Binary Response Variable. Los Angeles, CA: Statistical Consulting Group, UCLA. http://www.ats.ucla.edu/stat/stata/ado/analysis/.
21. Flores, Anthony, Alexander Holsinger, and Christopher T. Lowenkamp. In press. Comparing variable and fixed follow-up outcome periods: Do different methods produce different results? Criminal Justice and Behavior.
22. Frase, Richard. 2004. Limiting retributivism. In The Future of Imprisonment, ed. Michael Tonry. New York: Oxford University Press.
23. Frase, Richard. 2009. What explains persistent racial disproportionality in Minnesota's prison and jail populations? In Crime and Justice, vol. 38, ed. Michael Tonry. Chicago, IL: University of Chicago Press.
24. Frase, Richard. 2013. Just Sentencing: Principles and Procedures for a Workable System. New York: Oxford University Press.
25. Frase, Richard. 2014. Recurring policy issues of guidelines (and non-guidelines) sentencing: Risk assessments, criminal history enhancements, and the enforcement of release conditions. Federal Sentencing Reporter 26:145–57.
26. Frase, Richard, Julian Roberts, Rhys Hester, and Kelly Mitchell. 2015. Criminal History Enhancements Sourcebook. Minneapolis, MN: Robina Institute of Criminal Law and Criminal Justice. http://www.robinainstitute.org/publications/criminal-history-enhancements-sourcebook/.
27. Gendreau, Paul, Tracy Little, and Claire Goggin. 1996. A meta-analysis of the predictors of adult offender recidivism: What works! Criminology 34:575–608.
28. Gottfredson, Michael R., and Don Gottfredson. 1988. Decision Making in Criminal Justice: Toward the Rational Exercise of Discretion, 2nd ed. New York: Plenum Press.
29. Gottfredson, Stephen D., and G. Roger Jarjoura. 1996. Race, gender, and guidelines-based decision making. Journal of Research in Crime and Delinquency 33:49–69.
30. Griggs v. Duke Power Co. 1971. 401 U.S. 424.
31. Gutierrez, Roberto, and David Drukker. 2007. Stata's cluster-correlated robust variance estimates. http://www.stata.com/support/faqs/statistics/references/.
32. Harcourt, Bernard. 2008. Against Prediction: Profiling, Policing, and Punishing in an Actuarial Age. Chicago, IL: University of Chicago Press.
33. Harcourt, Bernard. 2015. Risk as a proxy for race: The dangers of risk assessment. Federal Sentencing Reporter 27:237–43.
34. Hoge, Robert. 2002. Standardized instruments for assessing risk and need in youthful offenders. Criminal Justice and Behavior 29:380–96.
35. Holder, Eric. 2014. Attorney General Eric Holder speaks at the National Association of Criminal Defense Lawyers 57th annual meeting. http://www.justice.gov/opa/speech/attorney-general-eric-holder-speaks-national-association-criminal-defense-lawyers-57th.
36. Johnson, James, Christopher Lowenkamp, Scott VanBenschoten, and Christopher Robinson. 2011. The construction and validation of the federal Post Conviction Risk Assessment (PCRA). Federal Probation 75:16–29.
37. Kim, Hye-Sun. 2010. Prisoner classification re-visited: A further test of the Level of Service Inventory-Revised (LSI-R) intake assessment. PhD dissertation. Indiana University of Pennsylvania.
38. Kleiman, Matthew, Brian Ostrom, and Fred Cheesman. 2007. Using risk assessment to inform sentencing decisions for nonviolent offenders in Virginia. Crime & Delinquency 53:106–32.
39. Kraemer, Helena, Eric Stice, Alan Kazdin, David Offord, and David Kupfer. 2001. How do risk factors work together? Mediators, moderators, and independent, overlapping, and proxy risk factors. American Journal of Psychiatry 158:848–56.
40. Lawrence Alison. 2013. Trends in Sentencing and Corrections: State Legislation. Denver, CO: National Conference of State Legislatures. http://www.ncsl.org/Documents/CJ/TrendsInSentencingAndCorrections.pdf.
41. Lin, Mingfeng, Henry Lucas Jr., and Galit Shmueli. 2013. Research commentary—too big to fail: Large samples and the p-value problem. Information Systems Research 24:906–17.
42. Lipsey, Mark W., Nana A. Landenberger, and Sandra J. Wilson. 2007. Effects of cognitive-behavioral programs for criminal offenders. Campbell Systematic Reviews 6:1–28.
43. Lowenkamp, Christopher T., and Kristin Bechtel. 2007. Predictive validity of the LSI-R on a sample of offenders drawn from the records of the Iowa Department of Correction Data Management System. Federal Probation 71:25–34.
44. Lowenkamp, Christopher T., Alexander Holsinger, and Thomas Cohen. 2015. PCRA revisited: Testing the validity of the federal Post Conviction Risk Assessment (PCRA). Psychological Services 12:149–57.
45. Lowenkamp, Christopher T., James Johnson, Alexander Holsinger, Scott VanBenschoten, and Christopher Robinson. 2013. The federal Post Conviction Risk Assessment (PCRA): A construction and validation study. Psychological Services 10:87–96.
46. McClesky v. Kemp. 1987. 481 U.S. 279.
47. McCord, Joan, Cathy Widom, and Nancy Crowell. 2001. Juvenile Crime, Juvenile Justice. Panel on Juvenile Crime: Prevention, Treatment, and Control. Washington, DC: National Academy Press.
48. Monahan, John, and Jennifer L. Skeem. 2014. Risk redux: The resurgence of risk assessment in criminal sentencing. Federal Sentencing Reporter 26:158–66.
49. Monahan, John, and Jennifer L. Skeem. 2016. Risk assessment in criminal sentencing. Annual Review of Clinical Psychology 12:489–513.
50. Monahan, John, Henry Steadman, Eric Silver, Paul Appelbaum, Pamela Robbins, Edward Mulvey, Loren Roth, Thomas Grisso, and Steven Banks. 2001. Rethinking Risk Assessment. The MacArthur Study of Mental Disorder and Violence. New York: Oxford University Press.
51. Morris, Norval. 1974. The Future of Imprisonment. Chicago, IL: University of Chicago Press.
52. National Conference of State Legislatures. 2015. State sentencing and corrections legislation. http://www.ncsl.org/research/civil-and-criminal-justice/state-sentencing-and-corrections-legislation.aspx.
53. Olver, Mark, Keira Stockdale, and J. Stephen Wormith. 2009. Risk assessment with young offenders: A meta-analysis of three assessment measures. Criminal Justice and Behavior 36:329–53.
54. Petersilia, Joan, and Susan Turner. 1987. Guideline-Based Justice: The Implications for Racial Minorities. Los Angeles, CA: The RAND Corporation. http://www.rand.org/pubs/reports/R3306.html.
55. Piquero, Alex R. 2015. Understanding race/ethnicity differences in offending across the life course: Gaps and opportunities. Journal of Developmental and Life-course Criminology 1:21–32.
56. Piquero, Alex R., and Robert Brame. 2008. Assessing the race-crime and ethnicity-crime relationship in a sample of serious adolescent delinquents. Crime & Delinquency 54:390–422.
57. Reiser, Benjamin, and David Faraggi. 1999. Confidence intervals for the overlapping coefficient: The normal equal variance case. Journal of the Royal Statistical Society 48:413–8.
58. Reynolds, Cecil R. 2000. Methods for detecting and evaluating cultural bias in neuropsychological tests. In Handbook of Cross-Cultural Neuropsychology, eds. Elaine Fletcher-Janzen, Tony L. Strickland, and Cecil R. Reynolds. New York: Springer.
59. Reynolds, Cecil R. and Lisa A. Suzuki. 2012. Bias in psychological assessment: An empirical review and recommendations. In Handbook of Psychology, Vol 10, Assessment Psychology, 2nd ed., eds. Irving B. Weiner, John R. Graham, and Jack A. Naglieri. New York: Wiley.
60. Rhodes, William, Ryan Kling, Jeremy Luallen, and Christina Dyous. 2015. Federal Sentencing Disparity: 2005-2012. Washington, DC: Bureau of Justice Statistics Working Paper Series. http://bjs.gov/content/pub/pdf/fsd0512.pdf.
61. Rice, Marnie, and Grant Harris. 2005. Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r. Law and Human Behavior 29:615–20.
62. Roberts, Julian V., and Andreas von Hirsch. 2010. Previous Convictions at Sentencing: Theoretical and Applied Perspectives. London: Bloomsbury Publishing.
63. Rogers, William. 1993. Regression standard errors in clustered samples. Stata Technical Bulletin 13:19–23.
64. Roth, Philip, Craig Bevier, Philip Bobko, Fred Switzer, and Peggy Tyler. 2001. Ethnic group differences in cognitive ability in employment and educational settings: A meta-analysis. Personnel Psychology 54:297–330.
65. Ryan, Ann Marie, and Robert Ployhart. 2014. A century of selection. Annual Review of Psychology 65:693–717.
66. Sackett, Paul, and Philip Bobko. 2010. Conceptual and technical issues in conducting and interpreting differential prediction analyses. Industrial and Organizational Psychology 3:213–7.
67. Sackett, Paul, Matthew Borneman, and Brian Connelly. 2008. High stakes testing in higher education and employment: Appraising the evidence for validity and fairness. American Psychologist 63:215–27.
68. Sackett, Paul, Neal Schmitt, Jill Ellingson, and Melissa Kabin. 2001. High-stakes testing in employment, credentialing, and higher education: Prospects in a post-affirmative-action world. American Psychologist 56:302–18.
69. Sentencing Project, The. 2000. Reducing racial disparity in the criminal justice system: A manual for practitioners and policymakers. http://www.sentencingproject.org/doc/publications/rd_reducingracialdisparity.pdf.
70. Sentencing Project News. 2015. Race & Justice News: Risk Assessment or Race Assessment? http://www.sentencingproject.org/news/race-justice-news-risk-assessment-or-race-assessment/.
71. Sentencing Reform and Corrections Act. 2015. 114th Congr., S. 2123.
72. Silver, Eric, and Lisa Miller. 2002. A cautionary note on the use of actuarial risk assessment tools for social control. Crime & Delinquency 48:138–61.
73. Silver, Eric, William Smith, and Steven Banks. 2000. Constructing actuarial devices for predicting recidivism: A comparison of methods. Criminal Justice and Behavior 27:733–64.
74. Singh, Jay, and Seena Fazel. 2010. Forensic risk assessment: A metareview. Criminal Justice and Behavior 37:965–88.
75. Skeem, Jennifer L., Robert Barnoski, Edward Latessa, David Robinson, and Claus Tjaden. 2013. Youth risk assessment approaches: Lessons learned and question raised by Baird et al.’s study. http://risk-resilience.berkeley.edu/sites/default/files/journal-articles/files/youth_risk_assessment_approaches_-_lessons_learned_and_question_raised_by_baird_et_al.s_study_2013.pdf.
76. Skeem, Jennifer L., John Edens, Jacqueline Camp, and Lori Colwell. 2004. Are there ethnic differences in levels of psychopathy? A meta-analysis. Law and Human Behavior 28:505–27.
77. Society for Industrial and Organizational Psychology (SIOP). 2003. Principles for the Validation and Use of Personnel Selection Procedures, 4th ed. Bowling Green, OH: Author. http://www.siop.org/_principles/principles.pdf.
78. Starr, Sonja. 2014. Evidence-based sentencing and the scientific rationalization of discrimination. Stanford Law Review 66:803–72.
79. Starr, Sonja. 2015. The new profiling: Why punishing based on poverty and identity is unconstitutional and wrong. Federal Sentencing Reporter 27:229–36.
80. Subramanian, Ram, Rebecka Moreno, and Sharyn Broomhead. 2014. Recalibrating Justice: A Review of 2013 State Sentencing and Corrections Trends. New York: Vera Institute of Justice. http://www.vera.org/sites/default/files/resources/downloads/state-sentencing-and-corrections-trends-2013-v2.pdf.
81. Swanson, Jeffrey, Marvin Swartz, Richard Van Dorn, John Monahan, Tom McGuire, Henry Steadman, and Pamela Robbins. 2009. Racial disparities in involuntary outpatient commitment: Are they real? Health Affairs 28:816–26.
82. Tabachnick, Barbara G., and Linda S. Fidell. 2008. Using Multivariate Statistics. New York: Pearson.
83. Tonry, Michael. 2012. Race, ethnicity, and punishment. In The Oxford Handbook of Sentencing and Corrections, eds. Kevin R. Reitz and Joan Petersilia. New York: Oxford University Press.
84. Tonry, Michael. 2014. Legal and ethical issues in the prediction of recidivism. Federal Sentencing Reporter 26:167–76.
85. Tonry, Michael, and Matthew Melewski. 2008. The malign effects of drug and crime control policies on Black Americans. In Crime and Justice, vol. 37, ed. Michael Tonry. Chicago, IL: University of Chicago Press.
86. Ulmer, Jeffery T. 2012. Recent developments and new directions in sentencing research. Justice Quarterly 29:1–40.
87. Ulmer, Jeffery T., Noah Painter-Davis, and Leigh Tinik. 2014. Disproportional imprisonment of Black and Hispanic males: Sentencing discretion, processing outcomes, and policy structures. Justice Quarterly 33:642–81.
88. van de Vijver, Fons, and Norbert Tanzer. 2004. Bias and equivalence in cross-cultural assessment: An overview. Revue Européenne de Psychologie Appliquée/European Review of Applied Psychology 54:119–35.
89. van Wingerden, Sigrid, Johan van Wilsem, and Martin Moerings. 2014. Pre-sentence reports and punishment: A quasi-experiment assessing the effects of risk-based pre-sentence reports on sentencing. European Journal of Criminology 11:723–44.
90. Walsh, Anthony. 2004. Race and Crime: A Biosocial Analysis. New York: Nova Science.
91. Walker, Samuel, Cassia Spohn, and Miriam DeLone. 2011. The Color of Justice: Race, Ethnicity, and Crime in America, 5th ed. Belmont, CA: Wadsworth.
92. Walters, Glenn. 2012. Psychopathy and crime: Testing the incremental validity of PCL-R-measured psychopathy as a predictor of general and violent recidivism. Law and Human Behavior 36:404–12.
93. Walters, Glenn, and Christopher T. Lowenkamp. 2015. Predicting recidivism with the Psychological Inventory of Criminal Thinking Styles (PICTS) in community-supervised male and female federal offenders. Psychological Assessment 28:652–9. https://doi.org/10.1037/pas0000210.
94. Wilson, Holly, and Leticia Gutierrez. 2014. Does one size fit all? A meta-analysis examining the predictive ability of the Level of Service Inventory (LSI) with aboriginal offenders. Criminal Justice and Behavior 41:196–219.
95. Yang, Min, Stephen Wong, and Jeremy Coid. 2010. The efficacy of violence prediction: A meta-analytic comparison of nine risk assessment tools. Psychological Bulletin 136:740–67.