Algorithmic decision making and the cost of fairness

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn Part F129685, Issue , 2017, Pages 797-806

  Corbett Davies, Sam ^a   Pierson, Emma ^a   Feller, Avi ^b   Goel, Sharad ^a   Huq, Aziz ^c  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONSTRAINED OPTIMIZATION; DATA MINING; ECONOMIC AND SOCIAL EFFECTS; OPTIMIZATION; SAFETY ENGINEERING;

BROWARD COUNTY; DECISION RULES; FAIRNESS CONSTRAINTS; HUMAN DECISIONS; OPTIMAL ALGORITHM; PUBLIC SAFETY; RISK THRESHOLD; TRADE OFF;

DECISION MAKING;

EID: 85029021286     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3097983.3098095     Document Type: Conference Paper

References (42)

1. Lindsay C Ahlman and Ellen M Kurtz. 2009. The APPD randomized controlled trial in low risk supervision: The effects on low risk supervision on rearrest. Philadelphia Adult Probation and Parole Department (2009).
2. Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine bias: There's software used across the country to predict future criminals. and it's biased against blacks. ProPublica (5 2016).
3. Shamena Anwar and Hanming Fang. 2006. An Alternative Test of Racial Prejudice in Motor Vehicle Searches: Theory and Evidence. The American Economic Review (2006).
4. Ian Ayres. 2002. Outcome tests of racial disparities in police practices. Justice research and Policy 4, 1-2(2002), 131-142.
5. Solon Barocas and Andrew D Selbst. 2016. Big data's disparate impact. California Law Review 104 (2016).
6. Gary S Becker. 1957. The economics of discrimination. University of Chicago Press.
7. Richard Berk. 2009. The role of race in forecasts of violent crime. Race and Social Problems (2009), 131-242.
8. Richard Berk. 2012. Criminal justice forecasts of risk: a machine learning approach. Springer Science & Business Media.
9. Richard Berk, Hoda Heidari, Shahin Jabbari, Michael Kearns, and Aaron Roth. 2017. Fairness in Criminal Justice Risk Assessments: The State of the Art. working paper (2017).
10. Richard Berk, Lawrence Sherman, Geoffrey Barnes, Ellen Kurtz, and Lindsay Ahlman. 2009. Forecasting murder within a population of probationers and parolees: a high stakes application of statistical learning. Journal of the Royal Statistical Society: Series A (Statistics in Society) 172, 1 (2009), 191-211.
11. James A Berkovec, Glenn B Canner, Stuart A Gabriel, and Timothy H Hannan. 1994. Race, redlining, and residential mortgage loan performance. The Journal of Real Estate Finance and Economics 9, 3 (1994), 263-294.
12. Alexandra Chouldechova. 2016. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. arXiv preprint arXiv: 1610.07524 (2016).
13. Angèle Christin, Alex Rosenblat, and danah boyd. 2015. Courts and Predictive Algorithms. Data & Civil Rights: Criminal Justice and Civil Rights Primer (2015).
14. Mona Danner, Marie Van Nostrand, and Lisa Spruance. August, 2015. Risk-Based Pretrial Release Recommendation and Supervision Guidelines. (August, 2015).
15. Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. 2012. Fairness through awareness. In Proceedings of the 3rd Innovations in Theoretical Computer Science Conference. ACM, 214-226.
16. Michael Feldman, Sorelle A Friedler, John Moeller, Carlos Scheidegger, and Suresh Venkatasubramanian. 2015. Certifying and removing disparate impact. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 259-268.
17. Benjamin Fish, Jeremy Kun, and Adam Daniel Lelkes. 2016. A Confidence-Based Approach for Balancing Fairness and Accuracy. CoRR abs/1601.05764 (2016).
18. Fisher v. University of Texas at Austin. 2016. 136 S. Ct. 2198, 2208 (2016).
19. Sharad Goel, Justin Rao, and Ravi Shroff. 2016. Personalized Risk Assessments in the Criminal Justice System. The American Economic Review 106, 5 (2016), 119-123.
20. Sharad Goel, Justin M Rao, and Ravi Shroff. 2016. Precinct or Prejudice? Understanding Racial Disparities in New York City's Stop-and-Frisk Policy. Annals of Applied Statistics 10, 1 (2016), 365-394.
21. Sara Hajian, Josep Domingo-Ferrer, and Antoni Martinez-Balleste. 2011. Discrimination prevention in data mining for intrusion and crime detection. In Computational Intelligence in Cyber Security (CICS), 2011 IEEE Symposium on. IEEE, 47-54.
22. Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of opportunity in supervised learning. In Advances In Neural Information Processing Systems. 3315-3323.
23. Eric Holder. 2014. (2014). Remarks at the National Association of Criminal Defense Lawyers 57th Annual Meeting.
24. Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie Morgenstern, and Aaron Roth. 2016. Fair Learning in Markovian Environments. arXiv preprint arXiv: 1611.03071 (2016).
25. Matthew Joseph, Michael Kearns, Jamie H Morgenstern, and Aaron Roth. 2016. Fairness in Learning: Classic and Contextual Bandits. In Advances in Neural Information Processing Systems 29. Curran Associates, Inc., 325-333.
26. Jongbin Jung, Connor Concannon, Ravi Shroff, Sharad Goel, and Daniel G. Goldstein. 2017. Simple rules for complex decisions. (2017). Working paper.
27. Faisal Kamiran, Indre Žliobaitė, and Toon Calders. 2013. Quantifying explainable discrimination and removing illegal discrimination in automated decision making. Knowledge and information systems 35, 3 (2013), 613-644.
28. Toshihiro Kamishima, Shotaro Akaho, Hideki Asoh, and Jun Sakuma. 2012. Fairness-aware classifier with prejudice remover regularizer. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 35-50.
29. Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2017. Inherent trade-offs in the fair determination of risk scores. Proceedings of Innovations in Theoretical Computer Science (ITCS) (2017).
30. Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. ProPublica (5 2016).
31. Kristian Lum and William Isaac. 2016. To predict and serve? Significance 13, 5 (2016), 14-19.
32. J Monahan and JL Skeem. 2016. Risk Assessment in Criminal Sentencing. Annual review of clinical psychology 12 (2016), 489.
33. Scott E Page. 2008. The difference: How the power of diversity creates better groups, firms, schools, and societies. Princeton University Press.
34. Emma Pierson, Sam Corbett-Davies, and Sharad Goel. 2017. Fast threshold tests for detecting discrimination. (2017). Working paper available at https://arxiv.org/abs/1702.08536.
35. John C. Platt. 1999. Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods. In Advances in Large Margin Classifiers. 61-74.
36. Andrea Romei and Salvatore Ruggieri. 2014. A multidisciplinary survey on discrimination analysis. The Knowledge Engineering Review 29, 05 (2014), 582-638.
37. Camelia Simoiu, Sam Corbett-Davies, and Sharad Goel. 2017. The problem of infra-marginality in outcome tests for discrimination. Annals of Applied Statistics (2017). Forthcoming.
38. Jennifer L. Skeem and Christopher T. Lowencamp. 2016. Risk, Race, and Recidivism: Predictive Bias and Disparate Impact. Criminology 54, 4 (2016), 680-712.
39. Sonja B Starr. 2014. Evidence-based sentencing and the scientific rationalization of discrimination. Stan. L. Rev. 66 (2014), 803.
40. Muhammad Bilal Zafar, Isabel Valera, Manuel Gomez Rodriguez, and Krishna P Gummadi. 2017. Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment. In Proceedings of the 26th International World Wide Web Conference.
41. Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. 2013. Learning Fair Representations. In Proceedings of The 30th International Conference on Machine Learning. 325-333.
42. Indre Zliobaite. 2017. Measuring discrimination in algorithmic decision making. Data Mining and Knowledge Discovery (2017).