On fairness and calibration

Advances in Neural Information Processing Systems

Volumn 2017-December, Issue , 2017, Pages 5681-5690

  Pleiss, Geoff ^a   Raghavan, Manish ^a   Wu, Felix ^a   Kleinberg, Jon ^a   Weinberger, Kilian Q ^a  

^a Department of Obstetrics Gynecology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

CLASSIFICATION PROCEDURE; ERROR CONSTRAINTS; FALSE NEGATIVES; MACHINE LEARNING COMMUNITIES; PREDICTIVE MODELS; PROBABILITY ESTIMATE;

CALIBRATION;

EID: 85047008485     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. J. Angwin, J. Larson, S. Mattu, and L. Kirchner. Machine bias: There's software used across the country to predict future criminals. And it's biased against blacks. ProPublica, 2016. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing.
2. S. Barocas and A. D. Selbst. Big data's disparate impact. California Law Review, 104, 2016.
3. R. Berk. A primer on fairness in criminal justice risk assessments. Criminology, 41(6): 6-9, 2016.
4. R. Berk, H. Heidari, S. Jabbari, M. Kearns, and A. Roth. Fairness in criminal justice risk assessments: The state of the art. arXiv preprint arXiv: 1703.09207, 2017.
5. T. Bolukbasi, K.-W. Chang, J. Y. Zou, V. Saligrama, and A. T. Kalai. Man is to computer programmer as woman is to homemaker? debiasing word embeddings. In NIPS, pages 4349-4357, 2016.
6. T. Calders and S. Verwer. Three naive bayes approaches for discrimination-free classification. KDD, 2012.
7. T. Calders, F. Kamiran, and M. Pechenizkiy. Building classifiers with independency constraints. In ICDM Workshops, 2009.
8. A. Chouldechova. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. arXiv preprint arXiv: 1703.00056, 2017.
9. S. Corbett-Davies, E. Pierson, A. Feller, S. Goel, and A. Huq. Algorithmic decision making and the cost of fairness. In KDD, pages 797-806, 2017.
10. C. S. Crowson, E. J. Atkinson, and T. M. Therneau. Assessing calibration of prognostic risk scores. Statistical Methods in Medical Research, 25(4): 1692-1706, 2016.
11. A. P. Dawid. The well-calibrated bayesian. Journal of the American Statistical Association, 77(379): 605-610, 1982.
12. W. Dieterich, C. Mendoza, and T. Brennan. COMPAS risk scales: Demonstrating accuracy equity and predictive parity. Technical report, Northpointe, July 2016. http://www.northpointeinc.com/northpointe-analysis.
13. C. Dwork, M. Hardt, T. Pitassi, O. Reingold, and R. Zemel. Fairness through awareness. In Innovations in Theoretical Computer Science, 2012.
14. H. Edwards and A. Storkey. Censoring representations with an adversary. In ICLR, 2016.
15. M. Feldman, S. A. Friedler, J. Moeller, C. Scheidegger, and S. Venkatasubramanian. Certifying and removing disparate impact. In KDD, pages 259-268, 2015.
16. A. Flores, C. Lowenkamp, and K. Bechtel. False positives, false negatives, and false analyses: A rejoinder to "machine bias: There's software used across the country to predict future criminals. and it's biased against blacks.". Technical report, Crime & Justice Institute, September 2016. http://www.crj.org/cji/entry/false-positives-false-negatives-and-false-analyses-a-rejoinder.
17. G. Goh, A. Cotter, M. Gupta, and M. P. Friedlander. Satisfying real-world goals with dataset constraints. In NIPS, pages 2415-2423. 2016.
18. C. Guo, G. Pleiss, Y. Sun, and K. Q. Weinberger. On calibration of modern neural networks. In ICML, 2017.
19. M. Hardt, E. Price, and S. Nathan. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems, 2016.
20. J. E. Johndrow and K. Lum. An algorithm for removing sensitive information: application to race-independent recidivism prediction. arXiv preprint arXiv: 1703.04957, 2017.
21. M. Joseph, M. Kearns, J. H. Morgenstern, and A. Roth. Fairness in learning: Classic and contextual bandits. In NIPS, 2016.
22. F. Kamiran and T. Calders. Classifying without discriminating. In International Conference on Computer Control and Communication, 2009.
23. T. Kamishima, S. Akaho, and J. Sakuma. Fairness-aware learning through regularization approach. In ICDM Workshops, 2011.
24. M. Kearns, A. Roth, and Z. S. Wu. Meritocratic fairness for cross-population selection. In International Conference on Machine Learning, pages 1828-1836, 2017.
25. N. Kilbertus, M. Rojas-Carulla, G. Parascandolo, M. Hardt, D. Janzing, and B. Schölkopf. Avoiding discrimination through causal reasoning. In NIPS, 2017.
26. J. Kleinberg, S. Mullainathan, and M. Raghavan. Inherent trade-offs in the fair determination of risk scores. In Innovations in Theoretical Computer Science. ACM, 2017.
27. M. J. Kusner, J. R. Loftus, C. Russell, and R. Silva. Counterfactual fairness. arXiv preprint arXiv: 1703.06856, 2017.
28. M. Lichman. UCI machine learning repository, 2013. URL http://archive.ics.uci.edu/ml.
29. C. Louizos, K. Swersky, Y. Li, M. Welling, and R. Zemel. The variational fair auto encoder. In ICLR, 2016.
30. A. Niculescu-Mizil and R. Caruana. Predicting good probabilities with supervised learning. In ICML, 2005.
31. J. Platt. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in Large Margin Classifiers, 10(3): 61-74, 1999.
32. A. Romei and S. Ruggieri. A multidisciplinary survey on discrimination analysis. The Knowledge Engineering Review, 29(05): 582-638, 2014.
33. White-House. Big data: A report on algorithmic systems, opportunity, and civil rights. Technical report, May 2016.
34. B. Woodworth, S. Gunasekar, M. I. Ohannessian, and N. Srebro. Learning non-discriminatory predictors. In Proceedings of the 2017 Conference on Learning Theory, Volume 65, pages 1920-1953, Amsterdam, Netherlands, 07-10 Jul 2017. PMLR.
35. B. Zadrozny and C. Elkan. Obtaining calibrated probability estimates from decision trees and naive bayesian classifiers. In ICML, pages 609-616, 2001.
36. M. B. Zafar, I. Valera, M. G. Rodriguez, and K. P. Gummadi. Learning fair classifiers. arXiv preprint arXiv: 1507.05259, 2015.
37. M. B. Zafar, I. Valera, M. G. Rodriguez, and K. P. Gummadi. Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment. In World Wide Web Conference, 2017.
38. R. S. Zemel, Y. Wu, K. Swersky, T. Pitassi, and C. Dwork. Learning fair representations. In ICML, 2013.
39. I. Zliobaite. On the relation between accuracy and fairness in binary classification. In ICML Workshop on Fairness, Accountability, and Transparency in Machine Learning, 2015.