European union regulations on algorithmic decision making and a "right to explanation"

AI Magazine

Volumn 38, Issue 3, 2017, Pages 50-57

  Goodman, Bryce ^a   Flaxman, Seth ^b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION MAKING; DIGITAL STORAGE;

EUROPEAN PARLIAMENT; EUROPEAN UNION; EUROPEAN UNION REGULATIONS; FOREIGN COMPANIES; GENERAL DATA PROTECTION REGULATIONS; PERSONAL INFORMATION; RIGHT TO BE FORGOTTEN;

LAWS AND LEGISLATION;

EID: 85030554293     PISSN: 07384602     EISSN: None     Source Type: Journal    
DOI: 10.1609/aimag.v38i3.2741     Document Type: Article

References (36)

1. Abrams, D.; Bertrand, M.; and Mullainathan, S. 2012. Do Judges Vary in Their Treatment of Race?. Journal of Legal Studies 41(2): 347-383. doi.org/10.1086/666006
2. Aigner, D. J., and Cain, G. G. 1977. Statistical Theories of Discrimination in Labor Markets. Industrial and Labor Relations Review 30(2): 175. doi.org/10.1177/00197939770 3000204
3. Altman, A. 2015. Discrimination. In The Stanford Encyclopedia of Philosophy, Fall edition, ed. E. N. Zalta. Stanford, CA: Stanford University.
4. Barocas, S., and Selbst, A. D. 2016. Big Data's Disparate Impact. California Law Review 104: 671.
5. Berendt, B., and Preibusch, S. 2012. Exploring Discrimination: A User-Centric Evaluation of Discrimination-Aware Data Mining. 344-351. In 2012 IEEE 12th International Conference on Data Mining Workshops. Piscataway, NJ: Institute for Electrical and Electronics Engineers.
6. Berendt, B., and Preibusch, S. 2014. Better Decision Support Through Exploratory Discrimination-Aware Data Mining: Foundations and Empirical Evidence. Artificial Intelligence and Law 22(2): 175-209. doi.org/ 10.1007/s10506-013-9152-0
7. Bowen, W. G.; and Bok, D. 1998. The Shape of the River. Long-Term Consequences of Considering Race in College and University Admissions. Princeton, NJ: Princeton Univ. Press
8. Burrell, J. 2016. How the Machine "Thinks": Understanding Opacity in Machine Learning Algorithms. Big Data and Society 3(1).
9. Calders, T., and Verwer, S. 2010. Three Naive Bayes Approaches for Discrimination-Free Classification. Data Mining and Knowledge Discovery 21(2): 277-292. doi.org/ 10.1007/s10618-010-0190-x
10. Danziger, S.; Levav, J.; and Avnaim-Pesso, L. 2011. Extraneous Factors in Judicial Decisions. Proceedings of the National Academy of Sciences 108(17): 6889-6892. doi.org/10. 1073/pnas.1018033108
11. Datta, A.; Sen, S.; and Zick, Y. 2016. Algorithmic Transparency via Quantitative Input Influence. Paper presented at the 37th IEEE Symposium on Security and Privacy, 23-25 May, San Jose, CA.
12. Dive, R., and Khedkar, A. 2014. An Approach for Discrimination Prevention in Data Mining. International Journal of Application or Innovation in Engineering and Management 3(6). European Documentation Centre. 2016.
13. European Commission - Legislation. Nicosia, Cyprus: University of Nicosia. (www.library.unic.ac.cy/EDC/EU-Resources /EU- Legislation.html.)
14. European Union, Parliament and Council. 2016. General Data Protection Regulation. Official Journal of the European Union L 119/1 April 5.
15. Feldman, M.; Friedler, S. A.; Moeller, J.; Scheidegger, C.; and Venkatasubramanian, S. 2015. Certifying and Removing Disparate Impact. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 259-268. New York: Association for Computing Machinery. doi.org/10.1145/2783258.2783311
16. Fromholz, J. M. 2000. The European Union Data Privacy Directive. Berkeley Technology Law Journal 15(1): 461-484.
17. Goodman, B. 2016a. Big Data's Crooked Timbers: Algorithmic Discrimination and the European Union's General Data Protection regulation. Master's thesis, (Computational Social Science) University of Oxford, Oxford, UK.
18. Goodman, B. 2016b. Computer Says No: Economic Models of (Algorithmic) Discrimination. Unpublished paper, Oxford, UK.
19. Hajian, S.; Domingo-Ferrer, J.; and Martinez-Balleste, A. 2011. Discrimination Prevention in Data Mining for Intrusion and Crime Detection. In 2011 IEEE Symposium on Computational Intelligence in Cyber Security (CICS), 4754. Piscataway, NJ: Institute for Electrical and Electronics Engineers. doi.org/10.1109/CICYBS.2011.5949405
20. Hardt, M. 2014. How Big Data Is Unfair: Understanding Sources of Unfairness in Data Driven Decision Making. Unpublished paper. (medium.com/@mrtz/how-big-datais-unfair-9aa544d739de)
21. Hildebrandt, M. 2008. Defining Profiling: A New Type of Knowledge?. In Profiling the European Citizen. Cross-Disciplinary Perspectives, ed. M. Hildebrandt and S. Guthwirth, 17-30. Berlin: Springer. doi.org/10.1007/ 978-1-4020-6914-7-2
22. Holmes, A., and Horvitz, P. 1994. Mortgage Redlining: Race, Risk, and Demand. Journal of Finance 49(1):81-100. doi.org/ 10.1111/ j.1540-6261.1994.tb04421.x
23. Jia, R., and Liang, P. 2016. Data Recombination for Neural Semantic Parsing. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL 2016), 12-22. Stroudsberg, PA: Association for Computational Linguistics. doi.org/10.18653/v1/p16-1002
24. Kim, B.; Malioutov, D. M.; and Varshney, K. R. 2016. Unpublished Proceedings of the 2016 ICML Workshop on Human Interpretability in Machine Learning (WHI 2016). arXiv:1607.02531. Ithaca, NY: Cornell University Library.
25. Kuner, C. 2012. The European Commission's Proposed Data Protection Regulation: A Copernican Revolution in European Data Protection Law. Bloomberg BNA. Privacy and Security 6(2012): 115.
26. Laqueur, H., and Copus, R. 2015. Machines Learning Justice: The Case for Judgmental Bootstrapping of Legal Decisions. SSRN. Amsterdam, Netherlands: Elsevier. doi.org/ 10.2139/ ssrn.2694326
27. Leese, M. 2014. The New Profiling: Algorithms, Black Boxes, and the Failure of Anti-Discriminatory Safeguards in the European Union. Security Dialogue 45(5): 494-511. doi.org/ 10.1177/0967010614544204
28. Lisboa, P. J. 2013. Interpretability in Machine Learning - Principles and Practice. In Fuzzy Logic and Applications. (WILF 2013), ed. F. Musulli, G. Pasi, and R. Yager. Lecture Notes in Computer Science, vol 8256. Berlin: Springer. doi.org/10.1007/978-3-319-03200-9-2
29. Mayer-Schönberger, V., and Padova, Y. 2016. Regime Change?. Enabling Big Data Through Europe's New Data Protection Regulation. The Columbia Science & Technology Law Review 17(1)(Spring): 315-335
30. Pasquale, F. 2015. The Black Box Society: The Secret Algorithms That Control Money and Information. Cambridge, MA: Harvard University Press. doi.org/10.4159/harvard. 9780674736061
31. Pastor, N., and Lawrence, G. 2016. Getting to Know the GDPR, Part 10: Enforcement under the GDPR - What Happens If You Get It Wrong?. Amsterdam, Netherlands: Fieldfisher.
32. Robinson, D.; Yu, H.; and Rieke, A. 2014. Civil Rights, Big Data, and Our Algorithmic Future: A September 2014 Report on Social Justice and Technology. Unpublished Report of the Center for Media Justice, Oakland, CA.
33. Sandvig, C.; Hamilton, K.; Karahalios, K.; and Langbort, C. 2014. Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms. Paper presented at Data and Discrimination: Converting Critical Concerns into Productive Inquiry, a preconference of the 64th Annual Meeting of the International Communication Association. Seattle, WA, May 22.
34. Tversky, A., and Kahneman, D. 1974. Judgment Under Uncertainty: Heuristics and Biases. Science 185(4157): 1124 1131. doi. org/10.1126/science.185.4157.112
35. Vellido, A.; Martín-Guerrero, J. D.; and Lisboa, P. J. 2012. Making Machine Learning Models Interpretable. Paper presented at the European Symposium on Artificial Neural Networks, Computational Intelligence, and Machine Learning, Bruges, Belgium, 25-27
36. April. Zliobaite, I.; Kamiran, F.; and Calders, T. 2011. Handling Conditional Discrimination. In Proceedings, 2011 IEEE 11th International Conference on Data Mining, 992-1001. Piscataway, NJ: Institute for Electrical and Electronics Engineers. doi.org/10.1109/ ICDM.2011.72