When the algorithm itself is a racist: Diagnosing ethical harm in the basic Components of Software

International Journal of Communication

Volumn 10, Issue , 2016, Pages 4972-4990

  Sandvig, Christian ^a   Hamilton, Kevin ^b   Karahalios, Karrie ^b   Langbort, Cedric ^b  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Algorithms; Applied ethics; Information and communication technologies (ICT); Internet studies; Science and technology studies (STS)

Indexed keywords

EID: 85024933855     PISSN: None     EISSN: 19328036     Source Type: Journal    
DOI: None     Document Type: Article

References (46)

1. Ananny, M. (2016). Toward an ethics of algorithms: Convening, observation, probability, and timeliness. Science, Technology and Human Values, 41(1), 93-117. Retrieved from http://doi.org/10.1177/0162243915606523
2. Angwin, J. (n.d.). The What They Know series. Retrieved from http://juliaangwin.com/the-what-they-know-series/
3. Association for Computing Machinery. (1992). ACM code of ethics and professional conduct. Retrieved from http://www.acm.org/about-acm/acm-code-of-ethics-and-professional-conduct
4. Barocas, S., Friedler, S., Hardt, M., Kroll, J., Venkatasubramanian, S., & Wallach, H. (2015). FAT ML resources: Fairness, accountability, and transparency in machine learning. Retrieved from http://www.fatml.org/resources.html
5. Bermejo, F. (2007). The Internet audience: Constitution and measurement. New York, NY: Peter Lang
6. Bonilla-Silva, E. (2010). Racism without racists: Color-blind racism and the persistence of racial inequality in the United States. Lanham, MD: Rowman & Littlefield
7. Bowker, G. C., & Star, S. L. (1999). Sorting things out: Classification and its consequences. Cambridge, MA: MIT Press
8. Brunton, F. (2013). Spam: A shadow history of the Internet. Cambridge, MA: MIT Press
9. Callon, M. (1986). Mapping the dynamics of science and technology: Sociology of science in the real world. Basingstoke, UK: Macmillan
10. Chetverikov, D., & Lerch, A. (1992). Multiresolution face detection. In Proceedings of the 6th Workshop on Theoretical Foundations of Computer Vision (pp. 14-21). Berlin, Germany: Akademie-Verlag GmbH
11. Crain, M. (2013). The revolution will be commercialized: Finance, public policy, and the construction of Internet advertising. Champaign: University of Illinois Press
12. Crain, M. (2016). The limits of transparency: Data brokers and commodification. New Media & Society, 1-17. Advanced online publication. Retrieved from http://doi.org/10.1177/1461444816657096
13. Diakopoulos, N. (2015). Algorithmic accountability. Digital Journalism, 3(3), 398-415. Retrieved from http://doi.org/10.1080/21670811.2014.976411
14. Dyer, R. (1997). White. New York, NY: Routledge
15. Fleck, M. M., Forsyth, D. A., & Bregler, C. (1996). Finding naked people. In Proceedings of the 4th European Conference on Computer Vision (Vol. 2, pp. 593-602). London, UK: Springer-Verlag
16. Floridi, L., & Sanders, J. W. (2004). On the morality of artificial agents. Minds and Machines, 14(3), 349-379. Retrieved from http://doi.org/10.1023/B:MIND.0000035461.63578.9d
17. Galloway, A. R. (2006). Gaming: Essays on algorithmic culture. Minneapolis: University of Minnesota Press
18. Gangadharan, S. P. (Ed.). (2014). Data and discrimination: Collected essays. Washington, DC: New America Foundation. Retrieved from https://na-production.s3.amazonaws.com/documents/data-and-discrimination.pdf
19. Gillespie, T. (2012, March). Can an algorithm be wrong? Limn. Retrieved from http://limn.it/can-an-algorithm-be-wrong/
20. Goffey, A. (2008). Algorithm. In M. Fuller (Ed.), Software studies: A lexicon (pp. 15-20). Cambridge, MA: MIT Press
21. Graf, H. P., Chen, T., Petajan, E., & Cosatto, E. (1995). Locating faces and facial parts. In Proceedings of the First International Workshop on Automatic Face and Gesture Recognition (pp. 41-46). New York, NY: IEEE
22. Grimmelmann, J. (2008). The Google dilemma. New York Law School Law Review, 53(4), 939-950
23. Hamilton, K., Karahalios, K., Sandvig, C., & Eslami, M. (2014). A path to understanding the effects of algorithm awareness. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (pp. 631-642). Toronto, Canada: Association for Computing Machinery. Retrieved from http://doi.org/10.1145/2559206.2578883
24. Hannak, A., Sapiezynski, P., Molavi Kakhki, A., Krishnamurthy, B., Lazer, D., Mislove, A., & Wilson, C. (2013). Measuring personalization of Web search. In Proceedings of the 22nd International Conference on World Wide Web (pp. 527-538). Rio de Janeiro, Brazil: Association for Computing Machinery. Retrieved from http://doi.org/10.1145/2488388.2488435
25. Huber, H. (1966). Algorithm and formula: Letter to the editor. Communications of the ACM, 9(9), 653-654
26. Humphreys, L. (2005). Reframing social groups, closure, and stabilization in the social construction of technology. Social Epistemology, 19(2-3), 231-253. Retrieved from http://doi.org/10.1080/02691720500145449
27. Introna, L. D., & Nissenbaum, H. (2000). Shaping the Web: Why the politics of search engines matters. Information Society, 16(3), 169-185. Retrieved from http://doi.org/10.1080/01972240050133634
28. Knuth, D. (1966). Algorithm and program, information and data: Letter to the editor. Communications of the ACM, 9(9), 654
29. Latour, B. (2005). Reassembling the social: An introduction to actor-network-theory. New York, NY: Oxford University Press
30. Neyland, D. (2016). Bearing account-able witness to the ethical algorithmic system. Science, Technology and Human Values, 41(1), 50-76. Retrieved from http://doi.org/10.1177/0162243915598056
31. Neyland, D., & Möllers, N. (2016). Algorithmic IF. THEN rules and the conditions and consequences of power. Information, Communication & Society, 19(0), 1-18. Retrieved from http://doi.org/10.1080/1369118X.2016.1156141
32. Pasquale, F. (2015). The black box society: The secret algorithms that control money and information. Cambridge, MA: Harvard University Press
33. Pinch, T. J., & Bijker, W. E. (1984). The social construction of facts and artifacts: Or how the sociology of science and the sociology of technology might benefit each other. Social Studies of Science, 14(3), 399-441. Retrieved from http://doi.org/10.1177/030631284014003004
34. Sandvig, C. (2014). Seeing the sort: The aesthetic and industrial defense of the algorithm. Media-N, 10(3), 35-51
35. Sandvig, C., Hamilton, K., Karahalios, K., & Langbort, C. (2014). Auditing algorithms: Research methods for detecting discrimination on Internet platforms. Pre-conference on Data and Discrimination at the 64th annual meeting of the International Communication Association (pp. 1-23). Seattle, WA: International Communication Association
36. Seaver, N. (2013). Knowing algorithms. In Media in Transition 8 International Conference (pp. 1-12). Cambridge, MA: MIT
37. Seaver, N. (2014, January 28). On reverse engineering: Looking for the cultural work of engineers. Medium. Retrieved from https://medium.com/anthropology-and-algorithms/on-reverse-engineering-d9f5bae87812#.xje7c8cd4
38. Simon, M. (2009, December 22). HP looking into claim webcams can't see Black people. CNN. Retrieved from http://www.cnn.com/2009/TECH/12/22/hp.webcams/index.html
39. Slack, J. D., & Wise, J. M. (2005). Culture and technology: A primer. New York, NY: Peter Lang
40. Steiner, C. (2012). Automate this: How algorithms came to rule our world. New York, NY: Penguin
41. Striphas, T. (2015). Algorithmic culture. European Journal of Cultural Studies, 18(4-5), 395-412. Retrieved from http://doi.org/10.1177/1367549415577392
42. Totaro, P., & Ninno, D. (2014). The concept of algorithm as an interpretative key of modern rationality. Theory, Culture and Society, 31(4), 29-49. Retrieved from http://doi.org/10.1177/0263276413510051
43. Wangsness, T., & Franklin, J. (1966). Algorithm and formula. Communications of the ACM, 9(4), 243. Retrieved from http://doi.org/10.1145/365278.365286
44. Yang, M. H., Kriegman, D. J., & Ahuja, N. (2002). Detecting faces in images: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1), 34-58. Retrieved from http://doi.org/10.1109/34.982883
45. Zamen, W. (2009, December 10). HP computers are racist. YouTube. Retrieved from https://www.youtube.com/watch?v=t4DT3tQqgRM
46. Ziewitz, M. (2015). Governing algorithms myth, mess, and methods. Science, Technology and Human Values, 41(1), 3-16. Retrieved from http://doi.org/10.1177/0162243915608948