Engaging rational discrimination: Exploring reasons for placing regulatory constraints on decision support systems

Ethics and Information Technology

Volumn 12, Issue 1, 2010, Pages 29-42

  Gandy Jr , Oscar H ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Ambient intelligence; Discrimination; Insurance; Privacy; Race; Surveillance; Technology assessment

Indexed keywords

AMBIENT INTELLIGENCE; CONTINUOUS ASSESSMENT; DISCRIMINATION; RACE; SOCIAL INEQUALITIES; TECHNOLOGY ASSESSMENTS; UNINTENDED CONSEQUENCES;

DATA PRIVACY; DECISION SUPPORT SYSTEMS; INSURANCE; SPACE SURVEILLANCE;

ARTIFICIAL INTELLIGENCE;

EID: 76649119461     PISSN: 13881957     EISSN: 15728439     Source Type: Journal    
DOI: 10.1007/s10676-009-9198-6     Document Type: Article

References (104)

1. ACORN Fair Housing. (2007). Foreclosure exposure: A study of racial and income disparities in home mortgage lending in 172 American cities. Chicago: ACORN Housing Corporation.
2. Altman, E., & Saunders, A. (1998). Credit risk measurement: Developments over the last 20 years. Journal of Banking and Finance, 21: 1721-1742.
3. See also, Mester, L. (1997). What's the point of credit scoring? Business Review, October/November, pp. 3-16.
4. Amegashie, J. A. (2008). Socially-tolerable discrimination. MPRA paper no. 8543, Munich Personal RePEc Archive. http://mpra. ub. uni-meunchen. de/8543.
5. Armour, J. (1997). Negrophobia and reasonable racism (pp. 35-67). New York: New York University Press.
6. Ayres, I. (2007). Market power and inequality: A competitive conduct standard for assessing when disparate impacts are unjustified. California Law Review, 95, 669-719.
7. Ayres, I., Vars, F., & Zakariya, N. (2005). To insure prejudice: Racial disparities in taxicab tipping. Yale Law Journal, 114, 1640.
8. Baker, C. E. (2002). Media, markets, and democracy. New York: Cambridge University Press.
9. Balkin, J. M. (1997). The constitution of status. Yale Law Journal, 106, 2366.
10. Barnes, P. (2006). Capitalism 3. 0: A guide to reclaiming the commons. San Francisco: Berrett-Koehler.
11. Baumgartner, F., & Jones, B. (1993). Agendas and instability in American politics. Chicago: University of Chicago Press.
12. Becker, G. (1971). The economics of discrimination (2nd ed.). Chicago: University of Chicago Press.
13. Belavkin, R. (2001). The role of emotion in problem solving. In C. Johnson (ed), Proceedings of the AISB '01 Symposium on emotion, cognition and affective computing (pp. 49-57). York: Heslington
14. See also, Canamero, D. (2001). Modeling motivations and emotions as a basis for intelligent behavior. Agents '97, ACM, 1997, and Aaron Sloman. Beyond shallow models of emotion. Cognitive Processing, 2: 177-198.
15. Birnbaum, B. (2003). Insurers' use of credit scoring for homeowners insurance in Ohio. Columbus: Ohio Civil Rights Commission.
16. Bowker, G. C., & Star, S. L. (1999). Sorting things out: Classification and its consequences. Cambridge: The MIT Press.
17. Brey, P. (2005). Freedom and privacy in ambient intelligence. Ethics and Information Technology, 7, 157-166.
18. Brockett, P. L., & Golden, L. L. (2007). Biological and psychobehavioral correlates of credit scores and automobile insurance losses: Toward an explication of why credit scoring works. The Journal of Risk and Insurance, 74, 23-63.
19. Camerer, C., & Fehr, E. (2006). When does "Economic Man" dominate social behavior? Science, 311, 47-52.
20. Carusi, A. (2008). Data as representation: Beyond anonymity in e-research ethics. International Journal of Internet Research Ethics, 1, 37-65.
21. Case, M. A. (2002-2003). Developing a taste for not being discriminated against. Stanford Law Review, 55: 2273-2291.
22. Chandler, S. (2002). Visualizing adverse selection: An economic approach to the law of insurance underwriting. Connecticut Insurance Law Journal, 8, 435-503.
23. Charles, C. Z. (2003). The dynamics of racial residential segregation. Annual Review of Sociology, 29, 167-207.
24. Chin, G. J. (2002). Race, the war on drugs, and the collateral consequences of criminal conviction. The Journal of Gender, Race & Justice, 6(25), 3-275.
25. Committee on Networked Systems of Embedded Computers. (2001). Embedded, everywhere: A research agenda for networked systems of embedded computers. Washington: National Research Council, National Academy Press.
26. Dahrendorf, R. (1979). Life chances: Approaches to social and political theory. Chicago: University of Chicago Press.
27. DiPrete, T., & Eirich, G. (2006). Cumulative advantage as a mechanism for inequality: A review of theoretical and empirical developments. Annual Review of Sociology, 32, 271-297.
28. Elster, J. (1990). When rationality fails. In K. S. Cook & M. Levi (Eds.), The limits of rationality (pp. 19-51). Chicago: University of Chicago Press.
29. Florescu, D., Koller, D., & Levy, A. (1997). Using probabilistic information in data integration. Proceedings of the 23rd VLDB Conference. Athens: Greece, pp. 216-225.
30. Friedewald, M., Lindner, R., & Wright, D. (eds.), (2006). Policy options to counteract threats and vulnerabilities in ambient intelligence, SWAMI. Deliverable D3: A report of the SWAMI consortium to the European Commission under contract 006507. http://swami. jrc. es.
31. Gandy, O. H., Jr. (1982). Beyond agenda setting: Information subsidies and public policy. Norwood: Ablex.
32. See also, Gandy, O. H., Jr. (2003). Public opinion surveys and the formation of privacy policy. Journal of Social Issues, 59: 283-299.
33. Gandy, O. (1993). The panoptic sort: A political economy of personal information. Boulder: Westview Press.
34. Gandy, O. (1995). It's discrimination stupid. In J. Brook & I. Boal (Eds.), Resisting the virtual life: The culture and politics of information (pp. 35-47). San Francisco: City Lights Books.
35. Gandy, O. (1996). Legitimate business interest: No end in sight? An inquiry into the status of privacy in cyberspace (pp. 77-137). Chicago: University of Chicago Legal Forum.
36. Gandy, O. (2006a). Quixotics unite! Engaging the pragmatists on rational discrimination. In D. Lyon (Ed.), Theorizing surveillance: The Panopticon and beyond (pp. 318-336). Portland: Willan Publishing.
37. Gandy, O. H., Jr. (2006b). Data mining, surveillance, and discrimination in the post-9/11 environment. In K. Haggerty & R. Ericson (Eds.), The new politics of surveillance and visibility (pp. 363-384). Toronto: University of Toronto Press.
38. Gandy, O., & Baruh, L. (2006). Racial profiling: They said it was against the law!. University of Ottawa Law & Technology Journal, 3, 297-327.
39. Giddens, A. (1984). The constitution of society (pp. 5-14). Cambridge: Polity Press.
40. Graham, S. (2005). Software-sorted geographies. Progress in Human Geography, 29, 1-19.
41. Haddawy, P. (1999). An overview of some recent developments in{open box}Bayesian problem solving techniques. The AI Magazine, 20, 11-19.
42. Hahn, R., & Tetlock, P. C. (2007). Has economic analysis improved regulatory decisions? Working paper 07-08. Washington: AEI-Brookings Joint Center for Regulatory Studies.
43. Harcourt, B. (2007). Against prediction: Profiling, policing, and punishment in an actuarial age. Chicago: University of Chicago Press.
44. Harmon, A. (2008). Congress passes bill to bar bias based on genes. In New York Times Online, http://www. nytimes. com/2008/05/02/health/policy/02gene. html.
45. Hausman, D., & McPherson, M. (1996). Economic analysis and moral philosophy. New York: Cambridge University Press.
46. Hildebrandt, M. (2006). Profiling: From data to knowledge. Datenschutz und Datensicherheit, 30, 548-552.
47. Hildebrandt, M., & Meints, M. (eds). (2006). D7. 7: RFID, Profiling, and AmI. Future of identity in the information society (FDIS Consortium).
48. Hildebrandt, M., Gutwirth, S., & De Hert, P. (2005). Implications of profiling practices on democracy and the rule of law. Deliverable D7. 4, FIDIS Consortium.
49. Holland, P. W. (2008). Causation and race. In T. Zuberi & E. Bonita-Silva (Eds.), White logic, White methods (pp. 93-109). Lanham: Rowman & Littlefield.
50. Jost, J., Nosek, B., & Gosling, S. (2008). Ideology: Its resurgence in social, personality, and political psychology. Perspectives on Psychological Science, 3(2), 126-136.
51. Kahn, S., & Lambert, A. (2001). Perceptions of rational discrimination: When do people attempt to justify race-based prejudice? Basic and Applied Social Psychology, 23, 43-53.
52. Kang, J., & Banaji, M. (2006). Fair measures: A behavioral realist revision of affirmative action. California Law Review, 94, 1063-1118.
53. Klasen, S. (2006). The efficiency of equity. Discussion paper no. 145, Goettingen: Ibero-America Institute for Economic Research.
54. Kleindorfer, P., Kunreuther, H., & Shoemaker, P. (1993). Decision sciences: An integrative perspective (pp. 86-104). New York: Cambridge University Press.
55. Knoch, D., Pascual-Leone, A., Meyer, K., Treyer, V., & Fehr, E. (2006). Diminishing reciprocal fairness by disrupting the right prefrontal cortex. Science, 314, 829-832.
56. Koomey, J., et al. (2002). Sorry wrong number: The use and misuse of numerical facts in analysis and media reporting of energy issues. Annual Review of Energy and the Environment, 27: 119-158.
57. See also, Best, J. (2001). Damned lies and statistics: Untangling numbers from the media, politicians, and activists. Berkeley: University of California Press.
58. Kurzweil, R. (2005). The singularity is near: When humans transcend biology. New York: Viking.
59. Lafuente-Rojo, A., Abascal-Gonzalez, J., & Cai, Y. (2007). Ambient intelligence: Chronicle of an announced technological revolution. UPGRADE, 8, 8-12.
60. Lakoff, G. (2002). Moral politics: How liberals and conservatives think. Chicago: University of Chicago Press
61. See also, Wilson, M. S. (2004). Values and political ideology: Rokeach's two-value model in a proportional representation environment. New Zealand Journal of Psychology23.
62. Landes, W. M., & Posner, R. A. (2004). The political economy of intellectual property law. Washington: The AEI Press.
63. Le Grand, J. (1990). Equity versus efficiency: The elusive trade-off. Ethics, 100, 554-568.
64. Lejano, R. P. (2008). Technology and institutions: A critical appraisal of GIS in the planning domain. Science, Technology and Human Values, 33, 653-678.
65. Lemmens, T., & Thiery, Y. (2007). Insurance and human rights: What can Europe learn from Canadian anti-discrimination law? In H. Cousy & C. V. Schoubroeck (Eds.), Discrimination in insurance. Maklu: Academia-Bruylant.
66. Link, B., & Phelan, J. C. (2001). Conceptualizing stigma. Annual Review of Sociology, 27, 363-385.
67. Medina, H. (2004). Consumer protection: Federal and state agencies face challenges in combating predatory lending. Washington: United States General Accounting Agency.
68. See also, Engel, K., & McCoy, P. (2002). A tale of three markets: The law and economics of predatory lending. Texas Law Review, 80: 1255-1367.
69. Moll, J., Oliveira-Souza, R., & Zahn, R. (2008). The neural basis of moral cognition: Sentiments, concepts, and values. Annals of the New York Academy of Sciences, 1124, 161-180.
70. Norman, P. (2003). Statistical discrimination and efficiency. The Review of Economic Studies, 70, 615-627.
71. Nosek, B., Greenwald, A., & Banaji, M. (2006). The implicit association test at age 7: A methodological and conceptual review. In J. A. Bargh (Ed.), Social psychology and the unconscious: The automaticity of higher mental processes (pp.{open box}265-292). London: Psychology Press.
72. Okun, A. (1975). Equality and efficiency: The big tradeoff. Washington: The Brookings Institution.
73. Patrick, G. (2007). The locus opus: Playing with privacy in a world of ambient intelligence. Manuscript online at http://ssrn. com/abstract=1091116.
74. Pirttila, J., & Uusitalo, R. (2007). Leaky bucket in the real world: Estimating inequality aversion using survey data. Paper presented to the Conference on Public Sector Economics. Munich.
75. Quillian, L. (2006). New approaches to understanding racial prejudice and discrimination. Annual Review of Sociology, 32, 299-328.
76. Ramirez, S. A. (2004). Bearing the costs of racial inequality: Brown and the myth of the equality/efficiency trade-off. Washburn Law Journal, 44, 87-104.
77. Rawls, A. J. (1971). Theory of justice. Cambridge: Harvard University Press.
78. Regan, M. C., Jr. (2007). Moral intuitions and organizational culture. Saint Louis University Law Journal, 51, 941-988.
79. Rokeach, M. (1973). The nature of human values. New York: Free Press.
80. Rouvroy, A. (2008). Privacy, data protection, and the unprecedented challenges of ambient intelligence. Studies in Ethics, Law, and Technology, 2, 1-51.
81. Saguaro Seminar on Civic Engagement in America. (2000). Better together. Cambridge: John F. Kennedy School of Government, Harvard University.
82. Sampson, R., Morenoff, J., & Gannon-Rowley, T. (2002). Assessing 'neighborhood effects': Social processes and new directions in research. Annual Review of Sociology, 28, 443-478.
83. Sandefur, R. (2008). Access to civil justice and race, class and gender inequality. Annual Review of Sociology, 34(16), 1-20.
84. Sanfey, A., Rilling, J., Aronson, J., Nystrom, L., & Cohen, J. (2003). The neural basis of economic decision-making in the Ultimatum game. Science, 300, 1755-1758.
85. Schauer, F. F. (2003). Profiles, probabilities and stereotypes. Cambridge: Harvard University Press.
86. Schneider, J. D. (2004). The psychology of stereotyping (pp. 197-206). New York: The Guilford Press.
87. Schneier, B. (2003). Beyond Fear: Thinking sensibly about security in an uncertain world. New York: Copernicus Books.
88. See also, Wall, D. S. (2007). Cybercrime: The transformation of crime in the information age. Cambridge: Polity.
89. Sen, A. (1992). Inequality reexamined. Cambridge: Harvard University Press.
90. Tenner, E. (1996). Why things bite back: Technology and the revenge of unintended consequences. New York: Vintage Books.
91. The Genetic Nondiscrimination Act (2008). Public Law No: 110-233, 21 May.
92. Thiery, Y., & van Shoubroeck, C. (2006). Fairness and equality in insurance classification. The Geneva Papers, 31: 190-211.
93. See also, Marmor, T., & Mashaw, J. (2006). Understanding social insurance: Fairness, affordability, and the 'modernization' of Social Security and Medicare. Health Affairs, 25: 114-134.
94. van Hoyweghen, I., Horstman, K., & Schepers, R. (2005). 'Genetics is not the issue': Insurers on genetics and life insurance. New Genetics and Society, 24, 79-98.
95. Waldo, J., Lin, H., & Millett, L. (Eds.). (2007). Engaging privacy and information technology in a digital age. Washington: National Academies Press.
96. Weiss, M. J. (1988). The clustering of America. New York: Harper & Row.
97. Weiss, J. M. (2000). The clustered world: How we live, what we buy, and what it all means about who we are. Boston: Little, Brown & Co.
98. Whitby, A., Josang, A., & Indulska, J. (2004). Filtering out unfair ratings in Bayesian reputation systems, Proceedings of the autonomous agents and multi agent systems conference. New York.
99. Wilson, M. S. (2005). A social-value analysis of postmaterialism. The Journal of Social Psychology, 145(2), 209-224.
100. Wortham, L. (1986). Insurance classification: Too important to be left to the actuaries. Journal of Law Reform, 19, 349-423.
101. Yamamiya, Y., Cash, T., Melnyk, S., Posavac, H., & Posavac, S. (2005). Women's exposure to thin-and beautiful media images: Body image effects of media-ideal internalization and impact-reduction interventions. Body Image, 2: 74-80.
102. See also, Johnson, P., McCreary, D., & Mills, J. (2007). Effects of exposure to objectified male and female media images on men's psychological well-being. Psychology of Men and Masculinity, 8: 95-102.
103. Zuberi, T. (2001). Thicker than blood: How racial statistics lie. Minneapolis: University of Minnesota Press, pp. 126-130.
104. See also, Freedman, D. A. (1997). From association to causation via regression. In V. McKim & S. Turner (eds), Causality in crisis? Statistical methods and the search for causal knowledge in the social sciences (pp. 113-162). Notre Dame: University of Notre Dame Press.