Statistically small effects of the Implicit Association Test can have societally large effects

Journal of Personality and Social Psychology

Volumn 108, Issue 4, 2015, Pages 553-561

  Greenwald, Anthony G ^a   Banaji, Mahzarin R ^b   Nosek, Brian A ^c  

^a UNIVERSITY OF WASHINGTON   (United States)

^b HARVARD UNIVERSITY   (United States)

^c UNIVERSITY OF VIRGINIA   (United States)

Author keywords

Effect size; Implicit Association Test; Meta analysis; Predictive validity; Race discrimination

Indexed keywords

ASSOCIATION; HUMAN; META ANALYSIS (TOPIC); NEUROPSYCHOLOGICAL TEST; PSYCHOLOGY; RACISM; STATISTICAL ANALYSIS; STATISTICS AND NUMERICAL DATA;

ASSOCIATION; DATA INTERPRETATION, STATISTICAL; HUMANS; META-ANALYSIS AS TOPIC; NEUROPSYCHOLOGICAL TESTS; RACISM;

EID: 84926375021     PISSN: 00223514     EISSN: None     Source Type: Journal    
DOI: 10.1037/pspa0000016     Document Type: Article

References (46)

1. Agerström, J., & Rooth, D.-O. (2011). The role of automatic obesity stereotypes in real hiring discrimination. Journal of Applied Psychology, 96, 790-805. http://dx.doi.org/10.1037/a0021594
2. Agosta, S., & Sartori, G. (2013). The autobiographical IAT: A review. Frontiers in Psychology, 4, 519. http://dx.doi.org/10.3389/fpsyg.2013.00519
3. Ajzen, I., & Fishbein, M. (1977). Attitude-behavior relations: A theoretical analysis and review of empirical research. Psychological Bulletin, 84, 888-918. http://dx.doi.org/10.1037/0033-2909.84.5.888
4. Amodio, D. M., & Devine, P. G. (2006). Stereotyping and evaluation in implicit race bias: Evidence for independent constructs and unique effects on behavior. Journal of Personality and Social Psychology, 91, 652-661. http://dx.doi.org/10.1037/0022-3514.91.4.652
5. Bendick, M. (2004, June). Using paired-comparison testing to develop a social psychology of civil rights. Paper presented at the biennial conference of the Society for the Psychological Study of Social Issues, Washington, DC.
6. Bertrand, M., & Mullainathan, S. (2004). Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. Chicago, IL: University of Chicago Business School.
7. Brewer, M. B. (1999). The psychology of prejudice: Ingroup love or outgroup hate? Journal of Social Issues, 55, 429-444. http://dx.doi.org/10.1111/0022-4537.00126
8. Carter, P., Fine, M., & Russell, S. (2014). Discipline disparities series: Overview. Bloomington, IN: Center for Evaluation and Education Policy.
9. Cohen, J. (1977). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
10. Fazio, R. H. (1990). Multiple processes by which attitudes guide behavior: The MODE model as an integrative framework. In M. P. Zanna (Ed.), Advances in experimental social psychology (Vol. 23, pp. 75-109). New York: Academic Press.
11. Gaertner, S. L., Dovidio, J. F., Banker, B. S., Rust, M. C., Nier, J. A., Mottola, G. R., & Ward, C. M. (1997). Does racism necessarily mean anti-Blackness? Aversive racism and pro-Whiteness. In M. Fine, L. Powell, L. Weis, & M. Wong (Eds.), Off white: Readings on race, power, and society (pp. 167-178). London, United Kingdom: Routledge.
12. Gray, N. S., Brown, A. S., MacCulloch, M. J., Smith, J., & Snowden, R. J. (2005). An implicit test of the associations between children and sex in pedophiles. Journal of Abnormal Psychology, 114, 304-308. http://dx.doi.org/10.1037/0021-843X.114.2.304
13. Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74, 1464-1480. http://dx.doi.org/10.1037/0022-3514.74.6.1464
14. Greenwald, A. G., & Nosek, B. A. (2001). Health of the Implicit Association Test at age 3. Zeitschrift für Experimentelle Psychologie, 48, 85-93.
15. Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003). Understanding and using the implicit association test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85, 197-216. http://dx.doi.org/10.1037/0022-3514.85.2.197
16. Greenwald, A. G., & Pettigrew, T. F. (2014). With malice toward none and charity for some: Ingroup favoritism enables discrimination. American Psychologist, 69, 669-684. http://dx.doi.org/10.1037/a0036056
17. Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., & Banaji, M. R. (2009). Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity. Journal of Personality and Social Psychology, 97, 17-41. http://dx.doi.org/10.1037/a0015575
18. Hedges, L. V., Tipton, E., & Johnson, M. C. (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39-65. http://dx.doi.org/10.1002/jrsm.5
19. Heider, J. D., & Skowronski, J. J. (2007). Improving the predictive validity of the Implicit Association Test. North American Journal of Psychology, 9, 53-76.
20. Hugenberg, K., & Bodenhausen, G. V. (2003). Facing prejudice: Implicit prejudice and the perception of facial threat. Psychological Science, 14, 640-643. http://dx.doi.org/10.1046/j.0956-7976.2003.psci_1478.x
21. Institute of Medicine. (2002). Unequal treatment: Confronting racial and ethnic disparities in health care. Washington, DC: National Academy of Sciences.
22. Kraus, S. J. (1995). Attitudes and the prediction of behavior: A metaanalysis of the empirical literature. Personality and Social Psychology Bulletin, 21, 58-75. http://dx.doi.org/10.1177/0146167295211007
23. Merton, R. K. (1968). The Matthew effect in science: The reward and communication systems of science are considered. Science, 159, 56-63. http://dx.doi.org/10.1126/science.159.3810.56
24. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749. http://dx.doi.org/10.1037/0003-066X.50.9.741
25. Milkman, K. L., Akinola, M., & Chugh, D. (2012). Temporal distance and discrimination: An audit study in academia. Psychological Science, 23, 710-717. http://dx.doi.org/10.1177/0956797611434539
26. Moss-Racusin, C. A., Dovidio, J. F., Brescoll, V. L., Graham, M. J., & Handelsman, J. (2012). Science faculty's subtle gender biases favor male students. Proceedings of the National Academy of Sciences of the United States of America, 109, 16474-16479.
27. Nosek, B. A., Greenwald, A. G., & Banaji, M. R. (2007). The Implicit Association Test at age 7: A methodological and conceptual review. In J. A. Bargh (Ed.), Automatic processes in social thinking and behavior (pp. 265-292). New York: Psychology Press.
28. Office of the Attorney General. (1999). The New York City Police Department's "stop & frisk" practices: A report to the people of the State of New York. Retrieved from www.oag.state.ny.us/bureaus/civil_rights/pdfs/stp_frsk.pdf
29. Oswald, F. L., Mitchell, G., Blanton, H., Jaccard, J., & Tetlock, P. E. (2013). Predicting ethnic and racial discrimination: A meta-analysis of IAT criterion studies. Journal of Personality and Social Psychology, 105, 171-192. http://dx.doi.org/10.1037/a0032734
30. Pager, D. (2003). The mark of a criminal record. American Journal of Sociology, 108, 937-975. http://dx.doi.org/10.1086/374403
31. Phelps, E. A., O'Conner, K. J., Cunningham, W. A., Funayama, E. S., Gatenby, J. C., Gore, J. C., & Banaji, M. R. (2000). Performance on indirect measures of race evaluation predicts amygdala activation. Journal of Cognitive Neuroscience, 12, 729-738. http://dx.doi.org/10.1162/089892900562552
32. Powell, A. J., & Williams, K. D. (2000, April). The role of racial attitudes and experience in cross-racial identification among Asian, Caucasian and Eurasian Australians. Paper presented at the 5th annual meeting of the Society of Australasian Social Psychologists, Fremantle, Western Australia.
33. Reskin, B. F. (2002). Rethinking employment discrimination and its remedies. In M. Guillen, R. Collins, P. England, & M. Meyer (Eds.), The new economic sociology: Developments in an emerging field (pp. 218-244). New York, NY: Russell Sage Foundation.
34. Richeson, J. A., Baird, A. A., Gordon, H. L., Heatherton, T. F., Wyland, C. L., Trawalter, S., & Shelton, J. N. (2003). An fMRI examination of the impact of interracial contact on executive function. Nature Neuroscience, 6, 1323-1328. http://dx.doi.org/10.1038/nn1156
35. Rooth, D.-O. (2010). Automatic associations and discrimination in hiring: Real world evidence. Labour Economics, 17, 523-534. http://dx.doi.org/10.1016/j.labeco.2009.04.005
36. Rosenthal, R. (1990). How are we doing in soft psychology? American Psychologist, 45, 775-777. http://dx.doi.org/10.1037/0003-066X.45.6.775
37. Rosenthal, R., & Rubin, D. B. (1982). A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 166-169. http://dx.doi.org/10.1037/0022-0663.74.2.166
38. Shelton, J. N., Richeson, J. A., Salvatore, J., & Trawalter, S. (2005). Ironic effects of racial bias during interracial interactions. Psychological Science, 16, 397-402.
39. Schmidt, A. F., Mokros, A., & Banse, R. (2013). Is pedophilic sexual preference continuous? A taxometric analysis based on direct and indirect measures. Psychological Assessment, 25, 1146-1153. http://dx.doi.org/10.1037/a0033326
40. Simpson, E. H. (1951). The interpretation of interaction in contingency tables. Journal of the Royal Statistical Society Series B. Methodological, 13, 238-241.
41. Stanley, D. A., Sokol-Hessner, P., Banaji, M. R., & Phelps, E. A. (2011). Implicit race attitudes predict trustworthiness judgments and economic trust decisions. PNAS Proceedings of the National Academy of Sciences of the United States of America, 108, 7710-7715. http://dx.doi.org/10.1073/pnas.1014345108
42. Steering Committee of the Physicians' Health Study Research Group. (1989). Final report on the aspirin component of the ongoing Physicians' Health Study. The New England Journal of Medicine, 321, 129-135. http://dx.doi.org/10.1056/NEJM198907203210301
43. Sue, D. W., Capodilupo, C. M., Torino, G. C., Bucceri, J. M., Holder, A. M. B., Nadal, K. L., & Esquilin, M. (2007). Racial microaggressions in everyday life: Implications for clinical practice. American Psychologist, 62, 271-286. http://dx.doi.org/10.1037/0003-066X.62.4.271
44. Swim, J., Borgida, E., Maruyama, G., & Myers, D. G. (1989). Joan McKay versus John McKay: Do gender stereotypes bias evaluations? Psychological Bulletin, 105, 409-429. http://dx.doi.org/10.1037/0033-2909.105.3.409
45. U.S. Equal Employment Opportunity Commission. (1978). Uniform Guidelines on Employee Selection Procedures. Retrieved from http://www.gpo.gov/fdsys/pkg/CFR-2013-title29-vol4/xml/CFR-2013-title29-vol4-part1607.xml
46. Valian, V. (1998). Why so slow? The advancement of women. Cambridge, MA: MIT Press.