Measuring implicit attitudes: A positive framing bias flaw in the Implicit Relational Assessment Procedure (IRAP)

Psychological Assessment

Volumn 28, Issue 2, 2016, Pages 158-170

  O'Shea, Brian ^a   Watson, Derrick G ^a   Brown, Gordon D A ^a  

^a UNIVERSITY OF WARWICK   (United Kingdom)

Author keywords

Implicit attitudes; Implicit Relational Assessment Procedure; Positive framing bias; Simple implicit procedure

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AWARENESS; CONTROLLED STUDY; ETHNICITY; FEMALE; FRAMING BIAS; HUMAN; IMPLICIT ATTITUDE; IMPLICIT RELATIONAL ASSESSMENT PROCEDURE; MALE; POSITIVE FRAMING BIAS; PSYCHOLOGIC TEST; REACTION TIME; UNIVERSITY STUDENT; ATTITUDE; LANGUAGE; PSYCHOMETRY; STATISTICAL BIAS; YOUNG ADULT;

ATTITUDE; BIAS (EPIDEMIOLOGY); FEMALE; HUMANS; LANGUAGE; MALE; PSYCHOMETRICS; YOUNG ADULT;

EID: 84956695185     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000172     Document Type: Article

References (50)

1. Bar-Anan, Y., & Nosek, B. A. (2013). A comparative investigation of seven implicit measures of social cognition. Unpublished manuscript. Retrieved from http://ssrn.com/abstract=2074556
2. Barnes-Holmes, D., Barnes-Holmes, Y., Stewart, I., & Boles, S. (2010). A sketch of the implicit relational assessment procedure (IRAP) and the relational elaboration and coherence (REC) model. The Psychological Record, 60, 527-542.
3. Barnes-Holmes, D., Murphy, A., Barnes-Holmes, Y., & Stewart, I. (2010). The implicit relational assessment procedure (IRAP): Exploring the impact of private versus public contexts and the response latency criterion on pro-White and anti-Black stereotyping among White Irish individuals. The Psychological Record, 60, 57-66.
4. Bessenoff, G. R., & Sherman, J. W. (2000). Automatic and controlled components of prejudice toward fat people: Evaluation versus stereotype activation. Social Cognition, 18, 329-353. http://dx.doi.org/10.1521/soco.2000.18.4.329
5. Blanton, H., & Jaccard, J. (2006). Arbitrary metrics in psychology. American Psychologist, 61, 27-41. http://dx.doi.org/10.1037/0003-066X.61.1.27
6. Bluemke, M., & Friese, M. (2008). Reliability and validity of the Single-Target IAT (ST-IAT): Assessing automatic affect towards multiple attitude objects. European Journal of Social Psychology, 38, 977-997. http://dx.doi.org/10.1002/ejsp.487
7. Boroditsky, L. (2011). How language shapes thought. Scientific American, 304, 62-65. http://dx.doi.org/10.1038/scientificamerican0211-62
8. Browning, M., Holmes, E. A., & Harmer, C. J. (2010). The modification of attentional bias to emotional information: A review of the techniques, mechanisms, and relevance to emotional disorders. Cognitive, Affective & Behavioral Neuroscience, 10, 8-20. http://dx.doi.org/10.3758/CABN.10.1.8
9. Brysbaert, M., & New, B. (2009). Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behavior Research Methods, 41, 977-990. http://dx.doi.org/10.3758/BRM.41.4.977
10. Cacioppo, J. T., Gardner, W. L., & Berntson, G. G. (1997). Beyond bipolar conceptualizations and measures: The case of attitudes and evaluative space. Personality and Social Psychology Review, 1, 3-25. http://dx.doi.org/10.1207/s15327957pspr0101_2
11. Clark, H. H. (1969). Linguistic processes in deductive reasoning. Psychological Review, 76, 387-404. http://dx.doi.org/10.1037/h0027578
12. Correll, J., Park, B., Judd, C. M., & Wittenbrink, B. (2007). The influence of stereotypes on decisions to shoot. European Journal of Social Psychology, 37, 1102-1117. http://dx.doi.org/10.1002/ejsp.450
13. De Houwer, J., & De Bruycker, E. (2007). The implicit association test outperforms the extrinsic affective Simon task as an implicit measure of inter-individual differences in attitudes. The British Journal of Social Psychology, 46, 401-421. http://dx.doi.org/10.1348/014466606X130346
14. Gawronski, B., & De Houwer, J. (2014). Implicit measures in social and personality psychology. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (2nd ed., pp. 283-310). New York, NY: Cambridge University Press. http://dx.doi.org/10.1017/CBO9780511996481.016
15. Gervais, W. M., Shariff, A. F., & Norenzayan, A. (2011). Do you believe in atheists? Distrust is central to anti-atheist prejudice. Journal of Personality and Social Psychology, 101, 1189-1206. http://dx.doi.org/10.1037/a0025882
16. Golijani-Moghaddam, N., Hart, A., & Dawson, D. L. (2013). The implicit relational assessment procedure: Emerging reliability and validity data. Journal of Contextual Behavioral Science, 2, 105-119. http://dx.doi.org/10.1016/j.jcbs.2013.05.002
17. Greenwald, A. G., & Banaji, M. R. (1995). Implicit social cognition: Attitudes, self-esteem, and stereotypes. Psychological Review, 102, 4-27. http://dx.doi.org/10.1037/0033-295X.102.1.4
18. Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74, 1464-1480. http://dx.doi.org/10.1037/0022-3514.74.6.1464
19. Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003). Understanding and using the implicit association test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85, 197-216. http://dx.doi.org/10.1037/0022-3514.85.2.197
20. Harrison, D. P., Stritzke, W. G. K., Fay, N., Ellison, T. M., & Hudaib, A. R. (2014). Probing the implicit suicidal mind: Does the Death/Suicide Implicit Association Test reveal a desire to die, or a diminished desire to live? Psychological Assessment, 26, 831-840. http://dx.doi.org/10.1037/pas0000001
21. Haspelmath, M. (2006). Against markedness (and what to replace it with). Journal of Linguistics, 42, 25-70. http://dx.doi.org/10.1017/S0022226705003683
22. Hussey, I., & Barnes-Holmes, D. (2012, May). Experiential avoidance and pro-death implicit attitudes in normative participants. Paper presented at the Northern Ireland Branch Annual Conference of the British Psychological Society, Killadeas, Ireland.
23. Karpinski, A. (2004). Measuring self-esteem using the implicit association test: The role of the other. Personality and Social Psychology Bulletin, 30, 22-34. http://dx.doi.org/10.1177/0146167203258835
24. Karpinski, A., & Steinman, R. B. (2006). The single category implicit association test as a measure of implicit social cognition. Journal of Personality and Social Psychology, 91, 16-32. http://dx.doi.org/10.1037/0022-3514.91.1.16
25. Klauer, K. C., & Mierke, J. (2005). Task-set inertia, attitude accessibility, and compatibility-order effects: New evidence for a task-set switching account of the implicit association test effect. Personality and Social Psychology Bulletin, 31, 208-217. http://dx.doi.org/10.1177/0146167204271416
26. Kosnes, L., Whelan, R., O'Donovan, A., & McHugh, L. A. (2013). Implicit measurement of positive and negative future thinking as a predictor of depressive symptoms and hopelessness. Consciousness and Cognition, 22, 898-912. http://dx.doi.org/10.1016/j.concog.2013.06.001
27. Kühberger, A. (1998). The influence of framing on risky decisions: A meta-analysis. Organizational Behavior and Human Decision Processes, 75, 23-55. http://dx.doi.org/10.1006/obhd.1998.2781
28. Lai, C. K., Marini, M., Lehr, S. A., Cerruti, C., Shin, J. E. L., Joy-Gaba, J. A. Nosek, B. A. (2014). Reducing implicit racial preferences: I. A comparative investigation of 17 interventions. Journal of Experimental Psychology: General, 143, 1765-1785. http://dx.doi.org/10.1037/a0036260
29. Leech, G. N. (2006). A glossary of English grammar. New York, NY: Columbia University Press.
30. Matlin, M. W. (2004). Pollyanna principle. In R. Pohl (Ed.), Cognitive illusions: A handbook on fallacies and biases in thinking, judgement and memory (pp. 257-271). New York, NY: Psychology Press.
31. Matthews, W. J., & Dylman, A. S. (2014). The language of magnitude comparison. Journal of Experimental Psychology: General, 143, 510-520. http://dx.doi.org/10.1037/a0034143
32. McKenna, I. M., Barnes-Holmes, D., Barnes-Holmes, Y., & Stewart, I. (2007). Testing the fake-ability of the implicit relational assessment procedure (IRAP): The first study. International Journal of Psychology & Psychological Therapy, 7, 253-268.
33. McKenzie, C. R., & Nelson, J. D. (2003). What a speaker's choice of frame reveals: Reference points, frame selection, and framing effects. Psychonomic Bulletin & Review, 10, 596-602. http://dx.doi.org/10.3758/BF03196520
34. Nolan, J., Murphy, C., & Barnes-Holmes, D. (2013). Implicit relational assessment procedure and body-weight bias: Influence of gender of participants and targets. The Psychological Record, 63, 467-488. http://dx.doi.org/10.11133/j.tpr.2013.63.3.005
35. Nosek, B. A., & Banaji, M. R. (2001). The go/no-go association task. Social Cognition, 19, 625-666. http://dx.doi.org/10.1521/soco.19.6.625.20886
36. Nosek, B. A., Greenwald, A. G., & Banaji, M. R. (2005). Understanding and using the Implicit Association Test: II. Method variables and construct validity. Personality and Social Psychology Bulletin, 31, 166-180. http://dx.doi.org/10.1177/0146167204271418
37. O'Brien, K. S., Hunter, J. A., & Banks, M. (2007). Implicit anti-fat bias in physical educators: Physical attributes, ideology and socialization. International Journal of Obesity, 31, 308-314. http://dx.doi.org/10.1038/sj.ijo.0803398
38. O'Shea, B. (2015a). Capitalism versus a new economic model: Implicit and explicit attitudes of protesters and bankers. Social Movement Studies, 14, 311-330. http://dx.doi.org/10.1080/14742837.2014.938732
39. O'Shea, B. (2015b). [The IRAP fails to measure abstract concepts absolutely]. Unpublished raw data.
40. O'Shea, B., & Stewart, I. (2015). Implicit and explicit attitudes towards atheism and religious belief: Limitations with the IRAP. Manuscript submitted for publication.
41. Peterson, C. (2000). The future of optimism. American Psychologist, 55, 44-55. http://dx.doi.org/10.1037/0003-066X.55.1.44
42. Randall, J. R., Rowe, B. H., Dong, K. A., Nock, M. K., & Colman, I. (2013). Assessment of self-harm risk using implicit thoughts. Psychological Assessment, 25, 714-721. http://dx.doi.org/10.1037/a0032391
43. Roddy, S., Stewart, I., & Barnes-Holmes, D. (2010). Anti-fat, pro-slim, or both? Using two reaction-time based measures to assess implicit attitudes to the slim and overweight. Journal of Health Psychology, 15, 416-425. http://dx.doi.org/10.1177/1359105309350232
44. Roddy, S., Stewart, I., & Barnes-Holmes, D. (2011). Facial reactions reveal that slim is good but fat is not bad: Implicit and explicit measures of body-size bias. European Journal of Social Psychology, 41, 688-694. http://dx.doi.org/10.1002/ejsp.839
45. Sherman, M. A. (1973). Bound to be easier? The negative prefix and sentence comprehension. Journal of Verbal Learning and Verbal Behavior, 12, 76-84. http://dx.doi.org/10.1016/S0022-5371(73)80062-3
46. Sriram, N., & Greenwald, A. G. (2009). The brief implicit association test. Experimental Psychology, 56, 283-294. http://dx.doi.org/10.1027/1618-3169.56.4.283
47. Taylor, S. E., & Brown, J. D. (1994). Positive illusions and well-being revisited: Separating fact from fiction. Psychological Bulletin, 116, 21-27. http://dx.doi.org/10.1037/0033-2909.116.1.21
48. Teachman, B. A., & Allen, J. P. (2007). Development of social anxiety: Social interaction predictors of implicit and explicit fear of negative evaluation. Journal of Abnormal Child Psychology, 35, 63-78. http://dx.doi.org/10.1007/s10802-006-9084-1
49. Tversky, A., & Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science, 211, 453-458. http://dx.doi.org/10.1126/science.7455683
50. Vahey, N. A., Nicholson, E., & Barnes-Holmes, D. (2015). A metaanalysis of criterion effects for the implicit relational assessment procedure (IRAP) in the clinical domain. Journal of Behavior Therapy and Experimental Psychiatry, 48, 59-65. http://dx.doi.org/10.1016/j.jbtep.2015.01.004