The Implicit Relational Assessment Procedure: Emerging reliability and validity data

Journal of Contextual Behavioral Science

Volumn 2, Issue 3-4, 2013, Pages 105-119

  Golijani Moghaddam, Nima ^a   Hart, Aidan ^a   Dawson, David L ^a  

^a UNIVERSITY OF LINCOLN   (United Kingdom)

Author keywords

Implicit; Implicit Relational Assessment Procedure; Relational Frame Theory; Reliability; Validity

Indexed keywords

EID: 84888436544     PISSN: 22121447     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jcbs.2013.05.002     Document Type: Review

References (63)

1. Barnes-Holmes D., Barnes-Holmes Y., Power P., Hayden E., Milne R., Stewart I. Do you really know what you believe? Developing the Implicit Relational Assessment Procedure (IRAP) as a direct measure of implicit beliefs. The Irish Psychologist 2006, 32(7):169-177.
2. Barnes-Holmes D., Barnes-Holmes Y., Stewart I., Boles S. A sketch of the Implicit Relational Assessment Procedure (IRAP) and the Relational Elaboration and Coherence (REC) model. Psychological Record 2010, 60:527-542.
3. Barnes-Holmes D., Hayden E., Barnes-Holmes Y., Stewart I. The Implicit Relational Assessment Procedure (IRAP) as a response-time and event-related-potentials methodology for testing natural verbal relations: a preliminary study. Psychological Record 2008, 58(4):497-515.
4. Barnes-Holmes D., Murphy A., Barnes-Holmes Y., Stewart I. The Implicit Relational Assessment Procedure: exploring the impact of private versus public contexts and the response latency criterion on pro-white and anti-black stereotyping among white Irish individuals. Psychological Record 2011, 60(1):57-79.
5. Barnes-Holmes D., Murtagh L., Barnes-Holmes Y., Stewart I. Using the Implicit Association Test and the Implicit Relational Assessment Procedure to measure attitudes toward meat and vegetables in vegetarians and meat-eaters. Psychological Record 2010, 60(2):287-305.
6. Barnes-Holmes D., Waldron D., Barnes-Holmes Y., Stewart I. Testing the validity of the Implicit Relational Assessment Procedure and the Implicit Association Test: measuring attitudes toward Dublin and country life in Ireland. Psychological Record 2009, 59(3):389-406.
7. Borsboom, D., Mellenbergh, G. J., & Van Heerden, J. (2004). The concept of validity. Psychological Review, 111(4), 1061-1071.
8. Bortoloti R., de Rose J.C. Equivalent stimuli are more strongly related after training with delayed matching than after simultaneous matching: a study using the Implicit Relational Assessment Procedure (IRAP). Psychological Record 2012, 62(1):41-54.
9. Bosson J.K., Swann W.B., Pennebaker J.W. Stalking the perfect measure of implicit self-esteem: the blind men and the elephant revisited?. Journal of Personality and Social Psychology 2000, 79(4):631-643.
10. Campbell, C., Barnes-Holmes, Y., Barnes-Holmes, D., & Stewart, I. (2011). Exploring screen presentations in the Implicit Relational Assessment Procedure (IRAP). International Journal of Psychology and Psychological Therapy, 11, 377-388.
11. Carpenter K.M., Martinez D., Vadhan N.P., Barnes-Holmes D., Nunes E.V. Measures of attentional bias and relational responding are associated with behavioral treatment outcome for cocaine dependence. The American Journal of Drug and Alcohol Abuse 2012, 38(2):146-154.
12. Chan G., Barnes-Holmes D., Barnes-Holmes Y., Stewart I. Implicit attitudes to work and leisure among North American and Irish individuals: a preliminary study. International Journal of Psychology and Psychological Therapy 2009, 9(3):317-334.
13. Chiou J., Spreng R.A. The reliability of difference scores: a re-examination. Journal of Consumer Satisfaction, Dissatisfaction and Complaining Behaviour 1996, 9:158-167.
14. Cullen, C., & Barnes-Holmes, D. (2008). Implicit pride and prejudice: A heterosexual phenomenon? In: T. G. Morrison & M. A. Morrison (Eds.), Modern Prejudice (pp. 195-223). New York: Nova Science.
15. Cullen C., Barnes-Holmes D., Barnes-Holmes Y., Stewart I. The Implicit Relational Assessment Procedure (IRAP) and the malleability of ageist attitudes. Psychological Record 2009, 59(4):591-620.
16. Cunningham W.A., Preacher K.J., Banaji M.R. Implicit attitude measures: consistency, stability, and convergent validity. Psychological Science 2001, 12(2):163-170.
17. Dawson D.L., Barnes-Holmes D., Gresswell D.M., Hart A.J., Gore N.J. Assessing the implicit beliefs of sexual offenders using the Implicit Relational Assessment Procedure: a first study. Sexual Abuse: A Journal of Research and Treatment 2009, 21(1):57-75. 10.1177/1079063208326928.
18. De Houwer J. What are implicit measures and why are we using them?. The handbook of implicit cognition and addiction 2006, 11-28. Sage Publishers, Thousand Oaks, CA. R.W. Wiers, A.W. Stacy (Eds.).
19. Drake, C. E., Kellum, K. K., Wilson, K. G., Luoma, J. B., Weinstein, J. H., & Adams, C. H. (2010). Examining the Implicit Relational Assessment Procedure: four preliminary studies. Psychological Record, 60(1), 81-100.
20. Fazio R.H., Olson M.A. Implicit measures in social cognition. research: their meaning and use. Annual Review of Psychology 2003, 54:297-327. 10.1146/annurev.psych.54.101601.145225.
21. Ferguson E., Moghaddam N.G., Bibby P.A. Memory bias in health anxiety is related to the emotional valence of health-related words. Journal of Psychosomatic Research 2007, 62(3):263-274.
22. Ferguson M.J., Bargh J.A. Beyond the attitude object: automatic attitudes spring from object-centered-contexts. Implicit measures of attitudes 2007, 216-246. Guilford, New York, NY. B. Wittenbrink, N. Schwarz (Eds.).
23. Field A.P., Gillett R. How to do a meta-analysis. British Journal of Mathematical and Statistical Psychology 2010, 63(3):665-694.
24. Gawronski B., Deutsch R., Banse R. Response interference tasks as indirect measures of automatic associations. Cognitive methods in social psychology 2011, Guilford, New York, NY. K.C. Klauer, C. Stahl, A. Voss (Eds.).
25. Gray N.S., Brown A.S., MacCulloch M.J., Smith J., Snowden R.J. An implicit test of the associations between children and sex in pedophiles. Journal of Abnormal Psychology 2005, 114(2):304-308.
26. Greenwald A.G., Banaji M.R., Rudman L.A., Farnham S.D., Nosek B.A., Mellott D.S. A unified theory of implicit attitudes, stereotypes, self-esteem, and self-concept. Psychological Review 2002, 109(1):3-25.
27. Greenwald A.G., McGhee D.E., Schwartz J.L. Measuring individual differences in implicit cognition: the implicit association test. Journal of Personality and Social Psychology 1998, 74(6):1464-1480.
28. Greenwald A.G., Nosek B.A. Health of the Implicit Association Test at age 3. Zeitschrift für Experimentelle Psychologie 2001, 48(2):85-93.
29. Greenwald A.G., Nosek B.A. Attitudinal dissociation: what does it mean?. Attitudes: insights from the new implicit measures 2009, 65-82. Erlbaum, Hillsdale. R.E. Petty, R.H. Fazio, P. Briñol (Eds.).
30. Greenwald A.G., Nosek B.A., Banaji M.R. Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology 2003, 85(2):197.
31. Hayes S.C., Barnes-Holmes D., Roche B. Relational Frame Theory: a Post-Skinnerian account of human language and cognition 2001, Plenum Press, New York.
32. Haynes S.N., Richard D.C.S., Kubany E.S. Content validity in psychological assessment: a functional approach to concepts and methods. Psychological Assessment 1995, 7(3):238-247.
33. Hooper N., Villatte M., Neofotistou E., McHugh L. The effects of mindfulness versus thought suppression on implicit and explicit measures of experiential avoidance. International Journal of Behavioral Consultation and Therapy 2010, 6(3):233-244.
34. Hughes S., Barnes-Holmes D. On the formation and persistence of implicit attitudes: new evidence from the Implicit Relational Assessment Procedure (IRAP). Psychological Record 2011, 61(3):391-410.
35. Hughes S., Barnes-Holmes D., De Houwer J. The dominance of associative theorising in implicit attitude research: propositional and behavioral alternatives. Psychological Record 2011, 61:465-498.
36. Hughes S., Barnes-Holmes D., Vahey N. Holding on to our functional roots when exploring new intellectual islands: a voyage through implicit cognition research. Journal of Contextual Behavioral Science 2012, 1(1-2):17-38. 10.1016/j.jcbs.2012.09.003.
37. Hussey I., Barnes-Holmes D. The Implicit Relational Assessment Procedure as a measure of implicit depression and the role of psychological flexibility. Cognitive and Behavioral Practice 2012, 19(4):573-582.
38. Juarascio A.S., Forman E.M., Timko C.A., Herbert J.D., Butryn M., Lowe M. Implicit internalization of the thin ideal as a predictor of increases in weight, body dissatisfaction, and disordered eating. Eating Behaviors 2011, 12(3):207-213. 10.1016/j.eatbeh.2011.04.004.
39. Kelly A., Barnes-Holmes D. Implicit attitudes towards children with autism versus normally developing children as predictors of professional burnout and psychopathology. Research in Developmental Disabilities 2013, 34(1):17-28.
40. Kim D.Y. Voluntary controllability of the implicit association test (IAT). Social Psychology Quarterly 2003, 66:83-96.
41. Lane K.A., Banaji M.R., Nosek B.A., Greenwald A.G. Understanding and using the Implicit Association Test: IV: procedures and validity. Implicit measures of attitudes: procedures and controversies 2007, 59-102. Guilford Press, New York. B. Wittenbrink, N. Schwarz (Eds.).
42. LeBel E.P., Paunonen S.V. Sexy but often unreliable: the impact of unreliability on the replicability of experimental findings with implicit measures. Personality and Social Psychology Bulletin 2011, 37(4):570-583.
43. McKenna I.M., Barnes-Holmes D., Barnes-Holmes Y., Stewart I. Testing the fake-ability of the implicit relational assessment procedure (IRAP): the first study. International Journal of Psychology and Psychological Therapy 2007, 7:123-138.
44. Nicholson E., Barnes-Holmes D. Developing an implicit measure of disgust propensity and disgust sensitivity: examining the role of implicit disgust propensity and sensitivity in obsessive-compulsive tendencies. Journal of Behavior Therapy and Experimental Psychiatry 2012, 43(3):922-930.
45. Nicholson E., Barnes-Holmes D. The Implicit Relational Assessment Procedure (IRAP) as a measure of spider fear. Psychological Record 2012, 62(2):263-277.
46. Nicholson, E., McCourt, A., & Barnes-Holmes, D. (2013). The Implicit Relational Assessment Procedure (IRAP) as a Measure of Obsessive Beliefs in Relation to Disgust. Journal of Contextual Behavioral Science, 2(1-2), 23-30.
47. Nolan, J., Murphy, C., & Barnes-Holmes, D. (in press). Implicit perceptions of intelligence in slim and overweight individuals: effects of gender of participants and target stimuli. The Psychological Record. Retrieved from http://irapresearch.org/publications/.
48. Nosek B.A., Greenwald A.G., Banaji M.R. The Implicit Association Test at age 7: a methodological and conceptual review. Automatic processes in social thinking and behavior 2007, 265-292. Psychology Press, London. J.A. Bargh (Ed.).
49. Nosek B.A., Hawkins C.B., Frazier R.S. Implicit social cognition: from measures to mechanisms. Trends in Cognitive Sciences 2011, 15(4):152-159.
50. Nunnally J. Psychometric theory 1978, McGraw-Hill, New York.
51. O'Toole C., Barnes-Holmes D. Three chronometric indices of relational responding as predictors of performance on a brief intelligence test: the importance of relational flexibility. Psychological Record 2009, 59(1):119-132.
52. Olson M.A., Fazio R.H. Relations between implicit measures of prejudice: what are we measuring?. Psychological Science 2003, 14:36-39.
53. Parling T., Cernvall M., Stewart I., Barnes-Holmes D., Ghaderi A. Using the implicit relational assessment procedure to compare implicit pro-thin/anti-fat attitudes of patients with anorexia nervosa and non-clinical controls. Eating Disorders 2012, 20(2):127-143.
54. Power P., Barnes-Holmes D., Barnes-Holmes Y., Stewart I. The Implicit Relational Assessment Procedure (IRAP) as a measure of implicit relative preferences: a first study. Psychological Record 2009, 59(4):621-639.
55. Roddy S., Stewart I., Barnes-Holmes D. Anti-fat, pro-slim, or both? Using two reaction-time based measures to assess implicit attitudes to the slim and overweight. Journal of Health Psychology 2010, 15(3):416-425. 10.1177/1359105309350232.
56. Roddy S., Stewart I., Barnes-Holmes D. Facial reactions reveal that slim is good but fat is not bad: implicit and explicit measures of body-size bias. European Journal of Social Psychology 2011, 41(6):688-694.
57. Scheel M.H., Fischer L.A., McMahon A.J., Mena M.M., Wolf J.E. The Implicit Relational Assessment Procedure (IRAP) as a measure of women's stereotypes about gay men. Current Research in Social Psychology 2011, 18(2):11-23.
58. Schmukle S.C., Egloff B. Does the Implicit Association Test for assessing anxiety measure trait and state variance?. European Journal of Personality 2004, 18(6):483-494.
59. Sireci S.G. The construct of content validity. Social Indicators Research 1998, 45(1):83-117.
60. Stockwell F.M.J., Walker D.J., Eshleman J.W. Measures of implicit and explicit attitudes toward mainstream and BDSM sexual terms using the IRAP and questionaire with BDSM/Fetish and student participants. Psychological Record 2010, 60(2):307-324.
61. Timko C.A., England E.L., Herbert J.D., Forman E.M. The Implicit Relational Assessment Procedure as a measure of self-esteem. Psychological Record 2010, 60(4):679-698.
62. Vahey N., Barnes-Holmes D., Barnes-Holmes Y., Stewart I. A first test of the Implicit Relational Assessment Procedure as a measure of self-esteem: Irish prisoner groups and university students. Psychological Record 2009, 59(3):371-387.
63. Vahey N., Boles S., Barnes-Holmes D. Measuring adolescents' smoking-related social identity preferences with the Implicit Relational Assessment Procedure (IRAP) for the first time: a starting point that explains later IRAP evolutions. International Journal of Psychology and Psychological Therapy 2010, 10(3):453-474.