Measuring attentional bias to threat: Reliability of dot probe and eye movement indices

Cognitive Therapy and Research

Volumn 38, Issue 3, 2014, Pages 313-333

  Waechter, Stephanie ^a   Nelson, Andrea L ^a   Wright, Caitlin ^b   Hyatt, Ashley ^c   Oakman, Jonathan ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

^b UNIVERSITY OF CALGARY   (Canada)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

Attentional bias; Dot probe; Eye movement; Reliability; Social anxiety

Indexed keywords

ANXIETY DISORDER; ARTICLE; ATTENTIONAL BIAS; DISGUST; EYE MOVEMENT; FACIAL EXPRESSION; FEMALE; HUMAN; MAJOR CLINICAL STUDY; MALE; TASK PERFORMANCE; THREAT;

EID: 84896490223     PISSN: 01475916     EISSN: 15732819     Source Type: Journal    
DOI: 10.1007/s10608-013-9588-2     Document Type: Article

References (84)

1. Amir, N., Elias, J., Klumpp, H., & Przeworski, A. (2003). Attentional bias to threat in social phobia: Facilitated processing of threat or difficulty disengaging attention fromthreat? Behaviour Research and Therapy, 41(11), 1325-1335. doi:10.1016/S0005-7967(03)00039-1. (Pubitemid 37188372)
2. Antony, M. M., Bieling, P. J., Cox, B. J., Enns, M. W., & Swinson, R. P. (1998). Psychometric properties of the 42-item and 21-item versions of the depression anxiety stress scales in clinical groups and a community sample. Psychological Assessment, 10(2), 176-181. doi:10.1037/1040-3590.10.2.176. (Pubitemid 28292803)
3. Armstrong, T., & Olatunji, B. O. (2012). Eye tracking of attention in the affective disorders: A meta-analytic review and synthesis. Clinical Psychology Review, 32, 704-723. doi:10.1016/j.cpr.2012.09.004.
4. Asmundson, G. J. G., & Stein, M. B. (1994). Selective processing of social threat in patients with generalized social phobia: Evaluation using a dot-probe paradigm. Journal of Anxiety Disorders, 8(2), 107-117. doi:10.1016/0887-6185(94)90009-4. (Pubitemid 24171163)
5. Bar-Haim, Y., Holoshitz, Y., Eldar, S., Frenkel, T. I., Muller, D., Charney, D. S., et al. (2010). Life-threatening danger and suppression of attention bias to threat. The American Journal of Psychiatry, 167(6), 694-698. doi:10.1176/appi.ajp.2009.09070956.
6. Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2007). Threat-related attentional bias in anxious and nonanxious individuals: A meta-analytic study. Psychological Bulletin, 133(1), 1-24. doi:10.1037/0033-2909.133.1.1.
7. Bishop, S. J. (2009). Trait anxiety and impoverished prefrontal control of attention. Nature Neuroscience, 12, 92-98.
8. Bögels, S. M., & Mansell, W. (2004). Attention processes in the maintenance and treatment of social phobia: Hypervigilance, avoidance and self-focused attention. Clinical Psychology Review, 24(7), 827-856. doi:10.1016/j.cpr.2004.06.005. (Pubitemid 39388874)
9. Borgmann, K. W. U., Risko, E. F., Stolz, J. A., & Besner, D. (2007). Simon says: Reliability and the role of working memory and attentional control in the Simon task. Psychonomic Bulletin & Review, 14(2), 313-319. doi:10.3758/BF03194070.
10. Bradley, B. P., Mogg, K., & Millar, N. H. (2000). Covert and overt orienting of attention to emotional faces in anxiety. Cognition and Emotion, 14(6), 789-808. doi:10.1080/02699930050156636.
11. Bradley, B. P., Mogg, K., Millar, N., Bonham-Carter, C., Fergusson, E., Jenkins, J., et al. (1997). Attentional biases for emotional faces. Cognition and Emotion, 11, 25-42. doi:10.1080/026999397380014. (Pubitemid 127465908)
12. Buckner, J. D., DeWall, C. N., Schmidt, N. B., & Maner, J. K. (2010a). A tale of two threats: Social anxiety and attention to social threat as a function of social exclusion and non-exclusion threats. Cognitive Therapy and Research, 34(5), 449-455. doi:10.1007/s10608-009-9254-x.
13. Buckner, J. D., Maner, J. K., & Schmidt, N. B. (2010b). Difficulty disengaging attention from social threat in social anxiety. Cognitive Therapy and Research, 34(1), 99-105. doi:10.1007/s10608-008-9205-y.
14. Calvo, M. G., & Avero, P. (2005). Time course of attentional bias to emotional scenes in anxiety: Gaze direction and duration. Cognition and Emotion, 19(3), 433-451. (Pubitemid 40542869)
15. Cisler, J. M., Bacon, A. K., & Williams, N. L. (2009). Phenomenological characteristics of attentional biases towards threat: A critical review. Cognitive Therapy and Research, 33(2), 221-234. doi:10.1007/s10608-007-9161-y.
16. Cisler, J. M., & Koster, E. H. W. (2010). Mechanisms of attentional biases towards threat in anxiety disorders: An integrative review. Clinical Psychology Review, 30, 203-216. doi:10.1016/j.cpr.2009.11.003.
17. Clark, D. M., & Wells, A. (1995). A cognitive model of social phobia. In G. Heimberg, M. R. Liebowitz, D. A. Hope, & F. R. Schneier (Eds.), r (pp. 69-93). New York: Guilford Press.
18. 2 inhalation on allocation of spatial attention to facial cues of emotional expression. Cognition and Emotion, 25(4), 626-638. doi:10.1080/02699931.2010.508887.
19. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Orlando, FL: Holt, Rinehart and Winston.
20. Eastwood, J. D., Smilek, D., Oakman, J. M., Farvolden, P., van Ameringen, M., Mancini, C., et al. (2005). Individuals with social phobia are biased to become aware of negative faces. Visual Cognition, 12(1), 159-179. doi:10.1080/13506280444000175. (Pubitemid 40352592)
21. Eide, P., Kemp, A., Silberstein, R. B., Nathan, P. J., & Stough, C. (2002). Test-retest reliability of the emotional stroop task: Examining the paradox of measurement change. Journal of Psychology: Interdisciplinary and Applied, 136(5), 514-520. doi:10.1080/00223980209605547.
22. Eysenck, M. W. (1997). Anxiety and cognition: A unified theory. Hove, England: Psychology Press/Erlbaum (UK) Taylor & Francis.
23. Fischer, D. G., & Fick, C. (1993). Measuring social desirability: Short forms of the Marlowe-Crowne Social Desirability Scale. Educational and Psychological Measurement, 53(2), 417-424. doi:10.1177/0013164493053002011.
24. Fox, E. (1993). Attentional bias in anxiety: Selective or not? Behaviour Research and Therapy, 31(5), 487-493. doi:10.1016/0005-7967(93)90129-I.
25. Gamble, A. L., & Rapee, R. M. (2010). The time-course of attention to emotional faces in social phobia. Journal of Behavior Therapy and Experimental Psychiatry, 41(1), 39-44. doi:10.1016/j.jbtep.2009.08.008.
26. Garner, M., Mogg, K., & Bradley, B. P. (2006). Orienting and maintenance of gaze to facial expressions in social anxiety. Journal of Abnormal Psychology, 115(4), 760-770. doi:10.1037/0021-843X.115.4.760. (Pubitemid 44747804)
27. Gerdes, A. B. M., Pauli, P., & Alpers, G. W. (2009). Toward and away from spiders: Eye-movements in spider-fearful participants. Journal of Neural Transmission, 116(6), 725-733. doi:10.1007/s00702-008-0167-8.
28. Grös, D. F., Antony, M. M., Simms, L. J., & McCabe, R. E. (2007). Psychometric properties of the state-trait inventory for cognitive and somatic anxiety (STICSA): Comparison to the state-trait anxiety inventory (STAI). Psychological Assessment, 19(4), 369-381. doi:10.1037/1040-3590.19.4. 369. (Pubitemid 351146635)
29. Haidt, J., Rozin, P., McCauley, C., & Imada, S. (1997). Body, psyche, and culture: The relationship of disgust to morality. Psychology and Developing Societies, 9, 107-131.
30. Havlicek, L. L., & Peterson, N. L. (1977). Effect of the violation of assumptions upon significance levels of the Pearson r. Psychological Bulletin, 84, 373-377. doi:10.1037/0033-2909.84.2.373.
31. Henson, R. K. (2001). Understanding internal consistency reliability estimates: A conceptual primers on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177-188.
32. Hermans, D., Vansteenwegen, D., & Eelen, P. (1999). Eye movement registration as a continuous index of attention deployment: Data from a group of spider anxious students. Cognition and Emotion, 13(4), 419-434. doi:10.1080/026999399379249.
33. Hope, D. A., Rapee, R. M., Heimberg, R. G., & Dombeck, M. J. (1990). Representations of the self in social phobia: Vulnerability to social threat. Cognitive Therapy and Research, 14(2), 177-189. doi:10.1007/BF01176208. (Pubitemid 20308083)
34. Horwitz, S. K., & Horwitz, I. B. (2012). Small is beautiful: Implications of reliability and statistical power for testing the efficacy of HR interventions. Human Resource Management, 51, 143-160. doi:10.1002/hrm.20465.
35. Kaspar, K., & König, P. (2011). Overt attention and context factors: The impact of repeated presentations, image type, and individual motivation. PLoS ONE, 6, e21719. doi:10.1371/journal.pone.0021719.
36. Kimble, M. O., Fleming, K., Bandy, C., Kim, J., & Zambetti, A. (2010a). Eye tracking and visual attention to threating stimuli in veterans of the Iraq war. Journal of Anxiety Disorders, 24(3), 293-299. doi:10.1016/j. janxdis.2009.12.006.
37. Kimble, M. O., Fleming, K., Bandy, C., & Zambetti, A. (2010b). Attention to novel and target stimuli in trauma survivors. Psychiatry Research, 178(3), 501-506. doi:10.1016/j.psychres.2009.10.009.
38. Klumpp, H., & Amir, N. (2009). Examination of vigilance and disengagement of threat in social anxiety with a probe detection task. Anxiety, Stress & Coping: An International Journal, 22(3), 283-296. doi:10.1080/10615800802449602.
39. Koster, E. H. W., Crombez, G., Van Damme, S., Verschuere, B., & De Houwer, J. (2004). Does imminent threat capture and hold attention? Emotion, 4(3), 312-317. doi:10.1037/1528-3542.4.3.312. (Pubitemid 39195422)
40. Leary, M. R. (1983). A brief version of the fear of negative evaluation scale. Personality and Social Psychology Bulletin, 9(3), 371-375. doi:10.1177/0146167283093007.
41. Levens, S. M., & Gotlib, I. H. (2010). Updating positive and negative stimuli in working memory in depression. Journal of Experimental Psychology: General, 139, 654. doi:10.1037/a0020283.
42. Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the depression anxiety stress scales (DASS) with the beck depression and anxiety inventories. Behaviour Research and Therapy, 33(3), 335-343. doi:10.1016/0005-7967(94)00075-U.
43. MacLeod, J. W., Lawrence, M. A., McConnell, M. M., Eskes, G. A., Klein, R. M., & Shore, D. I. (2010). Appraising the ANT: Psychometric and theoretical considerations of the attention network test. Neuropsychology, 24(5), 637-651. doi:10.1037/a0019803.
44. Maloney, E., Risko, E. F., Preston, F., Ansari, D., & Fugelsang, J. (2010). Challenging the reliability and validity of cognitive measures: The case of the numerical distance effect. Acta Psychologica, 134, 154-161. doi:10.1016/j.actpsy.2010.01.006.
45. Mansell, W., Ehlers, A., Clark, D. M., & Chen, Y. (2002). Attention to positive and negative social-evaluative words: Investigating the effects of social anxiety, trait anxiety and social threat. Anxiety, Stress & Coping: An International Journal, 15(1), 19-29. doi:10.1080/10615800290007263.
46. Mattick, R. P., & Clarke, J. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36(4), 455-470. doi:10.1016/S0005-7967(97)10031- 6. (Pubitemid 28256919)
47. Mogg, K., & Bradley, B. P. (1998). A cognitive-motivational analysis of anxiety. Behaviour Research and Therapy, 36(9), 809-848. doi:10.1016/S0005- 7967(98)00063-1. (Pubitemid 28377131)
48. Mogg, K., & Bradley, B. P. (2002). Selective orienting of attention to masked threat faces in social anxiety. Behaviour Research and Therapy, 40(12), 1403-1414. doi:10.1016/S0005-7967(02)00017-7. (Pubitemid 35365968)
49. Mogg, K., Garner, M., & Bradley, B. P. (2007). Anxiety and orienting of gaze to angry and fearful faces. Biological Psychology, 76(3), 163-169. doi:10.1016/j.biopsycho.2007.07.005. (Pubitemid 47575790)
50. Mühlberger, A., Wieser, M. J., & Pauli, P. (2008). Visual attention during virtual social situations depends on social anxiety. CyberPsychology & Behavior, 11(4), 425-430. doi:10.1089/cpb.2007.0084.
51. Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing: Principles and testing. Upper Saddle River, NJ: Pearson Prentice Hall.
52. Nelson, A., Quigley, L., Carriere, J., Purdon, C., & Smilek, D. (2010, June). The role of state and trait-anxiety on the time-course of selective attention towards emotional images. Boston, Massachusetts: Poster presented at the 6th World Congress of Behavioral and Cognitive Therapies.
53. Nummenmaa, L., Hyönä, J., & Calvo, M. G. (2006). Eye movement assessment of selective attentional capture by emotional pictures. Emotion, 6(2), 257-268. doi:10.1037/1528-3542.6.2.257. (Pubitemid 44060361)
54. Ononaiye, M. S. P., Turpin, G., & Reidy, J. G. (2007). Attentional bias in social anxiety: Manipulation of stimulus duration and social-evaluative anxiety. Cognitive Therapy and Research, 31(6), 727-740. doi:10.1007/s10608-006- 9096-8. (Pubitemid 350105247)
55. Pflugshaupt, T., Mosimann, U. P., von Wartburg, R., Schmitt, W., Nyffeler, T., & Müri, R. M. (2005). Hypervigilance-avoidance pattern in spider phobia. Journal of Anxiety Disorders, 19(1), 105-116. doi:10.1016/j.janxdis.2003.12.002. (Pubitemid 39370563)
56. Pineles, S. L., & Mineka, S. (2005). Attentional biases to internal and external sources of potential threat in social anxiety. Journal of Abnormal Psychology, 114(2), 314-318. doi:10.1037/0021-843X.114.2.314. (Pubitemid 40663772)
57. Pishyar, R., Harris, L. M., & Menzies, R. G. (2008). Responsiveness of measures of attentional bias to clinical change in social phobia. Cognition and Emotion, 22(7), 1209-1227. doi:10.1080/02699930701686008.
58. Quigley, L., Nelson, A. L., Carriere, J., Smilek, D., & Purdon, C. (2012). The effects of trait and state anxiety on attention to emotional images: An eye-tracking study. Cognition and Emotion, 26(8), 1390-1411. doi:10.1080/02699931.2012.662892.
59. Rapee, R. M., & Heimberg, R. G. (1997). A cognitive-behavioral model of anxiety in social phobia. Behaviour Research and Therapy, 35(8), 741-756. doi:10.1016/S0005-7967(97)00022-3. (Pubitemid 27336908)
60. Ree, M. J., French, D., MacLeod, C., & Locke, V. (2008). Distinguishing cognitive and somatic dimensions of state and trait anxiety: Development and validation of the state-trait inventory for cognitive and somatic anxiety (STICSA). Behavioural and Cognitive Psychotherapy, 36(3), 313-332. doi:10.1017/S1352465808004232. (Pubitemid 351862008)
61. Rinck, M., & Becker, E. S. (2006). Spider fearful individuals attend to threat, then quickly avoid it: Evidence from eye movements. Journal of Abnormal Psychology, 115(2), 231.
62. Rohner, J. (2002). The time-course of visual threat processing: High trait anxious individuals eventually avert their gaze from angry faces. Cognition and Emotion, 16(6), 837-844. doi:10.1080/02699930143000572.
63. Sattler, J. M. (2008). Assessment of children: Cognitive foundations. La Mesa, CA: Jerome M. Sattler, Publisher, Inc.
64. Schmidt, N. B., Richey, J. A., Buckner, J. D., & Timpano, K. R. (2009). Attention training for generalized social anxiety disorder. Journal of Abnormal Psychology, 118(1), 5-14. doi:10.1037/a0013643.
65. Schmukle, S. C. (2005). Unreliability of the dot probe task. European Journal of Personality, 19, 595-605. doi:10.1002/per.554.
66. Schofield, C. A., Johnson, A. L., Inhoff, A. W., & Coles, M. E. (2012). Social anxiety and difficulty disengaging threat: Evidence from eye-tracking. Cognition and Emotion, 26(2), 300-311. doi:10.1080/02699931.2011. 602050.
67. Schultz, L. T., & Heimberg, R. G. (2008). Attentional focus in social anxiety disorder: Potential for interactive processes. Clinical Psychology Review, 28(7), 1206-1221. doi:10.1016/j.cpr.2008.04.003.
68. Siegrist, M. (1995). Reliability of the stroop test with single-stimulus presentation. Perceptual and Motor Skills, 81(3), 1295-1298. doi:10.2466/pms.1995.81.3f.1295.
69. Staugaard, S. (2009). Reliability of two versions of the dot-probe task using photographic faces. Psychology Science, 51(3), 339-350.
70. Staugaard, S. (2010). Threatening faces and social anxiety: A literature review. Clinical Psychology Review, 30(6), 669-690. doi:10.1016/j.cpr.2010.05. 001.
71. Staugaard, S. R., & Rosenberg, N. K. (2011). Processing of emotional faces in social phobia. Mental Illness, 3(1), 14-20.
72. Stevens, S., Rist, F., & Gerlach, A. L. (2009). Influence of alcohol on the processing of emotional facial expressions in individuals with social phobia. British Journal of Clinical Psychology, 48(2), 125-140. doi:10.1348/014466508X368856.
73. Stolz, J. A., Besner, D., & Carr, T. H. (2005). Implications of measure of reliability for theories of priming: Activity in semantic memory is inherently noisy and uncoordinated. Visual Cognition, 12, 284-336. doi:10.1080/13506280444000030. (Pubitemid 40360720)
74. Strahan, R., & Gerbasi, K. C. (1972). Short, homogeneous versions of the marlowe-crowne social desirability scale. Journal of Clinical Psychology, 28(2), 191-193. doi:10.1002/1097-4679(197204)28:2〈191:AID-JC.
75. Tottenham, N., Tanaka, J., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., et al. (2009). The NimStim set of facial expressions: Judgments from untrained research participants. Psychiatry Research, 168(3), 242-249.
76. Vernon, P. A. (1983). Speed of information processing and general intelligence. Intelligence, 7(1), 53-70.
77. Waechter, S., Besner, D., & Stolz, J. A. (2010). Visual word recognition: On the reliability of repetition priming. Visual Cognition, 18, 537-558. doi:10.1080/13506280902868603.
78. Weierich, M. R., Treat, T. A., & Hollingworth, A. (2008). Theories and measurement of visual attentional processing in anxiety. Cognition and Emotion, 22(6), 985-1018.
79. Wieser, M. J., Pauli, P., Alpers, G. W., & Mühlberger, A. (2009a). Is eye to eye contact really threatening and avoided in social anxiety? - An eye-tracking and psychophysiology study. Journal of Anxiety Disorders, 23(1), 93-103. doi:10.1016/j.janxdis.2008.04.004.
80. Wieser, M. J., Pauli, P., Weyers, P., Alpers, G. W., & Mühlberger, A. (2009b). Fear of negative evaluation and the hypervigilance-avoidance hypothesis: An eye-tracking study. Journal of Neural Transmission, 116(6), 717-723. doi:10.1007/s00702-008-0101-0.
81. Williams, R. H., Zimmerman, D. W., & Zumbo, B. D. (1995). Impact of measurement error on statistical power: Review of an old paradox. Journal of Experimental Education, 63(4), 363-370. doi:10.1080/00220973.1995.9943470.
82. Yiend, J. (2010). The effects of emotion on attention: A review of attentional processing of emotional information. Cognition and Emotion, 24(1), 3-47. doi:10.1080/02699930903205698.
83. Yiend, J., & Mathews, A. (2001). Anxiety and attention to threatening pictures. The Quarterly Journal of Experimental Psychology A: Human Experimental Psychology, 54(3), 665-681. doi:10.1080/02724980042000462. (Pubitemid 33604292)
84. Yiend, J., & Mathews, A. (2005). In A. Wenzel, D. C. Rubin (Eds.), Selective attention tasks in clinical research (pp. 97-117). Washington, DC: American Psychological Association. doi:10.1037/10870-006.