Empirical recommendations for improving the stability of the dot-probe task in clinical research

Psychological Assessment

Volumn 27, Issue 2, 2015, Pages 365-376

  Price, Rebecca B ^a   Kuckertz, Jennie M ^b,c   Siegle, Greg J ^a   Ladouceur, Cecile D ^a   Silk, Jennifer S ^a   Ryan, Neal D ^a   Dahl, Ronald E ^a,d   Amir, Nader ^b,c  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^b SAN DIEGO STATE UNIVERSITY   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Attentional bias; Dot probe task; Psychometric; Reliability; Stability

Indexed keywords

ADULT; ARTICLE; ATTENTIONAL BIAS; CALCULATION; CLINICAL ARTICLE; CLINICAL RESEARCH; CONTROLLED STUDY; DOT PROBE TASK; EYE TRACKING; FEMALE; HUMAN; MALE; MENTAL TASK; REACTION TIME; SCORING SYSTEM; SOCIAL PHOBIA; TASK PERFORMANCE; TEST RETEST RELIABILITY; ADOLESCENT; AROUSAL; FACIAL EXPRESSION; FOLLOW UP; INDIVIDUALITY; MIDDLE AGED; PATTERN RECOGNITION; PERSONALITY ASSESSMENT; PHOBIA, SOCIAL; PSYCHOLOGY; PSYCHOMETRY; REPRODUCIBILITY; RESEARCH; STATISTICS AND NUMERICAL DATA; VALIDATION STUDY; YOUNG ADULT;

ADOLESCENT; ADULT; AROUSAL; ATTENTIONAL BIAS; FACIAL EXPRESSION; FEMALE; FOLLOW-UP STUDIES; HUMANS; INDIVIDUALITY; MALE; MIDDLE AGED; PATTERN RECOGNITION, VISUAL; PERSONALITY ASSESSMENT; PHOBIA, SOCIAL; PSYCHOMETRICS; REACTION TIME; REPRODUCIBILITY OF RESULTS; RESEARCH; YOUNG ADULT;

EID: 84930741221     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000036     Document Type: Article

References (45)

1. Amir, N., Beard, C., Burns, M., & Bomyea, J. (2009). Attention modification program in individuals with generalized anxiety disorder. Journal of Abnormal Psychology, 118, 28-33. http://dx.doi.org/10.1037/a0012589
2. Amir, N., Beard, C., Taylor, C. T., Klumpp, H., Elias, J., Burns, M., & Chen, X. (2009). Attention training in individuals with generalized social phobia: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 77, 961-973. http://dx.doi.org/10.1037/a0016685
3. Amir, N., Najmi, S., & Morrison, A. S. (2009). Attenuation of attention bias in obsessive-compulsive disorder. Behaviour Research and Therapy, 47, 153-157. http://dx.doi.org/10.1016/j.brat.2008.10.020
4. Amir, N., Taylor, C. T., & Donohue, M. C. (2011). Predictors of response to an attention modification program in generalized social phobia. Journal of Consulting and Clinical Psychology, 79, 533-541. http://dx.doi.org/10.1037/a0023808
5. Asmundson, G. J. G., & Stein, M. B. (1994). Selective processing of social threat in patients with generalized social phobia: Evaluation using a dot-probe paradigm. Journal of Anxiety Disorders, 8, 107-117. http://dx.doi.org/10.1016/0887-6185(94)90009-4
6. Ataya, A. F., Adams, S., Mullings, E., Cooper, R. M., Attwood, A. S., & Munafò, M. R. (2012). Internal reliability of measures of substancerelated cognitive bias. Drug and Alcohol Dependence, 121, 148-151. http://dx.doi.org/10.1016/j.drugalcdep.2011.08.023
7. Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2007). Threat-related attentional bias in anxious and nonanxious individuals: A meta-analytic study. Psychological Bulletin, 133, 1-24. http://dx.doi.org/10.1037/0033-2909.133.1.1
8. Bartko, J. J. (1966). The intraclass correlation coefficient as a measure of reliability. Psychological Reports, 19, 3-11. http://dx.doi.org/10.2466/pr0.1966.19.1.3
9. Beard, C., Sawyer, A. T., & Hofmann, S. G. (2012). Efficacy of attention bias modification using threat and appetitive stimuli: A meta-analytic review. Behavior Therapy, 43, 724-740. http://dx.doi.org/10.1016/j.beth.2012.01.002
10. Britton, J. C., Bar-Haim, Y., Clementi, M. A., Sankin, L. S., Chen, G., Shechner, T., . . . Pine, D. S. (2013). Training-associated changes and stability of attention bias in youth: Implications for Attention Bias Modification Treatment for pediatric anxiety. Developmental Cognitive Neuroscience, 4, 52-64. http://dx.doi.org/10.1016/j.dcn.2012.11.001
11. Broadbent, D., & Broadbent, M. (1988). Anxiety and attentional bias: State and trait. Cognition and Emotion, 2, 165-183. http://dx.doi.org/10.1080/02699938808410922
12. Cardi, V., Di Matteo, R., Corfield, F., & Treasure, J. (2013). Social reward and rejection sensitivity in eating disorders: An investigation of attentional bias and early experiences. The World Journal of Biological Psychiatry, 14, 622-633. http://dx.doi.org/10.3109/15622975.2012.665479
13. Dear, B. F., Sharpe, L., Nicholas, M. K., & Refshauge, K. (2011). The psychometric properties of the dot-probe paradigm when used in painrelated attentional bias research. The Journal of Pain, 12, 1247-1254. http://dx.doi.org/10.1016/j.jpain.2011.07.003
14. Erceg-Hurn, D. M., & Mirosevich, V. M. (2008). Modern robust statistical methods: An easy way to maximize the accuracy and power of your research. American Psychologist, 63, 591-601. http://dx.doi.org/10.1037/0003-066X.63.7.591
15. First, M. B., Spitzer, R. L., Williams, J. B. W., & Gibbon, M. (1995). Structured Clinical Interview for DSM-IV Axis I disorders-Patient ed. New York: New York Psychiatric Institute.
16. Forestell, C. A., Dickter, C. L., & Young, C. M. (2012). Take me away: The relationship between escape drinking and attentional bias for alcohol-related cues. Alcohol, 46, 543-549. http://dx.doi.org/10.1016/j.alcohol.2012.05.001
17. Gotlib, I. H., McLachlan, A. L., & Katz, A. N. (1988). Biases in visual attention in depressed and nondepressed individuals. Cognition and Emotion, 2, 185-200. http://dx.doi.org/10.1080/02699938808410923
18. Hajcak, G., & Foti, D. (2008). Errors are aversive: Defensive motivation and the error-related negativity. Psychological Science, 19, 103-108. http://dx.doi.org/10.1111/j.1467-9280.2008.02053.x
19. Iacoviello, B. M., Wu, G., Abend, R., Murrough, J. W., Feder, A., Fruchter, E., . . . Charney, D. S. (2014). Attention bias variability and symptoms of posttraumatic stress disorder. Journal of Traumatic Stress, 27, 232-239. http://dx.doi.org/10.1002/jts.21899
20. Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., . . . Ryan, N. (1997). Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime version (K-SADSPL): Initial reliability and validity data. Journal of the American Academy of Child & Adolescent Psychiatry, 36, 980-988. http://dx.doi.org/10.1097/00004583-199707000-00021
21. Klumpp, H., & Amir, N. (2009). Examination of vigilance and disengagement of threat in social anxiety with a probe detection task. Anxiety, Stress, & Coping, 22, 283-296. http://dx.doi.org/10.1080/10615800802449602
22. Koster, E. H., Crombez, G., Verschuere, B., & De Houwer, J. (2004). Selective attention to threat in the dot probe paradigm: Differentiating vigilance and difficulty to disengage. Behaviour Research and Therapy, 42, 1183-1192. http://dx.doi.org/10.1016/j.brat.2003.08.001
23. Legerstee, J. S., Tulen, J. H. M., Kallen, V. L., Dieleman, G. C., Treffers, P. D., Verhulst, F. C., & Utens, E. M. (2009). Threat-related selective attention predicts treatment success in childhood anxiety disorders. Journal of the American Academy of Child & Adolescent Psychiatry, 48, 196-205. http://dx.doi.org/10.1097/CHI.0b013e31819176e4
24. MacLeod, C., Mathews, A., & Tata, P. (1986). Attentional bias in emotional disorders. Journal of Abnormal Psychology, 95, 15-20. http://dx.doi.org/10.1037/0021-843X.95.1.15
25. MacLeod, C., Rutherford, E., Campbell, L., Ebsworthy, G., & Holker, L. (2002). Selective attention and emotional vulnerability: Assessing the causal basis of their association through the experimental manipulation of attentional bias. Journal of Abnormal Psychology, 111, 107-123. http://dx.doi.org/10.1037/0021-843X.111.1.107
26. Matsumoto, D., & Ekman, P. (1989). American-Japanese cultural differences in intensity ratings of facial expressions of emotion. Motivation and Emotion, 13, 143-157. http://dx.doi.org/10.1007/BF00992959
27. Mogg, K., Garner, M., & Bradley, B. P. (2007). Anxiety and orienting of gaze to angry and fearful faces. Biological Psychology, 76, 163-169. http://dx.doi.org/10.1016/j.biopsycho.2007.07.005
28. Mohlman, J., Price, R. B., & Vietri, J. (2013). Attentional bias in older adults: Effects of generalized anxiety disorder and cognitive behavior therapy. Journal of Anxiety Disorders, 27, 585-591. http://dx.doi.org/10.1016/j.janxdis.2013.06.005
29. Nunnally, J., & Bernstein, I. (1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.
30. Petersen, S. E., & Posner, M. I. (2012). The attention system of the human brain: 20 years after. Annual Review of Neuroscience, 35, 73-89. http://dx.doi.org/10.1146/annurev-neuro-062111-150525
31. Posner, M. I., & Petersen, S. E. (1990). The attention system of the human brain. Annual Review of Neuroscience, 13, 25-42. http://dx.doi.org/10.1146/annurev.ne.13.030190.000325
32. Price, M., Tone, E. B., & Anderson, P. L. (2011). Vigilant and avoidant attention biases as predictors of response to cognitive behavioral therapy for social phobia. Depression and Anxiety, 28, 349-353. http://dx.doi.org/10.1002/da.20791
33. Price, R. B., Siegle, G. J., Silk, J. S., Ladouceur, C., McFarland, A., Dahl, R. E., & Ryan, N. D. (2013). Sustained neural alterations in anxious youth performing an attentional bias task: A pupilometry study. Depression and Anxiety, 30, 22-30. http://dx.doi.org/10.1002/da.21966
34. Ratcliff, R. (2008). Modeling aging effects on two-choice tasks: Response signal and response time data. Psychology and Aging, 23, 900-916. http://dx.doi.org/10.1037/a0013930
35. Salemink, E., van den Hout, M. A., & Kindt, M. (2007). Selective attention and threat: Quick orienting versus slow disengagement and two versions of the dot probe task. Behaviour Research and Therapy, 45, 607-615. http://dx.doi.org/10.1016/j.brat.2006.04.004
36. Schmukle, S. C. (2005). Unreliability of the dot probe task. European Journal of Personality, 19, 595-605. http://dx.doi.org/10.1002/per.554
37. Sipos, M. L., Bar-Haim, Y., Abend, R., Adler, A. B., & Bliese, P. D. (2014). Postdeployment threat-related attention bias interacts with combat exposure to account for PTSD and anxiety symptoms in soldiers. Depression and Anxiety, 31, 124-129. http://dx.doi.org/10.1002/da.22157
38. Staugaard, S. R. (2009). Reliability of two versions of the dot-probe task using photographic faces. Psychology Science Quarterly, 51, 339-350.
39. Tottenham, N., Tanaka, J. W., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., . . . Nelson, C. (2009). The NimStim set of facial expressions: Judgments from untrained research participants. Psychiatry Research, 168, 242-249. http://dx.doi.org/10.1016/j.psychres.2008.05.006
40. Waechter, S., Nelson, A., Wright, C., Hyatt, A., & Oakman, J. (2014). Measuring attentional bias to threat: Reliability of dot probe and eye movement indices. Cognitive Therapy and Research, 38, 313-333.
41. Waters, A. M., Lipp, O. V., & Spence, S. H. (2004). Attentional bias toward fear-related stimuli: An investigation with nonselected children and adults and children with anxiety disorders. Journal of Experimental Child Psychology, 89, 320-337. http://dx.doi.org/10.1016/j.jecp.2004.06.003
42. Waters, A. M., Mogg, K., & Bradley, B. P. (2012). Direction of threat attention bias predicts treatment outcome in anxious children receiving cognitive-behavioural therapy. Behaviour Research and Therapy, 50, 428-434. http://dx.doi.org/10.1016/j.brat.2012.03.006
43. Waters, A. M., Wharton, T. A., Zimmer-Gembeck, M. J., & Craske, M. G. (2008). Threat-based cognitive biases in anxious children: Comparison with non-anxious children before and after cognitive behavioural treatment. Behaviour Research and Therapy, 46, 358-374. http://dx.doi.org/10.1016/j.brat.2008.01.002
44. Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence (WASI). San Antonio, TX: Harcourt Assessment.
45. Weir, J. P. (2005). Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. Journal of Strength and Conditioning Research, 19, 231-240.