Attentional bias for uncertain cues of shock in human fear conditioning: Evidence for attentional learning theory

Frontiers in Human Neuroscience

Volumn 11, Issue , 2017, Pages

  Koenig, Stephan ^a   Uengoer, Metin ^a   Lachnit, Harald ^a  

^a PHILIPPS UNIVERSITY MARBURG   (Germany)

Author keywords

Associative learning; Attention; Eye movements; Fear conditioning; Uncertainty

Indexed keywords

ADULT; ANTICIPATION; ARTICLE; ASSOCIATION; ATTENTIONAL BIAS; COLOR; CONDITIONING; CONFUSION (UNCERTAINTY); DISTRACTIBILITY; ELECTRIC SHOCK; EYE FIXATION; EYE TRACKING; FEAR; FEAR CONDITIONING TEST; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING THEORY; MALE; PREDICTION; PUPIL; STATE DEPENDENT LEARNING; STIMULUS RESPONSE;

EID: 85021394353     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2017.00266     Document Type: Article

References (67)

1. Anderson, B. A. (2015). The attention habit: how reward learning shapes attentional selection. Ann. N. Y. Acad. Sci. 1369, 24–39. doi: 10.1111/nyas.12957
2. Anderson, B. A., Kuwabara, H., Wong, D. F., Gean, E. G., Rahmim, A., Brašić, J. R., et al. (2016). The role of dopamine in value-based attentional orienting. Curr. Biol. 26, 550–555. doi: 10.1016/j.cub.2015.12.062
3. Anderson, B. A., Laurent, P. A., and Yantis, S. (2011a). Learned value magnifies salience-based attentional capture. PLoS ONE 6:e27926. doi: 10.1371/journal. pone.0027926
4. Anderson, B. A., Laurent, P. A., and Yantis, S. (2011b). Value-driven attentional capture. Proc. Natl. Acad. Sci. U.S.A. 108, 10367–10371. doi: 10.1073/pnas. 1104047108
5. Anderson, B. A., and Yantis, S. (2012). Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing. Atten. Percept. Psychophys. 74, 1644–1653. doi: 10.3758/s13414-012-0348-2
6. Anderson, B. A., and Yantis, S. (2013). Persistence of value-driven attentional capture. J. Exp. Psychol. 39, 6–9. doi: 10.1037/a0030860
7. Aston-Jones, G., and Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu. Rev. Neurosci. 28, 403–450. doi: 10.1146/annurev.neuro.28.061604.135709
8. Awh, E., Belopolsky, A. V., and Theeuwes, J. (2012). Top-down versus bottom-up attentional control: a failed theoretical dichotomy. Trends Cogn. Sci. 16, 437–443. doi: 10.1016/j.tics.2012.06.010
9. Barr, D. J., Levy, R., Scheepers, C., and Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: keep it maximal. J. Mem. Lang. 68, 255– 278. doi: 10.1016/j.jml.2012.11.001
10. Bates, D., Mächler, M., Bolker, B., and Walker, S. (2015). Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67, 1–48. doi: 10.18637/jss.v067.i01
11. Bouton, M. E., and Sunsay, C. (2001). Contextual control of appetitive conditioning: influence of a contextual stimulus generated by a partial reinforcement procedure. Q. J. Exp. Psychol. B 54, 109–125. doi: 10.1080/02724990042000083
12. Bradley, M. M., Miccoli, L., Escrig, M. A., and Lang, P. J. (2008). The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology 45, 602–607. doi: 10.1111/j.1469-8986.2008.00654.x
13. Corbetta, M., and Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201–215. doi: 10.1038/nrn755
14. Corneil, B. D., and Munoz, D. P. (2014). Overt responses during covert orienting. Neuron 82, 1230–1243. doi: 10.1016/j.neuron.2014.05.040
15. Desimone, R., and Duncan, J. (1995). Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 18, 193–222. doi: 10.1146/annurev.ne.18. 030195.001205
16. Dunsmoor, J. E., Bandettini, P. A., and Knight, D. C. (2007). Impact of continuous versus intermittent CS-UCS pairing on human brain activation during Pavlovian fear conditioning. Behav. Neurosci. 121, 635–642. doi: 10.1037/0735-7044.121.4.635
17. Fiorillo, C. D., Tobler, P. N., and Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898–1902. doi: 10.1126/science.1077349
18. Geva, R., Zivan, M., Warsha, A., and Olchik, D. (2013). Alerting, orienting or executive attention networks: differential patters of pupil dilations. Front. Behav. Neurosci. 7:145. doi: 10.3389/fnbeh.2013.00145
19. Goodnight, J. H., and Harvey, W. R. (1997). Least Squares Means in the Fixed Effects General Model. Cary, NC: SAS Institute.
20. Gottlieb, J. (2012). Attention, learning, and the value of information. Neuron 76, 281–295. doi: 10.1016/j.neuron.2012.09.034
21. Grady, A. K., Bowen, K. H., Hyde, A. T., Totsch, S. K., and Knight, D. C. (2016). Effect of continuous and partial reinforcement on the acquisition and extinction of human conditioned fear. Behav. Neurosci. 130, 36–43. doi: 10.1037/bne0000121
22. Halekoh, U., and Højsgaard, S. (2014). A kenward-roger approximation and parametric bootstrap methods for tests in linear mixed models–the r package pbkrtest. J. Stat. Softw. 59, 1–30. doi: 10.18637/jss.v059.i09
23. Haselgrove, M., Aydin, A., and Pearce, J. M. (2004). A partial reinforcement extinction effect despite equal rates of reinforcement during Pavlovian conditioning. J. Exp. Psychol. Anim. Behav. Process. 30, 240–250. doi: 10.1037/0097-7403.30.3.240
24. Hickey, C., and Peelen, M. V. (2015). Neural mechanisms of incentive salience in naturalistic human vision. Neuron 85, 512–518. doi: 10.1016/j.neuron.2014. 12.049
25. Hogarth, L., Dickinson, A., Austin, A., Brown, C., and Duka, T. (2008). Attention and expectation in human predictive learning: the role of uncertainty. Q. J. Exp. Psychol. 61, 1658–1668. doi: 10.1080/17470210701643439
26. Hothorn, T., Bretz, F., and Westfall, P. (2008). Simultaneous inference in general parametric models. Biom. J. 50, 346–363. doi: 10.1002/bimj.200810425
27. Huynh, H., and Feldt, L. S. (1976). Estimation of the box correction for degrees of freedom from sample data in the randomized block and split-plot designs. J. Educ. Stat. 1, 69–82. doi: 10.2307/1164736
28. Itti, L., and Koch, C. (2001). Computational modelling of visual attention. Nat. Rev. Neurosci. 2, 194–203. doi: 10.1038/35058500
29. Jenkins, W., and Stanley, J. (1950). Partial reinforcement - a review and critique. Psychol. Bull. 47, 193–234. doi: 10.1037/h0060772
30. Jepma, M., and Nieuwenhuis, S. (2011). Pupil diameter predicts changes in the exploration exploitation trade-off: evidence for the adaptive gain theory. J. Cogn. Neurosci. 23, 1587–1596. doi: 10.1162/jocn.2010.21548
31. Kaye, H., and Pearce, J. M. (1984). The strength of the orienting response during Pavlovian conditioning. J. Exp. Psychol 10, 90–109. doi: 10.1037/0097-7403. 10.1.90
32. Kenward, M. G., and Roger, J. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics 53, 983–997. doi: 10.2307/2533558
33. Kimmel, H., King, J., Hudy, J., and Gardner, K. (1980). A mutual inductance shocker. Behav. Res. Methods Instrum. 12, 605–606. doi: 10.3758/BF03201851
34. Koenig, S. (2010). Modulation of Saccadic Curvature by Spatial Memory and Associative Learning. Doctoral dissertation, Philipps-Universität Marburg, Marburg. Available at: http://archiv.ub.uni-marburg.de/diss/z2010/0636/
35. Koenig, S., and Lachnit, H. (2011). Curved saccade trajectories reveal conflicting predictions in associative learning. J. Exp. Psychol. 37, 1164–1177. doi: 10.1037/a0023718
36. Lachnit, H., Thorwart, A., Schultheis, H., Koenig, S., Lotz, A., and Uengoer, M. (2013). Indicators of early and late processing reveal the importance of within-trial-time for theories of associative learning. PLoS ONE 8:e66291. doi: 10.1371/journal.pone.0066291
37. Le Pelley, M. E., Beesley, T., and Griffiths, O. (2011). Overt attention and predictiveness in human contingency learning. J. Exp. Psychol. 37, 220–229. doi: 10.1037/a0021384
38. Le Pelley, M. E., Mitchell, C. J., Beesley, T., George, D. N., and Wills, A. J. (2016). Attention and associative learning in humans: an integrative review. Psychol. Bull. 142, 1111–1140. doi: 10.1037/bul0000064
39. Le Pelley, M. E., Pearson, D., Griffiths, O., and Beesley, T. (2015). When goals conflict with values: counterproductive attentional and oculomotor capture by reward-related stimuli. J. Exp. Psychol. 144, 158–171. doi: 10.1037/xge00 00037
40. Ledoux, J. (1996). The Emotional Brain: The Mysterious Underpinnings of Emotional Life. New York, NY: Simon & Schuster.
41. Lenth, R. V. (2016). Least-squares means: the R Package lsmeans. J. Stat. Softw. 69, 1–33. doi: 10.18637/jss.v069.i01
42. Lynn, R. (1966). Attention, Arousal and the Orientation Reaction. Oxford: Pergamon.
43. Mackintosh, N. J. (1975). A theory of attention: variations in the associability of stimuli with reinforcement. Psychol. Rev. 82, 276–298. doi: 10.1037/a00 32254
44. Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., and Gold, J. I. (2012). Rational regulation of learning dynamics by pupil-linked arousal systems. Nat. Neurosci. 15, 1040–1046. doi: 10.1038/nn.3130
45. Nevin, J. (1988). Behavioral momentum and the partial-reinforcement effect. Psychol. Bull. 103, 44–56. doi: 10.1037/0033-2909.103.1.44
46. O’Reilly, J. X., Schüffelgen, U., Cuell, S. F., Behrens, T. E. J., Mars, R. B., and Rushworth, M. F. S. (2013). Dissociable effects of surprise and model update in parietal and anterior cingulate cortex. Proc. Natl. Acad. Sci. U.S.A. 110, E3660–E3669. doi: 10.1073/pnas.1305373110
47. Pearce, J. M., and Hall, G. (1980). A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87, 532–552. doi: 10.1037/0033-295X.87.6.532
48. Pearce, J. M., Kaye, H., and Hall, G. (1982). “Predictive accuracy and stimulus associability: development of a model for Pavlovian learning,” in Quantitative Analysis of Behavior, eds M. Commonsa, R. Herrnstein, and A. R. Wagner (Cambridge, MA: Ballinger), 241–255.
49. Pearce, J. M., Redhead, E. S., and Aydin, A. (1997). Partial reinforcement in appetitive Pavlovian conditioning with rats. Q. J. Exp. Psychol. B 50, 273–294. doi: 10.1080/713932660
50. Preuschoff, K., ’t Hart, B. M., and Einhäuser, W. (2011). Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making. Front. Neurosci. 5:115. doi: 10.3389/fnins.2011.00115
51. R Core Team (2016). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
52. Reinhard, G., and Lachnit, H. (2002). Differential conditioning of anticipatory pupillary dilation responses in humans. Biol. Psychol. 60, 51–68. doi: 10.1016/S0301-0511(02)00011-X
53. Reinhard, G., Lachnit, H., and Koenig, S. (2006). Tracking stimulus processing in Pavlovian pupillary conditioning. Psychophysiology 43, 73–83. doi: 10.1111/j. 1469-8986.2006.00374.x
54. Rescorla, R. A., and Wagner, A. R. (1972). “A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement,” in Classical Conditioning II, eds A. H. Black and W. F. Prokasy (New York, NY: Appleton Century Crofts), 64–99.
55. Richer, F., and Beatty, J. (1987). Contrasting effects of response uncertainty on the task-evoked pupillary response and reaction time. Psychophysiology 24, 258–262. doi: 10.1111/j.1469-8986.1987.tb00291.x
56. Satterthwaite, T. D., Green, L., Myerson, J., Parker, J., Ramaratnam, M., and Buckner, R. L. (2007). Dissociable but inter-related systems of cognitive control and reward during decision making: evidence from pupillometry and event-related fMRI. Neuroimage 37, 1017–1031. doi: 10.1016/j.neuroimage.2007. 04.066
57. Schmidt, L. J., Belopolsky, A. V., and Theeuwes, J. (2015). Attentional capture by signals of threat. Cogn. Emot. 29, 687–694. doi: 10.1080/02699931.2014. 924484
58. Schultz, W. (2016). Dopamine reward prediction-error signalling: a two-component response. Nat. Rev. Neurosci. 17, 183–195. doi: 10.1038/nrn. 2015.26
59. Schultz, W., Preuschoff, K., Camerer, C., Hsu, M., Fiorillo, C. D., Tobler, P. N., et al. (2008). Explicit neural signals reflecting reward uncertainty. Philos. Trans. R. Soc. Lond. Series B Biol. Sci. 363, 3801–3811. doi: 10.1098/rstb.2008.0152
60. Sokolov, E. N. (1963). Perception and the Conditioned Reflex. New York, NY: McMillan.
61. Waelti, P., Dickinson, A., and Schultz, W. (2001). Dopamine responses comply with basic assumptions of formal learning theory. Nature 412, 43–48. doi: 10.1038/35083500
62. Wang, C.-A., Boehnke, S. E., White, B. J., and Munoz, D. P. (2012). Microstimulation of the monkey superior colliculus induces pupil dilation without evoking saccades. J. Neurosci. 32, 3629–3636. doi: 10.1523/JNEUROSCI.5512-11.2012
63. Wang, C.-A., and Munoz, D. P. (2015). A circuit for pupil orienting responses: implications for cognitive modulation of pupil size. Curr. Opin. Neurobiol 33, 134–140. doi: 10.1016/j.conb.2015.03.018
64. Wang, L., Yu, H., and Zhou, X. (2013). Interaction between value and perceptual salience in value-driven attentional capture. J. Vis. 13:5. doi: 10.1167/13.3.5
65. Wentura, D., Mueller, P., and Rothermund, K. (2014). Attentional capture by evaluative stimuli: Gain- and loss-connoting colors boost the additional-singleton effect. Psychon. Bull. Rev. 21, 701–707. doi: 10.3758/s13423-013-0531-z
66. Westfall, P. H. (1997). Multiple testing of general contrasts using logical constraints and correlations. J. Am. Stat. Assoc. 92, 299–306. doi: 10.1080/01621459.1997. 10473627
67. Wolfe, J. M., Cave, K. R., and Franzel, S. L. (1989). Guided search: an alternative to the feature integration model for visual search. J. Exp. Psychol. 15, 419–433. doi: 10.1037/0096-1523.15.3.419