Reconciling the influence of predictiveness and uncertainty on stimulus salience: A model of attention in associative learning

Proceedings of the Royal Society B: Biological Sciences

Volumn 278, Issue 1718, 2011, Pages 2553-2561

  Esber, Guillem R ^a   Haselgrove, Mark ^b  

^a UNIVERSITY OF MARYLAND SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Attention; Conditioning; Learning; Predictiveness; Salience; Uncertainty

Indexed keywords

LEARNING; NEUROLOGY; NUMERICAL MODEL; PREDICTION; PSYCHOLOGY; THEORETICAL STUDY; UNCERTAINTY ANALYSIS;

ANIMAL; ASSOCIATION; ATTENTION; HUMAN; LEARNING; PSYCHOLOGICAL MODEL; RAT; REVIEW; UNCERTAINTY;

ANIMALS; ASSOCIATION LEARNING; ATTENTION; CUES; HUMANS; MODELS, PSYCHOLOGICAL; PROBABILITY LEARNING; RATS; UNCERTAINTY;

EID: 79960809358     PISSN: 09628452     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rspb.2011.0836     Document Type: Review

References (57)

1. Mitchell, C. J. & Le Pelley, M. E. 2010 Attention and associative learning: from brain to behaviour. Oxford, UK: Oxford University Press.
2. Mackintosh, N. J. 1975 A theory of attention: variations in the associability of stimuli with reinforcement. Psychol. Rev. 82, 276-298. (doi:10.1037/h0076778)
3. Sutherland, N. S. & Mackintosh, N. J. 1971 Mechanisms of animal discrimination learning. New York, NY: Academic Press.
4. Kruschke, J. K. 2001 Towards a unified model of attention in associative learning. J. Math. Psychol. 45, 812-863. (doi:10.1006/jmps.2000.1354)
5. Pearce, J. M. & Hall, G. 1980 A model for Pavlovian learning: variation in the effectiveness of conditioned but not unconditioned stimuli. Psychol. Rev. 87, 532-552. (doi:10.1037/0033-295X.87.6.532)
6. Pearce, J. M., Kaye, H. & Hall, G. 1982 Predictive accuracy and stimulus associability: development of a model for Pavlovian conditioning. In Quantitative analysis of behavior (eds M. Commons, R. Herrnstein & A. R. Wagner), pp. 241-255. Cambridge, MA: Ballinger.
7. Schmajuk, N. A., Lam, Y. W. & Gray, J. A. 1996 Latent inhibition: a neural network approach. J. Exp. Psychol.: Anim. Behav. Proc. 22, 321-349. (doi:10.1037/0097- 7403.22.3.321)
8. Pearce, J. M., George, D. N. & Redhead, E. S. 1998 The role of attention in the solution of conditional discriminations. In Occasion setting: associative learning and cognition in animals (eds N. A. Schmajuk & P. C. Holland), pp. 249-275. Washington, DC: American Psychological Association.
9. Le Pelley, M. E. 2004 The role of associative history in models of associative learning: a selective review and a hybrid model. Q. J. Exp. Psychol. 57B, 193-243.
10. Pearce, J. M. & Mackintosh, N. J. 2010 Two theories of attention: a review and a possible integration. In Attention and associative learning: from brain to behaviour (eds C. J. Mitchell & M. E. Le Pelley), pp. 11-39. Oxford, UK: Oxford University Press.
11. Holland, P. C. 1977 Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response. J. Exp. Psychol.: Anim. Behav. Proc. 3, 77-104. (doi:10. 1037/0097-7403.3.1.77)
12. George, D. N. & Pearce, J. M. 1999 Acquired distinctiveness is controlled by stimulus relevance not correlation with reward. J. Exp. Psychol.: Anim. Behav. Proc. 25, 363-373. (doi:10.1037/0097-7403.25.3.363)
13. George, D. N., Duffaud, A. M. & Killcross, S. 2010 Neural correlates of attentional set. In Attention and associative learning: from brain to behaviour (eds C. J. Mitchell & M. E. Le Pelley), pp. 351-383. Oxford, UK: Oxford University Press.
14. Haselgrove, M., Esber, G. R., Pearce, J. M. & Jones, P. M. 2010 Two kinds of attention in Pavlovian conditioning: evidence for a hybrid model of learning. J. Exp. Psychol.: Anim. Behav. Proc. 36, 456-470. (doi:10.1037/a0018528)
15. Duffaud, A. M., Killcross, A. S. & George, D. N. 2007 Optional-shift behaviour in rats: a novel procedure for assessing attentional processes in discrimination learning. Q. J. Exp. Psychol. 60, 534-542. (doi:10.1080/ 17470210601154487)
16. Le Pelley, M. E. & McLaren, I. P. L. 2003 Learned associability and associative change in human causal learning. Q. J. Exp. Psychol. 56B, 68-79.
17. Le Pelley, M. E. 2010 Attention and human associative learning. In Attention and associative learning: from brain to behaviour (eds C. J. Mitchell & M. E. Le Pelley), pp. 187-215. Oxford, UK: Oxford University Press.
18. Griffiths, O. & Mitchell, C. J. 2008 Selective attention in human associative learning and recognition memory. J. Exp. Psychol.: Gen. 137, 626-648. (doi:10.1037/ a0013685)
19. Wills, A. J., Lavric, A., Croft, G. S. & Hodgson, T. L. 2007 Predictive learning, prediction errors, and attention: evidence from event-related potentials and eye tracking. J. Cogn. Neurosci. 19, 843-854. (doi:10.1162/ jocn.2007.19.5.843)
20. Le Pelley, M. E., Schmidt-Hansen, M., Harris, N. J., Lunter, C. M. & Morris, C. S. 2010 Disentangling the attentional deficit in schizophrenia: pointers from schizotypy. Psychiatr. Res. 176, 143-149. (doi:10.1016/j. psychres.2009.03.027)
21. Dickinson, A. 1980 Contemporary animal learning theory. Cambridge, UK: Cambridge University Press.
22. Kaye, H. & Pearce, J. M. 1984 The strength of the orienting response during Pavlovian conditioning. J. Exp. Psychol.: Anim. Behav. Proc. 10, 90-109. (doi:10.1037/ 0097-7403.10.1.90)
23. Swan, J. A. & Pearce, J. M. 1988 The orienting response as an index of stimulus associability in rats. J. Exp. Psychol: Anim. Behav. Proc. 4, 292-301. (doi:10.1037/ 0097-7403.14.3.292)
24. Hogarth, L., Dickinson, A., Austin, A., Brown, C. & Duka, T. 2007 Attention and expectation in human predictive learning: the role of uncertainty. Q. J. Exp. Psychol. 61, 1653-1668.
25. Wilson, P. N., Boumphrey, P. & Pearce, J. M. 1992 Restoration of the orienting response to a light by a change in its predictive accuracy. Q. J. Exp. Psychol. 44B, 17-36.
26. Dickinson, A., Hall, G. & Mackintosh, N. J. 1976 Surprise and the attenuation of blocking. J. Exp. Psychol: Anim. Behav. Proc. 2, 313-322. (doi:10.1037/0097-7403.2.4.313)
27. Holland, P. C. & Maddux, J. M. 2010 Brain systems of attention in associative learning. In Attention and associative learning: from brain to behaviour (eds C. J. Mitchell &M. E. Le Pelley), pp. 305-349. Oxford, UK: Oxford University Press.
28. Fiorillo, C. D., Tobler, P. N. & Schultz, W. 2003 Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898-1902. (doi:10.1126/ science.1077349)
29. Preuschoff, K., Bossaerts, P. & Quartz, S. R. 2006 Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51, 381-390. (doi:10.1016/j.neuron.2006.06.024)
30. Tobler, P. N., O'Doherty, J. P., Dolan, R. J. & Schultz W. 2007 Reward value coding distinct from risk attituderelated uncertainty coding in human reward systems. J. Neurophysiol. 97, 1621-1632. (doi:10.1152/jn.00745. 2006)
31. Schultz, W., Preuschoff, K., Camerer, C., Hsu, M., Fiorillo, C. D., Tobler, P. N. & Bossaerts, P. 2008 Explicit neural signals reflecting reward uncertainty. Phil. Trans. R. Soc. B 363, 3801-3811. (doi:10.1098/rstb. 2008.0152)
32. Rescorla, R. A. & Wagner, A.R. 1972 A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In Classical conditioning II: current research and theory (eds A. H. Black & W. F. Prokasy), pp. 64-99. New York, NY: Appleton-Century- Crofts.
33. Konorski, J. 1967 Integrative activity of the brain. Chicago, IL: University of Chicago Press.
34. Papini, M. R. & Dudley, R. T. 1997 Consequences of surprising reward omissions. Rev. Gen. Psychol. 1, 175- 197. (doi:10.1037/1089-2680.1.2.175)
35. Kim, H., Shimojo, S. & O'Doherty, J. P. 2006 Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 4, 1453-1461.
36. Dickinson, A. & Dearing, M. F. 1979 Appetitive-aversive interactions and inhibitory processes. In Mechanisms of learning and motivation: a memorial volume to Jerzy Konorski (eds A. Dickinson & R. A. Boakes), pp. 203- 231. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
37. Hall, G. & Pearce, J. M. 1982 Restoring the associability of a pre-exposed CS by a surprising event. Q. J. Exp. Psychol. 34B, 127-140.
38. Bromberg-Martin, E. S., Matsumoto, M. & Hikosaka, O. 2010 Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834. (doi:10.1016/j. neuron.2010.11.022)
39. Thompson, R. F. & Spencer, W. A. 1966 Habituation: a model phenomenon for the study of neuronal substrates of behavior. Psychol. Rev. 73, 16-43. (doi:10.1037/ h0022681)
40. Lubow, R. E. 1973 Latent inhibition. Psychol. Bull. 79, 398-407. (doi:10.1037/h0034425)
41. Donegan, N. H. 1981 Priming produced facilitation or diminution of responding to a Pavlovian unconditioned stimulus. J. Exp. Psychol.: Anim. Behav. Proc. 7, 295-312. (doi:10.1037/0097-7403.7.4.295)
42. Hall, G. & Pearce, J. M. 1979 Latent inhibition of a CS during CS-US pairings. J. Exp. Psychol.: Anim. Behav. Proc. 3, 31-42. (doi:10.1037/0097-7403.5.1.31)
43. Honey, R. C. & Hall, G. 1988 Overshadowing and blocking procedures in latent inhibition. Q. J. Exp. Psychol. 40B, 163-180.
44. Wagner, A. R. 1978 Expectancies and the priming of STM. In Cognitive processes in animal behavior (eds S. H. Hulse, H. Fowler & W. K. Honig), pp. 177-209. Hillsdale, NJ: Lawrence Erlbaum Associates.
45. Honey, R. A., Good, M. & Manser, K. L. 1998 Negative priming in associative learning: evidence from a serialhabituation procedure. J. Exp. Psychol.: Anim. Behav. Proc. 24, 229-237. (doi:10.1037/0097-7403.24.2.229)
46. Lovibond, P. E., Preston, G. C. & Mackintosh, N. J. 1984 Context specificity of conditioning and latent inhibition. J. Exp. Psychol.: Anim. Behav. Proc. 10, 360-375. (doi:10.1037/0097-7403.10.3.360)
47. Hall, G. & Channell, S. 1985 Differential effects of context change on latent inhibition and on the habituation of an orienting response. J. Exp. Psychol.: Anim. Behav. Proc. 11, 470-481. (doi:10.1037/0097-7403.11.3.470)
48. McLaren, I. P. L., Bennett, C., Plaisted, K., Aitken, M. & Mackintosh, N. J. 1994 Latent inhibition, context specificity, and context familiarity. Q. J. Exp. Psychol. 47B, 387-400.
49. Vogel, E. H., Brandon, S. E. & Wagner, A. R. 2003 Stimulus representation in SOP. II. An application to inhibition of delay. Behav. Process. 62, 27-48. (doi:10. 1016/S0376-6357(03)00050-0)
50. DeVietti, T. L., Bauste, R. L., Nutt, G., Barrett, O. V., Daly, K. & Petree, A. D. 1987 Latent inhibition: a trace conditioning phenomenon. Learn. Motiv. 18, 185-201. (doi:10.1016/0023-9690(87)90010-5)
51. Kamin, L. J. 1968 'Attention-like' processes in classical conditioning. In Miami symposium on the prediction of behavior: aversive stimuli (ed. M. R. Jones), pp. 9-32. Coral Gables, FL: University of Miami Press.
52. Pavlov, I. P. 1927 Conditioned reflexes. Oxford, UK: Oxford University Press.
53. Pearce, J. M. 1994 Similarity and discrimination: a selective review and a connectionist model. Psychol. Rev. 101, 587-607. (doi:10.1037/0033-295X.101.4.587)
54. Le Pelley, M. E., Beesley, T. & Suret, M. B. 2007 Blocking of human causal learning involves learned changes in stimulus processing. Q. J. Exp. Psychol. 60, 1468-1476.
55. Le Pelley, M. E. 2010 The hybrid modeling approach to conditioning. In Computational models of conditioning (ed. N. Schmajuk), pp. 71-107. Cambridge, UK: Cambridge University Press.
56. Le Pelley, M. E., Turnbull, M. N., Reimer, S. J. & Knipe, R. L. 2010 Learned predictiveness effects following single-cue training in humans. Learn. Behav. 38, 126-144. (doi:10.3758/LB.38.2.126)
57. Collins, L., Young, D. B., Davies, K. & Pearce, J. M. 1983 The influence of partial reinforcement on serial autoshaping with pigeons. Q. J. Exp. Psychol. 35B, 275-290.