Prediction and Uncertainty in Human Pavlovian to Instrumental Transfer

Journal of Experimental Psychology: Learning Memory and Cognition

Volumn 37, Issue 3, 2011, Pages 757-765

  Trick, Leanne ^a   Hogarth, Lee ^b   Duka, Theodora ^a  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

^b UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Associative learning; Attention; Human; Learning; Prediction error

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; ASSOCIATION; ATTENTION; AVOIDANCE BEHAVIOR; AWARENESS; CONDITIONED REFLEX; EMOTION; FEMALE; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; MALE; METHODOLOGY; MIDDLE AGED; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; PREDICTIVE VALUE; TIME; UNCERTAINTY;

ADOLESCENT; ADULT; ATTENTION; AVOIDANCE LEARNING; AWARENESS; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; CUES; EMOTIONS; FEMALE; HUMANS; MALE; MIDDLE AGED; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PREDICTIVE VALUE OF TESTS; TIME FACTORS; TRANSFER (PSYCHOLOGY); UNCERTAINTY; YOUNG ADULT;

EID: 79955709176     PISSN: 02787393     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0022310     Document Type: Article

References (28)

1. Balleine B.W., Ostlund S.B. Still at the choice-point: Action selection and initiation in instrumental conditioning. Reward and decision making in corticobasal ganglia networks 2007, 1104:147-171. Wiley-Blackwell, Hoboken, NJ, Annals of the New York Academy of Sciences. B.W. Balleine, K. Doya, J. O'Doherty, M. Sakagami (Eds.).
2. Bray S., Rangel A., Shimojo S., Balleine B., O'Doherty J.P. The neural mechanisms underlying the influence of Pavlovian cues on human decision making. Journal of Neuroscience 2008, 28:5861-5866. doi: 10.1523/JNEUROSCI.0897-08.2008.
3. Collins L., Pearce J.M. Predictive accuracy and the effects of partial reinforcement on serial autoshaping. Journal of Experimental Psychology: Animal Behavior Processes 1985, 11:548-564.
4. Dayan P., Kakade S., Montague P.R. Learning and selective attention. Nature Neuroscience 2000, 3(Suppl.):1218-1223. doi: 10.1038/81504.
5. Declercq M., De Houwer J. Transfer of avoidance responding to a sensory preconditioned cue: Evidence for the role of S-S and R-S knowledge in avoidance learning. Learning and Motivation 2009, 40:197-208. doi: 10.1016/j.lmot.2008.11.003.
6. Dickinson A. Causal learning: An associative analysis (The 28th Bartlett Memorial Lecture). Quarterly Journal of Experimental Psychology: Comparative and Physiological Psychology 2001, 54(B):3-25.
7. Dreher J.C., Kohn P., Berman K.F. Neural coding of distinct statistical properties of reward information in humans. Cerebral Cortex 2006, 16:561-573. doi: 10.1093/cercor/bhj004.
8. Field M., Munafo M.R., Franken I.H. A meta-analytic investigation of the relationship between attentional bias and subjective craving in substance abuse. Psychological Bulletin 2009, 135:589-607. doi: 10.1037/a0015843.
9. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, March 21, 299:1898-1902. doi: 10.1126/science.1077349.
10. Gámez M., Rosas J.M. Associations in human instrumental conditioning. Learning and Motivation 2007, 38:242-261. doi: 10.1016/j.lmot.2006.11.001.
11. Hogarth L., Dickinson A., Austin A., Brown C., Duka T. Attention and expectation in human predictive learning: The role of uncertainty. Quarterly Journal of Experimental Psychology 2008, 61:1658-1668. doi: 10.1080/17470210701643439.
12. Hogarth L., Dickinson A., Duka T. Detection versus sustained attention to drug cues have dissociable roles in mediating drug seeking behavior. Experimental and Clinical Psychopharmacology 2009, 17:21-30. doi: 10.1037/a0014957.
13. Hogarth L., Dickinson A., Hutton S.B., Elbers N., Duka T. Drug expectancy is necessary for stimulus control of human attention, instrumental drug-seeking behaviour and subjective pleasure. Psychopharmacology 2006, 185:495-504. doi: 10.1007/s00213-005-0287-x.
14. Hogarth L., Dickinson A., Wright A., Kouvaraki M., Duka T. The role of drug expectancy in the control of human drug seeking. Journal of Experimental Psychology: Animal Behavior Processes 2007, 33:484-496. doi: 10.1037/0097-7403.33.4.484.
15. Hogarth L., Duka T. Human nicotine conditioning requires explicit contingency knowledge: Is addictive behaviour cognitively mediated?. Psychopharmacology 2006, 184:553-566. doi: 10.1007/s00213-005-0150-0.
16. Kaye H., Pearce J.M. The strength of the orienting response during Pavlovian conditioning. Journal of Experimental Psychology: Animal Behavior Processes 1984, 10:90-109. doi: 10.1037/0097-7403.10.1.90.
17. Kim H., Shimojo S., O'Doherty J.P. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biology 2006, 4:e233. doi: 10.1371/journal.pbio.0040233.
18. Lieberman D.A., Sunnucks W.L., Kirk J.D. Reinforcement without awareness: I. Voice level. Quarterly Journal of Experimental Psychology: Comparative and Physiological Psychology 1998, 51(B):301-316.
19. Lovibond P.F., Shanks D.R. The role of awareness in Pavlovian conditioning: Empirical evidence and theoretical implications. Journal of Experimental Psychology: Animal Behavior Processes 2002, 28:3-26. doi: 10.1037/0097-7403.28.1.3.
20. Paredes-Olay C., Abad M.J.F., Gamez M., Rosas J.M. Transfer of control between causal predictive judgments and instrumental responding. Animal Learning & Behavior 2002, 30:239-248.
21. Pearce J.M., Hall G. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not unconditioned stimuli. Psychological Review 1980, 87:532-552. doi: 10.1037/0033-295X.87.6.532.
22. Premack D., Collier G. Duration of looking and number of brief looks as dependent variables. Psychonomic Science 1966, 4:81-82.
23. Preuschoff K., Quartz S.R., Bossaerts P. Human insula activation reflects risk prediction errors as well as risk. Journal of Neuroscience 2008, 28:2745-2752. doi: 10.1523/JNEUROSCI.4286-07.2008.
24. Schultz W., Preuschoff K., Camerer C., Hsu M., Fiorillo C.D., Tobler P.N., Bossaerts P. Explicit neural signals reflecting reward uncertainty. Philosophical Transactions of the Royal Society London: Biological Sciences 2008, 363(B):3801-3811. doi: 10.1098/rstb.2008.0152.
25. Talmi D., Seymour B., Dayan P., Dolan R.J. Human Pavlovian-instrumental transfer. Journal of Neuroscience 2008, 28:360-368. doi: 10.1523/JNEUROSCI.4028-07.2008.
26. Tobler P.N., O'Doherty J.P., Dolan R.J., Schultz W. Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. Journal of Neurophysiology 2007, 97:1621-1632. doi: 10.1152/jn.00745.2006.
27. Wagner A.R. Incidental stimuli and discrimination learning. Animal discrimination learning 1969, 83-111. Academic Press, London, England. R.M. Gilbert, N.S. Sutherland (Eds.).
28. Weierich M.R., Treat T.A., Hollingworth A. Theories and measurement of visual attentional processing in anxiety. Cognition & Emotion 2008, 22:985-1018. doi: 10.1080/02699930701597601.