The three principles of action: A Pavlovian-instrumental transfer hypothesis

Frontiers in Behavioral Neuroscience

Volumn , Issue NOV, 2013, Pages

  Cartoni, Emilio ^a   Puglisi Allegra, Stefano ^b,c   Baldassarre, Gianluca ^a  

^a INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

^b SAPIENZA UNIVERSITY OF ROME   (Italy)

^c IRCCS FONDAZIONE SANTA LUCIA   (Italy)

Author keywords

Bayesian network; General PIT; Goal directed behavior; Latent causes; Nucleus accumbens; Pavlovian instrumental transfer; Specific PIT

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; ASSOCIATIVE MEMORY; BAYES THEOREM; CONTROLLED STUDY; EVOKED RESPONSE; HABITUATION; INSTRUMENTAL CONDITIONING; MOTIVATION; MOUSE; NONHUMAN; NUCLEUS ACCUMBENS; PAVLOVIAN CONDITIONED STIMULI; PAVLOVIAN INSTRUMENTAL TRANSFER; RAT; REINFORCEMENT; REWARD; STIMULUS RESPONSE;

EID: 84887970129     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2013.00153     Document Type: Article

References (31)

1. Balleine, B. W., and Ostlund, S. B. (2007). Still at the choice-point: action selection and initiation in instrumental conditioning. Ann. N. Y Acad. Sci. 1104, 147-171. doi: 10.1196/annals.1390.006
2. Beaumont, M. A., and Rannala, B. (2004). The Bayesian revolution in genetics. Nat. Rev. Genet. 5, 251-261. doi: 10.1038/nrg1318
3. Blundell, P., Hall, G., and Killcross, S. (2001). Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats. J. Neurosci. 21, 9018-9026.
4. Corbit, L. H., and Balleine, B. W. (2005). Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J. Neurosci. 25, 962-970. doi: 10.1523/JNEUROSCI.4507-04.2005
5. Corbit, L. H., and Balleine, B. W. (2011). The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. J. Neurosci. 31, 11786-11794. doi: 10.1523/JNEUROSCI.2711-11.2011
6. Corbit, L. H., and Janak, P. H. (2007). Ethanol-associated cues produce general pavlovian-instrumental transfer. Alcohol. Clin. Exp. Res. 31, 766-774. doi: 10.1111/j.1530-0277.2007.00359.x
7. Corbit, L. H., and Janak, P. H. (2010). Posterior dorsomedial striatum is critical for both selective instrumental and Pavlovian reward learning. Eur. J. Neurosci. 31, 1312-1321. doi: 10.1111/j.1460-9568.2010.07153.x
8. Corbit, L. H., Janak, P. H., and Balleine, B. W. (2007). General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area. Eur. J. Neurosci. 26, 3141-3149. doi: 10.1111/j.1460-9568.2007.05934.x
9. Courville, A. C., Daw, N. D., Gordon, G. J., and Touretzky, D. S. (2004). "Model uncertainty in classical Conditioning, " in Advances in Neural Information Processing Systems, Vol. 16, eds S. Thrun, L. K. Saul, and B. Schölkopf (Cambridge, MA: MIT Press), 977-984.
10. Courville, A. C., Daw, N. D., and Touretzky, D. S. (2005). "Similarity and discrimination in classical conditioning: A latent variable account, " in Advances in Neural Information Processing Systems, Vol. 17, eds L. K. Saul, Y. Weiss, and L. Bottou (Cambridge, MA: MIT Press), 313-320.
11. Courville, A. C., Daw, N. D., and Touretzky, D. S. (2006). Bayesian theories of conditioning in a changing world. Trends Cogn. Sci. 10, 294-300. doi: 10.1016/j.tics.2006.05.004
12. Gershman, S. J., and Niv, Y. (2012). Exploring a latent cause theory of classical conditioning. Learn. Behav. 40, 255-268. doi: 10.3758/s13420-012-0080-8
13. Hall, J., Parkinson, J. A., Connor, T. M., Dickinson, A., and Everitt, B. J. (2001). Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour. Eur. J. Neurosci. 13, 1984-1992. doi: 10.1046/j.0953-816x.2001.01577.x
14. Hibbert, D., and Armstrong, N. (2009). An introduction to Bayesian methods for analyzing chemistry data. Chemomet. Intel. Lab. Syst. 97, 211-220. doi: 10.1016/j.chemolab.2009.03.009
15. Holland, P. C. (2004). Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J. Exp. Psychol. Anim. Behav. Process. 30, 104-117. doi: 10.1037/0097-7403.30.2.104
16. Holmes, N. M., Marchand, A. R., and Coutureau, E. (2010). Pavlovian to instrumental transfer: a neurobehavioural perspective. Neurosci. Biobehav. Rev. 34, 1277-1295. doi: 10.1016/j.neubiorev.2010.03.007
17. Loredo, T. J. (1992). "The promise of bayesian inference for astrophysics, " inStatistical Challenges in Modern Astronomy, Vol. 297, eds D. Eric and B. Jogesh (New York, NY: Springer-Verlag). 275-297. doi: 10.1007/978-1-4613-9290-3_31
18. Lunn, D. J., Thomas, A., Best, N., and Spiegelhalter, D. (2000). WinBUGS-A Bayesian modelling framework: concepts, structure, and extensibility. Stat. Comput. 10, 325-337. doi: 10.1023/A:1008929526011
19. Morgado, P., Silva, M., Sousa, N., and Cerqueira, J. A. J. (2012). Stress transiently affects pavlovian-to-instrumental transfer. Front. Neurosci. 6:93. doi: 10.3389/fnins.2012.00093
20. Ostlund, S. B., and Balleine, B. W. (2007). The contribution of orbitofrontal cortex to action selection. Ann. N.Y. Acad. Sci. 1121, 174-192. doi: 10.1196/annals.1401.033
21. Pearce, J. M. (1994). Similarity and discrimination: a selective review and a connectionist model. Psychol. Rev. 101, 587-607.
22. Pezzulo, G., Rigoli, F., and Chersi, F. (2013). The mixed instrumental controller: using value of information to combine habitual choice and mental simulation. Front. Psychol. 4:92. doi: 10.3389/fpsyg.2013.00092
23. Poirier, D. J. (2006). The growth of Bayesian methods in statistics and economics since 1970. Bayesian Anal. 1, 969-979. doi: 10.1214/06-BA132
24. Prévost, C., Liljeholm, M., Tyszka, J. M., and O'Doherty, J. P. (2012). Neural correlates of specific and general Pavlovian-to-Instrumental Transfer within human amygdalar subregions: a high-resolution fMRI study. J. Neurosci. 32, 8383-8390. doi: 10.1523/JNEUROSCI.6237-11.2012
25. Rescorla, R. A. (1994). Transfer of instrumental control mediated by a devalued outcome. Anim. Learn. Behav. 22, 27-33. doi: 10.3758/BF03199953
26. Rescorla, R. A., and Wagner, A. R. (1972). "A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement, " in Classical Conditioning II Current Research and Theory, eds A. Black and W. F. Prokasky. (New York, NY: Appleton-Century-Crofts.) 64-99.
27. Shiflett, M. W., and Balleine, B. W. (2010). At the limbic-motor interface: disconnection of basolateral amygdala from nucleus accumbens core and shell reveals dissociable components of incentive motivation. Eur. J. N. 32, 1735-1743. doi: 10.1111/j.1460-9568.2010.07439.x
28. Solway, A., and Botvinick, M. M. (2012). Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates. Psychol. Rev. 119, 120-154. doi: 10.1037/a0026435
29. Trick, L., Hogarth, L., and Duka, T. (2011). Prediction and uncertainty in human Pavlovian to instrumental transfer. J. Exp. Psychol. Learn. Mem. Cogn. 37, 757-765. doi: 10.1037/a0022310
30. Wyvell, C. L., and Berridge, K. C. (2001). Incentive sensitization by previous amphetamine exposure: increased cue-triggered "Wanting" for sucrose reward. J. Neurosci. 21, 7831-7840.
31. Yin, H. H., and Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464-476. doi: 10.1038/nrn1919