Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates

Neuropharmacology

Volumn 37, Issue 4-5, 1998, Pages 407-419

  Balleine, Bernard W ^a   Dickinson, Anthony ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b University of Cambridge   (United Kingdom)

Author keywords

Cortex; Instrumental conditioning; Rats; Reinforcement; Reward

Indexed keywords

BEHAVIOR; CONFERENCE PAPER; INSTRUMENTAL CONDITIONING; INSULA; LEARNING; NONHUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT;

ADAPTATION, PSYCHOLOGICAL; ANIMALS; BEHAVIOR, ANIMAL; CEREBRAL CORTEX; CONDITIONING, OPERANT; GOALS; HUMANS; MOTIVATION;

EID: 0031801210     PISSN: 00283908     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0028-3908(98)00033-1     Document Type: Conference Paper

References (50)

1. Adams C.D. Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q. J. Exp. Psychol. 34B:1982;77-98.
2. Adams C.D., Dickinson A. Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol. 33B:1981;109-122.
3. Balleine B.W. The role of incentive learning in instrumental performance following shifts in primary motivation. J. Exp. Psychol: Anim. Behav. Proc. 18:1992;236-250.
4. Balleine B., Dickinson A. The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety. Anim. Learn. Behav. 26:1998;46-59.
5. Braun J.J., 1990. Gustatory cortex: Definition and function. In: Kolb B., Tees R., (Eds.), The Cerebral Cortex of the Rat. MIT Press, Cambridge, MA., pp. 407-430.
6. Braun J.J., Lasiter P.S., Kiefer S.W. The gustatory neocortex of the rat. Physiol. Psychol. 10:1982;13-45.
7. Carp J.S., Wolpaw J.R. Motoneuron plasticity underlying operantly conditioned decrease in primate H-reflex. J. Neurophysiol. 72:1994;431-442.
8. Chen X.Y., Wolpaw J.R. Operant conditioning of H-reflex in freely moving rats. J. Neurophysiol. 73:1995;411-415.
9. Colwill R.M., Rescorla R.A. Postconditioning devaluation of a reinforcer affects instrumental responding. J. Exp. Psychol: Anim. Behav. Proc. 11:1985;120-132.
10. Colwill R.M., Rescorla R.A. Instrumental responding remains sensitive to reinforcer devaluation after extensive training. J. Exp. Psychol: Anim. Behav. Proc. 11:1985;520-536.
11. Colwill R.M. and Rescorla R.A. (1986) Associative structures in instrumental learning. In: Bower G.H., (Ed.) The Psychology of Learning and Motivation, 20: Academic Press, Orlando, FL., pp.55-104.
12. Colwill R.M., Rescorla R.A. The role of response-reinforcer associations increases throughout extended instrumental training. Anim. Learn. Behav. 16:1988;105-111.
13. Davidson T.L. The nature and function of interoceptive signals to feed: Towards intergration of physiological and learning perspectives. Psychol. Rev. 100:1993;637-640.
14. Dickinson A., 1980. Contemporary Animal Learning Theory. Cambridge University Press, Cambridge.
15. Dickinson A., Balleine B. Motivational control of goal-directed action. Anim. Learn. Behav. 22:1994;1-18.
16. Dickinson A., Balleine B. Motivational control of instrumental action. Curr. Dir. Psychol. Sci. 4:1995;162-167.
17. Dickinson A., Mulatero C.W. Reinforcer specificity of the suppression of instrumental performance on a non-contingent schedule. Behav. Proc. 19:1989;167-180.
18. Dickinson A., Shanks D.R., 1995. Instrumental action and causal representation. In: Sperber D., Premack A.J., (Eds.) Causal Cognition: A Multidisciplinary Debate. Clarendon Press, Oxford, pp. 5-25.
19. Dickinson A., Balleine B., Watt A., Gonzalez F., Boakes R.A. Motivational control after extended instrumental training. Anim. Learn. Behav. 23:1995;197-206.
20. Dickinson A., Campos J., Varga Z.L., Balleine B.W. Bidirectional instrumental conditioning. Q. J. Exp. Pychol. 49B:1996;289-306.
21. Donahoe J.W., Burgos J.E., Palmer D.C. A selectionist approach to reinforcement. J. Exp. Anal. Behav. 60:1993;17-40.
22. Donahoe J.W., Palmer D.C., Burgos J.E. The unit of selection: What do reinforcers reinforcer. J. Exp. Anal. Behav. 68:1997;259-273.
23. Frith C.D., Friston K., Liddle P.F., Frackowiak R.S. Willed action and the prefrontal cortex in man: a study with PET. Proc. R. Soc. Lond. 244:1991;241-246.
24. Fuster J., 1989. The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe (2nd ed). Raven Press, New York.
25. Gallistel C.R., 1990. The Organization of Learning. MIT Press, Cambridge, MA.
26. Gluck M.A., Thompson R.I. Modeling the neural substrate of associative learning and memory: a computational approach. Psychol. Rev. 94:1987;176-191.
27. Goldman-Rakic P.S. The issue of memory in the study of prefrontal function. Thiery A.-M. et al. Motor and Cognitive Functions of the Prefrontal Cortex. 1994;112-121 Springer-Verlag, Berlin.
28. Grand S., Cliff D., Malhotra A., 1996. Creatures: Artficial Life Autonomous Software Agents for Home Entertainment. University of Sussex Technical Report CSRP434.
29. Hammond L.J. The effects of contingencies upon appetitive conditioning of free-operant behavior. J. Exp. Anal. Behav. 34:1980;297-304.
30. Hawkins R.D., Kandel E.R. Is there a cell-biolological alphabet for simple forms of learning? Psychol. Rev. 91:1984;375-391.
31. Hetherington M.M., Rolls B.J., 1996. Sensory-specific satiety: Theoretical issues and central characteristics. In: Capaldi, E.D., (Ed.), Why We Eat What We Eat , American Psychological Association, Washington, D.C., pp. 267-290.
32. Hershberger W.A. An approach through the looking glass. Anim. Learn. Behav. 14:1986;443-451.
33. Hollis K.L., Pharr V.L., Dumas M.J., Britton G.B., Field J. Classical conditioning provides paternity advantage for territorial male blue gouramis (Trichogaster tricopterus). J. Comp. Psychol. 111:1997;219-225.
34. Hull C.L., 1943. Principles of Behavior. Appleton-Century-Crofts, New York.
35. Knight R.T., Grabowecky M.F., Scabini D. Role of human prefrontal cortex in attention control. Adv. Neurol. 66:1995;21-34.
36. Lavond D.G., Kim J.J., Thompson R.F. Mammalian brain substrates of aversive classical conditioning. Ann. Rev. Psychol. 44:1993;317-342.
37. Ledoux J., 1995. The Emotional Brain. Simon & Schuster, New York.
38. McGaugh J.L., Weinberger N.M., Lynch G., 1995. Brain and Memory: Modulation and Mediation of Neuroplasticity. Oxford University Press, New York.
39. Pearce J.M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87:1980;532-552.
40. Rescorla R.A., Wagner A.R., 1972. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and non-reinforcement. In: Black A.H., Prokasy W.F. (Eds.), Classical Conditioning II: Current Research and Theory, Appleton-Century-Crofts, New York, pp. 64-99.
41. Robbins T.W., Everitt B.J. Neurobehavioural mechanisms of reward and motivation. Cur. Opin. Neurobiol. 6:1996;228-236.
42. Rosenblum K., Berman D.E., Hazvi S., Lamprecht R., Dudai Y. NMDA receptor and the tyrosine phosphorylation of its 2B subunit in taste learning in the rat insular cortex. J. Neurosci. 17:1997;5129-5135.
43. Schmajuk N.A., 1997. Animal Learning and Cognition. Cambridge University Press, Cambridge.
44. Squire L.R. Memory and the hippocampus: A synthesis from findings with rats, monkeys and humans. Psychol. Rev. 99:1992;195-231.
45. Thorndike E.L., 1911. Animal Intelligence: Experimental Studies. Macmillan, New York.
46. Tolman E.C., 1932. Purposive Behavior in Animals and Man. Century, New York.
47. Wagner A.R., 1981. SOP: A model of automatic memory processing in animal behavior. In: Spear, N.E., Miller R.R. (Eds.), Information Processing in Animals: Memory Mechanisms, Lawrence Erlbaum Associates, Hillsdale, N.J., pp. 5-47.
48. White N.M. A functional hypothesis concerning the striatal matrix and patches: Mediation of S-R memory and reward. Life Sci. 45:1989;1943-1957.
49. Williams B.A. The effect of response contingency and reinforcement identity on response suppression by alternative reinforcement. Learn. Motiv. 20:1989;204-224.
50. Wolpaw J.R., Lee C.L., Calaitges J.G. Operant conditioning of primate triceps surae H-reflex produces reflex asymmetry. Exp. Brain Res. 75:1989;35-39.