Choice and contingency in the development of behavioral autonomy during instrumental conditioning

Journal of Experimental Psychology: Animal Behavior Processes

Volumn 36, Issue 3, 2010, Pages 334-342

  Kosaki, Yutaka ^a   Dickinson, Anthony ^a  

^a UK   (United Kingdom)

Author keywords

Choice; Goal directed behavior; Habits; Instrumental learning; Reinforcer devaluation

Indexed keywords

ANIMAL; ANIMAL BEHAVIOR; ARTICLE; AUTOMATISM; AVOIDANCE BEHAVIOR; DECISION MAKING; FOOD DEPRIVATION; INSTRUMENTAL CONDITIONING; MALE; PHYSIOLOGY; RAT; REINFORCEMENT;

ANIMALS; AUTOMATISM; AVOIDANCE LEARNING; BEHAVIOR, ANIMAL; CHOICE BEHAVIOR; CONDITIONING, OPERANT; EXTINCTION, PSYCHOLOGICAL; FOOD DEPRIVATION; MALE; RATS; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE;

RATTUS;

EID: 77955317341     PISSN: 00977403     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0016887     Document Type: Article

References (26)

1. Adams C.D. Variations in the sensitivity of instrumental responding to reinforcer devaluation. Quarterly Journal of Experimental Psychology 1982, 34B:77-98.
2. Adams C.D., Dickinson A. Instrumental responding following reinforcer devaluation. Quarterly Journal of Experimental Psychology 1981, 33B:109-122.
3. Balleine B.W., Dickinson A. Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37:407-419.
4. Baum W.M. The correlation-based law of effect. Journal of the Experimental Analysis of Behavior 1973, 20:137-153.
5. Callu D., Puget S., Faure A., Guegana M., El Massioui N. Habit learning dissociation in rats with lesions to the vermis and the interpositus of the cerebellum. Neurobiology of Disease 2007, 27:228-237.
6. Cardinal R.N., Aitken M.R.F. Whisker (Version 2.4) [Computer software] 2001, Cambridge University Technical Services, Cambridge, United Kingdom.
7. Colwill R.M., Rescorla R.A. Instrumental responding remains sensitive to reinforcer devaluation after extensive training. Journal of Experimental Psychology: Animal Behavior Processes 1985, 11:520-536.
8. Colwill R.M., Rescorla R.A. The role of response-reinforcer associations increases throughout extended instrumental training. Animal Learning and Behavior 1988, 16:105-111.
9. Corbit L.H., Balleine B.W. The role of prelimbic cortex in instrumental conditioning. Behavioural Brain Research 2003, 146:145-157.
10. Corbit L.H., Muir J.L., Balleine B.W. The role of the nucleus accumbens in instrumental conditioning: Evidence of a functional dissociation between accumbens core and shell. Journal of Neuroscience 2001, 21:3251-3260.
11. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 2005, 8:1704-1711.
12. Dickinson A. Actions and habits: The development of behavioural autonomy. Philosophical Transactions of the Royal Society (London), B 1985, 308:67-78.
13. Dickinson A. Expectancy theory in animal conditioning. Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theories 1989, 279-308. Erlbaum, Hillsdale, NJ. S.B. Klein, R.R. Mowrer (Eds.).
14. Dickinson A., Balleine B., Watt A., Gonzalez F., Boakes R.A. Motivational control after extended instrumental training. Animal Learning and Behavior 1995, 23:197-206.
15. Dickinson A., Nicholas D.J., Adams C.D. The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. Quarterly Journal of Experimental Psychology 1983, 35B:35-51.
16. Faure A., Haberland U., Condé F., El Massioui N. Lesion to the Nigrostriatal Dopamine System Disrupts Stimulus-Response Habit Formation. Journal of Neuroscience 2005, 25:2771-2780.
17. Hilário M.R.F., Clouse E., Yin H.H., Costa R.M. Endocannabinoid signaling is critical for habit formation. Frontiers in Integrative Neuroscience 2007, 1:6.
18. Hitchcott P.K., Quinn J.J., Taylor J.R. Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine. Cerebral Cortex 2007, 17:2820-2827.
19. Holland P.C. Relations between Pavlovian-instrumental transfer and reinforcer devaluation. Journal of Experimental Psychology: Animal Behavior Processes 2004, 30:104-117.
20. Hull C.L. Principles of behavior 1943, Appleton-Century-Crofts, New York.
21. Killcross A.S., Coutureau E. Coordination of actions and habits in the medial prefrontal cortex of rats. Cerebral Cortex 2003, 13:400-408.
22. Pearce J.M., Hall G. The influence of context-reinforcer associations on instrumental performance. Animal Learning and Behavior 1979, 7:504-508.
23. Tanaka S.C., Balleine B.W., O'Doherty J.P. Calculating consequences: Brain systems that encode the causal effects of actions. Journal of Neuroscience 2008, 28:6750-6755.
24. Thorndike E.L. Animal intelligence: Experimental studies 1911, Macmillan, New York.
25. Yin H.H., Knowlton B.J., Balleine B.B. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. European Journal of Neuroscience 2004, 19:181-189.
26. Yin H.H., Ostlund S.B., Knowlton B.J., Balleine B.W. The role of the dorsomedial striatum in instrumental conditioning. European Journal of Neuroscience 2005, 22:513-523.