Evidence of action sequence chunking in goal-directed instrumental conditioning and its dependence on the dorsomedial prefrontal cortex

Journal of Neuroscience

Volumn 29, Issue 25, 2009, Pages 8280-8287

  Ostlund, Sean B ^a,d   Winterbauer, Neil E ^b   Balleine, Bernard W ^c,d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF VERMONT   (United States)

^c UNIVERSITY OF SYDNEY   (Australia)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; CONTROLLED STUDY; DISCRIMINATIVE STIMULUS; FEMALE; GOAL ATTAINMENT; LEARNING; NONHUMAN; OUTCOME ASSESSMENT; PREFRONTAL CORTEX; PRIORITY JOURNAL; RAT; TASK PERFORMANCE;

ANIMALS; ASSOCIATION LEARNING; BEHAVIOR, ANIMAL; BRAIN INJURIES; CHOICE BEHAVIOR; CONDITIONING, CLASSICAL; DISCRIMINATION LEARNING; EXCITATORY AMINO ACID AGONISTS; FEMALE; MICROINJECTIONS; N-METHYLASPARTATE; PREFRONTAL CORTEX; RATS; RATS, LONG-EVANS; REACTION TIME;

EID: 67649342617     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1176-09.2009     Document Type: Article

References (38)

1. Bachá-Méndez G, Reid AK, Mendoza-Soylovna A (2007) Resurgence of integrated behavioral units. J Exp Anal Behav 87:5-24.
2. Bailey KR, Mair RG (2007) Effects of frontal cortex lesions on action sequence learning in the rat. Eur J Neurosci 25:2905-2915. (Pubitemid 46888825)
3. Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37:407-419. (Pubitemid 28306930)
4. Botvinick M, Plaut DC (2004) Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. Psychol Rev 111:395-429. (Pubitemid 38516423)
5. Colwill RM (1994) Associative representations of instrumental contingencies. Psychol Learn Motiv 31:1-72.
6. Cooper RP, Shallice T (2006) Hierarchical schemas and goals in the control of sequential behavior. Psychol Rev 113:887-916. (Pubitemid 44637069)
7. Corbit LH, Muir JL, Balleine BW (2003) Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats. Eur J Neurosci 18:1286-1294. (Pubitemid 37115047)
8. Deiber MP, Honda M, Ibañez V, Sadato N, Hallett M (1999) Mesial motor areas in self-initiated versus externally triggered movements examined with fMRI: effect of movement type and rate. J Neurophysiol 81:3065-3077. (Pubitemid 29283959)
9. Dickinson A, Balleine BW (1994) Motivational control of goal-directed action. Learn Behav 22:1-18. (Pubitemid 24054214)
10. Donoghue JP, Wise SP (1982) The motor cortex of the rat: cytoarchitecture and microstimulation mapping. J Comp Neurol 212:76-88. (Pubitemid 13208310)
11. Eccles JC (1982) The initiation of voluntary movements by the supplementary motor area. Arch Psychiatr Nervenkr 231:423-441.
12. Floresco SB, Ghods-Sharifi S (2007) Amygdala-prefrontal cortical circuitry regulates effort-based decision making. Cereb Cortex 17:251-260. (Pubitemid 46052764)
13. Goldberg G (1985) Supplementary motor area structure and function: review and hypotheses. Behav Brain Sci 8:567-615.
14. Graybiel AM (2008) Habits, rituals, and the evaluative brain. Annu Rev Neurosci 31:359-387.
15. Hoshi E, Tanji J (2004) Differential roles of neuronal activity in the supplementary and presupplementary motor areas: from information retrieval to motor planning and execution. J Neurophysiol 92:3482-3499. (Pubitemid 39506325)
16. Jenkins IH, Jahanshahi M, Jueptner M, Passingham RE, Brooks DJ (2000) Self-initiated versus externally triggered movements. II. The effect of movement predictability on regional cerebral blood flow. Brain 123:1216-1228.
17. Kennerley SW, Sakai K, Rushworth MFS (2004) Organization of action sequences and the role of the pre-SMA. J Neurophysiol 91:978-993. (Pubitemid 38168865)
18. Lashley KS (1951) The problem of serial order in behavior. In: Cerebral mechanisms in behavior (Jefferies LA, ed), pp 112-136. New York: Wiley.
19. Miller GA, Galanter E, Pribram KH (1960) Plans and the structure of behavior. New York: Holt, Rinehart and Winston.
20. Minsky M (1961) Steps toward artificial intelligence. Proc IRE 49:8-30.
21. Ostlund SB, Balleine BW (2007) Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome. Learn Behav 35:43-52. (Pubitemid 46854750)
22. Passingham RE (1993) The frontal lobes and voluntary action. Oxford, UK: Oxford UP.
23. Passingham RE, Myers C, Rawlins N, Lightfoot V, Fearn S (1988) Premotor cortex in the rat. Behav Neurosci 102:101-109. (Pubitemid 18208122)
24. Paxinos G, Watson C (1998) The rat brain in stereotaxic coordinates, Ed 4. San Diego: Academic.
25. Ray JP, Price JL (1992) The organization of the thalamocortical connections of the mediodorsal thalamic nucleus in the rat, related to the ventral forebrain-prefrontal cortex topography. J Comp Neurol 323:167-197.
26. Reed P, Morgan TA (2006) Resurgence of response sequences during extinction in rats shows a primacy effect. J Exp Anal Behav 86:307-315. (Pubitemid 44917005)
27. Reep RL, Corwin JV (1999) Topographic organization of the striatal and thalamic connections of rat medial agranular cortex. Brain Res 841:43-52. (Pubitemid 29440998)
28. Roesch MR, Olson CR (2004) Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304:307-310. (Pubitemid 38452186)
29. Rosenbaum DA, Kenny SB, Derr MA (1983) Hierarchical control of rapid movement sequences. J Exp Psychol Hum Percept Perform 9:86-102.
30. Rushworth MF, Walton ME, Kennerley SW, Bannerman DM (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8:410-8417. (Pubitemid 39179904)
31. Sakai K, Ramnani N, Passingham RE (2002) Learning of sequences of finger movements and timing: frontal lobe and action-oriented representation. J Neurophysiol 88:2035-2046. (Pubitemid 35191201)
32. Staddon JER, Zhang Y (1991) On the assignment-of-credit problem in operant learning. In: Quantitative analyses of behavior: neural network models of conditioning and action (Commons ML, Grossberg S, and Staddon JER, eds), pp 279-293. Hillsdale, NJ: Erlbaum.
33. Tanji J (2001) Sequential organization of multiple movements: involvement of cortical motor areas. Annu Rev Neurosci 24:631-651. (Pubitemid 32695241)
34. Terrace HS (2005) The simultaneous chain: a new approach to serial learning. Trends Cogn Sci 9:202-210. (Pubitemid 40543256)
35. Thaler D, Chen Nixon PD, Stern CE, Passingham RE (1995) The functions of the medial premotor cortex. I. Simple learned movements. Exp Brain Res 102:445-460.
36. Walton ME, Bannerman DM, Rushworth MFS (2002) The role of rat medial frontal cortex in effort-based decision making. J Neurosci 22:10996-11003. (Pubitemid 36005176)
37. Yin HH, Ostlund SB, Knowlton BJ, Balleine BW (2005) The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22:513-523. (Pubitemid 41097624)
38. Yin HH, Ostlund SB, Balleine BW (2008) Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of corticobasal ganglia networks. Eur J Neurosci 28:1437-1448.