Premotor cortex is critical for goal-directed actions

Frontiers in Computational Neuroscience

Volumn , Issue AUG, 2013, Pages

  Gremel, Christina M ^a   Costa, Rui M ^a,b  

^a NATIONAL INSTITUTE ON ALCOHOL ABUSE AND ALCOHOLISM   (United States)

^b CHAMPALIMAUD CENTRE FOR THE UNKNOWN   (Portugal)

Author keywords

Action selection; Goal directed actions; Habitual actions; Premotor cortex; Value based decision making

Indexed keywords

ACTION SELECTION; GOAL-DIRECTED; HABITUAL ACTIONS; PREMOTOR CORTEX; VALUE-BASED;

ACTIVATION ANALYSIS; REINFORCEMENT;

MAMMALS;

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; BRAIN DAMAGE; BRAIN FUNCTION; COMPARATIVE STUDY; CONTROLLED STUDY; GOAL DIRECTED ACTION; HABIT; LEARNING; MALE; MOTOR ACTIVITY; MOUSE; NEUROPHYSIOLOGY; NONHUMAN; OUTCOME ASSESSMENT; PREMOTOR CORTEX; REINFORCEMENT; REWARD; SENSITIVITY ANALYSIS; SYSTEMATIC ERROR; TASK PERFORMANCE;

EID: 84884683777     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncom.2013.00110     Document Type: Article

References (40)

1. Adams, C. D. (1982). Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q. J. Exp. Psychol. B 34, 77-98. doi: 10.1080/14640748208400878
2. Adams, C. D., and Dickinson, A. (1981). Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol. B 33, 109-121. doi: 10.1080/14640748108400816
3. Balleine, B. W., and O'Doherty, J. P. (2009). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35, 48-69. doi: 10.1038/npp.2009.131
4. Balleine, B. W., and Ostlund, S. B. (2007). Still at the choice-point: action selection and initiation in instrumental conditioning. Ann. NY Acad. Sci. 1104, 147-171. doi: 10.1196/annals.1390.006
5. Colwill, R. M., and Rescorla, R. A. (1985). Postconditioning devaluation of a reinforcer affects instrumental responding. J. Exp. Psychol. Anim. Behav. Process. 11, 120-132. doi: 10.1037//0097-7403.11.1.120
6. Colwill, R. M., and Rescorla, R. A. (1986). The Psychology of Learning and Motivation, ed G. Bower (New York: Academic), 55-104.
7. Corbit, L. (2003). The role of prelimbic cortex in instrumental conditioning. Behav. Brain Res. 146, 145-157. doi: 10.1016/j.bbr.2003.09.023
8. Corbit, L. H., Muir, J. L., and Balleine, B. W. (2003). Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats. Eur. J. Neurosci. 18, 1286-1294. doi: 10.1046/j.1460-9568.2003.02833.x
9. Derusso, A. L. (2010). Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement. Front. Integr. Neurosci. 4:17. doi: 10.3389/fnint.2010.00017
10. Dezfouli, A., and Balleine, B. W. (2012). Habits, action sequences and reinforcement learning. Eur. J. Neurosci. 35, 1036-1051. doi: 10.1111/j.1460-9568.2012.08050.x
11. Dickinson, A. (1985). Actions and habits: the development of behavioral autonomy. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 308, 67-78. doi: 10.1098/rstb.1985.0010
12. Dickinson, A., and Balleine, B. (1994). Motivational control of goal-directed action. Anim. Learn. Behav. 22, 1-18. doi: 10.3758/bf03199951
13. Dickinson, A., Nicholas, D., and Adams, C. D. (1983). The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. Q. J. Exp. Psychol. B 35, 35-51. doi: 10.1080/14640748308400912
14. Dove, A., Pollmann, S., Schubert, T., Wiggins, C. J., and von Cramon, D. Y. (2000). Prefrontal cortex activation in task switching: an event-related fMRI study. Brain. Res. Cogn. Brain Res. 9, 103-109. doi: 10.1016/s0926-6410(99)00029-4
15. Gremel, C. M., and Costa, R. M. (2013). Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nat. Commun. 4:2264. doi: 10.1038/ncomms3264
16. Hilário, M. R. (2007). Endocannabinoid signaling is critical for habit formation. Front. Integr. Neurosci. 1:6. doi: 10.3389/neuro.07.006. 2007
17. Hilario, M., Holloway, T., Jin, X., and Costa, R. M. (2012). Different dorsal striatum circuits mediate action discrimination and action generalization. Eur. J. Neurosci. 35, 1105-1114. doi: 10.1111/j.1460-9568.2012.08073.x
18. Hoover, W. B., and Vertes, R. P. (2007). Anatomical analysis of afferent projections to the medial prefrontal cortex in the rat. Brain Struct. Funct. 212, 149-179. doi: 10.1007/s00429-007-0150-4
19. Hoover, W. B., and Vertes, R. P. (2011). Projections of the medial orbital and ventral orbital cortex in the rat. J. Comp. Neurol. 519, 3766-3801. doi: 10.1002/cne.22733
20. Hoshi, E., and Tanji, J. (2004). Differential roles of neuronal activity in the supplementary and pre-supplementary motor areas: from information retrieval to motor planning and execution. J. Neurophysiol. 92, 3482-3499. doi: 10.1152/jn.00547.2004
21. Isoda, M., and Hikosaka, O. (2007). Switching from automatic to controlled action by monkey medial frontal cortex. Nat. Neurosci. 10, 240-248. doi: 10.1038/nn1830
22. Killcross, S., and Coutureau, E. (2003). Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex 13, 400-408. doi: 10.1093/cercor/13.4.400
23. Matsuzaka, Y., and Tanji, J. (1996). Changing directions of forthcoming arm movements: neuronal activity in the presupplementary and supplementary motor area of monkey cerebral cortex. J. Neurophysiol. 76, 2327-2342.
24. Mitchell, B. D., and Macklis, J. D. (2005). Large-scale maintenance of dual projections by callosal and frontal cortical projection neurons in adult mice. J. Comp. Neurol. 482, 17-32. doi: 10.1002/cne.20428
25. Obeso, I., Robles, N., Marrón, E. M., and Redolar-Ripoll, D. (2013). Dissociating the role of the pre-sma in response inhibition and switching: a combined online and offline TMS approach. Front. Hum. Neurosci. 7:150. doi: 10.3389/fnhum.2013.00150
26. Ostlund, S. B., Winterbauer, N. E., and Balleine, B. W. (2009). Evidence of action sequence chunking in goal-directed instrumental conditioning and its dependence on the dorsomedial prefrontal cortex. J. Neurosci. 29, 8280-8287. doi: 10.1523/jneurosci.1176-09.2009
27. Padoa-Schioppa, C., Li, C. S. R., and Bizzi, E. (2002). Neuronal correlates of kinematics-to-dynamics transformation in the supplementary motor area. Neuron 36, 751-765. doi: 10.1016/s0896-6273(02)01028-0
28. Pan, W. X., Mao, T., and Dudman, J. T. (2010). Frontiers: inputs to the dorsal striatum of the mouse reflect the parallel circuit architecture of the forebrain. Front. Neuroanat. 4:147. doi: 10.3389/fnana.2010.00147
29. Reep, R. L., Cheatwood, J. L., and Corwin, J. V. (2003). The associative striatum: organization of cortical projections to the dorsocentral striatum in rats. J. Comp. Neurol. 467, 271-292. doi: 10.1002/cne.10868
30. Reep, R. L., Corwin, J. V., Hashimoto, A., and Watson, R. T. (1984). Afferent connections of medial precentral cortex in the rat. Neurosci. Lett. 44, 247-252. doi: 10.1016/0304-3940(84)90030-2
31. Reep, R. L., Corwin, J. V., Hashimoto, A., and Watson, R. T. (1987). Efferent connections of the rostral portion of medial agranular cortex in rats. Brain Res. Bull. 19, 203-221. doi: 10.1016/0361-9230(87)90086-4
32. Rushworth, M. F. S., Hadland, K. A., Paus, T., and Sipila, P. K. (2002). Role of the human medial frontal cortex in task switching: a combined fMRI and TMS study. J. Neurophysiol. 87, 2577-2592.
33. Shima, K., Mushiake, H., Saito, N., and Tanji, J. (1996). Role for cells in the pre-supplementary motor area in updating motor plans. Proc. Nat. Acad. Sci. U S A 93, 8694-8698. doi: 10.1073/pnas.93.16.8694
34. Sul, J. H., Jo, S., Lee, D., and Jung, M. W. (2011). Role of rodent secondary motor cortex in value-based action selection. Nat. Neurosci. 14, 1202-1208. doi: 10.1038/nn.2881
35. Yin, H. H. (2009). The role of the murine motor cortex in action duration and order. Front. Integr. Neurosci. 3:23. doi: 10.3389/neuro.07.023.2009
36. Yin, H. H. (2010). The sensorimotor striatum is necessary for serial order learning. J. Neurosci. 30, 14719-14723. doi: 10.1523/jneurosci.3989-10.2010
37. Yin, H. H., and Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464-476. doi: 10.1038/nrn1919
38. Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci. 19, 181-189. doi: 10.1111/j.1460-9568.2004.03095.x
39. Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2006). Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav. Brain Res. 166, 189-196. doi: 10.1016/j.bbr.2005.07.012
40. Yin, H. H., Ostlund, S. B., Knowlton, B. J., and Balleine, B. W. (2005). The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci. 22, 513-523. doi: 10.1111/j.1460-9568.2005.04218.x