Frontostriatal mechanisms in instruction-based learning as a hallmark of flexible goal-directed behavior

Frontiers in Psychology

Volumn 3, Issue JUN, 2012, Pages

  Wolfensteller, Uta ^a   Ruge, Hannes ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Basal ganglia; Ideomotor theory; Instruction; Instrumental learning; Prefrontal cortex; Premotor cortex

Indexed keywords

EID: 84867130062     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00192     Document Type: Article

References (128)

1. Alexander, G. E., DeLong, M. R., and Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu.Rev.Neurosci.9, 357-381.
2. Antzoulatos, E. G., and Miller, E. K. (2011). Differences between neural activity in prefrontal cortex and striatum during learning of novel abstract categories. Neuron 71, 243-249.
3. Ashby, F. G., Turner, B. O., and Horvitz, J. C. (2010). Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn. Sci. 14, 208-215.
4. Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., and O'Reilly, R. C. (2007). Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nat. Neurosci. 10, 126-131.
5. Balleine, B. W., Liljeholm, M., and Ostlund, S. B. (2009). The integrative function of the basal ganglia in instrumental conditioning. Behav. Brain Res. 199, 43-52.
6. Balleine, B. W., and O'Doherty, J. P. (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychophar-macology 35, 48-69.
7. Boettiger, C. A., and D'Esposito, M. (2005). Frontal networks for learning and executing arbitrary stimulus-response associations. J. Neurosci. 25, 2723-2732.
8. Brasted, P. J., and Wise, S. P. (2004). Comparison of learningrelated neuronal activity in the dorsal premotor cortex and striatum. Eur. J. Neurosci. 19, 721-740.
9. Brovelli, A., Laksiri, N., Nazarian, B., Meunier, M., and Boussaoud, D. (2008). Understanding the neural computations of arbitrary visuomotor learning through fMRI and associative learning theory. Cereb. Cortex 18, 1485-1495.
10. Brovelli, A., Nazarian, B., Meunier, M., and Boussaoud, D. (2011). Differential roles of caudate nucleus and putamen during instrumental learning. Neuroimage 57, 1580-1590.
11. Buch, E. R., Brasted, P. J., and Wise, S. P. (2006). Comparison of population activity in the dorsal premotor cortex and putamen during the learning of arbitrary visuomotor mappings. Exp. Brain Res. 169, 69-84.
12. Bugmann, G. (2012). Modeling fast stimulus-response association learning along the occipito-parietofrontal pathway following rule instructions. Brain Res. 1434, 73-89.
13. Butz, M. V., and Hoffmann, J. (2002). Anticipations control behavior: animal behavior in an anticipatory learning classifier system. Adapt. Behav. 10, 75-96.
14. Cisek, P. (2007). Cortical mechanisms of action selection:the affordance competition hypothesis. Philos. Trans. R. Soc. Lond. B Biol. Sci. 362, 1585-1599.
15. Cisek, P., and Kalaska, J. F. (2004). Neural correlates of mental rehearsal in dorsal premotor cortex. Nature 431, 993-996.
16. Cisek, P., and Kalaska, J. F. (2005). Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron 45, 801-814.
17. Cohen-Kdoshay, O., and Meiran, N. (2007). The representation of instructions in working memory leads to autonomous response activation: evidence from the first trials in the flanker paradigm. Q. J. Exp. Psychol. 60, 1140-1154.
18. Cohen-Kdoshay, O., and Meiran, N. (2009). The representation of instructions operates like a prepared reflex. Exp. Psychol. 56, 128-133.
19. Cole, M. W., Bagic, A., Kass, R., and Schneider, W. (2010). Prefrontal dynamics underlying rapid instructed task learning reverse with practice. J. Neurosci. 30, 14245-14254.
20. Colwill, R. M., and Rescorla, R. A. (1985). Postconditioning devaluation of a reinforcer affects instrumental responding. J. Exp. Psychol. Anim. Behav. Process. 11, 120-132.
21. Colwill, R. M., and Rescorla, R. A. (1986). "Associative structures in instrumental learning," in The Psychology of Learning and Motivation, Vol. 20, ed G. H. Bower (Orlando, FL: Academic Press), 55-104.
22. Colwill, R. M., and Rescorla, R. A. (1990). Effect of reinforcer devaluation on discriminative control of instrumental behavior. J. Exp. Psychol. Anim. Behav. Process. 16, 40-47
23. Cools, R., Clark, L., Owen, A. M., and Robbins, T. W. (2002). Defining the neural mechanisms of probabilistic reversal learning using eventrelated functional magnetic resonance imaging. J. Neurosci. 22, 4563-4567.
24. Cromer, J. A., Machon, M., and Miller, E. K. (2011). Rapid association learning in the primate prefrontal cortex in the absence of behavioral reversals. J. Cogn. Neurosci. 23, 1823-1828.
25. Daniel, R., and Pollmann, S. (2010). Comparing the neural basis of monetary reward and cognitive feedback during informationintegration category learning. J. Neurosci. 30, 47-55.
26. Daniel, R., and Pollmann, S. (2012). Striatal activations signal prediction errors on confidence in the absence of external feedback. Neuroimage 59, 3457-3467.
27. Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., and Dolan, R. J. (2011). Model-based influences on humans' choices and striatal prediction errors. Neuron 69, 1204-1215.
28. de Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., and Fletcher, P. C. (2009). Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J. Neurosci. 29, 11330-11338.
29. de Wit, S., and Dickinson, A. (2009). Associative theories of goal-directed behaviour: a case for animal-human translational models. Psychol. Res. 73, 463-476.
30. Dickinson, A., Campos, J., Varga, Z. I., and Balleine, B. (1996). Bidirectional instrumental conditioning. Q. J. Exp. Psychol. B 49, 289-306.
31. Dickinson, A., and Shanks, D. (1995). "Instrumental action and causal representation," in Causal Cognition, edsD.Sperber, D.Premack, and A. J. Premack (London: Clarendon Press), 5-25.
32. Doll, B. B., Hutchison, K. E., and Frank, M. J. (2011). Dopaminergic genes predict individual differences in susceptibility to confirmation bias. J. Neurosci. 31, 6188-6198
33. Doll, B. B., Jacobs, W. J., Sanfey, A. G., and Frank, M. J. (2009). Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Res. 1299, 74-94.
34. Dumontheil, I., Thompson, R., and Duncan, J. (2011). Assembly and use of new task rules in frontoparietal cortex. J. Cogn. Neurosci. 23, 168-182.
35. Duncan, J., Emslie, H., Williams, P., Johnson, R., and Freer, C. (1996). Intelligence and the frontal lobe: the organization of goal-directed behavior. Cogn. Psychol. 30, 257-303.
36. Duncan, J., Parr, A., Woolgar, A., Thompson, R., Bright, P., Cox, S., Bishop, S., and Nimmo-Smith, I. (2008). Goal neglect and Spearman's g: competing parts of a complex task. J. Exp. Psychol. Gen. 137, 131-148.
37. Eliassen, J. C., Souza, T., and Sanes, J. N. (2003). Experience-dependent activation patterns in human brain during visual-motor associative learning. J. Neurosci. 23, 10540-10547.
38. Elsner, B., and Hommel, B. (2001). Effect anticipation and action control. J. Exp. Psychol. Hum. Percept. Perform. 27, 229-240.
39. Elsner, B., and Hommel, B. (2004). Contiguity and contingency in actioneffect learning. Psychol. Res. 68, 138-154.
40. Elsner, B., Hommel, B., Mentschel, C., Drzezga, A., Prinz, W., Conrad, B., and Siebner, H. (2002). Linking actions and their perceivable consequences in the human brain. Neuroimage 17, 364-372.
41. Frank, M. J. (2011). Computational models of motivated action selection in corticostriatal circuits. Curr. Opin. Neurobiol. 21, 381-386.
42. Frank, M. J., and Badre, D. (2012). Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. Cereb. Cortex 22, 509-526.
43. Frank, M. J., Cohen, M. X., and Sanfey, A. G. (2009). Multiple systems in decision making: a neurocomputational perspective. Curr. Dir. Psychol. Sci. 18, 73-77.
44. Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., and Poldrack, R. A. (2010). Neural components underlying behavioral flexibility in human reversal learning. Cereb. Cortex 20, 1843-1852.
45. Glascher, J., Daw, N., Dayan, P., and O'Doherty, J. P. (2010). States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66, 585-595.
46. Grahn, J. A., Parkinson, J. A., and Owen, A. M. (2009). The role of the basal ganglia in learning and memory: neuropsychological studies. Behav. Brain Res. 199, 53-60.
47. Greenwald, A. G. (1970a). A choice reaction time test of ideomotor theory. J. Exp. Psychol. 86, 20-25.
48. Greenwald, A. G. (1970b). Sensory feedback mechanisms in performance control: with special reference to the ideo-motor mechanism. Psychol. Rev. 77, 73-99.
49. Hadj-Bouziane, F., Frankowska, H., Meunier, M., Coquelin, P. A., and Boussaoud, D. (2006). Conditional visuo-motor learning and dimension reduction. Cogn. Process. 7, 95-104.
50. Harless, E. (1861). Der Apparat des Willens. Zeitschrift für Philosophie und philosophische Kritik 38, 50-73.
51. Hartstra, E., Kuhn, S., Verguts, T., and Brass, M. (2011). The implementation of verbal instructions: an fMRI study. Hum. Brain Mapp. 32, 1811-1824.
52. Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., and Kawato, M. (2004). A neural correlate of rewardbased behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. J. Neurosci. 24, 1660-1665.
53. Herwig, A., and Waszak, F. (2009). Intention and attention in ideomotor learning. Q. J. Exp. Psychol. 62, 219-227.
54. Hoffmann, J., Berner, M., Butz, M. V., Herbort, O., Kiesel, A., Kunde, W., and Lenhard, A. (2007). Explorations of anticipatory behavioral control (ABC): a report from the cognitive psychology unit of the University of Wurzburg. Cogn. Process. 8, 133-142.
55. Hommel, B. (2000). "The prepared reflex: automaticity and control in stimulus-response translation," in Control of Cognitive Processes: Attention and Performance XVIII, eds S. Monsell and J. Driver (Cambridge, MA: MIT Press), 247-273.
56. Hommel, B. (2004). Event files: feature binding in and across perception and action. Trends Cogn. Sci. (Regul. Ed.) 8, 494-500
57. Hommel, B., Musseler, J., Aschersleben, G., and Prinz, W. (2001). The Theory of Event Coding (TEC): a framework for perception and action planning. Behav. Brain Sci. 24, 849-878; discussion 878-937.
58. James, W. (1890). The Principles of Psychology, Vol. 2. London: Macmillan. Jenkins, I. H., Jahanshahi, M., Jueptner, M., Passingham, R. E., and Brooks, D. J. (2000). Self-initiated versus externally triggered movements. II. The effect of movement predictability on regional cerebral blood flow. Brain 123(Pt 6), 1216-1228.
59. Killcross, S., and Coutureau, E. (2003). Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex 13, 400-408.
60. Kühn, S., Seurinck, R., Fias, W., and Waszak, F. (2010). The internal anticipation of sensory action effects: when action induces FFA and PPA activity. Front. Hum. Neurosci. 4:54. doi:10.3389/fnhum.2010.00054
61. Kunde, W. (2001). Response-effect compatibility in manual choice reaction tasks. J. Exp. Psychol. Hum. Percept. Perform. 27, 387-394.
62. Kurata, K., and Wise, S. P. (1988). Premotor cortex of rhesus monkeys: set-related activity during two conditional motor tasks. Exp. Brain Res. 69, 327-343.
63. Lau, H. C., Rogers, R. D., and Passingham, R. E. (2006). Dissociating response selection and conflict in the medial frontal surface. Neuroimage 29, 446-451.
64. Lau, H. C., Rogers, R. D., Ramnani, N., and Passingham, R. E. (2004). Willed action and attention to the selection of action. Neuroimage 21, 1407-1415.
65. Law, J. R., Flanery, M. A., Wirth, S., Yanike, M., Smith, A. C., Frank, L. M., Suzuki, W. A., Brown, E. N., and Stark, C. E. (2005). Functional magnetic resonance imaging activity during the gradual acquisition and expression of paired-associate memory. J. Neurosci. 25, 5720-5729.
66. Lhermitte, F., Pillon, B., and Serdaru, M. (1986). Human autonomy and the frontal lobes. Part I: imitation and utilization behavior: a neuropsychological study of 75 patients. Ann. Neurol. 19, 326-334.
67. Li, J., Delgado, M. R., and Phelps, E. A. (2011). How instructed knowledge modulates the neural systems of reward learning. Proc. Natl. Acad. Sci. U.S.A. 108, 55-60.
68. Lotze, R. H. (1852). Medicinische Psychologie oder Physiologie der Seele. Leipzig: Weidmannsche Buchhandlung.
69. Luria, A. R. (1973). The Working Brain: An Introduction to Neuropsychology. New York: Basic Books.
70. Mattfeld, A. T., Gluck, M. A., and Stark, C. E. (2011). Functional specialization within the striatum along both the dorsal/ventral and anterior/posterior axes during associative learning via reward and punishment. Learn. Mem. 18, 703-711.
71. Mattfeld, A. T., and Stark, C. E. L. (2011). Striatal and medial temporal lobe functional interactions during visuomotor associative learning. Cereb. Cortex 21, 647-658.
72. Meiran, N., and Cohen-Kdoshay, O. (2012). Working memory load but not multitasking eliminates the prepared reflex: further evidence from the adapted flanker paradigm. Acta Psychol. (Amst.) 139, 309-313.
73. Melcher, T., Weidema, M., Eenshuistra, R. M., Hommel, B., and Gruber, O. (2008). The neural substrate of the ideomotor principle: an eventrelated fMRI analysis. Neuroimage 39, 1274-1288.
74. Miller, E. K., and Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annu.Rev.Neurosci. 24, 167-202.
75. Mitz, A. R., Godschalk, M., and Wise, S. P. (1991). Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations. J. Neurosci. 11, 1855-1872.
76. Mok, L. W., and Overmier, J. B. (2007). The differential outcomes effect in normal human adults using a concurrent-task within-subjects design and sensory outcomes. Psychol. Rec. 57, 187-200.
77. Monsell, S. (1996). "Control of mental processes," in Unsolved Mysteries of the Mind, ed. V. Bruce (Hove: Erlbaum/Taylor and Francis), 93-148.
78. Montojo, C. A., and Courtney, S. M. (2008). Differential neural activation for updating rule versus stimulus information in working memory. Neuron 59, 173-182
79. Mueller, V. A., Brass, M., Waszak, F., and Prinz, W. (2007). The role of the preSMA and the rostral cingulate zone in internally selected actions. Neuroimage 37, 1354-1361.
80. Nachev, P., and Husain, M. (2010). Action and the fallacy of the "internal": comment on Passingham et al. Trends Cogn. Sci. 14, 192-193.
81. Nattkemper, D., Ziessler, M., and Frensch, P. A. (2010). Binding in voluntary action control. Neurosci. Biobe-hav. Rev. 34, 1092-1101.
82. Noonan, M. P., Mars, R. B., and Rushworth, M. F. S. (2011). Distinct roles of three frontal cortical areas in reward-guided behavior. J. Neurosci. 31, 14399-14412.
83. Oberauer, K. (2009). Design for a working memory. Psychol. Learn. Motiv. 51, 45-100.
84. Obhi, S. S. (2012). The troublesome distinction between selfgenerated and externally triggered action: a commentary on Schuur and Haggard. Conscious. Cogn. 21, 587-588.
85. O'Doherty, J. P., Dayan, P., Schultz, J., Deichmann, R., Friston, K., and Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304, 452-454.
86. Passingham, R. E., Bengtsson, S. L., and Lau, H. C. (2010). Medial frontal cortex: from self-generated action to reflection on one's own performance. Trends Cogn. Sci. 14, 16-21.
87. Pastor-Bernier, A., and Cisek, P. (2011). Neural correlates of biased competition in premotor cortex. J. Neurosci. 31, 7083-7088.
88. Pasupathy, A., and Miller, E. K. (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433, 873-876.
89. Pennartz, C. M., Ito, R., Verschure, P. F., Battaglia, F. P., and Robbins, T. W. (2011). The hippocampal-striatal axis in learning, prediction and goaldirected behavior. Trends Neurosci. 34, 548-559.
90. Petrides, M. (1985). Deficits on conditional associative-learning tasks after frontaland temporal-lobe lesions in man. Neuropsychologia 23, 601-614.
91. Petrides, M. (1997). Visuo-motor conditional associative learning after frontal and temporal lesions in the human brain. Neuropsychologia 35, 989-997.
92. Pfister, R., and Janczyk, M. (2011). Harless'apparatus of will: 150 years later. Psychol. Res. doi: 10.1007/s00426-011-0362-3. [Epub ahead of print]. Pfister, R., Kiesel, A., and Hoffmann, J. (2011). Learning at any rate: actioneffect learning for stimulus-based actions. Psychol. Res. 75, 61-65.
93. Ramamoorthy, A., and Verguts, T. (2012). Word and deed: a computational model of instruction following. Brain Res. 1439, 54-65.
94. Ruge, H., Muller, S. C., and Braver, T. S. (2010). Anticipating the consequences of action: an fMRI study of intention-based task preparation. Psychophysiology 47, 1019-1027.
95. Ruge, H., and Wolfensteller, U. (2010). Rapid formation of pragmatic rule representations in the human brain during instruction-based learning. Cereb. Cortex 20, 1656-1667.
96. Schuur, F., and Haggard, P. (2011). What are self-generated actions? Conscious. Cogn. 20, 1697-1704.
97. Schuur, F., and Haggard, P. (2012). On capturing the essence of self-generated action: a reply to Obhi (2012). Conscious. Cogn. 21, 1070-1071.
98. Shin, Y. K., Proctor, R. W., and Capaldi, E. J. (2010). A review of contemporary ideomotor theory. Psychol. Bull. 136, 943-974.
99. Souza, A. S., Oberauer, K., Gade, M., and Druey, M. D. (2012). Processing of representations in declarative and procedural working memory. Q. J. Exp. Psychol. 65, 1006-1033.
100. Stadler, W., Ott, D. V., Springer, A., Schubotz, R. I., Schutz-Bosbach, S., and Prinz, W. (2012). Repetitive TMS suggests a role of the human dorsal premotor cortex in action prediction. Front. Hum. Neurosci. 6, 20.
101. Stadler, W., Schubotz, R. I., von Cramon, D. Y., Springer, A., Graf, M., and Prinz, W. (2011). Predicting and memorizing observed action: differential premotor cortex involvement. Hum. Brain Mapp. 32, 677-687.
102. Stalnaker, T. A., Calhoon, G. G., Ogawa, M., Roesch, M. R., and Schoenbaum, G. (2010). Neural correlates of stimulus-response and response-outcome associations in dorsolateral versus dorsomedial striatum. Front. Integr. Neurosci. 4:12. doi:10.3389/fnint.2010.00012
103. Stock, A., and Stock, C. (2004). A short history of ideo-motor action. Psy-chol. Res. 68, 176-188.
104. Tanaka, S. C., Balleine, B. W., and O'Doherty, J. P. (2008). Calculating consequences: brain systems that encode the causal effects of actions. J. Neurosci. 28, 6750-6755.
105. Thorn, C. A., Atallah, H., Howe, M., and Graybiel, A. M. (2010). Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 66, 781-795.
106. Thorndike, E. L. (1911). Animal Intelligence. New York: Macmillan.
107. Tkach, D., Reimer, J., and Hatsopoulos, N. G. (2007). Congruent activity during action and action observation in motor cortex. J. Neurosci. 27, 13241-13250.
108. Toni, I., Thoenissen, D., and Zilles, K. (2001). Movement preparation and motor intention. Neuroimage 14(1 Pt 2), S110-S117.
109. Trapold, M. A. (1970). Are expectancies based upon different positive reinforcing events discriminably different. Learn. Motiv. 1, 129-140.
110. Tricomi, E. M., Balleine, B. W., and O'Doherty, J. P. (2009). A specific role for posterior dorsolateral striatum in human habit learning. Eur. J. Neurosci. 29, 2225-2232.
111. Tricomi, E. M., Delgado, M. R., and Fiez, J.A. (2004). Modulation of caudate activity by action contingency. Neuron 41, 281-292.
112. Urcuioli, P. J. (2005). Behavioral and associative effects of differential outcomes in discrimination learning. Learn. Behav. 33, 1-21.
113. Valentin, V. V., Dickinson, A., and O'Doherty, J. P. (2007). Determining the neural substrates of goaldirected learning in the human brain. J. Neurosci. 27, 4019-4026.
114. van der Meer, M. A. A., and Redish, A. D. (2010). Expectancies in decision making, reinforcement learning, and ventral striatum. Front. Neurosci. 4:6. doi:10.3389/neuro.01.006.2010
115. Voorn, P., Vanderschuren, L. J., Groenewegen, H. J., Robbins, T. W., and Pennartz, C. M. (2004). Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci. 27, 468-474.
116. Vriezen, E. R., and Moscovitch, M. (1990). Memory for temporal order and conditional associative-learning in patients with Parkinson's disease. Neuropsychologia 28, 1283-1293.
117. Wager, T. D., and Smith, E. E. (2003). Neuroimaging studies of working memory: a meta-analysis. Cogn. Affect. Behav. Neurosci. 3, 255-274.
118. Walsh, M. M., and Anderson, J. R. (2011). Modulation of the feedbackrelated negativity by instruction and experience. Proc. Natl. Acad. Sci. U.S.A. 108, 19048-19053.
119. Waszak, F., Cardoso-Leite, P., and Hughes, G. (2012). Action effect anticipation: neurophysiological basis and functional consequences. Neurosci. Biobehav. Rev. 36, 943-959.
120. Waszak, F., Wenke, D., and Brass, M. (2008). Cross-talk of instructed and applied arbitrary visuomotor mappings. Acta Psychol. (Amst.) 127, 30-35.
121. Wenke, D., Gaschler, R., and Nattkemper, D. (2007). Instruction-induced feature binding. Psychol. Res. 71, 92-106.
122. Wolfensteller, U., and Ruge, H. (2011). On the timescale of stimulus-based action-effect learning. Q. J. Exp. Psychol. 64, 1273-1289.
123. Wolfensteller, U., Schubotz, R. I., and von Cramon, D. Y. (2004). "What" becoming "where": functional magnetic resonance imaging evidence for pragmatic relevance driving premotor cortex. J. Neurosci. 24, 10431-10439.
124. Wood, W., and Neal, D. T. (2007). A new look at habits and the habit-goal interface. Psychol. Rev. 114, 843-863.
125. Yin, H. H., and Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464-476.
126. Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci. 19, 181-189.
127. Yin, H. H., Ostlund, S. B., Knowlton, B. J., and Balleine, B. W. (2005). The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci. 22, 513-523.
128. Ziessler, M., Nattkemper, D., and Frensch, P. A. (2004). The role of anticipation and intention in the learning of effects of self-performed actions. Psychol. Res. 68, 163-175.