Towards an understanding of the neural dynamics of intentional learning: Considering the timescale

NeuroImage

Volumn 142, Issue , 2016, Pages 668-673

  Ruge, Hannes ^a   Wolfensteller, Uta ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ANTERIOR CAUDATE; BOLD SIGNAL; CAUDATE NUCLEUS; CAUSAL MODELING; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; INSTRUCTIONAL LEARNING; INTENTIONAL LEARNING; LATERAL PREFRONTAL CORTEX; LEARNING; NERVE CELL NETWORK; NEUROIMAGING; NOTE; PRIORITY JOURNAL; REINFORCEMENT; SHORT TERM MEMORY; TRIAL AND ERROR LEARNING; VENTRAL STRIATUM; DIAGNOSTIC IMAGING; FRONTAL LOBE; FUNCTIONAL NEUROIMAGING; NEOSTRIATUM; PHYSIOLOGY; PROCEDURES;

FRONTAL LOBE; FUNCTIONAL NEUROIMAGING; HUMANS; LEARNING; NEOSTRIATUM;

EID: 84994000456     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2016.06.006     Document Type: Note

References (63)

1. Ashby, F.G., Turner, B.O., Horvitz, J.C., Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn. Sci. 14 (2010), 208–215.
2. Bedard, P., Sanes, J.N., On a basal ganglia role in learning and rehearsing visual-motor associations. NeuroImage 47 (2009), 1701–1710.
3. Bellebaum, C., Kobza, S., Thiele, S., Daum, I., It was not my fault: event-related brain potentials in active and observational learning from feedback. Cereb. Cortex 20 (2010), 2874–2883.
4. Boettiger, C.A., D'Esposito, M., Frontal networks for learning and executing arbitrary stimulus-response associations. J. Neurosci. 25 (2005), 2723–2732.
5. Brass, M., Wenke, D., Spengler, S., Waszak, F., Neural correlates of overcoming interference from instructed and implemented stimulus-response associations. J. Neurosci. 29 (2009), 1766–1772.
6. Brovelli, A., Laksiri, N., Nazarian, B., Meunier, M., Boussaoud, D., Understanding the neural computations of arbitrary visuomotor learning through fMRI and associative learning theory. Cereb. Cortex 18 (2008), 1485–1495.
7. Brovelli, A., Nazarian, B., Meunier, M., Boussaoud, D., Differential roles of caudate nucleus and putamen during instrumental learning. NeuroImage 57 (2011), 1580–1590.
8. Bugmann, G., Modeling fast stimulus–response association learning along the occipito-parieto-frontal pathway following rule instructions. Brain Res. 1434 (2012), 73–89.
9. Cole, M.W., Bagic, A., Kass, R., Schneider, W., Prefrontal dynamics underlying rapid instructed task learning reverse with practice. J. Neurosci. 30 (2010), 14245–14254.
10. Cole, M.W., Laurent, P., Stocco, A., Rapid instructed task learning: a new window into the human brain's unique capacity for flexible cognitive control. Cogn. Affect. Behav. Neurosci. 13 (2013), 1–22.
11. Cole, M.W., Reynolds, J.R., Power, J.D., Repovs, G., Anticevic, A., Braver, T.S., Multi-task connectivity reveals flexible hubs for adaptive task control. Nat. Neurosci. 16 (2013), 1348–1355.
12. Cromer, J.A., Machon, M., Miller, E.K., Rapid association learning in the primate prefrontal cortex in the absence of behavioral reversals. J. Cogn. Neurosci. 23 (2011), 1823–1828.
13. De Houwer, J., Vandorpe, S., Beckers, T., On the role of controlled cognitive processes in human associative learning. Wills, A., (eds.) New Directions in Human Associative Learning, 2005, Lawrence Erlbaum, Mahwah, NJ, 41–63.
14. Dolan, R.J., Dayan, P., Goals and habits in the brain. Neuron 80 (2013), 312–325.
15. Doll, B.B., Jacobs, W.J., Sanfey, A.G., Frank, M.J., Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Res. 1299 (2009), 74–94.
16. Dumontheil, I., Thompson, R., Duncan, J., Assembly and use of new task rules in fronto-parietal cortex. J. Cogn. Neurosci. 23 (2011), 168–182.
17. Duncan, J., Emslie, H., Williams, P., Johnson, R., Freer, C., Intelligence and the frontal lobe: the organization of goal-directed behavior. Cogn. Psychol. 30 (1996), 257–303.
18. Eliassen, J.C., Souza, T., Sanes, J.N., Experience-dependent activation patterns in human brain during visual-motor associative learning. J. Neurosci. 23 (2003), 10540–10547.
19. Eliassen, J.C., Lamy, M., Allendorfer, J.B., Boespflug, E., Bullard, D.P., Smith, M.S., Lee, J.H., Strakowski, S.M., Selective role for striatal and prefrontal regions in processing first trial feedback during single-trial associative learning. Brain Res. 1458 (2012), 56–66.
20. Ghahremani, D.G., Monterosso, J., Jentsch, J.D., Bilder, R.M., Poldrack, R.A., Neural components underlying behavioral flexibility in human reversal learning. Cereb. Cortex 20 (2010), 1843–1852.
21. Glascher, J., Daw, N., Dayan, P., O'Doherty, J.P., States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66 (2010), 585–595.
22. Hampshire, A., Chaudhry, A.M., Owen, A.M., Roberts, A.C., Dissociable roles for lateral orbitofrontal cortex and lateral prefrontal cortex during preference driven reversal learning. NeuroImage 59 (2012), 4102–4112.
23. Hampshire, A., Hellyer, P.J., Parkin, B., Hiebert, N., MacDonald, P., Owen, A.M., Leech, R., Rowe, J., Network mechanisms of intentional learning. NeuroImage 127 (2016), 123–134.
24. Hartstra, E., Kuhn, S., Verguts, T., Brass, M., The implementation of verbal instructions: an fMRI study. Hum. Brain Mapp. 32 (2011), 1811–1824.
25. Hiebert, N.M., Vo, A., Hampshire, A., Owen, A.M., Seergobin, K.N., MacDonald, P.A., Striatum in stimulus-response learning via feedback and in decision making. NeuroImage 101 (2014), 448–457.
26. Huang, T.-R., Hazy, T.E., Herd, S.A., O'Reilly, R.C., Assembling old tricks for new tasks: a neural model of instructional learning and control. J. Cogn. Neurosci., 1–9, 2013.
27. Isbaine, F., Demolliens, M., Belmalih, A., Brovelli, A., Boussaoud, D., Learning by observation in the macaque monkey under high experimental constraints. Behav. Brain Res., 2015.
28. Kim, H.F., Hikosaka, O., Parallel basal ganglia circuits for voluntary and automatic behaviour to reach rewards. Brain 138 (2015), 1776–1800.
29. Law, J.R., Flanery, M.A., Wirth, S., Yanike, M., Smith, A.C., Frank, L.M., Suzuki, W.A., Brown, E.N., Stark, C.E., Functional magnetic resonance imaging activity during the gradual acquisition and expression of paired-associate memory. J. Neurosci. 25 (2005), 5720–5729.
30. Lee, S.W., O'Doherty, J.P., Shimojo, S., Neural computations mediating one-shot learning in the human brain. PLoS Biol., 13, 2015, e1002137.
31. Levine, M.A., CognitiveTheory of Learning. 1975, Lawrence Erlbaum, Hillsdale, NJ.
32. Li, J., Delgado, M.R., Phelps, E.A., How instructed knowledge modulates the neural systems of reward learning. Proc. Natl. Acad. Sci. 108 (2011), 55–60.
33. Liefooghe, B., Houwer, J., Wenke, D., Instruction-based response activation depends on task preparation. Psychon. Bull. Rev., 1-7, 2013.
34. Liu, Z., Braunlich, K., Wehe, H.S., Seger, C.A., Neural networks supporting switching, hypothesis testing, and rule application. Neuropsychologia 77 (2015), 19–34.
35. Luria, A.R., The Working Brain: An Introduction to Neuropsychology. 1973, Basic Books, New York.
36. Mattfeld, A.T., Stark, C.E., Striatal and medial temporal lobe functional interactions during visuomotor associative learning. Cereb. Cortex 21 (2011), 647–658.
37. Meiran, N., Pereg, M., Kessler, Y., Cole, M.W., Braver, T.S., The power of instructions: proactive configuration of stimulus-response translation. J. Exp. Psychol. Learn. Mem. Cogn. 41 (2015), 768–786.
38. Monfardini, E., Brovelli, A., Boussaoud, D., Takerkart, S., Wicker, B., I learned from what you did: retrieving visuomotor associations learned by observation. NeuroImage 42 (2008), 1207–1213.
39. Monsell, S., Control of mental processes. Bruce, V., (eds.) Unsolved Mysteries of the Mind, 1996, Erlbaum/Taylor and Francis, Hove, UK, 93–148.
40. Monsell, S., Driver, J., Control of Cognitive Processes: Attention and Performance XVIII. 2000, MIT Press, Cambridge, Mass.
41. Noelle, D.C., A Connectionist Model of Instructed Learning. 1997, University of California, San Diego.
42. Norman, D.A., Shallice, T., Attention to action: willed and automatic control of behavior. Davidson, R.J., Schwartz, G.E., Shapiro, D., (eds.) Consciousness and Self-regulation, 1986, Plenum Press, 1–18.
43. Olsson, A., Phelps, E.A., Learned fear of “unseen” faces after Pavlovian, observational, and instructed fear. Psychol. Sci. 15 (2004), 822–828.
44. Passingham, R.E., Rowe, J.B., Sakai, K., Has brain imaging discovered anything new about how the brain works?. NeuroImage 66 (2013), 142–150.
45. Pasupathy, A., Miller, E.K., Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433 (2005), 873–876.
46. Petrides, M., Visuo-motor conditional associative learning after frontal and temporal lesions in the human brain. Neuropsychologia 35 (1997), 989–997.
47. Rachman, S., The conditioning theory of fear-acquisition: a critical examination. Behav. Res. Ther. 15 (1977), 375–387.
48. Ramamoorthy, A., Verguts, T., Word and deed: a computational model of instruction following. Brain Res. 1439 (2012), 54–65.
49. Ruge, H., Wolfensteller, U., Rapid formation of pragmatic rule representations in the human brain during instruction-based learning. Cereb. Cortex 20 (2010), 1656–1667.
50. Ruge, H., Wolfensteller, U., Functional integration processes underlying the instruction-based learning of novel goal-directed behaviors. NeuroImage 68 (2013), 162–172.
51. Ruge, H., Wolfensteller, U., Distinct fronto-striatal couplings reveal the double-faced nature of response-outcome relations in instruction-based learning. Cogn. Affect. Behav. Neurosci. 15 (2015), 349–364.
52. Ruge, H., Jamadar, S., Zimmermann, U., Karayanidis, F., The many faces of preparatory control in task switching: reviewing a decade of fMRI research. Hum. Brain Mapp. 34 (2013), 12–35.
53. Rushworth, M.F.S., Behrens, T.E.J., Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 11 (2008), 389–397.
54. Sakai, K., Task set and prefrontal cortex. Annu. Rev. Neurosci. 31 (2008), 219–245.
55. Schultz, W., Dayan, P., Montague, P.R., A neural substrate of prediction and reward. Science 275 (1997), 1593–1599.
56. Seger, C.A., Cincotta, C.M., Dynamics of frontal, striatal, and hippocampal systems during rule learning. Cereb. Cortex 16 (2006), 1546–1555.
57. Seger, C.A., Spiering, B.J., A critical review of habit learning and the Basal Ganglia. Front. Syst. Neurosci., 5, 2011, 66.
58. Stocco, A., Lebiere, C., O'Reilly, R., Anderson, J., Distinct contributions of the caudate nucleus, rostral prefrontal cortex, and parietal cortex to the execution of instructed tasks. Cogn. Affect. Behav. Neurosci. 12 (2012), 611–628.
59. Tanaka, S., Pan, X., Oguchi, M., Taylor, J.E., Sakagami, M., Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum. Front. Psychol., 6, 2015, 995.
60. Toni, I., Ramnani, N., Josephs, O., Ashburner, J., Passingham, R.E., Learning arbitrary visuomotor associations: temporal dynamic of brain activity. NeuroImage 14 (2001), 1048–1057.
61. Waszak, F., Wenke, D., Brass, M., Cross-talk of instructed and applied arbitrary visuomotor mappings. Acta Psychol. 127 (2008), 30–35.
62. Wenke, D., Frensch, P.A., The influence of task instruction on action coding: constraint setting or direct coding?. J. Exp. Psychol. Hum. Percept. Perform. 31 (2005), 803–819.
63. Wolfensteller, U., Ruge, H., Frontostriatal mechanisms in instruction-based learning as a hallmark of flexible goal-directed behavior. Front. Psychol., 3, 2012, 192.