Human EEG uncovers latent generalizable rule structure during learning

Journal of Neuroscience

Volumn 34, Issue 13, 2014, Pages 4677-4685

  Collins, Anne G E ^a   Cavanagh, James F ^a,b   Frank, Michael J ^a  

^a BROWN UNIVERSITY   (United States)

^b UNIVERSITY OF NEW MEXICO   (United States)

Author keywords

EEG; Prefrontal cortex; Reinforcement learning; Rules; Task set

Indexed keywords

ARTICLE; BEHAVIOR; BRAIN DEPTH STIMULATION; ELECTROENCEPHALOGRAPH ELECTRODE; ELECTROENCEPHALOGRAPHY; EVENT RELATED POTENTIAL; FEMALE; HUMAN; HUMAN EXPERIMENT; LATENT PERIOD; LEARNING; LEARNING DISORDER; MALE; NERVE CELL NETWORK; NORMAL HUMAN; PATTERN RECOGNITION; PREFRONTAL CORTEX; PREMOTOR CORTEX; PRIORITY JOURNAL; REINFORCEMENT; SIMULATION; TASK PERFORMANCE; TEMPORAL CORTEX; TOPOGRAPHY;

EEG; PREFRONTAL CORTEX; REINFORCEMENT LEARNING; RULES; TASK-SET;

BRAIN MAPPING; COLOR PERCEPTION; COMPUTER SIMULATION; CUES; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; LEARNING; MALE; MODELS, BIOLOGICAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PREFRONTAL CORTEX; REACTION TIME;

EID: 84897881519     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3900-13.2014     Document Type: Article

References (37)

1. Badre D, D'Esposito M (2007) Functional magnetic resonance imaging evidence for a hierarchical organization of the prefrontal cortex. J Cogn Neurosci 19:2082-2099. CrossRef Medline
2. Badre D, Kayser AS, D'Esposito M (2010) Frontal cortex and the discovery of abstract action rules. Neuron 66:315-326. CrossRef Medline
3. Badre D, Frank MJ (2012) Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits: 2. Evidence from f MRI. Cereb Cortex 22: 527-536. CrossRef Medline
4. Bunge S, Wallis JD, Parker A, Brass M, Crone EA, Hoshi E, Sakai K (2005) Neural circuitry underlying rule use in humans and nonhuman primates. J Neurosci 25:10347-10350. CrossRef Medline
5. Cavanagh JF, Cohen MX, Allen JJ (2009) Prelude to and resolution of an error: EEG phase synchrony reveals cognitive control dynamics during action monitoring. J Neurosci 29:98-105. CrossRef Medline
6. Cohen MX (2011) Error-related medial frontal theta activity predicts cingulate-related structural connectivity. Neuroimage 55:1373-1383. CrossRef Medline
7. Cole MW, Etzel JA, Zacks JM, Schneider W, Braver TS (2011) Rapid transfer of abstract rules to novel contexts in human lateral prefrontal cortex. Front Hum Neurosci 5:142. Medline
8. Collins A, Koechlin E (2012) Reasoning, learning, and creativity: frontal lobe function and human decision-making. PLo S Biol 10:e1001293. CrossRef Medline
9. Collins AG, Frank MJ (2012) How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis. Eur J Neurosci 35:1024-1035. CrossRef Medline
10. Collins AG, Frank MJ (2013) Cognitive control over learning: creating, clustering, and generalizing task-set structure. Psychol Rev 120:190-229. CrossRef Medline
11. Delorme A, Makeig S (2004) EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods 134:9-21. CrossRef Medline
12. Elchlepp H, Rumball F, Lavric A (2013) A brain-potential correlate of taskset conflict. Psychophysiology 50:314-323. CrossRef Medline
13. Frank MJ, Loughry B, O'Reilly RC (2001) Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn Affect Behav Neurosci 1:137-160. CrossRef Medline
14. Frank MJ, Badre D (2012) Mechanisms of hierarchical reinforcement learning in corticostriatal circuits: 1. Computational analysis. Cereb Cortex 22:509-526. CrossRef Medline
15. Gladwin TE, Lindsen JP, de Jong R (2006) Pre-stimulus EEG effects related to response speed, task switching and upcoming response hand. Biol Psychol 72:15-34. CrossRef Medline
16. Haynes JD, Sakai K, Rees G, Gilbert S, Frith C, Passingham RE (2007) Reading hidden intentions in the human brain. Curr Biol 17:323-328. CrossRef Medline
17. Hyafil A, Summerfield C, Koechlin E (2009) Two mechanisms for task switching in the prefrontal cortex. J Neurosci 29:5135-5142. CrossRef Medline
18. Jamadar S, Michie PT, Karayanidis F (2010) Sequence effects in cued task switching modulate response preparedness and repetition priming processes. Psychophysiology 47:365-386. CrossRef Medline
19. Karayanidis F, Jamadar S, Ruge H, Phillips N, Heathcote A, Forstmann BU (2010) Advance preparation in task switching: converging evidence from behavioral, brain activation, and model-based approaches. Front Psychol 1:25. CrossRef Medline
20. Karayanidis F, Mansfield EL, Galloway KL, Smith JL, Provost A, Heathcote A (2009) Anticipatory reconfiguration elicited by fully and partially informative cues that validly predict a switch in task. Cogn Affect Behav Neurosci 9:202-215. CrossRef Medline
21. Koechlin E, Ody C, Kouneiher F (2003) The architecture of cognitive control in the human prefrontal cortex. Science 302:1181-1185. CrossRef Medline
22. Li L, Wang M, Zhao QJ, Fogelson N (2012) Neural mechanisms underlying the cost of task switching: an ERP study. Plo S One 7:e42233. CrossRef Medline
23. Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex. Annu Rev Neurosci 24:167-202. CrossRef Medline
24. Miller EK (2000) The prefrontal cortex and cognitive control. Nat Rev Neurosci 1:59-65. CrossRef Medline
25. Monsell S (2003) Task switching. Trends Cogn Sci 7:134-140. CrossRef Medline
26. Nessler D, Friedman D, Johnson R Jr (2012) A new account of the effect of probability on task switching: ERP evidence following the manipulation of switch probability, cue informativeness and predictability. Biol Psychol 91:245-262. CrossRef Medline
27. Nicholson R, Karayanidis F, Poboka D, Heathcote A, Michie PT (2005) Electrophysiological correlates of anticipatory task switching processes. Psychophysiology 42:540-554. CrossRef Medline
28. Nicholson R, Karayanidis F, Bumak E, Poboka D, Michie PT (2006) ERPs dissociate the effects of switching task sets and task cues. Brain Res 1095: 107-123. CrossRef Medline
29. Pascual-Marqui RD (2002) Standardized low-resolution brain electromagnetic tomography (s LORETA): technical details. Methods Find Exp Clin Pharmacol 24 [Suppl D]:5-12.
30. Reverberi C, Görgen K, Haynes JD (2012) Compositionality of rule representations in human prefrontal cortex. Cereb Cortex 22:1237-1246. CrossRef Medline
31. Rushworth MF, Passingham RE, Nobre AC (2005) Components of attentional set-switching. Exp Psychol 52:83-98. CrossRef Medline
32. Sjöstrand K, Clemmensen LH, Larsen R, Ersbøll B (2012) Spa SM: a Matlab toolbox for sparse statistical modeling. J Statist Software.
33. Swainson R, Cunnington R, Jackson GM, Rorden C, Peters AM, Morris PG, Jackson SR (2003) Cognitive control mechanisms revealed by ERP and f MRI: evidence from repeated task switching. J Cogn Neurosci 15:785-799. CrossRef Medline
34. Woolgar A, Hampshire A, Thompson R, Duncan J (2011a) Adaptive coding of task-relevant information in human frontoparietal cortex. J Neurosci 31:14592-14599. CrossRef Medline
35. Woolgar A, Thompson R, Bor D, Duncan J (2011b) Multi-voxel coding of stimuli, rules, and responses in human frontoparietal cortex. Neuroimage 56:744-752. CrossRef Medline
36. Wylie GR, Murray MM, Javitt DC, Foxe JJ (2009) Distinct neurophysiological mechanisms mediate mixing costs and switch costs. J Cogn Neurosci 21:105-118. CrossRef Medline
37. Yeung N, Botvinick MM, Cohen JD (2004) The neural basis of error detection: conflict monitoring and the error-related negativity. Psychol Rev 111:931-959. CrossRef Medline