A spiking neural integrator model of the adaptive control of action by the medial prefrontal cortex

Journal of Neuroscience

Volumn 34, Issue 5, 2014, Pages 1892-1902

  Bekolay, Trevor ^a   Laubach, Mark ^b   Eliasmith, Chris ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

^b YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Adaptive control; Delayed response RT task; mPFC; Neural dynamics; Neural engineering framework; Neural integrator

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; BRAIN FUNCTION; DYNAMICS; LEARNING; MALE; MEDIAL PREFRONTAL CORTEX; NERVE CELL NETWORK; NONHUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; RAT; REACTION TIME; SIMULATION; SPIKE WAVE; TASK PERFORMANCE;

ADAPTIVE CONTROL; DELAYED RESPONSE RT TASK; MPFC; NEURAL DYNAMICS; NEURAL ENGINEERING FRAMEWORK; NEURAL INTEGRATOR;

ACOUSTIC STIMULATION; ACTION POTENTIALS; ADAPTATION, PHYSIOLOGICAL; ANIMALS; COMPUTER SIMULATION; CONDITIONING, OPERANT; MALE; MODELS, NEUROLOGICAL; NERVE NET; NEURONS; PREDICTIVE VALUE OF TESTS; PREFRONTAL CORTEX; PRINCIPAL COMPONENT ANALYSIS; RATS; RATS, LONG-EVANS; REACTION TIME; REWARD;

EID: 84893078955     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2421-13.2014     Document Type: Article

References (46)

1. Aarts E, Roelofs A, van Turennout M (2008) Anticipatory activity in anterior cingulate cortex can be independent of conflict and error likelihood. J Neurosci 28: 4671-4678. CrossRef Medline
2. Aarts E, Roelofs A, van Turennout M (2009) Attentional control of task and response in lateral and medial frontal cortex: brain activity and reaction time distributions. Neuropsychologia 47: 2089-2099. CrossRef Medline
3. Alexander WH, Brown JW (2011) Medial prefrontal cortex as an actionoutcome predictor. Nat Neurosci 14: 1338-1344. CrossRef Medline
4. Amiez C, Joseph JP, Procyk E (2005) Anterior cingulate error-related activity is modulatedbypredicted reward. Eur J Neurosci 21: 3447-3452. CrossRefMedline
5. Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10: 1214-1221. CrossRef Medline
6. Bekolay T, Bergstra J, Hunsberger E, DeWolf T, Stewart TC, Rasmussen D, Choo X, Voelker A, Eliasmith C (2014) Nengo: a Python tool for building large-scale functional brain models. Front Neuroinform 7: 48. CrossRef
7. Botvinick MM, Cohen JD, Carter CS (2004) Conflict monitoring and anterior cingulate cortex: an update. Trends Cogn Sci 8: 539-546. CrossRef Medline
8. Brown JW, Braver TS (2005) Learned predictions of error likelihood in the anterior cingulate cortex. Science 307: 1118-1121. CrossRef Medline
9. Carracedo LM, Kjeldsen H, Cunnington L, Jenkins A, Schofield I, Cunningham MO, Davies CH, Traub RD, Whittington MA (2013) A neocortical delta rhythm facilitates reciprocal interlaminar interactions via nested theta rhythms. J Neurosci 33: 10750-10761. CrossRef Medline
10. Carter CS, Braver TS, Barch DM, Botvinick MM, Noll D, Cohen JD (1998) Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280: 747-749. CrossRef Medline
11. Cavanagh JF, Cohen MX, Allen JJ (2009) Prelude to and resolution of an error: EEG phase synchrony reveals cognitive control dynamics during action monitoring. J Neurosci 29: 98-105. CrossRef Medline
12. Critchley HD, Mathias CJ, Josephs O, O'Doherty J, Zanini S, Dewar BK, Cipolotti L, Shallice T, Dolan RJ (2003) Human cingulate cortex and autonomic control: converging neuroimaging and clinical evidence. Brain 126: 2139-2152. CrossRef Medline
13. Delatour B, Gisquet-Verrier P (2001) Involvement of the dorsal anterior cingulate cortex in temporal behavioral sequencing: subregional analysis of the medial prefrontal cortex in rat. Behav Brain Res 126: 105-114. CrossRef Medline
14. Eliasmith C (2005) A unified approach to building and controlling spiking attractor networks. Neural Comput 17: 1276-1314. CrossRef Medline
15. Eliasmith C, Anderson CH (2003) Neural engineering: computation, representation, and dynamics in neurobiological systems. Cambridge, MA: MIT.
16. Fecteau JH, Munoz DP (2003) Exploring the consequences of the previous trial. Nat Rev Neurosci 4: 435-443. CrossRef Medline
17. Georgopoulos AP, Schwartz AB, Kettner RE (1986) Neuronal population coding of movement direction. Science 233: 1416-1419. CrossRef Medline
18. Histed MH, Pasupathy A, Miller EK (2009) Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron 63: 244-253. CrossRef Medline
19. Horst NK, Laubach M (2012) Working with memory: evidence for a role for the medial prefrontal cortex in performance monitoring during spatial delayed alternation. J Neurophysiol 108: 3276-3288. CrossRef Medline
20. Hyman JM, Whitman J, Emberly E, Woodward TS, Seamans JK (2013) Action and outcome activity state patterns in the anterior cingulate cortex. Cereb Cortex 23: 1257-1268. CrossRef Medline
21. Khamassi M, Enel P, Dominey PF, Procyk E (2013) Medial prefrontal cortex and the adaptive regulation of reinforcement learning parameters. Prog Brain Res 202: 441-464. CrossRef Medline
22. Koch C (1998) Biophysics of computation: information processing in single neurons. Oxford: Oxford UP.
23. Koyama T, Kato K, Tanaka YZ, Mikami A (2001) Anterior cingulate activity during pain-avoidance and reward tasks in monkeys. Neurosci Res 39: 421-430. CrossRef Medline
24. Laubach M (2011) A comparative perspective on executive and motivational control by the medial prefrontal cortex. In: Neural basis of motivational and cognitive control (Mars RB, Sallet J, Rushworth MFS, Yeung N, eds), pp. 95. Cambridge, MA: MIT.
25. Laubach M, Wessberg J, Nicolelis MA (2000) Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task. Nature 405: 567-571. CrossRef Medline
26. Luu P, Posner MI (2003) Anterior cingulate cortex regulation of sympathetic activity. Brain 126: 2119-2120. CrossRef Medline
27. MacNeil D, Eliasmith C (2011) Fine-tuning and the stability of recurrent neural networks. PLoS ONE 6: e22885. CrossRef Medline
28. Medalla M, Barbas H (2009) Synapses with inhibitory neurons differentiate anterior cingulate from dorsolateral prefrontal pathways associated with cognitive control. Neuron 61: 609-620. CrossRef Medline
29. Modirrousta M, Fellows LK (2008) Dorsal medial prefrontal cortex plays a necessary role in rapid error prediction in humans. J Neurosci 28: 14000-14005. CrossRef Medline
30. Muir JL, Everitt BJ, Robbins TW (1996) The cerebral cortex of the rat and visual attentional function: dissociable effects of mediofrontal, cingulate, anterior dorsolateral, and parietal cortex lesions on a five-choice serial reaction-time task. Cereb Cortex 6: 470-481. CrossRef Medline
31. Mulert C, Gallinat J, Dorn H, Herrmann WM, Winterer G (2003) The relationship between reaction time, error rate and anterior cingulate cortex activity. Int J Psychophysiol 47: 175-183. CrossRef Medline
32. Naito E, Kinomura S, Geyer S, Kawashima R, Roland PE, Zilles K (2000) Fast reaction to different sensory modalities activates common fields in the motor areas, but the anterior cingulate cortex is involved in the speed of reaction. J Neurophysiol 83: 1701-1709. Medline
33. Narayanan NS, Laubach M (2006) Top-down control of motor cortex ensembles by dorsomedial prefrontal cortex. Neuron 52: 921-931. CrossRef Medline
34. Narayanan NS, Laubach M (2008) Neuronal correlates of post-error slowing in the rat dorsomedial prefrontal cortex. J Neurophysiol 100: 520-525. CrossRef Medline
35. Narayanan NS, Laubach M (2009) Delay activity in rodent frontal cortex during a simple reaction-time task. J Neurophysiol 101: 2859-2871. CrossRef Medline
36. Narayanan NS, Cavanagh JF, Frank MJ, Laubach M (2013) Common medial frontal mechanisms of adaptive control in humans and rodents. Nat Neurosci 16: 1888-1895. CrossRef Medline
37. Niv Y, Schoenbaum G (2008) Dialogues on prediction errors. Trends Cogn Sci 12: 265-272. CrossRef Medline
38. Risterucci C, Terramorsi D, Nieoullon A, Amalric M (2003) Excitotoxic lesions of the prelimbicinfralimbic areas of the rodent prefrontal cortex disrupt motor preparatory processes. Eur J Neurosci 17: 1498-1508. CrossRef Medline
39. Rushworth MF, Walton ME, Kennerley SW, Bannerman DM (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8: 410-417. CrossRef Medline
40. Salinas E, Abbott LF (1994) Vector reconstruction from firing rates. J Comput Neurosci 1: 89-107. CrossRef Medline
41. Seung HS (1996) How the brain keeps the eyes still. Proc Natl Acad Sci U S A 93: 13339-13344. CrossRef Medline
42. Shadlen MN, Newsome WT (2001) Neural basis of a perceptual decision in the parietal cortex (area lip) of the rhesus monkey. J Neurophysiol 86: 1916-1936. Medline
43. Sheth SA, Mian MK, Patel SR, Asaad WF, Williams ZM, Dougherty DD, Bush G, Eskandar EN (2012) Human dorsal anterior cingulate cortex neurons mediate ongoing behavioural adaptation. Nature 488: 218-221. CrossRef Medline
44. Singh R, Eliasmith C (2006) Higher-dimensional neurons explain the tuning and dynamics of working memory cells. J Neurosci 26: 3667-3678. CrossRef Medline
45. van Veen V, Holroyd CB, Cohen JD, Stenger VA, Carter CS (2004) Errors without conflict: implications for performance monitoring theories of anterior cingulate cortex. Brain Cogn 56: 267-276. CrossRef Medline
46. Wang XJ (2002) Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36: 955-968. CrossRef Medline