The influence of recent decisions on future goal selection

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 369, Issue 1655, 2014, Pages

  Genovesio, Aldo ^a   Ferraina, Stefano ^a  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Memory; Monkeys; Prefrontal cortex; Strategy

Indexed keywords

DECISION MAKING; ERROR ANALYSIS; LEARNING; LITERATURE REVIEW; MEMORY; NEUROLOGY; PRESERVATION; PRIMATE;

ANIMAL; DECISION MAKING; HUMAN; MEMORY; MOTIVATION; NERVE CELL; PHYSIOLOGY; PREFRONTAL CORTEX; RHESUS MONKEY;

ANIMALS; CHOICE BEHAVIOR; DECISION MAKING; GOALS; HUMANS; MACACA MULATTA; MEMORY; NEURONS; PREFRONTAL CORTEX;

EID: 84907487044     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2013.0477     Document Type: Article

References (82)

1. Ferraina S, Battaglia-Mayer A, Genovesio A, Marconi B, Onorati P, Caminiti R. 2001 Early coding of visuomanual coordination during reaching in parietal area PEc. J. Neurophysiol. 85, 462–467.
2. Genovesio A, Ferraina S. 2004 Integration of retinal disparity and fixation-distance related signals toward an egocentric coding of distance in the posterior parietal cortex of primates. J. Neurophysiol. 91, 2670–2684. (doi:10.1152/jn. 00712.2003)
3. Ferraina S, Brunamonti E, Giusti MA, Costa S, Genovesio A, Caminiti R. 2009 Reaching in depth: hand position and binocular eye position modulate reaching related activity in posterior parietal cortex. J. Neurosci. 29, 11461–11470. (doi:10.1523/JNEUROSCI.1305-09.2009)
4. Genovesio A, Brunamonti E, Giusti MA, Ferraina S. 2007 Post-saccadic activities in the posterior parietal cortex of primates are influenced by both eye movement vectors and eye position. J. Neurosci. 27, 3268–3273. (doi:10.1523/JNEUROSCI.5415-06.2007)
5. Mitz AR, Godschalk M, Wise SP. 1991 Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations. J. Neurosci. 11, 1855–1872.
6. Asaad WF, Rainer G, Miller EK. 1998 Neural activity in the primate prefrontal cortex during associative learning. Neuron 21, 1399–1407. (doi:10.1016/S0896-6273(00)80658-3)
7. Genovesio A, Brasted PJ, Mitz AR, Wise SP. 2005 Prefrontal cortex activity related to abstract response strategies. Neuron 47, 307–320. (doi:10.1016/j.neuron.2005.06.006)
8. Genovesio A, Mitz AR. 2007 MatOFF: a tool for analyzing behaviorally complex neurophysiological experiments. J. Neurosci. Methods 165, 38–48. (doi:10.1016/j.jneumeth.2007.05.026)
9. Histed MH, Pasupathy A, Miller EK. 2009 Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron 63, 244–253. (doi:10.1016/j.neuron.2009.06.019)
10. Barraclough DJ, Conroy ML, Lee D. 2004 Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 7, 404–410.(doi:10. 1038/nn1209)
11. Genovesio A, Brasted PJ, Wise SP. 2006 Representation of future and previous spatial goals by separate neural populations in prefrontal cortex. J. Neurosci. 26, 7305–7316. (doi:10.1523/JNEUROSCI.0699-06.200)
12. Sugrue LP, Corrado GS, Newsome WT. 2004 Matching behavior and the representation of value in the parietal cortex. Science 304, 1782–1787. (doi:10.1126/science.1094765)
13. Fecteau JH, Munoz DP. 2003 Exploring the consequences of the previous trial. Nat. Rev. Neurosci. 4, 435–443.(doi:10.1038/nrn1114)
14. Milner AD, Goodale MA. 2008 Two visual systems re-viewed. Neuropsychologia 46, 774–785.(doi:10. 1016/j.neuropsychologia.2007.10.005)
15. Passingham RE, Wise SP. 2012 The neurobiology of the prefrontal cortex: anatomy, evolution, and the origin of insight. Oxford, UK: Oxford University Press.
16. Fox E. 1995 Negative priming from ignored distractors in visual selection: a review. Psychon. Bull. Rev. 2, 145–173. (doi:10.3758/BF03210958)
17. Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD. 2001 Conflict monitoring and cognitive control. Psychol. Rev. 108, 624–652. (doi:10.1037/0033-295X.108.3.624)
18. Cherkasova MV, Manoach DS, Intriligator JM, Barton JJ. 2002 Antisaccades and task-switching: interactions in controlled processing. Exp. Brain Res. 144, 528–537. (doi:10.1007/s00221-002-1075-z)
19. Lee AK, Hämäläinen MS, Dyckman KA, Barton JJ, Manoach DS. 2011 Saccadic preparation in the frontal eye field is modulated by distinct trial history effects as revealed by magnetoencephalography. Cereb. Cortex 21, 245–253. (doi:10.1093/cercor/bhq057)
20. Manoach DS, Thakkar KN, Cain MS, Polli FE, Edelman JA, Fischl B, Barton JJ. 2007 Neural activity is modulated by trial history: a functional magnetic resonance imaging study of the effects of a previous antisaccade. J. Neurosci. 27, 1791-1798. (doi:10. 1523/JNEUROSCI.3662-06.2007)
21. Everling S, Dorris MC, Klein RM, Munoz DP. 1999 Role of primate superior colliculus in preparation and execution of anti-saccades and pro-saccades. J. Neurosci. 19, 2740–2754.
22. Everling S, Munoz DP. 2000 Neuronal correlates for preparatory set associated with pro-saccades and anti-saccades in the primate frontal eye field. J. Neurosci. 20, 387–400.
23. Selemon LD, Goldman-Rakic PS. 1988 Common cortical and subcortical targets of the dorsolateral prefrontal and posterior parietal cortices in the rhesus monkey: evidence for a distributed neural network subserving spatially guided behavior. J. Neurosci. 8, 4049–4068.
24. Logan GD, Cowan WB. 1984 On the ability to inhibit thought and action: a theory of an act of control. Psychol. Rev. 91, 295–327. (doi:10.1037/0033-295X.91.3.295)
25. Verbruggen F, Logan GD. 2008 Response inhibition in the stop-signal paradigm. Trends Cogn. Sci. 12, 418–424. (doi:10.1016/j.tics.2008.07.005)
26. Pouget P, Logan GD, Palmeri TJ, Boucher L, Pare´ M, Schall JD. 2011 Neural basis of adaptive response time adjustment during saccade countermanding. J. Neurosci. 31, 12604–12612. (doi:10.1523/JNEUROSCI.1868-11.2011)
27. Chen X, Scangos KW, Stuphorn V. 2010 Supplementary motor area exerts proactive and reactive control of arm movements. J. Neurosci. 30, 14657–14675. (doi:10.1523/JNEUROSCI.2669-10.2010)
28. Marcos E, Pani P, Brunamonti E, Deco G, Ferraina S, Verschure P. 2013 Neural variability in premotor cortex is modulated by trial history and predicts behavioral performance. Neuron 78, 249–255. (doi:10.1016/j.neuron.2013.02.006)
29. Brunamonti E, Chiricozzi FR, Clausi S, Olivito G, Giusti MA, Molinari M, Ferraina S, Leggio M. 2014 Cerebellar damage impairs executive control and monitoring of movement generation. PLoS ONE 9, e85997. (doi:10.1371/journal.pone.0085997)
30. Schall JD, Godlove DC. 2012 Current advances and pressing problems in studies of stopping. Curr. Opin. Neurobiol. 22, 1012–1021. (doi:10.1016/j.conb. 2012.06.002)
31. Greenhouse I, Oldenkamp CL, Aron AR. 2012 Stopping a response has global or nonglobal effects on the motor system depending on preparation. J. Neurophysiol. 107, 384–392. (doi:10.1152/jn. 00704.2011)
32. Emeric EE et al. 2007 Influence of history on saccade countermanding performance in humans and macaque monkeys. Vis. Res. 47, 35–49. (doi:10. 1016/j.visres.2006.08.032)
33. Rieger M, Gauggel S. 1999 Inhibitory after-effects in the stop signal paradigm. Br. J. Psychol. 90, 509–518. (doi:10.1348/000712699161585)
34. Kornylo K, Dill N, Saenz M, Krauzlis RJ. 2003 Cancelling of pursuit and saccadic eye movements in humans and monkeys. J. Neurophysiol. 89, 2984-2999. (doi:10.1152/jn.00859.2002)
35. Curtis CE, Cole MW, Rao VY, D’Esposito M. 2005 Canceling planned action: an fMRI study of countermanding saccades. Cereb. Cortex 15, 1281–1289. (doi:10.1093/cercor/bhi011)
36. Nelson MJ, Boucher L, Logan GD, Palmeri TJ, Schall JD. 2010 Nonindependent and nonstationary response times in stopping and stepping saccade tasks. Atten. Percept. Psychophys. 72, 1913–1929. (doi:10.3758/APP.72.7.1913)
37. Wurtz RH, Sommer MA, Pare´ M, Ferraina S. 2001 Signal transformations from cerebral cortex to superior colliculus for the generation of saccades. Vis. Res. 41, 3399–3412. (doi:10.1016/S0042-6989(01)00066-9)
38. Hanes DP, Schall JD. 1996 Neural control of voluntary movement initiation. Science 274, 427–430. (doi:10.1126/science.274.5286.427)
39. Paré M, Hanes DP. 2003 Controlled movement processing: superior colliculus activity associated with countermanded saccades. J. Neurosci. 23, 6480–6489.
40. Scangos KW, Stuphorn V. 2010 Medial frontal cortex motivates but does not control movement initiation in the countermanding task. J. Neurosci. 30, 1968–1982. (doi:10.1523/JNEUROSCI.4509-09.2010)
41. Mirabella G, Pani P, Ferraina S. 2011 Neural correlates of cognitive control of reaching movements in the dorsal premotor cortex of rhesus monkeys. J. Neurophysiol. 106, 1454–1466.(doi:10. 1152/jn.00995.2010)
42. Churchland AK, Kiani R, Chaudhuri R, Wang XJ, Pouget A, Shadlen MN. 2011 Variance as a signature of neural computations during decision making. Neuron 69, 818–831. (doi:10.1016/j.neuron.2010.12.037)
43. Bonnelle V, Ham TE, Leech R, Kinnunen KM, Mehta MA, Greenwood RJ, Sharp DJ. 2012 Salience network integrity predicts default mode network function after traumatic brain injury. Proc. Natl Acad. Sci. USA 109, 4690–4695. (doi:10.1073/pnas. 1113455109)
44. Jahfari S, Stinear CM, Claffey M, Verbruggen F, Aron AR. 2010 Responding with restraint: what are the neurocognitive mechanisms? J. Cogn. Neurosci. 22, 1479–1492. (doi:10.1162/jocn.2009.21307)
45. Jaffard M, Longcamp M, Velay JL, Anton JL, Roth M, Nazarian B, Boulinguez P. 2008 Proactive inhibitory control of movement assessed by event-related fMRI. Neuroimage 42, 1196–1206. (doi:10.1016/j.neuroimage.2008.05.041)
46. van Vreeswijk C, Sompolinsky H. 1996 Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274, 1724–1726. (doi:10.1126/science.274.5293.1724)
47. Rainer G, Rao SC, Miller EK. 1999 Prospective coding for objects in primate prefrontal cortex. J. Neurosci. 19, 5493–5505.
48. Saito N, Mushiake H, Sakamoto K, Itoyama Y, Tanji J. 2005 Representation of immediate and final behavioral goals in the monkey prefrontal cortex during an instructed delay period. Cereb. Cortex 15, 1535–1546. (doi:10.1093/cercor/bhi032)
49. Genovesio A, Tsujimoto S, Wise SP. 2012 Encoding goals but not abstract magnitude in the primate prefrontal cortex. Neuron 74, 656–662. (doi:10. 1016/j.neuron.2012.02.023)
50. Yamagata T, Nakayama Y, Tanji J, Hoshi E. 2012 Distinct information representation and processing for goal-directed behavior in the dorsolateral and ventrolateral prefrontal cortex and the dorsal premotor cortex. J. Neurosci. 2, 12934–12949. (doi:10.1523/JNEUROSCI.2398-12.2012)
51. Arimura N, Nakayama Y, Yamagata T, Tanji J, Hoshi E. 2013 Involvement of the globus pallidus in behavioral goal determination and action specification. J. Neurosci. 33, 13639–13653. (doi:10.1523/JNEUROSCI.1620-13.2013)
52. Hoshi E. 2013 Cortico-basal ganglia networks subserving goal-directed behavior mediated by conditional visuo-goal association. Front. Neural Circuits 7, 158. (doi:10.3389/fncir.2013.00158)
53. Padoa-Schioppa C, Assad JA. 2006 Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223–226. (doi:10.1038/nature04676)
54. Genovesio A, Wise SP, Passingham RE. 2014 Prefrontal–parietal function: from foraging to foresight. Trends Cogn. Sci. 18, 72–81. (doi:10. 1016/j.tics.2013.11.007)
55. Genovesio A, Tsujimoto S, Wise SP. 2009 Feature-and order-based timing representations in the frontal cortex. Neuron 63, 254–266. (doi:10.1016/j.neuron.2009.06.018)
56. Genovesio A, Tsujimoto S, Wise SP. 2011 Prefrontal cortex activity during the discrimination of relative distance. J. Neurosci. 31, 3968–3980. (doi:10.1523/JNEUROSCI.5373-10.2011)
57. Diester I, Nieder A. 2007 Semantic associations between signs and numerical categories in the prefrontal cortex. PLoS Biol. 5, e294. (doi:10.1371/journal.pbio.0050294)
58. Tsujimoto S, Sawaguchi T. 2004 Neuronal representation of response-outcome in the primate prefrontal cortex. Cereb. Cortex 14, 47–55. (doi:10. 1093/cercor/bhg090)
59. Funahashi S, Bruce CJ, Goldman-Rakic PS. 1989 Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex. J. Neurophysiol. 61, 331–349.
60. Wilson FA, Scalaidhe SP, Goldman-Rakic PS. 1993 Dissociation of object and spatial processing domains in primate prefrontal cortex. Science 260, 1955–1958. (doi:10.1126/science.8316836)
61. Donahue CH, Seo H, Lee D. 2013 Cortical signals for rewarded actions and strategic exploration. Neuron 80, 223–234. (doi:10.1016/j.neuron.2013. 07.040)
62. Warden MR, Miller EK. 2007 The representation of multiple objects in prefrontal neuronal delay activity. Cereb. Cortex 17(Suppl. 1), 141–150. (doi:10.1093/cercor/bhm070)
63. Genovesio A, Tsujimoto S, Wise SP. 2008 Encoding problem-solving strategies in prefrontal cortex: activity during strategic errors. Eur. J. Neurosci. 27, 984–990. (doi:10.1111/j.1460-9568.2008. 06048.x)
64. Einstein GO, McDaniel MA, Manzi M, Cochran B, Baker M. 2000 Prospective memory and aging: forgetting intentions over short delays. Psychol. Aging 15, 671–683. (doi:10.1037/0882-7974. 15.4.671)
65. Marsh RL, Hicks JL, Hancock TW, Munsayac K. 2002 Investigating the output monitoring component of event-based prospective memory performance. Mem. Cogn. 30, 302–311. (doi:10.3758/BF03195291)
66. Maylor EA, Smith G, Della Sala S, Logie RH. 2002 Prospective and retrospective memory in normal aging and dementia: an experimental study. Mem. Cogn. 30, 871–884. (doi:10.3758/BF03195773)
67. Elvevåg B, Maylor EA, Gilbert AL. 2003 Habitual prospective memory in schizophrenia. BMC Psychiatry 3, 9. (doi:10.1186/1471-244X-3-9)
68. Tsujimoto S, Genovesio A, Wise SP. 2008 Transient neuronal correlations underlying goal selection and maintenance in prefrontal cortex. Cereb. Cortex 18, 2748–2761. (doi:10.1093/cercor/bhn033.)
69. Tsujimoto S, Genovesio A, Wise SP. 2010 Evaluating self-generated decisions in frontal pole cortex of monkeys. Nat. Neurosci. 13, 120–126. (doi:10. 1038/nn.2453)
70. Tsujimoto S, Genovesio A, Wise SP. 2011 Comparison of strategy signals in the dorsolateral and orbital prefrontal cortex. J. Neurosci. 31, 4583–4592. doi:10.1523/JNEUROSCI.5816-10.2011)
71. Tsujimoto S, Genovesio A, Wise SP. 2012 Neuronal activity during a cued strategy task: comparison of dorsolateral, orbital and polar prefrontal cortex. J. Neurosci. 32, 11017–11031.(doi:10.1523/JNEUROSCI.1230-12.2012)
72. Curtis CE, Lee D. 2010 Beyond working memory: the role of persistent activity in decision making. Trends Cogn. Sci. 14, 216–222.(doi:10.1016/j.tics. 2010.03.006)
73. Sutton RS, Barto AG. 1998 Reinforcement learning: an introduction. Cambridge, MA: MIT Press.
74. Petrides M. 2005 Lateral prefrontal cortex: architectonic and functional organization. Phil. Trans. R. Soc. B 360, 781–795.(doi:10.1098/rstb. 2005.1631)
75. Owen AM, Evans AC, Petrides M. 1996 Evidence for a two-stage model of spatial working memory processing within the lateral frontal cortex: a positron emission tomography study. Cereb. Cortex 6, 31-38.(doi:10.1093/cercor/6.1.31)
76. Genovesio A, Tsujimoto S, Navarra G, Falcone R, Wise SP. 2014 Autonomous encoding of irrelevant goals and outcomes by prefrontal cortex neurons. J. Neurosci. 34, 1970–1978. (doi:10.1523/JNEUROSCI.3228-13.2014)
77. Genovesio A, Tsujimoto S, Wise SP. 2006 Neural activity related to elapsed time in prefrontal cortex. J. Neurophysiol. 95, 3281–3285. (doi:10.1152/jn. 01011.2005)
78. Meyer T, Qi XL, Constantinidis C. 2007 Persistent discharges in the prefrontal cortex of monkeys naive to working memory tasks. Cereb. Cortex 17(Suppl. 1) i70–i76. (doi:10.1093/cercor/bhm063)
79. Shima K, Isoda M, Mushiake H, Tanji J. 2007 Categorization of behavioural sequences in the prefrontal cortex. Nature 445, 315–318.(doi:10. 1038/nature05470)
80. Pasupathy A, Miller EK. 2005 Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433, 873–876. (doi:10.1038/nature03287)
81. Buschman TJ, Miller EK. 2014 Goal-direction and top-down control. Phil. Trans. R. Soc. B 369, 20130471. (doi:10.1098/rstb.2013.0471)
82. Koechlin E. 2014 An evolutionary computational theory of prefrontal executive function in decision-making. Phil. Trans. R. Soc. B 369, 20130474. (doi:10.1098/rstb.2013.0474)