Dynamic routing of task-relevant signals for decision making in dorsolateral prefrontal cortex

Nature Neuroscience

Volumn 18, Issue 2, 2015, Pages 295-301

  Donahue, Christopher H ^a,c   Lee, Daeyeol ^a,b  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b YALE UNIVERSITY   (United States)

^c GLADSTONE INSTITUTE OF NEUROLOGICAL DISEASE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; BEHAVIOR; COLOR; DECISION MAKING; HAPLORHINI; MALE; NERVE CELL; NEUROPHYSIOLOGY; NONHUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; REWARD; SIGNAL TRANSDUCTION; TASK PERFORMANCE; ANIMAL; ANIMAL BEHAVIOR; CYTOLOGY; LEARNING; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; RHESUS MONKEY; SHORT TERM MEMORY; VISION;

ANIMALS; BEHAVIOR, ANIMAL; CHOICE BEHAVIOR; MACACA MULATTA; MALE; MEMORY, SHORT-TERM; PREFRONTAL CORTEX; PROBABILITY LEARNING; PSYCHOMOTOR PERFORMANCE; REWARD; VISUAL PERCEPTION;

EID: 84923186354     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3918     Document Type: Article

References (50)

1. Funahashi, S., Bruce, C.J. & Goldman-Rakic, P.S. Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J. Neurophysiol. 61, 331-349 (1989).
2. Lara, A.H. & Wallis, J.D. Executive control processes underlying multi-item working memory. Nat. Neurosci. 17, 876-883 (2014).
3. Romo, R., Brody, C.D., Hernández, A. & Lemus, L. Neuronal correlates of parametric working memory in the prefrontal cortex. Nature 399, 470-473 (1999).
4. Constantinidis, C., Franowicz, M.N. & Goldman-Rakic, P.S. The sensory nature of mnemonic representation in the primate prefrontal cortex. Nat. Neurosci. 4, 311-316 (2001).
5. Ó Scalaidhe, S.P., Wilson, F.A. & Goldman-Rakic, P.S. Areal segregation of face-processing neurons in prefrontal cortex. Science 278, 1135-1138 (1997).
6. Rao, S.C., Rainer, G. & Miller, E.K. Integration of what and where in the primate prefrontal cortex. Science 276, 821-824 (1997).
7. Miller, E.K. & Cohen, J.D. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24, 167-202 (2001).
8. Tanji, J. & Hoshi, E. Role of the lateral prefrontal cortex in executive behavioral control. Physiol. Rev. 88, 37-57 (2008).
9. Lebedev, M.A., Messinger, A., Kralik, J.D. & Wise, S.P. Representation of attended versus remembered locations in prefrontal cortex. PLoS Biol. 2, e365 (2004).
10. Messinger, A., Lebedev, M.A., Kralik, J.D. & Wise, S.P. Multitasking of attention and memory functions in the primate prefrontal cortex. J. Neurosci. 29, 5640-5653 (2009).
11. Watanabe, M. Reward expectancy in primate prefrontal neurons. Nature 382, 629-632 (1996).
12. Leon, M.I. & Shadlen, M.N. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24, 415-425 (1999).
13. Barraclough, D.J., Conroy, M.L. & Lee, D. Prefrontal cortex and decision making in a mixed-strategy game. Nat. Neurosci. 7, 404-410 (2004).
14. Kim, S., Hwang, J. & Lee, D. Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59, 161-172 (2008).
15. Kim, S., Cai, X., Hwang, J. & Lee, D. Prefrontal and striatal activity related to values of objects and locations. Front. Neurosci. 6, 108 (2012).
16. Kennerley, S.W., Dahmubed, A.F., Lara, A.H. & Wallis, J.D. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 21, 1162-1178 (2009).
17. Lauwereyns, J. et al. Responses to task-irrelevant visual features by primate prefrontal neurons. J. Neurophysiol. 86, 2001-2010 (2001).
18. Genovesio, A., Tsujimoto, S., Navarra, G., Falcone, R. & Wise, S.P. Autonomous encoding of irrelevant goals and outcomes by prefrontal cortex neurons. J. Neurosci. 34, 1970-1978 (2014).
19. Sutton, R.S. & Barto, A.G. Reinforcement Learning: An Introduction (MIT Press, 1998).
20. Tobler, P.N., Fiorillo, C.D. & Schultz, W. Adaptive coding of reward value by dopamine neurons. Science 307, 1642-1645 (2005).
21. Knutson, B., Taylor, J., Kaufman, M., Peterson, R. & Glover, G. Distributed neural representation of expected value. J. Neurosci. 25, 4806-4812 (2005).
22. Yacubian, J. et al. Dissociable systems for gain-and loss-related value predictions and errors of prediction in the human brain. J. Neurosci. 26, 9530-9537 (2006).
23. Tobler, P.N., Christopoulos, G.I., O'Doherty, J.P., Dolan, R.J. & Schultz, W. Neuronal distortions of reward probability without choice. J. Neurosci. 28, 11703-11711 (2008).
24. Christopoulos, G.I., Tobler, P.N., Bossaerts, P., Dolan, R.J. & Schultz, W. Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J. Neurosci. 29, 12574-12583 (2009).
25. Venkatraman, V., Payne, J.W., Bettman, J.R., Luce, M.F. & Huettel, S.A. Separate neural mechanisms underlie choices and strategic preferences in risky decision making. Neuron 62, 593-602 (2009).
26. Berns, G.S. & Bell, E. Striatal topography of probability and magnitude information for decisions under uncertainty. Neuroimage 59, 3166-3172 (2012).
27. Donahue, C.H., Seo, H. & Lee, D. Cortical signals for rewarded actions and strategic exploration. Neuron 80, 223-234 (2013).
28. Histed, M.H., Pasupathy, A. & Miller, E.K. Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron 63, 244-253 (2009).
29. Ito, M. & Doya, K. Validation of decision-making models and analysis of decision variables in the rat basal ganglia. J. Neurosci. 29, 9861-9874 (2009).
30. Daw, N.D., Niv, Y. & Dayan, P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704-1711 (2005).
31. Hampton, A.N., Bossaerts, P. & O'Doherty, J.P. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J. Neurosci. 26, 8360-8367 (2006).
32. Lee, D., Seo, H. & Jung, M.W. Neural basis of reinforcement learning and decision making. Annu. Rev. Neurosci. 35, 287-308 (2012).
33. Gläscher, J., Daw, N., Dayan, P. & O'Doherty, J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66, 585-595 (2010).
34. Daw, N.D., Gershman, S.J., Seymour, B., Dayan, P. & Dolan, R.J. Model-based influences on humans' choices and striatal prediction errors. Neuron 69, 1204-1215 (2011).
35. Abe, H. & Lee, D. Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. Neuron 70, 731-741 (2011).
36. Lee, S.W., Shimojo, S. & O'Doherty, J.P. Neural computations underlying arbitration between model-based and model-free learning. Neuron 81, 687-699 (2014).
37. Seo, H., Cai, X., Donahue, C.H. & Lee, D. Neural correlates of strategic reasoning during competitive games. Science 346, 340-343 (2014).
38. Asaad, W.F., Rainer, G. & Miller, E.K. Neural activity in the primate prefrontal cortex during associative learning. Neuron 21, 1399-1407 (1998).
39. Curtis, C.E. & Lee, D. Beyond working memory: the role of persistent activity in decision making. Trends Cogn. Sci. 14, 216-222 (2010).
40. Bernacchia, A., Seo, H., Lee, D. & Wang, X.-J. A reservoir of time constants for memory traces in cortical neurons. Nat. Neurosci. 14, 366-372 (2011).
41. Genovesio, A., Brasted, P.J., Mitz, A.R. & Wise, S.P. Prefrontal cortex activity related to abstract response strategies. Neuron 47, 307-320 (2005).
42. Genovesio, A., Brasted, P.J. & Wise, S.P. Representation of future and previous spatial goals by separate neural populations in prefrontal cortex. J. Neurosci. 26, 7305-7316 (2006).
43. Fuster, J.M., Bodner, M. & Kroger, J.K. Cross-modal and cross-temporal association in neurons of frontal cortex. Nature 405, 347-351 (2000).
44. Mante, V., Sussillo, D., Shenoy, K.V. & Newsome, W.T. Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503, 78-84 (2013).
45. Chen, L.L. & Wise, S.P. Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73, 1101-1121 (1995).
46. Chen, L.L. & Wise, S.P. Evolution of directional preferences in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurosci. 16, 3067-3081 (1996).
47. Chen, L.L. & Wise, S.P. Conditional oculomotor learning: population vectors in the supplementary eye field. J. Neurophysiol. 78, 1166-1169 (1997).
48. Singer, A.C. & Frank, L.M. Rewarded outcomes enhance reactivation of experience in the hippocampus. Neuron 64, 910-921 (2009).
49. Rigotti, M. et al. The importance of mixed selectivity in complex cognitive tasks. Nature 497, 585-590 (2013).
50. Duncan, J. An adaptive coding model of neural function in prefrontal cortex. Nat. Rev. Neurosci. 2, 820-829 (2001).