Embedding reward signals into perception and cognition

Frontiers in Neuroscience

Volumn 4, Issue SEP, 2010, Pages

  Pessoa, Luiz ^a   Engelmann, Jan B ^b  

^a INDIANA UNIVERSITY   (United States)

^b UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Attention; Executive function; Fronto parietal; Motivation; Posterior cingulate cortex

Indexed keywords

EID: 79954588541     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2010.00017     Document Type: Review

References (52)

1. Alexander, G. E., DeLong, M. R., and Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 9, 357-381.
2. Barbas, H., and Pandya, D. N. (1989). Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey. J. Comp. Neurol. 286, 353-375.
3. Bendiksby, M. S., and Platt, M. L. (2006). Neural correlates of reward and attention in macaque area LIP. Neuropsychologia 44, 2411-2420.
4. Berns, G. S., McClure, S. M., Pagnoni, G., and Montague, P. R. (2001). Predictability modulates human brain response to reward. J. Neurosci. 21, 2793-2798.
5. Bunzeck, N., and Duzel, E. (2006). Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron 51, 369-379.
6. Corbetta, M., Kincade, J. M., Ollinger, J. M., McAvoy, M. P., and Shulman, G. L. (2000). Voluntary orienting is dissociated from target detection in human posterior parietal cortex. Nat. Neurosci. 3, 292-297.
7. D'Ardenne, K., McClure, S. M., Nystrom, L. E., and Cohen, J. D. (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319, 1264-1267.
8. Delgado, M. R., Locke, H. M., Stenger, V. A., and Fiez, J. A. (2003). Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn. Affect. Behav. Neurosci. 3, 27-38.
9. Devinsky, O., Morrell, M. J., and Vogt, B. A. (1995). Contributions of anterior cingulate cortex to behaviour. Brain 118(Pt 1), 279-306.
10. Douglas R. J., and Martin K. A. (2007). Recurrent neuronal circuits in the neocortex. Curr. Biol. 17, R496-R500.
11. Engelmann, J. B., Damaraju, E., Padmala, S., and Pessoa, L. (2009). Combined effects of attention and motivation on visual task performance: transient and sustained motivational effects. Front. Hum. Neurosci. 3, 4. doi:10.3389/neuro.09.004.2009.
12. Engelmann, J. B., and Pessoa, L. (2007). Motivation sharpens exogenous spatial attention. Emotion 7, 668-674.
13. Goldman-Rakic, P. S., Leranth, C., Williams, M., Mons, N., and Gefard, M. (1989). Dopamine synaptic complex with pyramidal neurons in primate cerebral cortex. Proc. Natl. Acad. Sci. U.S.A. 86, 9015-9019.
14. Granon, S., Passetti, F., Thomas, K. L., Dalley, J. W., Everitt, B. J., and Robbins, T. W. (2000). Enhanced and impaired attentional performance after infusion of D1 dopaminergic receptor agents into rat prefrontal cortex. J. Neurosci. 20, 1208-1215.
15. Gruber, A. J., Dayan, P., Gutkin, B. S., and Solla, S. A. (2006). Dopamine modulation in the basal ganglia locks the gate to working memory. J. Comput. Neurosci. 20, 153-166.
16. Guimera, R., and Nunes Amaral, L. A. (2005). Functional cartography of complex metabolic networks. Nature 433, 895-900.
17. Hopfinger, J. B., Buonocore, M. H., and Mangung, G. R. (2000). The neural mechanisms of top-down attentional control. Nat. Neurosci. 3, 248-291.
18. Jimura, K., Locke, H. S., and Braver, T. S. (in press). Prefrontal cortex mediation of cognitive enhancement in rewarding motivational contexts. Proc. Natl. Acad. Sci. U.S.A., early edition.
19. Kincade, J. M., Abrams, R. A., Astafiev, S. V., Shulman, G. L., and Corbetta, M. (2005). An event-related magnetic resonance imaging study of voluntary and stimulus-driven orienting of attention. J. Neurosci. 25, 4593-4604.
20. Knutson, B., Taylor, J., Kaufman, M., Peterson, R., and Glover, G. (2005). Distributed neural representation of expected value. J. Neurosci. 25, 4806-4812.
21. Kobayashi, S., Lauwereyns, J., Koizumi, M., Sakagami, M., and Hikosaka, O. (2002). Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J. Neurophysiol. 87, 1488-1498.
22. Kouneiher, F., Charron, S., and Koechlin, E. (2009). Motivation and cognitive control in the human prefrontal cortex. Nat. Neurosci. 12, 939-945.
23. Leon, M. I., and Shadlen, M. N. (1999). Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24, 415-425.
24. Locke, H. S., and Braver, T. S. (2008). Motivational influences on cognitive control: behavior, brain activation, and individual differences. Cogn. Affect. Behav. Neurosci. 8, 99-112.
25. Maunsell, J. H. (2004). Neuronal representations of cognitive state: reward or attention? Trends Cogn. Sci. 8, 261-265.
26. Mohanty, A., Gitelman, D. R., Small, D. M., and Mesulam, M. M. (2008). The spatial attention network interacts with limbic and monoaminergic systems to modulate motivation-induced attention shifts. Cereb. Cortex 18, 2604-2613.
27. Montague, P. R., Hyman, S. E., and Cohen, J. D. (2004). Computational roles for dopamine in behavioural control. Nature 431, 760-767.
28. O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., and Andrews, C. (2001). Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95-102.
29. Oades, R. D., and Halliday, G. M. (1987). Ventral tegmental (A10) system: neurobiology. 1. Anatomy and connectivity. Brain Res. 434, 117-165.
30. Pantoja, J., Ribeiro, S., Wiest, M., Soares, E., Gervasoni, D., Lemos, N. A., and Nicolelis, M. A. (2007). Neuronal activity in the primary somatosensory thalamocortical loop is modulated by reward contingency during tactile discrimination. J. Neurosci. 27, 10608-10620.
31. Pessoa, L. (2009). How do emotion and motivation direct executive control? Trends Cogn. Sci. (Regul. Ed.) 13, 160-166.
32. Pezze, M. A., Dalley, J. W., and Robbins, T. W. (2007). Differential roles of dopamine D1 and D2 receptors in the nucleus accumbens in attentional performance on the five-choice serial reaction time task. Neuropsychopharmacology 32, 273-283.
33. Platt, M. L., and Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature 400, 233-238.
34. Platt, M. L., and Huettel, S. A. (2008). Risky business: the neuroeconomics of decision making under uncertainty. Nat. Neurosci. 11, 398-403.
35. Pleger, B., Blankenburg, F., Ruff, C. C., Driver, J., and Dolan, R. J. (2008). Reward facilitates tactile judgments and modulates hemodynamic responses in human primary somatosensory cortex. J. Neurosci. 28, 8161-8168.
36. Pleger, B., Ruff, C. C., Blankenburg, F., Kloppel, S., Driver, J., and Dolan, R. J. (2009). Influence of dopaminergically mediated reward on somatosensory decision-making. PLoS Biol. 7, e1000164. doi: 10.1371/journal.pbio.1000164.
37. Pochon, J. B., Levy, R., Fossati, P., Lehericy, S., Poline, J. B., Pillon, B., Le Bihan, D., and Dubois, B. (2002). The neural system that bridges reward and cognition in humans: an fMRI study. Proc. Natl. Acad. Sci. U.S.A. 99, 5669-5674.
38. Posner, M. I., and DiGirolamo, G. J. (1998). "Executive attention: conflict, target detection, and cognitive control," in The Attentive Brain, ed. R. Parasuraman (Cambridge, MA: MIT Press), 401-423.
39. Raghanti, M. A., Stimpson, C. D., Marcinkiewicz, J. L., Erwin, J. M., Hof, P. R., and Sherwood, C. C. (2008). Cortical dopaminergic innervation among humans, chimpanzees and macaque monkeys: a comparative study. Neuroscience 155, 203-220.
40. Rushworth, M. F., Buckley, M. J., Behrens, T. E., Walton, M. E., and Bannerman, D. M. (2007). Functional organization of the medial frontal cortex. Curr. Opin. Neurobiol. 17, 220-227.
41. Sawaguchi, T., and Matsumura, M. (1985). Laminar distribution of neurons sensitive to acetylcholine, noradrenaline and dopamine in the dorsolateral prefrontal cortex of monkey. Neurosci. Res. 2, 255-273.
42. Schultz, W., Apicella, P., Scarnati, E., and Ljungberg, T. (1992). Neuronal activity in monkey ventral striatum related to the expectation of reward. J. Neurosci. 12, 4595-4610.
43. Seamans, J. K., and Yang, C. R. (2004). The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol. 74, 1-58.
44. Serences, J. T. (2008). Value-based modulations in human visual cortex. Neuron 60, 1169-1181.
45. Shuler, M. G., and Bear, M. F. (2006). Reward timing in the primary visual cortex. Science 311, 1606-1609.
46. Small, D. M., Gitelman, D., Simmons, K., Bloise, S. M., Parrish, T., and Mesulam, M. M. (2005). Monetary incentives enhance processing in brain regions mediating top-down control of attention. Cereb. Cortex 15, 1855-1865.
47. Sporns, O., Honey, C. J., and Kotter, R. (2007). Identification and classification of hubs in brain networks. PLoS ONE 2, e1049. doi:10.1371/journal.pone.0001049.
48. Taylor, S. F., Welsh, R. C., Wager, T. D., Phan, K. L., Fitzgerald, K. D., and Gehring, W. J. (2004). A functional neuroimaging study of motivation and executive function. Neuroimage 21, 1045-1054.
49. Visscher, K. M., Miezin, F. M., Kelly, J. E., Buckner, R. L., Donaldson, D. I., McAvoy, M. P., Bhalodia, V. M., and Petersen, S. E. (2003). Mixed blocked/event-related designs separate transient and sustained activity in fMRI. Neuroimage 19, 1694-1708.
50. Watanabe, M., and Sakagami, M. (2007). Integration of cognitive and motivational context information in the primate prefrontal cortex. Cereb. Cortex 17(Suppl. 1), i101-i109.
51. Weissman, D. H., Gopalakrishnan, A., Hazlett, C. J., and Woldorff, M. G. (2005). Dorsal anterior cingulate cortex resolves conflict from distracting stimuli by boosting attention toward relevant events. Cereb. Cortex 15, 229-237.
52. Zink, C. F., Pagnoni, G., Chappelow, J., Martin-Skurski, M., and Berns, G. S. (2006). Human striatal activation reflects degree of stimulus saliency. Neuroimage 29, 977-983.