The role of high-frequency oscillatory activity in reward processing and learning

Neuroscience and Biobehavioral Reviews

Volumn 49, Issue , 2015, Pages 1-7

  Marco Pallarés, Josep ^a,b   Münte, Thomas F ^c   Rodríguez Fornells, Antoni ^a,b,d  

^a UNIVERSITY OF BARCELONA   (Spain)

^b BELLVITGE BIOMEDICAL RESEARCH INSTITUTE IDIBELL   (Spain)

^c UNIVERSITY OF LÜBECK   (Germany)

^d INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

Author keywords

Beta; Gamma; Novelty; Oscillatory activity; Reward

Indexed keywords

ATTENTION; BETA RHYTHM; BRAIN ELECTROPHYSIOLOGY; BRAIN FUNCTION; COGNITION; ELECTROENCEPHALOGRAM; EMOTION; GAMMA RHYTHM; HIGH FREQUENCY OSCILLATION; HUMAN; LEARNING; MEMORY; MOTIVATION; NUCLEUS ACCUMBENS; POSITIVE FEEDBACK; REVIEW; REWARD; VENTRAL TEGMENTUM; ANIMAL; BRAIN; PHYSIOLOGY;

ANIMALS; ATTENTION; BETA RHYTHM; BRAIN; GAMMA RHYTHM; HUMANS; MEMORY; MOTIVATION; REWARD;

EID: 84916604460     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2014.11.014     Document Type: Review

References (91)

1. Alexander W.H., Brown J.W. Medial prefrontal cortex as an action-outcome predictor. Nat. Neurosci. 2011, 14:1338-1344. 10.1038/nn.2921.
2. Anderson A.K. Affective influences on the attentional dynamics supporting awareness. J. Exp. Psychol. Gen. 2005, 134:258-281. 10.1037/0096-3445.134.2.258.
3. Axmacher N., Cohen M.X., Fell J., Haupt S., Dümpelmann M., Elger C.E., Schlaepfer T.E., Lenartz D., Sturm V., Ranganath C. Intracranial EEG correlates of expectancy and memory formation in the human hippocampus and nucleus accumbens. Neuron 2010, 65:541-549. 10.1016/j.neuron.2010.02.006.
4. Berke J.D. Fast oscillations in cortical-striatal networks switch frequency following rewarding events and stimulant drugs. Eur. J. Neurosci. 2009, 30:848-859. 10.1111/j. 1460-9568.2009.06843.x.
5. Berke J.D., Okatan M., Skurski J., Eichenbaum H.B. Oscillatory entrainment of striatal neurons in freely moving rats. Neuron 2004, 43:883-896. 10.1016/j.neuron.2004.08.035.
6. Berlyne D.E. Conflict, Arousal, and Curiosity. McGraw-Hill Series in Psychology 1960, McGraw-Hill, New York, NY.
7. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. Brain Res. Rev. 1998, 28:309-369.
8. Bilder R.M., Volavka J., Lachman H.M., Grace A.A. The catechol-O-methyltransferase polymorphism: relations to the tonic-phasic dopamine hypothesis and neuropsychiatric phenotypes. Neuropsychopharmacology 2004, 29:1943-1961.
9. Blanchard M.M., Mendelsohn D., Stamp J.A. The HR/LR model: further evidence as an animal model of sensation seeking. Neurosci. Biobehav. Rev. 2009, 33:1145-1154. 10.1016/j.neubiorev.2009.05.009.
10. Bressler S.L., Coppola R., Nakamura R. Episodic multiregional cortical coherence at multiple frequencies during visual task performance. Nature 1993, 366:153-156.
11. Brovelli A., Ding M., Ledberg A., Chen Y., Nakamura R., Bressler S.L. Beta oscillations in a large-scale sensorimotor cortical network: directional influences revealed by Granger causality. Proc. Natl. Acad. Sci. U.S.A. 2004, 101:9849-9854. 10.1073/pnas.0308538101.
12. Brown P., Oliviero A., Mazzone P., Insola A., Tonali P., Di Lazzaro V. Dopamine dependency of oscillations between subthalamic nucleus and pallidum in Parkinson's disease. J. Neurosci. 2001, 21:1033-1038.
13. Bunzeck N., Guitart-Masip M., Dolan R.J., Düzel E. Contextual novelty modulates the neural dynamics of reward anticipation. J. Neurosci. 2011, 31:12816-12822. 10.1523/JNEUROSCI.0461-11.2011.
14. Buschman T.J., Miller E.K. Serial, covert shifts of attention during visual search are reflected by the frontal eye fields and correlated with population oscillations. Neuron 2009, 63:386-396. 10.1016/j.neuron.2009.06.020.
15. Buzsaki G., Draguhn A. Neuronal oscillations in cortical networks. Science 2004, 304:1926-1929. (80-).
16. Calhoun V.D., Pearlson G.D., Kiehl K.A. Neuronal chronometry of target detection: fusion of hemodynamic and event-related potential data. NeuroImage 2006, 30:544-553.
17. Camara E., Rodriguez-Fornells A., Munte T.F. Microstructural brain differences predict functional hemodynamic responses in a reward processing task. J. Neurosci. 2010, 30:11398-11402. 10.1523/JNEUROSCI.0111-10.2010.
18. Camara E., Rodriguez-Fornells A., Ye Z., Munte T.F. Reward networks in the brain as captured by connectivity measures. Front. Neurosci. 2009, 3:350-362.
19. Cavanagh J.F., Figueroa C.M., Cohen M.X., Frank M.J. Frontal theta reflects uncertainty and unexpectedness during exploration and exploitation. Cereb. Cortex 2012, 22:2575-2586. 10.1093/cercor/bhr332.
20. Chen J., Lipska B.K., Halim N., Ma Q.D., Matsumoto M., Melhem S., Kolachana B.S., Hyde T.M., Herman M.M., Apud J., Egan M.F., Kleinman J.E., Weinberger D.R. Functional analysis of genetic variation in catechol-O-methyltransferase (COMT): effects on mRNA, protein, and enzyme activity in postmortem human brain. Am. J. Hum. Genet. 2004, 75:807-821.
21. Cohen M.X., Axmacher N., Lenartz D., Elger C.E., Sturm V., Schlaepfer T.E. Good vibrations: cross-frequency coupling in the human nucleus accumbens during reward processing. J. Cogn. Neurosci. 2009, 21:875-889. 10.1162/jocn.2009.21062.
22. Cohen M.X., Elger C.E., Ranganath C. Reward expectation modulates feedback-related negativity and EEG spectra. NeuroImage 2007, 35:968-978.
23. Cohen M.X., Gulbinaite R. Five methodological challenges in cognitive electrophysiology. Neuroimage. 85 2014, 702-710.
24. Cohen M.X., Ranganath C. Reinforcement learning signals predict future decisions. J. Neurosci. 2007, 27:371-378.
25. Cohen M.X., Wilmes K., Vijver I., van de Cortical electrophysiological network dynamics of feedback learning. Trends Cogn. Sci. 2011, 15:558-566. 10.1016/j.tics.2011.10.004.
26. Colgin L.L. Oscillations and hippocampal-prefrontal synchrony. Curr. Opin. Neurobiol. 2011, 21:467-474. 10.1016/j.conb.2011.04.006.
27. Courtemanche R., Fujii N., Graybiel A.M. Synchronous, focally modulated beta-band oscillations characterize local field potential activity in the striatum of awake behaving monkeys. J. Neurosci. 2003, 23:11741-11752.
28. Cunillera T., Fuentemilla L., Periañez J., Marco-Pallarès J., Krämer U.M., Càmara E., Münte T.F., Rodríguez-Fornells A. Brain oscillatory activity associated with task switching and feedback processing. Cogn. Affect. Behav. Neurosci. 2012, 12:16-33. 10.3758/s13415-011-0075-5.
29. Doñamayor N., Marco-Pallarés J., Heldmann M., Schoenfeld M.A., Münte T.F. Temporal dynamics of reward processing revealed by magnetoencephalography. Hum. Brain Mapp. 2011, 32:2228-2240. 10.1002/hbm.21184.
30. Doñamayor N., Schoenfeld M.A., Münte T.F. Magneto- and electroencephalographic manifestations of reward anticipation and delivery. NeuroImage 2012, 62:17-29. 10.1016/j.neuroimage.2012.04.038.
31. Donchin E. Surprise!? Surprise?. Psychophysiology 1981, 18:493-513. 10.1111/j.1469-8986.1981.tb01815.x.
32. Engel A.K., Fries P. Beta-band oscillations-signalling the status quo?. Curr. Opin. Neurobiol. 2010, 20:156-165. 10.1016/j.conb.2010.02.015.
33. Feingold J. Beta Oscillations in Frontal Cortex and Striatum Represent Post-Processing of Successful Behavior 2011, Massachusetts Institute of Technology, Cambridge.
34. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
35. Fuentemilla L., Cucurell D., Marco-Pallarés J., Guitart-Masip M., Morís J., Rodríguez-Fornells A. Electrophysiological correlates of anticipating improbable but desired events. NeuroImage 2013, 78:135-144. 10.1016/j.neuroimage.2013.03.062.
36. Fujisawa S., Buzsáki G. A 4Hz oscillation adaptively synchronizes prefrontal, VTA, and hippocampal activities. Neuron 2011, 72:153-165. 10.1016/j.neuron.2011.08.018.
37. Gregoriou G.G., Gotts S.J., Zhou H., Desimone R. High-frequency, long-range coupling between prefrontal and visual cortex during attention. Science 2009, 324:1207-1210. 10.1126/science.1171402.
38. HajiHosseini A., Rodríguez-Fornells A., Marco-Pallarés J. The role of beta-gamma oscillations in unexpected rewards processing. NeuroImage 2012, 60:1678-1685. 10.1016/j.neuroimage.2012.01.125.
39. Herrmann C.S., Knight R.T. Mechanisms of human attention: event-related potentials and oscillations. Neurosci. Biobehav. Rev. 2001, 25:465-476.
40. Herrojo Ruiz M., Huebl J., Schönecker T., Kupsch A., Yarrow K., Krauss J.K., Schneider G.-H., Kühn A.A. Involvement of human internal globus pallidus in the early modulation of cortical error-related activity. Cereb. Cortex 2014, 24:1502-1517. 10.1093/cercor/bht002.
41. Jensen O., Kaiser J., Lachaux J.-P. Human gamma-frequency oscillations associated with attention and memory. Trends Neurosci. 2007, 30:317-324. 10.1016/j.tins.2007.05.001.
42. Kawasaki M., Yamaguchi Y. Frontal theta and beta synchronizations for monetary reward increase visual working memory capacity. Soc. Cogn. Affect. Neurosci. 2013, 8:523-530. 10.1093/scan/nss027.
43. Keil A., Müller M.M., Gruber T., Wienbruch C., Elbert T. Human large-scale oscillatory brain activity during an operant shaping procedure. Brain Res. Cogn. Brain Res. 2001, 12:397-407.
44. Knutson B., Taylor J., Kaufman M., Peterson R., Glover G. Distributed neural representation of expected value. J. Neurosci. 2005, 25:4806-4812.
45. Kopell N., Ermentrout G.B., Whittington M.A., Traub R.D. Gamma rhythms and beta rhythms have different synchronization properties. Proc. Natl. Acad. Sci. U.S.A. 2000, 97:1867-1872.
46. Lalo E., Thobois S., Sharott A., Polo G., Mertens P., Pogosyan A., Brown P. Patterns of bidirectional communication between cortex and basal ganglia during movement in patients with Parkinson disease. J. Neurosci. 2008, 28:3008-3016. 10.1523/JNEUROSCI.5295-07.2008.
47. Lammel S., Hetzel A., Häckel O., Jones I., Liss B., Roeper J. Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system. Neuron 2008, 57:760-773. 10.1016/j.neuron.2008.01.022.
48. Lapray D., Bergeler J., Luhmann H.J. Stimulus-induced gamma activity in the electrocorticogram of freely moving rats: the neuronal signature of novelty detection. Behav. Brain Res. 2009, 199:350-354. 10.1016/j.bbr.2008.12.028.
49. Legault M., Wise R.A. Novelty-evoked elevations of nucleus accumbens dopamine: dependence on impulse flow from the ventral subiculum and glutamatergic neurotransmission in the ventral tegmental area. Eur. J. Neurosci. 2001, 13:819-828.
50. Leicht G., Troschütz S., Andreou C., Karamatskos E., Ertl M., Naber D., Mulert C. Relationship between oscillatory neuronal activity during reward processing and trait impulsivity and sensation seeking. PLoS One 2013, 8:e83414. 10.1371/journal.pone.0083414.
51. Lisman J.E., Grace A.A. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 2005, 46:703-713. 10.1016/j.neuron.2005.05.002.
52. Llinás R., Urbano F.J., Leznik E., Ramírez R.R., van Marle H.J.F. Rhythmic and dysrhythmic thalamocortical dynamics: GABA systems and the edge effect. Trends Neurosci. 2005, 28:325-333. 10.1016/j.tins.2005.04.006.
53. Ma J., Leung L.S. Kindled seizure in the prefrontal cortex activated behavioral hyperactivity and increase in accumbens gamma oscillations through the hippocampus. Behav. Brain Res. 2010, 206:68-77. 10.1016/j.bbr.2009.08.038.
54. Marco-Pallares J., Cucurell D., Cunillera T., García R., Andrés-Pueyo A., Munte T.F., Rodriguez-Fornells A. Human oscillatory activity associated to reward processing in a gambling task. Neuropsychologia 2008, 46:241-248.
55. Marco-Pallarés J., Cucurell D., Cunillera T., Krämer U.M., Càmara E., Nager W., Bauer P., Schüle R., Schöls L., Münte T.F., Rodriguez-Fornells A. Genetic variability in the dopamine system (dopamine receptor D4, catechol-O-methyltransferase) modulates neurophysiological responses to gains and losses. Biol. Psychiatry 2009, 66:154-161. 10.1016/j.biopsych.2009.01.006.
56. Mas-Herrero E., Marco-Pallarés J. Frontal theta oscillatory activity is a common mechanism for the computation of unexpected outcomes and learning rate. J. Cogn. Neurosci. 2014, 26:447-458. 10.1162/jocn_a_00516.
57. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
58. Meehl P.E. Hedonic capacity: some conjectures. Bull. Menninger Clin. 1975, 39:295-307.
59. Mellers B., McGraw A. Anticipated emotions as guides to choice. Curr. Dir. Psychol. 2001, 10:201-214.
60. Mellers B.A., Schwartz A., Cooke A.D. Judgment and decision making. Annu. Rev. Psychol. 1998, 49:447-477. 10.1146/annurev.psych.49.1.447.
61. Münte T.F., Heldmann M., Hinrichs H., Marco-Pallarés J., Krämer U.M., Sturm V., Heinze H.J. Contribution of subcortical structures to cognition assessed with invasive electrophysiology in humans. Frontiers in Neuroscience 2008, 2:72-78.
62. Narayanan N.S., Cavanagh J.F., Frank M.J., Laubach M. Common medial frontal mechanisms of adaptive control in humans and rodents. Nat. Neurosci. 2013, 16:1888-1895. 10.1038/nn.3549.
63. Nieuwenhuis S., Slagter H.A., von Geusau N.J.A., Heslenfeld D.J., Holroyd C.B. Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes. Eur. J. Neurosci. 2005, 21:3161-3168.
64. Nyhus E., Curran T. Functional role of gamma and theta oscillations in episodic memory. Neurosci. Biobehav. Rev. 2010, 34:1023-1035. 10.1016/j.neubiorev.2009.12.014.
65. O'Doherty J., Rolls E.T., Francis S., Bowtell R., McGlone F. Representation of pleasant and aversive taste in the human brain. J. Neurophysiol. 2001, 85:1315-1321.
66. Ohman A., Flykt A., Esteves F. Emotion drives attention: detecting the snake in the grass. J. Exp. Psychol. Gen. 2001, 130:466-478.
67. Olson J.M., Roese N.J., Zanna M.P. Expectancies. Social Psychology: Handbook of Basic Principles 1996, 211-238. Guilford, New York, NY. E.T. Higgins, A.W. Kruglanski (Eds.).
68. Ortony A., Glore G.L., Collins A. The Cognitive Structure of Emotions 1988, Cambridge University Press, Cambridge.
69. Padrão G., Mallorquí A., Cucurell D., Marco-Pallares J., Rodriguez-Fornells A. Neurophysiological differences in reward processing in anhedonics. Cogn. Affect. Behav. Neurosci. 2013, 13:102-115. 10.3758/s13415-012-0119-5.
70. Pessiglione M., Schmidt L., Draganski B., Kalisch R., Lau H., Dolan R.J., Frith C.D. How the brain translates money into force: a neuroimaging study of subliminal motivation. Science 2007, 316:904-906. 10.1126/science.1140459.
71. Pessoa L., Kastner S., Ungerleider L.G. Attentional control of the processing of neural and emotional stimuli. Brain Res. Cogn. Brain Res. 2002, 15:31-45.
72. Phaf R.H., Rotteveel M. Affective monitoring: a generic mechanism for affect elicitation. Front. Psychol. 2012, 3:47. 10.3389/fpsyg.2012.00047.
73. Pujara M., Koenigs M. Mechanisms of reward circuit dysfunction in psychiatric illness: prefrontal-striatal interactions. Neuroscientist 2014, 20:82-95.
74. Ribary U. Dynamics of thalamo-cortical network oscillations and human perception. Prog. Brain Res. 2005, 150:127-142. 10.1016/S0079-6123(05)50010-4.
75. Russo S.J., Nestler E.J. The brain reward circuitry in mood disorders. Nat. Rev. Neurosci. 2013, 14:609-625. 10.1038/nrn3381.
76. Schachter S., Singer J. Cognitive, social, and physiological determinants of emotional state. Psychol. Rev. 1962, 69:379-399.
77. Schnitzler A., Gross J. Normal and pathological oscillatory communication in the brain. Nat. Rev. Neurosci. 2005, 6:285-296. 10.1038/nrn1650.
78. Schultz W., Apicella P., Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 1993, 13:900-913.
79. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
80. Sokolov E.N. Higher nervous functions; the orienting reflex. Annu. Rev. Physiol. 1963, 25:545-580. 10.1146/annurev.ph.25.030163.002553.
81. Steriade M. Grouping of brain rhythms in corticothalamic systems. Neuroscience 2006, 137:1087-1106. 10.1016/j.neuroscience.2005.10.029.
82. Sturman D.A., Moghaddam B. Striatum processes reward differently in adolescents versus adults. Proc. Natl. Acad. Sci. U.S.A. 2012, 109:1719-1724. 10.1073/pnas.1114137109.
83. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307:1642-1645. (80-).
84. Tsai H.-C., Zhang F., Adamantidis A., Stuber G.D., Bonci A., de Lecea L., Deisseroth K. Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 2009, 324:1080-1084. 10.1126/science.1168878.
85. Uhlhaas P.J., Singer W. Neural synchrony in brain disorders: relevance for cognitive dysfunctions and pathophysiology. Neuron 2006, 52:155-168. 10.1016/j.neuron.2006.09.020.
86. Van de Vijver I., Ridderinkhof K.R., Cohen M.X. Frontal oscillatory dynamics predict feedback learning and action adjustment. J. Cogn. Neurosci. 2011, 23:4106-4121. 10.1162/jocn_a_00110.
87. Van der Meer M.A.A., Redish A.D. Low and high gamma oscillations in rat ventral striatum have distinct relationships to behavior, reward, and spiking activity on a learned spatial decision task. Front. Integr. Neurosci. 2009, 3:9. 10.3389/neuro.07.009.2009.
88. Walsh J.J., Han M.H. The heterogeneity of ventral tegmental area neurons: projection functions in a mood-related context. Neuroscience 2014, 282C:101-108. 10.1016/j.neuroscience.2014.06.006.
89. Wang X.-J. Neurophysiological and computational principles of cortical rhythms in cognition. Physiol. Rev. 2010, 90:1195-1268. 10.1152/physrev.00035.2008.
90. Womelsdorf T., Fries P. The role of neuronal synchronization in selective attention. Curr. Opin. Neurobiol. 2007, 17:154-160. 10.1016/j.conb.2007.02.002.
91. Zillmann D. Attribution and misattribution of excitatory reactions. New Directions in Attribution Research 1978, 335-368. Lawrence Erlaub Associates, Hillsdale, NJ. J.H. Harvey, W.J. Ickes, R.F. Kidd (Eds.).