Contextual novelty modulates the neural dynamics of reward anticipation

Journal of Neuroscience

Volumn 31, Issue 36, 2011, Pages 12816-12822

  Bunzeck, Nico ^a   Guitart Masip, Marc ^b   Dolan, Ray J ^c   Düzel, Emrah ^b,d  

^a UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c WELLCOME TRUST CENTRE FOR NEUROIMAGING   (United Kingdom)

^d OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANTICIPATION; ARTICLE; ASSOCIATION; BETA RHYTHM; BRAIN ELECTROPHYSIOLOGY; CONTROLLED STUDY; EVENT RELATED FIELD; FEMALE; HIPPOCAMPUS; HUMAN; HUMAN EXPERIMENT; MAGNETOENCEPHALOGRAPHY; MALE; NERVE CELL NETWORK; NEUROMODULATION; NORMAL HUMAN; PRIORITY JOURNAL; REWARD; THETA RHYTHM; VENTRAL TEGMENTUM;

ADULT; ANTICIPATION, PSYCHOLOGICAL; BETA RHYTHM; BRAIN; CUES; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; FRACTALS; HUMANS; MAGNETIC RESONANCE IMAGING; MAGNETOENCEPHALOGRAPHY; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; RECOGNITION (PSYCHOLOGY); REWARD; THETA RHYTHM; VISUAL PERCEPTION; YOUNG ADULT;

EID: 80052599648     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0461-11.2011     Document Type: Article

References (60)

1. Aberg C, Nilsson LG (2001) Facilitation of source discrimination in the novelty effect. Scand J Psychol 42:349-357.
2. Axmacher N, Mormann F, Fernández G, Elger CE, Fell J (2006) Memory formation by neuronal synchronization. Brain Res Rev 52:170-182.
3. Bilder RM, Volavka J, Lachman HM, Grace AA (2004) The catechol-Omethyltransferase polymorphism: relations to the tonic-phasic dopamine hypothesis and neuropsychiatric phenotypes. Neuropsychopharmacology 29:1943-1961.
4. Bunzeck N, Dzel E (2006) Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron 51:369-379.
5. Bunzeck N, Schutze H, Stallforth S, Kaufmann J, Düzel S, Heinze HJ, Düzel E (2007) Mesolimbic novelty processing in older adults. Cereb Cortex 17:2940-2948.
6. Bunzeck N, Doeller CF, Fuentemilla L, Dolan RJ, Duzel E (2009) Reward motivation accelerates the onset of neural novelty signals in humans to 85 milliseconds. Curr Biol 19:1294-1300.
7. Buzsáki G (2002) Theta oscillations in the hippocampus. Neuron 33:325-340.
8. Buzsáki G, Draguhn A (2004) Neuronal oscillations in cortical networks. Science 304:1926-1929.
9. Cavanagh JF, Frank MJ, Klein TJ, Allen JJ (2010) Frontal theta links predic-tion errors to behavioral adaptation in reinforcement learning. Neuroimage 49:3198-3209.
10. Christie GJ, Tata MS (2009) Right frontal cortex generates reward-related theta-band oscillatory activity. Neuroimage 48:415-422.
11. Cohen MX, Elger CE, Ranganath C (2007) Reward expectation modulates feedback-related negativity and EEG spectra. Neuroimage 35:968-978.
12. Cohen MX, Axmacher N, Lenartz D, Elger CE, Sturm V, Schlaepfer TE (2009a) Neuroelectric signatures of reward learning and decisionmaking in the human nucleus accumbens. Neuropsychopharmacology 34:1649-1658.
13. Cohen MX, Axmacher N, Lenartz D, Elger CE, Sturm V, Schlaepfer TE (2009b) Good vibrations: cross-frequency coupling in the human nucleus accumbens during reward processing. J Cogn Neurosci 21:875-889.
14. Cohen MX, Axmacher N, Lenartz D, Elger CE, Sturm V, Schlaepfer TE (2009c) Nuclei accumbens phase synchrony predicts decision-making reversals following negative feedback. J Neurosci 29:7591-7598.
15. Cohen MX, Bour L, Mantione M, Figee M, Vink M, Tijssen MA, Rootselaar AF, Munckhof PV, Richard Schuurman P, Denys D (2011) Top-downdirected synchrony from medial frontal cortex to nucleus accumbens during reward anticipation. Hum Brain Mapp. Advance online publication. Retrieved May 27, 2011. doi:10.1002/hbm.21195.
16. Donamayor N, Marco-Pallares J, Heldmann M, Schoenfeld MA, Munte TF (2011) Temporal dynamics of reward processing revealed by magnetoencephalography. Hum Brain Mapp. Advance online publication. Retrieved February 28, 2011. doi:10.1002/hbm.21184.
17. Düzel E, Habib R, Guderian S, Heinze HJ (2004) Four types of noveltyfamiliarity responses in associative recognition memory of humans. Eur J Neurosci 19:1408-1416.
18. Düzel E, Bunzeck N, Guitart-Masip M, Wittmann B, Schott BH, Tobler PN (2009) Functional imaging of the human dopaminergic midbrain. Trends Neurosci 32:321-328.
19. Düzel E, Penny WD, Burgess N (2010) Brain oscillations and memory. Curr Opin Neurobiol 20:143-149.
20. Furl N, van Rijsbergen NJ, Treves A, Friston KJ, Dolan RJ (2007) Experience-dependent coding of facial expression in superior temporal sulcus. Proc Natl Acad Sci U S A 104:13485-13489.
21. Gonsalves BD, Kahn I, Curran T, Norman KA, Wagner AD (2005) Memory strength and repetition suppression: multimodal imaging of medial temporal cortical contributions to recognition. Neuron 47:751-761.
22. Goto Y, Grace AA (2008) Limbic and cortical information processing in the nucleus accumbens. Trends Neurosci 31:552-558.
23. Guitart-Masip M, Bunzeck N, Stephan KE, Dolan RJ, Düzel E (2010) Contextual novelty changes reward representations in the striatum. J Neurosci 30:1721-1726.
24. Hasselmo ME (2006) The role of acetylcholine in learning and memory. Curr Opin Neurobiol 16:710-715.
25. Henson RN (2003) Neuroimaging studies of priming. Prog Neurobiol 70:53-81.
26. Henson RN, Mouchlianitis E, Matthews WJ, Kouider S (2008) Electrophysiological correlates of masked face priming. Neuroimage 40:884-895.
27. Holroyd CB, Coles MG (2002) The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev 109:679-709.
28. Johnson JD, Muftuler LT, Rugg MD (2008) Multiple repetitions reveal functionally and anatomically distinct patterns of hippocampal activity during continuous recognition memory. Hippocampus 18:975-980.
29. Kakade S, Dayan P (2002) Dopamine: generalization and bonuses. Neural Netw 15:549-559.
30. Kawagoe R, Takikawa Y, Hikosaka O (1998) Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1:411-416.
31. Kiebel SJ, Friston KJ (2004a) Statistical parametric mapping for eventrelated potentials: I. Generic considerations. Neuroimage 22:492-502.
32. Kiebel SJ, Friston KJ (2004b) Statistical parametric mapping for eventrelated potentials: II. A hierarchical temporal model. Neuroimage 22:503-520.
33. Kilner J, Friston K (2010) Topological inference for EEG and MEG. Ann Appl Statistics 4:1272-1290.
34. Klimesch W, Freunberger R, Sauseng P, Gruber W (2008) A short review of slow phase synchronization and memory: evidence for control processes in different memory systems? Brain Res 1235:31-44.
35. Knutson B, Cooper JC (2005) Functional magnetic resonance imaging of reward prediction. Curr Opin Neurol 18:411-417.
36. Lisman JE, Grace AA (2005) The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46:703-713.
37. Litvak V, Mattout J, Kiebel S, Phillips C, Henson R, Kilner J, Barnes G, Oostenveld R, Daunizeau J, Flandin G, Penny W, Friston K (2011) EEG and MEG data analysis in SPM8. Comput Intell Neurosci 2011:852961.
38. Marco-Pallares J, Cucurell D, Cunillera T, García R, Andrés-Pueyo A, Münte TF, Rodríguez-Fornells A (2008) Human oscillatory activity associated to reward processing in a gambling task. Neuropsychologia 46:241-248.
39. Marco-Pallarés J, Cucurell D, Cunillera T, Krämer UM, Càmara E, Nager W, Bauer P, Schüle R, Schöls L, Münte TF, Rodriguez-Fornells A (2009) Genetic variability in the dopamine system (dopamine receptor D4, catechol-O-methyltransferase) modulates neurophysiological responses to gains and losses. Biol Psychiatry 66:154-161.
40. Nieuwenhuis S, Yeung N, Holroyd CB, Schurger A, Cohen JD (2004) Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cereb Cortex 14:741-747.
41. O'Doherty JP (2004) Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol 14:769-776.
42. Pessiglione M, Schmidt L, Draganski B, Kalisch R, Lau H, Dolan RJ, Frith CD (2007) How the brain translates money into force: a neuroimaging study of subliminal motivation. Science 316:904-906.
43. Peters J, Buchel C (2009) Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision making. J Neurosci 29:15727-15734.
44. Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233-238.
45. Ranganath C, Rainer G (2003) Neural mechanisms for detecting and remembering novel events. Nat Rev Neurosci 4:193-202.
46. Rugg MD, Curran T (2007) Event-related potentials and recognition memory. Trends Cogn Sci 11:251-257.
47. San Martín R, Manes F, Hurtado E, Isla P, Ibañez A (2010) Size and probability of rewards modulate the feedback error-related negativity associated with wins but not losses in a monetarily rewarded gambling task. Neuroimage 51:1194-1204.
48. Schultz W (2004) Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Curr Opin Neurobiol 14:139-147.
49. Schultz W (2007) Multiple dopamine functions at different time courses. Annu Rev Neurosci 30:259-288.
50. Shuler MG, Bear MF (2006) Reward timing in the primary visual cortex. Science 311:1606-1609.
51. Tobler PN, Fiorillo CD, Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307:1642-1645.
52. Tsivilis D, Otten LJ, Rugg MD (2001) Context effects on the neural correlates of recognition memory: an electrophysiological study. Neuron 31:497-505.
53. van Wingerden M, Vinck M, Lankelma J, Pennartz CM (2010) Theta-band phase locking of orbitofrontal neurons during reward expectancy. J Neurosci 30:7078-7087.
54. Watanabe M (1996) Reward expectancy in primate prefrontal neurons. Nature 382:629-632.
55. Weil RS, Kilner JM, Haynes JD, Rees G (2007) Neural correlates of perceptual filling-in of an artificial scotoma in humans. Proc Natl Acad SciU S A 104:5211-5216.
56. Worsley KJ, Marrett S, Neelin P, Vandal AC, Friston KJ, Evans AC (1996) A unified statistical approach for determining significant signals in images of cerebral activation. Hum Brain Mapp 4:58-73.
57. Worsley KJ, Taylor JE, Tomaiuolo F, Lerch J (2004) Unified univariate and multivariate random field theory. Neuroimage 23 [Suppl 1]:S189-S195.
58. Wu Y, Zhou X (2009) The P300 and reward valence, magnitude, and expectancy in outcome evaluation. Brain Res 1286:114-122.
59. Yeung N, Sanfey AG (2004) Independent coding of reward magnitude and valence in the human brain. J Neurosci 24:6258-6264.
60. Zaghloul KA, Blanco JA, Weidemann CT, McGill K, Jaggi JL, Baltuch GH, Kahana MJ (2009) Human substantia nigra neurons encode unexpected financial rewards. Science 323:1496-1499.