Offline reactivation of experience-dependent neuronal firing patterns in the rat ventral tegmental area

Journal of Neurophysiology

Volumn 114, Issue 2, 2015, Pages 1183-1195

  Valdés, José L ^a,b   McNaughton, Bruce L ^c,d   Fellous, Jean Marc ^b  

^a UNIVERSITY OF CHILE   (Chile)

^b UNIVERSITY OF ARIZONA   (United States)

^c UNIVERSITY OF LETHBRIDGE   (Canada)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Dopamine; Reinforcement; Sleep

Indexed keywords

APOMORPHINE; QUININE; DOPAMINE;

ADULT; ANIMAL CELL; ANIMAL TISSUE; ARTICLE; CELL POPULATION; CONTROLLED STUDY; CORPUS STRIATUM; DOPAMINERGIC NERVE CELL; ELECTROENCEPHALOGRAM; ELECTROMYOGRAM; HIPPOCAMPUS; IMMUNOHISTOCHEMISTRY; MALE; MEMORY CONSOLIDATION; NEOCORTEX; NERVE CELL PLASTICITY; NERVE POTENTIAL; NERVOUS SYSTEM PARAMETERS; NEURONAL FIRING PATTERN; NISSL STAINING; NONHUMAN; NONREM SLEEP; PRIORITY JOURNAL; RAT; REM SLEEP; SLEEP STAGE; SLOW WAVE SLEEP; STIMULUS; TASTE; VENTRAL TEGMENTUM; WAKEFULNESS; ACTION POTENTIAL; ANIMAL; FISCHER 344 RAT; METABOLISM; MICROELECTRODE; NERVE CELL; PHYSIOLOGY; SLEEP;

ACTION POTENTIALS; ANIMALS; DOPAMINE; MALE; MICROELECTRODES; NEURONS; RATS, INBRED F344; SLEEP; VENTRAL TEGMENTAL AREA; WAKEFULNESS;

EID: 84940038918     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00758.2014     Document Type: Article

References (70)

1. Bendor D, Wilson MA. Biasing the content of hippocampal replay during sleep. Nat Neurosci 15: 1439-1444, 2012.
2. Carr MF, Jadhav SP, Frank LM. Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval. Nat Neurosci 14: 147-153, 2011.
3. Carr MF, Karlsson MP, Frank LM. Transient slow gamma synchrony underlies hippocampal memory replay. Neuron 75: 700-713, 2012.
4. Chaudhury D, Walsh JJ, Friedman AK, Juarez B, Ku SM, Koo JW, Ferguson D, Tsai HC, Pomeranz L, Christoffel DJ, Nectow AR, Ekstrand M, Domingos A, Mazei-Robison MS, Mouzon E, Lobo MK, Neve RL, Friedman JM, Russo SJ, Deisseroth K, Nestler EJ, Han MH. Rapid regulation of depression-related behaviours by control of midbrain dopamine neurons. Nature 493: 532-536, 2013.
5. Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482: 85-88, 2012.
6. Corral-Frias NS, Lahood RP, Edelman-Vogelsang KE, French ED, Fellous JM. Involvement of the ventral tegmental area in a rodent model of post-traumatic stress disorder. Neuropsychopharmacology 38: 350-363, 2013.
7. Dahan L, Astier B, Vautrelle N, Urbain N, Kocsis B, Chouvet G. Prominent burst firing of dopaminergic neurons in the ventral tegmental area during paradoxical sleep. Neuropsychopharmacology 32: 1232-1241, 2007.
8. Davidson TJ, Kloosterman F, Wilson MA. Hippocampal replay of extended experience. Neuron 63: 497-507, 2009.
9. Diba K, Buzsaki G. Forward and reverse hippocampal place-cell sequences during ripples. Nat Neurosci 10: 1241-1242, 2007.
10. Edelmann E, Lessmann V. Dopamine regulates intrinsic excitability thereby gating successful induction of spike timing-dependent plasticity in CA1 of the hippocampus. Front Neurosci 7: 25, 2013.
11. Euston DR, Tatsuno M, McNaughton BL. Fast-forward playback of recent memory sequences in prefrontal cortex during sleep. Science 318: 1147- 1150, 2007.
12. Feld GB, Besedovsky L, Kaida K, Munte TF, Born J. Dopamine D2-like receptor activation wipes out preferential consolidation of high over low reward memories during human sleep. J Cogn Neurosci 26: 2310-2320, 2014.
13. Fellous J, Canavier CC, Hasselmo ME. Neuromodulation: Increasing computational power. In: From Neuron to Cognition, edited by Arbib MA. Cambridge, MA: MIT Press, 2015.
14. Fellous JM, Linster C. Computational models of neuromodulation. Neural Comput 10: 771-805, 1998.
15. Foster DJ, Wilson MA. Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440: 680-683, 2006.
16. Gasbarri A, Sulli A, Packard MG. The dopaminergic mesencephalic projections to the hippocampal formation in the rat. Prog Neuropsychopharmacol Biol Psychiatry 21: 1-22, 1997.
17. Grace AA, Bunney BS. Intracellular and extracellular electrophysiology of nigral dopaminergic neurons-1. Identification and characterization. Neuroscience 10: 301-315, 1983.
18. Gupta AS, van der Meer MA, Touretzky DS, Redish AD. Hippocampal replay is not a simple function of experience. Neuron 65: 695-705, 2010.
19. Hasselmo ME. Temporally structured replay of neural activity in a model of entorhinal cortex, hippocampus and postsubiculum. Eur J Neurosci 28: 1301-1315, 2008.
20. Hoffman KL, McNaughton BL. Coordinated reactivation of distributed memory traces in primate neocortex. Science 297: 2070-2073, 2002.
21. Ji D, Wilson MA. Coordinated memory replay in the visual cortex and hippocampus during sleep. Nat Neurosci 10: 100-107, 2007.
22. Johnson A, Redish AD. Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model. Neural Netw 18: 1163-1171, 2005.
23. Karlsson MP, Frank LM. Awake replay of remote experiences in the hippocampus. Nat Neurosci 12: 913-918, 2009.
24. Kruskal PB, Stanis JJ, McNaughton BL, Thomas PJ. A binless correlation measure reduces the variability of memory reactivation estimates. Stat Med 26: 3997-4008, 2007.
25. Kudrimoti HS, Barnes CA, McNaughton BL. Reactivation of hippocampal cell assemblies: effects of behavioral state, experience, and EEG dynamics. J Neurosci 19: 4090-4101, 1999.
26. Lammel S, Lim BK, Ran C, Huang KW, Betley MJ, Tye KM, Deisseroth K, Malenka RC. Input-specific control of reward and aversion in the ventral tegmental area. Nature 491: 212-217, 2012.
27. Lansink CS, Goltstein PM, Lankelma JV, Joosten RN, McNaughton BL, Pennartz CM. Preferential reactivation of motivationally relevant information in the ventral striatum. J Neurosci 28: 6372-6382, 2008.
28. Lee AK, Wilson MA. Memory of sequential experience in the hippocampus during slow wave sleep. Neuron 36: 1183-1194, 2002.
29. Lee RS, Steffensen SC, Henriksen SJ. Discharge profiles of ventral tegmental area GABA neurons during movement, anesthesia, and the sleep-wake cycle. J Neurosci 21: 1757-1766, 2001.
30. Lisman J, Grace AA, Duzel E. A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP. Trends Neurosci 34: 536- 547, 2011.
31. Lisman JE, Grace AA. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46: 703-713, 2005.
32. Livneh U, Paz R. Aversive-bias and stage-selectivity in neurons of the primate amygdala during acquisition, extinction and overnight retention. J Neurosci 32: 8598-8610, 2012.
33. Margolis EB, Lock H, Hjelmstad GO, Fields HL. The ventral tegmental area revisited: is there an electrophysiological marker for dopaminergic neurons? J Physiol 577: 907-924, 2006.
34. Margolis EB, Mitchell JM, Ishikawa J, Hjelmstad GO, Fields HL. Midbrain dopamine neurons: projection target determines action potential duration and dopamine D(2) receptor inhibition. J Neurosci 28: 8908-8913, 2008.
35. Marr D. Simple memory: a theory for archicortex. Philos Trans R Soc Lond B Biol Sci 262: 23-81, 1971.
36. McClelland JL, McNaughton BL, O'Reilly RC. Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol Rev 102: 419-457, 1995.
37. Monti JM, Monti D. The involvement of dopamine in the modulation of sleep and waking. Sleep Med Rev 11: 113-133, 2007.
38. Nadasdy Z, Hirase H, Czurko A, Csicsvari J, Buzsaki G. Replay and time compression of recurring spike sequences in the hippocampus. J Neurosci 19: 9497-9507, 1999.
39. Nair-Roberts RG, Chatelain-Badie SD, Benson E, White-Cooper H, Bolam JP, Ungless MA. Stereological estimates of dopaminergic, GABAergic and glutamatergic neurons in the ventral tegmental area, substantia nigra and retrorubral field in the rat. Neuroscience 152: 1024-1031, 2008.
40. Oades RD, Halliday GM. Ventral tegmental (A10) system: neurobiology. 1. Anatomy and connectivity. Brain Res 434: 117-165, 1987.
41. Packard MG, White NM. Dissociation of hippocampus and caudate nucleus memory systems by posttraining intracerebral injection of dopamine agonists. Behav Neurosci 105: 295-306, 1991.
42. Paxinos G, Watson C. The Rat Brain in Stereotaxic Coordinates. San Diego, CA: Academic, 1998.
43. Pennartz CM, Lee E, Verheul J, Lipa P, Barnes CA, McNaughton BL. The ventral striatum in off-line processing: ensemble reactivation during sleep and modulation by hippocampal ripples. J Neurosci 24: 6446 - 6456, 2004.
44. Peyrache A, Khamassi M, Benchenane K, Wiener SI, Battaglia FP. Replay of rule-learning related neural patterns in the prefrontal cortex during sleep. Nat Neurosci 12: 919-926, 2009.
45. Popa D, Duvarci S, Popescu AT, Lena C, Pare D. Coherent amygdalocortical theta promotes fear memory consolidation during paradoxical sleep. Proc Natl Acad Sci USA 107: 6516-6519, 2010.
46. Puryear CB, Kim MJ, Mizumori SJ. Conjunctive encoding of movement and reward by ventral tegmental area neurons in the freely navigating rodent. Behav Neurosci 124: 234-247, 2010.
47. Qin YL, McNaughton BL, Skaggs WE, Barnes CA. Memory reprocessing in corticocortical and hippocampocortical neuronal ensembles. Philos Trans R Soc Lond B Biol Sci 352: 1525-1533, 1997.
48. Ribeiro S, Gervasoni D, Soares ES, Zhou Y, Lin SC, Pantoja J, Lavine M, Nicolelis MA. Long-lasting novelty-induced neuronal reverberation during slow-wave sleep in multiple forebrain areas. PLoS Biol 2: E24, 2004.
49. Roeper J. Dissecting the diversity of midbrain dopamine neurons. Trends Neurosci 36: 336-342, 2013.
50. Roesch MR, Calu DJ, Schoenbaum G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat Neurosci 10: 1615-1624, 2007.
51. Samson RD, Frank MJ, Fellous JM. Computational models of reinforcement learning: the role of dopamine as a reward signal. Cogn Neurodyn 4: 91-105, 2010.
52. Schultz W. Multiple dopamine functions at different time courses. Annu Rev Neurosci 30: 259-288, 2007.
53. Schultz W. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Curr Opin Neurobiol 14: 139-147, 2004.
54. Schwindel CD, McNaughton BL. Hippocampal-cortical interactions and the dynamics of memory trace reactivation. Prog Brain Res 193: 163-177, 2011.
55. Shen B, McNaughton BL. Modeling the spontaneous reactivation of experience- specific hippocampal cell assembles during sleep. Hippocampus 6: 685-692, 1996.
56. Shohamy D, Adcock RA. Dopamine and adaptive memory. Trends Cogn Sci 14: 464-472, 2010.
57. Singer AC, Frank LM. Rewarded outcomes enhance reactivation of experience in the hippocampus. Neuron 64: 910-921, 2009.
58. Stamatakis AM, Stuber GD. Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance. Nat Neurosci 15: 1105- 1107, 2012.
59. Stickgold R, Walker MP. Sleep-dependent memory consolidation and reconsolidation. Sleep Med 8: 331-343, 2007.
60. Sutherland GR, McNaughton B. Memory trace reactivation in hippocampal and neocortical neuronal ensembles. Curr Opin Neurobiol 10: 180-186, 2000.
61. Tatsuno M, Lipa P, McNaughton BL. Methodological considerations on the use of template matching to study long-lasting memory trace replay. J Neurosci 26: 10727-10742, 2006.
62. Tsai HC, Zhang F, Adamantidis A, Stuber GD, Bonci A, de Lecea L, Deisseroth K. Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324: 1080-1084, 2009.
63. Tye KM, Mirzabekov JJ, Warden MR, Ferenczi EA, Tsai HC, Finkelstein J, Kim SY, Adhikari A, Thompson KR, Andalman AS, Gunaydin LA, Witten IB, Deisseroth K. Dopamine neurons modulate neural encoding and expression of depression-related behaviour. Nature 493: 537-541, 2013.
64. Uncapher MR, Rugg MD. Selecting for memory? The influence of selective attention on the mnemonic binding of contextual information. J Neurosci 29: 8270-8279, 2009.
65. Ungless MA. Dopamine: the salient issue. Trends Neurosci 27: 702-706, 2004.
66. Ungless MA, Grace AA. Are you or aren't you? Challenges associated with physiologically identifying dopamine neurons. Trends Neurosci 35: 422- 430, 2012.
67. Waelti P, Dickinson A, Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412: 43-48, 2001.
68. White NM, Packard MG, Seamans J. Memory enhancement by post-training peripheral administration of low doses of dopamine agonists: possible autoreceptor effect. Behav Neural Biol 59: 230-241, 1993.
69. Wilson MA, McNaughton BL. Dynamics of the hippocampal ensemble code for space. Science 261: 1055-1058, 1993.
70. Witten IB, Steinberg EE, Lee SY, Davidson TJ, Zalocusky KA, Brodsky M, Yizhar O, Cho SL, Gong S, Ramakrishnan C, Stuber GD, Tye KM, Janak PH, Deisseroth K. Recombinase-driver rat lines: tools, techniques, and optogenetic application to dopamine-mediated reinforcement. Neuron 72: 721-733, 2011.