Theta phase precession beyond the hippocampus

Reviews in the Neurosciences

Volumn 23, Issue 1, 2012, Pages 39-65

  Malhotra, Sushant ^a   Cross, Robert W A ^a   Van Der Meer, Matthijs A A ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

decoding; local field potential; medial prefrontal cortex; nucleus accumbens; phase coding; spike timing; temporal coding; ventral striatum

Indexed keywords

ASSOCIATION; BRAIN FUNCTION; BRAIN REGION; CONDITIONING; CONTEXT DEPENDENT REINSTATEMENT; CORPUS STRIATUM; DECISION MAKING; HIPPOCAMPUS; HUMAN; LEARNING; MEMORY; MOVEMENT (PHYSIOLOGY); NERVE CELL EXCITABILITY; NEUROANATOMY; NONHUMAN; OSCILLATION; PLACE PREFERENCE; PREFRONTAL CORTEX; PRIORITY JOURNAL; REVIEW; REWARD; SPIKE WAVE; SUBICULUM; THETA PHASE PRECESSION; THETA RHYTHM;

ACTION POTENTIALS; ANIMALS; BASAL GANGLIA; HIPPOCAMPUS; HUMANS; MODELS, NEUROLOGICAL; NEURAL PATHWAYS; NEURONS; THETA RHYTHM;

EID: 84860530542     PISSN: 03341763     EISSN: None     Source Type: Journal    
DOI: 10.1515/revneuro-2011-0064     Document Type: Review

References (266)

1. Addante, R.J., Watrous, A.J., Yonelinas, A.P., Ekstrom, A.D., and Ranganath, C. (2011). Prestimulus theta activity predicts correct source memory retrieval. Proc. Natl. Acad. Sci. USA 108, 10702-10707.
2. Alvernhe, A., Van Cauter, T., Save, E., and Poucet, B. (2008). Different CA1 and CA3 representations of novel routes in a shortcut situation. J. Neurosci. 28, 7324-7333.
3. Amaral, D.G. and Lavenex, P. (2006). Hippocampal Neuroanatomy. The Hippocampus Book. P. Andersen, R. Morris, D. Amaral, T. Bliss and J. O'Keefe, eds. (Oxford University Press), pp. 37-113.
4. Anagnostaras, S.G., Gale, G.D., and Fanselow, M.S. (2001). Hippocampus and contextual fear conditioning: Recent controversies and advances. Hippocampus 11, 8-17.
5. Apicella, P., Ljungberg, T., Scarnati, E., and Schultz, W. (1991). Responses to reward in monkey dorsal and ventral striatum. Exp. Brain. Res. 85, 491-500.
6. Bannerman, D.M., Rawlins, J.N.P., McHugh, S.B., Deacon, R.M.J., Yee, B.K., Bast, T., Zhang, W.-N., Pothuizen, H.H.J., and Feldon, J. (2004). Regional dissociations within the hippocampus-memory and anxiety. Neurosci. Biobehav. Rev. 28, 273-283. (Pubitemid 38844376)
7. Bast, T. (2007). Toward an integrative perspective on hippocampal function: From the rapid encoding of experience to adaptive behavior. Rev. Neurosci. 18, 253-281.
8. Bast, T. (2011). The hippocampal learning-behavior translation and the functional significance of hippocampal dysfunction in schizophrenia. Curr. Opin. Neurobiol. 21, 492-501.
9. Bast, T. and Feldon, J. (2003). Hippocampal modulation of senso-rimotor processes. Prog. Neurobiol. 70, 319-345.
10. Battaglia, F.P., Benchenane, K., Sirota, A., Pennartz, C.M., and Wiener, S.I. (2011). The hippocampus: Hub of brain network communication for memory. Trends Cogn. Sci. 15, 310-318.
11. Beck, A., Schlagenhauf, F., Wüstenberg, T., Hein, J., Kienast, T., Kahnt, T., Schmack, K., Hägele, C., Knutson, B., Heinz, A., et al. (2009). Ventral striatal activation during reward anticipation correlates with impulsivity in alcoholics. Biol. Psychiatry 66, 734-742.
12. Benchenane, K., Peyrache, A., Khamassi, M., Tierney, P.L., Gioanni, Y., Battaglia, F.P., and Wiener, S.I. (2010). Coherent theta oscillations and reorganization of spike timing in the hippocam-pal-prefrontal network upon learning. Neuron 66, 921-936.
13. Berens, P., Keliris, G.A., Ecker, A.S., Logothetis, N.K., and Tolias, A.S. (2008). Feature selectivity of the gamma-band of the local field potential in primate primary visual cortex. Front. Neurosci. 2, 199-207.
14. Berens, P., Ecker, A.S., Gerwinn, S., Tolias, A.S., and Bethge, M. (2011). Reassessing optimal neural population codes with neuro-metric functions. Proc. Natl. Acad. Sci. USA 108, 4423-4428.
15. Berke, J.D. (2009). Fast oscillations in cortical-striatal networks switch frequency following rewarding events and stimulant drugs. Eur. J. Neurosci. 30, 848-859.
16. Berke, J.D. (2011). Functional properties of striatal fast-spiking interneurons. Front. Syst. Neurosci. 5, 1-7.
17. Berke, J.D., Okatan, M., Skurski, J., and Eichenbaum, H.B. (2004). Oscillatory entrainment of striatal neurons in freely-moving rats. Neuron 43, 883-896. (Pubitemid 39215018)
18. Berridge, K. (2007). The debate over dopamine s role in reward: The case for incentive salience. Psychopharmacology 191, 391-431. (Pubitemid 46355895)
19. Bi, G. and Poo, M. (1998). Synaptic modifications in cultured hip-pocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18, 10464-10472. (Pubitemid 29016566)
20. Blaha, C.D., Yang, C.R., Floresco, S.B., Barr, A.M., and Phillips, A.G. (1997). Stimulation of the ventral subiculum of the hippocampus evokes glutamate receptor-mediated changes in dopamine efflux in the rat nucleus accumbens. Eur. J. Neurosci. 9, 902-911.
21. Blair, H.T., Gupta, K., and Zhang, K. (2008). Conversion of a phase-to a rate-coded position signal by a three-stage model of theta cells, grid cells, and place cells. Hippocampus 18, 1239-1255.
22. Bland, B.H. and Oddie, S.D. (2001). Theta band oscillation and synchrony in the hippocampal formation and associated structures: The case for its role in sensorimotor integration. Behav. Brain Res. 127, 119-136. (Pubitemid 33069358)
23. Blumenthal, A., Steiner, A., Seeland, K., and David Redish, A. (2011). Effects of pharmacological manipulations of NMDA-receptors on deliberation in the Multiple-T task. Neurobiol. Learn. Mem. 95, 376-384.
24. Boeijinga, P.H., Mulder, A.B., Pennartz, C.M., Manshanden, I., and Lopes da Silva, F.H. (1993). Responses of the nucleus accum-bens following fornix/fimbria stimulation in the rat. Identification and long-term potentiation of mono-and polysynaptic pathways. Neuroscience 53, 1049-1058. (Pubitemid 23126100)
25. Bornstein, A.M. and Daw, N.D. (2011). Multiplicity of control in the basal ganglia: Computational roles of striatal subregions. Curr. Opin. Neurobiol. 21, 374-380.
26. Bose, A. and Recce, M. (2001). Phase precession and phase-locking of hippocampal pyramidal cells. Hippocampus 11, 204-215. (Pubitemid 32655282)
27. Bossert, J.M., Poles, G.C., Wihbey, K.A., Koya, E., and Shaham, Y. (2007). Differential effects of blockade of dopamine D1-family receptors in nucleus accumbens core or shell on reinstatement of heroin seeking induced by contextual and discrete cues. J. Neurosci. 27, 12655-12663. (Pubitemid 350127821)
28. Brandon, M.P., Bogaard, A.R., Libby, C.P., Connerney, M.A., Gupta, K., and Hasselmo, M.E. (2011). Reduction of theta rhythm dissociates grid cell spatial periodicity from directional tuning. Science 332, 595-599.
29. Brog, J., Salyapongse, A., Deutch, A., and Zahm, D. (1993). The patterns of afferent innervation of the core and shell in the " accumbens " part of the rat ventral striatum: Immunohistochemical detection of retrogradely transported. J. Comp. Neurol. 338, 255-278. (Pubitemid 23339283)
30. Burgess, N. and O'Keefe, J. (2011). Models of place and grid cell firing and theta rhythmicity. Curr. Opin. Neurobiol. 21, 734-744.
31. Burgess, N., Barry, C., and O'Keefe, J. (2007). An oscillatory interference model of grid cell firing. Hippocampus 17, 801-812. (Pubitemid 47493460)
32. Burton, B.G., Hok, V., Save, E., and Poucet, B. (2009). Lesion of the ventral and intermediate hippocampus abolishes anticipatory activity in the medial prefrontal cortex of the rat. Behav. Brain Res. 199, 222-234.
33. Buzsáki G.(2002). Theta oscillations in the hippocampus. Neuron 33: 325-340. (Pubitemid 34158839)
34. Buzsáki, G. (2005). Theta rhythm of navigation: Link between path integration and landmark navigation, episodic and semantic memory. Hippocampus 15, 827-840 (Pubitemid 41556413)
35. Buzsáki, G., Leung, L.W., and Vanderwolf, C.H. (1983). Cellular bases of hippocampal EEG in the behaving rat. Brain Res. 287, 139-171. (Pubitemid 14230350)
36. Cardinal, R.N., Parkinson, J.A., Hall, J., and Everitt, B.J. (2002). Emotion and motivation: The role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26, 321-352. (Pubitemid 34555410)
37. Carelli, R.M. and Deadwyler, S.A. (1994). A comparison of nucleus accumbens neuronal firing patterns during cocaine self-administration and water reinforcement in rats. J. Neurosci. 14, 7735-7746. (Pubitemid 24983711)
38. Carelli, R.M., Ijames, S., and Crumling, A. (2000). Evidence that separate neural circuits in the nucleus accumbens encode cocaine versus natural (water and food) reward. J. Neurosci. 20, 4255-4266. (Pubitemid 30365697)
39. Chaudhri, N., Sahuque, L.L., Schairer, W.W., and Janak, P.H. (2010). Separable roles of the nucleus accumbens core and shell in context-and cue-induced alcohol-seeking. Neuropsychopharmacology 35, 783-791.
40. Cheng, S. and Frank, L.M. (2008). New experiences enhance coordinated neural activity in the hippocampus. Neuron 57, 303-313.
41. Ciccocioppo, R., Martin-Fardon, R., and Weiss, F. (2004). Stimuli associated with a single cocaine experience elicit long-lasting cocaine-seeking. Nat. Neurosci. 7, 495-496. (Pubitemid 38544586)
42. Cohen, M.X., Axmacher, N., Lenartz, D., Elger, C.E., Sturm, V., and Schlaepfer, T.E. (2009a). Good vibrations: Cross-frequency coupling in the human nucleus accumbens during reward processing. J. Cogn. Neurosci. 21, 875-889.
43. Cohen, M.X., Axmacher, N., Lenartz, D., Elger, C.E., Sturm, V., and Schlaepfer, T.E. (2009b). Nuclei accumbens phase synchrony predicts decision-making reversals following negative feedback. J. Neurosci. 29, 7591-7598.
44. Colgin, L.L., Denninger, T., Fyhn, M., Hafting, T., Bonnevie, T., Jensen, O., Moser, M.-B., and Moser, E.I. (2009). Frequency of gamma oscillations routes flow of information in the hippocampus. Nature 462, 353-357.
45. Colgin, L.L., Leutgeb, S., Jezek, K., Leutgeb, J.K., Moser, E.I., McNaughton, B.L., and Moser, M.-B. (2010). Attractor-map versus autoassociation based attractor dynamics in the hippocampal network. J. Neurophysiol. 104, 35-50.
46. Conklin, C.A. (2006). Environments as cues to smoke: Implications for human extinction-based research and treatment. Exp. Clin. Psychopharmacol. 14, 12-19.
47. Corbit, L.H., Ostlund, S.B., and Balleine, B.W. (2002). Sensitivity to instrumental contingency degradation is mediated by the ento-rhinal cortex and its efferents via the dorsal hippocampus. J. Neurosci. 22, 10976-10984. (Pubitemid 36005174)
48. Crombag, H.S., Grimm, J.W., and Shaham, Y. (2002). Effect of dopamine receptor antagonists on renewal of cocaine seeking by reexposure to drug-associated contextual cues. Neuropsychopharmacology 27, 1006-1015. (Pubitemid 35447637)
49. Crombag, H.S., Bossert, J.M., Koya, E., and Shaham, Y. (2008). Context-induced relapse to drug seeking: A review. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363, 3233-3243.
50. Cromwell, H.C. and Schultz, W. (2003). Effects of expectations for different reward magnitudes on neuronal activity in primate stria-tum. J. Neurophysiol. 89, 2823-2838. (Pubitemid 36570241)
51. Cromwell, H.C., Hassani, O.K., and Schultz, W. (2005). Relative reward processing in primate striatum. Exp. Brain Res. 162, 520-525. (Pubitemid 40684788)
52. Daw, N.D. (2003). Reinforcement learning models of the dopamine system and their behavioral implications. PhD thesis, Carnegie Mellon University, Pittsburgh, PA.
53. Daw, N.D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704-1711. (Pubitemid 41683198)
54. Dayan, P. and Balleine, B.W. (2002). Reward, motivation and reinforcement learning. Neuron 36, 285-298.
55. de Almeida, L., Idiart, M., and Lisman, J.E. (2009). The input-output transformation of the hippocampal granule cells: From grid cells to place fields. J. Neurosci. 29, 7504-7512.
56. Deshmukh, S.S., Yoganarasimha, D., Voicu, H., and Knierim, J.J. (2010). Theta modulation in the medial and the lateral entorhinal cortices. J. Neurophysiol. 104, 994-1006.
57. Diba, K. and Buzsáki, G. (2008). Hippocampal network dynamics constrain the time lag between pyramidal cells across modified environments. J. Neurosci. 28, 13448-13456.
58. Doeller, C.F., Barry, C., and Burgess, N. (2010). Evidence for grid cells in a human memory network. Nature 463, 657-661.
59. Dragoi, G. and Buzsáki, G. (2006). Temporal encoding of place sequences by hippocampal cell assemblies. Neuron 50, 145-157.
60. Dragoi, G. and Tonegawa, S. (2010). Preplay of future place cell sequences by hippocampal cellular assemblies. Nature 469, 397-401.
61. Ego-Stengel, V. and Wilson, M.A. (2007). Spatial selectivity and theta phase precession in CA1 interneurons. Hippocampus 17, 161-174. (Pubitemid 46362610)
62. Eichenbaum, H., Dudchenko, P., Wood, E., Shapiro, M., and Tanila, H. (1999). The hippocampus, memory, and place cells: Is it spatial memory or a memory space? Neuron 23, 209-226. (Pubitemid 29315717)
63. Ekstrom, A.D., Caplan, J.B., Ho, E., Shattuck, K., Fried, I., and Kahana, M.J. (2005). Human hippocampal theta activity during virtual navigation. Hippocampus 15, 881-889. (Pubitemid 41556418)
64. Eschenko, O. and Mizumori, S.J.Y. (2007). Memory influences on hippocampal and striatal neural codes: Effects of a shift between task rules. Neurobiol. Learn. Mem. 87, 495-509. (Pubitemid 46483118)
65. Fanselow, M.S. and Dong, H.-W. (2010). Are the dorsal and ventral hippocampus functionally distinct structures? Neuron 65, 7-19.
66. Fenton, A.A., Lytton, W.W., Barry, J.M., Lenck-Santini, P.-P., Zinyuk, L.E., Kubík, S., Bures, J., Poucet, B., Muller, R.U., and Olypher, A.V. (2010). Attention-like modulation of hippocampus place cell discharge. J. Neurosci. 30, 4613-4625.
67. Ferbinteanu, J. and McDonald, R.J. (2001). Dorsal/ventral hippocampus, fornix, and conditioned place preference. Hippocampus 11, 187-200. (Pubitemid 32433265)
68. Finch, D. (1996). Neurophysiology of converging synaptic inputs from the rat prefrontal cortex, amygdala, midline thalamus, and hippocampal formation onto single neurons of the caudate/puta-men and nucleus accumbens. Hippocampus 6, 495-512. (Pubitemid 26413936)
69. Floresco, S.B., Seamans, J.K., and Phillips, A.G. (1997). Selective roles for hippocampal, prefrontal cortical, and ventral striatal circuits in radial-arm maze tasks with or without a delay. J. Neurosci. 17, 1880-1890. (Pubitemid 27089832)
70. Floresco, S.B., Todd, C.L., and Grace, A.A. (2001). Glutamatergic afferents from the hippocampus to the nucleus accumbens regulate activity of ventral tegmental area dopamine neurons. J. Neurosci. 21, 4915-4922. (Pubitemid 32565650)
71. Fortin, N.J., Agster, K.L., and Eichenbaum, H.B. (2002). Critical role of the hippocampus in memory for sequences of events. Nat. Neurosci. 5, 458-462. (Pubitemid 34454252)
72. Foster, D.J. and Wilson, M.A. (2007). Hippocampal theta sequences. Hippocampus 17, 1093-1099. (Pubitemid 350156823)
73. Fuchs, R.A., Evans, K.A., Ledford, C.C., Parker, M.P., Case, J.M., Mehta, R.H., and See, R.E. (2005). The role of the dorsome-dial prefrontal cortex, basolateral amygdala, and dorsal hippocampus in contextual reinstatement of cocaine seeking in rats. Neuropsychopharmacology 30, 296-309. (Pubitemid 40129481)
74. Fuhs, M.C. and Touretzky, D.S. (2007). Context learning in the rodent hippocampus. Neural Comput. 19, 3173-3215.
75. Geisler, C., Robbe, D., Zugaro, M., Sirota, A., and Buzsáki, G. (2007). Hippocampal place cell assemblies are speed-controlled oscillators. Proc. Natl. Acad. Sci. USA 104, 8149-8154. (Pubitemid 47185890)
76. Geisler, C., Diba, K., Pastalkova, E., Mizuseki, K., Royer, S., and Buzsáki, G. (2010). Temporal delays among place cells determine the frequency of population theta oscillations in the hippocampus. Proc. Natl. Acad. Sci. USA 107, 7957-7962.
77. Gelbard-Sagiv, H., Mukamel, R., Harel, M., Malach, R., and Fried, I. (2008). Internally generated reactivation of single neurons in human hippocampus during free recall. Science 322, 96-101.
78. Ginther, M.R., Walsh, D.F., and Ramus, S.J. (2011). Hippocampal neurons encode different episodes in an overlapping sequence of odors task. J. Neurosci. 31, 2706-2711.
79. Giocomo, L.M., Zilli, E.A., Fransén, E., and Hasselmo, M.E. (2007). Temporal frequency of subthreshold oscillations scales with entorhinal grid cell field spacing. Science 315, 1719-1722. (Pubitemid 46515627)
80. Goto, Y. and O'Donnell, P. (2001). Synchronous activity in the hippocampus and nucleus accumbens in vivo. J. Neurosci. 21, RC131.
81. Goto, Y. and Grace, A.A. (2008). Limbic and cortical information processing in the nucleus accumbens. Trends Neurosci. 31, 552-558.
82. Grace, A.A. (2010). Dopamine system dysregulation by the ventral subiculum as the common pathophysiological basis for schizophrenia psychosis, psychostimulant abuse, and stress. Neurotox. Res. 18, 367-376.
83. Gray, J.A. and McNaughton, N. (2000). The Neuropsychology of Anxiety: An enquiry into the Functions of the Septo-hippocampal System (Oxford: Oxford University Press, 2nd edition).
84. Green, J.D. and Arduini, A.A. (1954). Hippocampal electrical activity in arousal. Neurosci. Lett. 17, 533-554.
85. Groenewegen, H., der Zee, E., Te Kortschot, A., and Witter, M. (1987). Organization of the projections from the subiculum to the ventral striatum in the rat. A study using anterograde transport of Phaseolus vulgaris leucoagglutinin. Neuroscience 23, 103-120. (Pubitemid 17159558)
86. Groenewegen, H.J., Wright, C.I., Beijer, A.V., and Voorn, P. (1999). Convergence and segregation of ventral striatal inputs and outputs. Ann. NY Acad. Sci. 877, 49-63. (Pubitemid 29351850)
87. Gruber, A.J., Hussain, R.J., and O'Donnell, P. (2009). The nucleus accumbens: A switchboard for goal-directed behaviors. PLoS ONE 4, e5062.
88. Gupta, A.S., van der Meer, M.A.A., Touretzky, D.S., and Redish, A.D. (2010). Hippocampal replay is not a simple function of experience. Neuron 65, 695-705.
89. Haber, S.N. (2009). Anatomy and Connectivity of the Reward Circuit. Handbook of Reward and Decision Making. J.-C. Dreher and Tremblay, L., eds. (Amsterdam: Academic Press), pp. 3-27.
90. Hafting, T., Fyhn, M., Bonnevie, T., Moser, M.-B., and Moser, E.I. (2008). Hippocampus-independent phase precession in entorhi-nal grid cells. Nature 453, 1248-1252. (Pubitemid 351913591)
91. Hare, T.A., O'Doherty, J., Camerer, C.F., Schultz, W., and Rangel, A. (2008). Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 28, 5623-5630.
92. Harris, K.D., Henze, D.A., Hirase, H., Leinekugel, X., Dragoi, G., Czurkó, A., and Buzsáki, G. (2002). Spike train dynamics predicts theta-related phase precession in hippocampal pyramidal cells. Nature 417, 738-741. (Pubitemid 34640626)
93. Harvey, C.D., Collman, F., Dombeck, D.A., and Tank, D.W. (2009). Intracellular dynamics of hippocampal place cells during virtual navigation. Nature 461, 941-946.
94. Hassani, O.K., Cromwell, H.C., and Schultz, W. (2001). Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J. Neurophysiol. 85, 2477-2489. (Pubitemid 32525526)
95. Hasselmo, M.E. (2005). What is the function of hippocampal theta rhythm?-Linking behavioral data to phasic properties of field potential and unit recording data. Hippocampus 15, 936-949. (Pubitemid 41556423)
96. Hebb, D. (1949). The Organization of Behavior (New York: Wiley), 911, pp. 112-126.
97. Hirase, H., Czurkó, A., Csicsvari, J., and Buzsáki, G. (1999). Firing rate and theta-phase coding by hippocampal pyramidal neurons during ' space clamping'. Eur. J. Neurosci. 11, 4373-4380. (Pubitemid 30009269)
98. Holland, P.C. and Bouton, M.E. (1999). Hippocampus and context in classical conditioning. Curr. Opin. Neurobiol. 9, 195-202. (Pubitemid 29201792)
99. Hollerman, J.R., Tremblay, L., and Schultz, W. (1998). Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80, 947-963. (Pubitemid 28387672)
100. Holscher, C., Anwyl, R., and Rowan, M.J. (1997). Stimulation on the positive phase of hippocampal theta rhythm induces long-term potentiation that can be depotentiated by stimulation on the negative phase in area CA1 in vivo. J. Neurosci. 17, 6470-6477. (Pubitemid 27329918)
101. Houk, J.C., Adams, J.L., and Barto, A.G. (1995). A Model of How the Basal Ganglia Generate and Use Neural Signals that Predict Reinforcement. Models of Information Processing in the Basal Ganglia. J.C. Houk, J.L. Davis and D.G. Beiser, eds. (Cambridge, MA), pp. 249-270.
102. Hu, H., Vervaeke, K., Graham, L.J., and Storm, J.F. (2009). Complementary theta resonance filtering by two spatially segregated mechanisms in CA1 hippocampal pyramidal neurons. J. Neurosci. 29, 14472-14483.
103. Huh, N., Jo, S., Kim, H., Sul, J.H., and Jung, M.W. (2009). Model-based reinforcement learning under concurrent schedules of reinforcement in rodents. Learn. Mem. 16, 315-323.
104. Humphries, M. and Prescott, T. (2010). The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward. Prog. Neurobiol. 90, 385-417.
105. Huxter, J., Burgess, N., and OKeefe, J. (2003). Independent rate and temporal coding in hippocampal pyramidal cells. Nature 425, 828.
106. Huxter, J.R., Senior, T.J., Allen, K., and Csicsvari, J. (2008). Theta phase-specific codes for two-dimensional position, trajectory and heading in the hippocampus. Nat. Neurosci. 11, 587-594. (Pubitemid 351595200)
107. Hyman, J.M., Wyble, B.P., Goyal, V., Rossi, C.A., and Hasselmo, M.E. (2003). Stimulation in hippocampal region CA1 in behaving rats yields long-term potentiation when delivered to the peak of theta and long-term depression when delivered to the trough. J. Neurosci. 23, 11725-11731. (Pubitemid 38021299)
108. Hyman, J.M., Zilli, E.A., Paley, A.M., and Hasselmo, M.E. (2010). Working memory performance correlates with prefrontal-hippocampal theta interactions but not with prefrontal neuron firing rates. Front. Integr. Neurosci. 4, 2.
109. Hyman, J.M., Hasselmo, M.E., and Seamans, J.K. (2011). What is the functional relevance of prefrontal cortex entrainment to hip-pocampal theta rhythms? Front. Neurosci. 5, 24.
110. Ikemoto, S. and Panksepp, J. (1999). The role of nucleus accum-bens dopamine in motivated behavior: A unifying interpretation with special reference to reward-seeking. Brain Res. Rev. 31, 6-41. (Pubitemid 30009611)
111. Ito, M. and Doya, K. (2011). Multiple representations and algorithms for reinforcement learning in the cortico-basal ganglia circuit. Curr. Opin. Neurobiol. 21, 368-373.
112. Ito, R., Robbins, T., Pennartz, C., and Everitt, B. (2008). Functional interaction between the hippocampus and nucleus accumbens shell is necessary for the acquisition of appetitive spatial context conditioning. J. Neurosci. 28, 6950-6959.
113. Izhikevich, E.M. (2007). Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb. Cortex 17, 2443-2452. (Pubitemid 47517479)
114. Jackson, J. and Redish, A.D. (2007). Network dynamics of hip-pocampal cell-assemblies resemble multiple spatial maps within single tasks. Hippocampus 17, 1209-1229. (Pubitemid 350244237)
115. Jacobs, J., Kahana, M.J., Ekstrom, A.D., and Fried, I. (2007). Brain oscillations control timing of single-neuron activity in humans. J. Neurosci. 27, 3839-3844. (Pubitemid 46557681)
116. Jay, T.M. and Witter, M.P. (1991). Distribution of hippocampal CA1 and subicular efferents in the prefrontal cortex of the rat studied by means of anterograde transport of Phaseolus vulgaris-leuco-agglutinin. J. Comp. Neurol. 313, 574-586.
117. Jeewajee, A., Lever, C., Burton, S., O'Keefe, J., and Burgess, N. (2008). Environmental novelty is signaled by reduction of the hippocampal theta frequency. Hippocampus 18, 340-348. (Pubitemid 351543931)
118. Jeffery, K.J. and Etienne, A.S. (2004). Path integration in mammals. Hippocampus 14, 180-192. (Pubitemid 38477105)
119. Jeffery, K.J., Anderson, M.I., Hayman, R., and Chakraborty, S. (2004). A proposed architecture for the neural representation of spatial context. Neurosci. Biobehav. Rev. 28, 201-218. (Pubitemid 38692364)
120. Jensen, O. (2001). Information transfer between rhythmically coupled networks: Reading the hippocampal phase code. Neural Comput. 13, 2743-2761. (Pubitemid 33597995)
121. Jensen, O. and Lisman, J. (1996). Hippocampal CA3 region predicts memory sequences: Accounting for the phase precession of place cells. Learn. Mem. 3, 279.
122. Jensen, O. and Lisman, J. (2000). Position reconstruction from an ensemble of hippocampal place cells: Contribution of theta phase coding. J. Neurophysiol. 83, 2602.
123. Johnson, A. and Redish, A.D. (2007). Neural ensembles in ca3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 27, 12176-12189. (Pubitemid 350085471)
124. Johnson, A., van der Meer, M.A.A., and Redish, A.D. (2007). Integrating hippocampus and striatum in decision-making. Curr. Opin. Neurobiol. 17, 692-697.
125. Jones, M.W. and Wilson, M.A. (2005a). Phase precession of medial prefrontal cortical activity relative to the hippocampal theta rhythm. Hippocampus 15, 867-873. (Pubitemid 41556416)
126. Jones, M.W. and Wilson, M.A. (2005b). Theta rhythms coordinate hipp̀ocampal-prefrontal interactions in a spatial memory task. PLoS Biol. 3, e402.
127. Jung, M.W., Wiener, S.I., and McNaughton, B.L. (1994). Comparison of spatial firing characteristics of units in dorsal and ventral hippocampus of the rat. J. Neurosci. 14, 7347-7356. (Pubitemid 24379745)
128. Kahana, M.J., Seelig, D., and Madsen, J.R. (2001). Theta returns. Curr. Opin. Neurobiol. 11, 739-744. (Pubitemid 34014925)
129. Kamondi, A., Acsády, L., Wang, X.J., and Buzsáki, G. (1998). Theta oscillations in somata and dendrites of hippocampal pyramidal cells in vivo: Activity-dependent phase-precession of action potentials. Hippocampus 8, 244-261. (Pubitemid 28288857)
130. Kelemen, E. and Fenton, A.A. (2010). Dynamic grouping of hip-pocampal neural activity during cognitive control of two spatial frames. PLoS Biol. 8, e1000403.
131. Kennedy, P.J. and Shapiro, M.L. (2009). Motivational states activate distinct hippocampal representations to guide goal-directed behaviors. Proc. Natl. Acad. Sci. USA 106, 10805-10810.
132. Khamassi, M., Mulder, A., Tabuchi, E., Douchamps, V., and Wiener, S. (2008). Anticipatory reward signals in ventral striatal neurons of behaving rats. Eur. J. Neurosci. 28, 1849-1866.
133. Kjelstrup, K.B., Solstad, T., Brun, V.H., Hafting, T., Leutgeb, S., Witter, M.P., Moser, E.I., and Moser, M.-B. (2008). Finite scale of spatial representation in the hippocampus. Science 321, 140-143. (Pubitemid 351956252)
134. Klausberger, T., Magill, P.J., Márton, L.F., Roberts, J.D.B., Cobden, P.M., Buzsáki, G., and Somogyi, P. (2003). Brain-state and cell-type-specific firing of hippocampal interneurons in vivo. Nature 421, 844-848. (Pubitemid 36254143)
135. Kocsis, B. and Vertes, R.P. (1992). Dorsal raphe neurons: Synchronous discharge with the theta rhythm of the hippocampus in the freely behaving rat. J. Neurophysiol. 68, 1463-1467.
136. Kocsis, B., Di Prisco, G.V., and Vertes, R.P. (2001). Theta synchronization in the limbic system: The role of Gudden's tegmental nuclei. Eur. J. Neurosci. 13, 381-388. (Pubitemid 32142483)
137. Koenig, J., Linder, A.N., Leutgeb, J.K., and Leutgeb, S. (2011). The spatial periodicity of grid cells is not sustained during reduced theta oscillations. Science 332, 592-595.
138. Koya, E., Golden, S.A., Harvey, B.K., Guez-Barber, D.H., Berkow, A., Simmons, D.E., Bossert, J.M., Nair, S.G., Uejima, J.L., Marin, M.T., et al. (2009). Targeted disruption of cocaine-activated nucleus accumbens neurons prevents context-specific sen-sitization. Nat. Neurosci. 12, 1069-1073.
139. Lansink, C.S., Goltstein, P.M., Lankelma, J.V., Joosten, R.N.J.M.A., McNaughton, B.L., and Pennartz, C.M.A. (2008). Preferential reactivation of motivationally relevant information in the ventral striatum. J. Neurosci. 28, 6372-6382.
140. Lansink, C.S., Goltstein, P.M., Lankelma, J.V., McNaughton, B.L., and Pennartz, C.M.A. (2009). Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biol. 7, e1000173.
141. Larson, J., Wong, D., and Lynch, G. (1986). Patterned stimulation at the theta frequency is optimal for the induction of hippocampal long-term potentiation. Brain Res. 368, 347-350. (Pubitemid 16046186)
142. Lasseter, H.C., Xie, X., Ramirez, D.R., and Fuchs, R.A. (2010). Sub-region specific contribution of the ventral hippocampus to drug context-induced reinstatement of cocaine-seeking behavior in rats. Neuroscience 171, 830-839.
143. Lavoie, A.M. and Mizumori, S.J.Y. (1994). Spatial-, movement-and reward-sensitive discharge by medial ventral striatum neurons in rats. Brain Res. 638, 157-168. (Pubitemid 24063300)
144. Leibold, C., Gundlfinger, A., Schmidt, R., Thurley, K., Schmitz, D., and Kempter, R. (2008). Temporal compression mediated by short-term synaptic plasticity. Proc. Natl. Acad. Sci. USA 105, 4417-4422. (Pubitemid 351754395)
145. Lenck-Santini, P.-P. and Holmes, G.L. (2008). Altered phase precession and compression of temporal sequences by place cells in epileptic rats. J. Neurosci. 28, 5053-5062.
146. Lengyel, M., Szatmáry, Z., and Erdi, P. (2003). Dynamically detuned oscillations account for the coupled rate and temporal code of place cell firing. Hippocampus 13, 700-714. (Pubitemid 37098758)
147. Leung, L.S. (1998). Generation of theta and gamma rhythms in the hippocampus. Neurosci. Biobehav. Rev. 22, 275-290.
148. Leung, L.S. (2011). A model of intracellular theta phase precession dependent on intrinsic subthreshold membrane currents. J. Neurosci. 31, 12282-12296.
149. Leung, L.S. and Yim, C.Y. (1986). Intracellular records of theta rhythm in hippocampal CA1 cells of the rat. Brain Res. 367, 323-327. (Pubitemid 16011696)
150. Leung, L.S. and Yim, C.Y. (1993). Rhythmic delta-frequency activities in the nucleus accumbens of anesthetized and freely moving rats. Can. J. Physiol. Pharmacol. 71, 311-320. (Pubitemid 23287172)
151. Leung, L.S. and Yu, H.W. (1998). Theta-frequency resonance in hip-pocampal CA1 neurons in vitro demonstrated by sinusoidal current injection. J. Neurophysiol. 79, 1592-1596. (Pubitemid 28125391)
152. Leutgeb, J.K., Leutgeb, S., Treves, A., Meyer, R., Barnes, C.A., McNaughton, B.L., Moser, M.-B., and Moser, E.I. (2005a). Progressive transformation of hippocampal neuronal representations in " morphed " environments. Neuron 48, 345-358.
153. Leutgeb, S., Leutgeb, J., Barnes, C., and Moser, E. (2005b). Independent codes for spatial and episodic memory in hippocam-pal neuronal ensembles. Science 309, 619-623. (Pubitemid 41033647)
154. Lisman, J. and Redish, A. (2009). Prediction, sequences and the hippocampus. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 1193-1201.
155. Lodge, D.J. and Grace, A.A. (2008). Amphetamine activation of hip-pocampal drive of mesolimbic dopamine neurons: A mechanism of behavioral sensitization. J. Neurosci. 28, 7876-7882.
156. Losonczy, A., Zemelman, B.V., Vaziri, A., and Magee, J.C. (2010). Network mechanisms of theta related neuronal activity in hip-pocampal CA1 pyramidal neurons. Nat. Neurosci. 13, 967-972.
157. Lubenov, E.V. and Siapas, A.G. (2009). Hippocampal theta oscillations are travelling waves. Nature 459, 534-539.
158. Magee, J. (2001). Dendritic mechanisms of phase precession in hip-pocampal CA1 pyramidal neurons. J. Neurophysiol. 86, 528.
159. Manns, J.R., Zilli, E.A., Ong, K.C., Hasselmo, M.E., and Eichenbaum, H. (2007). Hippocampal CA1 spiking during encoding and retrieval: Relation to theta phase. Neurobiol. Learn. Mem. 87, 9-20. (Pubitemid 44667570)
160. Maren, S. (2008). Pavlovian fear conditioning as a behavioral assay for hippocampus and amygdala function: Cautions and caveats. Eur. J. Neurosci. 28, 1661-1666.
161. Martin, P.D. (2001). Locomotion towards a goal alters the synchronous firing of neurons recorded simultaneously in the subiculum and nucleus accumbens of rats. Behav. Brain Res. 124, 19-28. (Pubitemid 32567555)
162. Martin, P.D. and Ono, T. (2000). Effects of reward anticipation, reward presentation, and spatial parameters on the firing of single neurons recorded in the subiculum and nucleus accumbens of freely moving rats. Behav. Brain Res. 116, 23-38.
163. Masquelier, T., Hugues, E., Deco, G., and Thorpe, S.J. (2009). Oscillations, phase-of-firing coding, and spike timing-dependent plasticity: An efficient learning scheme. J. Neurosci. 29, 13484-13493.
164. Maurer, A.P. and McNaughton, B.L. (2007). Network and intrinsic cellular mechanisms underlying theta phase precession of hip-pocampal neurons. Trends Neurosci. 30, 325-333. (Pubitemid 46991118)
165. Maurer, A.P., Cowen, S.L., Burke, S.N., Barnes, C.A., and McNaughton, B.L. (2006). Phase precession in hippocampal interneurons showing strong functional coupling to individual pyramidal cells. J. Neurosci. 26, 13485-13492. (Pubitemid 46026480)
166. Maurer, A.P., Burke, S.N., Lipa, P., Skaggs, W.E., and Barnes, C.A. (2011). Greater running speeds result in altered hippocampal phase sequence dynamics. Hippocampus DOI: 10.1002/hipo.20936. http://onlinelibrary.wiley.com/
167. McNaughton, B., Barnes, C., and O'Keefe, J. (1983). The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats. Exp. Brain Res. 52, 41-49. (Pubitemid 13019617)
168. Mehta, M.R., Barnes, C.A., and McNaughton, B.L. (1997). Experience-dependent, asymmetric expansion of hippocampal place fields. Proc. Natl. Acad. Sci. USA 94, 8918-8921. (Pubitemid 27335140)
169. Mehta, M.R., Lee, A.K., and Wilson, M.A. (2002). Role of experience and oscillations in transforming a rate code into a temporal code. Nature 417, 741-746. (Pubitemid 34640627)
170. Miyazaki, K., Mogi, E., Araki, N., and Matsumoto, G. (1998). Reward-quality dependent anticipation in rat nucleus accum-bens. NeuroReport 9, 3943-3948. (Pubitemid 29189331)
171. Mizumori, S.J.Y., Pratt, W.E., and Ragozzino, K.E. (1999). Function of the nucleus accumbens within the context of the larger striatal system. Psychobiology 27, 214-224. (Pubitemid 29337102)
172. Mizuseki, K., Sirota, A., Pastalkova, E., and Buzsáki, G. (2009). Theta oscillations provide temporal windows for local circuit computation in the entorhinal-hippocampal loop. Neuron 64, 267-280.
173. Mogenson, G.J. and Yang, C.R. (1991). The contribution of basal forebrain to limbic-motor integration and the mediation of motivation to action. Adv. Exp. Med. Biol. 295, 267-290.
174. Morris, R.G.M. (2006). Theories of Hippocampal Function. The Hippocampus Book. P. Andersen, R. Morris, D. Amaral, T. Bliss and J. O'Keefe, eds. (Oxford: Oxford University Press), pp. 581-713.
175. Morris, R.G.M., Garrud, P., Rawlins, J.N.P., and O'Keefe, J. (1982). Place navigation impaired in rats with hippocampal lesions. Nature 297, 681-683. (Pubitemid 12096189)
176. Moser, M.B. and Moser, E.I. (1998). Functional differentiation in the hippocampus. Hippocampus 8, 608-619. (Pubitemid 29010188)
177. Mulder, A.B., Hodenpijl, M.G., and da Silva, F.H.L. (1998). Electrophysiology of the hippocampal and amygdaloid projections to the nucleus accumbens of the rat: Convergence, segregation, and interaction of inputs. J. Neurosci. 18, 5095-5102. (Pubitemid 28285418)
178. Mulder, A.B., Shibata, R., Trullier, O., and Wiener, S.I. (2005). Spatially selective reward site responses in tonically active neurons of the nucleus accumbens in behaving rats. Exp. Brain Res. 163, 32-43. (Pubitemid 40868513)
179. Nadasdy, Z. (2009). Information encoding and reconstruction from the phase of action potentials. Front. Syst. Neurosci. 3, 1-20.
180. Nadel, L. (2008). The Hippocampus and Context Revisited. Hippocampal Place Fields: Relevance to Learning and Memory. S.J.Y. Mizumori, ed. (Oxford: Oxford University Press), pp. 3-15.
181. Navratilova, Z., Giocomo, L.M., Fellous, J.-M., Hasselmo, M.E., and McNaughton, B.L. (2011). Phase precession and variable spatial scaling in a periodic attractor map model of medial entorhinal grid cells with realistic after-spike dynamics. Hippocampus DOI: 10.1002/hipo.20939.
182. Nicola, S.M. (2007). The nucleus accumbens as part of a basal ganglia action selection circuit. Psychopharmacology (Berl.) 191, 521-550. (Pubitemid 46355879)
183. Niv, Y., Joel, D., and Dayan, P. (2006). A normative perspective on motivation. Trends Cogn. Sci. 10, 375-381. (Pubitemid 44093326)
184. O'Doherty, J.P., Hampton, A., and Kim, H. (2007). Model-based fMRI and its application to reward learning and decision making. Ann. NY Acad. Sci. 1104, 35-53. (Pubitemid 47092746)
185. O'Donnell, P. and Grace, A.A. (1993). Physiological and morphological properties of accumbens core and shell neurons recorded in vitro. Synapse 13, 135-160. (Pubitemid 23051482)
186. O'Donnell, P. and Grace, A. (1995). Synaptic interactions accumbens neurons: Input among excitatory afferents to nucleus hippocam-pal gating of prefrontal cortical. J. Neurosci. 15, 3622-3639.
187. O'Keefe, J. (1993). Hippocampus, theta, and spatial memory. Curr. Opin. Neurobiol. 3, 917-924. (Pubitemid 24003339)
188. O'Keefe, J. and Burgess, N. (1999). Theta activity, virtual navigation and the human hippocampus. Trends Cogn. Sci. 3, 403-406. (Pubitemid 29499806)
189. O'Keefe, J. and Burgess, N. (2005). Dual phase and rate coding in hippocampal place cells: Theoretical significance and relationship to entorhinal grid cells. Hippocampus 15, 853-866. (Pubitemid 41556415)
190. O'Keefe, J. and Nadel, L. (1978). The Hippocampus as a Cognitive Map (Oxford: Clarendon).
191. O'Keefe, J. and Recce, M.L. (1993). Phase relationship between hip-pocampal place units and the EEG theta rhythm. Hippocampus 3, 317-330. (Pubitemid 23231466)
192. O'Keefe, J. and Speakman, A. (1987). Single unit activity in the rat hippocampus during a spatial memory task. Exp. Brain Res. 68, 1-27. (Pubitemid 17153678)
193. O'Reilly, R.C. and Frank, M.J. (2006). Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput. 18, 283-328. (Pubitemid 43543839)
194. Panzeri, S., Brunel, N., Logothetis, N.K., and Kayser, C. (2010). Sensory neural codes using multiplexed temporal scales. Trends Neurosci. 33, 111-120.
195. Paré, D. (2002). Amygdala oscillations and the consolidation of emotional memories. Trends Cogn. Sci. 6, 306-314. (Pubitemid 34754470)
196. Pastalkova, E., Itskov, V., Amarasingham, A., and Buzsáki, G. (2008). Internally generated cell assembly sequences in the rat hippocampus. Science 321, 1322-1327.
197. Paxinos, G. and Watson, C. (2007). The rat brain in stereotactic coordinates, 6th edition. (Sydney: Academic Press).
198. Pearce, J.M., Roberts, A.D., and Good, M. (1998). Hippocampal lesions disrupt navigation based on cognitive maps but not heading vectors. Nature 396, 75-77. (Pubitemid 28520451)
199. Pennartz, C.M.A., Lee, E., Verheul, J., Lipa, P., Barnes, C.A., and McNaughton, B.L. (2004). The ventral striatum in off-line processing: Ensemble reactivation during sleep and modulation by hippocampal ripples. J. Neurosci. 24, 6446-6456. (Pubitemid 38971691)
200. Peters, J., Bromberg, U., Schneider, S., Brassen, S., Menz, M., Banaschewski, T., Conrod, P.J., Flor, H., Gallinat, J., Garavan, H., et al. (2011). Lower ventral striatal activation during reward anticipation in adolescent smokers. Am. J. Psychiatry, 168, 540-549.
201. Petsche, H., Stumpf, C., and Gogolak, G. (1962). The significance of the rabbit's septum as a relay station between the midbrain and the hippocampus I. The control of hippocampus arousal activity by the septum cells. Electroencephalogr. Clin. Neurophysiol. 14, 202-211.
202. Poucet, B., Lenck-Santini, P.P., Hok, V., Save, E., Banquet, J.P., Gaussier, P., and Muller, R.U. (2004). Spatial navigation and hip-pocampal place cell firing: The problem of goal encoding. Rev. Neurosci. 15, 89-107. (Pubitemid 38858891)
203. Pouget, A., Deneve, S., Ducom, J.C., and Latham, P.E. (1999). Narrow versus wide tuning curves: What's best for a population code? Neural Comput. 11, 85-90.
204. Ramus, S.J., Davis, J.B., Donahue, R.J., Discenza, C.B., and Waite, A.A. (2007). Interactions between the orbitofrontal cortex and the hippocampal memory system during the storage of long-term memory. Ann. NY Acad. Sci. 1121, 216-231.
205. Redish, A.D. (1999). Beyond the Cognitive Map (Cambridge, MA: MIT Press).
206. Redish, A.D. and Touretzky, D.S. (1998). The role of the hippocampus in solving the Morris water maze. Neural Comput. 10, 73-111. (Pubitemid 128463654)
207. Robbe, D. and Buzsáki, G. (2009). Alteration of theta timescale dynamics of hippocampal place cells by a cannabinoid is associated with memory impairment. J. Neurosci. 29, 12597-12605.
208. Roesch, M.R., Calu, D.J., Esber, G.R., and Schoenbaum, G. (2010). All that glitters dissociating attention and outcome-expectancy from prediction errors signals. J. Neurophysiol. 104, 587-595.
209. Rogers, J.L. and See, R.E. (2007). Selective inactivation of the ventral hippocampus attenuates cue-induced and cocaine-primed reinstatement of drug-seeking in rats. Neurobiol. Learn. Mem. 87, 688-692. (Pubitemid 46483135)
210. Rosenzweig, E.S., Redish, A.D., McNaughton, B.L., and Barnes, C.A. (2003). Hippocampal map realignment and spatial learning. Nat. Neurosci. 6, 609-615. (Pubitemid 36648802)
211. Royer, S., Sirota, A., Patel, J., and Buzsáki, G. (2010). Distinct representations and theta dynamics in dorsal and ventral hippocampus. J. Neurosci. 30, 1777-1787.
212. Rutishauser, U., Ross, I.B., Mamelak, A.N., and Schuman, E.M. (2010). Human memory strength is predicted by theta-frequency phase-locking of single neurons. Nature 464, 903-907.
213. Salamone, J.D., Correa, M., Farrar, A., and Mingote, S.M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191, 461-482. (Pubitemid 46355902)
214. Salzman, C.D. and Fusi, S. (2010). Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. Annu. Rev. Neurosci. 33, 173-202.
215. Samejima, K., Ueda, Y., Doya, K., and Kimura, M. (2005). Representation of action-specific reward values in the striatum. Science 310, 1337-1340. (Pubitemid 41698867)
216. Samsonovich, A.V. and McNaughton, B.L. (1997). Path integration and cognitive mapping in a continuous attractor neural network model. J. Neurosci. 17, 5900-5920. (Pubitemid 27310504)
217. Scheres, A., Milham, M.P., Knutson, B., and Castellanos, F.X. (2007). Ventral striatal hyporesponsiveness during reward anticipation in attention-deficit/hyperactivity disorder. Biol. Psychiatry 61, 720-724. (Pubitemid 46328856)
218. Schmidt, R., Diba, K., Leibold, C., Schmitz, D., Buzsáki, G., and Kempter, R. (2009). Single-trial phase precession in the hippocampus. J. Neurosci. 29, 13232-13241.
219. Schultz, W., Apicella, P., Scarnati, E., and Ljungberg, T. (1992). Neuronal activity in monkey ventral striatum related to the expectation of reward. J. Neurosci. 12, 4595-4610.
220. Sederberg, P.B., Kahana, M.J., Howard, M.W., Donner, E.J., and Madsen, J.R. (2003). Theta and gamma oscillations during encoding predict subsequent recall. J. Neurosci. 23, 10809-10814. (Pubitemid 37499687)
221. Seidenbecher, T., Laxmi, T.R., Stork, O., and Pape, H.-C. (2003). Amygdalar and hippocampal theta rhythm synchronization during fear memory retrieval. Science 301, 846-850. (Pubitemid 36962628)
222. Sejnowski, T.J. and Paulsen, O. (2006). Network oscillations: Emerging computational principles. J. Neurosci. 26, 1673-1676. (Pubitemid 43239572)
223. Sesack, S.R. and Grace, A.A. (2010). Cortico-basal ganglia reward network: Microcircuitry. Neuropsychopharmacology 35, 27-47.
224. Shapiro, M.L., Kennedy, P.J., and Ferbinteanu, J. (2006). Representing episodes in the mammalian brain. Curr. Opin. Neurobiol. 16, 701-709. (Pubitemid 44791923)
225. Sharp, P.E. (2006). Subicular place cells generate the same " map " for different environments: Comparison with hippocampal cells. Behav. Brain Res. 174, 206-214. (Pubitemid 44585077)
226. Shirvalkar, P.R., Rapp, P.R., and Shapiro, M.L. (2010). Bidirectional changes to hippocampal theta-gamma comodulation predict memory for recent spatial episodes. Proc. Natl. Acad. Sci. USA 107, 7054-709.
227. Siapas, A.G., Lubenov, E.V., and Wilson, M.A. (2005). Prefrontal phase locking to hippocampal theta oscillations. Neuron 46, 141-151. (Pubitemid 40488318)
228. Sigurdsson, T., Stark, K.L., Karayiorgou, M., Gogos, J.A., and Gordon, J.A. (2010). Impaired hippocampal-prefrontal synchrony in a genetic mouse model of schizophrenia. Nature 464, 763-767.
229. Skaggs, W.E. and McNaughton, B.L. (1996). Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience. Science 271, 1870-1873. (Pubitemid 26112314)
230. Skaggs, W.E., Mcnaughton, B.L., Wilson, M.A., and Barnes, C.A. (1996). Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences. Hippocampus 6, 149-173.
231. Smith, D.M. and Mizumori, S.J.Y. (2006). Learning-related development of context-specific neuronal responses to places and events: The hippocampal role in context processing. J. Neurosci. 26, 3154-3163.
232. Sutherland, R.J., Chew, G.L., Baker, J.C., and Linggard, R.C. (1987). Some limitations on the use of distal cues in place navigation by rats. Psychobiology 15, 48-57.
233. Sutton, R.S. (1990). First Results with Dyna, an Integrated Architecture for Learning, Planning and Reacting. Neural Networks for Control (Cambridge, MA: MIT Press), pp. 179-189.
234. Sutton, R.S. and Barto, A.G. (1998). Reinforcement Learning: An Introduction (Cambridge, MA: MIT Press).
235. Swanson, L. (1981). A direct projection from Ammon's horn to pre-frontal cortex in the rat. Brain Res. 217, 150-154. (Pubitemid 11072711)
236. Tabuchi, E.T., Mulder, A.B., and Wiener, S.I. (2000). Position and behavioral modulation of synchronization of hippocam-pal and accumbens neuronal discharges in freely moving rats. Hippocampus 10, 717-728. (Pubitemid 32045825)
237. Taverna, S., Canciani, B., and Pennartz, C.M.A. (2007). Membrane properties and synaptic connectivity of fast-spiking interneurons in rat ventral striatum. Brain Res. 1152, 49-56. (Pubitemid 46802508)
238. Tepper, J.M., Wilson, C.J., and Koós, T. (2008). Feedforward and feedback inhibition in neostriatal GABAergic spiny neurons. Brain Res.Rev. 58, 272-281.
239. Thierry, A.M., Gioanni, Y., Dégénétais, E., and Glowinski, J. (2000). Hippocampo-prefrontal cortex pathway: Anatomical and electro-physiological characteristics. Hippocampus 10, 411-419.
240. Thurley, K., Leibold, C., Gundlfinger, A., Schmitz, D., and Kempter, R. (2008). Phase precession through synaptic facilitation. Neural Comput. 20, 1285-1324.
241. Tolman, E.C., Ritchie, B.F., and Kalish, D. (1946a). Studies in spatial learning: Orientation and the short-cut. J. Exp. Psychol. 36, 13-24.
242. Tolman, E.C., Ritchie, B.F., and Kalish, D. (1946b). Studies in spatial learning; place learning versus response learning. J. Exp. Psychol. 36, 221-229.
243. Tremblay, L., Hollerman, J.R., and Schultz, W. (1998). Modifications of reward expectation-related neuronal activity during learning in primate striatum. J. Neurophysiol. 80, 964-977. (Pubitemid 28387673)
244. Tremblay, L., Worbe, Y., and Hollerman, J.R. (2009). The Ventral Striatum: A Heterogeneous Structure Involved in Reward Processing, Motivation and Decision-making. Handbook of Reward and Decision Making. J.-C. Dreher and L. Tremblay, eds. (Amsterdam: Academic Press), pp. 51-78.
245. Tsodyks, M.V., Skaggs, W.E., Sejnowski, T.J., and McNaughton, B.L. (1996). Population dynamics and theta rhythm phase precession of hippocampal place cell firing: A spiking neuron model. Hippocampus 6, 271-280. (Pubitemid 26275787)
246. van der Meer, M.A.A. and Redish, A.D. (2009). Low and high gamma oscillations in rat ventral striatum have distinct relationships to behavior, reward, and spiking activity on a learned spatial decision task. Front. Integr. Neurosci. 3, 9.
247. van der Meer, M.A.A. and Redish, A.D. (2010). Expectancies in decision making, reinforcement learning, and ventral striatum. Front. Neurosci. 4, 6.
248. van der Meer, M.A.A. and Redish, A.D. (2011a). Theta phase precession in rat ventral striatum links place and reward information. J. Neurosci. 31, 2843-2854.
249. van der Meer, M.A.A. and Redish, A.D. (2011b). Ventral striatum: A critical look at models of learning and evaluation. Curr. Opin. Neurobiol. 21, 387-392.
250. van der Meer, M.A.A., Johnson, A., Schmitzer-Torbert, N.C., and Redish, A.D. (2010a). Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task. Neuron 67, 25-32.
251. van der Meer, M.A.A., Kalenscher, T., Lansink, C.S., Pennartz, C.M.A., Berke, J.D., and Redish, A.D. (2010b). Integrating early results on ventral striatal gamma oscillations in the rat. Front. Neurosci. 4, 300.
252. van Wingerden, M., Vinck, M., Lankelma, J., and Pennartz, C.M.A. (2010). Theta-band phase locking of orbitofrontal neurons during reward expectancy. J. Neurosci. 30, 7078-7087.
253. Vanderwolf, C. (1969). Hippocampal electrical activity and voluntary movement in the rat. Electroencephalogr. Clin. Neurophysiol. 26, 407-418.
254. Voorn, P., Vanderschuren, L.J., Groenewegen, H.J., Robbins, T.W., and Pennartz, C.M. (2004). Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci. 27, 468-474. (Pubitemid 38951039)
255. Vorel, S.R., Liu, X., Hayes, R.J., Spector, J.A., and Gardner, E.L. (2001). Relapse to cocaine-seeking after hippocampal theta burst stimulation. Science 292, 1175-1178. (Pubitemid 32440941)
256. Wallenstein, G.V. and Hasselmo, M.E. (1997). GABAergic modulation of hippocampal population activity: Sequence learning, place field development, and the phase precession effect. J. Neurophysiol. 78, 393-408. (Pubitemid 27320124)
257. Wang, X.-J. (2010). Neurophysiological and computational principles of cortical rhythms in cognition. Physiol. Rev. 90, 1195-1268.
258. Whishaw, I.Q. and Mittleman, G. (1991). Hippocampal modulation of nucleus accumbens: Behavioral evidence from amphetamine-induced activity profiles. Behav. Neural Biol. 55, 289-306.
259. Whishaw, I.Q., Hines, D.J., and Wallace, D.G. (2001). Dead reckoning (path integration) requires the hippocampal formation: Evidence from spontaneous exploration and spatial learning tasks in light (allothetic) and dark (idiothetic) tests. Behav. Brain Res. 127, 49-69. (Pubitemid 33062403)
260. Wise, R.A. (2006). Role of brain dopamine in food reward and reinforcement. Philos. Trans. R. Soc. Lond. B Biol. Sci. 361, 1149-1158. (Pubitemid 44874226)
261. Womelsdorf, T., Vinck, M., Leung, L.S., and Everling, S. (2010). Selective theta-synchronization of choice-relevant information subserves goal-directed behavior. Front. Hum. Neurosci. 4, 210.
262. Yamaguchi, Y. (2003). A theory of hippocampal memory based on theta phase precession. Biol. Cybern. 89, 1-9.
263. Yamaguchi, Y., Sato, N., Wagatsuma, H., Wu, Z., Molter, C., and Aota, Y. (2007). A unified view of theta-phase coding in the entorhinal-hippocampal system. Curr. Opin. Neurobiol. 17, 197-204. (Pubitemid 46584801)
264. Ylinen, A., Soltész, I., Bragin, A., Penttonen, M., Sik, A., and Buzsáki, G. (1995). Intracellular correlates of hippocampal theta rhythm in identified pyramidal cells, granule cells, and basket cells. Hippocampus 5, 78-90.
265. Zhang, K. and Sejnowski, T.J. (1999). Neuronal tuning: To sharpen or broaden? Neural Comput. 11, 75-84.
266. Zilli, E.A. and Hasselmo, M.E. (2008). Modeling the role of working memory and episodic memory in behavioral tasks. Hippocampus 2, 193-209. (Pubitemid 351413485)