A biophysical implementation of a bidirectional graph search algorithm to solve multiple goal navigation tasks

Connection Science

Volumn 17, Issue 1-2, 2005, Pages 145-164

  Gorchetchnikov, Anatoli ^a   Hasselmo, Michael E ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

Goal selection; Goal directed navigation; Graph search; Hippocampus; Spiking neuronal model

Indexed keywords

BRAIN; FLOW GRAPHS; NEURAL NETWORKS;

GOAL DIRECTED; GOAL SELECTION; GRAPH SEARCH; HIPPOCAMPUS; NEURONAL MODEL;

NEURONS;

EID: 24344442390     PISSN: 09540091     EISSN: 13600494     Source Type: Journal    
DOI: 10.1080/09540090500140925     Document Type: Article

References (78)

1. L.F. Abbott and K.I. Blum, "Functional significance of long-term potentiation for sequence learning and prediction", Cereb. Cortex, 6, pp. 406-416, 1996.
2. S.V. Albertin, A.B. Mulder, E. Tabuchi, M.B. Zugaro and I. Wiener, "Lesions of the media shell of the nucleus accumbens impair rats in finding larger rewards, but spare reward-seeking behavior", Behav. Brain Res., 117, pp. 173-183, 2000.
3. S.D. Berry and M.A. Seager, "Hippocampal theta oscillations and classical conditioning", Neurobiol. Learn. Mem., 76, pp. 298-313, 2001.
4. K.I. Blum and L.F. Abbott, "A model of spatial map formation in the hippocampus of the rat", Neural Comput., 8, pp. 85-93, 1996.
5. A. Bragin, G. Jandò, Z. Nàdasdy, J. Hetke, K. Wise and G. Buzsàki, "Gamma (40-100 Hz) oscillation in the hippocampus of the behaving rat", J. Neurosci., 15, pp. 47-60, 1995.
6. J. Brankack, M. Stewart and S.E. Fox, "Current source density analysis of the hippocampal theta rhythm: associated sustained potentials and candidate synaptic generators", Brain Res., 615, pp. 310-327, 1993.
7. V.E. Brun, M.K. Otnæss, S. Molden, H.A. Steffenach, M.P. Witter, M.B. Moser and E.I. Moser, "Place cells and place recognition maintained by direct entorhinal-hippocampal circuitry", Science, 296, pp. 2243-2246, 2002.
8. N. Burgess, J.G. Donnett, K.J. Jeffery and J.M. O'Keefe, "Robotic and neuronal simulation of the hippocampus and rat navigation", Philoso. Trans. R. Soc. London, Ser. B, 352, pp. 1535-1543, 1997.
9. G. Buzsàki and E. Eidelberg, "Phase-relations of hippocampal projection cells and interneurons to theta activity in the anesthetized rat", Brain Res., 266, pp. 334-339, 1983.
10. G. Buzsàki, L.W.S. Leung and C.H. Vanderwolf, "Cellular bases of hippocampal EEG in the behaving rat", Brain Res. Rev., 6, pp. 139-171, 1983.
11. R.C. Cannon, M.E. Hasselmo and R.A. Koene, "From biophysics to behavior: Catacomb2 and the design of biologically plausible models for spatial navigation", Neuroinformatics, 1, pp. 3-42, 2003.
12. C.M. Colbert and W.B. Levy, "Electrophysiological and pharmacological characterization of perforant path synapses in CA1: mediation by glutamate receptors", J. Neurophysiol., 68, pp. 1-8, 1992.
13. A. Delorme and S.J. Thorpe, "Face identification using one spike per neuron: resistance to image degradation", Neural Net., 14, pp. 795-803, 2001.
14. G.B. Ermentrout and N. Kopell, "Parabolic bursting in an excitable system coupled with slow oscillation", SIAM J. Appl. Math., 46, pp. 233-252, 1986.
15. J. Ferbinteanu and M.L. Shapiro, "Prospective and retrospective memory coding in the hippocampus", Neuron, 40, pp. 1227-1239, 2003.
16. S.E. Fox, S. Wolfson and J.B. Ranck J, "Hippocampal theta rhythm and the firing of neurons in walking and urethane anesthetized rats", Experimental Brain Res, 62, pp. 495-508, 1986.
17. L.M. Frank, E.N. Brown and M.A. Wilson, "Trajectory encoding in the hippocampus and entorhinal cortex", Neuron, 27, pp. 169-178, 2000.
18. M. Fyhn, S. Molden, M.P. Witter, E.I. Moser and M.B. Moser, "Spatial representation in the entorhinal cortex", Science, 305, pp. 1258-1264, 2004.
19. J. Gautrais and S.J. Thorpe, "Rate coding versus temporal order coding: a theoretical approach", Biosystems, 48, pp.57-65, 1998.
20. B.S. Givens and D.S. Olton, "Cholinergic and GABAergic modulation of the medial septal area: effect on working memory", Behav. Neurosci., 104, pp. 849-855, 1990.
21. A. Gorchetchnikov and M.E. Hasselmo, "A model of hippocampal circuitry mediating goal-driven navigation in a familiar environment", Neurocomputing, 44-46, pp. 423-427, 2002a.
22. A. Gorchetchnikov, and M.E. Hasselmo, "A model of septal, entorhinal and hippocampal interactions to solve multiple goal navigation tasks", Soc. Neurosci. Abstr., 32, 676.16, 2002b.
23. A. Gorchetchnikov and M.E. Hasselmo, "Timing of consecutive traveling pulses in a model of entorhinal cortex", in Proceedings of the International Joint Conference on Neural Networks, 2003, pp. 1637-1642.
24. A. Gorchetchnikov and M.E. Hasselmo, "A biologically realistic graph search: application to spatial navigation", Biological Cybernetics, submitted.
25. A. Gorchetchnikov, M. Versace and M.E. Hasselmo, "KInNeSS: a new software environment for simulations of neuronal activity", Available online at: http://www.kinness.net/Docs/KInNeSS/ICCNS 04.pdf.
26. M.E. Hasselmo, "A model of prefrontal cortical mechanisms for goal directed behavior", J. Cog. Neuro., in press.
27. M.E. Hasselmo, R.C. Cannon and R.A. Koene, "A simulation of parahippocampal and hippocampal structures guiding spatial navigation of a virtual rat in a virtual environment: a functional framework for theta theory", in The Parahippocampal Region: Organisation and Role in Cognitive Functions Vol. 121, M.P. Witter and F.G. Wouterlood, Eds, Oxford: Oxford University Press, 2002a, pp. 139-161.
28. M.E. Hasselmo and H. Eichenbaum, "Hippocampal mechanisms for the context-dependent retrieval of episodes", Neural Newt., in press.
29. M.E. Hasselmo and B.P. Fehlau, "Differences in time course of cholinergic and GABAergic modulation of excitatory synaptic potentials in rat hippocampal slice preparations", J. Neurophysiol., 86, pp. 1792-1802, 2001.
30. M.E. Hasselmo, J. Hay, M. Ilyn and A. Gorchetchnikov, "Neuromodulation, theta rhythm, and rat spatial navigation", Neural Net., 15, pp. 689-707, 2002b.
31. M.E. Hasselmo and E. Schnell, "Laminar selectivity of the cholinergic suppression of synaptic transmission in rat hippocampal region CA1: computational modeling and brain slice physiology", J. Neurosci., 14, pp. 3898-3914, 1994.
32. M.E. Hasselmo, E. Schnell and E. Barkai, "Dynamics of learning and recall at excitatory recurrent synapses and cholinergic modulation in hippocampal region CA3", J. Neurosci., 15, pp. 5249-5262, 1995.
33. R.J. Herrnstein, "Relative and absolute strength of response as a function of frequency of reinforcement", J. Exp. Anal. Behav., 4, pp. 267-272, 1961.
34. P.A. Hetherington and M.L. Shapiro, "A simple network model simulates hippocampal place fields: Parametric analyses and physiological predictions", Behavi. Neurosci., 107, pp. 34-50, 1993.
35. A.L. Hodgkin and A.F. Huxley, "Quantitative description of membrane current and its application to conduction and excitation in nerve", J. Physiol., 117, pp. 500-544, 1952.
36. J.M. Hyman and M.E. Hasselmo, "Medial prefrontal cell firing linked with hippocampal theta rhythm", Soc. Neurosci. Abstr, 34, p. 551.12, 2004.
37. E.M. Izhikevich, "Which model to use for cortical spiking neurons?", IEEE Trans. Neural Net., 15, pp. 1063-1070, 2004.
38. O. Jensen and J.E. Lisman, "Ilippocampal CA3 region predict memory sequences: accounting for the phase advance of place cells", Learn. Mem., 3, pp. 279-287, 1996.
39. A. Kamondi, L. Acsady, X.J. Wang and G. Buzsàki, "Theta oscillations in somata and dendrites of hippocampal pyramidal cells in vivo: activity dependent phase-precession of action potentials", Hippocampus, 8, pp. 244-261, 1998.
40. I. Kanter and H. Sompolinsky, "Temporal association in asymmetric neural networks", Phys. Rev. Lett., 57, pp. 2861-2864, 1986.
41. R.A. Koene, A. Gorchetchnikov, R.C. Cannon and M.E. Hasselmo, "Modeling goal-directed spatial navigation in the rat based on physiological data from the hippocampal formation", Neural Net., 16, pp. 577-584, 2003.
42. R.A. Koene and M.E. Hasselmo, "An integrate-and-fire model of prefrontal cortex neuronal activity during performance of goal-directed decision making", Cerebral Cortex, in press.
43. J.L. Lanciego, F.G. Wouterlood, E. Erro, J. Arribas, N. Gonzalo, X. Urra, S. Cervantes and J.M. Gimenez-Amaya, "Complex brain circuits studied via simultaneous and permanent detection of three transported neuroanatomical tracers in the same histological section", J. Neurosci. Meth., 103, pp. 127-135, 2000.
44. W.B. Levy, X. Wu and R.A. Baxter, "Unification of hippocampal function via computational/encoding considerations", Inte. J. Neural Syst., 6, pp. 71-80, 1995.
45. J.E. Lisman, "Relating hippocampal circuitry to function: recall of memory sequences by reciprocal dentate-CA3 interactions", Neuron, 22, pp. 233-242, 1999.
46. I.D. Manns, A. Alonso and B.E. Jones, "Discharge properties of juxtacellularly labeled and immunohistochemically identified cholinergic basal forebrain neurons recorded in association with the electroencephalogram in anesthetized rats", J. Neurosci., 20, pp. 1505-1518, 2000.
47. Marr, D., "Simple memory: a theory for archicortex", Philos. Trans. R. Soc. London, Ser. B, 262, pp. 23-81, 1971.
48. B.L. McNaughton and R.G.M. Morris, "Hippocampal synaptic enhancement and information storage within a distributed memory system", Trends Neurosci., 10, pp. 408-415, 1987.
49. M.R. Mehta, M.C. Quirk and M.A. Wilson, "Experience-dependent asymmetric shape of hippocampal receptive fields", Neuron, 25, pp. 707-715, 2000.
50. M. M'Harzi, A. Palacios, P. Monmaur, F. Willig, O. Houcine and J. Delacour, "Effects of selective lesions of fimbria-fornix on learning set in the rat", Physiol. Behav., 40(2), pp. 181-188, 1987.
51. V.M. Miller and P.J. Best, "Spatial correlates of hippocampal unit activity are altered by lesions of the fornix and entorhinal cortex", Brain Res., 194, pp. 311-323, 1980.
52. B presynaptic inhibition has an in vivo time constant suffciently rapid to allow modulation at theta frequency", J. Neurophysiol., 87, pp. 1196-1205, 2002.
53. R.G.M. Morris, F. Schenk, P. Garrud, J.N.P. Rawlins and J.M. O'Keefe, "Place navigation impaired in rats with hippocampal lesions", Nature, 297, pp. 681-683, 1982.
54. R.U. Muller, J.L. Kubie and R. Saypoff, "The hippocampus as a cognitive graph", Hippocampus, 1, pp. 243-246, 1991.
55. J.D. Murray, Mathematical Biology, New York: Springer-Verlag, 1989.
56. K. Nakazawa, M.C. Quirk, R.A. Chitwood, M. Watanabe, M.F. Yeckel, L.D. Sun, A. Kato, C.A. Carr, D. Johnston, M.A. Wilson and S. Tonegawa, "Requirement for hippocampal CA3 NMDA receptors in associative memory recall", Science, 297, pp. 211-218, 2002.
57. J.M. O'Keefe and J. Dostrovsky, "The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat", Brain Res., 34, pp. 171-175, 1971.
58. J.M. O'Keefe and L. Nadel, The Hippocampus as a Cognitive Map, Oxford: Oxford University Press, 1978.
59. J.M. O'Keefe and M.L. Recce, "Phase relationship between hippocampal place units and the EEG theta rhythm", Hippocampus, 3, pp. 317-330, 1993.
60. D.S. Olton, "Memory functions and the hippocampus, in Neurobiology of the Hippocampus, W.G. Seifert, Ed., New York: Academic Press, 1983 pp. 335-374.
61. I. Pohl, "Bi-directional search", in Machine Intelligence, Vol. 6, B. Meltzer and D. Michie, Eds, Edinburgh: Edinburgh University Press, 1971, pp. 127-140.
62. A.D. Redish and D.S. Touretzky, "The role of the hippocampus in solving the Morris water maze", Neural Comput., 10, pp. 73-111, 1998.
63. R.S. Sainsbury, J.L. Harris and G.L. Rowland, "Sensitization and hippocampal type 2 theta in the rat", Physiol. Behav., 41, pp. 489-493, 1970.
64. A.C. Scott, Active and Nonlinear Wave Propagation in Electronics, New York: Wiley Interscience, 1970.
65. M.L. Shapiro, D.K. Simon, D.S. Olton, F.H. Gager, O. Nilsson and A. Bjorklund, "Intrahippocampal grafts of fetal basal forebrain tissue alter place fields in the hippocampus of rats with fimbria-fornix lesions", Neuroscience, 32, pp. 1-18, 1989.
66. P.E. Sharp, "Computer simulation of hippocampal place cells", Psychobiology, 19, pp. 103-115, 1991.
67. P.E. Sharp, H.T. Blair and M. Brown, "Neural network modeling of the hippocampal formation spatial signals and their possible role in navigation: a modular approach", Hippocampus, 6, pp. 720-734, 1996.
68. K. Shima and J. Tanji, "Role for cingulate motor area cells in voluntary movement selection based on reward", Science, 282, pp. 1335-1338, 1998.
69. B modulation improves sequence disambiguation in computational models of hippocampal region CA3", Hippocampus, 8, pp. 171-193, 1998.
70. O. Trullier, S.I. Wiener, A. Berthoz and J.A. Meyer, "Biologically based artificial navigation systems: review and prospects", Prog. Neurobiol., 51, pp. 483-544, 1997.
71. M.V. Tsodyks, W.E. Skaggs, T.J. Sejnowski and B.L. McNaughton, "Population dynamics and theta rhythm phase precession of hippocampal place cell firing: a spiking neuron model", Hippocampus, 6, pp. 271-280, 1996.
72. R. van Rullen, J. Gautrais, A. Delorme and S.J. Thorpe, "Face processing using one spike per neurone", Biosystems, 48, pp. 229-239, 1998.
73. C.H. Vanderwolf, "Hippocampal electrical activity and movement of the rat", Electroencephalogr. Clin. Neurophysiol., 26, pp. 407-418, 1969.
74. G.V. Wallenstein and M.E. Hasselmo, "GABAergic modulation of hippocampal population activity: sequence learning, place field development, and the phase precession effect", J. Neurophysiol., 78, pp. 393-408, 1997.
75. I.Q. Whishaw, "Hippocampal electroencephalographic activity in the Mongolian gerbil during natural behaviours and wheel running and in the rat during wheel running and conditioned immobility", Can. J. Psychol., 26, pp. 219-239, 1972.
76. X. Wu, J. Tyrcha and W.B. Levy, "A neural network solution to the transverse patterning problem depends on repetition of the input code", Biol. Cybernet., 79, pp. 203-213, 1998.
77. A. Zador, C. Koch and T.H. Brown, "Biophysical model of a Hebbian synapse", in Proc. Nat. Acad. Sci., USA, 87, pp. 6718-6722, 1990.
78. M. Zugaro, L. Monconduit and G. Buzsàki, "Spike phase precession persists after transient intrahippocampal perturbation", Nature Neurosci., 8, pp. 67-71, 2005.