Behavioral and neurophysiological analyses of dynamic learning processes

Behavioral and Cognitive Neuroscience Reviews

Volumn 4, Issue 2, 2005, Pages 67-95

  Suzuki, Wendy A ^a   Brown, Emery N ^b  

^a NEW YORK UNIVERSITY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Associative; Hidden Markov model; Hippocampus; Medial temporal lobe; State space model

Indexed keywords

ALGORITHM; BEHAVIOR; BRAIN FUNCTION; CONDITIONING; CORPUS STRIATUM; EYE MOVEMENT; EYELID REFLEX; FRONTAL LOBE; HIPPOCAMPUS; LEARNING; NEUROPHYSIOLOGY; NONHUMAN; PREFRONTAL CORTEX; PREMOTOR CORTEX; REVIEW; STATE DEPENDENT LEARNING; STATISTICAL ANALYSIS; STATISTICAL MODEL; TASK PERFORMANCE; TEMPORAL LOBE;

ASSOCIATION LEARNING; FRONTAL LOBE; HUMANS; NEURONS; RESEARCH DESIGN; TEMPORAL LOBE;

EID: 27544511377     PISSN: 15345823     EISSN: 15524159     Source Type: Journal    
DOI: 10.1177/1534582305280030     Document Type: Review

References (136)

1. Akase, E., Alkon, D. L., & Disterhoft, J. F. (1989). Hippocampal lesions impair memory of short-delay conditioned eye blink in rabbits. Behavioral Neuroscience, 103, 935-943.
2. Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience, 9, 357-381.
3. Assad, W. F., Rainer, G., & Miller, E. K. (1998). Neural activity in the primate prefrontal cortex during associative learning. Neuron, 21, 1399-1407.
4. Bayley, P. J., & Squire, L. R. (2002). Medial temporal lobe amnesia: Gradual acquisition of factual information by nondeclarative memory. Journal of Neuroscience, 22, 5741-5748.
5. Berger, T. W., Alger, B. E., & Thompson, R. F. (1976). Neuronal substrates of classical conditioning in the hippocampus. Science, 192, 483-485.
6. Berger, T. W., & Thompson, R. F. (1978). Neuronal plasticity in the limbic system during classical conditioning of the rabbit nictitating membrane response: I. The hippocampus. Brain Research, 145, 323-346.
7. Brasted, P. J., Bussey, T. J., Murray, E. A., & Wise, S. P. (2002). Fornix transection impairs conditional visuomotor learning in tasks involving nonspatially differentiated responses. Journal of Neurophysiology, 87, 631-633.
8. Brasted, P. J., Bussey, T. J., Murray, E. A., & Wise, S. P. (2003). Role of the hippocampal system in associative learning beyond the spatial domain. Brain, 126, 1202-1223.
9. Brasted, P. J., & Wise, S. P. (2004). Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. European Journal of Neuroscience, 19, 721-740.
10. Brown, E. N., Nguyen, D. P., Frank, L. M., Wilson, M. A., & Solo, V. (2001). An analysis of neural receptive field plasticity by point process adaptive filtering. Proceedings of the National Academy of Sciences of the United States of America, 98, 12261-12266.
11. Buckmaster, C. A., Eichenbaum, H., Amaral, D. G., Suzuki, W. A., & Rapp, P. R. (2004). Entorhinal cortex lesions disrupt the relational organization of memory in monkeys. Journal of Neuroscience, 24, 9811-9825.
12. Bures, J., Fenton, A. A., Kaminsky, Y., Rossier, J., Sacchetti, B., & Zinvuk, L. (1997). Dissociation of exteroceptive and idiothetic orientation cues: Effect on hippocampal place cells and place navigation. Philosophical Transactions of the Royal Society of London: Series B, Biological Sciences, 352, 1515-1524.
13. Cahusac, P. M., Rolls, E. T., Miyashita, Y., & Niki, H. (1993). Modification of the responses of hippocampal neurons in the monkey during the learning of a conditional spatial response task. Hippocampus, 3, 29-42.
14. Chen, L. L., & Wise, S. P. (1995a). Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. Journal of Neurophysiology, 73, 1101-1121.
15. Chen, L. L., & Wise, S. P. (1995b). Supplementary eve field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. Journal of Neurophysiology, 73, 1122-1134.
16. Chen, L. L., & Wise, S. P. (1996). Evolution of directional preferences in the supplementary eye field during acquisition of conditional oculomotor associations. Journal of Neuroscience, 16, 3067-3081.
17. Chen, L. L., & Wise, S. P. (1997). Conditional oculomotor learning: Population vectors in the supplementary eye field. Journal of Neurophysiology, 78, 1166-1169.
18. Cook, E. P., & Maunsell, J. H. (2002). Attentional modulation of behavioral performance and neuronal responses in middle temporal and ventral intraparietal areas of macaque monkey. Journal of Neuroscience, 22, 1994-2004.
19. Daley, D., & Vere-Jones, D. (2003). An introduction to the theory of point processes. New York: Springer-Verlag.
20. Dayan, P., Kakade, S., & Montague, P. R. (2000). Learning and selective attention. Nature Neuroscience, 5(Suppl.), 1218-1223.
21. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society, 39, 1-38.
22. Dias, R., Robbins, T. W., & Roberts, A. C. (1997). Dissociable forms of inhibitory control within prefrontal cortex with an analog of the Wisconsin Card Sort Test: Restriction to novel situations and independence from "on-line" processing. Journal of Neuroscience, 17, 9285-9297.
23. Eacott, M. J., & Gaffan, D. (1992). Inferotemporal-frontal disconnection: The uncinate fascicle and visual associative learning in monkeys. European Journal of Neuroscience, 4, 1320-1332.
24. Eden, U. T., Frank, L. M., Barbieri, R., Solo, V., & Brown, E. N. (2004). Dynamic analysis of neural encoding by point process adaptive filtering. Neural Computation, 16, 971-998.
25. Eichenbaum, H. (2000). Cortical-hippocampal networks for declarative memory. Nature Neuroscience Reviews, 1, 41-50.
26. Eichenbaum, H., & Cohen, N. J. (2001). From conditioning to conscious recollection. New York: Oxford University Press.
27. Eichenbaum, H., Dudchenko, P., Wood, E., Shapiro, M., & Tanila, H. (1999). The hippocampus, memory, and place cells: Is it spatial memory or a memory space? Neuron, 23, 209-226.
28. Eichenbaum, H., Fagan, A., & Cohen, N. J. (1986). Normal olfactory discrimination learning set and facilitation of reversal learning after medial-temporal damage in rats: Implications for an account of preserved learning abilities in amnesia. Journal of Neuroscience, 6, 1876-1884.
29. Erickson, C. A., & Desimone, R. (1999). Responses of macaque perirhinal neurons during and after visual stimulus association learning. Journal of Neuroscience, 19, 10404-10416.
30. Estes, W. K. (1978). Handbook of learning and cognitive processes. New York: Wiley (Halsted Press).
31. Fahrmeir, L., & Tutz, G. (2001). Multivariate statistical modelling based on generalized linear models. New York: Springer-Verlag.
32. Fletcher, P. C., Frith, C. D., Grasby, P. M., Shallice, T., Frackowiak, R. S., & Dolan, R. J. (1995). Brain systems for encoding and retrieval of auditory-verbal memory: An in vivo study in humans. Brain, 118(pt. 2), 401-416.
33. Fox, M. T., Barense, M. D., & Baxter, M. G. (2003). Perceptual attentional set-shifting is impaired in rats with neurotoxic lesions of posterior parietal cortex. Journal of Neuroscience, 23, 676-681.
34. Frank, L. M., Eden, U. T., Solo, V., Wilson, M. A., & Brown, E. N. (2002). Contrasting patterns of receptive field plasticity in the hippocampus and the entorhinal cortex: An adaptive filtering approach. Journal of Neuroscience, 22, 3817-3830.
35. Frank, L. M., Stanley, G. B., & Brown, E. N. (2004). Hippocampal plasticity across multiple days of exposure to novel environments. Journal of Neuroscience, 24, 7681-7689, 2004.
36. Fuster, J. M. (2001). The prefrontal cortex-An update: Time is of the essence. Neuron, 30, 319-333.
37. Fyhn, M., Molden, S., Hollup, S., Moser, M. B., & Moser, E. I. (2002). Hippocampal neurons responding to first-time dislocation of a target object. Neuron, 35, 555-566.
38. Gaffan, D. (1994). Scene-specific memory for objects: A model of episodic memory impairment in monkeys with fornix transection. Journal of Cognitive Neuroscience, 6, 305-320.
39. Gaffan, D., & Harrison, S. (1988). Inferotemporal-frontal disconnection and fornix transection in visuomotor conditional learning by monkeys. Behavioural Brain Research, 31, 149-163.
40. Gaffan, D., & Harrison, S. (1989). A comparison of the effects of fornix transection and sulcus principalis ablation upon spatial learning by monkeys. Behavioural Brain Research, 31, 207-220.
41. Gallistel, C. R., Fairhurst, S., & Balsom, P., (2004). The learning curve: Implications of a quantitative analysis. Proceedings of the National Academy of Sciences, 101 (36), 13124-13131.
42. Germain, L., & Lamarre, Y. (1993). Neuronal activity in the motor and premotor cortices before and after learning the associations between auditory stimuli and motor responses. Brain Research, 611, 175-179.
43. Gilks, W. R., Richardson, S., & Spiegelhalter, D. J. (1996). Makov chain Monte Carlo in practice. New York: Chapman and Hall.
44. Graybiel, A. M. (1998). The basal ganglia and chunking of action repertoires. Neurobiology of Learning and Memory, 70, 119-136.
45. Hadj-Bouziane, F., & Boussaoud, D. (2003). Neuronal activity in the monkey striatum during conditional visuomotor learning. Experimental Brain Research, 153, 190-196.
46. Halsband, U., & Passingham, R. (1982). The role of premotor and parietal cortex in the direction of action. Brain Research, 240, 368-372.
47. Halsband, U., & Passingham, R. E. (1985). Premotor cortex and the conditions for movement in monkeys (Macaca fascicularis). Behavioural Brain Research, 18, 269-277.
48. Haykin, S. (1996). Adaptive filter theory. Englewood Cliffs, NJ: Prentice Hall.
49. Higuchi, S., & Miyashita, Y. (1996). Neural code of visual paired associate memory in primate inferotemporal cortex is impaired by perirhinal and entorhinal lesions. Proceedings of the National Academy of Sciences of the United States of America, 93, 739-743.
50. Houk, J. C., & Wise, S. P. (1995). Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: Their role in planning and controlling action. Cerebral Cortex, 5, 95-110.
51. Hu, D., Kubota, Y., & Graybiel, A. M. (2001). Successive resculpting of task-related activity patterns in the striatum during action-sequence procedural learning, extinction and retraining. SEV Abstracts, 27, 514.9.
52. Inase, M., Li, B. M., Takashima, I., & Iijima, T. (2001). Pallidal activity is involved in visuomotor association learning in monkeys. European Journal of Neuroscience, 14, 897-901.
53. Jeffery, K. J., Gilbert, A., Burton, S., & Strudwick, A. (2003). Preserved performance in a hippocampal-dependent spatial task despite complete place cell remapping. Hippocampus, 13, 175-189.
54. Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999). Building neural representations of habits. Science, 286, 1745-1749.
55. Jones, R. H. (1993). Longitudinal data with serial correlation: A state-space approach. New York: Chapman and Hall.
56. Kakade, S., & Dayan, P. (2002). Acquisition and extinction in autoshaping. Psychological Review, 109, 533-544.
57. Kalbfleisch, J., & Prentice, R. (1980). The statistical analysis of failure time data. New York: Wiley.
58. Kim, J. J., Clark, R. E., & Thompson, R. F. (1995). Hippocampectomy impairs the memory of recently, but not remotely acquired trace eyeblink conditioned responses. Behavioral Neuroscience, 109, 195-203.
59. Kitagawa, G., & Gersh, W. (1996). Smoothness priors analysis of times series. New York: Springer.
60. Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996). A neostriatal habit learning system in humans. Science, 273, 1399-1402.
61. Kubota, K., & Komatsu, H. (1985). Neuron activities of monkey prefrontal cortex during the learning of visual discrimination tasks with GO/NO-GO performances. Neuroscience Research, 3, 106-129.
62. Kubota, K., & Niki, H. (1971). Prefrontal cortical unit activity and delayed alternation performance in monkeys. Journal of Neurophysiology, 34, 337-347.
63. Laird, N. M., & Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics, 38, 963-974.
64. Law, J. R., Flanery, M. A., Wirth, S., Yanike, M., Smith, A. C., Frank, L. M., et al. (2005). Functional magnetic resonance imaging activity during the gradual acquisition and expression of paired-associate memory. Journal of Neuroscience, 25, 5720-5729.
65. Lebedev, M. A., Messinger, A., Kralik, J. D., & Wise, S. P. (2004). Representation of attended versus remembered locations in prefrontal cortex. PLoS Biology, 2, e365.
66. Lenck-Santini, P. P., Muller, R. U., Save, E., & Poucet, B. (2002). Relationships between place cell firing fields and navigational decisions by rats. Journal of Neuroscience, 22, 9035-9047.
67. Lenck-Santini, P. P., Save, E., & Poucet, B. (2001). Evidence for a relationship between place-cell spatial firing and spatial memory performance. Hippocampus, 11, 377-390.
68. Li, L., Miller, E. K., & Desimone, R. (1993). The representation of stimulus familiarity in anterior inferior temporal cortex. Journal of Neurophysiology, 69, 1918-1929.
69. Loader, C. (1999). Local regression and likelihood. New York: Springer-Verlag.
70. Luce, R. D., Bush, R., & Galanter, E. (1965). Handbook of mathematical psychology. New York: Wiley.
71. Maclean, C. J., Gaffan, D., Baker, H. F., & Ridley, R. M. (2001). Visual discrimination learning impairments produced by combined transertions of the anterior temporal stem, amygdala and fornix in marmoset monkeys. Brain Research, 888, 34-50.
72. Martin, A. (1999). Automatic activation of the medial temporal lobe during encoding: Lateralized influences of meaning and novelty. Hippocampus, 9, 62-70.
73. McEchron, M. D., & Disterhoft, J. F. (1997). Sequence of single neuron changes in CA1 hippocampus of rabbits during acquisition of trace eyeblink conditioned responses. Journal of Neurophysiology, 78, 1030-1044.
74. McEchron, M. D., & Disterhoft, J. F. (1999). Hippocampal encoding of non-spatial trace conditioning. Hippocampus, 9, 385-396.
75. McEchron, M. D., Tseng, W., & Disterhoft, J. F. (2000). Neurotoxic lesions of the dorsal hippocampus disrupt auditory-cued trace heart rate (fear) conditioning in rabbits. Hippocampus, 10, 739-751.
76. McEchron, M. D., Tseng, W., & Disterhoft, J. F. (2003). Single neurons in CA1 hippocampus encode trace interval duration during trace heart rate (fear) conditioning in rabbit. Journal of Neuroscience, 23, 1535-1547.
77. McEchron, M. D., Weible, A. P., & Disterhoft, J. F. (2001). Aging and learning-specific changes in single-neuron activity in CA1 hippocampus during rabbit trace eveblink conditioning. Journal of Neurophysiology, 86, 1839-1857.
78. Messinger, A., Squire, L. R., Zola, S. M., & Albright, T. D. (2001). Neuronal representations of stimulus associations develop in the temporal lobe during learning. Proceedings of the National Academy of Sciences of the United States of America, 98, 12239-12244.
79. Miller, E. K. (1999). The prefrontal cortex: Complex neural properties for complex behavior 15-17.
80. Miller, E. K., Li, L., & Desimone R. (1991). A neural mechanism for working and recognition memory in inferior temporal cortex. Science, 254, 1377-1379.
81. Mishkin, M., Malamut, B. L., & Bachevalier, J. (1984). Memories and habits: Two neural systems. In G. Lynch, J. L. McGaugh, & N. M. Weinberger (Eds.), Neurobiology of learning and memory (pp. 65-77). New York: Guilford.
82. Mitz, A. R., Godschalk, M., & Wise, S. P. (1991). Learning-dependent neuronal activity in the premotor cortex: Activity during the acquisition of conditional motor associations. Journal of Neuroscience, 11, 1855-1872.
83. Miyashita, Y., Rolls, E. T., Cahusac, P. M., Niki, H., & Feigenbaum, J. D. (1989). Activity of hippocampal formation neurons in the monkey related to a conditional spatial response task. Journal of Neurophysiology, 61, 669-678.
84. Mover, J. R., Jr., Deyo, R. A., & Disterhoft, J. F. (1990). Hippocampectomy disrupts trace eye-blink conditioning in rabbits. Behavioral Neuroscience, 104, 243-252.
85. Murray, E. A., Bussey, T. J., & Wise, S. P. (2000). Role of prefrontal cortex in a network for arbitrary visuomotor mapping. Experimental Brain Research, 133, 114-129.
86. Murray, E. A., & Wise, S. P. (1996). Role of the hippocampus plus subjacent cortex but not amygdala in visuomotor conditional learning in rhesus monkeys. Behavioral Neuroscience, 110, 1261-1270.
87. Naya, Y., Yoshida, M., & Miyashita, Y. (2001). Backward spreading of memory-retrieval signal in the primate temporal cortex. Science, 291, 661-664.
88. Naya, Y., Yoshida, M., & Miyashita, Y. (2003). Forward processing of long-term associative memory in monkey inferotemporal cortex. Journal of Neuroscience, 23, 2861-2871.
89. Niki, H., Sugita, S., & Watanabe, M. (1990). Modification of the activity of primate frontal neurons during learning of a Go/No-GO discrimination and its reversal. In E. Iwai & M. Mishkin (Eds.), Vision, memory, and the temporal lobe (pp. 295-304). New York: Elsevier.
90. O'Keefe, J., & Dostrovsky, J. (1971). The hippocampus as a spatial map: Preliminary evidence from unit activity in the freely-moving rat. Brain Research, 34, 171-175.
91. O'Keefe, J., & Speakman, A. S. (1987). Single unit activity in the rat hippocampus during a spatial memory task. Experimental Brain Research, 68, 1-27.
92. Packard, M. G., & McGaugh, J. L. (1996). Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiology of Learning and Memory, 65, 65-72.
93. Passingham, R. (1993). The frontal lobes and voluntary action. Oxford, UK: Oxford University Press.
94. Pasupathy, A., & Miller, E. K. (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature, 433, 873-876.
95. Pawitan, Y. (2001). In all likelihood: Statistical modeling and inference using likelihood. London: Oxford University Press.
96. Petrides, M. (1982). Motor conditional associative-learning after selective prefrontal lesions in the monkey. Behavioural Brain Research, 5, 407-413.
97. Petrides, M. (1987). Conditional learning and the primate frontal cortex. In E. Perecman (Ed.), The frontal lobes revisited (pp. 91-108). New York: IRBN Press.
98. Prerau, M. J., Smith, A. C., Yanike, M., Suzuki, W. A., & Brown, E. N. (2004). A mixed filter algorithm for simultaneously recorded continuous-valued and binary observations. Manuscript submitted for publication.
99. Reading, P. J., Dunnett, S. B., & Robbins, T. W. (1991). Dissociable roles of the ventral, medial and lateral striatum on the acquisition and performance of a complex visual stimulus-response habit. Behavioural Brain Research, 45, 147-161.
100. Robinson, A. L., Heaton, R. K., Lehman, R. A., & Stilson, D. W. (1980). The utility of the Wisconsin Card Sorting Test in detecting and localizing frontal lobe lesions. Journal of Consulting and Clinical Psychology, 48, 605-614.
101. Roman, F. S., Simonetto, I., & Soumireu-Mourat, B. (1993). Learning and memory of odor-reward association: Selective impairment following horizontal diagonal band lesions. Behavioral Neuroscience, 107, 72-81.
102. Rondi-Reig, L., Libbey, M., Eichenbaum, H., & Tonegawa, S. (2001). CA1-specific N-methyl-D-aspartate receptor knockout mice are deficient in solving a nonspatial transverse patterning task. Proceedings of the National Academy of Sciences of the United States of America, 98, 3543-3548.
103. Rosenzweig, E. S., Redish, A. D., McNaughton B. L., Barnes, C. A. (2003) Hippocampal map realignment and spatial learning. Nature Neuroscience, 6, 609-615.
104. Roweis, S., & Ghahramani, Z. (1999). A unifying review of linear Gaussian models. Neural Computation, 11, 305-345.
105. Rupniak, N. M., & Gaffan, D. (1987). Monkey hippocampus and learning about spatially directed movements. Journal of Neuroscience, 7, 2331-2337.
106. Sakai, K., & Miyashita, Y. (1991). Neural organization for the long-term memory of paired associates. Nature, 354, 152-155.
107. Schmaltz, L. W., & Theios, J. (1972). Acquisition and extinction of a classically conditioned response in hippocampectomized rabbits (Oryctolagus cuniculus). Journal of Comparative and Physiological Psychology 79, 328-333.
108. Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80, 1-27.
109. Schultz, W., Tremblay, L., & Hollerman, J. R. (2003). Changes in behavior-related neuronal activity in the striatum during learning. Trends in Neuroscience, 26, 321-328.
110. Siegel, S., & Castellan, N. J. (1988). Nonparametric statistics for the behavioral sciences. New York: McGraw-Hill.
111. Smith, A. C., & Brown, E. N. (2003). State-space estimation from point process observations. Neural Computation, 15, 965-991.
112. Smith, A. C., Frank, L. M., Wirth, S., Yanike, M., Hu, D., Kubota, Y., et al. (2004). Dynamic analysis of learning in behavioral experiments. Journal of Neuroscience, 24, 447-461.
113. Smith, A. C., Stefani, M. R., Moghaddam, B., & Brown, E. N. (2005). Analysis and design of behavioral experiments to characterize population learning. Journal of Neurophysiology, 93, 1776-1792.
114. Solomon, P. R., & Moore, J. W. (1975). Latent inhibition and stimulus generalization of the classically conditioned nictitating membrane response in rabbits (Oryctolagus cuniculus) following dorsal hippocampal ablation. Journal of Comparative and Physiological Psychology, 89, 1192-1203.
115. Solomon, P. R., Vander Schaaf, E. R., Thompson, R. F., & Weisz, D. J. (1986). Hippocampus and trace conditioning of the rabbit's classically conditioned nictitating membrane response. Behavioral Neuroscience, 100, 729-744.
116. Squire, L. R., Stark, C. E., & Clark, R. E. (2004). The medial temporal lobe. Annual Review of Neuroscience, 27, 279-306.
117. Stark, C. E., Bayley, P. J., & Squire, L. R. (2002). Recognition memory for single items and for associations is similarly impaired following damage to the hippocampal region. Learning and Memory, 9, 238-242.
118. Stark, C. E., & Okado, Y. (2003). Making memories without trying: Medial temporal lobe activity associated with incidental memory formation during recognition. Journal of Neuroscience, 23, 6748-6753.
119. Stark, C. E., & Squire, L. R. (2003). Hippocampal damage equally impairs memory for single items and memory for conjunctions. Hippocampus, 13, 281-292.
120. Stefani, M. R., Groth, K., & Moghaddam, B. (2003). Glutamate receptors in the rat medial prefrontal cortex regulate set-shifting ability. Behavioral Neuroscience, 117, 728-737.
121. Suppes, P. (1959). A linear model for a continuum of responses. In R. R. Bush & K. K. Estes (Eds.), Studies in mathematical learning theory (pp. 400-414). Stanford, CA: Stanford University Press.
122. Suppes, P. (1990). On deriving models in the social-sciences. Mathematical and Computer Modelling, 14, 21-28.
123. Sutton, R. S. (1992). Adaptation beats least squares? In Proceedings of the Seventh Yale Workshop on Adaptive Systems und Learning (pp. 161-166).
124. Suzuki, W. A., Miller, E. K., & Desimone, R. (1997). Object and place memory in the macaque entorhinal cortex. Journal of Neurophysiology, 78, 1062-1081.
125. Toth, L. J., & Assad, J. A. (2002). Dynamic coding of behaviourally relevant stimuli in parietal cortex. Nature, 415, 165-168.
126. Tremblay, L., Hollerman, J. R., & Schultz, W. (1998). Modifications of reward expectation-related neuronal activity during learning in primate striatum. Journal of Neurophysiology, 80, 964-977.
127. Ungerleider, L. G. (1995). Functional brain imaging studies of cortical mechanisms for memory. Science, 270, 769-775.
128. Usher, M., & McClelland, J. L. (2001). The time course of perceptual choice: The leaky, competing accumulator model. Psychology Reviews, 108, 550-592.
129. Vargha-Khadem, F., Gadian, D. G., Watkins, K. E., Connelly, A., Van Paesschen, W., & Mishkin, M. (1997). Differential effects of early hippocampal pathology on episodic and semantic memory. Science, 277, 376-380.
130. Watanabe, M. (1990). Prefrontal unit activity during associative learning in the monkey. Experimental Brain Research, 80, 296-309.
131. Whishaw, I. Q., & Tomie, J. A. (1991). Acquisition and retention by hippocampal rats of simple, conditional, and configural tasks using tactile and olfactory cues: Implications for hippocampal function. Behavioral Neuroscience, 105, 787-797.
132. Winocur, G., & Eskes, G. (1998). Prefrontal cortex and caudate nucleus in conditional associative learning: Dissociated effects of selective brain lesions in rats. Behavioral Neuroscience, 112, 89-101.
133. Wirth, S., Yanike, M., Frank, L. M., Smith, A. C., Brown, E. N., & Suzuki, W. A. (2003). Single neurons in the monkey hippocampus and learning of new associations. Science, 300, 1578-1581.
134. Wise, S. P., & Murray, E. A. (1999). Role of the hippocampal system in conditional motor learning: Mapping antecedents to action. Hippocampus, 9, 101-117.
135. Wise, S. P., Murray, E. A., & Gerfen, C. R. (1996). The frontal cortex-basal ganglia system in primates. Critical Review of Neurobiology, 10, 317-356.
136. Yu, A., & Dayan, P. (2003). Expected and unexpected uncertainty: ACH and NE in the neocortex. News in Physiological Sciences.