Time to rethink the neural mechanisms of learning and memory

Neurobiology of Learning and Memory

Volumn 108, Issue , 2014, Pages 136-144

  Gallistel, Charles R ^a   Balsam, Peter D ^b  

^a RUTGERS UNIVERSITY   (United States)

^b Howard Hughes Medical Institute   (United States)

Author keywords

Anticipation; Conditioning; Information theory; Learning; Time perception; Timing

Indexed keywords

ANTICIPATION; CONDITIONING; INFORMATION THEORY; LEARNING; TIME PERCEPTION; TIMING;

ANIMALS; ANTICIPATION, PSYCHOLOGICAL; BRAIN; CONDITIONING (PSYCHOLOGY); HUMANS; LEARNING; MEMORY; TIME FACTORS; TIME PERCEPTION;

EID: 84893725695     PISSN: 10747427     EISSN: 10959564     Source Type: Journal    
DOI: 10.1016/j.nlm.2013.11.019     Document Type: Review

References (78)

1. Abrams T.W., Kandel E.R. Is contiguity detection in classical conditioning a system or a cellular property? Learning in Aplysia suggests a possible molecular site. TINS 1988, 11(4):128-135.
2. Akins C.K., Domjan M., et al. Topography of sexually conditioned behavior in male Japanese quail (Coturnix japonica) depends on the CS-US interval. Journal of Experimental Psychology: Animal Behavior Processes 1994, 20(2):199-209.
3. Arcediano F., Miller R.R. Some constraints for models of timing: a temporal coding hypothesis perspective. Learning and Motivation 2002, 33:105-123.
4. Balsam P. Relative time in trace conditioning. Annals of the New York Academy of Sciences 1984, 423:211-227.
5. Balsam P.D., Drew M.R., et al. Timing at the start of associative learning. Learning and Motivation 2002, 33(1):141-155.
6. Balsam P.D., Drew M.R., et al. Time and associative learning. Comparative Cognition and Behavior Review 2010, 5:1-22.
7. Balsam P.D., Gallistel C.R. Temporal maps and informativeness in associative learning. Trends in Neurosciences 2009, 32(2):73-78.
8. Bouton M.E., Sunsay C. Importance of trials versus accumulating time across trials in partially reinforced appetitive conditioning. Journal of Experimental Psychology: Animal Behavior Processes 2003, 29(1):62-77.
9. Brandon S., Vogel E., et al. Stimulus representation in SOP: I. Theoretical rationalization and some implications. Behavioural Processes 2003, 62(1):5-25.
10. Brown P.L., Jenkins H.M. Auto-shaping of the pigeon's key-peck. Journal of the Experimental Analysis of Behavior 1968, 11(1):1-8.
11. Buhusi C.V., Meck W.H. What makes us tick? Functional and neural mechanisms of interval timing. Nature Reviews Neuroscience 2005, 6(10):755-765.
12. Buonomano D.V., Laje R. Population clocks: motor timing with neural dynamics. Trends in Cognitive Sciences 2010, 14(12):520-527.
13. Carew T.J., Walters E.T., et al. Associative learning in Aplysia: cellular correlates supporting a conditioned fear hypothesis. Science 1981, 211:501-504.
14. Clayton N.S., Dickinson A. Episodic-like memory during cache recovery by scrub jays. Nature 1998, 395(6699):272-274.
15. Coleman D.A., Hemmes N.S., et al. Relative durations of conditioned-stimulus and intertrial interval in conditioned suppression. Journal of the Experimental Analysis of Behavior 1986, 46(1):51-66.
16. Davis M., Schlesinger L.S., et al. Temporal specificity of fear conditioning - effects of different conditioned-stimulus - unconditioned stimulus intervals on the fear-potentiated startle effect. Journal of Experimental Psychology - Animal Behavior Processes 1989, 15(4):295-310.
17. Delamater A.R., Holland P.C. The influence of CS-US interval on several different indices of learning in appetitive conditioning. Journal of Experimental Psychology: Animal Behavior Processes 2008, 34(2):202-222.
18. Denniston J.C., Blaidsdell A.P., et al. Temporal coding affects transfer of serial and simultaneous inhibitors. Animal Learning and Behavior 1998, 26(3):336-350.
19. Denniston J.C., Blaisdell A.P., et al. Temporal coding in conditioned inhibition: analysis of associative structure of inhibition. Journal of Experimental Psychology: Animal Behavior Processes 2004, 30:190-202.
20. Diaz-Mataix L., Ruiz Martinez R.C., et al. Detection of a temporal error triggers reconsolidation of amygdala-dependent memories. Current Biology 2013, 23(6):467-472.
21. Drew M.R., Yang C., et al. Temporal specificity of extinction in autoshaping. Journal of Experimental Psychology: Animal Behavior Processes 2004, 30(3):163-176.
22. Drew M.R., Zupan B., et al. Temporal control of conditioned responding in goldfish. Journal of Experimental Psychology: Animal Behavior Processes 2005, 31(1):31-39.
23. du Bois-Reymond E. Untersuchungen über thierische Elektricität 1848, Reimer, Berlin.
24. Gallistel C.R. The organization of learning 1990, Bradford Books/MIT Press, Cambridge MA.
25. Gallistel C.R Contingency in learning. Encyclopedia of the sciences of learning 2012, Springer, New York. N.M. Seel (Ed.).
26. Gallistel C.R. Extinction from a rationalist perspective. Behavioural Processes 2012, 90:66-88.
27. Gallistel C.R, King A.P Memory and the computational brain: Why cognitive science will transform neuroscience 2009, Wiley.
28. Gallistel C.R., Craig A.R., et al. Temporal contingency. Behavioural Processes 2013.
29. Gallistel C.R., Gibbon J. Time, rate, and conditioning. Psychological Review 2000, 107(2):289-344.
30. Gallistel C.R., Matzel L.D. The neuroscience of learning: beyond the Hebbian synapse. Annual Review of Psychology 2013, 64:169-200.
31. Gallistel C.R., Shizgal P., et al. A portrait of the substrate for self-stimulation. Psychological Review 1981, 88(3):228-273.
32. Garcia J., Kimmeldorf D.J., et al. The use of ionizing radiation as a motivating stimulus. Psychological Review 1961, 68:383-385.
33. Gibbon J., Baldock M.D., et al. Trial and intertrial durations in autoshaping. Journal of Experimental Psychology - Animal Behavior Processes 1977, 3(3):264-284.
34. Gibbon J., Balsam P. Spreading association in time. Autoshaping and Conditioning Theory 1981, 219-253.
35. Gibbon J., Farrell L., et al. Partial-reinforcement in autoshaping with pigeons. Animal Learning Behavior 1980, 8(1):45-59.
36. Gluck M.A., Thompson R.F. Modeling the neural substrates of associative learning and memory: a computational approach. Psychological Review 1987, 94(2):176-191.
37. Gottlieb D.A. Acquisition with partial and continuous reinforcement in pigeon autoshaping. Learning and Behavior 2004, 32(3):321-334.
38. Gottlieb D.A. Acquisition with partial and continuous reinforcement in rat magazine approach. Journal of Experimental Psychology: Animal Behavior Processes 2005, 31(3):319-333.
39. Gottlieb D.A., Prince E.B. Isolated effects of number of acquisition trials on extinction of rat conditioned approach behavior. Behavioural Processes 2012, 90(1):34-48.
40. Gottlieb D.A., Rescorla R.A. Within-subject effects of number of trials in rat conditioning procedures. Journal of Experimental Psychology: Animal Behavior Processes 2010, 36(2):217-231.
41. Harris J.A. The acquisition of conditioned responding. Journal of Experimental Psychology: Animal Behavior Processes 2011, 37:151-164.
42. Haselgrove M., Aydin A., et al. A partial reinforcement extinction effect despite equal rates of reinforcement during Pavlovian conditioning. Journal of Experimental Psychology: Animal Behavior Processes 2004, 30(3):240-250.
43. Hawkins R.D., Kandel E.R., et al. Molecular mechanisms of memory storage in Aplysia. Biological Bulletin 2006, 210(3):174-191.
44. Helmholtz H.v. Messungen über Fortpflanzungsgeschwindigkeit der Reizung in den Nerven. Archiv für Anatomie, Physiologie, und wissenschaftliche Medizin 1852, 199-216.
45. Hermann, L. (1879). Handbuch der Physiologie. Band 2. Teil 1. Leipzig. Vogel.
46. Holder M.D., Bermudez-Rattoni F., et al. Taste potentiated noise-illness associations. Behavioral Neuroscience 1988, 102(3):363-370.
47. Holland P.C. CS-US interval as a determinant of the form of Pavlovian appetitive conditioned responses. Journal of Experimental Psychology: Animal Behavior Processes 1980, 6(2):155-174.
48. Holland P.C. Trial and intertrial durations in appetitive conditioning in rats. Animal Learning and Behavior 2000, 28(2):121-135.
49. Judson H. The eighth day of creation 1980, Simon & Schuster, New York.
50. Kamin L.J Predictability, surprise, attention, and conditioning. Punishment and aversive behavior 1969, 276-296. Appleton-Century-Crofts, New York. B.A. Campbell, R.M. Church (Eds.).
51. Kamin L.J Selective association and conditioning. Fundamental issues in associative learning 1969, 42-64. Dalhousie University Press, Halifax. N.J. Mackintosh, W.K. Honig (Eds.).
52. Kaplan P.S. Importance of relative temporal parameters in trace autoshaping - from excitation to inhibition. Journal of Experimental Psychology: Animal Behavior Processes 1984, 10(2):113-126.
53. Kimble G.A. Hilgard and Marquis' conditioning and learning 1961, Appleton-Century-Crofts, NY.
54. Kirkpatrick K., Church R.M. Stimulus and temporal cues in classical conditioning. Journal of Experimental Psychology: Animal Behavior Processes 2000, 26(2):206-219.
55. Laje R., Cheng K., et al. Learning of temporal motor patterns: an analysis of continuous versus reset timing. Frontiers in Integrative Neuroscience 2011, 5:61.
56. Lattal K.M. Trial and intertrial durations in pavlovian conditioning: issues of learning and performance. Journal of Experimental Psychology: Animal Behavior Processes 1999, 25(4):433-450.
57. Lustig C., Matell M.S., et al. Not "just" a coincidence: frontal-striatal interactions in working memory and interval timing. Memory 2005, 13(3-4):441-448.
58. Matell M.S., Meck W.H. Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. Brain Research. Cognitive Brain Research 2004, 21(2):139-170.
59. Molet M., Miller R.R. Timing: an attribute of associative learning. Behavioural Processes 2013, 95.
60. Mustaca A.E., Gabelli F., et al. The effects of varying the interreinforcement interval on appetitive contextual conditioning in rats and ring doves. Animal Learning and Behavior 1991, 19:125-138.
61. Ohyama T., Mauk M. Latent acquisition of timed responses in cerebellar cortex. Journal of Neuroscience 2001, 21(2):682-690.
62. Pavlov I.P. Conditioned reflexes 1927, Dover, New York.
63. Raby C.R., Alexis D.M., et al. Planning for the future by western scrub-jays. Nature 2007, 445(7130):919-921.
64. Rescorla R.A. Inhibition of delay in Pavlovian fear conditioning. Journal of Comparative and Physiological Psychology 1967, 64(1):114-120.
65. Rescorla R.A. Informational variables in Pavlovian conditioning. The psychology of learning and motivation 1972, Vol. 6:1-46. Academic, New York.
66. Rieke F., Warland D., et al. Spikes: exploring the neural code 1997, MIT Press, Cambridge MA.
67. Silva K.M., Timberlake W. A behavior systems view of conditioned states during long and short CS-US intervals. Learning and Motivation 1997, 28(4):465-490.
68. Silva K.M., Timberlake W. The organization and temporal properties of appetitive behavior in rats. Animal Learning and Behavior 1998, 26(2):182-195.
69. Silva K.M., Timberlake W. A behavior systems view of the organization of multiple responses during a partially or continuously reinforced interfood clock. Learning and Behavior 2005, 33(1):99-110.
70. Silver R., Balsam P.D., et al. Food anticipation depends on oscillators and memories in both body and brain. Physiology and Behavior 2011, 104(4):562-571.
71. Staddon, J. E., & Zhang, Y. (1991). On the assignment-of-credit problem in operant learning. In Commons, Michael, L., Grossberg, Stephen, et al. (Eds.), Neural network models of conditioning and action. Quantitative analyses of behavior series (pp. 279-293) (xx, p. 359).
72. Stein L., Sidman M., et al. Some effects of 2 temporal variables on conditioned suppression. Journal of the Experimental Analysis of Behavior 1958, 1(1):153-162.
73. Sutton, R. S. (1984). Temporal credit assignment in reinforcement learning. PhD, University of Massachusetts, Amherst.
74. Sutton R.S. Learning to predict by the methods of temporal differences. Machine Learning 1988, 3:9-44.
75. Wagner A.R., Logan F.A., et al. Stimulus selection in animal discrimination learning. Journal of Experimental Psychology 1968, 76(2):171-180.
76. Ward R.D., Gallistel C.R., et al. Conditioned [corrected] stimulus informativeness governs conditioned stimulus-unconditioned stimulus associability. Journal of Experimental Psychology: Animal Behavior Processes 2012, 38(3):217-232.
77. Ward R.D., Gallistel C.R., et al. It is the information!. Behavioural Processes 2013, 95:3-7.
78. Williams B.A. Invariance in reinforcements to acquisition, with implications for the theory of inhibition. Behaviour Analysis Letters 1981, 1:73-80.