Direct associations or internal transformations? Exploring the mechanisms underlying sequential learning behavior

Cognitive Science

Volumn 34, Issue 1, 2010, Pages 10-50

  Gureckis, Todd M ^a   Love, Bradley C ^b  

^a NEW YORK UNIVERSITY   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Associative learing; Learning constraints; Sequence learning; Simple recurrent networks; Skill acquisition and learning

Indexed keywords

EID: 77953216728     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1551-6709.2009.01076.x     Document Type: Article

References (87)

1. Anderson, J. (1993). Rules of the mind. Hillsdale, NJ: Erlbaum.
2. Anderson, J., & Libiere, C. (1998). The atomic components of thought. Mahwah, NJ: Erlbaum.
3. Ashby, F., Queller, S., & Berretty, P. (1999). On the dominance of unidimensional rules in unsupervised categorization. Perception & Psychophysics, 61, 1178-1199.
4. Beer, R. (2000). Dynamical approaches to cognitive science. Trends in Cognitive Sciences, 4(3), 91-99.
5. Botvinick, M., & Plaut, D. (2004). Doing without schema hierarchies: A recurrent connectionist approach to normal and impaired routine sequential action. Psychological Review, 111, 395-429.
6. Boucher, L., & Dienes, Z. (2003). Two ways of learning associations. Cognitive Science, 27(6), 807-842.
7. Boyer, M., Destrebecqz, A., & Cleeremans, A. (2005). Processing abstract sequence structure: Learning without knowing, or knowing without learning? Psychological Research, 69(5-6), 583-398.
8. Calvo, F., & Colunga, E. (2003). The statistical brain: Reply to Marcus' the algebraic mind. In R. Alterman & D. Kirsh (Eds.), Proceedings of the 25th annual conference of the Cognitive Science Society (pp. 210-215). Hillsdale, NJ: Erlbaum.
9. Carpenter, G., & Grossberg, S. (1987). Art 2: Self-organization of stable category recognition codes for analog input patterns. Applied Optics, 26(23), 4914-4930.
10. Chomsky, N. (1957). Syntactic structures. The Hague, The Netherlands: Mouton.
11. Chomsky, N. (1965). Aspects of the theory of syntax. Cambridge, MA: MIT Press.
12. Christiansen, M.H., Conway, C.M., & Curtin, S. (2002). A connectionist single-mechanism account of rule-like behavior in infancy. In L. Gleitman & A. Joshi (Eds.), Proceedings of the 22nd annual conference of the Cognitive Science Society (pp. 83-88). Hillsdale, NJ: Erlbaum.
13. Chun, M., & Phelps, E. (1999). Memory deficits for implicit contextual information in amnesic subjects with hippocampal damage. Nature Neuroscience, 2(9), 844-847.
14. Cleeremans, A. (1993). Mechanisms of implicit learning: Connectionist models of sequence processing. Cambridge, MA: MIT Press.
15. Cleeremans, A., & Destrebecqz, A. (1997). Incremental sequence learning. In M. Shaffo & P. Langley (Eds.), Proceedings of the 19th annual conference of the Cognitive Science Society (pp. 119-124). Hillsdale, NJ: Erlbaum.
16. Cleeremans, A., & McClelland, J.L. (1991). Learning the structure of event sequences. Journal of Experimental Psychology: General, 120(3), 235-253.
17. Cleeremans, A., Servan-Schreiber, D., & McClelland, J. (1989). Finite state automata and simple recurrent networks. Neural Computation, 1, 372-381.
18. Cohen, A., Ivry, R., & Keele, S. (1990). Attention and structure in sequence learning. Journal of Experimental Psychology: Learning, Memory and Cognition, 16(1), 17-30.
19. Curran, T. (1997). Higher-order associative learning in amnesia: Evidence from the serial reaction time task. Journal of Cognitive Neuroscience, 9(4), 522-533.
20. Ding, L., Dennis, S., & Mehay, D.N. (2009). A single layer network model of sentential recursive patterns. In N. Taatgen & H. Van Rijn (Eds.), Proceedings of the 31st annual conference of the Cognitive Science Society (pp. 461-466). Austin, TX: Cognitive Science Society.
21. Dominey, P., Arbib, M., & Joseph, J. (1995). A model of cortico-striatal plasticity for learning oculomotor associations and sequences. Journal of Cognitive Neuroscience, 7, 311-336.
22. Ebbinghaus, H. (1964). Memory: A contribution of experiment psychology. New York: Dover.
23. Eichenbaum, H. (1999). Conscious awareness, memory, and the hippocampus. Nature Neuroscience, 2, 775-776.
24. Elman, J. (1991). Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning, 7, 195-225.
25. Elman, J. (2004). An alternative view of the mental lexicon. Trends in Cognitive Science, 8(7), 301-306.
26. Elman, J., & Zipser, D. (1988). Discovering the hidden structure of speech. Journal of the Acoustical Society of America, 83, 1615-1626.
27. Elman, J.L. (1990). Finding structure in time. Cognitive Science, 14, 179-211.
28. Estes, W. (1954). Individual behavior in uncertain situations: An interpretation in terms of statistical association theory. In R. Thrall, C. Coombs, & R.L. Davies (Eds.), Descition processes (pp. 127-137). New York: Wiley.
29. Fahlman, S. (1988). Faster-learning variations on back-propagation: An empirical study. In D.S. Touretzky (Ed.), Proceedings, 1988 connectionist models summer school (pp. 38-51). Los Altos, CA: Morgan-Kaufmann.
30. Fiser, J., & Aslin, R. (2002). Statistical learning of higher-order temporal structure from visual shape sequences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28(3), 458-467.
31. Gilovich, T., Vallone, R., & Tversky, A. (1985). The hot hand in basketball: On the misperception of random sequences. Cognitive Psychology, 17, 295-314.
32. Gomez, R.L. (1997). Transfer and complexity in artificial grammar learning. Cognitive Psychology, 33 (2), 157-207.
33. Gureckis, T. M, & Love, B.C. (2005). A critical look at the mechanisms underlying implicit sequence learning. In Proceedings of the 27th annual conference of the Cognitive Science Society (pp. 869-874). Mahwah, NJ: Erlbaum.
34. Gureckis, T.M. (2005). Mechanisms and constraints in sequence learning. Unpublished doctoral dissertation, University of Texas at Austin, Austin, TX.
35. Hahn, U., Chater, N., & Richardson, L. (2003). Similarity as transformation. Cognition, 87, 1-32.
36. Hanson, S., & Kegl, J. (1987). Parsnip: A connectionist network that learns natural language from exposure to natural language sentences. In Proceedings of the ninth annual conference of the Cognitive Science Society (pp. 106-111). Hillsdale, NJ: Erlbaum.
37. Hunt, R., & Aslin, R. (2001). Statistical learning in a serial reaction time task: Access to separable statistical cues by individual learners. Journal of Experimental Psychology: General, 130(4), 658-680.
38. Imai, S. (1977). Pattern similarity and cognitive transformations. Acta Psychologica, 41, 433-447.
39. Izui, Y., & Pentland, A. (1990). Speeding up back-propagation. In M. Caudill (Ed.), Proceedings of the international joint conference on neural networks (IJCNN90) (Vol. 1, pp. 639-642). Hillsdale, NJ: Erlbaum.
40. Jarvik, M. (1951). Probability learning and a negative recency effect in the serial anticipation of alternative symbols. Journal of Experimental Psychology, 41, 291-297.
41. Jordan, M. (1986). Attractor dynamics and parallelism in a connectionist sequential machine. In Proceedings of the twelfth annual conference of the cognitive science society (pp. 531-546). Hillsdale, NJ: Erlbaum.
42. Jordan, M., Flash, T., & Arnon, Y. (1994). A model of the learning of arm trajectories from spatial deviations. Journal of Cognitive Neuroscience, 6, 286-290.
43. Karlsson, F. (2007). Constraints on multiple center-embedding of clauses. Journal of Linguistics, 43, 365-392.
44. Keele, S., & Jennings, P. (1992). Attention in the representation of sequence: Experiment and theory. Human Movement Science, 11, 125-138.
45. Kolen, J. (1994). Exploring the computational capabilities of recurrent neural networks. Unpublished doctoral dissertation, The Ohio State University.
46. Laird, J.E., Newell, A., & Rosenbloom, P.S. (1987). Soar: An architecture for general intelligence. Artificial Intelligence, 33(1), 1-64.
47. Landy, D. (2004). Recurrent representation reinterpreted. In Aaai fall symposium on connectionism and compositionality (pp. 40-43). Arlington, VA: American Association for Artificial Intelligence.
48. Lashley, K. (1951). The problem of serial order in behavior. In L. Jeffress (Ed.), Cerebral mechanisms in behavior (pp. 112-136). New York: Wiley.
49. Lebiere, C., & Wallach, D. (2000). Sequence learning in the act-r cognitive architecture: Empirical analysis of a hybrid model. In R. Sun & C. Giles (Eds.), Sequence learning (pp. 188-212). Berlin: Springer-Verlag.
50. Lee, Y. (1997). Learing and awareness in the serial reaction time task. In M. Shafto & P. Langley (Eds.), Proceedings of the 19th annual conference of the Cognitive Science Society (pp. 119-124). Hillsdale, NJ: Erlbaum.
51. Love, B., & Gureckis, T. (2007). Models in search of the brain. Cognitive, Affective, and Behavioral Neuroscience, 7(2), 90-108.
52. Love, B., Medin, D., & Gureckis, T. (2004). SUSTAIN: A network model of category learning. Psychological Review, 111(2), 309-332.
53. Love, B.C. (2002). Comparing supervised and unsupervised category learning. Psychonomic Bulletin and Review, 9, 829-835.
54. Luce, R.D. (1959). Individual choice behavior: A theoretical analysis. Westport, CT: Greenwood Press.
55. Marcus, G. (1999). Reply to Seidenberg and Elman. Trends in Cognitive Science, 3, 289.
56. Marcus, G. (2001). The algebraic mind. Cambridge, MA: MIT Press.
57. Marcus, G., Vijayan, S., Rao, S.B., & Vishton, P. (1999). Rule learning by seven-month-old infants. Science, 283, 77-80.
58. Maskara, A., & Noetzel, A. (1992). Forced simple recurrent neural network and grammatical inference. In Proceedings of the 14th annual conference of the cognitive science society (pp. 420-427).Hillsdale, NJ:Erlbaum.
59. Maskara, A., & Noetzel, A. (1993). Sequence learning with recurrent neural networks. Connection Science, 5, 139-152.
60. McClelland, J., McNaughton, B., & O'Reilly, R. (1995). Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102(3), 419-457.
61. McCulloch, W., & Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics, 5, 115-133.
62. Medin, D.L., & Schwanenugel, P.J. (1981). Linear separability in classification learning. Journal of Experimental Psychology: Human Learning & Memory, 7, 355-368.
63. Minsky, M., & Papert, S. (1969). Perceptrons. Cambridge, MA: MIT Press.
64. Minsky, M., & Papert, S. (1998). Perceptrons: Expanded edition. Cambridge, MA: MIT Press.
65. Myers, J. (1976). Probability learning. In W. Estes (Ed.), The psychology of learning and motivation: Vol. 4. advances in research and theory (pp. 109-170). New York: Academic Press.
66. Nicks, D. (1959). Prediction of sequential two-choice decisions from event runs. Journal of Experimental Psychology, 57(2), 105-114.
67. Nissen, M., & Bullemer, P. (1987). Attentional requirements of learning: Evidence from performance measures. Cognitive Psychology, 19, 1-32.
68. Quartz, S. (1993). Neural networks nativism and the plausibility of constructivism. Cognition, 48, 223-242.
69. Reed, J., & Johnson, P. (1994). Assessing implicit learning with indirect tests: Determining what is learned about sequence structure. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20(3), 585-594.
70. Remillard, G., & Clark, J. (2001). Implicit learning of first-, second-, and third-order transitional probabilities. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27(2), 483-498.
71. Rescorla, R., & Wagner, A. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and non-reinforcement. In A. Black & W. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
72. Rodriguez, P. (2001). Simple recurrent networks learn context-free and context-sensitive languages by counting. Neural Computation, 13, 2093-2118.
73. Rodriguez, P., Wiles, J., & Elman, J. (1999). A recurrent neural network that learns to count. Connection Science, 11(1), 5-40.
74. Rosenblatt, F. (1958). The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65, 386-408.
75. Rumelhart, D.E., McClelland, J.L., & the PDP Research Group. (1986). Parallel distributed processing. explorations in the microstructure of cognition. Cambridge, MA: MIT Press.
76. Sang, E. (1995, September). The limitations of modeling finite state grammars with simple recurrent networks. Unpublished.
77. Schendan, H., Searl, M., Melrose, R., & Stern, C. (2003). An FMRI study of the role of the medial temporal lobe in implicit and explicit sequence learning. Neuron, 37, 1013-1025.
78. Servan-Schreiber, D., Cleeremans, A., & McClelland, J. (1991). Graded state machines: The representation of temporal contingencies in simple recurrent networks. Machine Learning, 7, 161-193.
79. Skinner, B. (1957). Verbal behavior. New York: Appleton-Century-Crofts.
80. Stadler, M.A. (1992). Statistical structure and implicit serial learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19(2), 318-327.
81. Sutherland, R., & Rudy, J. (1989). Configural association theory: The contribution of the hippocampus to learning, memory, and amnesia. Psychobiology, 17(2), 129-144.
82. Sutton, R., & Barto, A. (1981). Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review, 88, 135-170.
83. Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 2, 105-110.
84. Wagner, A., & Rescorla, R. (1972). Inhibition in Pavlovian conditioning: Application of a theory. In R. Boake & M. Halliday (Eds.), Inhibition and learning (pp. 301-336). London: Academic Press.
85. Wickelgren, W. (1965). Short-term memory for phonemically similar lists. American Journal of Psychology, 78, 567-574.
86. Widrow, B., & Hoff, M. (1960). Adaptive switching circuits. Institute of Radio Engineers, Western Electronic Show and Convention Record, 4, 96-104.
87. Willingham, D.B., Nissen, M.J., & Bullemer, P. (1989). On the development of procedural knowledge. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15(6), 1047-1060.