Parallel distributed processing at 25: Further explorations in the microstructure of cognition

Cognitive Science

Volumn 38, Issue 6, 2014, Pages 1024-1077

  Rogers, Timothy T ^a   Mcclelland, James L ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Cognition; Cognitive control; Connectionist models; Language; Learning; Memory; Neural networks; Perception

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; COGNITION; CONSCIOUSNESS; HUMAN; LANGUAGE; PSYCHOLOGY;

COGNITION; COGNITIVE SCIENCE; CONSCIOUSNESS; HUMANS; LANGUAGE; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER);

EID: 84906262947     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/cogs.12148     Document Type: Article

References (233)

1. Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985). A learning algorithm for Boltzmann machines. Cognitive Science, 9, 147-169.
2. Albright, A., & Hayes, B. (2003). Rules vs. analogy in English past tenses: A computational/experimental study. Cognition, 90(2), 119-161.
3. Altmann, G. T. M., & Dienes, Z. (1999). Rule learning by seven-month-old infants and neural networks. Science, 284, 875.
4. Anderson, J. R. (1975). Computer simulation of a language-acquisition system. In R. L. Solso (Ed.), Information processing and cognition: The loyola symposium (pp. 295-349). Hillsdale, NJ: Lawrence Erlbaum.
5. Anderson, J. R. (1983). The architecture of cognition. Cambridge, MA: Harvard.
6. Anderson, J. R. (1990). The adaptive character of thought. Hillsdale, NJ: Erlbaum.
7. Anderson, J. A., Silverstein, J. W., Ritz, S. A., & Jones, R. S. (1977). Distinctive features, categorical perception, and probability learning: Some applications of a neural model. Psychological Review, 84, 413-451.
8. Barto, A. G. (1994). Reinforcement learning control. Current Opinion in Neurobiology, 4, 888-893.
9. Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007). Greedy layer-wise training of deep networks. B. Schölkopf, J. Platt & T. Hoffman (Eds.), Advances in Neural Information Processing, 19(d), 153.
10. Besner, D., Twilley, L., McCann, R. S., & Seergobin, K. (1990). On the connection between connectionism and data: Are a few words necessary? Psychological Review, 97(3), 432-446.
11. Botvinick, M. M., & Cohen, J. D. (2014). The Computational and Neural Basis of Cognitive Control: Charted Territory and New Frontiers. Cognitive Science, 38, 1249-1285.
12. Botvinick, M. M., & Plaut, D. C. (2004). Doing without schema hierarchies: A recurrent connectionist approach to normal and impaired routine sequential action. Psychological Review, 111(2), 395-429.
13. Brown, R. (1973). A first language. Cambridge, MA: Harvard University Press.
14. Bullmore, E., & Sporns, O. (2009). Complex brain networks: Graph theoretical analysis of structural and functional systems. Nature Reviews Neuroscience, 10(3), 186-198. doi:10.1038/nrn2575.
15. Burton, A. M., Bruce, V., & Johnston, R. A. (1990). Understanding face recognition with an interactive activation model. British Journal of Psychology, 81(3), 361-380. doi:10.1111/j.2044-8295.1990.tb02367.x.
16. Bybee, J. L. (1985). Morphology: A study of the relation between meaning and form. Amsterdam, the Netherlands: John Benjamins.
17. Bybee, J. L. (1995). Regular morphology and the lexicon. Language and Cognitive Processes, 10(5), 425-455.
18. Bybee, J. L., & Slobin, D. I. (1982). Rules and schemas in the development and use of the English past tense. Language, 58(2), 265-289.
19. Caramazza, A. (1984). On drawing inferences about the structure of normal cognitive systems from the analysis of patterns of impaired performance: The case for single-patient studies. Brain and Cognition, 5(1), 41-66. doi:10.1016/0278-2626(86)90061-8.
20. Carey, S. (1985). Conceptual change in childhood. Cambridge, MA: MIT Press.
21. Carey, S. (2000). The origin of concepts. Cognition and Development, 1, 37-42.
22. Carey, S., & Spelke, E. (1994). Domain-specific knowledge and conceptual change. In L. A. H. & S. Gelman (Ed.), Mapping the mind: Domain specificity in cognition and culture (pp. 169-200). New York: Cambridge University Press.
23. Chang, F., Dell, G. S., & Bock, K. (2006). Becoming syntactic. Psychological Review, 113(2), 234-272.
24. Chomsky, N. (1965). Aspects of the theory of syntax. Cambridge, MA: MIT Press.
25. Clark, D. (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 36(03), 181-204. DOI: http://dx.doi.org/10.1017/S0140525X12000477
26. Cleeremans, A. (2014). Connecting Conscious and Unconscious Processing. Cognitive Science, 38, 1286-1315.
27. Cleeremans, A., & McClelland, J. L. (1991). Learning the structure of event sequences. Journal of Experimental Psychology: General, 120, 235-253.
28. Cohen, J. D., Aston-Jones, G., & Gilzenrat, M. S. (2004). A systems-level perspective on attention and cognitive control. In M. I. Posner (Ed.), Cognitive neuroscience of attention (pp. 71-90). New York: Guilford Press.
29. Cohen, J. D., Dunbar, K., & McClelland, J. L. (1990). On the control of automatic processes: A parallel distributed processing model of the Stroop effect. Psychological Review, 97, 332-361.
30. Cohen, L. B., Rundell, L. J., Spellman, B. A., & Cashon, C. H. (1999). Infants' perception of causal chains. Psychological Science, 10, 412-418.
31. Coltheart, M., Rastle, K., Perry, C., Langdon, R., & Ziegler, J. (2001). DRC: A Dual Route Cascaded model of visual word recognition and reading aloud. Psychological Review, 108, 204-256.
32. Colunga, E., & Smith, L. (2005). From the lexicon to expectations about kinds: A role for associative learning. Psychological Review, 112(2), 347-382.
33. Davidson, K., Eng, K., & Barner, D. (2012). Does learning to count involve a semantic induction? Cognition, 123(1), 162-173.
34. Deneve, S., Latham, P. E., & Pouget, A. (1999). Reading population codes: A neural implementation of ideal observers. Nature Neuroscience, 2(8), 740-745.
35. Devlin, J. T., Gonnerman, L. M., Andersen, E. S., & Seidenberg, M. S. (1998). Category-specific semantic deficits in focal and widespread brain damage: A computational account. Journal of Cognitive Neuroscience, 10(1), 77-94.
36. Dilkina, K., McClelland, J. L., & Plaut, D. C. (2008). A single-system account of semantic and lexical deficits in five semantic dementia patients. Cognitive Neuropsychology, 25(2), 136-164.
37. Eliasmith, C., & Anderson, C. H. (2004). Neural engineering: Computation, representation, and dynamics in neurobiological systems. Cambridge, MA: MIT Press.
38. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179-211.
39. Elman, J. L. (1991). Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning, 7, 194-220.
40. Elman, J. L., Bates, E. A., Johnson, M. H., Karmiloff-Smith, A., Parisi, D., & Plunkett, K. (1996). Rethinking innateness: A connectionist perspective on development. Cambridge, MA: MIT Press.
41. Evans, N., & Levinson, S. C. (2009). The myth of language universals: Language diversity and its importance for cognitive science. Behavioral and Brain Sciences, 32(5), 429-448; discussion 448-494.
42. Farah, M. J. (1990). Visual agnosia. Cambridge, MA: MIT Press.
43. Farah, M. J., & McClelland, J. L. (1991). A computational model of semantic memory impairment: Modality-specificity and emergent category-specificity. Journal of Experimental Psychology: General, 120, 339-357.
44. Feldman, J. A., & Ballard, D. H. (1982). Connectionist models and their properties. Cognitive Science, 6, 205-254.
45. Feldman, N. H., Griffiths, T. L., & Morgan, J. L. (2009). The influence of categories on perception: Explaining the perceptual magnet effect as optimal statistical inference. Psychological Review, 116(4), 752-782.
46. Fodor, J. A. (1983). Modularity of mind: An essay on faculty psychology. Cambridge, MA: MIT Press.
47. Fodor, J. A., & Pylyshyn, Z. W. (1988). Connectionism and cognitive architecture: A critical analysis. Cognition, 28, 3-71.
48. Frank, M. J., Loughry, B., & O'Reilly, R. C. (2001). Interactions between frontal cortex and basal ganglia in working memory: A computational model. Cognitive, Affective, & Behavioral Neuroscience, 1(2), 137-160. doi:10.3758/CABN.1.2.137.
49. Frazier, L., & Fodor, J. D. (1978). The sausage machine: A new two-stage parsing model. Cognition, 6(4), 291-325.
50. Freeman, J. B., & Ambady, N. (2011). A dynamic interactive theory of person construal. Psychological Review, 118(2), 247-279.
51. French, R. M., Addyman, C., & Mareschal, D. (2011). TRACX: A recognition-based connectionist framework for sequence segmentation and chunk extraction. Psychological Review, 118(4), 614-636. doi:10.1037/a0025255.
52. Gelman, S. A., & Markman, E. M. (1986). Categories and induction in young children. Cognition, 23, 183-209.
53. Gelman, R., & Williams, E. M. (1998). Enabling constraints for cognitive development and learning: A domain-specific epigenetic theory. In D. Kuhn & R. Siegler (Eds.), Handbook of child psychology, Volume II: Cognition, perception and development (pp. 575-630). New York: John Wiley and Sons.
54. Goldberg, A. E. (2003). Constructions: A new theoretical approach to language. Trends in Cognitive Sciences, 7(5), 219-224. doi:10.1016/S1364-6613(03)00080-9.
55. Goldinger, S. D. (1998). Echoes of echoes? An episodic theory of lexical access. Psychological Review, 105(2), 251-279.
56. Gordon, P. (2004). Numerical cognition without words: Evidence from Amazonia. Science, 306(5695), 496-499. doi:10.1126/science.1094492.
57. Gough, P. B. (1972). One second of reading. In J. F. Kavanagh, & I. G. Mattingly (Eds.), Language by eye and by ear. Cambridge, MA: MIT Press.
58. Graves, W. W., Desai, R., Humphries, C., Seidenberg, M. S., & Binder, J. R. (2010). Neural systems for reading aloud: A multiparametric approach. Cerebral cortex, 20(8), 1799-1815. doi:10.1093/cercor/bhp245
59. Graves, A., Mohamed, A., & Hinton, G. (2013). Speech recognition with deep recurrent neural networks. 2013 IEEE international conference on acoustics, speech and signal processing (pp. 6645-6649). doi:10.1109/ICASSP.2013.6638947
60. Greenberg, J. (1963). Some universals of grammar with particular reference to the order of meaningful elements. In J. Greenberg (Ed.), Universals of language (pp. 73-113). Cambridge, MA: MIT Press.
61. Griffiths, T. L., Chater, N., Kemp, C., Perfors, A., Tenenbaum, J. B., & Griffiths, T. (2010). Probabilistic models of cognition: Exploring the laws of thought. Trends in Cognitive Sciences, 14(7), 357-364.
62. Hahn, U., & Nakisa, R. C. (2000). German inflection: Single route or dual route? Cognitive Psychology, 41(4), 313-360.
63. Harm, M. W., & Seidenberg, M. (2004). Computing the meanings of words in reading: Cooperative division of labor between visual and phonological processes. Psychological Review, 111(3), 662-720.
64. Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science, 293, 2425-2430.
65. Hinton, G. E. (1989). Learning distributed representations of concepts. In R. G. M. Morris (Ed.), Parallel distributed processing: Implications for psychology and neurobiology (pp. 46-61). Oxford, England: Clarendon Press.
66. Hinton, G. E., & McClelland, J. L. (1988). Learning representations by recirculation. In D. Z. Anderson (Ed.), Neural Information Processing Systems (pp. 358-366). New York: American Institute of Physics.
67. Hinton, G. E., & Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks. Science, 313(5786), 504-507. doi:10.1126/science.1127647.
68. Hinton, G. E., & Sejnowski, T. J. (1986). Learning and relearning in Boltzmann machines. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing (Vol. 1, pp. 282-317). Cambridge: MIT Press.
69. Jacobs, R. A., & Jordan, M. I. (1992). Computational consequences of a bias toward short connections. Journal of Cognitive Neuroscience, 4(4), 323-336.
70. Joanisse, M. F., & Seidenberg, M. S. (1999). Impairments in verb morphology after brain injury: A connectionist model. Proceedings of the National Academy of Science, 96, 7592-7597.
71. Johnson, S. (2001). Emergence: The connected lives of ants, brains, cities, and software. New York: Touchstone.
72. Johnson, S. P., & Johnson, K. L. (2000). Early perception-action coupling: Eye movements and the development of object perception. Infant Behavior and Development, 23, 461-483.
73. Johnson, J. S., Spencer, J. P., & Schöner, G. (2008). Moving to higher ground: The dynamic field theory and the dynamics of visual cognition. New Ideas in Psychology, 26(2), 227-251. doi:10.1016/j.newideapsych.2007.07.007.
74. Jordan, M. I., & Rumelhart, D. E. (1992). Forward models: Supervised learning with a distal teacher. Cognitive Science, 16(3), 307-354.
75. Karmiloff-Smith, A. (1992). Beyond Modularity: A Developmental Perspective on Cognitive Science. Cambridge, MA: MIT Press.
76. Keil, F. (1989). Concepts, Kinds, and Cognitive Development. Cambridge, MA: MIT Press.
77. Kemp, C., & Tenenbaum, J. B. (2008). The discovery of structural form. Proceedings of the National Academy of Sciences, 105(31), 10687-10692.
78. Kemp, C., & Tenenbaum, J. B. (2009). Structured statistical models of inductive reasoning. Psychological Review, 116(2), 20-58.
79. Knill, D. C., & Pouget, A. (2004). The Bayesian brain: The role of uncertainty in neural coding and computation. Trends in Neurosciences, 27(12), 712-719.
80. Kollias, P., & McClelland, J. L. (2013). Context, cortex, and associations: A connectionist developmental approach to verbal analogies. Frontiers in Psychology, 4, 857. doi:10.3389/fpsyg.2013.00857.
81. Kopcke, K. (1988). Schemas in German plural formation. Lingua, 74, 303-335.
82. Kriegeskorte, N., Mur, M., & Bandettini, P. (2008). Representational similarity analysis-connecting the branches of systems neuroscience. Frontiers in Systems Neuroscience, 2, 4. doi:10.3389/neuro.06.004.2008.
83. Kumaran, D., & McClelland, J. L. (2012). Generalization through the recurrent interaction of episodic memories: A model of the hippocampal system. Psychological Review, 119(3), 573-616. doi:10.1037/a0028681.
84. Laird, J. E., Newell, A., & Rosenbloom, P. S. (1987). SOAR: An architecture for general intelligence. Artificial Intelligence, 33(1), 1-64.
85. Lambon Ralph, M. A., Lowe, C., & Rogers, T. T. (2007). The neural basis of category-specific semantic deficits for living things: Evidence from semantic dementia, HSVE and a neural network model. Brain, 130, 1127-1137.
86. Le, Q. V., Ranzato, M. A., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J. & Ng, A. Y. (2012). Building high-level features using large scale unsupervised learning. Proceedings of the International Conference on Machine Learning, Edinburgh, Scotland, UK. June, 2012. http://icml.cc/2012/papers/73.pdf
87. Le, Q. V. (2013). Building high-level features using large scale unsupervised learning. 2013 IEEE international conference on acoustics, speech and signal processing (pp. 8595-8598). doi:10.1109/ICASSP.2013.6639343
88. LeCun, Y. L. Y., Kavukcuoglu, K., & Farabet, C. (2010). Convolutional networks and applications in vision. Circuits and systems ISCAS proceedings of 2010 IEEE international symposium on circuits and systems (pp. 253-256). doi:10.1109/ISCAS.2010.5537907
89. Lewes, G. H. (1879). Problems of life and mind. Vol. 1. Boston, MA: Houghton, Osgood and Company.
90. MacWhinney, B., & Leinbach, J. (1991). Implementations are not conceptualizations: Revising the verb learning model. Cognition, 40, 121-153.
91. Marcus, G. F. (2001). The algebraic mind. Cambridge, MA: MIT Press.
92. Marcus, G. F., Brinkmann, U., Clahsen, H., Wiese, R., & Pinker, S. (1995). German inflection: The exception that proves the rule. Cognitive Psychology, 29(3), 189-256.
93. Marcus, G. F., Pinker, S., Ullman, M., Hollander, M., Rosen, J. T., & Xu, F. (1992). Overregularization in language acquisition. Monographs of the Society for Research in Child Development, 57(4), 1-165.
94. Mareschal, D. (2000). Infant object knowledge: Current trends and controversies. Trends in Cognitive Science, 4, 408-416.
95. Mareschal, D., French, R. M., & Quinn, P. C. (2000). A connectionist account of asymmetric category learning in early infancy. Developmental Psychology, 36(5), 635-645.
96. Marr, D. (1971). Simple memory: A theory for archicortex. The Philosophical Transactions of the Royal Society of London, 262(Series B), 23-81.
97. Marr, D. (1982). Vision. New York: Freeman.
98. Massaro, D. W. (1989). Testing between the TRACE model and the fuzzy logical model of speech perception. Cognitive Psychology, 21, 398-421.
99. Mayor, J., & Plunkett, K. (2010). A neurocomputational account of taxonomic responding and fast mapping in early word learning. Psychological Review, 117(1), 1-31. doi:10.1037/a0018130.
100. McClelland, J. L. (1981). Retrieving general and specific information from stored knowledge of specifics. Proceedings of the Third Annual Conference of the Cognitive Science Society (pp. 170-172). Berkeley, CA: Cognitive Science Society.
101. McClelland, J. L. (1989). Parallel distributed processing and role assignment constraints. In Y. Wilks (Ed.), Theoretical issues in natural language processing (pp. 78-85). Hillsdale, NJ: Erlbaum.
102. McClelland, J. L. (2010). Emergence in cognitive science. Topics in Cognitive Science, 2(4), 751-770. doi:10.1111/j.1756-8765.2010.01116.x.
103. McClelland, J. L. (2013a). Integrating probabilistic models of perception and interactive neural networks: A historical and tutorial review. Frontiers in Psychology, doi:10.3389/fpsyg.2013.00503.
104. McClelland, J. L. (2013b). Incorporating rapid neocortical learning of new schema-consistent information into complementary learning systems theory. Journal of Experimental Psychology: General, 142(4), 1190-1210.
105. McClelland, J. L., Botvinick, M. M., Noelle, D. C., Plaut, D. C., Rogers, T. T., Seidenberg, M. S., & Smith, L. B. (2010). Letting structure emerge: Connectionist and dynamical systems approaches to cognition. Trends in Cognitive Sciences, 14(8), 348-356.
106. McClelland, J. L., & Elman, J. L. (1986). The TRACE model of speech perception. Cognitive Psychology, 18, 1-86.
107. McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102, 419-457.
108. McClelland, J. L., Mirman, D., Bolger, D. J., & Khaitan, P. (2014). Interactive activation and mutual constraint satisfaction in perception and cognition. Cognitive Science, 38, 1139-1189.
109. McClelland, J. L., & Patterson, K. (2002a). "Words or Rules" cannot exploit the regularity in exceptions. Trends in Cognitive Science, 6, 464-465.
110. McClelland, J. L., & Patterson, K. (2002b). Rules or connections in past-tense inflections: What does the evidence rule out? Trends in Cognitive Science, 6, 465-472.
111. McClelland, J. L., & Rumelhart, D. E. (1981). An interactive activation model of context effects in letter perception: Part 1. An account of basic findings. Psychological Review, 88, 375-407.
112. McClelland, J. L., & Rumelhart, D. E. (1985). Distributed memory and the representation of general and specific information. Journal of Experimental Psychology: General, 114, 159-188.
113. McClelland, J. L., Rumelhart, D. E., & Hinton, G. E. (1986). The appeal of parallel distributed processing. In D. E. Rumelhart, J. L. McClelland, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1, pp. 3-44). Cambridge, MA: MIT Press.
114. McClelland, J. L., & St. John, M. F. & Taraban, R. (1989). Sentence comprehension: A parallel distibuted processing approach. Language and Cognitive Processes, 4, 287-335.
115. McCloskey, M. (1991). Networks and theories: The place of connectionism in cognitive science. Psychological Science, 2(6), 387-395.
116. McCloskey, M., & Cohen, N. J. (1989). Catastrophic interference in connectionist networks: The sequential learning problem. In G. H. Bower (Ed.), The psychology of learning and motivation. Vol. 24 (pp. 109-165). New York: Academic Press.
117. McMurray, B., Horst, J. S., & Samuelson, L. K. (2012). Word learning emerges from the interaction of online referent selection and slow associative learning. Psychological Review, 119(4), 831-877.
118. McRae, K., & Cree, G. (2002). Factors underlying category-specific deficits. In G. Humphreys (Ed.), Category specificity in brain and mind. Hove, UK: Psychology Press.
119. McRae, K., Spivey-Knowlton, M. J., & Tanenhaus, M. K. (1998). Modeling the influence of thematic fit (and other constraints) in on-line sentence comprehension. Journal of Memory and Language, 38(3), 283-312. doi:10.1006/jmla.1997.2543.
120. Miikkulainen, R. (1996). Subsymbolic case-role analysis of sentences with embedded clauses. Cognitive Science, 20(1), 47-74.
121. Minsky, M. (1974). A framework for representing knowledge. In P. Winston (Ed.), The psychology of computer vision (pp. 211-277). New York, NY: McGraw-Hill. doi:10.2307/3680823
122. Minsky, M., & Papert, S. (1969). Perceptrons: An introduction to computational geometry. Cambridge, MA: MIT Press.
123. Mohamed, A., Dahl, G., & Hinton, G. (2009). Deep belief networks for phone recognition. Science, 4(5), 1-9. doi:10.4249/scholarpedia.5947.
124. Montague, P. R., Dayan, P., & Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience, 16, 1936-1947.
125. Morowitz, H. J. (2002). The emergence of everything: How the world became complex. New York: Oxford University Press.
126. Movellan, J. R., & McClelland, J. L. (2001). The Morton-Massaro law of information integration: Implications for models of perception. Psychological Review, 108, 113-148.
127. Munakata, Y., & McClelland, J. L. (2003). Connectionist models of development. Developmental Science, 6(4), 413-429.
128. Munakata, Y., McClelland, J. L., Johnson, M. H., & Siegler, R. S. (1997). Rethinking infant knowledge: Toward an adaptive process account of successes and failures in object permanence tasks. Psychological Review, 104, 686-713.
129. Murphy, G., & Medin, D. L. (1985). The role of theories in conceptual coherence. Psychological Review, 92, 289-316.
130. Neisser, U. (1967). Cognitive Psychology. New York: Appleton-Century-Crofts.
131. Newell, A. (1990). Unified Theories of Cognition. Cambridge, MA: MIT Press.
132. Newell, Allen., & Simon, H. A. (1961). Computer simulation of human thinking. Science, 134(3495), 2011-2017.
133. Norman, K. A., & O'Reilly, R. C. (2003). Modeling hippocampal and neocortical contributions to recognition memory: A complementary learning-systems approach. Psychological Review, 110(4), 611-646.
134. Oden, G. C. (1978). Semantic constraints and judged preference for interpretations of ambiguous sentences. Memory & Cognition, 6(1), 26-37. doi:10.3758/BF03197425.
135. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive-field properties by learning a sparse code for natural images. Nature, 381, 607-609.
136. O'Reilly, R. C., Bhattacharyya, R., Howard, M. D., & Ketz, N. (2014). Complementary Learning Systems. Cognitive Science, 38, 1229-1248.
137. O'Reilly, R. C., Braver, T. S., & Cohen, J. D. (1999). A biologically-based computational model of working memory. In A. Miyake & P. Shah (Ed.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 375-411). New York: Cambridge University Press.
138. O'Reilly, R. C., & Munakata, Y. (2000). Computational explorations in cognitive neuroscience. Cambridge, MA: MIT Press.
139. O'Reilly, R. C., & Rudy, J. W. (2000). Computational principles of learning in the neocortex and hippocampus. Hippocampus, 10(4), 389-397.
140. Patterson, K., Lambon Ralph, M. A., Jefferies, E., Woollams, A., Jones, R., Hodges, J. R., & Rogers, T. T. (2006). "Pre-semantic" cognition in semantic dementia: Six deficits in search of an explanation. Journal of Cognitive Neuroscience, 18(2), 169-183.
141. Pearl, J. (1982). Reverend Bayes on inference engines: A distributed hierarchical approach. In D. L. Waltz (Ed.), Proceedings of the AAAI national conference on AI (pp. 133-136).
142. Pereira, F., Mitchell, T., & Botvinick, M. M. (2009). Machine learning classifiers and fMRI: A tutorial overview. NeuroImage, 45(1), S199-S209.
143. Perry, C., Ziegler, J. C., & Zorzi, M. (2010). Beyond single syllables: large-scale modeling of reading aloud with the Connectionist Dual Process (CDP++) model. Cognitive Psychology, 61(2), 106-151.
144. Phaf, R. H., van der Heijden, A. H. C., & Hudson, P. T. W. (1990). SLAM: A connectionist model for attention in visual selection tasks. Cognitive Psychology, 22, 273-341.
145. Piaget, J. (1970). The child's conception of movement and speed. New York: Ballantine.
146. Piaget, J. (2008). Intellectual evolution from adolescence to adulthood. Human Development, 51(1), 40-47. doi:10.1159/000112531.
147. Pierrehumbert, J. B. (2003). Phonetic diversity, statistical learning, and acquisition of phonology. Language and Speech, 46(Pt 2-3), 115-154.
148. Pinker, S. (1991). Rules of language. Science, 253, 530.
149. Pinker, S. (1999). Words and Rules. New York: Basic.
150. Pinker, S., & Prince, A. (1988). On language and connectionism: Analysis of a Parallel Distributed Processing model of language acquisition. Cognition, 28, 73-193.
151. Plaut, D. C. (2002). Graded modality-specific specialisation in semantics: A computational account of optic aphasia. Cognitive Neuropsychology, 19(7), 603-639.
152. Plaut, D. C., & Behrmann, M. (2011). Complementary neural representations for faces and words: A computational exploration. Cognitive Neuropsychology, 28(3-4), 251-275. doi:10.1080/02643294.2011.609812.
153. Plaut, D. C., & Booth, J. R. (2000). Individual and developmental differences in semantic priming: Empirical and computational support for a single-mechanism account of lexical processing. Psychological Review, 107(4), 786-823.
154. Plaut, D. C., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996). Understanding normal and impaired word reading: Computational principles in quasi-regular domains. Psychological Review, 103, 56-115.
155. Plaut, D. C., & Shallice, T. (1993). Deep dyslexia: A case study of connectionist neuropsychology. Cognitive Neuropsychology, 10(5), 377-500.
156. Plunkett, K., & Marchman, V. A. (1991). U-Shaped learning and frequency effects in a multi-layered perceptron: Implications for child language acquisition. Cognition, 38, 43-102.
157. Plunkett, K., & Marchman, V. A. (1996). Learning from a connectionist model of the acquisition of the English past tense. Cognition, 61(3), 299-308.
158. Plunkett, K., & Sinha, C. (1992). Connectionism and developmental theory. British Journal of Developmental Psychology, 10(3), 209-254.
159. Pollack, J. B. (1990). Recursive distributed representations. Artificial Intelligence, 46(1-2), 77-105. doi:10.1016/0004-3702(90)90005-K.
160. Prince, A., & Smolensky, P. (1997). Optimality: From neural networks to universal grammar. Science, 275(5306), 1604-1610.
161. Ranzato, M., Huang, F. J., Boureau, Y.-L., & LeCun, Y. (2007). Unsupervised learning of invariant feature hierarchies with applications to object recognition. 2007 IEEE conference on computer vision and pattern recognition (pp. 1-8). doi:10.1109/CVPR.2007.383157
162. Rasmussen, D., & Eliasmith, C. (2011). A neural model of rule generation in inductive reasoning. In R. Cattrambone & S. Ohlsson (Eds.), Topics in Cognitive Science, 3(1), 140-153. doi:10.1111/j.1756-8765.2010.01127.x
163. Reicher, G. M. (1969). Perceptual recognition as a function of meaningfulness of stimulus material. Journal of Experimental Psychology, 81, 275-280.
164. Rogers, T. T., Lambon Ralph, M. A., Garrard, P., Bozeat, S., McClelland, J. L., Hodges, J. R., & Patterson, K. (2004). The structure and deterioration of semantic memory: A computational and neuropsychological investigation. Psychological Review, 111(1), 205-235.
165. Rogers, T. T., Lambon Ralph, M. A., Hodges, J. R., & Patterson, K. (2003). Object recognition under semantic impairment: The effects of conceptual regularities on perceptual decisions. Language and Cognitive Processes, 18(5/6), 625-662.
166. Rogers, T. T., & McClelland, J. L. (2004). Semantic cognition: A parallel distributed processing approach. Cambridge, MA: MIT Press.
167. Rogers, T. T., & McClelland, J. L. (2008a). A simple model from a powerful framework that spans levels of analysis. Behavioral and Brain Sciences, 31, 729-749.
168. Rogers, T. T., & McClelland, J. L. (2008b). Précis of semantic cognition: A parallel distributed processing approach. Behavioral and Brain Sciences, 31(06), 689. doi:10.1017/S0140525X0800589X.
169. Rogers, T. T., Rakison, D. H., & McClelland, J. L. (2004). U-shaped curves in development: A PDP approach. Journal of Cognition and Development, 5(1), 137-145. doi:10.1207/s15327647jcd0501_14.
170. Rohde, D. L. (2002). A connectionist model of sentence comprehension and production. Ph.D. Thesis. Pittsburgh, PA: Computer Science Department, Carnegie Mellon University.
171. Rohde, D. L., & Plaut, D. C. (1999). Simple recurrent networks can distinguish non-occurring from ungrammatical sentences given appropriate task structure: Reply to Marcus. Cognition, 73(3), 297-300.
172. Rosenblatt, F. (1958). The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65(6), 386-408.
173. Rueckl, J. G., Mikolinski, M., Raveh, M., Miner, C. S., & Mars, F. (1997). Morphological priming, fragment completion, and connectionist networks. Journal of Memory and Language, 36(3), 382-405.
174. Rumelhart, D. E. (1977). Toward an interactive model of reading. In S. Dornic (Ed.), Attention and performance VI. Hillsdale, NJ: Erlbaum.
175. Rumelhart, D. E. (1989). The architecture of mind: A connectionist approach. Foundations of Cognitive Science, 1, 133-159.
176. Rumelhart, D. E. (1990). Brain style computation: Learning and generalization. In S. F. Zornetzer, J. L. Ddavis, & C. Lau (Eds.), An Introduction to neural and electronic networks (pp. 405-420). San Diego, CA: Academic Press.
177. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning internal representations by error propagation. In D. E. Rumelhart J. L. McClelland, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1, pp. 318-362). Cambridge, MA: MIT Press.
178. Rumelhart, D. E., & McClelland, J. L. (1986). On learning the past tenses of English verbs. In J. L. McClelland & D. E. Rumelhart (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 2, pp. 216-271). Cambridge, MA: MIT Press.
179. Rumelhart, D. E., & McClelland, J. L., & the PDP Research Group (1986). Parallel distributed processing: Explorations in the microstructure of cognition. Volume I: foundations & volume II: Psychological and biological models. Cambridge, MA: MIT Press.
180. Rumelhart, D. E., & Ortony, A. (1976). The representation of knowledge in memory. In W. E. Montague, R. Anderson, & R. J. Sprio (Eds.), Schooling and the acquisition of knowledge. Hillsdale, NJ: Lawrence Erlbaum Associates.
181. Rumelhart, D. E., Smolensky, P., McClelland, J. L., & Hinton, G. E. (1986). Schemata and sequential thought processes in PDP Models. In J. L. McClelland & D. E. Rumelhart, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 2, pp. 7-57). Cambridge, MA: MIT Press.
182. Saffran, J. R. (2003). Statistical language learning: Mechanisms and constraints. Current Directions in Psychological Science, 12(4), 110-114. doi:10.1111/1467-8721.01243.
183. Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996). Statistical learning by 8-month-olds. Science, 274(5294), 1926-1928.
184. Salakhutdinov, R., & Hinton, G. (2009). Deep Boltzmann machines. Artificial Intelligence, 5(2), 448-455.
185. Samuel, A. L. (1959). Some studies in machine learning using the game of checkers. IBM Journal of Research and Development, 3(3), 210-229. doi:10.1147/rd.441.0206.
186. Saxe, A., McClelland, J. L., & Ganguli, S. (2013). Learning hierarchical categories in deep networks. Proceedings of the 35th annual meeting of the Cognitive Science Society (pp. 1271-1276). Austin, TX: Cognitive Science Society.
187. Schank, R. C. (1981). Language and memory. In D. A. Norman (Ed.), Perspectives on cognitive science (pp. 105-146). Hillsdale, NJ: Lawrence Erlbaum Associates.
188. Schank, R. C., & Abelson, R. P. (1977). Scripts, plans, goals and understanding. In A. Flammer & W. Kintsch (Eds.), Representation (Vol. Discourse, p. 272). Hillsdale, NJ: Lawrence Erlbaum Associates.
189. Schapiro, A. C., & McClelland, J. L. (2009). A connectionist model of a continuous developmental transition in the balance scale task. Cognition, 110(3), 395-411.
190. Schapiro, A. C., Rogers, T. T., Cordova, N. I., Turk-Browne, N. B., & Botvinick, M. M. (2013). Neural representations of events arise from temporal "community" structure. Nature Neuroscience, 16, 486-492.
191. Seidenberg, M. S., & McClelland, J. L. (1989). A distributed, developmental model of word recognition and naming. Psychological Review, 96, 523-568.
192. Seidenberg, M. S., & Plaut, D. C. (2014). Quasiregularity and its discontents: The legacy of the past tense debate. Cognitive Science, 38, 1190-1228.
193. Sejnowski, T. J., & Rosenberg, C. R. (1987). Parallel networks that learn to pronounce English text. Complex Systems, 1, 145-168.
194. Shallice, T. (1988). From neuropsychology to mental structure. Oxford, UK: Oxford University Press.
195. Shallice, T., & Cooper, R. P. (2011). The organization of mind. Oxford, UK: Oxford University Press.
196. Shirai, Y., & Andersen, R. W. (1995). The acquisition of tense-aspect morphology: A prototype account. Language, 71(4), 743-762.
197. Sibley, D. E., Kello, C. T., Plaut, D. C., & Elman, J. L. (2008). Large-scale modeling of wordform learning and representation. Cognitive Science, 32(4), 741-754. doi:10.1080/03640210802066964.
198. Siegler, R. S. (1976). Three aspects of cognitive development. Cognitive Psychology, 8(4), 481-520.
199. Siegler, R. S. (1981). Developmental sequences within and between concepts. Monographs of the Society for Research in Child Development, 46(2), 1-84. doi:10.2307/1165995.
200. Siegler, R. S., & Alibali, M. W. (2005). Childrens thinking. Upper Saddle River, NJ: Prentice Hall.
201. Siegler, R. S., & Chen, Z. (1998). Developmental differences in rule learning: A microgenetic analysis. Cognitive Psychology, 36(3), 273-310.
202. Sloutsky, V. M. (2010). From perceptual categories to concepts: What develops? Cognitive Science, 34(7), 1244-1286. doi:10.1111/j.1551-6709.2010.01129.x.
203. Smolensky, P. (1986). Information processing in dynamical systems: Foundations of harmony theory. In J. L. Mcclelland, D. E. Rumelhart, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1, pp. 194-281). Cambridge, MA: MIT Press.
204. Smolensky, P. (1990). Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artificial Intelligence, 46(1-2), 159-216. doi:10.1016/0004-3702(90)90007-M.
205. Smolensky, P., Goldrick, M., & Mathis, D. (2014). Optimization and Quantization in Gradient Symbol Systems: A Framework for Integrating the Continuous and the Discrete in Cognition. Cognitive Science, 38, 1102-1138.
206. Smolensky, P., & Legendre, G. (2005). The harmonic mind. Cambridge, MA: MIT Press.
207. Socher, R., Bauer, J., Manning, C. D., & Ng, A. Y. (2013). Parsing with compositional vector grammars. Proceedings of the 51st annual meeting of the Association for Computational Linguistics(Volume 1: Long Papers) (pp. 455-465). Sofia, Bulgaria: Association for Computational Linguistics.
208. Socher, R., Perelygin, A., Wu, J. Y., Chuang, J., Manning, C. D., Ng, A. Y., & Potts, C. (2013). Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank. Proceedings of the 2013 conference on empirical methods in natural language processing (pp. 1631-1642). Seattle, WA: Association for Computational Linguistics.
209. Spelke, E. S., Breinlinger, K., Macomber, J., & Jacobson, K. (1992). Origins of knowledge. Psychological Review, 99(4), 605-632.
210. Spencer, J., Thomas, M. S. C., & McClelland, J. L. (2009). Toward a unified theory of development: Connectionism and dynamic systems theory re-considered. Oxford, UK: Oxford University Press.
211. Spivey, M. J. (2008). Continuity of Mind. Oxford, UK: Oxford University Press.
212. Spivey, M. J., & Tanenhaus, M. K. (1998). Syntactic ambiguity resolution in discourse: Modeling the effects of referential context and lexical frequency. Journal of Experimental Psychology: Learning Memory and Cognition, 24(6), 1521-1543.
213. St. John, M. F. (1992). The story gestalt: A model of knowledge-intensive processes in text comprehension. Cognitive Science, 16, 271-306.
214. St. John, M. F., McClelland, J. L. (1990). Learning and applying contextual constraints in sentence comprehension. Artificial Intelligence, 46, 217-257.
215. Sternberg, S. (1969). The discovery of processing stages: Extensions of Donders' method. Acta Psychologica, 30(1), 276-315.
216. Stoianov, I., & Zorzi, M. (2012). Emergence of a "visual number sense" in hierarchical generative models. Nature Neuroscience, 15(2), 194-196. doi:10.1038/nn.2996.
217. Suri, R. E., & Schulz, W. (2001). Temporal difference model reproduces anticipatory neural activity. Neural Computation, 13, 841-862.
218. Tabor, W., Juliano, C., & Tanenhaus, M. (1997). Parsing in a dynamical system: An attractor-based account of the interaction of lexical and structural constraints in sentence processing. Language and Cognitive Processes, 12(2), 211-271. doi:10.1080/016909697386853.
219. Taraban, R., & McClelland, J. L. (1988). Constituent attachment and thematic role assignment in sentence processing: Influences of content-based expectations. Journal of Memory and Language, 27, 597-632.
220. Tenenbaum, J. B., Griffiths, T. L., & Kemp, C. (2006). Theory-based Bayesian models of inductive learning and reasoning. Trends in Cognitive Sciences, 10(7), 309-318.
221. Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011). How to grow a mind: Statistics, structure, and abstraction. Science (New York, N.Y.), 331(6022), 1279-1285. doi:10.1126/science.1192788.
222. Thelen, E., & Smith, L. B. (1996). A dynamic systems approach to the development of cognition and action. Cambridge, MA: MIT Press.
223. Thomas, M. S. C., & Karmiloff-Smith, A. (2003). Modeling language acquisition in atypical phenotypes. Psychological Review, 110(4), 647-682.
224. Tyler, L., Moss, H. E., Durrant-Peatfield, M. R., & Levy, J. P. (2000). Conceptual structure and the structure of concepts: A distributed account of category-specific deficits. Brain and Language, 75(2), 195-231.
225. Ueno, T., Saito, S., Rogers, T. T., & Lambon Ralph, M. A. (2011). Lichtheim 2: Synthesizing aphasia and the neural basis of language in a neurocomputational model of the dual dorsal-ventral language pathways. Neuron, 72(2), 385-396. doi:10.1016/j.neuron.2011.09.013.
226. Van Rijn, H., Van Someren, M., & Van Der Maas, H. (2003). Modeling developmental transitions on the balance scale task. Cognitive Science, 27(2), 227-257. doi:10.1207/s15516709cog2702_4.
227. Weigand, A. S., Rumelhart, D. E., & Huberman, B. A. (1991). Generalization by weight elimination applied to currency exchange rate prediction. Advances in Neural Information Processing Systems 3 (pp. 875-882). Menlo Park, CA: Morgan Kaufmann.
228. Wellman, H. M., & Gelman, S. A. (1997). Knowledge acquisition in foundational domains. In D. Kuhn & R. Siegler (Eds.), Handbook of child psychology, Volume 2: Cognition, perception and development (pp. 523-573). New York: John Wiley and Sons.
229. Westermann, G., & Mareschal, D. (2012). Mechanisms of developmental change in infant categorization. Cognitive Development, 27(4), 367-382. doi:10.1016/j.cogdev.2012.08.004.
230. Wheeler, D. D. (1970). Processes in word recognition. Cognitive Psychology, 1, 59-85.
231. Wilkening, F., & Anderson, N. H. (1980). Comparison of two rule assessment methodologies for studying cognitive development. Center for Human Information Processing Report (Vol. 94, p. 44 pp.).
232. Woods, W. A. (1970). Transition network grammars for natural language analysis. B. Grosz, K. Jones, & B. Webber, (Eds.), Communications of the ACM, 13(10), 591-606. doi:10.1145/355598.362773
233. Woollams, A. M., Lambon Ralph, M. A., Plaut, D. C., & Nagaraja, S. S. (2007). SD-squared: On the association between semantic dementia and surface dyslexia. Psychological Review, 114(2), 316-339.