Simple Substrates for Complex Cognition

Frontiers in Neuroscience

Volumn 2, Issue 2, 2008, Pages 255-263

  Dayan, Peter ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

actions; habits; prefrontal cortex; rules; striatum

Indexed keywords

COGNITION; CORPUS STRIATUM; HABIT; HUMAN; HUMAN EXPERIMENT; PREFRONTAL CORTEX; REVIEW;

EID: 77952549358     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/neuro.01.031.2008     Document Type: Review

References (70)

1. Anderson J. R., (1982). Acquisition of cognitive skill. Psychol. Rev. 89, 369–406.10.1037/0033-295X.89.4.369
2. Anderson J. R., Bothell D., Byrne M. D., Douglass S., Lebiere C., Qin Y., (2004). An integrated theory of the mind. Psychol. Rev. 111, 1036–1060.10.1037/0033-295X.111.4.103615482072
3. Anderson J. R., Fincham J. M., Qin Y., Stocco A., (2008). A central circuit of the mind. Trends. Cogn. Sci. 12, 136–143.10.1016/j.tics.2008.01.00618329948
4. Anderson J. R., Lebiere C., (1998). The Atomic Components of Thought. Mahwah, NJ, Erlbaum.
5. Badre D., Poldrack R. A., Paré-Blagoev E. J., Insler R. Z., Wagner A. D., (2005). Dissociable controlled retrieval and generalized selection mechanisms in ventrolateral prefrontal cortex. Neuron 47, 907–918.10.1016/j.neuron.2005.07.02316157284
6. Balleine B., Garner C., Gonzalez F., Dickinson A., (1995). Motivational control of heterogeneous instrumental chains. J. Exp. Psychol. 21, 203–217.
7. Chaiken S., Trope Y., (1999). Dual-Process Theories in Social Psychology. New York, NY, Guilford Press.
8. Crossman E., (1959). A theory of the acquisition of speed-skill. Ergonomics 2, 153–166.10.1080/00140135908930419
9. Daw N. D., Niv Y., Dayan P., (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal system for behavioral control. Nat. Neurosci. 8, 1704–1711.10.1038/nn156016286932
10. Dayan P., (2006). Images, frames, and connectionist hierarchies. Neural Comput. 18, 2293–2319.10.1162/neco.2006.18.10.229316907627
11. Dayan P., (2007). Bilinearity, rules and prefrontal cortex. Front. Comput. Neurosci. 1, 1.10.3389/neuro.10.001.200718946523
12. Dayan P., Hinton G. E., Neal R. M., Zemel R. S., (1995). The Helmholtz machine. Neural Comput. 7, 889–904.10.1162/neco.1995.7.5.8897584891
13. Derthick M., (1990). Mundane Reasoning by Parallel Constraint Satisfaction. Ph.D. thesis, Dept of Computer Science, Carnegie-Mellon, Pittsburgh, PA.
14. Dickinson A., (1985). Actions and habits: the development of behavioural autonomy. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 308, 67–78.10.1098/rstb.1985.0010
15. Dickinson A., Balleine B., (2002). The role of learning in motivation. In Stevens' Handbook of Experimental Psychology, Vol. 3, Gallistel C., ed. (New York, NY, Wiley), pp. 497–533.
16. Eichenbaum H., Cohen N. J., (2004). From Conditioning to Conscious Recollection: Memory Systems of the Brain (Oxford Psychology Series). New York, NY, Oxford University Press.
17. Epstein S., (1994). Integration of the cognitive and the psychodynamic unconscious. Am. Psychol. 49, 709–724.10.1037/0003-066X.49.8.7098092614
18. Evans J. S. B. T., (2003). In two minds: dual-process accounts of reasoning. Trends. Cogn. Sci. 7, 454–459.10.1016/j.tics.2003.08.01214550493
19. Fitts P., (1964). Perceptual-motor skill learning. In Categories of Human Learning, Melton A, ed. (New York, NY, Academic Press), pp. 243–285.
20. Frank M. J., Loughry B., O'Reilly R. C., (2001). Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn. Affect. Behav. Neurosci. 1, 137–160.10.3758/CABN.1.2.13712467110
21. Fukushima K., (1980). Neocognition: a self organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193–202.10.1007/BF003442517370364
22. Fusi S., Assad W. F., Miller E. K., Wang X. J., (2007). A neural circuit model of flexible sensorimotor mapping: learning and forgetting on multiple timescales. Neuron 54, 319–333.10.1016/j.neuron.2007.03.01717442251
23. Fuster J. M., (1997). The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe, 3rd edn. New York, NY, Raven Press.
24. Gers F. A., Schmidhuber J., Cummins F., (2000). Learning to forget: continual prediction with LSTM. Neural Comput. 12, 2451–2471.10.1162/08997660030001501511032042
25. Halford G. S., Cowan N., Andrews G., (2007). Separating cognitive capacity from knowledge: a new hypothesis. Trends Cogn. Sci. 11, 236–242.10.1016/j.tics.2007.04.00117475538
26. Hazy T. E., Frank M. J., O'Reilly R. C., (2006). Banishing the homunculus: Making working memory work. Neuroscience 139, 105–118.10.1016/j.neuroscience.2005.04.06716343792
27. Hazy T. E., Frank M. J., O'Reilly R. C., (2007). Toward an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 362, 1601–1613.10.1098/rstb.2007.205517428778
28. Hinton G., (1990). Preface to the special issue on connectionist symbol processing. Artif. Intell. 46, 1–4.10.1016/0004-3702(90)90002-H
29. Hinton G. E., Dayan P., Frey B. J., Neal R. M., (1995). The wake-sleep algorithm for unsupervised neural networks. Science 268, 1158–1161.10.1126/science.77618317761831
30. Hinton G. E., Zemel R. S., (1994). Autoencoders, minimum description length, and Helmholtz free energy. Adv. Neural Inf. Process. Syst. 6, 3–10.
31. Hochreiter S., Schmidhuber J., (1997). Long short-term memory. Neural Comput. 9, 1735–1780.10.1162/neco.1997.9.8.17359377276
32. Hopfield J. J., (1982). Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA 79, 2554–2558.10.1073/pnas.79.8.2554
33. Kahneman D., Frederick S., (2002). Representativeness revisited: attribute substitution in intuitive judgment. In Heuristics of Intuitive Judgement: The Psychology of Intuitive Judgement, Gilovich T., Griffin D., Kahneman D., eds (New York, NY, CUP), pp. 49–81.
34. Kawato M., Hayakawa H., Inui T., (1993). A forward-inverse optics model of reciprocal connections between visual cortical areas. Netw. Comput. Neural Syst. 4, 415–422.10.1088/0954-898X/4/4/001
35. Koechlin E., Basso G., Pietrini P., Panzer S., Grafman J., (1999). The role of the anterior prefrontal cortex in human cognition. Nature 399, 148–51.10.1038/2017810335843
36. Koechlin E., Ody C., Kouneiher F., (2003). The architecture of cognitive control in the human prefrontal cortex. Science 302, 1181–1185.10.1126/science.108854514615530
37. Koechlin E., Summerfield C., (2007). An information theoretical approach to prefrontal executive function. Trends Cogn. Sci. 11, 229–235.10.1016/j.tics.2007.04.00517475536
38. Koenderink J. J., Van Doorn A. J., (1997). The generic bilinear calibration-estimation problem. Int. J. Comput. Vis. 23, 217–234.10.1023/A:1007971132346
39. Krueger K. A., Dayan P., (2007). Flexible shaping: how learning in small steps helps. In Poster II-41. COSYNE 2007.
40. Logan G., (1988). Toward an instance theory of automatization. Psychol. Rev. 95, 492–527.10.1037/0033-295X.95.4.492
41. Marr D., (1982). Vision. New York, NY, Freeman.
42. McCarthy J., Hayes P., (1969). Some philosophical problems from the standpoint of artificial intelligence. In Machine Intelligence, Vol. 4, Meltzer B., Michie D., eds (Edinburgh, Edinburgh University Press), pp. 463–502.
43. Neisser U., (1967). Cognitive Psychology. New York, NY, Appleton-Century-Crofts.
44. Newell A., (1990). Unified Theories of Cognition. Cambridge, MA, Harvard University Press.
45. Newell A., Rosenbloom P., (1981). Mechanisms of skill acquisition and the law of practice. In Cognitive Skills and their Acquisition, Anderson J., ed. (Hillsdale, NJ, Lawrence Erlbaum Associates), pp. 1–56.
46. Olshausen B. A., Anderson C. H., Van Essen D. C., (1993). A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. J. Neurosci. 13, 4700–4719.8229193
47. O'Reilly R. C., Frank M. J., (2006). Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput. 18, 283–328.10.1162/08997660677509390916378516
48. O'Reilly R. C., Munakata Y., (2000). Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain. Cambridge, MA, MIT Press.
49. Plate T., (2003). Holographic Reduced Representation: Distributed Representation for Cognitive Structures. Stanford, CA, CSLI Publications.
50. Poggio T., (1990). A theory of how the brain might work. Cold Spring Harb. Symp. Quant. Biol. 55, 899–910.2132866
51. Pouget A., (1997). Spatial transformations in the parietal cortex using basis functions. J. Cogn. Neurosci. 9, 222–237.10.1162/jocn.1997.9.2.222
52. Pucak M. L., Levitt J. B., Lund J. S., Lewis D. A., (1996). Patterns of intrinsic and associational circuitry in monkey prefrontal cortex. J. Comp. Neurol. 376, 614–630.10.1002/(SICI)1096-9861(19961223)376:4<614::AID-CNE9>3.0.CO;2-48978474
53. Rao R., Olshausen B., Lewicki M., (2002). Probabilistic Models of the Brain: Perception and Neural Function. Cambridge, MA, MIT Press (Bradford Books).
54. Riesenhuber M., Poggio T., (2000). Models of object recognition. Nat. Neurosci. 3(Suppl.), 1199–1204.10.1038/8147911127838
55. Rigotti M., Ben Dayan Rubin D., Wang X.-J., Fusi S., (2007). The importance of neural diversity in complex cognitive tasks. In Society for Neuroscience Annual Meeting. Washington, DC, Society for Neuroscience.
56. Rigotti M., Fusi S., (2006). Modeling event drives transitions between attractors of the neural dynamics. In Society for Neuroscience Annual Meeting. Washington, DC, Society for Neuroscience, p 569.14/LL5.
57. Rumelhart D., McClelland J., (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Cambridge, MA, MIT Press.3099697
58. Schneider W., Shiffrin R., (1977). Controlled and Automatic Human Information Processing: 1. Detection, search, and attention. Psychol. Rev. 84, 1–66.10.1037/0033-295X.84.1.1
59. Shastri L., Ajjanagadde V., (1993). From simple associations to systematic reasoning: a connectionist representation of rules, variables, and dynamic bindings using temporal synchrony. Behav. Brain Sci. 16, 417–494.
60. Shiffrin R. M., Schneider W., (1984). Automatic and controlled processing revisited. Psychol. Rev. 91, 269–276.10.1037/0033-295X.91.2.2696571425
61. Sloman S. A., (1996). The empirical case for two systems of reasoning. Psychol. Bull. 119, 3–22.10.1037/0033-2909.119.1.3
62. Smolensky P., (1990). Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artif. Intell. 46, 159–216.10.1016/0004-3702(90)90007-M
63. Stanovich K., West R., (2002). Individual differences in reasoning: implications for the rationality debate? In Heuristics and Biases: The Psychology of Intuitive Judgment, Gilovich T., Griffin D., Kahneman D., eds (New York, NY, Cambridge University Press), pp. 421–440.
64. Sutton R. S., Barto A. G., (1998). Reinforcement Learning: An Introduction (Adaptive Computation and Machine Learning). Cambridge, MA, MIT Press.
65. Taatgen N. A., Huss D., Dickison D., Anderson J. R., (2008). The acquisition of robust and flexible cognitive skills. J. Exp. Psychol. Gen. 137, 548–565.10.1037/0096-3445.137.3.54818729715
66. Tenenbaum J. B., Freeman W. T., (2000). Separating style and content with bilinear models. Neural Comput. 12, 1247–1283.10.1162/08997660030001534910935711
67. Touretzky D., Hinton G., (1988). A distributed connectionist production system. Cogn. Sci. 12, 423–466.
68. Wermter S., Sun R., (2000). Hybrid neural systems. Heidelberg, Springer.
69. Wolpert D., Kawato M., (1998). Multiple paired forward and inverse models for motor control. Neural Netw. 11, 1317–1329.10.1016/S0893-6080(98)00066-512662752
70. Wolpert D., Miall R., (1996). Forward models for physiological motor control. Neural Netw. 9, 1265–1279.10.1016/S0893-6080(96)00035-412662535