Learning posture invariant spatial representations through temporal correlations

IEEE Transactions on Autonomous Mental Development

Volumn 1, Issue 4, 2009, Pages 253-263

  Spratling, Michael W ^a  

^a KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

Cognitive science; Computational models of vision; Coordinate transformations; Neural networks for development; Visual system and development

Indexed keywords

CO-ORDINATE TRANSFORMATION; COGNITIVE SCIENCE; COMPUTATIONAL MODEL; COMPUTATIONAL MODELS OF VISION; VISUAL SYSTEMS;

NEURAL NETWORKS;

EID: 77955704664     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2009.2038494     Document Type: Article

References (107)

1. J. S. Albus, Brains, Behaviour and Robotics. Peterborough, NH: BYTE Books, 1981.
2. R. A. Andersen, G. K. Essick, and R. M. Siegel, "Encoding of spatial location by posterior parietal neurons," Science, vol.230, no.4724, pp. 456-458, 1985.
3. E. G. Araujo and R. A. Grupen, P. Maes, M. Mataric, J. Meyer, J. Pollack, and S. W.Wilson, Eds., "Learning control composition in a complex environment," in Proc. Int. Conf. Simulation Adapt. Behav., Cambridge, MA, 1996, pp. 333-342.
4. M. A. Arbib, E. J. Conklin, and J. C. Hill, From Schema Theory to Language. Oxford, U.K.: Oxford Univ. Press, 1987.
5. C. Balkenius, "Multi-modal sensing for robot control," in Current trends in connectionism, L. F. Niklasson and M. B. Bodén, Eds. Hillsdale, NJ: Erlbaum, 1995, pp. 203-216.
6. P. Baraduc, E. Guigon, and Y. Burnod, "Recodning arm position to learn visuomotor transformations," Cereb. Cortex, vol.11, pp. 906-917, 2001.
7. H. B. Barlow, "What is the computational goal of the neocortex?," in Large-Scale Neuronal Theories of the Brain, C. Koch and J. L. Davis, Eds. Cambridge, MA: MIT Press, 1994, ch. 1.
8. H. B. Barlow, "The neuron doctrine in perception," in The Cognitive Neurosciences, M. S. Gazzaniga, Ed. Cambridge, MA: MIT Press, 1995, ch. 26.
9. M. S. Bartlett and T. J. Sejnowski, "Learning viewpoint invariant face representations from visual experience in an attractor network," Netw.: Comput. Neural Syst., vol.9, no.3, pp. 1-19, 1998.
10. A. Battaglia-Mayer, R. Caminiti, F. Lacquaniti, and M. Zago, "Multiple levels of representation of reaching in the parieto-frontal network," Cereb. Cortex, vol.13, no.10, pp. 1009-1022, 2003.
11. S. Becker, "Implicit learning in 3D object recognition: The importance of temporal context," Neural Comput., vol.11, no.2, pp. 347-374, 1999.
12. P. R. Brotchie, R. A. Andersen, L. H. Snyder, and S. J. Goodman, "Head position signals used by parietal neurons to encode locations of visual stimuli," Nature, vol.375, no.6528, pp. 232-235, 1995.
13. P. Byrne and S. Becker, "A principle for learning egocentric-allocentric transformations," Neural Comput., vol.20, no.3, pp. 709-737, 2008.
14. M. V. Chafee, B. B. Averbeck, and D. A. Crowe, "Representing spatial relationships in posterior parietal cortex: Single neurons code objectreferenced position," Cereb. Cortex, vol.17, no.12, pp. 2914-2932, 2007.
15. P. M. Churchland, "Some reductive strategies in cognitive neurobiology," in The Philosophy of Artificial Intelligence,M.A. Boden, Ed. Oxford, U.K.: Oxford Univ. Press, 1990, ch. 14.
16. P. S. Churchland, Neurophilosophy. Cambridge, MA: MIT Press, 1986, ch. 10.
17. A. Clark and C. Thornton, "Trading spaces: Computation, representation and the limits of uninformed learning," Behav. Brain Sci., vol.20, no.1, pp. 57-66, 1997.
18. P. R. Cohen, M. S. Atkin, T. Oates, and C. R. Beal, "Neo: Learning conceptual knowledge by sensorimotor interaction with an environment," in Proc. 1st Int. Conf. Autonom. Agents, Marina Del Ray, CA, 1997, pp. 170-177.
19. Y. Coiton, J. C. Gilhodes, J. L. Velay, and J. P. Roll, "A neural network model for the intersensory coordination involved in goal-directed movements," Biolog. Cybern., vol.66, no.2, pp. 167-176, 1991.
20. D. D. Cox, P. Meier, N. Oertelt, and J. J. DiCarlo, "'Breaking' position- invariant object recognition," Nature Neurosci., vol.8, no.9, pp. 1145-1147, 2005.
21. F. Crick and C. Asanuma, "Certain aspects of the anatomy and physiology of the cerebral cortex," in Parallel Distributed Processing: Explorations in the Microstructures of Cognition. Volume 2: Psychological and Biological Models, D. E. Rumelhart and J. L. McClell, Eds. Cambridge, MA: MIT Press, 1986, pp. 333-371.
22. S. Deneve and A. Pouget, "Basis functions for object-centered representations," Neuron, vol.37, pp. 347-359, 2003.
23. R. J. Douglas, K. A. C. Martin, and D. Whitteridge, "A canonical microcircuit for neocortex," Neural Comput., vol.1, no.4, pp. 480-488, 1989.
24. J.-R. Duhamel, F. Bremmer, S. BenHamed, and W. Graf, "Spatial invariance of visual receptive fields in parietal cortex neurons," Nature, vol.389, 1997.
25. M. Ebdon, The Uniformity of Cerebral Neocortex and its Implications for Cognitive Science School of Cogn. Comput. Sci., Univ. of Sussex, 1992, Tech. Rep. CSRP-228.
26. M. Ebdon, "Towards a General Theory of Cerebral Neocortex," Ph.D. dissertation, Univ. of Sussex, Sussex, U.K., 1996.
27. W. Einhäuser, J. Hipp, J. Eggert, E. Körner, and P. König, "Learning viewpoint invariant object representations using a temporal coherence principle," Biol. Cybern., vol.93, pp. 79-90, 2005. (Pubitemid 41067713)
28. J. L. Elman, "Learning and development in neural networks: The importance of starting small," Cognition, vol.48, pp. 71-99, 1993.
29. J. L. Elman, E. A. Bates, M. H. Johnson, A. Karmiloff-Smith, D. Parisi, and K. Plunkett, Rethinking Innateness: A Connectionist Perspective on Development. Cambridge, MA: MIT Press, 1996.
30. P. Földiák, "Learning invariance from transformation sequences," Neural Comput., vol.3, pp. 194-200, 1991.
31. M. Franzius, H. Sprekeler, and L. Wiskott, "Slowness and sparseness lead to place, head-direction, and spatial-view cells," PLoS Comput. Biol., vol.3, no.8, p. e166, 2007.
32. K. Fukushima, "Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position," Biol. Cybern., vol.36, no.4, pp. 193-202, 1980.
33. K. Fukushima, "Neocognitron: A hierarchical neural network capable of visual pattern recognition," Neural Netw., vol.1, no.2, pp. 119-130, 1988.
34. P. Gaudiano and S. Grossberg, "Vector associative maps: Unsupervised real-time error-based learning and control of movement trajectories," Neural Netw., vol.4, pp. 147-183, 1991.
35. S. Grossberg, "How does the cerebral cortex work? learning, attention, and grouping by the laminar circuits of visual cortex," Spatial Vis., vol.12, pp. 163-187, 1999.
36. G. F. Harpur, "Low Entropy Coding with Unsupervised Neural Networks," Ph.D. dissertation, Dept. of Engineering, Univ. of Cambridge, Cambridge, U.K., 1997.
37. G. F. Harpur and R. W. Prager, "A fast method for activating competitive self-organising neural networks," in Proc. Int. Symp. Artif. Neural Netw., 1994, pp. 412-418.
38. D. J. Heeger, "Nonlinear model of neural responses in cat visual cortex," in Computational Models of Visual Processing, M. S. Ly and J. A. Movshon, Eds. Cambridge, MA: MIT Press, 1991, pp. 119-133.
39. D. J. Heeger, "Normalization of cell responses in cat striate cortex," Vis. Neurosci., vol.9, pp. 181-197, 1992.
40. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol.5, pp. 1457-1469, 2004.
41. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol., vol.160, pp. 106-154, 1962.
42. A. Karni, "The acquisition of perceptual and motor skills: A memory system in the adult human cortex," Cogn. Brain Res., vol.5, pp. 39-48, 1996.
43. A. Karni, G. Meyer, P. Jezzard, M. M. Adams, R. Turner, and L. G. Ungerleider, "Functional MRI evidence for adult motor cortex plasticity during motor skill learning," Nature, vol.377, no.6545, p. 155, 1995.
44. K. P. Körding and P. König, "Neurons with two sites of synaptic integration learn invariant representations," Neural Comput., vol.13, no.12, pp. 2823-2849, 2001. (Pubitemid 33597998)
45. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol.86, pp. 2278-2324, 1998.
46. Y. LeCun, F. J. Huang, and L. Bottou, "Learning methods for generic object recognition with invariance to pose and lighting," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2004.
47. D. D. Lee and H. S. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol.401, pp. 788-791, 1999.
48. N. Logothetis, "Object vision and visual awareness," Current Opinion Neurobiol., vol.8, no.4, pp. 536-544, 1998.
49. M. Lungarella and L. Berthouze, "On the interplay between morphological, neural and environmental dynamics," Adapt. Behav., vol.10, no.3-4, pp. 223-241, 2002.
50. D. Mareschal, M. H. Johnson, S. Siros, M. W. Spratling, M. S. C. Thomas, and G. Westermann, Neuroconstructivism: How the Brain Constructs Cognition. Oxford, UK: Oxford Univ. Press, 2007.
51. D. Marr, "A theory for cerebral neocortex," Proc. Roy. Soc. London. Series B., Biol. Sci., vol.176, pp. 161-234, 1970.
52. J. L. McClelland and D. C. Plaut, "Computational approaches to cognition: Top-down approaches," Current Opinion Neurobiol., vol.3, pp. 209-216, 1993.
53. B. W. Mel, Connectionist Robot Motion Planning : A Neurally-Inspired Approach to Visually-Guided Reaching. New York: Academic, 1990, vol.7.
54. Q. Meng and M. H. Lee, "Automated cross-modal mapping in robotic eye/hand systems using plastic radial basis function networks," Connect. Sci., vol.19, no.1, pp. 25-52, 2007.
55. G. Metta, G. Sandini, and J. Konczak, "A developmental approach to visually-guided reaching in artificial systems," Neural Netw., vol.12, pp. 1413-1427, 1999.
56. V. B. Mountcastle, Perceptual Neuroscience: The Cerebral Cortex. Cambridge, MA: Harvard Univ. Press, 1998.
57. D. Mumford, "On the computational architecture of the neocortex II: The role of cortico-cortical loops," Biol. Cybern., vol.66, pp. 241-251, 1992.
58. D. Mumford, "Neuronal architectures for pattern-theoretic problems," in Large-Scale Neuronal Theories of the Brain, C.Koch and J. L. Davis, Eds. Cambridge, MA: MIT Press, 1994, pp. 125-152.
59. M. W. Oram and P. Földiák, "Learning generalisation and localisation: Competition for stimulus type and receptive field," Neurocomputing, vol.11, no.2-4, pp. 297-321, 1996.
60. R. C. O'Reilly and J. L. McClelland, The Self-Organization of Spatially Invariant Representations Dept. of Psychology, Carnegie Mellon Univ., 1992, Tech. Rep. PDP.CNS.92.5.
61. S. E. Petersen, H. VanMier, J. A. Fiez, and M. E. Raichle, "The effects of practice on the functional anatomy of task performance," in Proc. Nat. Acad. Sci. USA, vol.95, pp. 853-860, 1998.
62. W. A. Phillips and W. Singer, "In search of common foundations for cortical computation," Behav. Brain Sci., vol.20, no.4, pp. 657-722, 1997.
63. A. Pouget and T. J. Sejnowski, "Spatial transformations in the parietal cortex using basis functions," J. Cogn. Neurosci., vol.9, no.2, pp. 222-237, 1997.
64. A. Pouget and L. Snyder, "Computational approaches to sensorimotor transformations," Nature Neurosci., vol.3, pp. 1192-1198, 2000.
65. A. Pouget, S. Deneve, and J. R. Duhamel, "A computational perspective on the neural basis of multisensory spatial representations," Nature Rev. Neurosci., vol.3, pp. 741-747, 2002.
66. S. R. Quartz, "The constructivist brain," Trends Cogn. Sci., vol.3, no.2, pp. 48-57, 1999.
67. M. Riesenhuber and T. Poggio, "Hierarchical models of object recognition in cortex," Nature Neurosci., vol.2, no.11, pp. 1019-1025, 1999.
68. H. Ritter, T.Martinetz, and K. Schulten, Neural Computation and Self- Organizing Maps. An Introduction. Reading, MA: Addison-Wesley, 1992.
69. E. T. Rolls and T. Milward, "A model of invariant object recognition in the visual system: Learning rules, activation functions, lateral inhibition, and information-based performance measures," Neural Comput., vol.12, no.11, pp. 2547-2572, 2000.
70. K. Sakai and Y. Miyashita, "Neural organization for the long-term memory of paired associates," Nature, vol.354, pp. 152-155, 1991.
71. E. Salinas and L. F. Abbott, "Transfer of coded information from sensory to motor networks," J. Neurosci., vol.15, pp. 6461-6474, 1995.
72. K. Schulten and M. Zeller, "Topology representing maps and brain function," Nova Acta Leopoldina, vol.72, no.294, pp. 133-157, 1996.
73. T. Serre, J. Louie, M. Riesenhuber, and T. Poggio, "On the role of object- specific features for real-world object recognition in biological vision," in Proc. 2nd Workshop Biol. Motivated Comput. Vis., Tubingen, Germany, 2002.
74. T. Serre, L.Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Robust object recognition with cortex-like mechanisms," IEEE Trans. Pattern Anal. Mach. Intell., vol.29, no.3, pp. 411-426, Mar. 2007.
75. N. Sigala and N. K. Logothetis, "Visual categorization shapes feature selectivity in the primate temporal cortex," Nature, vol.415, pp. 318-320, 2001.
76. M. Sigman and C. D. Gilbert, "Learning to find a shape," Nature Neurosci., vol.3, no.3, pp. 264-269, 2000.
77. P. Sinha and T. Poggio, "Role of learning in three-dimensional form perception," Nature, vol.384, pp. 460-463, 1996. (Pubitemid 26414662)
78. S. Siros, M. W. Spratling, M. S. C. Thomas, G. Westermann, D. Mareschal, and M. H. Johnson, "Précis of neuroconstructivism: How the brain constructs cognition," Behav. Brain Sci., vol.31, no.3, pp. 321-331, 2008.
79. L. H. Snyder, K. L. Grieve, P. Brotchie, and R. A. Andersen, "Separate body- and world-referenced representations of visual space in parietal cortex," Nature, vol.394, pp. 887-891, 1998.
80. M. W. Spratling, "Learning viewpoint invariant perceptual representations from cluttered images," IEEE Trans. Pattern Anal. Mach. Intell., vol.27, no.5, pp. 753-761, May 2005.
81. M. W. Spratling, "Pre-synaptic lateral inhibition provides a better architecture for self-organising neural networks," Netw.: Comput. Neural Syst., vol.10, no.4, pp. 285-301, 1999.
82. M. W. Spratling, "Artificial Ontogenesis: A Connectionist Model of Development," Ph.D. dissertation, Univ. of Edinburgh, Edinburgh, U.K., 1999.
83. M. W. Spratling, "Predictive coding as a model of biased competition in visual selective attention," Vis. Res., vol.48, no.12, pp. 1391-1408, 2008.
84. M. W. Spratling and G. M. Hayes, M. Verleysen, Ed., "Learning sensory-motor cortical mappings without training," in Proc. 6th Euro. Symp. Artif. Neural Netw., Brussels, Belgium, 1998, pp. 339-344.
85. M. W. Spratling and M. H. Johnson, "Dendritic inhibition enhances neural coding properties," Cereb. Cortex, vol.11, no.12, pp. 1144-1149, 2001.
86. M. W. Spratling and M. H. Johnson, "Pre-integration lateral inhibition enhances unsupervised learning," Neural Comput., vol.14, no.9, pp. 2157-2179, 2002.
87. M. W. Spratling and M. H. Johnson, "Neural coding strategies and mechanisms of competition," Cogn. Syst. Res., vol.5, no.2, pp. 93-117, 2004.
88. M. W. Spratling, K. D. Meyer, and R. Kompass, "Unsupervised learning of overlapping image components using divisive input modulation," Comput. Intell. Neurosci., vol.2009, no.381457, pp. 1-19, 2009.
89. J. Stone, "Object recognition using spatio- temporal signatures," Vis. Res., vol.38, no.7, pp. 947-951, 1998.
90. J. Stone and A. Bray, "A learning rule for extracting spatio-temporal invariances," Netw.: Comput. Neural Syst., vol.6, no.3, pp. 429-436, 1995.
91. S. M. Stringer and E. T. Rolls, "Position invariant recognition in the visual system with cluttered environments," Neural Netw., vol.13, pp. 305-315, 2000.
92. M. P. Stryker, "Temporal associations," Nature, vol.354, pp. 108-109, 1991.
93. J. N. Templeman and M. H. Loew, "Staged assimilation: A system for detecting invariant features in temporally coherent visual stimuli," in Proc. Int. Joint Conf. Neural Netw., New York, NY, 1989, vol.1, pp. 731-738.
94. J. K. Tsotsos, "Behaviourist intelligence and the scaling problem," Artif. Intell., vol.75, pp. 135-160, 1995.
95. M. C. W. van Rossum and A. Renart, "Computation with populations codes in layered networks of integrate-and-fire neurons," Neurocomputing, vol.58-60, pp. 265-270, 2004.
96. G. Wallis, "The role of object motion in forging long-term representations of objects," Vis. Cogn., vol.9, pp. 233-247, 2002.
97. G.Wallis, "Using spatio-temporal correlations to learn invariant object recognition," Neural Netw., vol.9, no.9, pp. 1513-1519, 1996.
98. G.Wallis, "Temporal order in human object recognition," J. Biol. Syst., vol.6, no.3, pp. 299-313, 1998.
99. G.Wallis and H. Bülthoff, "Role of temporal association in establishing recognition memory," in Proc. Nat. Acad. Sci. USA, vol.98, no.8, pp. 4800-4804, 2001.
100. G. Wallis and H. Bülthoff, "Learning to recognize objects," Trends Cogn. Sci., vol.3, no.1, pp. 22-31, 1999.
101. G. Wallis and E. T. Rolls, "Invariant face and object recognition in the visual system," Progr. Neurobiol., vol.51, no.2, pp. 167-194, 1997. (Pubitemid 27112409)
102. V. Walsh, E. Ashbridge, and A. Cowey, "Cortical plasticity in perceptual learning demonstrated by transcranial magnetic stimulation," Neuropsychologia, vol.36, no.4, pp. 363-367, 1998. (Pubitemid 28256845)
103. C. Weber and S. Wermter, "A self-organizing map of sigma-pi units," Neurocomputing, vol.70, no.13-15, pp. 2552-2560, 2007.
104. C. Weber, M. Elshaw, J. Triesch, and S. Wermter, "Neural control of actions involving different coordinate systems," in Humanoid Robots: Human-like Machines, M. Hackel, Ed. Vienna, Austria: I-Tech Education, 2007.
105. J. Weng, J. McClelland, A. Pentland, O. Sporns, I. Stockman, M. Sur, and E. Thelen, "Autonomous mental development by robots and animals," Science, vol.291, pp. 599-600, 2001.
106. G.Westermann, S. Sirois, T. Shultz, and D. Mareschal, "Modeling developmental cognitive neuroscience," Trends Cogn. Sci., vol.10, pp. 227-233, 2006.
107. L. Wiskott and T. J. Sejnowski, "Slow feature analysis: Unsupervised learning of invariances," Neural Comput., vol.14, no.4, pp. 715-770, 2002.