Deformation-specific and deformation-invariant visual object recognition: Pose vs. identity recognition of people and deforming objects

Frontiers in Computational Neuroscience

Volumn 8, Issue 1 APR, 2014, Pages

  Webb, Tristan J ^a   Rolls, Edmund T ^a,b  

^a UNIVERSITY OF WARWICK   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Deformation; Inferior temporal visual cortex; Invariance; Object recognition; Pose; Trace learning rule; VisNet

Indexed keywords

INVARIANCE; OBJECT RECOGNITION;

IDENTITY RECOGNITION; INVARIANT REPRESENTATION; LEARNING RULES; PERCEPTUAL REPRESENTATIONS; POSE; VISNET; VISUAL CORTEXES; VISUAL OBJECT RECOGNITION;

DEFORMATION;

ARTICLE; BODY POSTURE; COMPUTER SIMULATION; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; IDENTITY; MALE; PATTERN RECOGNITION; SHORT TERM MEMORY; STIMULUS RESPONSE; SYNAPTIC POTENTIAL; VISUAL CORTEX; VISUAL DISCRIMINATION; VISUAL MEMORY; VISUAL STIMULATION; VISUAL SYSTEM;

EID: 84897456565     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncom.2014.00037     Document Type: Article

References (77)

1. Abbott, L. F., Rolls, E. T., and Tovee, M. J. (1996). Representational capacity of face coding in monkeys. Cereb. Cortex 6, 498-505. doi: 10.1093/cercor/6.3.498
2. Barraclough, N. E., Xiao, D., Oram, M. W., and Perrett, D. I. (2006). The sensitivity of primate STS neurons to walking sequences and to the degree of articulation in static images. Prog. Brain Res. 154, 135-148. doi: 10.1016/S0079-6123(06)54007-5
3. Baylis, G. C., Rolls, E. T., and Leonard, C. M. (1985). Selectivity between faces in the responses of a population of neurons in the cortex in the superior temporal sulcus of the monkey. Brain Res. 342, 91-102. doi: 10.1016/0006-8993(85)91356-3
4. Baylis, G. C., Rolls, E. T., and Leonard, C. M. (1987). Functional subdivisions of temporal lobe neocortex. J. Neurosci. 7, 330-342.
5. Booth, M. C. A., and Rolls, E. T. (1998). View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. Cereb. Cortex 8, 510-523. doi: 10.1093/cercor/8.6.510
6. Buhmann, J., Lange, J., von der Malsburg, C., Vorbrüggen, J. C., and Würtz, R. P. (1991). "Object recognition in the dynamic link architecture: parallel implementation of a transputer network, " in Neural Networks for Signal Processing, ed B. Kosko (Englewood Cliffs, NJ: Prentice Hall), 121-159.
7. Daugman, J. (1988). Complete discrete 2D-Gabor transforms by neural networks for image analysis and compression. IEEE Trans. Acoust. Speech Signal Process. 36, 1169-1179. doi: 10.1109/29.1644
8. Deco, G., and Rolls, E. T. (2004). A neurodynamical cortical model of visual attention and invariant object recognition. Vis. Res. 44, 621-644. doi: 10.1016/j.visres.2003.09.037
9. De Valois, R. L., and De Valois, K. K. (1988). Spatial Vision. New York, NY: Oxford University Press.
10. DeWeese, M. R., and Meister, M. (1999). How to measure the information gained from one symbol. Network 10, 325-340. doi: 10.1088/0954-898X/10/4/303
11. Elliffe, M. C. M., Rolls, E. T., and Stringer, S. M. (2002). Invariant recognition of feature combinations in the visual system. Biol. Cybernet. 86, 59-71. doi: 10.1007/s004220100284
12. Földiák, P. (1991). Learning invariance from transformation sequences. Neural Comput. 3, 193-199. doi: 10.1162/neco.1991.3.2.194
13. Földiák, P. (1992). Models of sensory coding. Technical Report CUED/F-INFENG/TR 91, Department of Engineering, University of Cambridge, Cambridge.
14. Franco, L., Rolls, E. T., Aggelopoulos, N. C., and Jerez, J. M. (2007). Neuronal selectivity, population sparseness, and ergodicity in the inferior temporal visual cortex. Biol. Cybernet. 96, 547-560. doi: 10.1007/s00422-007-0149-1
15. Franzius, M., Sprekeler, H., and Wiskott, L. (2007). Slowness and sparseness lead to place, head-direction, and spatial-view cells. PLoS Comput. Biol. 3:e166. doi: 10.1371/journal.pcbi.0030166
16. Fukushima, K. (1980). Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybernet. 36, 193-202. doi: 10.1007/BF00344251
17. Garthwaite, J. (2008). Concepts of neural nitric oxide-mediated transmission. Eur. J. Neurosci. 27, 2783-3802. doi: 10.1111/j.1460-9568.2008.06285.x
18. Hasselmo, M. E., Rolls, E. T., and Baylis, G. C. (1989a). The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav. Brain Res. 32, 203-218. doi: 10.1016/S0166-4328(89)80054-3
19. Hasselmo, M. E., Rolls, E. T., Baylis, G. C., and Nalwa, V. (1989b). Object-centered encoding by face-selective neurons in the cortex in the superior temporal sulcus of the monkey. Exp. Brain Res. 75, 417-429. doi: 10.1007/BF00247948
20. Hawken, M. J., and Parker, A. J. (1987). Spatial properties of the monkey striate cortex. Proc. R. Soc. Lond. B 231, 251-288. doi: 10.1098/rspb.1987.0044
21. Hestrin, S., Sah, P., and Nicoll, R. (1990). Mechanisms generating the time course of dual component excitatory synaptic currents recorded in hippocampal slices. Neuron 5, 247-253. doi: 10.1016/0896-6273(90)90162-9
22. Hummel, J. E., and Biederman, I. (1992). Dynamic binding in a neural network for shape recognition. Psychol. Rev. 99, 480-517. doi: 10.1037/0033-295X.99.3.480
23. Isik, L., Leibo, J. Z., and Poggio, T. (2012). Learning and disrupting invariance in visual recognition with a temporal association rule. Front. Comput. Neurosci. 6:37. doi: 10.3389/fncom.2012.00037
24. Lee, T. S. (1996). Image representation using 2D Gabor wavelets. IEEE Trans. Pattern Anal. Mach. Intell. 18, 959-971. doi: 10.1109/34.541406
25. Li, N., and DiCarlo, J. J. (2008). Unsupervised natural experience rapidly alters invariant object representation in visual cortex. Science 321, 1502-1507. doi: 10.1126/science.1160028
26. Li, N., and DiCarlo, J. J. (2010). Unsupervised natural visual experience rapidly reshapes size-invariant object representation in inferior temporal cortex. Neuron 67, 1062-1075. doi: 10.1016/j.neuron.2010.08.029
27. Li, N., and DiCarlo, J. J. (2012). Neuronal learning of invariant object representation in the ventral visual stream is not dependent on reward. J. Neurosci. 32, 6611-6620. doi: 10.1523/JNEUROSCI.3786-11.2012
28. Malsburg, C. V. D. (1973). Self-organization of orientation-sensitive columns in the striate cortex. Kybernetik 14, 85-100. doi: 10.1007/BF00288907
29. Miyashita, Y. (1988). Neuronal correlate of visual associative long-term memory in the primate temporal cortex. Nature 335, 817-820. doi: 10.1007/BF00288907
30. Montague, P. R., Gally, J. A., and Edelman, G. M. (1991). Spatial signalling in the development and function of neural connections. Cereb. Cortex 1, 199-220. doi: 10.1093/cercor/1.3.199
31. Oja, E. (1982). A simplified neuron model as a principal component analyzer. J. Math. Biol. 15, 267-273. doi: 10.1007/BF00275687
32. Perrett, D. I., Oram, M. W., Harries, M. H., Bevan, R., Hietanen, J. K., and Benson, P. J. (1991). Viewer-centered and object centered coding of heads in the macaque temporal cortex. Exp. Brain Res. 86, 159-173. doi: 10.1007/BF00231050
33. Perrett, D. I., Smith, P. A. J., Potter, D. D., Mistlin, A. J., Head, A. S., Milner, D., et al. (1985). Visual cells in temporal cortex sensitive to face view and gaze direction. Proc. R. Soc. Lond. Ser. B 223, 293-317. doi: 10.1098/rspb.1985.0003
34. Perry, G., Rolls, E. T., and Stringer, S. M. (2006). Spatial vs temporal continuity in view invariant visual object recognition learning. Vis. Res. 46, 3994-4006. doi: 10.1016/j.visres.2006.07.025
35. Perry, G., Rolls, E. T., and Stringer, S. M. (2010). Continuous transformation learning of translation invariant representations. Exp. Brain Res. 204, 255-270. doi: 10.1007/s00221-010-2309-0
36. Pollen, D., and Ronner, S. (1981). Phase relationship between adjacent simple cells in the visual cortex. Science 212, 1409-1411. doi: 10.1126/science.7233231
37. Rhodes, P. (1992). The open time of the NMDA channel facilitates the self-organisation of invariant object responses in cortex. Soc. Neurosci. Abstr. 18, 740.
38. Riesenhuber, M., and Poggio, T. (2000). Models of object recognition. Nat. Neurosci. Suppl. 3, 1199-1204. doi: 10.1038/81479
39. Rolls, E. T. (1992). Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. Philos. Trans. R. Soc. 335, 11-21. doi: 10.1098/rstb.1992.0002
40. Rolls, E. T. (1995). Learning mechanisms in the temporal lobe visual cortex. Behav. Brain Res. 66, 177-185. doi: 10.1016/0166-4328(94)00138-6
41. Rolls, E. T. (2000). Functions of the primate temporal lobe cortical visual areas in invariant visual object and face recognition. Neuron 27, 205-218. doi: 10.1016/S0896-6273(00)00030-1
42. Rolls, E. T. (2007). The representation of information about faces in the temporal and frontal lobes of primates including humans. Neuropsychologia 45, 124-143. doi: 10.1016/j.neuropsychologia.2006.04.019
43. Rolls, E. T. (2008). Memory, Attention, and Decision-Making. A Unifying Computational Neuroscience Approach. Oxford: Oxford University Press.
44. Rolls, E. T. (2012). Invariant visual object and face recognition: neural and computational bases, and a model, VisNet. Front. Comput. Neurosci. 6:1-70. doi: 10.3389/fncom.2012.00035
45. Rolls, E. T. (2014). Emotion and Decision-Making Explained. Oxford: Oxford University Press.
46. Rolls, E. T., Aggelopoulos, N. C., and Zheng, F. (2003). The receptive fields of inferior temporal cortex neurons in natural scenes. J. Neurosci. 23, 339-348.
47. Rolls, E. T., and Baylis, G. C. (1986). Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey. Exp. Brain Res. 65, 38-48. doi: 10.1007/BF00243828
48. Rolls, E. T., Baylis, G. C., and Hasselmo, M. E. (1987). The responses of neurons in the cortex in the superior temporal sulcus of the monkey to band-pass spatial frequency filtered faces. Vis. Res. 27, 311-326. doi: 10.1016/0042-6989(87)90081-2
49. Rolls, E. T., Baylis, G. C., Hasselmo, M., and Nalwa, V. (1989). "The representation of information in the temporal lobe visual cortical areas of macaque monkeys, " in Seeing Contour and Colour, eds J. Kulikowski, C. Dickinson, and I. Murray (Oxford: Pergamon).
50. Rolls, E. T., Baylis, G. C., and Leonard, C. M. (1985). Role of low and high spatial frequencies in the face-selective responses of neurons in the cortex in the superior temporal sulcus. Vis. Res. 25, 1021-1035. doi: 10.1016/0042-6989(85)90091-4
51. Rolls, E. T., and Deco, G. (2002). Computational Neuroscience of Vision. Oxford: Oxford University Press.
52. Rolls, E. T., and Milward, T. (2000). A model of invariant object recognition in the visual system: learning rules, activation functions, lateral inhibition, and information-based performance measures. Neural Comput. 12, 2547-2572. doi: 10.1162/089976600300014845
53. Rolls, E. T., and Stringer, S. M. (2001). Invariant object recognition in the visual system with error correction and temporal difference learning. Network 12, 111-129. doi: 10.1088/0954-898X/12/2/302
54. Rolls, E. T., and Stringer, S. M. (2006). Invariant visual object recognition: a model, with lighting invariance. J. Physiol. 100, 43-62. doi: 10.1016/j.jphysparis.2006.09.004
55. Rolls, E. T., and Stringer, S. M. (2007). Invariant global motion recognition in the dorsal visual system: a unifying theory. Neural Comput. 19, 139-169. doi: 10.1162/neco.2007.19.1.139
56. Rolls, E. T., and Tovee, M. J. (1994). Processing speed in the cerebral cortex and the neurophysiology of visual masking. Proc. R. Soc. B 257, 9-15. doi: 10.1098/rspb.1994.0087
57. Rolls, E. T., and Treves, A. (1998). Neural Networks and Brain Function. Oxford: Oxford University Press.
58. Rolls, E. T., and Treves, A. (2011). The neuronal encoding of information in the brain. Prog. Neurobiol. 95, 448-490. doi: 10.1016/j.pneurobio.2011.08.002
59. Rolls, E. T., Treves, A., and Tovee, M. J. (1997a). The representational capacity of the distributed encoding of information provided by populations of neurons in the primate temporal visual cortex. Exp. Brain Res. 114, 149-162. doi: 10.1007/PL00005615
60. Rolls, E. T., Treves, A., Tovee, M., and Panzeri, S. (1997b). Information in the neuronal representation of individual stimuli in the primate temporal visual cortex. J. Comput. Neurosci. 4, 309-333. doi: 10.1023/A:1008899916425
61. Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., and Poggio, T. (2007). Robust object recognition with cortex-like mechanisms. IEEE Trans. Pattern Anal. Mach. Intell. 29, 411-426. doi: 10.1109/TPAMI.2007.56
62. Spruston, N., Jonas, P., and Sakmann, B. (1995). Dendritic glutamate receptor channel in rat hippocampal CA3 and CA1 pyramidal neurons. J. Physiol. 482, 325-352.
63. Stringer, S. M., Perry, G., Rolls, E. T., and Proske, J. H. (2006). Learning invariant object recognition in the visual system with continuous transformations. Biol. Cybernet. 94, 128-142. doi: 10.1007/s00422-005-0030-z
64. Stringer, S. M., and Rolls, E. T. (2000). Position invariant recognition in the visual system with cluttered environments. Neural Netw. 13, 305-315. doi: 10.1016/S0893-6080(00)00017-4
65. Stringer, S. M., and Rolls, E. T. (2002). Invariant object recognition in the visual system with novel views of 3D objects. Neural Comput. 14, 2585-2596. doi: 10.1162/089976602760407982
66. Stringer, S. M., and Rolls, E. T. (2008). Learning transform invariant object recognition in the visual system with multiple stimuli present during training. Neural Netw. 21, 888-903. doi: 10.1016/j.neunet.2007.11.004
67. Stringer, S. M., Rolls, E. T., and Tromans, J. M. (2007). Invariant object recognition with trace learning and multiple stimuli present during training. Network 18, 161-187. doi: 10.1080/09548980701556055
68. Sutton, R. S., and Barto, A. G. (1981). Towards a modern theory of adaptive networks: expectation and prediction. Psychol. Rev. 88, 135-170. doi: 10.1037/0033-295X.88.2.135
69. Tovee, M. J., Rolls, E. T., and Azzopardi, P. (1994). Translation invariance and the responses of neurons in the temporal visual cortical areas of primates. J. Neurophysiol. 72, 1049-1060.
70. Van Essen, D., Anderson, C. H., and Felleman, D. J. (1992). Information processing in the primate visual system: an integrated systems perspective. Science 255, 419-423. doi: 10.1126/science.1734518
71. Wallis, G. (2013). Toward a unified model of face and object recognition in the human visual system. Front. Psychol. 4:497. doi: 10.3389/fpsyg.2013.00497
72. Wallis, G., and Rolls, E. T. (1997). Invariant face and object recognition in the visual system. Prog. Neurobiol. 51, 167-194. doi: 10.1016/S0301-0082(96)00054-8
73. Wallis, G., Rolls, E. T., and Foldiak, P. (1993). Learning invariant responses to the natural transformations of objects. Int. Joint Conf. Neural Netw. 2, 1087-1090.
74. Wiskott, L. (2003). Slow feature analysis: a theoretical analysis of optimal free responses. Neural Comput. 15, 2147-2177. doi: 10.1162/089976603322297331
75. Wiskott, L., and Sejnowski, T. J. (2002). Slow feature analysis: unsupervised learning of invariances. Neural Comput. 14, 715-770. doi: 10.1162/089976602317318938
76. Wyss, R., Konig, P., and Verschure, P. F. (2006). A model of the ventral visual system based on temporal stability and local memory. PLoS Biol. 4:e120. doi: 10.1371/journal.pbio.0040120
77. Yang, W., Wang, Y., and Mori, G. (2010). "Recognizing human actions from still images with latent poses, " in 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (San Francisco, CA: IEEE), 2030-2037. doi: 10.1109/CVPR.2010.5539879