Hierarchical representation of shapes in visual cortex-from localized features to figural shape segregation

Frontiers in Computational Neuroscience

Volumn 8, Issue AUG, 2014, Pages

  Tschechne, Stephan ^a   Neumann, Heiko ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

Computational model; Distributed representation; Figure ground segregation; Modulatory feedback; Ventral pathway

Indexed keywords

COMPLEX NETWORKS; MAMMALS; NETWORK ARCHITECTURE; VISION;

COMPUTATIONAL MODEL; COMPUTATIONAL NETWORKS; DISTRIBUTED REPRESENTATION; FIGURE-GROUND SEGREGATION; HIERARCHICAL PROCESSING; HIERARCHICAL REPRESENTATION; PERCEPTUAL ORGANIZATION; VENTRAL PATHWAY;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84905913006     PISSN: None     EISSN: 16625188     Source Type: Journal    
DOI: 10.3389/fncom.2014.00093     Document Type: Article

References (94)

1. Anzai, A., Peng, X., and Van Essen, D. (2007). Neurons in monkey visual area V2 encode combinations of orientations. Nat. Neurosci. 10, 1313-1321. doi: 10.1038/nn1975
2. Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., and Friston, K. J. (2012). Canonical Microcircuits for Predictive Coding. Neuron 76, 695-711. doi: 10.1016/j.neuron.2012.10.038
3. Bayerl, P., and Neumann, H. (2004). Disambiguating visual motion through contextual feedback modulation. Neural Comput. 16, 2041-2066. doi: 10.1162/0899766041732404
4. Bayerl, P., and Neumann, H. (2007). Disambiguating visual motion by form-motion interaction-a computational model. Int. J. Comp. Vis. 72, 27-45. doi: 10.1007/s11263-006-8891-8
5. Baylis, G. C., and Driver, J. (2001). Shape coding in IT cells generalizes over contrast and mirror reversal but not figureground reversal. Nat. Neurosci. 4, 937-942. doi: 10.1038/nn0901-937
6. Beck, C., and Neumann, H. (2010). Interactions of motion and form in visual cortex-a neural model. J. Physiol. Paris 104, 61-70. doi: 10.1016/j.jphysparis.2009.11.005
7. Beck, C., and Neumann, H. (2011). Combining feature selection and integration. A neural model for mt motion selectivity. PLoS ONE 6:e21254. doi: 10.1371/journal.pone.0021254
8. Ben-Shahar, O., and Zucker, S. (2004). Geometrical computations explain projection patterns of long-range horizontal connections in visual cortex. Neural Comput. 16, 445-476. doi: 10.1162/089976604772744866
9. Born, R. T. (2001). Visual processing: parallel-er and Parallel-er. Curr. Biol. 11, R566-R568. doi: 10.1016/S0960-9822(01)00345-1
10. Bosking, W. H., Zhang, Y., Schofield, B., and Fitzpatrick, D. (1997). Orientation selectivity and the arrangement of horizontal connections in tree shrew striate cortex. J. Neurosci. 17, 2112-2127.
11. Brosch, T., and Neumann, H. (2014). Interaction of feedforward and feedback streams in visual cortex in a firing-rate model of columnar computations. Neural Netw. 54, 11-16. doi: 10.1016/j.neunet.2014.02.005
12. Cadieu, C., Kouh, M., Pasupathy, A., Connor, C., Riesenhuber, M., and Poggio, T. (2007). A model of V4 shape selectivity and invariance. J. Neurophysiol. 98, 1733-1750. doi: 10.1152/jn.01265.2006
13. Caplovitz, G., and Tse, P. (2007). V3A processes contour curvature as a trackable feature for the perception of rotational motion. Cereb. Cortex 17, 1179-1189. doi: 10.1093/cercor/bhl029
14. Carandini, M., and Heeger, D. J. (1994). Summation and division by neurons in primate visual cortex. Science 264, 1333-1336. doi: 10.1126/science.8191289
15. Carandini, M., and Heeger, D. J. (2012). Normalization as a canonical neural computation. Nat. Rev. Neurosci. 13, 51-62. doi: 10.1038/nrn3136
16. Carandini, M., Heeger, D. J., and Movshon, J. A. (1999). "Linearity and gain control in V1 simple cells, " in Cerebral Cortex Volume 13 Models of Cortical Circuits, eds P. S. Ulinski, E. G. Jones, and A. Peters (New York, NY: Kluwer Academic; Plenum Publishers), 401-443.
17. Connor, C. E., Brincat, S. L., and Pasupathy, A. (2007). Transformation of shape information in the ventral pathway. Curr. Opin. Neurobiol. 17, 140-147. doi: 10.1016/j.conb.2007.03.002
18. De Pasquale, R., and Murray Sherman, S. (2013). A modulatory effect of the feedback from higher visual areas to V1 in the mouse. J. Neurophysiol. 109, 2618-2631. doi: 10.1152/jn.01083.2012
19. Desimone, R. (1998). Visual attention mediated by biased competition in extrastriate visual cortex. Philos. Trans. R. Soc. Lond. B 353, 1245-1255. doi: 10.1098/rstb.1998.0280
20. Eckhorn, R. (1999). Neural mechanisms of visual feature binding investigated with microelectrodes and models. Vis. Cogn. 6, 231-265. doi: 10.1080/135062899394975
21. Eckhorn, R., Reitboeck, H. J., Arndt, M., and Dicke, P. (1990). Feature linking via synchronization among distributed assemblies: simulations of results from cat visual cortex. Neural Comput. 2, 293-307. doi: 10.1162/neco.1990.2.3.293
22. Edelman, G. (1993). Neural darwinism: selection and reentrant signaling in higher brain function. Neuron 10, 115-125. doi: 10.1016/0896-6273(93)90304-A
23. Felleman, D. J., and Van Essen, D. C. (1987). Receptive field properties of neurons in area V3 of macaque monkey extrastriate cortex. J. Neurophysiol. 57, 889-920.
24. Felleman, D. J., and Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1, 1-47. doi: 10.1093/cercor/1.1.1
25. Field, D. J., Hayes, A., and Hass, R. F. (1993). Contour integration by the human visual system: evidence for a local association field. Vision Res. 33, 173-193. doi: 10.1016/0042-6989(93)90156-Q
26. Fowlkes, C. C., Martin, D. R., and Malik, J. (2007). Local figure-ground cues are valid for natural images. J. Vis. 7, 1-9. doi: 10.1167/7.8.2
27. Fukushima, K. (1980). Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193-202. doi: 10.1007/BF00344251
28. Fukushima, K. (1988). Neocognitron: a hierarchical neural network capable of visual pattern recognition. Neural Netw. 1, 119-130. doi: 10.1016/0893-6080(88)90014-7
29. Gilbert, C. D., and Li, W. (2013). Top-down influences on visual processing. Nat. Rev. Neurosci. 14, 350-363. doi: 10.1038/nrn3476
30. Girard, P., and Bullier, J. (1989). Visual activity in area V2 during reversible inactivation of area 17 in the macaque monkey. J. Neurophysiol. 62, 1287-1302.
31. Grossberg, S. (1980). How does the brain build a cognitive code? Psychol. Rev. 87, 1-51. doi: 10.1037/0033-295X.87.1.1
32. Grossberg, S., and Mingolla, E. (1985). Neural dynamics of perceptual grouping: textual, boundaries, and emergent segmentations. Percept. Psychophys. 38, 141-171. doi: 10.3758/BF03198851
33. Hansen, T., and Neumann, H. (2004). Neural mechanisms for the robust representation of junctions. Neural Comput. 16, 1013-1037. doi: 10.1162/089976604773135087
34. Hatori, Y., and Sakai, K. (2012). "Surface-based construction of curvature selectivity from the integration of local orientations, " in 19th International Conference on Neural Information Processing (ICONIP), Vol. 7665, eds H. Tingwen, Z. Zhigang, L. Chuandong, and L. ChiSing (Berlin; Heidelberg: Springer), 425-433. doi: 10.1007/978-3-642-34487-9_52
35. Hegdé, J., and Van Essen, D. (2000). Selectivity for complex shapes in primate visual area V2. J. Neurosci. 20, 1-6.
36. Heitger, F., von der Heydt, R., Peterhans, E., Rosenthaler, L., and Kübler, O. (1998). Simulation of neural contour mechanisms: representing anomalous contours. Image Vis. Comput. 16, 407-421. doi: 10.1016/S0262-8856(97)00083-8
37. Hubel, D. H., and Wiesel, T. N. (1959). Receptive fields of single neurones in the cat's striate cortex. J. Physiol. 148, 574-591.
38. Hubel, D. H., and Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol. 160, 106-154.
39. Hupé, J. M., James, A. C., Payne, B. R., Lomber, S. G., Girard, P., and Bullier, J. (1998). Cortical feedback improves discrimination between figure and background by v1, v2 and v3 neurons. Nature 394, 784-787. doi: 10.1038/29537
40. Ito, M., and Komatsu, H. (2004). Representation of angles embedded within contour stimuli in area V2 of macaque monkeys. J. Neurosci. 24, 3313-3324. doi: 10.1523/JNEUROSCI.4364-03.2004
41. Jehee, J. F. M., Lamme, V. A. F., and Roelfsema, P. R. (2006). Boundary assignment in a recurrent network architecture. Vision Res. 47, 1153-1165. doi: 10.1016/j.visres.2006.12.018
42. Kanizsa, G. (1955). Margini quasi-percettivi in campi con stimolozione omogenea. Rivista Psicologia 49, 7-30.
43. Kouh, M., and Poggio, T. (2008). A canonical neural circuit for cortical nonlinear operations. Neural Comput. 20, 1427-1451. doi: 10.1162/neco.2008.02-07-466
44. Lamme, V., and Roelfsema, P. (2000). The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci. 23, 571-579. doi: 10.1016/S0166-2236(00)01657-X
45. Larkum, M. (2013). A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex. Trends Neurosci. 36, 141-151. doi: 10.1016/j.tins.2012.11.006
46. Layher, G., Giese, M., and Neumann, H. (2014). Learning representations of animated motion sequences-a neural model. Top. Cogn. Sci. 6, 170-182. doi: 10.1111/tops.12075
47. Layton, O. W., Mingolla, E., and Yazdanbakhsh, A. (2012). Dynamic coding of border-ownership in visual cortex. J. Vis. 12, 1-21. doi: 10.1167/12.13.8
48. LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P. (1998). Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278-2324. doi: 10.1109/5.726791
49. Logothetis, N., Pauls, J., and Poggio, T. (1995). Shape representation in the inferior temporal cortex of monkeys. Curr. Biol. 5, 552-563. doi: 10.1016/S0960-9822(95)00108-4
50. Louie, K., Grattan, L. E., and Glimcher, P. W. (2011). Reward value-based gain control: divisive normalization in parietal cortex. J. Neurosci. 31, 10627-10639. doi: 10.1523/JNEUROSCI.1237-11.2011
51. Markov, N., Ercsey-Ravasz, M., Van Essen, D., Knoblauch, K., Toroczkai, Z., and Kennedy, H. (2013). Anatomy of hierarchy: feedforward and feedback pathways in macaque visual cortex. Science 342, 1238406. doi: 10.1126/science.1238406
52. Mineault, P., Khawaja, F., Butts, D., and Pack, C. (2012). Hierarchical processing of complex motion along the primate dorsal visual pathway. Proc. Natl. Acad. Sci. U.S.A. 109, E972-E980. doi: 10.1073/pnas.1115685109
53. Mokhtarian, F. (1995). Silhouette-based isolated object recognition through curvature scale space. IEEE Trans. PAMI 17, 539-544. doi: 10.1109/34.391387
54. Mokhtarian, F., and Mackworth, A. (1986). Scale-based description and recognition of planar curves and two-dimensional shapes. IEEE Trans. PAMI 8, 34-43. doi: 10.1109/TPAMI.1986.4767750
55. Mutch, J., and Lowe, D. G. (2008). Object class recognition and localization using sparse features with limited receptive fields. Int. J. Comp. Vis. 80, 45-57. doi: 10.1007/s11263-007-0118-0
56. Neumann, H., and Mingolla, E. (2001). "Computational neural models of spatial integration in perceptual grouping, " in From Fragments to Objects: Grouping and Segmentation in Vision, Chapter 12, eds T. Shipley and P. Kellman (Amsterdam: Elsevier), 353-400.
57. Neumann, H., and Sepp, W. (1999). Recurrent v1-v2 interaction in early visual boundary processing. Biol. Cybern. 81, 425-444. doi: 10.1007/s004220050573
58. Neumann, H., Yazdanbakhsh, A., and Mingolla, E. (2007). Seeing surfaces: the brain's vision of the world. Phys. Life Rev. 4, 189-222. doi: 10.1016/j.plrev.2007.09.001
59. O'Herron, P., and von der Heydt, R. (2011). Representation of object continuity in the visual cortex. J. Vis. 11, 1-9. doi: 10.1167/11.2.12
60. O'Herron, P., and von der Heydt, R. (2013). Remapping of border ownership in the visual cortex. J. Neurosci. 33, 1964-1974. doi: 10.1523/JNEUROSCI.2797-12.2013
61. Parent, P., and Zucker, S. (1989). Trace inference, curvature consistency, and curve detection. IEEE Trans. PAMI 11, 823-839. doi: 10.1109/34.31445
62. Pasupathy, A., and Connor, C. (1999). Responses to contour features in macaque area V4. J. Neurophysiol. 82, 2490-2502.
63. Piëch, V., Li, W., Reeke, G. N., and Gilbert, C. D. (2013). Network model of top-down influences on local gain and contextual interactions in visual cortex. Proc. Natl. Acad. Sci. U.S.A. 110, E4108-4117. doi: 10.1073/pnas.1317019110
64. Qiu, F. T., and von der Heydt, R. (2005). Figure and ground in the visual cortex: V2 combines stereoscopic cues with gestalt rules. Neuron 47, 155-166. doi: 10.1016/j.neuron.2005.05.028
65. Rao, R. P. N., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87. doi: 10.1038/4580
66. Raudies, F., and Neumann, H. (2010). A model of neural mechanisms in monocular transparent motion perception. J. Physiol. Paris 104, 71-83. doi: 10.1016/j.jphysparis.2009.11.010
67. Reynolds, J. H., and Heeger, D. J. (2009). The normalization model of attention. Neuron 61, 168-185. doi: 10.1016/j.neuron.2009.01.002
68. Riesenhuber, M., and Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019-1025. doi: 10.1038/14819
69. Riesenhuber, M., and Poggio, T. (2000). Models of object recognition. Nat. Neurosci. 3, 1199-1204. doi: 10.1038/81479
70. Rodríguez-Sánchez, A. J., and Tsotsos, J. K. (2012). The roles of endstopped and curvature tuned computations in a hierarchical representation of 2D shape. PLoS ONE 7:e42058. doi: 10.1371/journal.pone.0042058
71. Roelfsema, P., Lamme, V., Spekreijse, H., and Bosch, H. (2002). Figure-ground segregation in a recurrent network architecture. J. Cogn. Neurosci. 14, 525-537. doi: 10.1162/08989290260045756
72. Roelfsema, P. R. (2006). Cortical algorithms for perceptual grouping. Ann. Rev. Neurosci. 29, 203-227. doi: 10.1146/annurev.neuro.29.051605.112939
73. Roelfsema, P. R., Tolboom, M., and Khayat, P. S. (2007). Different processing phases for features, figures, and selective attention in the primary visual cortex. Neuron 56, 785-792. doi: 10.1016/j.neuron.2007.10.006
74. Salin, P.-A., and Bullier, J. (1995). Corticocortical connections in the visual system: structure and function. Physiol. Rev. 75, 107-154.
75. Schwartz, E., Desimone, R., Albright, T., and Gross, C. (1983). Shape Recognition and inferior temporal neurons. Proc. Natl. Acad. Sci. U.S.A. 80, 5776-5778. doi: 10.1073/pnas.80.18.5776
76. Self, M. W., Kooijmans, R. N., Supér, H., Lamme, V. A., and Roelfsema, P. R. (2012). Different glutamate receptors convey feedforward and recurrent processing in macaque V1. Proc. Natl. Acad. Sci. U.S.A. 109, 11031-11036. doi: 10.1073/pnas.1119527109
77. Serre, T., and Poggio, T. (2010). A neuromorphic approach to computer vision. Commun. ACM 53, 54. doi: 10.1145/1831407.1831425
78. Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., and Poggio, T. (2007). Robust object recognition with cortex-like mechanisms. TPAMI 29, 411-426. doi: 10.1109/TPAMI.2007.56
79. Shi, X., Wang, B., and Tsotsos, J. K. (2013). "Early recurrence improves edge detection, " in Proceedings of the 24th British Machine Vision Conference (Bristol, UK).
80. Spratling, M. W. (2008). Reconciling predictive coding and biased competition models of cortical function. Front. Comput. Neurosci. 2:4. doi: 10.3389/neuro.10.004.2008
81. Tabernik, D., Kristan, M., Boben, M., and Leonardis, A. (2014). "Using discriminative analysis for improving hierarchical compositional models, " in Proc. 19th Computer Vision Winter Workshop, ed Z. Kukelova (Krtiny).
82. Thielscher, A., and Neumann, H. (2003). Neural mechanisms of cortico-cortical interaction in texture boundary detection: a modeling approach. Neuroscience 122, 921-939. doi: 10.1016/j.neuroscience.2003.08.050
83. Tsotsos, J. K. (1988). "Computational processes in human vision: an interdisciplinary perspective, " in How Does Human Vision Beat the Computational Complexity of Visual Perception? ed Z. Pylyshyn (Norwood, NJ: Ablex Press), 286-338.
84. Tsotsos, J. K. (2005). "Neurobiology of attention, " in Computational Foundations for Attentive Processes, eds L. Itti, G. Rees, and J. K. Tsotsos (Amsterdam, NL: Elsevier), 3-7.
85. Ullman, S. (1995). Sequence-seeking and counter streams: a computational model for bi-directional information flow in the visual cortex. Cereb. Cortex 5, 1-11. doi: 10.1093/cercor/5.1.1
86. Ungerleider, L. G., and Haxby, J. V. (1994). 'what' and 'where' in the human brain. Curr. Opin. Neurobiol. 4, 157-165. doi: 10.1016/0959-4388(94)90066-3
87. von der Heydt, R., Peterhans, E., and Baumgartner, G. (1984). Illusory contours and cortical neuron responses. Science 224, 1260-1262. doi: 10.1126/science.6539501
88. Weidenbacher, U., and Neumann, H. (2009). Extraction of surface-related features in a recurrent model of V1-V2 interactions. PLoS ONE 4:e5909. doi: 10.1371/journal.pone.0005909
89. Williford, J., and von der Heydt, R. (2013). Border-ownership coding. Scholarpedia 8, 30040. doi: 10.4249/scholarpedia.30040
90. Wilson, H., and Wilkinson, F. (1998). Detection of global structure in Glass patterns: implications for form vision. Vision Res. 38, 2933-2947. doi: 10.1016/S0042-6989(98)00109-6
91. Yamane, Y., Carlson, E., Bowman, K., Wang, Z., and Connor, C. (2008). A neural code for three-dimensional object shape in macque inferotemporal cortex. Nat. Neurosci. 11, 1352-1360. doi: 10.1038/nn.2202
92. Yau, J., Pasupathy, A., Brincat, S., and Connor, C. (2013). Curvature processing dynamics in macaque area V4. Cereb. Cortex 23, 198-209.
93. Zhaoping, L. (1998). A neural model of contour integration in the primary visual cortex. Neural Comput. 10, 903-940. doi: 10.1162/089976698300017557
94. Zhou, H., Friedman, H. S., and Von Der Heydt, R. (2000). Coding of border ownership in monkey visual cortex. J. Neurosci. 20, 6594-6611. doi: 10.1113/jphysiol.2002.033555