A conceptual framework of computations in mid-level vision

Frontiers in Computational Neuroscience

Volumn 8, Issue DEC, 2014, Pages

  Kubilius, Jonas ^a   Wagemans, Johan ^a   Op de Beeck, Hans P ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Mid level vision; Perceptual organization; Pooling; Similarity; Summary statistics

Indexed keywords

MEDICAL COMPUTING; NEUROLOGY;

CONCEPTUAL FRAMEWORKS; HIERARCHICAL COMPUTATION; IMAGE REPRESENTATIONS; INTERMEDIATE REPRESENTATIONS; PERCEPTUAL ORGANIZATION; POOLING; SIMILARITY; SUMMARY STATISTIC;

SEMANTICS;

ARTICLE; COLOR; CONCEPTUAL FRAMEWORK; IMAGING; KNOWLEDGE; ORIENTATION; RECOGNITION; SEMANTICS; SURFACE PROPERTY; TASK PERFORMANCE; VISION; VISUAL STIMULATION;

EID: 84917670890     PISSN: None     EISSN: 16625188     Source Type: Journal    
DOI: 10.3389/fncom.2014.00158     Document Type: Article

References (204)

1. Σ64. (2012). The Forest in Yakushima, Kagoshima Pref., Japan. Available online at:http://commons.wikimedia.org/wiki/File:Forest_in_Yakushima_08.jpg(Accessed November 26, 2014).
2. Allen, H. A., Humphreys, G. W., Colin, J., and Neumann, H. (2009). Ventral extra-striate cortical areas are required for human visual texture segmentation. J. Vis. 9:2. doi: 10.1167/9.9.2
3. Amir, O., Biederman, I., and Hayworth, K. J. (2012). Sensitivity to nonaccidental properties across various shape dimensions. Vision Res. 62, 35-43. doi: 10.1016/j.visres.2012.03.020
4. Angelucci, A., Levitt, J. B., Walton, E. J. S., Hupé, J.-M., Bullier, J., and Lund, J. S. (2002). Circuits for local and global signal integration in primary visual cortex. J. Neurosci. 22, 8633-8646.
5. Arall, M., Romeo, A., and Supèr, H. (2012). "Role of feedforward and feedback projections in figure-ground responses," in Visual Cortex-Current Status and Perspectives, ed S. Molotchnikoff (InTech). Available online at:http://www.intechopen.com/books/visual-cortex-current-status-and-perspectives/role-of-feedforward-and-feedback-projections-in-figure-ground-responses
6. Arbeláez, P., Maire, M., Fowlkes, C., and Malik, J. (2011). Contour detection and hierarchical image segmentation.Pattern Anal. Mach. Intell. IEEE Trans. 33, 898-916. doi: 10.1109/TPAMI.2010.161
7. Arbeláez, P., Pont-Tuset, J., Barron, J., Marques, F., and Malik, J. (2014). Multiscale combinatorial grouping, inComputer Vision and Pattern Recognition. Available online at:http://www.eecs.berkeley.edu/Research/Projects/CS/vision/grouping/mcg/
8. Attneave, F. (1954). Some informational aspects of visual perception. Psychol. Rev. 61, 183-193. doi: 10.1037/h0054663
9. Balas, B., Nakano, L., and Rosenholtz, R. (2009). A summary-statistic representation in peripheral vision explains visual crowding. J. Vis. 9:13. doi: 10.1167/9.12.13
10. Ban, H., Yamamoto, H., Hanakawa, T., Urayama, S., Aso, T., Fukuyama, H., et al. (2013). Topographic representation of an occluded object and the effects of spatiotemporal context in human early visual areas. J. Neurosci. 33, 16992-17007. doi: 10.1523/JNEUROSCI.1455-12.2013
11. Bar, M. (2004). Visual objects in context. Nat. Rev. Neurosci. 5, 617-629. doi: 10.1038/nrn1476
12. Barenholtz, E., and Tarr, M. J. (2007). "Reconsidering the role of structure in vision," in Categories in Use, Vol. 47, eds A. Markman and B. Ross (San Diego, CA: Academic Press), 157-180.
13. Barlow, H. B. (1961). "Possible principles underlying the transformation of sensory messages," in Sensory Communication, ed W. Rosenblith (Cambridge, MA: MIT Press), 217-234.
14. bengt-re. (2009). Car 132. Available on line at: https://www.flickr.com/photos/bengt-re/3889978926/(Accessed November 26, 2014).
15. Berbezier, M. (2008). IMG_3536. Available online at:https://www.flickr.com/photos/berbezier/2399217350/(Accessed November 26, 2014).
16. Biederman, I. (1987). Recognition-by-components: a theory of human image understanding. Psychol. Rev. 94, 115-147. doi: 10.1037/0033-295X.94.2.115
17. Blum, H. (1973). Biological shape and visual science (part I). J. Theor. Biol. 38, 205-287. doi: 10.1016/0022-5193(73)90175-6
18. Bosch, A., Zisserman, A., and Munoz, X. (2007). "Representing shape with a spatial pyramid kernel," inProceedings of the 6th ACM International Conference on Image and Video Retrieval (New York, NY).
19. Boureau, Y.-L., Bach, F., LeCun, Y., and Ponce, J. (2010). "Learning mid-level features for recognition," in 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (San Francisco, CA).
20. Brincat, S. L., and Connor, C. E. (2006). Dynamic shape synthesis in posterior inferotemporal cortex. Neuron 49, 17-24. doi: 10.1016/j.neuron.2005.11.026
21. Bullier, J. (2001). Integrated model of visual processing. Brain Res. Rev. 36, 96-107. doi: 10.1016/S0165-0173(01)00085-6
22. Bushnell, B. N., Harding, P. J., Kosai, Y., and Pasupathy, A. (2011). Partial occlusion modulates contour-based shape encoding in primate area V4. J. Neurosci. 31, 4012-4024. doi: 10.1523/JNEUROSCI.4766-10.2011
23. Camera Eye Photography. (2013). Trio, Quartet, or Quintet of Objects… Week #26 [26 of 52]. Available online at:https://www.flickr.com/photos/camera_is_a_mirror_with_memory/9126653341/(Accessed November 26, 2014).
24. Carandini, M., Demb, J. B., Mante, V., Tolhurst, D. J., Dan, Y., Olshausen, B. A., et al. (2005). Do we know what the early visual system does? J. Neurosci. 25, 10577-10597. doi: 10.1523/JNEUROSCI.3726-05.2005
25. Chen, L. (1982). Topological structure in visual perception. Science 218, 699-700. doi: 10.1126/science.7134969
26. Chen, L. (2005). The topological approach to perceptual organization. Vis. Cogn. 12, 553-637. doi: 10.1080/13506280444000256
27. Choi, M. J., Torralba, A., and Willsky, A. S. (2012). Context models and out-of-context objects. Pattern Recognit. Lett. 33, 853-862. doi: 10.1016/j.patrec.2011.12.004
28. Coates, A., Karpathy, A., and Ng, A. (2012). "Emergence of object-selective features in unsupervised feature learning," Presented at the Advances in Neural Information Processing Systems 25. Available online at:http://nips.cc/Conferences/2012/Program/event.php?ID=3342
29. Cox, D. D. (2014). Do we understand high-level vision? Curr. Opin. Neurobiol. 25, 187-193. doi: 10.1016/j.conb.2014.01.016
30. Craft, E., Schütze, H., Niebur, E., and von der Heydt, R. (2007). A neural model of figure-ground organization. J. Neurophysiol. 97, 4310-4326. doi: 10.1152/jn.00203.2007
31. D'Antona, A. D., Perry, J. S., and Geisler, W. S. (2013). Humans make efficient use of natural image statistics when performing spatial interpolation. J. Vis. 13:11. doi: 10.1167/13.14.11
32. Dalal, N., and Triggs, B. (2005). "Histograms of oriented gradients for human detection," in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, Vol. 1 (San Diego, CA), 886-893. doi: 10.1109/CVPR.2005.177
33. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009). "ImageNet: a large-scale hierarchical image database," in IEEE Conference on Computer Vision and Pattern Recognition, 2009. CVPR 2009 (Miami, FL), 248-255. doi: 10.1109/CVPR.2009.5206848
34. Desimone, R., Albright, T., Gross, C., and Bruce, C. (1984). Stimulus-selective properties of inferior temporal neurons in the macaque. J. Neurosci. 4, 2051-2062.
35. DiCarlo, J. J., and Cox, D. D. (2007). Untangling invariant object recognition. Trends Cogn. Sci. 11, 333-341. doi: 10.1016/j.tics.2007.06.010
36. DiCarlo, J. J., Zoccolan, D., and Rust, N. C. (2012). How does the brain solve visual object recognition? Neuron 73, 415-434. doi: 10.1016/j.neuron.2012.01.010
37. Dobbins, A., Zucker, S. W., and Cynader, M. S. (1987). Endstopped neurons in the visual cortex as a substrate for calculating curvature. Nature 329, 438-441. doi: 10.1038/329438a0
38. Downing, P. E., Jiang, Y., Shuman, M., and Kanwisher, N. (2001). A cortical area selective for visual processing of the human body. Science 293, 2470-2473. doi: 10.1126/science.1063414
39. Elder, J. H., and Zucker, S. W. (1996). "Computing contour closure," in Computer Vision-ECCV'96, eds B. Buxton and R. Cipolla (Berlin Heidelberg: Springer), 399-412. Available online at:http://link.springer.com/chapter/10.1007/BFb0015553
40. El-Shamayleh, Y., and Movshon, J. A. (2011). Neuronal responses to texture-defined form in macaque visual area V2. J. Neurosci. 31, 8543-8555. doi: 10.1523/JNEUROSCI.5974-10.2011
41. Epstein, R., and Kanwisher, N. (1998). A cortical representation of the local visual environment. Nature 392, 598-601. doi: 10.1038/33402
42. Feldman, J. (1997). Regularity-based perceptual grouping. Comput. Intell. 13, 582-623. doi: 10.1111/0824-7935.00052
43. Feldman, J. (2003). What is a visual object? Trends Cogn. Sci. 7, 252-256. doi: 10.1016/S1364-6613(03)00111-6
44. Felleman, D. J., and Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex.Cereb. Cortex 1, 1-47. doi: 10.1093/cercor/1.1.1
45. Felzenszwalb, P. F., and Huttenlocher, D. P. (2004). Efficient graph-based image segmentation. Int. J. Comput. Vis. 59, 167-181. doi: 10.1023/B:VISI.0000022288.19776.77
46. Fidler, S., Boben, M., and Leonardis, A. (2009). "Learning hierarchical compositional representations of object structure," in Object Categorization: Computer and Human Vision Perspectives, 1st Edn., eds S. J. Dickinson, A. Leonardis, B. Schiele, and M. J. Tarr (New York, NY: Cambridge University Press), 196-215.
47. Freeman, J., and Simoncelli, E. P. (2011). Metamers of the ventral stream. Nat. Neurosci. 14, 1195-1201. doi: 10.1038/nn.2889
48. Freeman, J., Ziemba, C. M., Heeger, D. J., Simoncelli, E. P., and Movshon, J. A. (2013). A functional and perceptual signature of the second visual area in primates. Nat. Neurosci. 16, 974-981. doi: 10.1038/nn.3402
49. Fukushima, K. (1980). Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193-202. doi: 10.1007/BF00344251
50. Geisler, W. S. (2008). Visual perception and the statistical properties of natural scenes. Annu. Rev. Psychol. 59, 167-192. doi: 10. 1146/annurev.psych.58.110405.085632
51. Geisler, W. S., and Perry, J. S. (2009). Contour statistics in natural images: grouping across occlusions. Vis. Neurosci. 26, 109-121. doi: 10.1017/S0952523808080875
52. Geisler, W. S., and Super, B. J. (2000). Perceptual organization of two-dimensional patterns. Psychol. Rev. 107, 677-708. doi: 10.1037/0033-295X.107.4.677
53. Gibson, J. J. (1979). The Ecological Approach to Visual Perception. Houghton, MI: Mifflin.
54. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014). "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Available online at: http://arxiv.org/abs/1311.2524
55. Goodale, M. A., and Milner, A. D. (1992). Separate visual pathways for perception and action. Trends in Neurosciences, 15, 20-25. doi: 10.1016/0166-2236(92)90344-8
56. Grossberg, S. (1994). 3-D vision and figure-ground separation by visual cortex. Percept. Psychophys. 55, 48-121. doi: 10.3758/BF03206880
57. Hansen, T., and Neumann, H. (2004). Neural Mechanisms for the Robust Representation of Junctions. Neural Comput. 16, 1013-1037. doi: 10.1162/089976604773135087
58. Hariharan, B., Arbeláez, P., Girshick, R., and Malik, J. (2014). "Simultaneous detection and segmentation," inEuropean Conference on Computer Vision (ECCV). Available online at: http://arxiv.org/abs/1407.1808
59. Hinton, G. E., and Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks. Science313, 504-507. doi: 10.1126/science.1127647
60. Hochstein, S., and Ahissar, M. (2002). View from the top: hierarchies and reverse hierarchies in the visual system.Neuron 36, 791-804. doi: 10.1016/S0896-6273(02)01091-7
61. Hubel, D. H., and Wiesel, T. N. (1961). Integrative action in the cat's lateral geniculate body. J. Physiol. 155, 385-398.
62. Hubel, D. H., and Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol. 160, 106-154.
63. Hubel, D. H., and Wiesel, T. N. (1965). Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. J. Neurophysiol. 28, 229-289.
64. Hummel, J. E., and Biederman, I. (1992). Dynamic binding in a neural network for shape recognition. Psychol. Rev. 99, 480-517. doi: 10.1037/0033-295X.99.3.480
65. Hung, C.-C., Carlson, E. T., and Connor, C. E. (2012). Medial axis shape coding in macaque inferotemporal cortex.Neuron 74, 1099-1113. doi: 10.1016/j.neuron.2012.04.029
66. Huth, A. G., Nishimoto, S., Vu, A. T., and Gallant, J. L. (2012). A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron 76, 1210-1224. doi: 10.1016/j.neuron.2012.10.014
67. Hyvärinen, A., and Hoyer, P. (2000). Emergence of phase- and shift-invariant features by decomposition of natural images into independent feature subspaces. Neural Comput. 12, 1705-1720. doi: 10.1162/089976600300015312
68. Hyvärinen, A., and Hoyer, P. O. (2001). A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images. Vision Res. 41, 2413-2423. doi: 10.1016/S0042-6989(01)00114-6
69. Ion, A., Carreira, J., and Sminchisescu, C. (2013). Probabilistic joint image segmentation and labeling by figure-ground composition. Int. J. Comput. Vis. doi: 10.1007/s11263-013-0663-7
70. Ito, M., and Komatsu, H. (2004). Representation of angles embedded within contour stimuli in area V2 of macaque monkeys. J. Neurosci. 24, 3313-3324. doi: 10.1523/JNEUROSCI.4364-03.2004
71. Jehee, J. F. M., Lamme, V. A. F., and Roelfsema, P. R. (2007). Boundary assignment in a recurrent network architecture. Vision Res. 47, 1153-1165. doi: 10.1016/j.visres.2006.12.018
72. Joo, S. J., and Murray, S. O. (2014). Contextual effects in human visual cortex depend on surface structure. J. Neurophysiol. 111, 1783-1791. doi: 10.1152/jn.00671.2013
73. Kanizsa, G. (1955). Margini quasi-percettivi in campi con stimolazione omogenea. Riv. Psicol. 49, 7-30.
74. Kanwisher, N., McDermott, J., and Chun, M. M. (1997). The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302-4311.
75. Kayaert, G., Biederman, I., Op de Beeck, H. P., and Vogels, R. (2005a). Tuning for shape dimensions in macaque inferior temporal cortex. Eur. J. Neurosci. 22, 212-224. doi: 10.1111/j.1460-9568.2005.04202.x
76. Kayaert, G., Biederman, I., and Vogels, R. (2005b). Representation of regular and irregular shapes in macaque inferotemporal cortex. Cereb. Cortex 15, 1308-1321. doi: 10.1093/cercor/bhi014
77. Kogo, N., and Froyen, V. (2014). "Border-ownership computation reflecting consistency of surface properties,"Presented at the Vision Sciences Society (St. Pete Beach, FL).
78. Kogo, N., Strecha, C., Van Gool, L., and Wagemans, J. (2010). Surface construction by a 2-D differentiation-integration process: a neurocomputational model for perceived border ownership, depth, and lightness in Kanizsa figures. Psychol. Rev. 117, 406-439. doi: 10.1037/a0019076
79. Kogo, N., and van Ee, R. (2014). "Neural mechanisms of figure-ground organization: border-ownership, competition and perceptual switching," in Oxford Handbook of Perceptual Organization, ed J. Wagemans (Oxford, UK: Oxford University Press).
80. Kornblith, S., Cheng, X., Ohayon, S., and Tsao, D. Y. (2013). A network for scene processing in the macaque temporal lobe. Neuron 79, 766-781. doi: 10.1016/j.neuron.2013.06.015
81. Kosai, Y., El-Shamayleh, Y., Fyall, A. M., and Pasupathy, A. (2014). The role of visual area V4 in the discrimination of partially occluded shapes. J. Neurosci. 34, 8570-8584. doi: 10.1523/JNEUROSCI.1375-14.2014
82. Kourtzi, Z., and Kanwisher, N. (2001). Representation of perceived object shape by the human lateral occipital complex. Science 293, 1506-1509. doi: 10.1126/science.1061133
83. Kreiman, G. (2013). "Computational models of visual object recognition," in Principles of Neural Coding, Vol. 1-0. (CRC Press), 565-580. Available online at: http://www.crcnetbase.com/doi/abs/10.1201/b14756-33 doi: 10.1201/b14756-33
84. Krizhevsky, A., Sutskever, I., and Hinton, G. E. (2012). "ImageNet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems 25, eds F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger (Curran Associates, Inc), 1097-1105. Available online at: http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf
85. Kubilius, J., Wagemans, J., and Op de Beeck, H. P. (2014). Encoding of configural regularity in the human visual system. J. Vis. 14:11. doi: 10.1167/14.9.11
86. Kuffler, S. W. (1953). Discharge patterns and functional organization of mammalian retina. J. Neurophysiol. 16, 37-68.
87. Lamme, V. A. (1995). The neurophysiology of figure-ground segregation in primary visual cortex. J. Neurosci. 15, 1605-1615.
88. Lamme, V. A. F., Rodriguez-Rodriguez, V., and Spekreijse, H. (1999). Separate processing dynamics for texture elements, boundaries and surfaces in primary visual cortex of the macaque monkey. Cereb. Cortex 9, 406-413. doi: 10.1093/cercor/9.4.406
89. Landecker, W., Thomure, M. D., Bettencourt, L. M. A., Mitchell, M., Kenyon, G. T., and Brumby, S. P. (2013). "Interpreting individual classifications of hierarchical networks," in 2013 IEEE Symposium on Computational Intelligence and Data Mining (CIDM) (Singapore).
90. Larsson, J., Landy, M. S., and Heeger, D. J. (2006). Orientation-selective adaptation to first- and second-order patterns in human visual cortex. J. Neurophysiol. 95, 862-881. doi: 10.1152/jn.00668.2005
91. Layton, O. W., Mingolla, E., and Yazdanbakhsh, A. (2012). Dynamic coding of border-ownership in visual cortex. J. Vis. 12:8. doi: 10.1167/12.13.8
92. LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., et al. (1989). Backpropagation applied to handwritten zip code recognition. Neural Comput. 1, 541-551. doi: 10.1162/neco.1989.1.4.541
93. Lee, T. S., Mumford, D., and Yuille, A. (1992). "Texture segmentation by minimizing vector-valued energy functionals: the coupled-membrane model," in Computer Vision-ECCV'92, ed G. Sandini (Berlin Heidelberg: Springer), 165-173. Available online at: http://link.springer.com/chapter/10.1007/3-540-55426-2_19
94. Leibe, B., Leonardis, A., and Schiele, B. (2008). Robust object detection with interleaved categorization and segmentation. Int. J. Comput. Vis. 77, 259-289. doi: 10.1007/s11263-007-0095-3
95. Lescroart, M. D., Biederman, I., Yue, X., and Davidoff, J. (2010). A cross-cultural study of the representation of shape: sensitivity to generalized cone dimensions. Visual Cogn. 18, 50-66. doi: 10.1080/13506280802507806
96. Li, F. F., VanRullen, R., Koch, C., and Perona, P. (2002). Rapid natural scene categorization in the near absence of attention. Proc. Natl. Acad. Sci. U.S.A. 99, 9596-9601. doi: 10.1073/pnas.092277599
97. Li, G., Yao, Z., Wang, Z., Yuan, N., Talebi, V., Tan, J., et al. (2014). Form-cue invariant second-order neuronal responses to contrast modulation in primate area V2. J. Neurosci. 34, 12081-12092. doi: 10.1523/JNEUROSCI.0211-14.2014
98. Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91-110. doi: 10.1023/B:VISI.0000029664.99615.94
99. Lu, C., and Tang, X. (2014). Surpassing human-level face verification performance on LFW with GaussianFace.arXiv:1404.3840 [cs, Stat]. Available online at: arxiv.org/abs/1404.3840
100. Marcar, V. L., Raiguel, S. E., Xiao, D., and Orban, G. A. (2000). Processing of kinetically defined boundaries in areas V1 and V2 of the macaque monkey. J. Neurophysiol. 84, 2786-2798.
101. Mareschal, I., and Baker, C. L. (1998). A cortical locus for the processing of contrast-defined contours. Nat. Neurosci. 1, 150-154. doi: 10.1038/401
102. Marr, D. (1982). Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. San Francisco, CA: W. H. Freeman.
103. McDermott, J. (2004). Psychophysics with junctions in real images. Perception 33, 1101-1127. doi: 10.1068/p5265
104. Mihalas, S., Dong, Y., von der Heydt, R., and Niebur, E. (2011). Mechanisms of perceptual organization provide auto-zoom and auto-localization for attention to objects. Proc. Natl. Acad. Sci. U.S.A. 108, 7583-7588. doi: 10.1073/pnas.1014655108
105. Mumford, D., and Shah, J. (1989). Optimal approximations by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. 42, 577-685. doi: 10.1002/cpa.3160420503
106. Murray, R. F., Sekuler, A. B., and Bennett, P. J. (2001). Time course of amodal completion revealed by a shape discrimination task. Psychon. Bull. Rev. 8, 713-720. doi: 10.3758/BF03196208
107. Nakayama, K., He, Z. J., and Shimojo, S. (1995). "Visual surface representation: a critical link between lower-level and higher-level vision," in Visual cognition: An invitation to cognitive science, 2nd Edn, Vol. 2, eds S. M. Kosslyn and D. N. Osherson (Cambridge, MA: The MIT Press), 1-70. Available online at:http://visionlab.harvard.edu/members/ken/Papers/077NKHeShimojoMIT1995b.pdf
108. Nothdurft, H. C. (1994). Common properties of visual segmentation. Ciba Found. Symp. 184, 245-259. discussion: 260-271.
109. Oliva, A., and Torralba, A. (2001). Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42, 145-175. doi: 10.1023/A:1011139631724
110. Oliva, A., and Torralba, A. (2006). "Chapter 2 Building the gist of a scene: the role of global image features in recognition," in Progress in Brain Research, Vol. 155, Part B, eds S. L. Macknik, L. M. Martinez, J. -M. Alonso, P. U. Tse and S. Martinez-Conde (Elsevier), 23-36. Available online at:http://www.sciencedirect.com/science/article/pii/S0079612306550022
111. Oliva, A., and Torralba, A. (2007). The role of context in object recognition. Trends Cogn. Sci. 11, 520-527. doi: 10.1016/j.tics.2007.09.009
112. Olshausen, B. A., and Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607-609. doi: 10.1038/381607a0
113. Olshausen, B. A., and Field, D. J. (2004). Sparse coding of sensory inputs. Curr. Opin. Neurobiol. 14, 481-487. doi: 10.1016/j.conb.2004.07.007
114. Op de Beeck, H., Wagemans, J., and Vogels, R. (2001). Inferotemporal neurons represent low-dimensional configurations of parameterized shapes. Nat. Neurosci. 4, 1244-1252. doi: 10.1038/nn767
115. Ostrovsky, Y., Andalman, A., and Sinha, P. (2006). Vision following extended congenital blindness. Psychol. Sci. 17, 1009-1014. doi: 10.1111/j.1467-9280.2006.01827.x
116. Ostrovsky, Y., Meyers, E., Ganesh, S., Mathur, U., and Sinha, P. (2009). Visual parsing after recovery from blindness. Psychol. Sci. 20, 1484-1491. doi: 10.1111/j.1467-9280.2009.02471.x
117. Pan, Y., Chen, M., Yin, J., An, X., Zhang, X., Lu, Y., et al. (2012). Equivalent representation of real and illusory contours in macaque V4. J. Neurosci. 32, 6760-6770. doi: 10.1523/JNEUROSCI.6140-11.2012
118. Paris, S., and Durand, F. (2007). "A topological approach to hierarchical segmentation using mean shift," in IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR'07 (Minneapolis, MN), 1-8.
119. Pasupathy, A., and Connor, C. E. (1999). Responses to contour features in macaque area V4. J. Neurophysiol. 82, 2490-2502.
120. Pasupathy, A., and Connor, C. E. (2001). Shape representation in area V4: position-specific tuning for boundary conformation. J. Neurophysiol. 86, 2505-2519.
121. Pasupathy, A., and Connor, C. E. (2002). Population coding of shape in area V4. Nat. Neurosci. 5, 1332-1338. doi: 10.1038/nn972
122. Peelen, M. V., and Downing, P. E. (2005). Selectivity for the human body in the fusiform gyrus. J. Neurophysiol. 93, 603-608. doi: 10.1152/jn.00513.2004
123. Peterson, M. A. (1994). Object recognition processes can and do operate before figure-ground organization. Curr. Dir. Psychol. Sci. 3, 105-111. doi: 10.1111/1467-8721.ep10770552
124. Pinto, N., Cox, D. D., and DiCarlo, J. J. (2008). Why is real-world visual object recognition hard? PLoS Comput. Biol. 4:e27. doi: 10.1371/journal.pcbi.0040027
125. Poort, J., Raudies, F., Wannig, A., Lamme, V. A. F., Neumann, H., and Roelfsema, P. R. (2012). The role of attention in figure-ground segregation in areas V1 and V4 of the visual cortex. Neuron 75, 143-156. doi: 10.1016/j.neuron.2012.04.032
126. Portilla, J., and Simoncelli, E. P. (2000). A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vis. 40, 49-70. doi: 10.1023/A:1026553619983
127. Potter, M. C. (1976). Short-term conceptual memory for pictures. J. Exp. Psychol. Hum. Learn. Mem. 2, 509-522. doi: 10.1037/0278-7393.2.5.509
128. Purves, D., Monson, B. B., Sundararajan, J., and Wojtach, W. T. (2014). How biological vision succeeds in the physical world. Proc. Natl. Acad. Sci. U.S.A. 111, 4750-4755. doi: 10.1073/pnas.1311309111
129. Pylyshyn, Z. W. (2001). Visual indexes, preconceptual objects, and situated vision. Cognition 80, 127-158. doi: 10.1016/S0010-0277(00)00156-6
130. Qiu, F. T., Sugihara, T., and von der Heydt, R. (2007). Figure-ground mechanisms provide structure for selective attention. Nature Neuroscience, 10, 1492-1499. doi: 10.1038/nn1989
131. Quiroga, R. Q., Mukamel, R., Isham, E. A., Malach, R., and Fried, I. (2008). Human single-neuron responses at the threshold of conscious recognition. Proc. Natl. Acad. Sci. U.S.A. 105, 3599-3604. doi: 10.1073/pnas.0707043105
132. Ramenahalli, S., Mihalas, S., and Niebur, E. (2014). Local spectral anisotropy is a valid cue for figure-ground organization in natural scenes. Vision Res. 103, 116-126. doi: 10.1016/j.visres.2014.08.012
133. Ramsden, B. M., Hung, C. P., and Roe, A. W. (2001). Real and illusory contour processing in area V1 of the primate: a cortical balancing act. Cereb. Cortex 11, 648-665. doi: 10.1093/cercor/11.7.648
134. Rao, R. P. N., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87. doi: 10.1038/4580
135. Rauschenberger, R., Liu, T., Slotnick, S. D., and Yantis, S. (2006). Temporally unfolding neural representation of pictorial occlusion. Psychol. Sci. 17, 358-364. doi: 10.1111/j.1467-9280.2006.01711.x
136. Razavian, A. S., Azizpour, H., Sullivan, J., and Carlsson, S. (2014). CNN features off-the-shelf: an astounding baseline for recognition. arXiv:1403.6382 [cs]. Available online at: http://arxiv.org/abs/1403.6382
137. Regan, D. (2000). Mountains. Available online at: https://www.flickr.com/photos/r-z/3690169484/(Accessed November 26, 2014).
138. Reza. (2009). Mountains. Available online at: https://www.flickr.com/photos/r-z/3690169484/(Accessed November 26, 2014).
139. Riesenhuber, M., and Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019-1025. doi: 10.1038/14819
140. Ringach, D. L., and Shapley, R. (1996). Spatial and temporal properties of illusory contours and amodal boundary completion. Vision Res. 36, 3037-3050. doi: 10.1016/0042-6989(96)00062-4
141. Rodríguez-Sánchez, A. J., and Tsotsos, J. K. (2012). The roles of endstopped and curvature tuned computations in a hierarchical representation of 2D shape. PLoS ONE 7:e42058. doi: 10.1371/journal.pone.0042058
142. Roelfsema, P. R. (2006). Cortical algorithms for perceptual grouping. Annu. Rev. Neurosci. 29, 203-227. doi: 10.1146/annurev.neuro.29.051605.112939
143. Roelfsema, P. R., Lamme, V. A. F., and Spekreijse, H. (2004). Synchrony and covariation of firing rates in the primary visual cortex during contour grouping. Nat. Neurosci. 7, 982-991. doi: 10.1038/nn1304
144. Roelfsema, P. R., Lamme, V. A. F., Spekreijse, H., and Bosch, H. (2002). Figure-ground segregation in a recurrent network architecture. J. Cogn. Neurosci. 14, 525-537. doi: 10.1162/08989290260045756
145. Roelfsema, P. R., van Ooyen, A., and Watanabe, T. (2010). Perceptual learning rules based on reinforcers and attention. Trends Cogn. Sci. 14, 64-71. doi: 10.1016/j.tics.2009.11.005
146. Rosenholtz, R., Huang, J., Raj, A., Balas, B. J., and Ilie, L. (2012). A summary statistic representation in peripheral vision explains visual search. J. Vis. 12:14. doi: 10.1167/12.4.14
147. Rosenholtz, R., Twarog, N. R., Schinkel-Bielefeld, N., and Wattenberg, M. (2009). "An intuitive model of perceptual grouping for HCI design," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1331-1340. Available online at: http://dl.acm.org/citation.cfm?id=1518903
148. Roskies, A. L. (1999). The binding problem. Neuron 24, 7-9. doi: 10.1016/S0896-6273(00)80817-X
149. Russakovsky, O., Deng, J., Huang, Z., Berg, A. C., and Fei-Fei, L. (2013). "Detecting avocados to zucchinis: what have we done, and where are we going?" in 2013 IEEE International Conference on Computer Vision (ICCV)(Sydney, NSW), 2064-2071. doi: 10.1109/ICCV.2013.258
150. Russell, A. F., Mihalaş, S., von der Heydt, R., Niebur, E., and Etienne-Cummings, R. (2014). A model of proto-object based saliency. Vision Res. 94, 1-15. doi: 10.1016/j.visres.2013.10.005
151. Scharstein, D., and Szeliski, R. (2002). A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47, 7-42. doi: 10.1023/A:1014573219977
152. Schmid, A. M., Purpura, K. P., and Victor, J. D. (2014). Responses to orientation discontinuities in V1 and V2: physiological dissociations and functional implications. J. Neurosci. 34, 3559-3578. doi: 10.1523/JNEUROSCI.2293-13.2014
153. Schmidhuber, J. (1992). Learning complex, extended sequences using the principle of history compression. Neural Comput. 4, 234-242. doi: 10.1162/neco.1992.4.2.234
154. Sekuler, A. B., and Palmer, S. E. (1992). Perception of partly occluded objects: a microgenetic analysis. J. Exp. Psychol. 121, 95-111. doi: 10.1037/0096-3445.121.1.95
155. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., and LeCun, Y. (2013). OverFeat: integrated recognition, localization and detection using convolutional networks. arXiv:1312.6229 [cs]. Available online at:http://arxiv.org/abs/1312.6229
156. Serre, T., Oliva, A., and Poggio, T. (2007). A feedforward architecture accounts for rapid categorization. Proc. Natl. Acad. Sci. U.S.A. 104, 6424-6429. doi: 10.1073/pnas.0700622104
157. Sharon, E., Galun, M., Sharon, D., Basri, R., and Brandt, A. (2006). Hierarchy and adaptivity in segmenting visual scenes. Nature 442, 810-813. doi: 10.1038/nature04977
158. Sheila in Moonducks. (2010). Tree. Available online at:https://www.flickr.com/photos/aspis7/5075169756/(Accessed November 26, 2014).
159. Shi, J., and Malik, J. (2000). Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22, 888-905. doi: 10.1109/34.868688
160. Simoncelli, E. P., and Olshausen, B. A. (2001). Natural image statistics and neural representation. Annu. Rev. Neurosci. 24, 1193-1216. doi: 10.1146/annurev.neuro.24.1.1193
161. Singer, W., and Gray, C. M. (1995). Visual feature integration and the temporal correlation hypothesis. Annu. Rev. Neurosci. 18, 555-586. doi: 10.1146/annurev.ne.18.030195.003011
162. Snowdog. (2005). Leuven - Grote Markt. Available online at: commons.wikimedia.org/wiki/File:Leuven-Grote-Markt.jpg(Accessed November 26, 2014).
163. Song, Y., and Baker, C. L. (2007). Neuronal response to texture- and contrast-defined boundaries in early visual cortex. Visual Neurosci. 24, 65-77. doi: 10.1017/S0952523807070113
164. Supèr, H., and Lamme, V. A. F. (2007). Altered figure-ground perception in monkeys with an extra-striate lesion.Neuropsychologia 45, 3329-3334. doi: 10.1016/j.neuropsychologia.2007.07.001
165. Supèr, H., Romeo, A., and Keil, M. (2010). Feed-forward segmentation of figure-ground and assignment of border-ownership. PLoS ONE 5:e10705. doi: 10.1371/journal.pone.0010705
166. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., et al. (2014). Going deeper with convolutions.arXiv:1409.4842 [cs]. Available online at: arxiv.org/abs/1409.4842
167. Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., et al. (2013). Intriguing properties of neural networks. arXiv:1312.6199 [cs]. Available online at: arxiv.org/abs/1312.6199
168. Taigman, Y., Yang, M., Ranzato, M., and Wolf, L. (2014). "DeepFace: closing the gap to human-level performance in face verification," in 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Available online at: https://www.facebook.com/publications/546316888800776/ doi: 10.1109/CVPR.2014.220
169. Tanaka, K. (1996). Inferotemporal cortex and object vision. Annu. Rev. Neurosci. 19, 109-139. doi: 10.1146/annurev.ne.19.030196.000545
170. Thielscher, A., and Neumann, H. (2003). Neural mechanisms of cortico-cortical interaction in texture boundary detection: a modeling approach. Neuroscience 122, 921-939. doi: 10.1016/j.neuroscience.2003.08.050
171. Thielscher, A., and Neumann, H. (2005). Neural mechanisms of human texture processing: texture boundary detection and visual search. Spat. Vis. 18, 227-257. doi: 10.1163/1568568053320594
172. Thielscher, A., and Neumann, H. (2008). Globally consistent depth sorting of overlapping 2D surfaces in a model using local recurrent interactions. Biol. Cybern. 98, 305-337. doi: 10.1007/s00422-008-0211-7
173. Thorpe, S., Fize, D., and Marlot, C. (1996). Speed of processing in the human visual system. Nature 381, 520-522. doi: 10.1038/381520a0
174. Todd, J. T., Weismantel, E., and Kallie, C. S. (2014). On the relative detectability of configural properties. J. Vis. 14:18. doi: 10.1167/14.1.18
175. Torralba, A., and Efros, A. A. (2011). "Unbiased look at dataset bias," in 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Providence, RI), 1521-1528.
176. Torralba, A., and Oliva, A. (2003). Statistics of natural image categories. Network (Bristol, England) 14, 391-412. doi: 10.1088/0954-898X/14/3/302
177. Tsao, D. Y., Freiwald, W. A., Tootell, R. B. H., and Livingstone, M. S. (2006). A cortical region consisting entirely of face-selective cells. Science 311, 670-674. doi: 10.1126/science.1119983
178. Tschechne, S., and Neumann, H. (2014). Hierarchical representation of shapes in visual cortex-from localized features to figural shape segregation. Front. Comput. Neurosci. 8:93. doi: 10.3389/fncom.2014.00093
179. Tse, P. U. (1999). Volume completion. Cogn. Psychol. 39, 37-68. doi: 10.1006/cogp.1999.0715
180. Ullman, S., and Basri, R. (1991). Recognition by linear combinations of models. IEEE Trans. Pattern Anal. Mach. Intell. 13, 992-1006. doi: 10.1109/34.99234
181. van Lier, R., van der Helm, P., and Leeuwenberg, E. (1994). Integrating global and local aspects of visual occlusion.Perception 23, 883-903. doi: 10.1068/p230883
182. van Lier, R. (1999). Investigating global effects in visual occlusion: from a partly occluded square to the back of a tree-trunk. Acta Psychol. (Amst.) 102, 203-220.
183. Vilankar, K. P., Golden, J. R., Chandler, D. M., and Field, D. J. (2014). Local edge statistics provide information regarding occlusion and nonocclusion edges in natural scenes. J. Vis. 14:13. doi: 10.1167/14.9.13
184. Vinje, W. E., and Gallant, J. L. (2000). Sparse coding and decorrelation in primary visual cortex during natural vision. Science 287, 1273-1276. doi: 10.1126/science.287.5456.1273
185. Viola, P., and Jones, M. (2001). "Rapid object detection using a boosted cascade of simple features," in Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2001. CVPR 2001(Vol. 1, I-511-I-518) (Kauai, HI). doi: 10.1109/CVPR.2001.990517
186. Vogels, R., Biederman, I., Bar, M., and Lorincz, A. (2001). Inferior temporal neurons show greater sensitivity to nonaccidental than to metric shape differences. J. Cogn. Neurosci. 13, 444-453. doi: 10.1162/08989290152001871
187. von der Heydt, R., and Peterhans, E. (1989). Mechanisms of contour perception in monkey visual cortex. I. Lines of pattern discontinuity. J. Neurosci. 9, 1731-1748.
188. von der Heydt, R., Peterhans, E., and Baumgartner, G. (1984). Illusory contours and cortical neuron responses.Science 224, 1260-1262. doi: 10.1126/science.6539501
189. von der Malsburg, C. (1981). The Correlation Theory of Brain Function. Departmental Technical Report, MPI. Available online at: http://cogprints.org/1380/
190. Wagemans, J., Elder, J. H., Kubovy, M., Palmer, S. E., Peterson, M. A., Singh, M., et al. (2012a). A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization. Psychol. Bull. 138, 1172-1217. doi: 10.1037/a0029333
191. Wagemans, J., Feldman, J., Gepshtein, S., Kimchi, R., Pomerantz, J. R., van der Helm, P. A., et al. (2012b). A century of Gestalt psychology in visual perception: II. Conceptual and theoretical foundations. Psychol. Bull. 138, 1218-1252. doi: 10.1037/a0029334
192. Wagemans, J., Lamote, C., and Gool, L. V. (1997). Shape equivalence under perspective and projective transformations. Psychon. Bull. Rev. 4, 248-253. doi: 10.3758/BF03209401
193. Wagemans, J., Van Gool, L., Lamote, C., and Foster, D. H. (2000). Minimal information to determine affine shape equivalence. J. Exp. Psychol. Hum. Percept. Perform. 26, 443-468. doi: 10.1037/0096-1523.26.2.443
194. Walther, D., and Koch, C. (2006). Modeling attention to salient proto-objects. Neural Netw. 19, 1395-1407. doi: 10.1016/j.neunet.2006.10.001
195. Wehr, M., and Laurent, G. (1996). Odour encoding by temporal sequences of firing in oscillating neural assemblies.Nature 384, 162-166. doi: 10.1038/384162a0
196. Weidenbacher, U., and Neumann, H. (2009). Extraction of surface-related features in a recurrent model of V1-V2 interactions. PLoS ONE 4:e5909. doi: 10.1371/journal.pone.0005909
197. Witkin, A. P., and Tenenbaum, J. M. (1983). On the role of structure in vision. Hum. Mach. Vis. 1, 481-543. doi: 10.1016/B978-0-12-084320-6.50022-0
198. Wyatte, D., Herd, S., Mingus, B., and O'Reilly, R. (2012). The role of competitive inhibition and top-down feedback in binding during object recognition. Front. Psychol. 3:182. doi: 10.3389/fpsyg.2012.00182
199. Yamane, Y., Carlson, E. T., Bowman, K. C., Wang, Z., and Connor, C. E. (2008). A neural code for three-dimensional object shape in macaque inferotemporal cortex. Nat. Neurosci. 11, 1352-1360. doi: 10.1038/nn.2202
200. Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., and DiCarlo, J. J. (2014). Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proc. Natl. Acad. Sci. U.S.A. 111, 8619-8624. doi: 10.1073/pnas.1403112111
201. Yu, C.-P., Samaras, D., and Zelinsky, G. J. (2014). Modeling visual clutter perception using proto-object segmentation. J. Vis. 14:4. doi: 10.1167/14.7.4
202. Zhaoping, L. (2005). Border ownership from intracortical interactions in visual area V2. Neuron 47, 143-153. doi: 10.1016/j.neuron.2005.04.005
203. Zhou, H., Friedman, H. S., and von der Heydt, R. (2000). Coding of border ownership in monkey visual cortex. J. Neurosci. 20, 6594-6611.
204. Zucker, S. W. (2014). "Border inference and border ownership. The challenge of integrating geometry and topology." in Oxford Handbook of Perceptual Organization, ed J. Wagemans (Oxford, UK: Oxford University Press). doi: 10.1093/oxfordhb/9780199686858.013.020