Cortical surround interactions and perceptual salience via natural scene statistics

PLoS Computational Biology

Volumn 8, Issue 3, 2012, Pages

  Coen Cagli, Ruben ^a   Dayan, Peter ^b   Schwartz, Odelia ^a  

^a ALBERT EINSTEIN COLLEGE OF MEDICINE   (United States)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; STATISTICS;

CONTEXTUAL EFFECTS; ECOLOGICAL PRINCIPLES; FEATURE-BASED; FIRING RATES; GENERALISATION; JOINT STATISTICS; NATURAL IMAGES; NATURAL SCENE STATISTICS; PRIMARY VISUAL CORTEX; SPATIAL CONTEXT;

IMAGE SEGMENTATION;

ARTICLE; BRAIN ASYMMETRY; BRAIN CORTEX; BRAIN FUNCTION; BRAIN REGION; CELL INTERACTION; CONTROLLED STUDY; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MOLECULAR DYNAMICS; NEIGHBOR JOINING METHOD; NERVE CELL STIMULATION; NEUROMODULATION; PREDICTION; SENSITIVITY ANALYSIS; SPATIAL DISCRIMINATION; STIMULUS RESPONSE; VISUAL FIELD;

EID: 84861108659     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1002405     Document Type: Article

References (100)

1. Allman J, Miezin F, McGuinness E, (1985) Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. Annu Rev Neurosci 8: 407-430.
2. Knierim JJ, van Essen DC, (1992) Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. J Neurophysiol 67: 961-980.
3. Nothdurft HC, (1993) The conspicuousness of orientation and motion contrast. Spat Vis 7: 341-363.
4. Li CY, Li W, (1994) Extensive integration field beyond the classical receptive field of cat's striate cortical neurons-classification and tuning properties. Vision Res 34: 2337-2355.
5. Gallant JL, van Essen DC, Nothdurft HC, (1995) Two-dimensional and three-dimensional texture processing in visual cortex of the macaque monkey. In: Papathomas T, Chubb C, Gorea A, Kowler E, editors. Early Vision and Beyond MIT press pp. 89-98.
6. Lamme VA, Rodriguez-Rodriguez V, Spekreijse H, (1999) Separate processing dynamics for texture elements, boundaries and surfaces in primary visual cortex of the macaque monkey. Cereb Cortex 9: 406-413.
7. Walker GA, Ohzawa I, Freeman RD, (1999) Asymmetric suppression outside the classical receptive field of the visual cortex. J Neurosci 19: 10536-10553.
8. Cavanaugh JR, Bair W, Movshon JA, (2002a) Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. J Neurophysiol 88: 2530-2546.
9. Cavanaugh JR, Bair W, Movshon JA, (2002b) Selectivity and spatial distribution of signals from the receptive field surround in macaque V1 neurons. J Neurophysiol 88: 2547-2556.
10. Jones HE, Wang W, Sillito AM, (2002) Spatial organization and magnitude of orientation contrast interactions in primate V1. J Neurophysiol 88: 2796-2808.
11. Chen G, Dan Y, Li CY, (2005) Stimulation of non-classical receptive field enhances orientation selectivity in the cat. J Physiol 564: 233-243.
12. Ichida JM, Schwabe L, Bressloff PC, Angelucci A, (2007) Response facilitation from the "suppressive" receptive field surround of macaque V1 neurons. J Neurophysiol 98: 2168-2181.
13. Series P, Lorenceau J, Fregnac Y, (2003) The "silent" surround of V1 receptive fields: theory and experiments. J Physiol Paris 97: 453-474.
14. Li Z, (1998) A neural model of contour integration in the primary visual cortex. Neural Comput 10: 903-940.
15. Itti L, Koch C, (2000) A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Res 40: 1489-1506.
16. Gao D, Mahadevan V, Vasconcelos N, (2008) On the plausibility of the discriminant center-surround hypothesis for visual saliency. J Vis 8: 11-18.
17. Zhang LY, Tong MH, Marks TK, Shan HH, Cottrell GW, (2008) SUN: A Bayesian framework for saliency using natural statistics. J Vis 8: 1-20.
18. Bruce ND, Tsotsos JK, (2009) Saliency, attention, and visual search: an information theoretic approach. J Vis 9: 1-24.
19. Li Z, (1999) Visual segmentation by contextual influences via intra-cortical interactions in the primary visual cortex. Network 10: 187-212.
20. Li Z, (2002) A saliency map in primary visual cortex. Trends Cogn Sci 6: 9-16.
21. Zhaoping L, (2006) Theoretical understanding of the early visual processes by data compression and data selection. Network 17: 301-334.
22. Zhaoping L, May KA, (2007) Psychophysical tests of the hypothesis of a bottom up saliency map in primary visual cortex. PLoS Comput Biol 3: e62.
23. Koene AR, Zhaoping L, (2007) Feature-specific interactions in salience from combined feature contrasts: Evidence for a bottom-up saliency map in V1. J Vis 7: 1-14.
24. Zhaoping L, (2008) After-search-visual search by gaze shifts after input image vanishes. J Vis 8: 21-11.
25. Attneave F, (1954) Some informational aspects of visual perception. Psychol Rev 61: 183-193.
26. Barlow HB, (1961) Possible principles underlying the transformation of sensory messages. In: Rosenblith WA, editors. Sensory Communication MIT press pp. 217-234.
27. Simoncelli EP, Olshausen BA, (2001) Natural image statistics and neural representation. Annu Rev Neurosci 24: 1193-1216.
28. Olshausen BA, Field DJ, (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381: 607-609.
29. Bell AJ, Sejnowski TJ, (1997) The "independent components" of natural scenes are edge filters. Vision Res 37: 3327-3338.
30. Schwartz O, Simoncelli EP, (2001) Natural signal statistics and sensory gain control. Nat Neurosci 4: 819-825.
31. Hyvärinen A, Hurri J, Vayrynen J, (2003) Bubbles: a unifying framework for low-level statistical properties of natural image sequences. J Opt Soc Am A Opt Image Sci Vis 20: 1237-1252.
32. Körding KP, Kayser C, Einhäuser W, König P, (2003) How are complex cell properties adapted to the statistics of natural scenes? J Neurophysiol 91: 206-212.
33. Zetzsche C, Nuding U, (2005) Natural scene statistics and nonlinear neural interactions between frequency-selective mechanisms. Biosystems 79: 143-149.
34. Karklin Y, Lewicki MS, (2009) Emergence of complex cell properties by learning to generalize in natural scenes. Nature 457: 83-86.
35. Spratling MW, (2010) Predictive coding as a model of response properties in cortical area V1. J Neurosci 30: 3531-3543.
36. Karklin Y, Lewicki MS, (2005) A hierarchical Bayesian model for learning nonlinear statistical regularities in nonstationary natural signals. Neural Comput 17: 397-423.
37. Schwartz O, Sejnowski TJ, Dayan P, (2006) Soft mixer assignment in a hierarchical generative model of natural scene statistics. Neural Comput 18: 2680-2718.
38. Kivinen JJ, Sudderth EB, Jordan MI, (2007) Learning Multiscale Representations of Natural Scenes Using Dirichlet Processes. In: Proceedings of the 11th IEEE Int'l Conf. on Comp. Vis.; 14-21 October 2007; Rio De Janeiro, Brazil. ICCV 2007. Available: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4408870&isnumber=4408819. Accessed 24 April 2010.
39. Guerrero-Colon JA, Simoncelli EP, Portilla J, (2008) Image denoising using mixtures of Gaussian scale mixtures. In: Proceedings of the 15th IEEE Int'l Conf. on Image Proc.; 12-15 October 2008; San Diego, California, United States. ICIP 2008. Available: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4711817&isnumber=4711669. Accessed March 2009.
40. Geisler WS, Albrecht DG, (1992) Cortical neurons: isolation of contrast gain control. Vision Res 32: 1409-1410.
41. Heeger DJ, (1992) Normalization of cell responses in cat striate cortex. Vis Neurosci 9: 181-197.
42. Carandini M, Heeger DJ, Movshon JA, (1997) Linearity and normalization in simple cells of the macaque primary visual cortex. J Neurosci 17: 8621-8644.
43. Heuer HW, Britten KH, (2002) Contrast dependence of response normalization in area MT of the rhesus macaque. J Neurophysiol 88: 3398-3408.
44. Simoncelli EP, Freeman WT, Adelson EH, Heeger DJ, (1992) Shiftable Multiscale Transforms. Ieee T Inform Theory 38: 587-607.
45. Parra L, Spence C, Sajda P, (2001) Higher-order Statistical Properties Arising from the Non-stationarity of Natural Signals. In: Leen TK, Dietterich TG, Tresp V, editors. Advances in NIPS MIT press pp. 786-792.
46. Wainwright MJ, Simoncelli EP, Willsky AS, (2001) Random cascades on wavelet trees and their use in analyzing and modeling natural images. Appl Comput Harmon A 11: 89-123.
47. Coen-Cagli R, Dayan P, Schwartz O, (2009) Statistical models of linear and nonlinear contextual interactions in early visual processing. In: Bengio Y, Schuurmans D, Lafferty J, Williams CKI, Culotta A, editors. Advances in NIPS MIT press pp. 369-377.
48. Portilla J, Simoncelli EP, (2000) A parametric texture model based on joint statistics of complex wavelet coefficients. Int J Comput Vision 40: 49-71.
49. Ringach DL, Shapley RM, Hawken MJ, (2002) Orientation selectivity in macaque V1: diversity and laminar dependence. J Neurosci 22: 5639-5651.
50. Bishop CM, (2006) Pattern Recognition and Machine Learning. Springer.
51. Dayan P, Abbott LF, (1999) Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. MIT Press.
52. Gilbert CD, Wiesel TN, (1983) Clustered intrinsic connections in cat visual cortex. J Neurosci 3: 1116-1133.
53. Ts'o DY, Gilbert CD, Wiesel TN, (1986) Relationships between horizontal interactions and functional architecture in cat striate cortex as revealed by cross-correlation analysis. J Neurosci 6: 1160-1170.
54. Fitzpatrick D, (1996) The functional organization of local circuits in visual cortex: insights from the study of tree shrew striate cortex. Cereb Cortex 6: 329-341.
55. Stettler DD, Das A, Bennett J, Gilbert CD, (2002) Lateral connectivity and contextual interactions in macaque primary visual cortex. Neuron 36: 739-750.
56. Gilbert CD, Wiesel TN, (1989) Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex. J Neurosci 9: 2432-2442.
57. Angelucci A, Levitt JB, Walton EJ, Hupe JM, Bullier J, Lund JS, (2002) Circuits for local and global signal integration in primary visual cortex. J Neurosci 22: 8633-8646.
58. Shmuel A, Korman M, Sterkin A, Harel M, Ullman S, et al. (2005) Retinotopic axis specificity and selective clustering of feedback projections from V2 to V1 in the owl monkey. J Neurosci 25: 2117-2131.
59. Schwabe L, Obermayer K, Angelucci A, Bressloff PC, (2006) The role of feedback in shaping the extra-classical receptive field of cortical neurons: a recurrent network model. J Neurosci 26: 9117-9129.
60. Moore CI, Carlen M, Knoblich U, Cardin JA, (2010) Neocortical Interneurons: from Diversity, Strength. Cell 142: 184-188.
61. Salinas E, (2003) Background synaptic activity as a switch between dynamical states in a network. Neural Comput 15: 1439-1475.
62. Nauhaus I, Busse L, Carandini M, Ringach D, (2009) Stimulus contrast modulates functional connectivity in visual cortex. Nat Neurosci 12: 70-76.
63. Ozeki H, Finn IM, Schaffer ES, Miller KD, Ferster D, (2009) Inhibitory stabilization of the cortical network underlies visual surround suppression. Neuron 62: 578-592.
64. Kapadia MK, Westheimer G, Gilbert CD, (1999) Dynamics of spatial summation in primary visual cortex of alert monkeys. Proc Natl Acad Sci U S A 96: 12073-12078.
65. Sceniak MP, Ringach DL, Hawken MJ, Shapley R, (1999) Contrast's effect on spatial summation by macaque V1 neurons. Nat Neurosci 2: 733-739.
66. Sillito AM, Grieve KL, Jones HE, Cudeiro J, Davis J, (1995) Visual cortical mechanisms detecting focal orientation discontinuities. Nature 378: 492-496.
67. Levitt JB, Lund JS, (1997) Contrast dependence of contextual effects in primate visual cortex. Nature 387: 73-76.
68. Sengpiel F, Sen A, Blakemore C, (1997) Characteristics of surround inhibition in cat area 17. Exp Brain Res 116: 216-228.
69. Goddard E, Clifford CW, Solomon SG, (2008) Centre-surround effects on perceived orientation in complex images. Vision Res 48: 1374-182.
70. Schwartz O, Sejnowski TJ, Dayan P, (2009) Perceptual organization in the tilt illusion. J Vis 9: 11-20.
71. Shen ZM, Xu WF, Li CY, (2007) Cue-invariant detection of centre-surround discontinuity by V1 neurons in awake macaque monkey. J Physiol 583: 581-592.
72. Vinje WE, Gallant JL, (2000) Sparse coding and decorrelation in primary visual cortex during natural vision. Science 287: 1273-1276.
73. Polat U, Mizobe K, Pettet MW, Kasamatsu T, Norcia AM, (1998) Collinear stimuli regulate visual responses depending on cell's contrast threshold. Nature 391: 580-584.
74. Kasamatsu T, Polat U, Pettet MW, Norcia AM, (2001) Colinear facilitation promotes reliability of single-cell responses in cat striate cortex. Exp Brain Res 138: 163-172.
75. Zhaoping L, (2003) V1 mechanisms and some figure-ground and border effects. J Physiol Paris 97: 503-515.
76. Zhaoping L, (2005) The primary visual cortex creates a bottom-up saliency map. In: Itti L, Rees G, Tsotsos JK, editors. Neurobiology of Attention pp. 570-575 Academic Press: Burlington.
77. Li W, Piech V, Gilbert CD, (2006) Contour saliency in primary visual cortex. Neuron 50: 951-962.
78. Chance FS, Abbott LF, Reyes AD, (2002) Gain modulation from background synaptic input. Neuron 35: 773-782.
79. Kouh M, Poggio T, (2008) A canonical neural circuit for cortical nonlinear operations. Neural Comput 20: 1427-1451.
80. Ayaz A, Chance FS, (2009) Gain modulation of neuronal responses by subtractive and divisive mechanisms of inhibition. J Neurophysiol 101: 958-968.
81. Kuhlmann L, Vidyasagar TR, (2011) A computational study of how orientation bias in the lateral geniculate nucleus can give rise to orientation selectivity in primary visual cortex. Front Syst Neurosci 5: 81.
82. Pettet MW, McKee SP, Grzywacz NM, (1998) Constraints on long range interactions mediating contour detection. Vision Res 38: 865-879.
83. Yen SC, Finkel LH, (1998) Extraction of perceptually salient contours by striate cortical networks. Vision Res 38: 719-741.
84. Mundhenk TN, Itti L, (2005) Computational modeling and exploration of contour integration for visual saliency. Biol Cybern 93: 188-212.
85. Dakin SC, Baruch NJ, (2009) Context influences contour integration. J Vis 9: 11-13.
86. Li W, Piech V, Gilbert CD, (2008) Learning to link visual contours. Neuron 57: 442-451.
87. Geisler WS, Perry JS, (2009) Contour statistics in natural images: grouping across occlusions. Vis Neurosci 26: 109-121.
88. Sigman M, Cecchi GA, Gilbert CD, Magnasco MO, (2001) On a common circle: natural scenes and Gestalt rules. Proc Natl Acad Sci U S A 98: 1935-1940.
89. Geisler WS, Perry JS, Super BJ, Gallogly DP, (2001) Edge co-occurrence in natural images predicts contour grouping performance. Vision Res 41: 711-724.
90. Hoyer PO, Hyvärinen A, (2002) A multi-layer sparse coding network learns contour coding from natural images. Vision Res 42: 1593-1605.
91. Osindero S, Welling M, Hinton GE, (2006) Topographic product models applied to natural scene statistics. Neural Comput 18: 381-414.
92. Malo J, Gutierrez J, (2006) V1 non-linear properties emerge from local-to-global non-linear ICA. Network 17: 85-102.
93. Lücke J, (2009) Receptive field self-organization in a model of the fine structure in v1 cortical columns. Neural Comput 21: 2805-2845.
94. Portilla J, Strela V, Wainwright MJ, Simoncelli EP, (2003) Image denoising using scale mixtures of Gaussians in the wavelet domain. Ieee T Image Process 12: 1338-1351.
95. Li Q, Wang Z, (2008) General-purpose reduced-reference image quality assessment based on perceptually and statistically motivated image representation. In: Proceedings of the 15th IEEE Int'l Conf. on Image Proc.; 12-15 October 2008; San Diego, California, United States. ICIP 2008. Available:http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4711974&isnumber=4711669. Accessed August 2009.
96. Hammond DK, Simoncelli EP, (2008) Image modeling and denoising with orientation-adapted Gaussian scale mixtures. IEEE Trans Image Process 17: 2089-2101.
97. Gauthier JL, Field GD, Sher A, Greschner M, Shlens J, et al. (2009) Receptive Fields in Primate Retina Are Coordinated to Sample Visual Space More Uniformly. PLoS Biol 7: e1000063.
98. Rao RP, Ballard DH, (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2: 79-87.
99. Schwartz O, Hsu A, Dayan P, (2007) Space and time in visual context. Nat Rev Neurosci 8: 522-535.
100. Itti L, Baldi P, (2006) Bayesian surprise attracts human attention. In: Weiss Y, Scholkopf B, Platt J, editors. Advances in NIPS MIT press pp. 547-554.