Beyond multiple pattern analyzers modeled as linear filters (as classical V1 simple cells): Useful additions of the last 25 years

Vision Research

Volumn 51, Issue 13, 2011, Pages 1397-1430

  Graham, Norma V ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Contour integration; Contrast comparison; Contrast gain; Contrast normalization; FRF; Lateral connections; Second order; Surround suppression

Indexed keywords

BRAIN CORTEX; BRAIN FUNCTION; COGNITION; DEPTH PERCEPTION; HUMAN; IMAGE PROCESSING; LINEAR SYSTEM; MATHEMATICAL MODEL; NONLINEAR SYSTEM; PATTERN RECOGNITION; PRIORITY JOURNAL; PSYCHOPHYSICS; RECEPTIVE FIELD; REVIEW; SENSORY GATING; STIMULUS RESPONSE; VISION; VISUAL STIMULATION; VISUAL SYSTEM;

HUMANS; MODELS, NEUROLOGICAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; SENSORY RECEPTOR CELLS; VISUAL PATHWAYS;

EID: 79960635298     PISSN: 00426989     EISSN: 18785646     Source Type: Journal    
DOI: 10.1016/j.visres.2011.02.007     Document Type: Review

References (124)

1. Albrecht D.G., Hamilton D.B. Striate cortex of monkey and cat: Contrast response function. Journal of Neurophysiology 1982, 48:217-237.
2. Allard R., Faubert J. Double dissociation between first- and second-order processing. Vision Research 2007, 47:1129-1141.
3. Arsenault A.S., Wilkinson F., Kingdom F.A.A. Modulation frequency and orientation tuning of second-order texture mechanisms. Journal of the Optical Society of America A 1999, 16(3):427-435.
4. Badcock D.R., Clifford W.G., Khuu S.K. Interactions between luminance and contrast signals in global form detection. Vision Research 2005, 45:881-889.
5. Bair W., Cavanaugh J.R., Movshon J.A. Time course and time-distance relationships for surround suppression in Macaque V1 neurons. Journal of Neuroscience 2003, 23:7690-7701.
6. Baker C.L., Mareschal I. Processing of second-order stimuli in the visual cortex. Progress in Brain Research 2001, 134:171-191.
7. Beck J., Rosenfeld A., Ivry R. Line segregation. Spatial Vision 1989, 4:75-101.
8. Bex P.J., Mareschal I., Dakin S.C. Contrast gain control in natural scenes. Journal of Vision 2007, 7(11):12.
9. Blake R., Wilson H. Binocular vision. Vision Research 2011, 51(7):754-770.
10. Bonds A.B. Role of inhibition in the specification of orientation selectivity of cells in the cat striate cortex. Visual Neuroscience 1989, 2:41-55.
11. Bonds A.B. The encoding of cortical contrast gain control. Contrast sensitivity 1993, 215-230. MIT Press, Cambridge. R.M. Shapley, D.M. Lam (Eds.).
12. Bracewell, R. (1965, 1978, 1999). The Fourier transform and its applications. New York: McGraw-Hill.
13. Burr D., Thompson P. Motion psychophysics: 1985-2010. Vision Research 2011, 51(13):1431-1456.
14. Caputo G. The role of the background: Texture segregation and figure-ground segmentation. Vision Research 1996, 36:2815-2826.
15. Carandini M. Receptive fields and suppressive fields in the early visual system. The cognitive neurosciences 2004, Vol. III:313-326. MIT Press, 3rd ed.
16. Carandini M., Demb J.B., Mante V., Tolhurst D.J., Dan Y., Olshausen B.A., et al. Mini-symposium: Do we know what the early visual system does?. Journal of Neuroscience 2005, 25(46):10577-10597.
17. Carandini M., Heeger D.J., Movshon J.A. Linearity and normalization in simple cells of the macaque primary visual cortex. Journal of Neuroscience 1997, 17:8621-8644.
18. Carrasco M. Visual attention: Neurophysiology, Pscychophysics and cognitive neuroscience. Vision Research 2009, 49(10):1033-1036.
19. Cavanaugh J.R., Bair W., Movshon J.A. Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. Journal of Neurophysiology 2002, 88:2530-2546.
20. Chen C.C., Kasamatsu T., Polat U., Norcia A.M. Contrast response characteristics of long-range lateral interactions in cat striate cortex. Neuroreport 2001, 12:655-661.
21. Dakin S.C., Hess R.F. Spatial-frequency tuning of visual contour integration. Journal of the Optical Society of America A 1998, 15:1486-1499.
22. Dakin S.C., Hess R.F. Contour integration and scale combination processes in visual edge detection. Spatial Vision 1999, 12:309-327.
23. Dosher B.A., Lu Z.L. Level and mechanisms of perceptual learning: Learning first-order luminance and second-order texture objects. Vision Research 2005, 46:1996-2007.
24. Ejima Y., Miura K. Change in detection threshold caused by peripheral gratings: Dependence on contrast and separation. Vision Research 1984, 24:367-372.
25. Ellemberg D., Allen H.A., Hess R.F. Second-order spatial frequency and orientation channels in human vision. Vision Research 2006, 46:2798-2803.
26. El-Shamayleh, Y. (2009). Neuronal and behavioral responses to visual form. Ph.D. dissertation. New York University.
27. El-Shamayleh, Y., & Movshon, J. A. (2006). Responses to texture-defined forms in macaque V2 neurons. Program No. 604.9. Neuroscience meeting planner. Atlanta, GA. Society for Neuroscience.
28. Falkner A.L., Krishna B.S., Goldberg M.E. Surround suppression sharpens the priority map in the lateral intraparietal area. Journal of Neuroscience 2010, 30:12787-12797.
29. Field D.J., Hayes A., Hess R.F. Contour integration by the human visual system: Evidence for a local 'association field'. Vision Research 1993, 33:173-193.
30. Foley J.M. Human luminance pattern mechanisms: Masking experiments require a new model. Journal of the Optical Society of America A 1994, 11:1710-1719.
31. Foley, J.M. (2010). The Role of Temporal Transients in Forward and Backward Masking. VSS spring 2010. Journal of Vision, 10, 7, article 1390.
32. Foster D.H. Color constancy. Vision Research 2011, 51(7):674-700.
33. Gardner J.L., Sun P., Waggoner R.A., Ueno K., Tanaka K., Cheng K. Contrast adaptation and representation in human early visual cortex. Neuron 2005, 47:607-620.
34. Goris R.L.T., Wichmann F.A., Henning G.B. A neurophysiologically plausible population code model for human contrast discrimination. Journal of Vision 2009, 9(7):15.
35. Graham N. Visual pattern analyzers 1989, Oxford University Press, New York.
36. Graham N. Complex channels, early local nonlinearities, and normalization in texture segregation. Computational models of visual processing 1991, MIT Press. M.L. Landy, J.A. Movshon (Eds.).
37. Graham N. Breaking the visual stimulus into parts. Current Directions in Psychological Science 1992, 1:55-61.
38. Graham, N., & Wolfson, S. S. (in press). Two visual contrast processes: One new, One Old. In C. Chubb, B. Dosher, Z. Lu, & R. Schiffrin, (Eds.), Vision, memory, and attention. American Psychological Association.
39. Graham N., Beck J., Sutter A. Nonlinear processes in spatial-frequency channel models of perceived texture segregation: Effects of sign and amount of contrast. Vision Research 1992, 32:719-743.
40. Graham N., Sutter A. Spatial summation in simple (Fourier) and complex (non-Fourier) channels in texture segregation. Vision Research 1998, 38:231-257.
41. Graham N., Sutter A. Normalization: Contrast-gain control in simple (Fourier) and complex (non-Fourier) pathways of pattern vision. Vision Research 2000, 40:2737-2761.
42. Graham N., Sutter A., Venkatesan C. Spatial-frequency- and orientation-selectivity of simple and complex channels in region segregation. Vision Research 1993, 33(14):1893-1911.
43. Graham N., Wolfson S.S. Is there opponent-orientation coding in the second-order channels of pattern vision?. Vision Research 2004, 44(27):3145-3175.
44. Graham N., Wolfson S.S. Exploring contrast-controlled adaptation processes in human vision (with help from Buffy the Vampire Slayer). Computational vision in neural and machine system 2007, 9-47. Cambridge University Press. M. Jenkins, L. Harris (Eds.).
45. Graham, N., Wolfson, S. S., Pan, S., Wauble, G., & Kwok, I. (2009). Modeling the interaction of two rapid adaptation processes: Contrast comparison and contrast normalization. Program No. 651.74. 2009 Neuroscience Meeting Planner. Chicago, IL. Society for Neuroscience 2009.
46. Hallum, L. E., Landy, M. S., & Heeger, D. J. (in press). Human primary visual cortex (V1) is selective for second-order spatial frequency. Journal of Neurophysiology.
47. Heeger D.J. Computational model of cat striate physiology. Computational models of visual processing 1991, MIT Press, Cambridge, MA. M.S. Landy, J.A. Movshon (Eds.).
48. Heeger D.J. Normalization of cell responses in cat striate cortex. Visual Neuroscience 1992, 9:181-198.
49. Heeger D.J., Ress D. Neuronal correlates of visual attention and perception. The cognitive neurosciences 2004, 339-350. MIT Press. M. Gazzaniga (Ed.).
50. Heeger D.J., Simoncelli E.P., Movshon J.A. Computational models of cortical visual processing. Proceedings of the National Academy of Sciences of the United States of America 1996, 93:623-627. Copyright National Academy of Sciences U.S.A.
51. Henning G.B., Hertz B.G., Broadbent D.E. Some experiments bearing on the hypothesis that the visual system analyzes spatial patterns in independent bands of spatial frequency. Vision Research 1975, 15:887-899.
52. Hess R.F., Baker D.H., May K.A., Wang J. On the decline of 1st and 2nd order sensitivity with eccentricity. Journal of Vision 2008, 8(19):1-12.
53. Higher-order processing in the visual system (1994). G. R. Bock (Organizer) & J. A. Goode (Eds.), Ciba foundation symposium 184. Symposium held October 1993 based on a proposal by Michael J. Morgan.
54. Hochberg J. Gestalt theory and its legacy. Organization in eye and brain. In attention, mental representation. Perception and cognition at century's end 1998, 276-278. Academic Press, New York. J. Hochberg (Ed.).
55. Itti L., Koch C., Braun J. Revisiting spatial vision: Toward a unifying model. Journal of the Optical Society of America A 2000, 17:1899-1917.
56. Johnson A.P., Baker C.L. First- and second-order information in natural images: A filter-based approach to image statistics. Journal of the Optical Society of America A 2004, 21(6):913-925.
57. Johnson A.P., Kingdom F.A.A., Baker C.L. Spatiochromatic statistics of natural scenes: First-and-second-order information and their correlational structure. Journal of the Optical Society of American A 2005, 22:2050-2059.
58. Johnson A.P., Prins N., Kingdom F.A.A., Baker C.L. Ecologically valid combinations of first- and second-order surface markings facilitate texture discrimination. Vision Research 2007, 14:2250-2281.
59. Jones H.E., Grieve K.L., Wang W., Sillito A.M. Surround suppression in primate V1. Journal of Neurophysiology 2001, 86:2011-2028.
60. Kachinsky E.S., Smith V.C., Pokorny J. Discrimination and identification of luminance contrast stimuli. Journal of Vision 2003, 3(10):599-609.
61. Kingdom F.A.A. Lightness, brightness, and transparency: A quarter century of new ideas, captivating demonstrations, and unrelenting controversy. Vision Research 2011, 51(7):652-673.
62. Kiorpes L., Bassin S.A. Development of contour integration in macaque monkeys. Visual Neuroscience 2003, 20:567-575.
63. Korenberg M.J., Hunter I.W. The identification of nonlinear biological systems: LNL cascade models. Biological Cybernetics 1986, 55:125-134.
64. Landy M.S., Graham N. Visual perception of texture. The visual neurosciences 2003, Vol. 2:1106-1118. MIT Press.
65. Landy M.S., Oruc I. Properties of second-order spatial frequency channels. Vision Research 2002, 42:2311-2329.
66. Larsson J., Landy M.S., Heeger D.J. Orientation-selective adaptation to first- and second-order patterns in human visual cortex. Journal of Neurophysiology 2006, 95:862-881.
67. Legendy C. Circuits in the brain. A model of shape processing in the primary visual cortex 2009, Springer-Verlag, NYC.
68. Legge G.E., Foley J.M. Contrast masking in human vision. Journal of the Optical Society of America 1980, 70:1458-1471.
69. Lennie P. Single units and visual cortical organization. Perception 1998, 27:889-935.
70. Levi D.M., Carney T. The effect of three flankers on three tasks in central, peripheral, and amblyopic vision. Journal of Vision 2011, 11(1):1-23.
71. Levi D.M., Waugh S.J. Position acuity with opposite-contrast polarity features: Evidence for a nonlinear collector mechanism for position acuity?. Vision Research 1996, 36:1907-1918.
72. Levick W.R., Cleland B.G., Dubin M.W. Lateral geniculate neurons of cat: Retinal inputs and physiology. Investigative Ophthalmology 1972, 11:302-311.
73. Levitt J.B., Lund J.B. Contrast dependence of contextual effects in primate visual cortex. Nature 1997, 387:73-76.
74. Lu Z.L., Sperling G. Second-order illusions: Mach Bands, Chevreul, and Craik-O'Brien-Cornsweet. Vision Research 1996, 36(4):559-572.
75. Maertens M., Shapley R. Local determinants of contour interpolation. Journal of Vision 2008, 8(7):3.
76. Manahilov V., Simpson W.A., Calvert J. Why is second-order vision less efficient than first-order vision?. Vision Research 2005, 45:2759-2772.
77. McLaughlin D., Shapley R., Shelley M., Wielaard J. A neuronal network model of macaque primary visual cortex (V1): Orientation selectivity and dynamics in the Input layer 4Ca. Proceedings of the National Academy of Sciences of the United States of America 2000, 97:8087-8092.
78. Meese T.S. Area summation and masking. Journal of Vision 2004, 4:930-943.
79. Meese T.S., Holmes D.J. Adaptation and gain pool summation: Alternative models and masking data. Vision Research 2002, 42:1113-1125.
80. Morgan M. Features and the 'primal sketch'. Vision Research 2011, 51(7):738-753.
81. Mostafavi H., Sakrison D.J. Structure and properties of a single channel in the human visual system. Vision Research 1976, 23:997-1004.
82. Motoyoshi I., Kingdom F.A.A. Differential roles of contrast polarity reveal two streams of second-order processing. Vision Research 2007, 47:2047-2054.
83. Motoyoshi I., Nishida S. Cross-orientation summation in texture segregation. Vision Research 2004, 44:2567-2576.
84. Movshon J.A. Visual processing of moving images. Images and understanding 1990, Cambridge University Press, Cambridge, England. H. Barlow, C. Blakemore, M. Weston-Smith (Eds.).
85. Nachmias J. How is a grating detected on a narrowband noise masker?. Vision Research 1999, 39:1133-1142.
86. Olzak L.A., Thomas J.P. Neural recoding in human pattern vision: Model and mechanisms. Vision Research 1999, 39:231-256.
87. Olzak L.A., Thomas J.P. Dual nonlinearities regulate contrast sensitivity in pattern discrimination tasks. Vision Research 2003, 13:1433-1442.
88. Oruc I., Landy M.S., Pelli D.G. Noise masking reveals channels for second-order letters. Vision Research 2006, 46:1493-1506.
89. Persike M., Olzak L.A., Meinhardt G. Contour integration across spatial frequency. Journal of Experimental Psychology: Human Perception and Performance 2009, 35:1629-1648.
90. Petrov Y., Carandini M., McKee S.P. Two distinct mechanisms of suppression in human vision. Journal of Neuroscience 2005, 25:8704-8707.
91. Polat U., Sagi D. Lateral interactions between spatial channels. Suppression and facilitation revealed by lateral masking experiments. Vision Research 1993, 7:993-999.
92. Polat U., Sagi D. The architecture of perceptual spatial interactions. Vision Research 1994, 34:73-78.
93. Prins N., Kingdom F.A.A., Hayes A. Detection low shape-frequencies in smooth and jagged contours. Vision Research 2007, 47:2390-2402.
94. Quick R.F. A vector-magnitude model of contrast detection. Kybernetik 1974, 16:65-67.
95. Reynolds J.H., Heeger D.J. The normalization model of attention. Neuron 2009, 61:168-185.
96. Ringach D. Population coding under normalization. Vision Research 2010, 50:2223-2232.
97. Robson J.G., Graham N. Probability summation and regional variation in contrast sensitivity across the visual field. Vision Research 1981, 21:409-418.
98. Roelfsma P.R. Cortical algorithms for perceptual grouping. Annual Review of Neuroscience 2006, 29:203-227.
99. Rogowitz B. Spatial/temporal interactions: Backward and forward metacontrast masking with sine-wave gratings. Vision Research 1983, 23:1057-1073.
100. Samonds J.M., Zhou Z., Bernard M.R., Bonds A.B. Synchronous activity in cat visual cortex encodes collinear and cocircular contours. Journal of Neurophysiology 2006, 95:2016-2602.
101. Schofield A.J. What does second-order vision see in an image?. Perception 2000, 29:1071-1086.
102. Schofield A.J., Georgeson M.A. Sensitivity to modulations of luminance and contrast in visual white noise: Separate mechanisms with similar behaviour. Vision Research 1999, 39:2697-2716.
103. Schwartz O., Simoncelli E.P. Natural signal statistics and sensory gain control. Nature Neuroscience 2001, 4:819-825.
104. Shapley R. Linear and nonlinear systems analysis of the visual system: Why does it seem so linear? A review dedicated to the memory of Henk Spekreijse. Vision Research 2009, 49:907-921.
105. Shapley R., Hawken M. Color in the cortex. Vision Research 2011, 51(7):701-717.
106. Shapley R., Gordon J. Nonlinearity in the perception of form. Perception & Psychophysics 1985, 37:84-88. Fig. 4 from this publication used in Fig. 24 here with kind permission from Springer Science+Business Media B.V.
107. Snowden R.J., Hammett S.T. The effects of surround contrast on contrast thresholds, perceived contrast and contrast discrimination. Vision Research 1998, 38:1935-1945.
108. Sterkin A., Yehezkel O., Bonneh Y.S., Norcia A., Polat U. Backward masking suppresses collinear facilitation in the visual cortex. Vision Research 2009, 49:1784-1794.
109. Thielscher A., Neumann H. A computational model to link psychophysics and cortical cell activation in human texture processing. Journal of Computational Neuroscience 2007, 22:255-282.
110. Vakrou C., Whitaker D., McGraw P.V. Extrafoveal viewing reveals the nature of second-order human vision. Journal of Vision 2007, 7(14):1-15.
111. Victor J.D., Conte M.M. The role of high-order phase correlations in texture processing. Vision Research 1996, 36(11):1615-1631.
112. Victor J.D., Conte M.M., Purpura K.P. Dynamic shifts of the contrast-response function. Visual Neuroscience 1997, 14:577-587.
113. Watson A.B., Solomon J.A. Model of visual contrast gain control and pattern masking. Journal of the Optical Society of America A 1997, 14:2379-2391.
114. Webb B.S., Dhruv N.T., Solomon S.G., Tailby C., Lennie P. Early and late mechanisms of surround suppression in striate cortex of macaque. The Journal of Neuroscience 2005, 25(50):11666-11675.
115. Wielaard J., Sajda P. Extraclassical phenomena and short-range connectivity in V1. Cerebral Cortex 2006, 16:1531-1545.
116. Wilson H.R. Discrimination of contour curvature: Data and theory. Journal of the Optical Society of America A 1985, 2:1191-1199.
117. Wilson H.R. Non-fourier cortical processes in texture, form, and motion perception. Cerebral cortex 1999, Vol. 13:999. Academic/Plenum Publishers, New York, Fig. 5 from this publication used in Fig. 7 here with kind permission from Springer Science+Business Media B.V.
118. Wilson H.R., Richards W.A. Mechanisms of curvature discrimination. Journal of the Optical Society of America A 1989, 6:106-115.
119. Wolfson S.S., Graham N. An unusual kind of contrast adaptation: Shifting a contrast-comparison level. Journal of Vision 2007, 7(8):12.
120. Wolfson S.S., Graham N. Two contrast adaptation processes: Contrast normalization and shifting, rectifying, contrast comparison. Journal of Vision 2009, 9(4):30.
121. Wolfson S.S., Landy M.S. Long range interactions between oriented texture elements. Vision Research 1999, 39:933-945.
122. Yu C., Klein S.A., Levi D.M. Cross- and Iso-oriented surrounds modulate the contrast response function: The effect of surround contrast. Journal of Vision 2003, 3:527-540.
123. Zenger-Landolt B., Koch C. Flanker effects in peripheral contrast discrimination. Psychophysics and modeling. Vision Research 2001, 41:3663-3675.
124. Zhaoping L. A neural model of contour integration in the primary visual cortex. Neural Computation 1998, 10:903-940.