Semantic control of feature extraction from natural scenes

Journal of Neuroscience

Volumn 34, Issue 6, 2014, Pages 2374-2388

  Neri, Peter ^a,b  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b PSL Research University   (France)

Author keywords

Inversion effect; Natural statistics; Noise image classification; Orientation tuning; Reverse correlation

Indexed keywords

ARTICLE; ATTENTION; AUDIOVISUAL EQUIPMENT; COMPUTER MODEL; DATA BASE; FEMALE; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; MALE; ORIENTATION; PRIORITY JOURNAL; RECOGNITION; SEMANTIC MEMORY; STIMULATION; TASK PERFORMANCE; VISUAL DISCRIMINATION LEARNING TEST;

INVERSION EFFECT; NATURAL STATISTICS; NOISE IMAGE CLASSIFICATION; ORIENTATION TUNING; REVERSE CORRELATION;

DISCRIMINATION (PSYCHOLOGY); HUMANS; ORIENTATION; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; SEMANTICS; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 84893435992     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.1755-13.2014     Document Type: Article

References (78)

1. Ahumada AJ Jr (2002) Classification image weights and internal noise level estimation. J Vis 2 (1): 121-131. CrossRef Medline
2. Allman J, Miezin F, McGuinness E (1985) Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. Annu Rev Neurosci 8: 407-430. CrossRef Medline
3. Arbelaez P, Hariharan B, Gu C, Gupta S, Bourdev L, Malik J (2012) Semantic segmentation using regions and parts. CVPR, IEEE Conference, June 2012.
4. Ban H, Yamamoto H, Hanakawa T, Urayama S, Aso T, Fukuyama H, Ejima Y (2013) Topographic representation of an occluded object and the effects of spatiotemporal context in human early visual areas. J Neurosci 33: 16992-17007. CrossRef Medline
5. Bar M (2004) Visual objects in context. Nat Rev Neurosci 5: 617-629. CrossRef Medline
6. Bartlett JC, Searcy J (1993) Inversion and configuration of faces. Cogn Psychol 25: 281-316. CrossRef Medline
7. Bex PJ, Solomon SG, Dakin SC (2009) Contrast sensitivity in natural scenes depends on edge as well as spatial frequency structure. J Vis 9 (10): 1-19. CrossRef Medline
8. Biederman I (1972) Perceiving real-world scenes. Science 177: 77-80. CrossRef Medline
9. Blake R, Shiffrar M (2007) Perception of human motion. Annu Rev Psychol 58: 47-73. CrossRef Medline
10. Bolz J, Gilbert CD (1986) Generation of end-inhibition in the visual cortex via interlaminar connections. Nature 320: 362-365. CrossRef Medline
11. Bonds AB (1989) Role of inhibition in the specification of orientation selectivity of cells in the cat striate cortex. Vis Neurosci 2: 41-55. CrossRef Medline
12. Bracewell RN (1965) The Fourier transform and its applications. New York: McGraw-Hill.
13. Bullier J (2001) Feedback connections and conscious vision. Trends Cogn Sci 5: 369-370. CrossRef Medline
14. Burr DC, Ross J (2002) Direct evidence that "speedlines" influence motion mechanisms. J Neurosci 22: 8661-8664. Medline
15. Carandini M, Demb JB, Mante V, Tolhurst DJ, Dan Y, Olshausen BA, Gallant JL, Rust NC (2005) Do we know what the early visual system does? J Neurosci 25: 10577-10597. CrossRef Medline
16. Chen G, Dan Y, Li CY (2005) Stimulation of non-classical receptive field enhances orientation selectivity in the cat. J Physiol 564: 233-243. CrossRef Medline
17. Coen-Cagli R, Dayan P, Schwartz O (2012) Cortical surround interactions and perceptual salience via natural scene statistics. PLoS Comput Biol 8: e1002405. CrossRef Medline
18. David SV, Vinje WE, Gallant JL (2004) Natural stimulus statistics alter the receptive field structure of v1 neurons. J Neurosci 24: 6991-7006. CrossRef Medline
19. Dobres J, Seitz AR (2010) Perceptual learning of oriented gratings as revealed by classification images. J Vis 10 (13): 8. CrossRef Medline
20. Felsen G, Dan Y (2005) A natural approach to studying vision. Nat Neurosci 8: 1643-1646. CrossRef Medline
21. Felsen G, Touryan J, Han F, Dan Y (2005) Cortical sensitivity to visual features in natural scenes. PLoS Biol 3: e342. CrossRef Medline
22. Geisler WS (1999) Motion streaks provide a spatial code for motion direction. Nature 400: 65-69. CrossRef Medline
23. Geisler WS (2008) Visual perception and the statistical properties of natural scenes. Annu Rev Psychol 59: 167-192. CrossRef Medline
24. Geisler WS (2011) Contributions of ideal observer theory to vision research. Vision Res 51: 771-781. CrossRef Medline
25. Gerhard HE, Wichmann FA, Bethge M (2013) How sensitive is the human visual system to the local statistics of natural images? PLoS Comput Biol 9: e1002873. CrossRef Medline
26. Gold JM, Mundy PJ, Tjan BS (2012) The perception of a face is no more than the sum of its parts. Psychol Sci 23: 427-434. CrossRef Medline
27. Green DM, Swets JA (1966) Signal detection theory and psychophysics. New York: Wiley.
28. Haslinger R, Pipa G, Lima B, Singer W, Brown EN, Neuenschwander S (2012) Context matters: the illusive simplicity of macaque V1 receptive fields. PLoS One 7: e39699. CrossRef Medline
29. Heeger DJ, Simoncelli EP, Movshon JA (1996) Computational models of cortical visual processing. Proc Natl Acad Sci U S A 93: 623-627. CrossRef Medline
30. Heeger DJ, Boynton GM, Demb JB, Seidemann E, Newsome WT (1999) Motion opponency in visual cortex. J Neurosci 19: 7162-7174. Medline
31. Hubel DH (1963) The visual cortex of the brain. Sci Am 209: 54-62. CrossRef Medline
32. Huth AG, Nishimoto S, Vu AT, Gallant JL (2012) A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron 76: 1210-1224. CrossRef Medline
33. Kelley TA, Chun MM, Chua KP (2003) Effects of scene inversion on change detection of targets matched for visual salience. J Vis 3 (1): 1-5. CrossRef Medline
34. Kveraga K, Boshyan J, Bar M (2007) Magnocellular projections as the trigger of top-down facilitation in recognition. J Neurosci 27: 13232-13240. CrossRef Medline
35. Lamme VA, Roelfsema PR (2000) The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci 23: 571-579. CrossRef Medline
36. Lee TS, Mumford D (2003) Hierarchical Bayesian inference in the visual cortex. J Opt Soc Am A Opt Image Sci Vis 20: 1434-1448. CrossRef Medline
37. Li FF, VanRullen R, Koch C, Perona P (2002) Rapid natural scene categorization in the near absence of attention. Proc Natl Acad Sci U S A 99: 9596-9601. CrossRef Medline
38. Maurer D, Grand RL, Mondloch CJ (2002) The many faces of configural processing. Trends Cogn Sci 6: 255-260. CrossRef Medline
39. McAdams CJ, Maunsell JH (1999) Effects of attention on orientationtuning functions of single neurons in macaque cortical area V4. J Neurosci 19: 431-441. Medline
40. McAdams CJ, Reid RC (2005) Attention modulates the responses of simple cells in monkey primary visual cortex. J Neurosci 25: 11023-11033. CrossRef Medline
41. Morgan MJ (2011) Features and the "primal sketch. Vision Res 51: 738-753. CrossRef Medline
42. Murray RF (2011) Classification images: a review. J Vis 11 (5): pii: 2. CrossRef Medline
43. Nagai M, Bennett PJ, Sekuler AB (2008) Exploration of vertical bias in perceptual completion of illusory contours: threshold measures and response classification. J Vis 8 (7): 25. 1-17. CrossRef Medline
44. Neri P (2009) Nonlinear characterization of a simple process in human vision. J Vis 9 (12): 1. 1-29. CrossRef Medline
45. Neri P (2011a) Coarse to fine dynamics of monocular and binocular processing in human pattern vision. Proc Natl Acad Sci U S A 108: 10726-10731. CrossRef Medline
46. Neri P (2011b) Global properties of natural scenes shape local properties of human edge detectors. Front Psychol 2: 172. Medline
47. Neri P (2013) The statistical distribution of noisy transmission in human sensors. J Neural Eng 10: 016014. CrossRef Medline
48. Neri P, Levi D (2009) Surround motion silences signals from samedirection motion. J Neurophysiol 102: 2594-2602. CrossRef Medline
49. Oliva A, Torralba A (2001) Modeling the shape of the scene: a holistic representation of the spatial envelope. Int J Comp Vis 42: 145-175. CrossRef
50. Paltoglou AE, Neri P (2012) Attentional control of sensory tuning in human visual perception. J Neurophysiol 107: 1260-1274. CrossRef Medline
51. Párraga CA, Troscianko T, Tolhurst DJ (2000) The human visual system is optimised for processing the spatial information in natural visual images. Curr Biol 10: 35-38. CrossRef Medline
52. Piotrowski LN, Campbell FW (1982) A demonstration of the visual importance and flexibility of spatial-frequency amplitude and phase. Perception 11: 337-346. CrossRef Medline
53. Preston TJ, Guo F, Das K, Giesbrecht B, Eckstein MP (2013) Neural representations of contextual guidance in visual search of real-world scenes. J Neurosci 33: 7846-7855. CrossRef Medline
54. Ramachandran VS, Gregory RL (1991) Perceptual filling in of artificially induced scotomas in human vision. Nature 350: 699-702. CrossRef Medline
55. Rao RP, Ballard DH (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2: 79-87. CrossRef Medline
56. Rauss K, Schwartz S, Pourtois G (2011) Top-down effects on early visual processing in humans: a predictive coding framework. Neurosci Biobehav Rev 35: 1237-1253. CrossRef Medline
57. Rieger JW, Köchy N, Schalk F, Grüschow M, Heinze HJ (2008) Speed limits: orientation and semantic context interactions constrain natural scene discrimination dynamics. J Exp Psychol Hum Percept Perform 34: 56-76. CrossRef Medline
58. Rolls ET, Aggelopoulos NC, Zheng F (2003) The receptive fields of inferior temporal cortex neurons in natural scenes. J Neurosci 23: 339-348. Medline
59. Rossion B, Gauthier I (2002) How does the brain process upright and inverted faces? Behav Cogn Neurosci Rev 1: 63-75. CrossRef Medline
60. Rousselet GA, Fabre-Thorpe M, Thorpe SJ (2002) Parallel processing in high-level categorization of natural images. Nat Neurosci 5: 629-630. Medline
61. Ruderman DL, Bialek W (1994) Statistics of natural images: scaling in the woods. Phys Rev Lett 73: 814-817. CrossRef Medline
62. Rust NC, Movshon JA (2005) In praise of artifice. Nat Neurosci 8: 1647-1650. CrossRef Medline
63. Schwartz O, Hsu A, Dayan P (2007) Space and time in visual context. Nat Rev Neurosci 8: 522-535. CrossRef Medline
64. Seber GAF, Wild CJ (2003) Nonlinear regression. New York: Wiley.
65. Sekuler AB, Gaspar CM, Gold JM, Bennett PJ (2004) Inversion leads to quantitative, not qualitative, changes in face processing. Curr Biol 14: 391-396. CrossRef Medline
66. Simoncelli EP, Olshausen BA (2001) Natural image statistics and neural representation. Annu Rev Neurosci 24: 1193-1216. CrossRef Medline
67. Smyth D, Willmore B, Baker GE, Thompson ID, Tolhurst DJ (2003) The receptive-field organization of simple cells in primary visual cortex of ferrets under natural scene stimulation. J Neurosci 23: 4746-4759. Medline
68. Sohoglu E, Peelle JE, Carlyon RP, Davis MH (2012) Predictive top-down integration of prior knowledge during speech perception. J Neurosci 32: 8443-8453. CrossRef Medline
69. Spillmann L (2006) From perceptive fields to Gestalt. Prog Brain Res 155: 67-92. Medline
70. Spratling MW (2010) Predictive coding as a model of response properties in cortical area V1. J Neurosci 30: 3531-3543. CrossRef Medline
71. Thompson P (1980) Margaret Thatcher: a new illusion. Perception 9: 483-484. CrossRef Medline
72. Torralba A, Oliva A (2003) Statistics of natural image categories. Network 14: 391-412. CrossRef Medline
73. Torralba A, Murphy KP, Freeman WT (2010) Using the forest to see the trees: exploiting context for visual object detection and localization. Commun ACM 53: 107-114. CrossRef
74. Ullman S (1996) High-level vision. Cambridge, MA: MIT.
75. Valentine T (1988) Upside-down faces: a review of the effect of inversion upon face recognition. Br J Psychol 79: 471-491. CrossRef Medline
76. Walther DB, Caddigan E, Fei-Fei L, Beck DM (2009) Natural scene categories revealed in distributed patterns of activity in the human brain. J Neurosci 29: 10573-10581. CrossRef Medline
77. Webster MA, Miyahara E (1997) Contrast adaptation and the spatial structure of natural images. J Opt Soc Am A Opt Image Sci Vis 14: 2355-2366. CrossRef Medline
78. Yin RK (1969) Looking at upside-down faces. J Exp Psychol 81: 141-145. CrossRef