From image statistics to scene gist: Evoked neural activity reveals transition from low-level natural image structure to scene category

Journal of Neuroscience

Volumn 33, Issue 48, 2013, Pages 18814-18824

  Groen, Iris I A ^a   Ghebreab, Sennay ^a   Prins, Hielke ^a   Lamme, Victor A F ^a   Steven Scholte, H ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; CONTRAST ENERGY; CONTRAST SENSITIVITY; DECISION MAKING; ELECTROENCEPHALOGRAPHY; EVOKED BRAIN STEM RESPONSE; FEMALE; FOURIER ANALYSIS; HUMAN; IMAGE PROCESSING; MALE; NERVE CELL; NEURAL ACTIVITY; PERCEPTIVE THRESHOLD; PRIORITY JOURNAL; REGRESSION ANALYSIS; SCENE; SCENE FRAGMENTATION; SENSITIVITY ANALYSIS; SPATIAL COHERENCE; VISION; VISUAL STIMULATION; VISUAL SYSTEM FUNCTION; VISUAL SYSTEM PARAMETERS; BIOLOGICAL MODEL; COMPUTER SIMULATION; ENVIRONMENT; EVOKED RESPONSE; EVOKED VISUAL RESPONSE; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; REACTION TIME; STATISTICAL ANALYSIS; YOUNG ADULT;

ADULT; COMPUTER SIMULATION; CONTRAST SENSITIVITY; DATA INTERPRETATION, STATISTICAL; ELECTROENCEPHALOGRAPHY; ENVIRONMENT; EVOKED POTENTIALS; EVOKED POTENTIALS, VISUAL; FEMALE; FOURIER ANALYSIS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MALE; MODELS, NEUROLOGICAL; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84888255911     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.3128-13.2013     Document Type: Article

References (72)

1. Baddeley R (1997) The correlational structure of natural images and the calibration of spatial representations. Cogn Sci 21:351-372. CrossRef
2. Bankó EM, Gál V, Körtvélyes J, KovácsG, Vidnyánsky Z (2011) Dissociating the effect of noise on sensory processing and overall decision difficulty. J Neurosci 31:2663-2674. CrossRef Medline
3. Bieniek MM, Pernet CR, Rousselet GA (2012) Early ERPs to faces and objects are driven by phase, not amplitude spectrum information: evidence from parametric, test-retest, single-subject analyses. J Vis 12:1-24. CrossRef Medline
4. Blank H, Biele G, Heekeren HR, Philiastides MG (2013) Temporal characteristics of the influence of punishment on perceptual decision making in the human brain. J Neurosci 33:3939-3952. CrossRef Medline
5. Bonin V, Mante V, CarandiniM (2005) The suppressive field of neurons in lateral geniculate nucleus. J Neurosci 25:10844-10856. CrossRef Medline
6. Conroy B, Sajda P (2012) Fast, exact model selection and permutation testing for L2-regularized logistic regression. In: Proceedings of the 15th International Conference on Artificial Intelligence and Statistics, pp 246-254. La Palma, Canary Islands.
7. Croner LJ, Kaplan E (1995) Receptive fields of P andMganglion cells across the primate retina. Vision Res 35:7-24. CrossRef Medline
8. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) ImageNet: a largescale hierarchical image database. IEEE Conf Comput Vis Pattern Recognit 248-255.
9. De Valois RL, De Valois KK (1990) Spatial vision. New York: Oxford UP.
10. Duda R, Hart P, Stork D (2001) Pattern classification. New York: Wiley.
11. Einhäuser W, Rutishauser U, Frady EP, Nadler S, König P, Koch C (2006) The relation of phase noise and luminance contrast to overt attention in complex visual stimuli. J Vis 6:1148-1158. CrossRef Medline
12. Elder JH, Zucker SW (1998) Local scale control for edge detection and blur estimation. IEEE Trans Pattern Anal Mach Intell 20:699-716. CrossRef
13. Fei-Fei L, Iyer A, Koch C, Perona P (2007) What do we perceive in a glance of a real-world scene? J Vis 7:10. CrossRef Medline
14. Field DJ (1987) Relations between the statistics of natural images and the response properties of cortical cells. J Opt SocAm4:2379-2394. CrossRef Medline
15. Gaspar CM, Rousselet GA (2009) How do amplitude spectra influence rapid animal detection? Vision Res 49:3001-3012. CrossRef Medline
16. Geusebroek JM, SmeuldersAWM (2002) A physical explanation for natural image statistics. In: Paper presented at the 2nd International Workshop on Texture Analysis, Heriot-Watt University.
17. Ghebreab S, Smeulders AWM, Scholte HS, Lamme VAF (2009) A biologically plausible model for rapid natural image identification. In: Advances in Neural Information Processing Systems 22, pp 629-637.
18. Goffaux V, Jacques C, Mouraux A, Oliva A, Schyns PPG, Rossion B (2005) Diagnostic colours contribute to the early stages of scene categorization: behavioural and neurophysiological evidence. Vis Cogn 12:878-892. CrossRef
19. Graham N (1979) Does the brain perform a Fourier analysis of the visual scene? Trends Neurosci 2:207-208. CrossRef
20. Gratton G, Coles MG, Donchin E (1983) A new method for off-line removal of ocular artifact. Electroencephalogr Clin Neurophysiol 55:468-484. CrossRef Medline
21. Greene MR, Oliva A (2009a) Recognition of natural scenes from global properties: seeing the forest without representing the trees. Cogn Psychol 58:137-176. CrossRef Medline
22. Greene MR, Oliva A (2009b) The briefest of glances: the time course of natural scene understanding. Psychol Sci 20:464-472. CrossRef Medline
23. Groen II A, Ghebreab S, Lamme VAF, Scholte HS (2012a) Spatially pooled contrast responses predict neural and perceptual similarity of naturalistic image categories. PLoS Comput Biol 8:e1002726. CrossRef Medline
24. Groen II A, Ghebreab S, Lamme VAF, Scholte HS (2012b) Low-level contrast statistics are diagnostic of invariance of natural textures. Front Comput Neurosci 6:34. CrossRef Medline
25. Hansen BC, Jacques T, Johnson AP, Ellemberg D (2011) From spatial frequency contrast to edge preponderance: the differential modulation of early visual evoked potentials by natural scene stimuli. Vis Neurosci 28: 221-237. CrossRef Medline
26. Hansen BC, Johnson AP, Ellemberg D (2012) Different spatial frequency bands selectively signal for natural image statistics in the early visual system. J Neurophysiol 108:2160-2172. CrossRef Medline
27. Hegdé J (2008) Time course of visual perception: coarse-to-fine processing and beyond. Prog Neurobiol 84:405-439. CrossRef Medline
28. Hochstein S, Ahissar M (2002) View from the top: hierarchies and reverse hierarchies in the visual system. Neuron 36:791-804. CrossRef Medline
29. Intraub H (1981) Rapid conceptual identification of sequentially presented pictures. J Exp Psychol Hum Percept Perform 7:604-610. CrossRef
30. Jegou H, Douze M, Schmid C (2008) Hamming embedding and weak geometric consistency for large scale image search. In: Proceedings of the 10th European conference on Computer Vision, pp 304-317.
31. Johnson JS, Olshausen BA (2003) Timecourse of neural signatures of object recognition. J Vis 3:499-512. CrossRef Medline
32. Joubert OR, Rousselet GA, Fize D, Fabre-ThorpeM (2007) Processing scene context: fast categorization and object interference. Vision Res 47:3286-3297. CrossRef Medline
33. Joubert OR, Rousselet GA, Fabre-Thorpe M, Fize D (2009) Rapid visual categorization of natural scene contexts with equalized amplitude spectrum and increasing phase noise. J Vis. 9:2 1-16. CrossRef Medline
34. Kadar I, Ben-Shahar O (2012) A perceptual paradigm and psychophysical evidence for hierarchy in scene gist processing. J Vis 12:1-17. CrossRef Medline
35. Kahn DA, Harris AM, Wolk DA, Aguirre GK (2010) Temporally distinct neural coding of perceptual similarity and prototype bias. J Vis 10:1-12. CrossRef Medline
36. Kaping D, Tzvetanov T, Treue S (2007) Adaptation to statistical properties of visual scenes biases rapid categorization. Vis Cogn 15:12-19. CrossRef
37. Koenderink JJ, van de Grind WA, BoumanMA (1972) Opponent color coding: a mechanistic model and a new metric for color space. Kybernetik 10:78-98. CrossRef Medline
38. Loschky LC, LarsonAM (2008) Localized information is necessary for scene categorization, including the Natural/Man-made distinction. J Vis 8:1-9. CrossRef Medline
39. Loschky LC, Larson AM (2010) The natural/man-made distinction is made before basic-level distinctions in scene gist processing. Vis Cogn 18:513-536. CrossRef
40. Loschky LC, Sethi A, Simons DJ, Pydimarri TN, Ochs D, Corbeille JL (2007) The importance of information localization in scene gist recognition. J Exp Psychol Hum Percept Perform 33:1431-1450. CrossRef Medline
41. Luck SJ, Woodman GF, Vogel EK (2000) Event-related potential studies of attention. Trends Cogn Sci 4:432-440. CrossRef Medline
42. Martinovic J, Mordal J, Wuerger SM (2011) Event-related potentials reveal an early advantage for luminance contours in the processing of objects. J Vis 11:1-15. CrossRef Medline
43. McCotter M, Gosselin F, Sowden P, Schyns PG (2005) The use of visual information in natural scenes. Vis Cogn 12:938-953. CrossRef
44. Oliva A (2005) Gist of the scene. In: Encyclopedia of neurobiology of attention (Itti L, Rees G, Tsotsos JK, eds.), pp 251-256. San Diego: Elsevier.
45. Oliva A, Schyns PG (2000) Diagnostic colors mediate scene recognition. Cogn Psychol 41:176-210. CrossRef Medline
46. Oliva A, Torralba A (2001) Modeling the shape of the scene: a holistic representation of the spatial envelope. Int J Comput Vis 42:145-175. CrossRef
47. Oliva A, Torralba AB, Guerin-Dugue A, Herault J (1999) Global semantic classification of scenes using power spectrum templates. In: Proceedings of the Challenge of Image Retrieval, Electronic Workshops in Computing Series. Newcastle: Springer.
48. Olmos A, Kingdom FA (2004) A biologically inspired algorithm for the recovery of shading and reflectance images. Perception 33:1463-1473. CrossRef Medline
49. Opelt A, Pinz A, Fussenegger M, Auer P (2006) Generic object recognition with boosting. IEEE Trans Pattern Anal Mach Intell 28:416-431. CrossRef Medline
50. Parra L, Alvino C, Tang A, Pearlmutter B, Yeung N, Osman A, Sajda P (2002) Linear spatial integration for single-trial detection in encephalography. Neuroimage 230:223-230. Medline
51. Perrin F, Pernier J, Bertrand O, Echallier JF (1989) Spherical splines for scalp potential and current density mapping. Electroencephalogr Clin Neurophysiol 72:184-187. CrossRef Medline
52. Philiastides MG, Sajda P (2006) Temporal characterization of the neural correlates of perceptual decision making in the human brain. Cereb Cortex 16:509-518. CrossRef Medline
53. Philiastides MG, Ratcliff R, Sajda P (2006) Neural representation of task difficulty and decision making during perceptual categorization: a timing diagram. J Neurosci 26:8965-8975. CrossRef Medline
54. Potter MC (1975) Meaning in visual search. Science 187:965-966. CrossRef Medline
55. Ratcliff R, Philiastides MG, Sajda P (2009) Quality of evidence for perceptual decision making is indexed by trial-to-trial variability of the EEG. Proc Natl Acad Sci U S A 106:6539-6544. CrossRef Medline
56. Renninger LW, Malik J (2004) When is scene identification just texture recognition? Vision Res 44:2301-2311. CrossRef Medline
57. Rousselet GA, Joubert OR, Fabre-Thorpe M (2005) How long to get to the "gist" of real-world natural scenes? Vis Cogn 12:852-877. CrossRef
58. Rousselet GA, Husk JS, Bennett PJ, Sekuler AB (2008a) Time course and robustness of ERP object and face differences. J Vis 8:1-18. CrossRef Medline
59. Rousselet GA, Pernet CR, Bennett PJ, Sekuler AB (2008b) Parametric study of EEG sensitivity to phase noise during face processing. BMC Neurosci 9:98. CrossRef Medline
60. Rousselet GA, Gaspar CM, Wieczorek KP, Pernet CR (2011) Modeling single-trial ERP reveals modulation of bottom-up face visual processing by top-down task constraints (in some subjects). Front Psychol 2:1-19. CrossRef Medline
61. Scholte HS, Witteveen SC, Spekreijse H, LammeVA (2006) The influence of inattention on the neural correlates of scene segmentation. Brain Res 1076:106-115. CrossRef Medline
62. Scholte HS, Ghebreab S, Waldorp L, Smeulders AWM, Lamme VAF (2009) Brain responses strongly correlate with Weibull image statistics when processing natural images. J Vis 9:1-15. CrossRef Medline
63. Schyns PG, Oliva A (1994) From blobs to boundary edges: evidence for time and spatial-scale-dependent scene recognition. Psychol Sci 5:195-200. CrossRef
64. Simoncelli EP (1999) Modeling the joint statistics of images in the wavelet domain. Proc SPIE D:188-195.
65. Tadmor Y, Tolhurst DJ (2000) Calculating the contrasts that retinal ganglion cells and LGN neurones encounter in natural scenes. Vision Res 40:3145-3157. CrossRef Medline
66. Thorpe S, Fize D, Marlot C (1996) Speed of processing in the human visual system. Nature 381:520-522. CrossRef Medline
67. Torralba A (2003) Contextual priming for object detection. Int J Comput Vis 53:169-191. CrossRef
68. Torralba A, Oliva A (2003) Statistics of natural image categories. Network 14:391-412. Medline
69. Walther DB, Caddigan E, Fei-Fei L, Beck DM (2009) Natural scene categories revealed in distributed patterns of activity in the human brain. J Neurosci 29:10573-10581. CrossRef Medline
70. Wichmann FA, Braun DI, Gegenfurtner KR (2006) Phase noise and the classification of natural images. Vision Res 46:1520-1529. CrossRef Medline
71. Wolfe JM, Võ ML, Evans KK, Greene MR (2011) Visual search in scenes involves selective and nonselective pathways. Trends Cogn Sci 15:77-84. CrossRef Medline
72. Zhu SC, Mumford D (1997) Prior learning and Gibbs reaction-diffusion. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp 1236-1250.