Processing of complex stimuli and natural scenes in the visual cortex

Current Opinion in Neurobiology

Volumn 14, Issue 4, 2004, Pages 468-473

  Kayser, Christoph ^a   Körding, Konrad P ^b   König, Peter ^c  

^a Institute of Neuroinformatics Zurich   (Switzerland)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF OSNABRÜCK   (Germany)

Author keywords

nCRF; non classical receptive field; primary visual cortex; receptive field; RF; V1

Indexed keywords

BAYES THEOREM; CELL ACTIVATION; DEPTH PERCEPTION; LATERAL GENICULATE NUCLEUS; LUMINANCE; NERVE CELL NETWORK; NONHUMAN; PRIORITY JOURNAL; PSYCHOPHYSICS; RECEPTIVE FIELD; REVIEW; SIGNAL PROCESSING; TASK PERFORMANCE; VISION; VISUAL CORTEX; VISUAL STIMULATION;

ANIMALS; ARTIFACTS; HUMANS; MODELS, NEUROLOGICAL; NEURONS; NEUROPHYSIOLOGY; PHOTIC STIMULATION; VISUAL CORTEX; VISUAL FIELDS; VISUAL PATHWAYS; VISUAL PERCEPTION;

EID: 4043092727     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2004.06.002     Document Type: Review

References (47)

1. Barlow H: Possible principles underlying the transformation of sensory messages. In Sensory Communication. Edited by WA Rosenblinth. Cambridge, MA: M.I.T. Press; 1961: 217-234.
2. Lettvin J.Y., Maturana H.R., McCulloch W.S., Pitts W.R. What the frog's eye tells the frog's brain. Proc IRE. 47:1959;1940-1950
3. Hubel D., Wiesel T.N. Receptive fields of single neurons in the cat's striate cortex. J Physiol. 148:1959;574-591
4. Riesenhuber M., Poggio T. Hierarchical models of object recognition in cortex. Nat Neurosci. 2:1999;1019-1025
5. Li F.F., VanRullen R., Koch C., Perona P. Rapid natural scene categorization in the near absence of attention. Proc Natl Acad Sci USA. 99:2002;9596-9601 This study demonstrates that natural images can be categorized even when the subject is simultaneously solving another demanding task. Such parallel discrimination does not work for simple stimuli. This supports the notion that the processing of natural scenes is qualitatively different to that of classical stimuli.
6. Braun J. Natural scenes upset the visual applecart. Trends Cogn Sci. 7:2003;7-9
7. Simoncelli E.P. Vision and the statistics of the visual environment. Curr Opin Neurobiol. 13:2003;144-149
8. Simoncelli E.P., Olshausen B.A. Natural image statistics and neural representation. Annu Rev Neurosci. 24:2001;1193-1216
9. Touryan J., Dan Y. Analysis of sensory coding with complex stimuli. Curr Opin Neurobiol. 11:2001;443-448
10. de Boer E., Kuyper P. Triggered correlation. IEEE Trans Biomed Eng. 15:1968;169-179
11. Stevens J.K., Gerstein G.L. Spatiotemporal organization of cat lateral geniculate receptive fields. J Neurophysiol. 39:1976;213-238
12. Cai D., DeAngelis G.C., Freeman R.D. Spatiotemporal receptive field organization in the lateral geniculate nucleus of cats and kittens. J Neurophysiol. 78:1997;1045-1061
13. DeAngelis G.C., Ohzawa I., Freeman R.D. Receptive-field dynamics in the central visual pathways. Trends Neurosci. 18:1995;451-458
14. Theunissen F.E., David S.V., Singh N.C., Hsu A., Vinje W.E., Gallant J.L. Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli. Network. 12:2001;289-316
15. Ringach D.L., Hawken M.J., Shapley R. Receptive field structure of neurons in monkey primary visual cortex revealed by stimulation with natural image sequences. J Vis. 2:2002;12-24 This study provides a technique to map RFs using complex stimuli and uses this to demonstrate that the RFs of simple and complex cells can be estimated using natural movie sequences.
16. Stanley G.B. Adaptive spatiotemporal receptive field estimation in the visual pathway. Neural Comput. 14:2002;2925-2946
17. Smyth D., Willmore B., Baker G.E., Thompson I.D., Tolhurst D.J. The receptive-field organization of simple cells in primary visual cortex of ferrets under natural scene stimulation. J Neurosci. 23:2003;4746-4759 The authors demonstrate that the tuning preferences of simple cells in V1 are the same when determined using gratings or natural images. Using RF maps to predict responses to natural stimuli, this study reveals the influence of contextual effects and nonlinearities that were not present during stimulation with classical stimuli.
18. Sharpee T., Rust N.C., Bialek W. Analyzing neural responses to natural signals: maximally informative dimensions. Neural Comput. 16:2004;223-250
19. Willmore B., Smyth D. Methods for first-order kernel estimation: simple-cell receptive fields from responses to natural scenes. Network. 14:2003;553-577
20. Allman J., Miezin F., McGuinness E. Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. Annu Rev Neurosci. 8:1985;407-430
21. Fitzpatrick D. Seeing beyond the receptive field in primary visual cortex. Curr Opin Neurobiol. 10:2000;438-443
22. Jones H.E., Wang W., Sillito A.M. Spatial organization and magnitude of orientation contrast interactions in primate V1. J Neurophysiol. 88:2002;2796-2808 The authors present a thorough analysis of center-surround interactions in V1. The results suggest that V1 cells have a greater preference for the orientation context defined by the positioning of several features within the nCRF than for single orientations. Thus, V1 cells are more than just an edge detector.
23. Touryan J., Lau B., Dan Y. Isolation of relevant visual features from random stimuli for cortical complex cells. J Neurosci. 22:2002;10811-10818 In this study, the reverse correlation technique is adapted specifically to use with orientation selective cells in primary visual cortex. This allows separation of the effects of optimal and null features and investigation of their interaction. The responses of complex cells can be quantitatively described by a combination of additive and divisive interactions.
24. Vinje W.E., Gallant J.L. Sparse coding and decorrelation in primary visual cortex during natural vision. Science. 287:2000;1273-1276
25. Vinje W.E., Gallant J.L. Natural stimulation of the nonclassical receptive field increases information transmission efficiency in V1. J Neurosci. 22:2002;2904-2915
26. Weliky M., Fiser J., Hunt R.H., Wagner D.N. Coding of natural scenes in primary visual cortex. Neuron. 37:2003;703-718 On the basis of classical tuning properties of V1 cells, the authors predict the responses of single cells and larger populations of neurons to natural images. The population responses better predict the local image contrast and thus provide a linear code that can easily read out at the next processing stage.
27. Adelson E.H., Bergen J.R. Spatiotemporal energy models for the perception of motion. J Opt Soc Am. A2:1985;284-299
28. Kayser C., Salazar R.F., König P. Responses to natural scenes in cat V1. J Neurophysiol. 90:2003;1910-1920 This study shows that population responses in V1 of awake cats are not sensitive to the higher order structure of the stimulus. However, the responses to classical drifting gratings differ quantitatively and qualitatively from those to complex stimuli and, thus, results obtained using gratings should only be carefully extrapolated to everyday conditions.
29. Oram M.W., Foldiak P., Perrett D.I., Sengpiel F. The 'ideal' homunculus: decoding neural population signals. Trends Neurosci. 6:1998;259-265
30. Lee T.S., Mumford D. Hierarchical Bayesian inference in the visual cortex. J Opt Soc Am A Opt Image Sci Vis. 20:2003;1434-1448
31. Srivastava A., Lee A.B., Simoncelli E.P., Zhu S.C. On advances in statistical modeling of natural images. J Math Imaging Vis. 18:2003;17-33
32. Olshausen B.A., Field D.J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature. 381:1996;607-609
33. Caywood M.S., Willmore B., Tolhurst D.J. Independent components of color natural scenes resemble V1 neurons in their spatial and color tuning. J Neurophysiol. 91:2004;2859-2873
34. Wiskott L., Sejnowski T.J. Slow feature analysis: unsupervised learning of invariances. Neural Comput. 14:2002;715-770
35. Körding K.P., Kayser C., Einhauser W., König P. How are complex cell properties adapted to the statistics of natural stimuli? J Neurophysiol. 91:2004;206-212
36. Kayser C., Körding K.P., König P. Learning the nonlinearity of neurons from natural visual stimuli. Neural Comput. 15:2003;1751-1759
37. Karklin Y., Lewicki M.S. Learning higher-order structures in natural images. Network. 14:2003;483-499
38. Lau B., Stanley G.B., Dan Y. Computational subunits of visual cortical neurons revealed by artificial neural networks. Proc Natl Acad Sci USA. 99:2002;8974-8979
39. Logothetis N.K., Pauls J., Poggio T. Shape representation in the inferior temporal cortex of monkeys. Curr Biol. 5:1995;552-563
40. Rainer G, Lee H, Logothetis NK: The effect of learning on the function of monkey extrastriate visual cortex. PLoS Biol 2004, 2:E44. The authors trained monkeys to discriminate among natural images that were degraded by noise. In V4, the authors recorded many neurons for which training selectively enhanced the responses to degraded stimuli and increased the amount of information about the stimulus extracted by these cells. These results support the notion that sensory neurons optimally adapt to the particular task they are involved in.
41. Körding K.P., Wolpert D.M. Bayesian integration in sensorimotor learning. Nature. 427:2004;244-247
42. Weiss Y., Simoncelli E.P., Adelson E.H. Motion illusions as optimal percepts. Nat Neurosci. 5:2002;598-604 Using a psychophysical motion discrimination task, the authors compare the subject's performance to an optimal Bayesian estimator. If the Bayesian model is equipped with a preference for slow speeds, it correctly reproduces a large amount of behavioral data including illusions. This demonstrates that Bayesian models can be successful at modeling behavioral performance.
43. Long F., Purves D. Natural scene statistics as the universal basis of color context effects. Proc Natl Acad Sci USA. 100:2003;15190-15193
44. Howe C.Q., Purves D. Range image statistics can explain the anomalous perception of length. Proc Natl Acad Sci USA. 99:2002;13184-13188
45. Hansen B.C., Essock E.A., Zheng Y., DeFord J.K. Perceptual anisotropies in visual processing and their relation to natural image statistics. Network. 14:2003;501-526
46. VanRullen R., Thorpe S.J. Is it a bird? Is it a plane? Ultra-rapid visual categorisation of natural and artifactual objects. Perception. 30:2001;655-668
47. Rousselet G.A., Fabre-Thorpe M., Thorpe S.J. Parallel processing in high-level categorization of natural images. Nat Neurosci. 5:2002;629-630