Emergence of visual saliency from natural scenes via context-mediated probability distributions coding

PLoS ONE

Volumn 5, Issue 12, 2010, Pages

  Xu, Jinhua ^a,b   Yang, Zhiyong ^a   Tsien, Joe Z ^a  

^a MEDICAL COLLEGE OF GEORGIA   (United States)

^b EAST CHINA NORMAL UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; CONTROLLED STUDY; GAZE; HUMAN; INDEPENDENT COMPONENT ANALYSIS; MATHEMATICAL MODEL; PROBABILITY; VISUAL CORTEX; VISUAL DISCRIMINATION; VISUAL SALIENCY; VISUAL SYSTEM; ADULT; BIOLOGICAL MODEL; BRAIN MAPPING; CALIBRATION; METABOLISM; METHODOLOGY; NERVE CELL; PHYSIOLOGY; PRINCIPAL COMPONENT ANALYSIS; RECEIVER OPERATING CHARACTERISTIC; STATISTICAL MODEL; VIDEORECORDING; VISION;

ADULT; ALGORITHMS; BRAIN MAPPING; CALIBRATION; HUMANS; MODELS, BIOLOGICAL; MODELS, STATISTICAL; NEURONS; PRINCIPAL COMPONENT ANALYSIS; PROBABILITY; ROC CURVE; VIDEO RECORDING; VISION, OCULAR; VISUAL PERCEPTION;

EID: 78650850447     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0015796     Document Type: Article

References (51)

1. Albright TD, Stoner GR (2002) Contextual influences on visual processing. Annu Rev Neurosci 25: 339-379.
2. Carandini M, Demb JB, Mante V, Tolhurst DJ, Dan Y, et al. (2005) Do we know what the early visual system does? J Neurosci 25: 10577-10597.
3. Julesz B (1981) Textons, the elements of texture perception, and their interactions. Nature 290: 91-97.
4. Treisman AM, Gelade G (1980) A feature-integration theory of attention. Cog Psy 12: 97-136.
5. Wolf JM (2007) Guided search 4.0: Current progress with a model of visual search. In: Gray W, ed. Integrated models of cognitive systems: New York: Oxford. pp 99-119.
6. Itti L, Koch C (2001) Computational modelling of visual attention. Nature reviews Neuroscience 2: 194-203.
7. Felsen G, Dan Y (2005) A natural approach to studying vision. Nature neuroscience 8: 1643-1646.
8. Simoncelli EP (2003) Vision and the statistics of the visual environment. Curr Opin Neurobiol 13: 144-149.
9. Geisler WS (2008) Visual perception and the statistical properties of natural scenes. Annu Rev Psychol 59: 167-192.
10. Attneave F (1954) Some informational aspects of visual perception. Psychol Rev 61: 183-193.
11. Barlow H (2001) Redundancy reduction revisited. Network 12: 241-253.
12. Atick JJ (1992) Could information processing provide an ecological theory of sensory processing? Network 3: 213-251.
13. Field D (1994) What is the goal of sensory coding? Neural Comput 6: 559-601.
14. Simoncelli EP, Olshausen BA (2001) Natural image statistics and neural representation. Annu Rev Neurosci 24: 1193-1216.
15. Olshausen BA, Field DJ (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381: 607-609.
16. Bell AJ, Sejnowski TJ (1997) The ''independent components'' of natural scenes are edge filters. Vision Res 37: 3327-3338.
17. van Hateren JH, van der Schaaf A (1998) Independent component filters of natural images compared with simple cells in primary visual cortex. Proc Biol Sci 265: 359-366.
18. Hyvarinen A, Hoyer PO (2001) A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images. Vision Res 41: 2413-2423.
19. Kayser C, Kording KP, Konig P (2003) Learning the nonlinearity of neurons from natural visual stimuli. Neural Comput 15: 1751-1759.
20. Karklin Y, Lewicki MS (2009) Emergence of complex cell properties by learning to generalize in natural scenes. Nature 457: 83-86.
21. Vinje WE, Gallant JL (2000) Sparse coding and decorrelation in primary visual cortex during natural vision. Science 287: 1273-1276.
22. Olshausen BA, Field DJ (2005) How close are we to understanding v1? Neural Comput 17: 1665-1699.
23. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. Ieee Transactions on Pattern Analysis and Machine Intelligence 20: 1254-1259.
24. Itti L, Koch C (2000) A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Res 40: 1489-1506.
25. Li Z (2002) A saliency map in primary visual cortex. Trends Cogn Sci 6: 9-16.
26. Zhaoping L, May KA (2007) Psychophysical tests of the hypothesis of a bottomup saliency map in primary visual cortex. Plos Computational Biology 3: 616-633.
27. Koch C, Ullman S (1985) Shifts in selective visual attention: towards the underlying neural circuitry. Hum Neurobiol 4: 219-227.
28. Le Meur O, Le Callet P, Barba D, Thoreau D (2006) A coherent computational approach to model bottom-up visual attention. Ieee Transactions on Pattern Analysis and Machine Intelligence 28: 802-817.
29. Seo HJ, Milanfar P (2009) Static and space-time visual saliency detection by selfresemblance. J Vis 9: 15 11-27.
30. Bruce ND, Tsotsos JK (2009) Saliency, attention, and visual search: an information theoretic approach. J Vis 9: 5 1-24.
31. Zhang L, Tong MH, Marks TK, Shan H, Cottrell GW (2008) SUN: A Bayesian framework for saliency using natural statistics. J Vis 8: 32 31-20.
32. Gao D, Han S, Vasconcelos N (2009) Discriminant saliency, the detection of suspicious coincidences, and applications to visual recognition. IEEE Trans Pattern Anal Mach Intell 31: 989-1005.
33. Gao D, Vasconcelos N (2009) Decision-theoretic saliency: computational principles, biological plausibility, and implications for neurophysiology and psychophysics. Neural Comput 21: 239-271.
34. Itti L, Baldi P (2009) Bayesian surprise attracts human attention. Vision Res 49: 1295-1306.
35. Torralba A, Oliva A, Castelhano MS, Henderson JM (2006) Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychol Rev 113: 766-786.
36. van Hateren JH, Ruderman DL (1998) Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex. Proc Biol Sci 265: 2315-2320.
37. Hoyer PO, Hyvarinen A (2000) Independent component analysis applied to feature extraction from colour and stereo images. Network 11: 191-210.
38. Wachtler T, Lee TW, Sejnowski TJ (2001) Chromatic structure of natural scenes. Journal of the Optical Society of America A, Optics, image science, and vision 18: 65-77.
39. Caywood MS, Willmore B, Tolhurst DJ (2004) Independent components of color natural scenes resemble V1 neurons in their spatial and color tuning. J Neurophysiol 91: 2859-2873.
40. Olmos A, Kingdom FA (2004) McGill calibrated color image database.
41. Hyvarinen A (1999) Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans Neural Netw 10: 626-634.
42. DeAngelis GC, Ohzawa I, Freeman RD (1993) Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and post-natal development. J Neurophysiol 69: 1091-1117.
43. Rust NC, Schwartz O, Movshon JA, Simoncelli EP (2005) Spatiotemporal elements of macaque v1 receptive fields. Neuron 46: 945-956.
44. Tatler BW, Baddeley RJ, Gilchrist ID (2005) Visual correlates of fixation selection: effects of scale and time. Vision Res 45: 643-659.
45. Rao RPN, Ballard DH (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature neuroscience 2: 79-87.
46. Rao RP (2004) Bayesian computation in recurrent neural circuits. Neural Comput 16: 1-38.
47. Chen X, Han F, Poo MM, Dan Y (2007) Excitatory and suppressive receptive field subunits in awake monkey primary visual cortex (V1). Proc Natl Acad Sci U S A 104: 19120-19125.
48. Ma WJ, Beck JM, Latham PE, Pouget A (2006) Bayesian inference with probabilistic population codes. Nature neuroscience 9: 1432-1438.
49. Bruce NDB, Tsotsos JK (2006) Saliency based on information maximization. Advances in Neural Information Processing Systems. pp 155-162.
50. Gao D, Vasconcelos N (2007) Bottom-up saliency is a discriminant process. ICCV. Rio de Janeiro, Brazil.
51. Zhang L, Tong MH, Cottrell GW (2009) SUNDAy: Saliency using natural statistics for dynamic analysis of scenes. The 31st Annual Cognitive Science Conference. Amsterdam, Netherlands: Mahwah: Lawrence Erlbaum. pp 2944-2949.