A model of proto-object based saliency

Vision Research

Volumn 94, Issue , 2014, Pages 1-15

  Russell, Alexander F ^a   Mihalaş, Stefan ^b,c   von der Heydt, Rudiger ^b,c   Niebur, Ernst ^b,c   Etienne Cummings, Ralph ^a  

^a Johns Hopkins University   (United States)

^b JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Attention; Gestalt; Proto object; Saliency

Indexed keywords

ARTICLE; CLASSIFICATION ALGORITHM; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; EYE FIXATION; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; OPTICAL RESOLUTION; PERFORMANCE MEASUREMENT SYSTEM; PREDICTIVE VALUE; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; RECEIVER OPERATING CHARACTERISTIC; RESPONSE TIME; SELECTIVE ATTENTION; SPATIAL ANALYSIS; STIMULUS RESPONSE; VISUAL STIMULATION;

ATTENTION; GESTALT; PROTO-OBJECT; SALIENCY;

ADULT; ALGORITHMS; ATTENTION; EYE MOVEMENTS; FIXATION, OCULAR; HUMANS; MODELS, THEORETICAL; PHOTIC STIMULATION; VISUAL PERCEPTION;

EID: 84888036511     PISSN: 00426989     EISSN: 18785646     Source Type: Journal    
DOI: 10.1016/j.visres.2013.10.005     Document Type: Article

References (113)

1. Adelson E.H., Bergen J.R. Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America - A 1985, 2:284-299.
2. Ardila D., Mihalas S., von der Heydt R., Niebur E. Medial axis generation in a model of perceptual organization. 46th Annual conference on information sciences and systems 2012, 1-4. IEEE Press.
3. Awh E., Belopolsky A., Theeuwes J. Top-down versus bottom-up attentional control: A failed theoretical dichotomy. Trends in Cognitive Sciences 2012, 16(8):437-443.
4. Basso M.A., Wurtz R.H. Modulation of neuronal activity in superior colliculus by changes in target probability. The Journal of Neuroscience 1998, 18:7519-7534.
5. Beauchamp M.S., Petit L., Ellmore T.M., Ingeholm J., Haxby J.V. A parametric fMRI study of overt and covert shifts of visuospatial attention. Neuroimage 2001, 14(2):310-321.
6. Bisley J.W., Goldberg M.E. Neuronal activity in the lateral intraparietal area and spatial attention. Science 2003, 299:81-86.
7. Borji A., Sihite D.N., Itti L. Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study. IEEE Transactions on Image Processing 2012.
8. Borji A., Sihite D.N., Itti L. Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study. In Proc European conference on computer vision (ECCV) 2013, 22(1):55-69. Epub 2012 Jul 30. 10.1109/TIP.2012.2210727.
9. Brincat S.L., Connor C.E. Underlying principles of visual shape selectivity in posterior inferotemporal cortex. Nature Neuroscience 2004, 7:880-886.
10. Broadbent D.E. Perception and communication 1958, Pergamon, London.
11. Cave K.R., Bichot N.P. Visuospatial attention: Beyond a spotlight model. Psychonomic Bulletin & Review 1999, 6:204-223.
12. Constantinidis C., Steinmetz M.A. Posterior parietal cortex automatically encodes the location of salient stimuli. The Journal of Neuroscience 2005, 25:233-238.
13. Corbetta M., Akbudak E., Conturo T.E., Snyder A.Z., Ollinger J.M., Drury H.A., et al. A common network of functional areas for attention and eye movements. Neuron 1998, 21:761-773.
14. Craft E., Schütze H., Niebur E., von der Heydt R. A neural model of figure-ground organization. Journal of Neurophysiology 2007, 97(6):4310-4326.
15. Doi, E., & Lewicki, M. S. (2005). Relations between the statistical regularities of natural images and the response properties of the early visual system. In Japanese cognitive science society, Kyoto University, July 2005 (pp. 1-8).
16. Duncan J. Selective attention and the organization of visual information. Journal of Experimental Psychology: General 1984, 113:501-517.
17. Egly R., Driver J., Rafal R.D. Shifting visual attention between objects and locations: Evidence from normal and parietal lesion subjects. Journal of Experimental Psychology: General 1994, 123:161-177.
18. Einhauser W., Spain M., Perona P. Objects predict fixations better than early saliency. Journal of Vision 2008, 8(14):1-26.
19. Elazary L., Itti L. Interesting objects are visually salient. Journal of Vision 2008, 8:1-15.
20. Gallant J.L., Connor C.E., Rakshit S., Lewis J.W., Van Essen D.C. Neural responses to polar, hyperbolic, and Cartesian gratings in area v4 of the macaque monkey. Journal of Neurophysiology 1996, 76(4):2718-2739.
21. Garcia-Diaz A., Fdez-Vidal X.R., Pardo X.M., Dosil R. Saliency from hierarchical adaptation through decorrelation and variance normalization. Image and Vision Computing 2012, 30(1):51-64.
22. Garcia-Diaz A., Leborn V., Fdez-Vidal X.R., Pardo X.M. On the relationship between optical variability, visual saliency, and eye fixations: A computational approach. Journal of Vision 2012, 12(6):17.
23. Graham D.J., Chandler D.M., Field D.J. Decorrelation and response equalization with center-surround receptive fields. Journal of Vision 2004, 4(8):276.
24. Green D.M., Swets J.A. Signal detection theory and psychophysics 1966, John Wiley, New York.
25. Hafed Z.M., Clark J.J. Microsaccades as an overt measure of covert attention shifts. Vision Research 2002, 42(22):2533-2545. cited By (since 1996) 72.
26. Harel J., Koch C., Perona P. Graph-based visual saliency. NIPS 2007, 545-552. MIT Press, Cambridge, MA. B. Schölkopf, J. Platt, T. Hoffman (Eds.).
27. He Z.J., Nakayama K. Visual attention to surfaces in three-dimensional space. Proceedings of the National Academy of Sciences of the United States of America 1995, 92:11155-11159.
28. Hoffman J.E., Subramaniam B. The role of visual attention in saccadic eye movements. Perception & Psychophysics 1995, 57(6):787-795.
29. Hou, X., & Zhang, L. (2008). Dynamic visual attention: Searching for coding length increments, In NIPS (pp. 681-688).
30. Ho M.C., Yeh S.L. Effects of instantaneous object input and past experience on object-based attention. Acta Psychologica (Amst) 2009, 132:31-39.
31. Ito M., Gilbert C.D. Attention modulates contextual influences in the primary visual cortex of alert monkeys. Neuron 1999, 22:593-604.
32. Itti, L., & Baldi, P. (2005). A principled approach to detecting surprising events in video. In IEEE proc. CVPR, Washington, DC, September 2005 (Vol. 1, pp. 631-637).
33. Itti L., Baldi P. Bayesian surprise attracts human attention. NIPS 2006, Vol. 18:1-8. MIT Press, Cambridge, MA.
34. Itti L., Koch C. Computational modeling of visual attention. Nature Reviews Neuroscience 2001, 2(3):194-203.
35. Itti L., Koch C. Feature combination strategies for saliency-based visual attention systems. Journal of Electronic Imaging 2001, 10:161-169.
36. Itti L., Koch C., Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE PAMI 1998, 20(11):1254-1259.
37. Johnson J.S., Olshausen B.A. Timecourse of neural signatures of object recognition. Journal of Vision 2003, 3(7):499-512.
38. Jones J.P., Palmer A. An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. Journal of Neurophysiology 1987, 58(6):1233-1258.
39. Kanizsa G. Organization in vision: Essays on Gestalt perception 1979, Praeger Publishers, New York, NY.
40. Kastner S., McMains S.A. Out of the spotlight: Face to face with attention. Nature Neuroscience 2007, 10:1344-1345.
41. Kimchi R., Yeshurun Y., Cohen-Savransky A. Automatic, stimulus-driven attentional capture by objecthood. Psychonomic Bulletin & Review 2007, 14:166-172.
42. Koch K., McLean J., Berry M., Sterling P., Balasubramanian V., Freed M.A. Efficiency of information transmission by retinal ganglion cells. Current Biology 2004, 14(17):1523-1530.
43. Koch C., Ullman S. Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology 1985, 4:219-227.
44. Koene A.R., Zhaoping L. Feature-specific interactions in salience from combined feature contrasts: Evidence for a bottom-up saliency map in v1. Journal of Vision 2007, 7(7):6.
45. Koffka K. Principles of Gestalt psychology 1935, Hartcourt, NY.
46. Kootstra G., de Boer B., Schomaker L. Predicting eye fixations on complex visual stimuli using local symmetry. Cognitive Computation 2011, 3(1):223-240. ISSN 1866-9956.
47. Kowler E., Anderson E., Dosher B., Blaser E. The role of attention in the programming of saccades. Vision Research 1995, 35(13):1897-1916.
48. Kulikowski J., Marcelja S., Bishop P. Theory of spatial position and spatial frequency relations in the receptive fields of simple cells in the visual cortex. Biological Cybernetics 1982, 43:187-198.
49. Kustov A.A., Robinson D.L. Shared neural control of attentional shifts and eye movements. Nature 1996, 384(6604):74-77.
50. Kusunoki M., Gottlieb J., Goldberg M.E. The lateral intraparietal area as a salience map: The representation of abrupt onset, stimulus motion, and task relevance. Vision Research 2000, 40:1459-1468.
51. Li Z. Primary cortical dynamics for visual grouping. Theoretical aspects of neural computation 1998, 154-164. Springer-Verlag. K.M. Wong, I. King, D.Y. Yeung (Eds.).
52. Marcelja S. Mathematical description of the responses of simple cortical cells. Journal of the Optical Society of America 1980, 70:1297-1300.
53. Masciocchi C.M., Mihalas S., Parkhurst D., Niebur E. Everyone knows what is interesting: Salient locations which should be fixated. Journal of Vision 2009, 9(11):25.1-22.
54. Matsukura M., Vecera S.P. The return of object-based attention: Selection of multiple-region objects. Perception & Psychophysics 2006, 68:1163-1175.
55. Mazer J.A., Gallant J.L. Goal-related activity in v4 during free viewing visual search. evidence for a ventral stream visual salience map. Neuron 2003, 40(6):1241-1250.
56. McPeek R.M., Keller E.L. Saccade target selection in the superior colliculus during a visual search task. Journal of Neurophysiology 2002, 88:2019-2034.
57. Mihalaş S., Dong Y., von der Heydt R., Niebur E. Mechanisms of perceptual organization provide auto-zoom and auto-localization for attention to objects. Proceedings of the National Academy of Sciences of the United States of America 2011, 108(18):7583-7588.
58. Milanese R., Gil S., Pun T. Attentive mechanisms for dynamic and static scene analysis. Neural Computation 1995, 34:2428-2434.
59. Monosov I.E., Sheinberg D.L., Thompson K.G. Paired neuron recordings in the prefrontal and inferotemporal cortices reveal that spatial selection precedes object identification during visual search. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(29):13105-13110.
60. Moore T., Armstrong K.M., Fallah M. Visuomotor origins of covert spatial attention. Neuron 2003, 40(4):671-683.
61. Moore T., Fallah M. Control of eye movements and spatial attention. Proceedings of the National Academy of Sciences of the United States of America 2001, 98(3):1273-1276.
62. Moore T., Fallah M. Microstimulation of the frontal eye field and its effects on covert spatial attention. Journal of Neurophysiology 2004, 91(1):152-162.
63. Morrone M.C., Burr D.C. Feature detection in human vision: A phase-dependent energy model. Proceedings of the Royal Society of London, Series B: Biological Sciences 1988, 235:221-245.
64. Niebur E., Koch C. Control of selective visual attention: Modeling the "where" pathway. Advances in neural information processing systems 1996, Vol. 8:802-808. MIT Press, Cambridge, MA.
65. Nobre A.C., Gitelman D.R., Dias E.C., Mesulam M.M. Covert visual spatial orienting and saccades: Overlapping neural systems. NeuroImage 2000, 11(3):210-216.
66. Nuthmann A., Henderson J. Object-based attentional selection in scene viewing. Journal of Vision 2010, 10(8):1-19.
67. Parkhurst, D. (2002). Selective attention in natural vision: Using computational models to quantify stimulus-drive attentional allocation. PhD Thesis, The Johns Hopkins University, Baltimore, MD.
68. Parkhurst D., Law K., Niebur E. Modeling the role of salience in the allocation of overt visual attention. Vision Research 2002, 42(1):107-123.
69. Parkhurst D.J., Niebur E. Scene content selected by active vision. Spatial Vision 2003, 16:125-154.
70. Pasupathy A., Connor C.E. Shape representation in area v4: Position-specific tuning for boundary conformation. Journal of Neurophysiology 2001, 83:2505-2519.
71. Posner M.I., Petersen S.E. The attention system of the human brain. Annual Review of Neuroscience 1990, 13:25-42.
72. Qiu F.T., Sugihara T., von der Heydt R. Figure-ground mechanisms provide structure for selective attention. Nature Neuroscience 2007, 10:1492-1499.
73. Qiu F.T., von der Heydt R. Figure and ground in the visual cortex: V2 combines stereoscopic cues with gestalt rules. Neuron 2005, 47:155-166.
74. Reid R.C. The visual system. Fundamental neuroscience 2008, Academic Press, San Diego. M. Zigmond, F. Bloom, S. Landis, J. Roberts, L. Squire (Eds.).
75. Reinagel P., Zador A.M. Natural scene statistics at the centre of gaze. Network 1999, 10:341-350.
76. Rensink R.A. The dynamic representation of scenes. Visual Cognition 2000, 7:17-42.
77. Riesenhuber M., Poggio T. Hierarchical models of object recognition in cortex. Nature Neuroscience 1999, 2:1019-1025.
78. Rizzolatti G., Riggio L., Dascola I., Umilt C. Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention. Neuropsychologia (1, Part 1) 1987, 25:31-40.
79. Robinson D.L., Petersen S.E. The pulvinar and visual salience. Trends in Neurosciences 1992, 15(4):127-132. ISSN 0166-2236.
80. Roelfsema P.R., Lamme V.A., Spekreijse H. Object-based attention in the primary visual cortex of the macaque monkey. Nature 1998, 395:376-381.
81. Roe A., Lu H., Hung C. Cortical processing of a brightness illusion. Proceedings of the National Academy of Sciences of the United States of America 2005, 102:3869-3874.
82. Rossi A., Paradiso M. Neural correlates of perceived brightness in the retina, lateral geniculate nucleus, and striate cortex. The Journal of Neuroscience 1999, 19:6145-6156.
83. Scholl B.J. Objects and attention: The state of the art. Cognition 2001, 80:1-46.
84. Schumann F., Einhauser-Treyer W., Vockeroth J., Bartl K., Schneider E., Konig P. Salient features in gaze-aligned recordings of human visual input during free exploration of natural environments. Journal of Vision 2008, 8:1-17.
85. Sheliga B.M., Riggio L., Rizzolatti G. Orienting of attention and eye movements. Experimental Brain Research 1994, 98(3):507-522.
86. Sheliga B.M., Riggio L., Rizzolatti G. Spatial attention and eye movements. Experimental Brain Research 1995, 105(2):261-275.
87. Sigman M., Cecchi G.A., Gilbert C.D., Magnasco M.O. On a common circle: Natural scenes and gestalt rules. Proceedings of the National Academy of Sciences of the United States of America 2001, 98(4):1935-1940. 10.1073/pnas.031571498.
88. Strong S.P., Koberle R., de Ruyter van Steveninck R.R., Bialek W. Entropy and information in neural spike trains. Physical Review Letters 1998, 80:197-200.
89. Sun Y., Fisher R. Object based visual attention for computer vision. Artificial Intelligence 2003, 146:77-123.
90. Sun Y., Fisher R., Wang F., Gomes H. A computer vision model for visual-object-based attention and eye movements. Computer Vision and Image Understanding 2008, 112(2):126-142.
91. Tatler B.W. The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision 2007, 7:1-17.
92. Tatler B.W., Baddeley R.J., Gilchrist I.D. Visual correlates of fixation selection: Effects of scale and time. Vision Research 2005, 45:643-659.
93. Thompson K.G., Bichot N.P. A visual salience map in the primate frontal eye field. Progress in Brain Research 2005, 147:251-262.
94. Treisman A. Features and objects: The fourteenth Bartlett memorial lecture. The Quarterly Journal of Experimental Psychology: Section A 1988, 40(2):201-237.
95. Treisman A., Gelade G. A feature integration theory of attention. Cognitive Psychology 1980, 12:97-136.
96. Tseng P., Carmi R., Cameron I.G.M., Munoz D.P., Itti L. Quantifying center bias of observers in free viewing of dynamic natural scenes. Journal of Vision 2009, 9(7). 10.1167/9.7.4.
97. Tsotsos J. Is complexity theory appropriate for analysing biological systems?. Behavioral and Brain Sciences 1991, 14(4):770-773.
98. Vitu F., Kapoula Z., Lancelin D., Lavigne F. Eye movements in reading isolated words: Evidence for strong biases towards the center of the screen. Vision Research 2004, 44:321-338.
99. von der Heydt, R., Friedman, H. S., & Zhou, H. (2003). Filling-in: From perceptual completion to cortical reorganization. Oxford University Press, pp. 106-127 (Chapter Searching for the neural mechanism of color filling-in).
100. Walther D., Itti L., Riesenhuber M., Poggio T., Koch C. Attentional selection for object recognition - A gentle way. Lecture Notes in Computer Science 2002, Vol. 2525:472-479. Springer.
101. Walther D., Koch C. Modeling attention to salient proto-objects. Neural Networks 2006, 19(9):1395-1407.
102. Wannig A., Stanisor L., Roelfsema P.R. Automatic spread of attentional response modulation along Gestalt criteria in primary visual cortex. Nature Neuroscience 2011, 14:1243-1244.
103. White B., Munoz D. Independent influence of luminance and color on saccade initiation during target selection in the superior colliculus. Journal of Vision 2010, 10(7):1320.
104. Wilson H., Wilkinson F., Asaad W. Concentric orientation summation in human form vision. Vision Research 1997, 37(17):2325-2330.
105. Wolfe J.M. Guided search 2.0 - A revised model of visual search. Psychonomics Bulletin & Review 1994, 1(2):202-238.
106. Wolfe J.M. Visual attention. Seeing 2000, 2:335-386.
107. Wolfe, J. M. (2007). Guided search 4.0. Integrated models of cognitive systems, pp. 99-119.
108. Yau J., Pasupathy A., Brincat S., Connor C. Curvature processing dynamics in macaque area V4. Cerebral Cortex 2013, 23:198-209.
109. Zenon A., Filali N., Duhamel J.R., Olivier E. Salience representation in the parietal and frontal cortex. Journal of Cognitive Neuroscience 2010, 22:918-930.
110. Zhang L., Tong M., Marks T., Shan H., Cottrell G. Sun: A bayesian framework for saliency using natural statistics. Journal of Vision 2008, 8(7):32.1-20.
111. Zhang N.R., von der Heydt R. Analysis of the context integration mechanisms underlying figure-ground organization in the visual cortex. The Journal of Neuroscience 2010, 30(19):6482-6496.
112. Zhaoping L. Attention capture by eye of origin singletons even without awareness-A hallmark of a bottom-up saliency map in the primary visual cortex. Journal of Vision 2008, 8(5).
113. Zhou H., Friedman H., von der Heydt R. Coding of border ownership in monkey visual cortex. The Journal of Neuroscience 2000, 20:6591-6611.