Predicting Eye Fixations on Complex Visual Stimuli Using Local Symmetry

Cognitive Computation

Volumn 3, Issue 1, 2011, Pages 223-240

  Kootstra, Gert ^a   de Boer, Bart ^b   Schomaker, Lambert R B ^c  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Covert visual attention; Eye movements; Local symmetry; Saliency models

Indexed keywords

CONTRAST MODELS; EYE FIXATIONS; EYE-TRACKING; HIGH RESPONSE; HUMAN EYE; HUMAN OBSERVERS; LOCAL SYMMETRY; MIRROR SYMMETRY; PHOTOGRAPHIC IMAGE; SALIENCY MODELS; VISUAL ATTENTION; VISUAL STIMULUS;

FORECASTING; MIRRORS; PHOTOGRAPHY;

EYE MOVEMENTS;

EID: 79952814300     PISSN: 18669956     EISSN: 18669964     Source Type: Journal    
DOI: 10.1007/s12559-010-9089-5     Document Type: Article

References (73)

1. Yarbus A. Eye movements and vision. New York: Plenum Press; 1967.
2. Rothkopf CA, Ballard DH, Hayhoe MM. Task and context determine where you look. J Vis. 2007; 7(14): 1-20.
3. De Graef P, Christiaens D, d'Ydewalle G. Perceptual effects of scene context on object identification. Psychol Res. 1990; 52: 317-29.
4. Neider MB, Zelinsky GJ. Scene context guides eye movements during visual search. Vis Res. 2006; 46: 614-21.
5. Chun MM, Jiang Y. Contextual cueing: implicit learning and memory of visual context guides spatial attention. Cogn Psychol. 1998; 36: 28-71.
6. Noton D, Stark LW. Scanpaths in saccadic eye movements while viewing and recognizing patterns. Vis Res. 1971; 11: 929-42.
7. Henderson JM, Castelhano MS. Eye movements and visual memory for scenes. In: Underwood G, editor. Cognitive processes in eye guidance. Oxford: Oxford University Press; 2005. p. 213-35.
8. Karn KS, Hayhoe MM. Memory representations guide targeting eye movements in a natural task. Vis Cogn. 2000; 7(6): 673-703.
9. Carmi R, Itti L. The role of memory in guiding attention during natural vision. J Vis. 2006; 6(9): 898-914.
10. van Zoest W, Donk M, Theeuwes J. The role of stimulus-driven and goal-driven control in saccadic visual selection. J Exp Psychol Hum Percept Perf. 2004; 30(4): 746-59.
11. Einhäuser W, Rutishauser U, Koch C. Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. J Vis. 2008; 8(2): 1-19.
12. Theeuwes J. Exogenous and endogenous control of attention: The effect of visual onsets and offsets. Perception & Psychophysics. 1991; 49(1): 83-90.
13. Theeuwes J. Stimulus-Driven Capture and Attentional Set: Selective Search for Color and Visual Abrupt Onsets. J Exp Psychol Hum Percept Perform. 1994; 20(4): 799-806.
14. Theeuwes J. Perceptual Selectivity for Color and Form. Perception & Psychophysics. 1992; 51(6): 599-606.
15. Einhäuser W, Rutishauser U, Frady EP, Nadler S, Köning P, Koch C. The Relation of Phase Noise and Luminance Contrast to Overt Attention in Complex Visual Stimuli. J Vis. 2006; 6: 1148-58.
16. Mannan S, Ruddock KH, Wooding DS. Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images. Spat Vis. 1995; 9(3): 363-86.
17. Wolfe JM. Guided search 4. 0: current progress with a model of visual search. In: Gray W, editor. Integrated models of cognitive systems. New York: Oxford; 2007. p. 99-119.
18. Torralba A, Oliva A, Castelhano MS, Henderson JM. Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychol Rev. 2006; 113(4): 766-86.
19. Navalpakkam V, Itti L. Modeling the influence of task on attention. Vis Res. 2005; 45: 205-31.
20. Zelinsky GJ, Zhang W, Yu B, Chen X, Samaras D. The role of top-down and bottom-up processes in guiding eye movements during visual search. In: Weiss Y, Schölkopf B, Platt J, editors. Advances in neural information processing systems (NIPS). Cambridge, MA: MIT Press; 2006. p. 1569-76.
21. Frintrop S. VOCUS: a virtual attention system for object detection and goal-directed search. Berlin: Springer; 2006.
22. Itti L, Koch C. Computational modelling of visual attention. Nat Rev Neurosci. 2001; 2(3): 194-203.
23. Itti L, Koch C, Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell. 1998; 20(11): 1254-9.
24. Koch C, Ullman S. Shifts in selective visual attention: towards the underlying neural circuitry. Hum Neurobiol. 1985; 4: 219-27.
25. Treisman AM, Gelade G. A feature-integration theory of attention. Cogn Psychol. 1980; 12(1): 97-136.
26. Itti L, Koch C. A saliency-based search mechanism for overt and covert shifts of visual attention. Vis Res. 2000; 40(10-12): 1489-506.
27. Parkhurst DJ, Law K, Niebur E. Modeling the role of salience in the allocation of overt visual attention. Vis Res. 2002; 42: 107-23.
28. Ouerhani N, von Wartburg R, Hügli H, Müri R. Empirical validation of the saliency-based model of visual attention. Elect Lett Comput Vis Image Anal. 2004; 3(1): 13-4.
29. Itti L, Dhavale N, Pighin F. Realistic avatar eye and head animation using a neurobiological model of visual attention. In: Bosacchi B, Fogel DB, Bezdek JC, editors. SPIE 48th annual international symposium on optical science and technology. Bellingham, WA: SPIE Press; 2003. p. 64-78.
30. Carmi R, Itti L. Visual causes versus correlates of attentional selection in dynamic scenes. Vis Res. 2006; 46: 4333-45.
31. Itti L, Baldi PF. Bayesian surprise attracts human attention. Vis Res (in press). 2009.
32. Le Meur O, Le Callet P, Barba D, Thoreau D. A coherent computational approach to model bottom-up visual attention. IEEE Trans Pattern Anal Mach Intell. 2006; 28(5): 802-17.
33. Bruce NDB, Tsotsos JK. Saliency, attention, and visual search: an information theoretic approach. J Vis. 2009; 9(3): 1-24.
34. Kienzle W, Franz MO, Schölkopf B, Wichmann FA. Center-surround patterns emerge as optimal predictors for human saccade targets. J Vis. 2009; 9(5): 7: 1-15.
35. Privitera CM, Stark LW. Algorithms for defining visual regions-of-interest: comparison with eye fixations. IEEE Trans Pattern Anal Mach Intell. 2000; 22(9): 970-82.
36. Grammer K, Thornhill R. Human (Home sapiens) facial attractiveness and sexual selection: the role of symmetry and averageness. J Comp Psychol. 1994; 108(3): 233-42.
37. Rhodes G, Proffitt F, Grady JM, Sumich A. Facial symmetry and the perception of beauty. Psychon Bull Rev. 1998; 5(4): 659-69.
38. Tyler CW. The human expression of symmetry: art and neuroscience. In: Bogdan A, editor. ICUS Symmetry Symposium; 2000. Seoul.
39. Palmer SE. Goodness, gestalt, groups, and garner: local symmetry subgroups as a theory of figural goodness. In: Lockhead GR, Pomerantz JR, editors. The perception of structure essays in honor of Wendell R Garner. Washington, DC: American Psychological Association; 1991. p. 23-40.
40. Palmer SE, Hemenway K. Orientation and symmetry: effects of multiple, rotational, and near symmetries. J Exp Psychol Hum Percept Perf. 1978; 4(4): 691-702.
41. Royer FL. Detection of symmetry. J Exp Psychol Hum Percept Perf. 1981; 7(6): 1186-210.
42. Wagemans J. Parallel visual processes in symmetry perception: normality and pathology. Doc Ophthalmol. 1999; 95: 359-70.
43. Barlow HB, Reeves BC. The versatility and absolute efficiency of detecting mirror symmetry in random dot displays. Vis Res. 1979; 19: 783-93.
44. Delius JD, Nowak B. Visual symmetry recognition by pigeons. Psychol Res. 1982; 44: 199-212.
45. Kaufman L, Richards W. Spontaneous fixation tendencies for visual forms. Percept Psychophys. 1969; 5(2): 85-8.
46. Kootstra G, Schomaker LRB. Prediction of Human Eye Fixations using Symmetry. Cognitive Science Conference (CogSci 2009), under review; 2009; Amsterdam, The Netherlands; 2009.
47. Açik A, Onat S, Schumann F, Einhäuser W, König P. Effects of luminance contrast and its modifications on fixation behavior during free viewing of images from different categories. Vis Res. 2009; 49: 1541-53.
48. Findlay JM. Global visual processing for saccadic eye-movements. Vis Res. 1982; 22(8): 1033-45.
49. Ottes FP, van Gisbergen JAM, Eggermont JJ. Metrics of saccade responses to visual double stimuli: two different modes. Vis Res. 1984; 24(10): 1169-79.
50. He PY, Kowler E. The role of location probability in the programming of saccades-implications for center-of-gravity tendencies. Vis Res. 1989; 29(9): 1165-81.
51. Bindemann M, Scheepers C, Burton AM. Viewpoint and center of gravity affect eye movements to human faces. J Vis. 2009; 9(2): 1-16.
52. Locher PJ, Nodine CF. Symmetry catches the eye. In: O'Regan JK, Lévy-Schoen A, editors. Eye movements: from physiology to cognition. North-Holland: Elsevier Science Publishers B. V; 1987.
53. Köhler W. Gestalt psychology: an introduction to new concepts in modern psychology (Reissued). New York: Liveright; 1992.
54. Koffka K. Principles of Gestalt psychology. London: Lund Humphries; 1935.
55. Driver J, Baylis GC, Rafal RD. Preserved figure-ground segregation and symmetry perception in visual neglect. Nature. 1992; 360: 73-5.
56. Kanizsa G, Gerbino W. Convexity and symmetry in figure-ground organization. In: Henle H, editor. Vision and artifact. New York: Springer; 1976. p. 25-32.
57. Scholl BJ. Objects and attention: the state of the art. Cognition. 2001; 80(1-2): 1-46.
58. Lowe DG. Distinctive image features from scale-invariant keypoints. Int J Comput Vis. 2004; 60(2): 91-110.
59. Mikolajczyk K, Schmid C. Scale & affine invariant interest point detectors. Int J Comput Vis. 2004; 60(1): 63-86.
60. Marola G. Using symmetry for detecting and locating objects in a picture. Comput Vis Graph Image Process. 1989; 46(2): 179-95.
61. Backer G, Mertsching B, Bollmann M. Data- and model-driven gaze control for an active-vision system. IEEE Trans Pattern Anal Mach Intell. 2001; 23(12): 1415-29.
62. Sela G, Levine MD. Real-time attention for robotic vision. Real-Time Imaging. 1997; 3: 173-94.
63. Reisfeld D, Yeshurun Y. Preprocessing of face images: detection of features and pose normalization. Comput Vis Image Underst. 1998; 71(3): 413-30.
64. Jenkinson M, Brady M. A saliency-based hierarchy for local symmetries. Image Vis Comput. 2002; 20(2): 85-101.
65. Reisfeld D, Wolfson H, Yeshurun Y. Context-free attentional operators: the generalized symmetry transform. Int J Comput Vis. 1995; 14: 119-30.
66. Heidemann G. Focus-of-attention from local color symmetries. IEEE Trans Pattern Anal Mach Intell. 2004; 26(7): 817-30.
67. Noton D, Stark LW. Scanpaths in eye movements during pattern perception. Science. 1971; 171(3968): 308-11.
68. Tatler BW, Baddeley RJ, Gilchrist ID. Visual correlates of fixation selection: effects of scale and time. Vis Res. 2005; 45: 2005.
69. Foulsham T, Underwood G. How does the purpose of inspection influence the potency of visual salience in scene perception? Perception. 2007; 36(8): 1123-38.
70. Olmos A, Kingdom FAA. McGill calibrated colour image database, http://tabby. vision. mcgill. ca; 2004.
71. Kootstra G, Nederveen A, de Boer B. Paying attention to symmetry. British machine vision conference; 2008 1-4 September 2008; Leeds, UK; 2008. p. 1115-25.
72. Tatler BW. The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. J Vis. 2007; 7(14): 1-17.
73. Parkhurst DJ, Niebur E. Scene content selected by active vision. Spat Vis. 2003; 16(2): 125-54.