Modelling eye movements in a categorical search task

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 368, Issue 1628, 2013, Pages

  Zelinsky, Gregory J ^a,b,c   Adeli, Hossein ^a   Peng, Yifan ^b   Samaras, Dimitris ^b  

^a STONY BROOK UNIVERSITY   (United States)

^b Stony Brook University   (United States)

^c BIELEFELD UNIVERSITY   (Germany)

Author keywords

Classification; Computational models; Eye movement guidance; Object detection; Realistic objects; Visual search

Indexed keywords

CLASSIFICATION; EYE; MAPPING; MOVEMENT; NUMERICAL MODEL; PROBABILITY; VISUAL CUE;

APPETITE; DISCRIMINATION LEARNING; EYE FIXATION; EYE MOVEMENT; HUMAN; METABOLISM; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; RECOGNITION; RETINA; VISION;

APPETITIVE BEHAVIOR; DISCRIMINATION LEARNING; EYE MOVEMENTS; FIXATION, OCULAR; HUMANS; MODELS, PSYCHOLOGICAL; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; RECOGNITION (PSYCHOLOGY); RETINA; VISION, OCULAR;

EID: 84896590662     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2013.0058     Document Type: Article

References (66)

1. Eckstein MP. 2011 Visual search: a retrospective. J. Vis. 11(5), 1-36. (doi:10.1167/11.5.14)
2. Wolfe JM. 1998 Visual search. In Attention (ed. H Pashler), pp. 13-71. London, UK: University College London Press.
3. Findlay JM. 1997 Saccade target selection during visual search. Vis. Res. 37, 617-631. (doi:10.1016/ S0042-6989(96)00218-0)
4. Williams DE, Reingold EM, Moscovitch M, Behrmann M. 1997 Patterns of eye movements during parallel and serial visual search tasks. Can. J. Exp. Psychol. 51, 151-164. (doi:10.1037/1196-1961.51.2.151)
5. Zelinsky GJ. 1996 Using eye saccades to assess the selectivity of search movements. Vis. Res. 36, 2177-2187. (doi:10.1016/0042-6989(95)00300-2)
6. Zelinsky GJ, Sheinberg D. 1997 Eye movements during parallel-serial visual search. J. Exp. Psychol. Hum. Percept. Perform. 23, 244-262. (doi:10.1037/ 0096-1523.23.1.244)
7. Engel F. 1977 Visual conspicuity, visual search and fixation tendencies of the eye. Vis. Res. 17, 95-108. (doi:10.1016/0042-6989(77)90207-3)
8. Williams LG. 1967 The effects of target specification on objects fixated during visual search. Acta Psychol. 27, 355-360. (doi:10.1016/0001-6918(67)90080-7)
9. Chen X, Zelinsky GJ. 2006 Real-world visual search is dominated by top-down guidance. Vis. Res. 46, 4118-4133. (doi:10.1016/j.visres.2006.08.008)
10. Schmidt J, Zelinsky GJ. 2011 Visual search guidance is best after a short delay. Vis. Res. 51, 535-545. (doi:10.1016/j.visres.2011.01.013)
11. Zelinsky GJ, Rao RPN, Hayhoe MM, Ballard DH. 1997 Eye movements reveal the spatio-temporal dynamics of visual search. Psychol. Sci. 8, 448-453. (doi:10.1111/j.1467-9280.1997.tb00459.x)
12. Henderson JM, Weeks P, Hollingworth A. 1999 The effects of semantic consistency on eye movements during scene viewing. J. Exp. Psychol. Hum. Percept. Perform. 25, 210-228. (doi:10.1037/0096-1523. 25.1.210)
13. Eckstein MP, Drescher B, Shimozaki SS. 2006 Attentional cues in real scenes, saccadic targeting and Bayesian priors. Psychol. Sci. 17, 973-980. (doi:10.1111/j.1467-9280.2006.01815.x)
14. Zelinsky GJ, Schmidt J. 2009 An effect of referential scene constraint on search implies scene segmentation. Vis. Cogn. 17, 1004-1028. (doi:10. 1080/13506280902764315)
15. Wolfe JM. 1994 Guided search 2.0: a revised model of visual search. Psychon. Bull. Rev. 1, 202-238. (doi:10.3758/BF03200774)
16. Itti L, Koch C. 2000 A saliency-based search mechanism for overt and covert shifts of visual attention. Vis. Res. 40, 1489-1506. (doi:10.1016/ S0042-6989(99)00163-7)
17. Zelinsky GJ. 2008 A theory of eye movements during target acquisition. Psychol. Rev. 115, 787-835. (doi:10.1037/a0013118)
18. Bisley JW, Goldberg ME. 2010 Attention, intention, and priority in the parietal lobe. Annu. Rev. Neurosci. 33, 1-21. (doi:10.1146/annurev-neuro-060909-152823)
19. Alexander RG, Zelinsky GJ. 2011 Visual similarity effects in categorical search. J. Vis. 11(8), 1-15. (doi:10.1167/11.8.9)
20. Hwang AD, Higgins EC, Pomplun M. 2009 A model of top-down attentional control during visual search in complex scenes. J. Vis. 9(5), 1-18. (doi:10.1167/9.5.25)
21. Peters RJ, Iyer A, Itti L, Koch C. 2005 Components of bottom-up gaze allocation in natural images. Vis. Res. 45, 2397-2416. (doi:10.1016/j.visres.2005. 03.019)
22. Zhang L, Tong MH, Marks TK, Shan H, Cottrell GW. 2008 SUN: a Bayesian framework for saliency using natural statistics. J. Vis. 8(7), 1-20. (doi:10.1167/8.7.32)
23. Findlay JM. 1982 Global visual processing for saccadic eye movements. Vis. Res. 22, 1033-1045. (doi:10.1016/0042-6989(82)90040-2)
24. Zelinsky GJ. 2012 TAM: Explaining off-object fixations and central fixation biases as effects of population averaging during search. Vis. Cogn. 20, 515-545. (Special Issue on Behavioral and Computational Approaches to Reading and Scene Perception). (doi:10.1080/13506285.2012.666577)
25. Olivers C, Peters J, Roos H, Roelfsema P. 2011 Different states in visual working memory: when it guides attention and when it does not. Trends Cogn. Sci. 15, 327-334.
26. McIlwain JT. 1991 Distributed spatial coding in the superior colliculus: a review. Vis. Neurosci. 6, 3-13. (doi:10.1017/S0952523800000857)
27. Tatler BW. 2007 The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. J. Vis. 7(14), 1-17. (doi:10.1167/7.14.4)
28. Vickory TJ, King L-W, Jiang Y. 2005 Setting up the target template in visual search. J. Vis. 5, 81-92. (doi:10.1167/5.1.8)
29. Wolfe JM, Horowitz TS, Kenner N, Hyle M, Vasan N. 2004 How fast can you change your mind? The speed of top-down guidance in visual search. Vis. Res. 44, 1411-1426. (doi:10.1016/j.visres. 2003.11.024)
30. Castelhano MS, Pollatsek A, Cave KR. 2008 Typicality aids search for an unspecified target, but only in identification and not in attentional guidance. Psychon. Bull. Rev. 15, 795-801. (doi:10.3758/PBR.15.4.795)
31. Yang H, Zelinsky GJ. 2009 Visual search is guided to categorically-defined targets. Vis. Res. 49, 2095-2103. (doi:10.1016/j.visres.2009.05.017)
32. Schmidt J, Zelinsky GJ. 2009 Search guidance is proportional to the categorical specificity of a target cue. Q. J. Exp. Psychol. 62, 1904-1914. (doi:10. 1080/17470210902853530)
33. Maxfield JT, Zelinsky GJ. 2012 Searching through the hierarchy: how level of target categorization affects visual search. Vis. Cogn. 20, 1153-1163. (doi:10.1080/13506285.2012.735718)
34. Daugman J. 1980 Two-dimensional spectral analysis of cortical receptive field profiles. Vis. Res. 20, 847-856. (doi:10.1016/0042-6989(80)90065-6)
35. Olshausen B, Field D. 1996 Emergence of simplecell receptive field properties by learning a sparse code for natural images. Nature 381, 607-609. (doi:10.1038/381607a0)
36. Felzenszwalb PF, Girshick RB, McAllester D, Ramanan D. 2010 Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1627-1645. (doi:10.1109/TPAMI.2009.167)
37. Russakovsky O, Lin Y, Yu K, Fei-Fei L. 2012 Objectcentric spatial pooling for image classification. In Lecture Notes in Computer Science, (Proceedings of the 12th European Conference on Computer Vision; ECCV, 8-11 October, Firenze, Italy), 1-15.
38. Everingham M, van Gool L, Williams CKI, Winn J, Zisserman A. 2012 The PASCAL visual object classes challenge 2012 results. See http://www.pascalnetwork. org/challenges/VOC/voc2012/workshop/index.html.
39. Torralba A, Oliva A, Castelhano M, Henderson JM. 2006 Contextual guidance of attention in natural scenes: the role of global features on object search. Psychol. Rev. 113, 766-786. (doi:10.1037/0033- 295X.113.4.766)
40. Kanan C, Tong M, Zhang L, Cottrell G. 2009 SUN: top-down saliency using natural statistics. Vis. Cogn. 17, 979-1003. (doi:10.1080/1350628 0902771138)
41. Ehinger KA, Hidalgo-Sotelo B, Torralba A, Oliva A. 2009 Modelling search for people in 900 scenes: a combined source model of eye guidance. Vis. Cogn. 17, 945-978. (doi:10.1080/13506280902834720)
42. Dalal N, Triggs B. 2005 Histograms of oriented gradients for human detection. IEEE Conf. on Computer Vision and Pattern Recognition 1, 886-893.
43. Zhang W, Yang H, Samaras D, Zelinsky GJ. 2006 A computational model of eye movements during object class detection. In Advances in neural information processing systems 18 (eds Y Weiss, B Scholkopf, J Platt), pp. 1609-1616. Cambridge, MA: MIT Press.
44. Zelinsky GJ, Peng Y, Berg AC, Samaras D. In press. Modeling guidance and recognition in categorical search: bridging human and computer object detection. J. Vis. 12, 957. (doi:10.1167/12.9.957)
45. Serre T, Wolf L, Poggio T. 2006 Object recognition with features inspired by visual cortex. IEEE Conf. on Computer Vision and Pattern Recognition 2, 994-1000.
46. Motter BC, Belky EJ. 1998 The guidance of eye movements during active visual search. Vis. Res. 38, 1805-1815. (doi:10.1016/S0042-6989(97)00349-0)
47. Rutishauser U, Koch C. 2007 Probabilistic modeling of eye movement data during conjunction search via feature-based attention. J. Vis. 7(6), 1-20. (doi:10.1167/7.6.5)
48. Williams DE, Reingold EM. 2001 Preattentive guidance of eye movements during triple conjunction search tasks. Psychon. Bull. Rev. 8, 476-488. (doi:10.3758/BF03196182)
49. Swain M, Ballard D. 1991 Color indexing. Int. J. Comp. Vis. 7, 11-32. (doi:10.1007/ BF00130487)
50. Derrington AM, Krauskopf J, Lennie P. 1984 Chromatic mechanisms in lateral geniculate nucleus of macaque. J. Physiol. 357, 241-265.
51. Chang CC, Lin CJ. 2001 LIBSVM: a library for support vector machines. See http://www.csie.ntu.edu.tw/ cjlin/libsvm.
52. Platt JC. 2000 Probabilities for SV machines. In Advances in large margin classifiers (ed. AJ Smola), pp. 61-74. Cambridge, MA: MIT Press.
53. McPeek RM, Keller EL. 2002 Saccade target selection in the superior colliculus during a visual search task. J. Neurophysiol. 88, 2019-2034.
54. Geisler WS, Perry JS. 2002 A real-time foveated multiresolution system for low-bandwidth video communication. SPIE Human Vision and Electronic Imaging 3299, 294-305.
55. Geisler WS, Perry JS. 2002 Real-time simulation of arbitrary visual fields. In Proc. of the Eye Tracking Research & Applications Symp. (ACM), pp. 83-87. New York, NY: ACM.
56. Fischer B. 1973 Overlap of receptive field centers and representation of the visual field in the cat's optic tract. Vis. Res. 13, 2113-2120. (doi:10.1016/ 0042-6989(73)90188-0)
57. Mcllwain JT. 1986 Point images in the visual system: new interest in an old idea. Trends Neurosci. 9, 354-358. (doi:10.1016/0166-2236(86)90113-X)
58. Ottes F, Van Gisbergen J, Eggermont J. 1986 Visuomotor fields of the superior colliculus: a quantitative model. Vis. Res. 26, 857-873. (doi:10.1016/0042-6989(86)90144-6)
59. Posner MI, Cohen Y. 1984 Components of visual orienting. In Attention and performance X: control of language processes (eds H Bouma, DG Bouwhuis), pp. 531-556. Hillsdale, NJ: Erlbaum.
60. Smith TJ, Henderson JM. 2011 Looking back at Waldo: oculomotor inhibition of return does not prevent return fixations. J. Vis. 11(1), 1-11. (doi:10.1167/11.1.3)
61. Wilming N, Harst S, Schmidt N, König P. 2013 Saccadic momentum and facilitation of return saccades contribute to an optimal foraging strategy. PLoS Comput. Biol. 9, 1-13. (doi:10.1371/journal. pcbi.1002871)
62. Nuthmann A, Henderson JM. 2010 Object-based attentional selection in scene viewing. J. Vis. 10(8), 1-19. (doi:10.1167/10.8.20)
63. Tatler BW, Hayhoe MM, Land MF, Ballard DH. 2011 Eye guidance in natural vision: reinterpreting salience. J. Vis. 11(5), 1-23. (doi:10.1167/11.5.5)
64. Becker MW, Pashler H, Lubin J. 2007 Object-intrinsic oddities drawearly saccades. J. Exp. Psychol. Hum. Percept. Perform. 33, 20-30. (doi:10.1037/0096-1523.33.1.20)
65. Bonitz VS, Gordon RD. 2008 Attention to smokingrelated and incongruous objects during scene viewing. Acta Psychol. 129, 255-263. (doi:10.1016/ j.actpsy.2008.08.006)
66. Underwood G, Foulsham T. 2006 Visual saliency and semantic incongruency influence eye movements when inspecting pictures. Q. J. Exp. Psychol. 59, 1931-1949. (doi:10.1080/17470210500416342)