Eye movements, visual search and scene memory, in an immersive virtual environment

PLoS ONE

Volumn 9, Issue 4, 2014, Pages

  Kit, Dmitry ^a   Katz, Leor ^b   Sullivan, Brian ^c   Snyder, Kat ^b   Ballard, Dana ^d   Hayhoe, Mary ^b  

^a University of Bath   (United Kingdom)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^c SMITH KETTLEWELL EYE RESEARCH INSTITUTE   (United States)

^d University of Texas at Austin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COLOR VISION; EYE FIXATION; EYE MOVEMENT; HUMAN; HUMAN EXPERIMENT; IMMERSIVE VIRTUAL ENVIRONMENT; NORMAL HUMAN; NOVEL OBJECT RECOGNITION TEST; TASK PERFORMANCE; VIRTUAL REALITY; VISUAL ADAPTATION; VISUAL DISCRIMINATION; VISUAL INFORMATION; VISUAL MEMORY; PATTERN RECOGNITION; PHYSIOLOGY;

EYE MOVEMENTS; FIXATION, OCULAR; HUMANS; PATTERN RECOGNITION, VISUAL;

EID: 84899758555     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0094362     Document Type: Article

References (61)

1. Hollingworth A, Henderson JM (2002) Accurate visual memory for previously attended objects in natural scenes. Journal of Experimental Psychology: Human Perception and Performance 28: 113-136.
2. Inui T, McClelland JL, editors (1996) Integration and accumulation of information across saccadic eye movements.
3. Luck SJ, Vogel EK (1997) The capacity of visual working memory for features and conjunctions. Nature 390: 279-281.
4. Simons D (2000) Change Blindness and Visual Memory. Special Issues of Visual Cognition Series. Psychology Press. Available: http://books.google.com/ books?id=y8kOAAAAQAAJ.
5. Rensink RA (2000) The dynamic representation of scenes. doi:10.1080/135062800394667.
6. Rensink RA (2002) Change detection. Annual review of psychology 53: 245-277.
7. Wolfe JM (1999). Inattentional amnesia. doi:10.1162/0898929053747685.
8. Hollingworth A (2006) Visual memory for natural scenes: Evidence from change detection and visual research. Visual Cognition 14: 781-807.
9. Konkle T, Brady T, Alvarez G, Oliva A (2008) Remembering thousands of objects with high fidelity. Journal of Vision 8: 694.
10. Melcher D, Kowler E (2001) Visual scene memory and the guidance of saccadic eye movements. Vision research 41: 3597-3611. (Pubitemid 33096277)
11. Melcher D (2006) Accumulation and persistence of memory for natural scenes. Journal of vision 6: 8-17.
12. Brooks DI, Rasmussen IP, Hollingworth A (2010) The nesting of search contexts within natural scenes: evidence from contextual cuing. J Exp Psychol Hum Percept Perform: 1406-18.
13. Castelhano MS, Henderson JM (2007) Initial scene representations facilitate eye movement guidance in visual search. Journal of Experimental Psychology: Human Perception and Performance 33: 753-763.
14. Summerfield JJ, Lepsien J, Gitelman DR, Mesulam MM, Nobre AC (2006) Orienting attention based on long-term memory experience. Neuron 49: 905-916. (Pubitemid 43376086)
15. Becker M, Rasmussen I (2008) Guidance of of attention to objects and locations by long-term memory of natural scenes. Journal of Experimental Psychology: Learning, Memory, and Cognition 34: 1325-1338.
16. Geisler WS (2008) Visual perception and the statistical properties of natural scenes. Annual Review of Psychology 59: 167-192.
17. Fiser J, Berkes P, Orbán G, Lengyel M (2010) Statistically optimal perception and learning: from behavior to neural representations. Trends in Cognitive Sciences 14: 119-130.
18. Morris RG, Parslow DM (2004) Neurocognitive components of spatial memory. In: Allen GL, editor, Human Spatial Memory: Remembering Where, London: Lawrence Erlbaum Associates, Inc. pp. 217-247.
19. Montello DR, Hegarty M, Richardson AE, Waller D (2004) Spatial memory of real environments, virtual environments, and maps. In: Allen GL, editor, Human Spatial Memory: Remembering Where, London: Lawrence Erlbaum Associates, Inc. pp. 251-285.
20. Wolfe JM (1994). Guided search 2.0 a revised model of visual search. doi:10.3758/BF03200774.
21. Treisman A (1993) The perception of features and objects.In: Baddeley AD, Weiskrantz L, editors, Attention: Selection, awareness, and control: A tribute to Donald Broadbent. pp. 5-35. Available: http://psycnet.apa.org/psycinfo/1994- 97378-001.
22. Itti L, Koch C (2001) Computational modeling of visual attention. Nature Reviews Neuroscience 2: 194-203.
23. Torralba A (2003) Modeling global scene factors in attention. Journal of the Optical Society of America A, Optics, image science, and vision 20: 1407-1418.
24. Bruce NDB, Tsotsos JK (2009) Saliency, attention, and visual search: An information theoretic approach. Journal of Vision 9: 1-24.
25. Zhang L, Tong MH, Marks TK, Shan H, Cottrell GW (2008) Sun: A bayesian framework for saliency using natural statistics. Journal of vision 8: 32.1-20.
26. Tatler BW, Hayhoe MM, Land MF, Ballard DH (2011) Eye guidance in natural vision: reinterpreting salience. Journal of vision 11: 1-23.
27. Schütz AC, Braun DI, Gegenfurtner KR (2011) Eye movements and perception: A selective review. Journal of vision 11.
28. Rothkopf CA, Ballard DH, Hayhoe MM (2007) Task and context determine where you look. Journal of vision 7: 16.1-20.
29. Stirk JA, Underwood G (2007) Low-level visual saliency does not predict change detection in natural scenes. Journal of vision 7: 3.1-10.
30. Jovancevic J, Sullivan B, Hayhoe M (2006) Control of attention and gaze in complex environments. Journal of Vision 6: 1431-50. (Pubitemid 46002459)
31. Rao RP, Ballard DH (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature neuroscience 2: 79-87. (Pubitemid 30488944)
32. Itti L, Baldi PF (2006) Modeling what attracts human gaze over dynamic natural scenes. In: Harris L, Jenkin M, editors, Computational Vision in Neural and Machine Systems, Cambridge, MA: Cambridge University Press. pp. 183-199.
33. Itti L, Baldi PF (2006) Bayesian surprise attracts human attention. In: Advances in Neural Information Processing Systems, Vol. 19 (NIPS*2005). Cambridge, MA: MIT Press, pp. 547-554.
34. Horstmann G (2002) Evidence for attentional capture by a surprising color singleton in visual search. Psychological Science 13: 499-505.
35. Horstmann G (2005) Attentional capture by an unannounced color singleton depends on expectation discrepancy. J Exp Psychol Hum Percept Perform 31: 1039-1060.
36. Becker SI, Horstmann G (2011) Novelty and saliency in attentional capture by unannounced motion singletons. Acta Psychologica 136: 290-299.
37. Rosenholtz R (1999) A simple saliency model predicts a number of motion popout phenomena. Vision research 39: 3157-3163.
38. Rosenholtz R, Jin Z (2005). A computational form of the statistical saliency model for visual search. doi:10.1167/5.8.777.
39. Brockmole JR, Henderson JM (2005) Object appearance, disappearance, and attention prioritization in real-world scenes. Psychonomic Bulletin and Review 12: 1061-1067. (Pubitemid 43751209)
40. Brockmole JR, Henderson JM (2005) Prioritization of new objects in real-world scenes: evidence from eye movements. Journal of Experimental Psychology: Human Perception and Performance 31: 857.
41. Brockmole JR, Henderson JM (2008) Prioritizing new objects for eye fixation in real-world scenes: E-ects of object-scene consistency. Visual Cognition 16: 375-390. (Pubitemid 351338370)
42. Matsukura M, Brockmole J, Henderson J (2009) Overt attentional prioritization of new objects and feature changes during real-world scene viewing. Visual Cognition 17: 835-855.
43. Droll JA, Eckstein MP (2009) Gaze control and memory for objects while walking in a real world environment. Visual Cognition 17: 1159-1184.
44. Tatler BW, Tatler SL (2013) The inuence of instructions on object memory in a real-world setting. Journal of vision 13.
45. Mack SC, Eckstein MP (2011) Object co-occurrence serves as a contextual cue to guide and facilitate visual search in a natural viewing environment. Journal of vision 11.
46. Karacan H, Hayhoe M (2008) Is attention drawn to changes in familiar scenes? Visual Cognition 16: 356-374. (Pubitemid 351338369)
47. Hollingworth A (2003) Failures of retrieval and comparison constrain change detection in natural scenes. Journal of Experimental Psychology-human Perception and Performance 29: 388-403.
48. Ohlsson S, Catrambone R, editors (2003) Person, place, and past inuence eye movements during visual search.
49. Võ MLH, Wolfe JM (2013) The interplay of episodic and semantic memory in guiding repeated search in scenes. Cognition 126: 198-212.
50. Hollingworth A (2012) Task specificity and the inuence of memory on visual search: comment on võ and wolfe (2012). Journal of experimental psychology Human perception and performance 38: 1596-1603.
51. Rothkopf CA, Pelz JB (2004) Head movement estimation for wearable eye tracker. In: Proceedings of the 2004 Symposium on Eye Tracking Research and Applications. New York, NY, USA: ACM, ETRA '04, pp. 123-130. doi:10.1145/968363.968388. Available: http://doi.acm.org/10.1145/968363.968388.
52. Torralba A, Oliva A, Castelhano MS, Henderson JM (2006) Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychological Review 113: 766-786. (Pubitemid 44629917)
53. Võ MLH, Wolfe JM (2012). When does repeated search in scenes involve memory? looking at versus looking for objects in scenes. doi:10.1037/a0024147.
54. Thomas LE, Seiffert AE (2010) Self-motion impairs multiple-object tracking. Cognition 117: 80-86.
55. Rao RP, Zelinsky GJ, Hayhoe MM, Ballard DH (2002) Eye movements in iconic visual search. Vision Research 42: 1447-1463. (Pubitemid 34603544)
56. Black J, Ellis T, Rosin P (2003) A novel method for video tracking performance evaluation. In: In Joint IEEE Int. Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS. pp. 125-132.
57. Adam A, Rivlin E, Shimshoni I, Reinitz D (2008) Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Transactions on Pattern Analysis and Machine Intelligence 30: 555-560. (Pubitemid 351280062)
58. Antic B, Ommer B (2011) Video parsing for abnormality detection. Computer Vision, IEEE International Conference on 0: 2415-2422.
59. Kit D, Sullivan BT, Ballard DH (2011) Novelty detection using growing neural gas for visuo-spatial memory. In: IROS. IEEE, pp. 1194-1200.
60. Swain MJ, Ballard DH (1991) Color indexing. International Journal of Computer Vision 7: 11-32.
61. Kit DM (2012) Change detection models for mobile cameras. dissertation, University of Texas.