Eye can read your mind: Decoding gaze fixations to reveal categorical search targets

Journal of Vision

Volumn 13, Issue 14, 2013, Pages

  Zelinsky, Gregory J ^a,b   Peng, Yifan ^b   Samaras, Dimitris ^b  

^a STONY BROOK UNIVERSITY   (United States)

^b Stony Brook University   (United States)

Author keywords

Categorical search; Classification; Computer vision; Decoding; Fixation duration

Indexed keywords

ARTICLE; ARTIFICIAL INTELLIGENCE; CATEGORICAL SEARCH; CLASSIFICATION; COMPUTER VISION; DECODING; EYE FIXATION; EYE MOVEMENT; FEMALE; FIXATION DURATION; HUMAN; MALE; PATTERN RECOGNITION; PHYSIOLOGY;

CATEGORICAL SEARCH; CLASSIFICATION; COMPUTER VISION; DECODING; FIXATION DURATION;

ARTIFICIAL INTELLIGENCE; EYE MOVEMENTS; FEMALE; FIXATION, OCULAR; HUMANS; MALE; PATTERN RECOGNITION, VISUAL;

EID: 84891665672     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/13.14.10     Document Type: Article

References (34)

1. Alexander, R. G., & Zelinsky, G. J. (2011). Visual similarity effects in categorical search. Journal of Vision, 11(8):9, 1-15, http://www.journalofvision. org/content/11/8/9, doi:10.1167/11.8.9. [PubMed] [Article]
2. Alexander, R. G., & Zelinsky, G. J. (2012). Effects of part-based similarity on visual search: The Frankenbear Experiment. Vision Research, 54, 20-30.
3. Baddeley, R. J., & Tatler, B. W. (2006). High frequency edges (but not contrast) predict where we fixate: A Bayesian system identification analysis. Vision Research, 46, 2824-2833.
4. Becker, S. I. (2011). Determinants of dwell time in visual search: Similarity or perceptual difficulty. PLoS ONE, 6(3).
5. Caspi, A., Beutter, B. R., & Eckstein, M. P. (2004). The time course of visual information accrual guiding eye movement decisions. Proceedings of the National Academy of Sciences, USA, 101(35), 13086-13090.
6. Castelhano, M. S., Pollatsek, A., & Cave, K. R. (2008). Typicality aids search for an unspecified target, but only in identification and not in attentional guidance. Psychonomic Bulletin & Review, 15(4), 795-801.
7. Chang, C. C., & Lin, C. J. (2001). LIBSVM: A library for support vector machines (Version 3.11) [Software]. Retrieved from http://www.csie.ntu.edu.tw/cjlin/libsvm.
8. Cockrill, P. (2001). The teddy bear encyclopedia. New York: DK Publishing, Inc.
9. Derrington, A. M., Krauskopf, J., & Lennie, P. (1984). Chromatic mechanisms in lateral geniculate nucleus of macaque. The Journal of Physiology, 357(1), 241-265.
10. Eckstein, M. P., & Ahumada, A. J. (2002). Classification images: A tool to analyze visual strategies. Journal of Vision, 2(1):i, http://www. journalofvision.org/content/2/1/i, doi:10.1167/2.1.i. [PubMed] [Article]
11. Eckstein, M. P., Beutter, B. R., Pham, B. T., Shimozaki, S. S., & Stone, L. S. (2007). Similar neural representations of the target for saccades and perception during search. Neuron, 27, 1266-1270.
12. Gosselin, F., & Schyns, P. G. (2001). Bubbles: A technique to reveal the use of information in recognition. Vision Research, 41, 2261-2271.
13. Grandoni, D. (2012, July 13). "Mind Reading" helmet reads EEG to see if wearer recognizes faces or objects. The Huffington Post. Available from http://www.huffingtonpost.com/2012/07/13/mind-reading-helmet-eeg_n_1671210.html.
14. Greene, M. R., Liu, T., & Wolfe, J. M. (2012). Reconsidering Yarbus: A failure to predict observers' task from eye movement patterns. Vision Research, 62, 1-8.
15. Henderson, J. M., Weeks, P., & Hollingworth, A. (1999). The effects of semantic consistency on eye movements during scene viewing. Journal of Experimental Psychology: Human Perception and Performance, 25, 210-228.
16. Hwang, A. D., Higgins, E. C., & Pomplun, M. (2009). A model of top-down attentional control during visual search in complex scenes. Journal of Vision, 9(5):25, 1-18, http://www.journalofvision.org/content/9/5/25, doi:10.1167/9.5.25. [PubMed] [Article]
17. Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008). Identifying natural images from human brain activity. Nature, 452, 352-355.
18. Lazebnik, S., Schmidt, C., & Ponce, J. (2006). Beyond bags of features: Spatial pyramid matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2, 2169-2178.
19. Lowe, D. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60(2), 91-110.
20. Malcolm, G. L., & Henderson, J. M. (2009). The effects of target template specificity on visual search in real-world scenes: Evidence from eye movements. Journal of Vision, 9(11):8, 1-13, http://www. journalofvision.org/content/9/11/8, doi:10.1167/9. 11.8. [PubMed] [Article]
21. Maxfield, J. T., & Zelinsky, G. J. (2012). Searching through the hierarchy: How level of target categorization affects visual search. Visual Cognition, 20(10), 1153-1163.
22. Motter, B. C., & Belky, E. J. (1998). The guidance of eye movements during active visual search. Vision Research, 38, 1805-1815.
23. Rutishauser, U., & Koch, C. (2007). Probabilistic modeling of eye movement data during conjunction search via feature-based attention. Journal of Vision, 7(6):5, 1-20, http://www.journalofvision. org/content/7/6/5, doi:10.1167/7.6.5. [PubMed] [Article]
24. Schmidt, J., & Zelinsky, G. J. (2009). Search guidance is proportional to the categorical specificity of a target cue. Quarterly Journal of Experimental Psychology, 62(10), 1904-1914.
25. Shen, J., Reingold, E. M., Pomplun, M., & Williams, D. E. (2003). Saccadic selectivity during visual search: The influence of central processing difficulty. In J. Hyona, R. Radach, & H. Deubel (Eds.), The mind's eyes: Cognitive and applied aspects of eye movement research (pp. 65-88). Amsterdam: Elsevier Science.
26. Swain, M., & Ballard, D. (1991). Color indexing. International Journal of Computer Vision, 7(1), 11-32.
27. Tavassoli, A., van der Linde, I., Bovik, A. C., & Cormack, L. K. (2009). Eye movements selective for spatial frequency and orientation during active visual search. Vision Research, 49, 173-181.
28. Tong, F., & Pratte, M. S. (2012). Decoding patterns of human brain activity. Annual Review of Psychology, 63, 483-509.
29. Williams, L. G. (1966). The effects of target specification on objects fixated during visual search. Acta Psychologica, 27, 355-360.
30. Wolfe, J. M. (1998). Visual search. In H. Pashler (Ed.), Attention (pp. 13-71). London: University College London Press.
31. Wolfe, J. M., Horowitz, T. S., Kenner, N., Hyle, M., & Vasan, N. (2004). How fast can you change your mind? The speed of top-down guidance in visual search. Vision Research, 44, 1411-1426.
32. Yang, H., & Zelinsky, G. J. (2009). Visual search is guided to categorically-defined targets. Vision Research, 49, 2095-2103.
33. Zelinsky, G. J. (2008). A theory of eye movements during target acquisition. Psychological Review, 115(4), 787-835.
34. Zhang, W., Samaras, D., & Zelinsky, G. J. (2008). Classifying objects based on their visual similarity to target categories. In Proceedings of the 30th Annual Conference of the Cognitive Science Society, (pp. 1856-1861) Washington, DC.