Prediction of search targets from fixations in open-world settings

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 981-990

  Sattar, Hosnieh ^a   Müller, Sabine ^a   Fritz, Mario ^a   Bulling, Andreas ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; FORECASTING;

CANDIDATE SETS; NATURAL IMAGES; POTENTIAL TARGETS; PROBLEM FORMULATION; STATE OF THE ART; TARGET IMAGES; TARGET PREDICTION; VISUAL SEARCH;

PATTERN RECOGNITION;

EID: 84933553644     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298700     Document Type: Conference Paper

References (43)

1. A. Borji and L. Itti. Defending yarbus: Eye movements reveal observers' task. Journal of Vision, 14(3):29, 2014
2. A. Borji, A. Lennartz, and M. Pomplun. What do eyes reveal about the mind: Algorithmic inference of search targets from fixations. Neurocomputing, 2014
3. A. Borji, D. N. Sihite, and L. Itti. Probabilistic learning of task-specific visual attention. In Proc. CVPR, pages 470-477, 2012
4. S. A. Brandt and L. W. Stark. Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of Cognitive Neuroscience, 9(1):27-38, 1997
5. A. Bulling and D. Roggen. Recognition of Visual Memory Recall Processes Using Eye Movement Analysis. In Proc. UbiComp, pages 455-464, 2011
6. A. Bulling, J. A. Ward, and H. Gellersen. Multimodal recognition of reading activity in ransit using body-worn sensors. ACM Transactions on Applied Perception, 9(1):2:1-2:21, 2012
7. A. Bulling, J. A. Ward, H. Gellersen, and G. Tröster. Eye Movement Analysis for Activity Recognition Using Electrooculography. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(4):741-753, Apr. 2011
8. A. Bulling, C. Weichel, and H. Gellersen. EyeContext: Recognition of High-level Contextual Cues from Human Visual Behaviour. In Proc. CHI, pages 305-308, 2013
9. N. J. Butko and J. R. Movellan. Infomax control of eye movements. IEEE Transactions on Autonomous Mental Development, 2(2):91-107, 2010
10. M. Cerf, J. Harel, A. Huth,W. Einhuser, and C. Koch. Decoding what people see from where they look: Predicting visual stimuli from scanpaths. In Attention in Cognitive Systems, volume 5395, pages 15-26. 2009
11. J. Coddington, J. Xu, S. Sridharan, M. Rege, and R. Bailey. Gaze-based image retrieval system using dual eye-trackers. In Proc. ESPA, pages 37-40, 2012
12. R. Coen-Cagli, P. Coraggio, P. Napoletano, O. Schwartz, M. Ferraro, and G. Boccignone. Visuomotor characterization of eye movements in a drawing task. Vision Research, 49(8):810-818, 2009
13. M. DeAngelus and J. B. Pelz. Top-down control of eye movements: Yarbus revisited. Visual Cognition, 17(6-7):790-811, 2009
14. M. R. Greene, T. Liu, and J. M. Wolfe. Reconsidering yarbus: A failure to predict observers? task from eye movement patterns. Vision Research, 62:1-8, 2012
15. G.-D. Guo, A. K. Jain, W.-Y. Ma, and H.-J. Zhang. Learning similarity measure for natural image retrieval with relevance feedback. IEEE Transactions on Neural Networks, 13(4):811-820, 2002
16. A. Haji-Abolhassani and J. J. Clark. A computational model for task inference in visual search. Journal of Vision, 13(3):29, 2013
17. A. Haji-Abolhassani and J. J. Clark. An inverse yarbus process: Predicting observers' task from eye movement patterns. Vision Research, 103:127-142, 2014
18. J. Harel, C. Koch, and P. Perona. Graph-based visual saliency. In Proc. NIPS, pages 545-552, 2006
19. J. M. Henderson, S. V. Shinkareva, J. Wang, S. G. Luke, and J. Olejarczyk. Predicting cognitive state from eye movements. PloS one, 8(5):e64937, 2013
20. Z. Hussain, A. Klami, J. Kujala, A. P. Leung, K. Pasupa, P. Auer, S. Kaski, J. Laaksonen, and J. Shawe-Taylor. Pinview: Implicit feedback in content-based image retrieval. Technical Report 1410. 0471, October 2014
21. A. D. Hwang, E. C. Higgins, and M. Pomplun. A model of top-down attentional control during visual search in complex scenes. Journal of Vision, 9(5):25, 2009
22. C. Kanan, N. A. Ray, D. N. F. Bseiso, J. H. wen Hsiao, and G. W. Cottrell. Predicting an observer's task using multifixation pattern analysis. In Proc. ETRA, pages 287-290, 2014
23. L. King. The relationship between scene and eye movements. In Proc. HICSS, pages 1829-1837, 2002
24. A. Klami. Inferring task-relevant image regions from gaze data. In Proc. MLSP, pages 101-106, 2010
25. L. Kozma, A. Klami, and S. Kaski. GaZIR: Gaze-based zooming interface for image retrieval. In Proc. ICMI-MLMI, pages 305-312, 2009
26. M. F. Land. Eye movements and the control of actions in everyday life. Progress in Retinal and Eye Research, 25(3):296-324, 2006
27. T. Loetscher, C. J. Bockisch, M. E. Nicholls, and P. Brugger. Eye position predicts what number you have in mind. Current Biology, 20(6):R264-R265, 2010
28. F. W. Mast and S. M. Kosslyn. Eye movements during visual mental imagery. Trends in Cognitive Sciences, 6(7):271-272, 2002
29. B. C. Motter and E. J. Belky. The guidance of eye movements during active visual search. Vision Research, 38(12):1805-1815, 1998
30. O. Oyekoya and F. Stentiford. Eye tracking as a new interface for image retrieval. BT Technology Journal, 22(3):161-169, 2004
31. O. Oyekoya and F. Stentiford. Perceptual image retrieval using eye movements. International Journal of Computer Mathematics, 84(9):1379-1391, 2007
32. G. Papadopoulos, K. Apostolakis, and P. Daras. Gazebased relevance feedback for realizing region-based image retrieval. IEEE Transactions on Multimedia, 16(2):440-454, Feb 2014
33. R. J. Peters and L. Itti. Congruence between model and human attention reveals unique signatures of critical visual events. In Proc. NIPS, pages 1145-1152, 2008
34. U. Rajashekar, A. C. Bovik, and L. K. Cormack. Visual search in noise: Revealing the influence of structural cues by gaze-contingent classification image analysis. Journal of Vision, 6(4):7, 2006
35. L. W. Renninger, J. M. Coughlan, P. Verghese, and J. Malik. An information maximization model of eye movements. In Proc. NIPS, pages 1121-1128, 2004
36. C. Schulze, R. Frister, and F. Shafait. Eye-tracker based partimage selection for image retrieval. In Proc. ICIP, pages 4392-4396, 2013
37. G. Stefanou and S. P. Wilson. Mental image category search: a Bayesian approach
38. B. Tessendorf, A. Bulling, D. Roggen, T. Stiefmeier, M. Feilner, P. Derleth, and G. Trster. Recognition of hearing needs from body and eye movements to improve hearing instruments. In Proc. Pervasive, pages 314-331, 2011
39. A. L. Yarbus, B. Haigh, and L. A. Rigss. Eye movements and vision, volume 2. Plenum press New York, 1967
40. G. J. Zelinsky, H. Adeli, Y. Peng, and D. Samaras. Modelling eye movements in a categorical search task. Philosophical Transactions of the Royal Society B: Biological Sciences, 368(1628):20130058, 2013
41. G. J. Zelinsky, Y. Peng, and D. Samaras. Eye can read your mind: Decoding gaze fixations to reveal categorical search targets. Journal of Vision, 13(14):10, 2013
42. W. Zhang, H. Yang, D. Samaras, and G. J. Zelinsky. A computational model of eye movements during object class detection. In Proc. NIPS, pages 1609-1616, 2005
43. Y. Zhang, H. Fu, Z. Liang, Z. Chi, and D. Feng. Eye movement as an interaction mechanism for relevance feedback in a content-based image retrieval system. In Proc. ETRA, pages 37-40, 2010.