Semantically-based human scanpath estimation with HMMs

Proceedings of the IEEE International Conference on Computer Vision

Volumn , Issue , 2013, Pages 3232-3239

  Liu, Huiying ^a   Xu, Dong ^b   Huang, Qingming ^c   Li, Wen ^b   Xu, Min ^d   Lin, Stephen ^e  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^d UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^e MICROSOFT RESEARCH ASIA   (China)

Author keywords

Attention; Gaze shift; Hidden Markov Model; Levy flight; Saliency

Indexed keywords

HIDDEN MARKOV MODELS; SEMANTICS;

ATTENTION; BAG-OF-VISUAL-WORDS; CAUCHY DISTRIBUTION; FEATURE DIFFERENCES; GAZE SHIFTS; LEVY FLIGHTS; SALIENCY; TRANSITION PROBABILITIES;

PROBABILITY DISTRIBUTIONS;

EID: 84898807239     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2013.401     Document Type: Conference Paper

References (32)

1. A. Borji, D. N. Sihite, and L. Itti. An Object-Based Bayesian Framework for Top-Down Visual Attention. AAAI, 2012.
2. A. Borji, D. Sihite, and L. Itti. Probabilistic learning of task-specific visual attention. CVPR, 2012.
3. D. Brockmann and T. Geisel. Are human scanpaths Levy flights? ICANN, 1999.
4. N. Bruce and J. Tsotsos. Saliency based on information maximization. NIPS, 2006.
5. W. Einḧauser, M. Spain, and P. Perona. Objects predict fixations better than early saliency. Journal of Vision, 8(14):18, 1-26, 2008.
6. L. Fei-Fei and P. Perona. A Bayesian hierarchical model for learning natural scene categories. CVPR, 2005.
7. V. Gopalakrishnan, Y. Hu, and D. Rajan. Random walks on graphs for salient object detection in images. T-IP, 19(12): 3232-3242, 2010.
8. J. Harel and C. Koch. Graph-based visual saliency. NIPS, 2006.
9. A. D. Hwang, H.-C. Wang, and M. Pomplun. Semantic guidance of eye movements in real-world scenes. Vision Research, 51: 1192-1205, 2011.
10. L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. T-PAMI, 20(11): 1254-1259, 1998.
11. T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. ICCV, 2009.
12. T. Lee. An information-theoretic framework for understanding saccadic eye movements. NIPS, 2000.
13. J. Li, Y. Tian, T. Huang, and W. Gao. Probabilistic multi-task learning for visual saliency estimation in video. IJCV, 90: 150-165, 2010.
14. M.-Y. Liu, O. Tuzel, S. Ramalingam, and R. Chellappa. Entropy rate superpixel segmentation. CVPR, 2011.
15. T. Liu, Z. Yuan, J. Sun, J.Wang, N. Zheng, X. Tang, and H.-Y. Shum. Learning to detect a salient object. T-PAMI, 33(2): 353-367, 2011.
16. D. G. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60(2): 91-110, 2004.
17. S. Lu and J. Lim. Saliency modeling from image histograms. ECCV, 2012.
18. D. Pang, A. Kimura, T. Takeuchi, J. Yamato, and K. Kashino. A stochastic model of selective visual attention with a dynamic Bayesian network. ICME, 2008.
19. R. J. Peters and L. Itti. Beyond bottom-up: Incorporating taskdependent influences into a computational model of spatial attention. CVPR, 2007.
20. L. R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of IEEE, 77(2), 1999.
21. L. W. Renninger, J. Coughlan, P. Verghese, and J. Malik. An information maximization model of eye movements. NIPS, 2004.
22. L. W. Renninger, P. Verghese, and J. Coughlan. Where to look next? Eye movements reduce local uncertainty. Journal of Vision, 7(3):6, 1-17, 2007.
23. R. D. Rimey and C. M. Brown. Controlling eye movements with hidden Markov models. IJCV, 7(1):47-65, 1991.
24. T. F. Smith and M. S.Waterman. Identification of common molecular subsequences. Journal of Molecular Biology, 147:195-197, 1981.
25. R. Subramanian, H. Katti, N. Sebe, M. Kankanhalli, and T.-S. Chua. An eye fixation database for saliency detection in images. ECCV, 2010.
26. X. Sun, H. Yao, and R. Ji. What are we looking for: towards statistical modeling of saccadic eye movements and visual saliency. CVPR, 2012.
27. D. Walthera and C. Koch. Modeling attention to salient protoobjects. Neural Networks, 19: 1395-1407, 2006.
28. W. Wang, C. Chen, Y. Wang, T. Jiang, F. Fang, and Y. Yao. Simulating human saccadic scanpaths on natural images. CVPR, 2011.
29. W. Wang, Y. Wang, Q. Huang, and W. Gao. Measuring visual saliency by site entropy rate. CVPR, 2010.
30. J. Yang and M. Yang. Top-down visual saliency via joint crf and dictionary learning. CVPR, 2012.
31. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell. SUN: A Bayesian framework for salience using natural statistics. Journal of Vision, 8(7):32, 1-20, 2008.
32. Q. Zhao and C. Koch. Learning a saliency map using fixated locations in natural scenes. Journal of Vision, 11(3):9, 1-15, 2011.