Learning video saliency from human gaze using candidate selection

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2013, Pages 1147-1154

  Rudoy, Dmitry ^a   Goldman, Dan B ^b   Shechtman, Eli ^b   Zelnik Manor, Lihi ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b ADOBE RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CANDIDATE SELECTION; CANDIDATE SETS; COMPUTATION SPEED; ESTIMATION METHODS; HUMAN OBSERVERS; IMAGE SALIENCIES; VIDEO SALIENCIES; VISUAL SALIENCY MODEL;

COMPUTER SCIENCE; ELECTRICAL ENGINEERING; PATTERN RECOGNITION; SOFTWARE ENGINEERING;

OBJECT RECOGNITION;

EID: 84887331360     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2013.152     Document Type: Conference Paper

References (32)

1. B. Block. The visual story: seeing the structure of film, TV, and new media. Focal Press, 2001.
2. A. Borji and L. Itti. State-of-the-art in visual attention modeling. PAMI, 2012.
3. A. Borji, D. Sihite, and L. Itti. Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study. IEEE Transactions on Image Processing, 2012.
4. L. Bourdev and J. Brandt. Robust object detection via soft cascade. In CVPR, pages 236-243, 2005.
5. L. Bourdev and J. Malik. Poselets: Body part detectors trained using 3d human pose annotations. In ICCV, pages 1365-1372, 2009.
6. G. Buswell. How people look at pictures: a study of the psychology and perception in art. 1935.
7. Y. Cheng. Mean shift, mode seeking, and clustering. PAMI, 17(8):790-799, 1995.
8. X. Cui, Q. Liu, and D. Metaxas. Temporal spectral residual: fast motion saliency detection. In Proceedings of the ACM international Conference on Multimedia, 2009.
9. S. Goferman, L. Zelnik-Manor, and A. Tal. Contextaware saliency detection. PAMI, 34(10):1915-1926, 2012.
10. R. Goldstein, R. Woods, and E. Peli. Where people look when watching movies: Do all viewers look at the same place? Computers in biology and medicine, 37(7):957-964, 2007.
11. C. Guo, Q. Ma, and L. Zhang. Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In CVPR, pages 1-8, 2008.
12. J. Harel, C. Koch, and P. Perona. Graph-based visual saliency. NIPS, 19:545, 2007.
13. J. Henderson. Human gaze control during realworld scene perception. Trends in cognitive sciences, 7(11):498-504, 2003.
14. X. Hou and L. Zhang. Dynamic visual attention: Searching for coding length increments. NIPS, 21:681-688, 2008.
15. L. Itti. Automatic foveation for video compression using a neurobiological model of visual attention. IEEE Transactions on Image Processing, 13(10):1304-1318, 2004.
16. L. Itti, C. Koch, and E. Niebur. A model of saliencybased visual attention for rapid scene analysis. PAMI, 20(11):1254-1259, 1998.
17. G. Johansson. Visual perception of biological motion and a model for its analysis. Perceiving events and objects, 1973.
18. T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. In ICCV, pages 2106-2113, 2009.
19. W. Kim, C. Jung, and C. Kim. Spatiotemporal saliency detection and its applications in static and dynamic scenes. IEEE Transactions on Circuits and Systems for Video Technology, 21(4):446-456, 2011.
20. C. Koch and S. Ullman. Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology, 4(4):219-27, 1985.
21. A. Liaw and M. Wiener. Classification and regression by randomforest. R news, 2(3):18-22, 2002.
22. C. Liu. Beyond pixels: exploring new representations and applications for motion analysis. PhD thesis, Massachusetts Institute of Technology, 2009.
23. V. Mahadevan and N. Vasconcelos. Spatiotemporal saliency in dynamic scenes. PAMI, 32(1):171-177, 2010.
24. P. Mital, T. Smith, R. Hill, and J. Henderson. Clustering of gaze during dynamic scene viewing is predicted by motion. Cognitive Computation, 3(1):5-24, 2011.
25. B. Schauerte and R. Stiefelhagen. Predicting human gaze using quaternion dct image signature saliency and face detection. In IEEEWorkshop on Applications of Computer Vision (WACV), pages 137-144. IEEE, 2012.
26. H. Seo and P. Milanfar. Static and space-time visual saliency detection by self-resemblance. Journal of Vision, 9(7), 2009.
27. T. Smith. Attentional theory of cinematic continuity. Projections: The Journal for Movies and Mind, 6(1):1-27, 2012.
28. T. Smith and J. Henderson. Edit blindness: The relationship between attention and global change blindness in dynamic scenes. Journal of Eye Movement Research, 2(2):6, 2008.
29. Tobii. Advertising research and eye tracking. http://www. tobii. com/ eye-tracking-research/global/ research/advertising-research/.
30. A. Treisman and G. Gelade. A feature-integration theory of attention. Cognitive psychology, 12(1):97-136, 1980.
31. P. Tseng, R. Carmi, I. Cameron, D. Munoz, and L. Itti. Quantifying center bias of observers in free viewing of dynamic natural scenes. Journal of Vision, 9(7), 2009.
32. S. Zanetti, L. Zelnik-Manor, and P. Perona. A walk through the webs video clips. In CVPRW, pages 1-8. IEEE, 2008.