Dynamic eye movement datasets and learnt saliency models for visual action recognition

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7573 LNCS, Issue PART 2, 2012, Pages 842-856

  Mathe, Stefan ^a,c   Sminchisescu, Cristian ^a,b  

^a INSTITUTE OF MATHEMATICS   (Romania)

^b UNIVERSITY OF BONN   (Germany)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION RECOGNITION; AUTOMATIC SYSTEMS; BAG-OF-WORDS MODELS; COMPUTER VISION SYSTEM; DATA SETS; HUMAN EYE; IMAGE FEATURES; LARGE-SCALE DYNAMICS; SAMPLING STRATEGIES; SPATIO-TEMPORAL; STATE OF THE ART; TASK CONTROL; VISION COMMUNITIES; VISUAL OBJECTS; VISUAL RECOGNITION; VISUAL SEARCH; VISUAL-PROCESSING;

EYE MOVEMENTS;

COMPUTER VISION;

EID: 84867848624     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-33709-3_60     Document Type: Conference Paper

References (32)

1. Marszalek, M., Laptev, I., Schmid, C.: Actions in context. In: CVPR (2009)
2. Rodriguez, M.D., Ahmed, J., Shah, M.: Action mach a spatio-temporal maximum average correlation height filter for action recognition. In: CVPR (2008)
3. Everingham, M., Gool, L.V., Williams, C., Winn, J., Zisserman, A.: The Pascal visual object classes (VOC) challenge. IJCV (2010)
4. Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where humans look. In: ICCV (2009)
5. Larochelle, H., Hinton, G.: Learning to combine foveal glimpses with a third-order boltzmann machine. In: NIPS (2010)
6. Laptev, I.: On space-time interest points. In: IJCV (2005)
7. Han, D., Bo, L., Sminchisescu, C.: Selection and context for action recognition. In: ICCV (2009)
8. Prest, A., Schmid, C., Ferrari, V.: Weakly supervised learning of interactions between humans and objects. PAMI (2011)
9. Yao, B., Fei-Fei, L.: Modeling mutual context of object and human pose in human-object interaction activities. In: CVPR (2010)
10. Itti, L., Koch, C.: A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 40 (2000)
11. Ehinger, K.A., Sotelo, B., Torralba, A., Oliva, A.: Modeling search for people in 900 scenes: A combined source model of eye guidance. Visual Cognition 17 (2009)
12. Judd, T., Durand, F., Torralba, A.: Fixations on low resolution images. In: ICCV (2009)
13. Kienzle, W., Schölkopf, B., Wichmann, F.A., Franz, M.O.: How to Find Interesting Locations in Video: A Spatiotemporal Interest Point Detector Learned from Human Eye Movements. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 405-414. Springer, Heidelberg (2007)
14. Fei-Fei, L., Iyer, A., Koch, C., Perona, P.: What do we perceive in a glance of a real-world scene? Journal of Vision (2007)
15. Jhuang, H., Serre, T., Wolf, L., Poggio, T.: A biologically inspired system for action recognition. In: ICCV (2007)
16. Itti, L., Rees, G., Tsotsos, J.K. (eds.): Neurobiology of Attention. Academic Press (2005)
17. Vig, E., Dorr, M., Cox, D.: Space-Variant Descriptor Sampling for Action Recognition Based on Saliency and Eye Movements. In: Fitzgibbon, A., Lazebnik, S., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 84-97. Springer, Heidelberg (2012)
18. Land, M.F., Tatler, B.W.: Looking and Acting. Oxford University Press (2009)
19. Torralba, A., Oliva, A., Castelhano, M., Henderson, J.: Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review 13 (2006)
20. Borji, A., Itti, L.: Scene classification with a sparse set of salient regions. In: ICRA (2011)
21. Elazary, L., Itti, L.: A Bayesian model for efficient visual search and recognition. Vision Research 50 (2010)
22. Wang, H., Klaser, A., Schmid, C.: Liu, C.: Action recognition by dense trajectories. In: CVPR (2011)
23. Li, W., Zhang, Z., Liu, Z.: Expandable data-driven graphical modeling of human actions based on salient postures. In: IEEE TCSVT, vol. 18 (2008)
24. Mathe, S., Sminchisescu, C.: Actions in the eye: dynamic gaze datasets and learnt saliency models for visual recognition. Technical report, Institute of Mathematics of the Romanian Academy and University of Bonn (February 2012)
25. Yarbus, A.: Eye Movements and Vision. Plenum Press, New York (1967)
26. Hwang, A., Wang, H., Pomplun, M.: Semantic guidance of eye movements in real-world scenes. Vision Research (2011)
27. Oliva, A., Torralba, A.: Modeling the shape of the scene: A holistic representation of the spatial envelope. IJCV (42) (2001)
28. Rosenholtz, R.: A simple saliency model predicts a number of motion popout phenomena. Vision Research (39) (1999)
29. Viola, P., Jones, M.: Robust real-time object detection. IJCV (2001)
30. Felzenswalb, P., McAllester, D., Ramanan, D.: A discriminatively trained, multi-scale, deformable part model. In: CVPR (2008)
31. Li, F., Guy, L., Sminchisescu, C.: Chebyshev approximations to the histogram chi-square kernel. In: CVPR (2012)
32. Simocelli, E., Freeman, W.: The steerable pyramid: A flexible architecture for multi-scale derivative computation. In: ICIP (1995)