Efficient visual coding and the predictability of eye movements on natural movies

Spatial Vision

Volumn 22, Issue 5, 2009, Pages 397-408

  Vig, Eleonora ^a   Dorr, Michael ^a   Barth, Erhardt ^a  

^a UNIVERSITY OF LÜBECK   (Germany)

Author keywords

Curvature; Efficient visual coding; Eye movements; Intrinsic dimension; Machine learning; Saliency; Visual attention

Indexed keywords

CURVATURE; EFFICIENT VISUAL CODING; INTRINSIC DIMENSION; MACHINE LEARNING; SALIENCY; VISUAL ATTENTION;

LEARNING ALGORITHMS; MOTION PICTURES; ROBOT LEARNING;

EYE MOVEMENTS;

ARTICLE; ARTIFICIAL INTELLIGENCE; ATTENTION; COMPARATIVE STUDY; EYE MOVEMENT; HUMAN; MOVEMENT PERCEPTION; PATTERN RECOGNITION; PHYSIOLOGY;

ARTIFICIAL INTELLIGENCE; ATTENTION; EYE MOVEMENTS; FORM PERCEPTION; HUMANS; MOTION PERCEPTION;

EID: 70349602522     PISSN: 01691015     EISSN: 15685683     Source Type: Journal    
DOI: 10.1163/156856809789476065     Document Type: Article

References (32)

1. Barth, E., Caelli, T. and Zetzsche, C. (1993). Image encoding, labeling, and reconstruction from differential geometry, CVGIP: Graphical Models and Image Processing 55, 428-446.
2. Barth, E., Dorr, M., Böhme, M., Gegenfurtner, K. R. andMartinetz, T. (2006). Guiding the mind's eye: improving communication and vision by external control of the scanpath, in: Human Vision and Electronic Imaging, B. E. Rogowitz, T. N. Pappas and S. J. Daly (Eds), Proc. SPIE, Vol.6057.
3. Invited contribution for a special session on Eye Movements, Visual Search, and Attention: a Tribute to Larry Stark.
4. Barth, E. and Watson, A. B. (2000). A geometric framework for nonlinear visual coding, Optics Express 7, 155-165.
5. Becker, W. (1991). Saccades, in: Vision and Visual Dysfunction Vol8: Eye Movements, R. H. S. Carpenter (Ed.), pp. 95-137. CRC Press, Boca Raton, FL, USA.
6. Böhme, M., Dorr, M., Krause, C., Martinetz, T. and Barth, E. (2006). Eye movement predictions on natural videos, Neurocomputing 69, 1996-2004.
7. Bruce, N. D. B., Loach, D. P. and Tsotsos, J. K. (2007). Visual correlates of fixation selection: a look at the spatial frequency domain, in: ICIP 2007, San Antonio, Texas, USA, pp. 289-292.
8. Carmi, R. and Itti, L. (2006). Visual causes versus correlates of attentional selection in dynamic scenes, Vision Research 46, 4333-4345.
9. Chang, C.-C. and Lin, C.-J. (2001). LIBSVM: a Library for Support Vector Machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
10. Geisler, W. S. and Perry, J. S. (1998). A real-time foveated multiresolution system for low-bandwidth video communication, in: Human Vision and Electronic Imaging,B. E. Rogowitz and T. N. Pappas (Eds), Proc. SPIE, Vol.3299, pp. 294-305.
11. Granlund, G. H. and Knutsson, H. (1995). Signal Processing for Computer Vision. Kluwer, Dordrecht, The Netherlands.
12. Guo, C., Ma, Q. and Zhang, L. (2008). Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform, in: Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2008), Anchorage, Alaska, USA, pp. 1-8.
13. Itti, L. (2005). Models of bottom-up attention and saliency, in: Neurobiology of Attention, L. Itti, G. Rees and J. K. Tsotsos (Eds), pp. 576-582. Elsevier, San Diego, CA, USA.
14. Itti, L., Koch, C. and Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 1254-1259.
15. Jähne, B., Haußecker, H. and Geißler, P. (Eds) (1999). Handbook of Computer Vision and Applications. Academic Press.
16. Kienzle, W., Schölkopf, B., Wichmann, F. A. and Franz, M. O. (2007). How to find interesting locations in video: a spatiotemporal interest point detector learned from human eye movements, in: Proceedings of the 29th Annual Symposium of the German Association for Pattern Recognition (DAGM 2007), Springer Verlag, Berlin, Germany, pp. 405-414.
17. Krieger, G., Zetzsche, C. and Barth, E. (1995). Nonlinear image operators for the detection of local intrinsic dimensionality, in: Proc. IEEE Workshop Nonlinear Signal and Image Processing, Halkidiki, Greece, pp. 182-185.
18. Krieger, G., Rentschler, I., Hauske, G., Schill, K. and Zetzsche, C. (2000). Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics, Spatial Vision 13, 201-214.
19. Meur, O. L., Callet, P. L. and Barba, D. (2007). Predicting visual fixations on video based on low-level visual features, Vision Research 47, 2483-2498.
20. Mota, C. and Barth, E. (2000). On the uniqueness of curvature features, in: Dynamische Perzeption, G. Baratoff and H. Neumann (Eds), Proceedings in Artificial Intelligence, Vol.9, pp. 175-178. Infix Verlag, Köln.
21. Mota, C., Stuke, I. and Barth, E. (2001). Analytic solutions for multiple motions, in: Proc. IEEE Int. Conf. Image Processing, IEEE Signal Processing Soc., Thessaloniki, Greece, Vol.2, pp. 917-920.
22. Mota, C., Dorr,M., Stuke, I. and Barth, E. (2004). Categorization of transparent-motion patterns using the projective plane, International Journal of Computer and Information Science 5, 129-140.
23. Mota, C., Stuke, I. and Barth, E. (2006). The intrinsic dimension of multispectral images, in: MICCAI Workshop on Biophotonics Imaging for Diagnostics and Treatment, Copenhagen, Denmark, pp. 93-100.
24. Paletta, L. and Rome, E. (Eds) (2007). Attention in Cognitive Systems. Theories and Systems from an Interdisciplinary Viewpoint. Lecture Notes in Computer Science, Vol.4840. Springer.
25. Peters, R. J., Iyer, A., Koch, C. and Itti, L. (2005). Components of bottom-up gaze allocation in natural scenes (Abstract), J. Vision 5, 692.
26. Reinagel, P. and Zador, A. M. (1999). Natural scene statistics at the centre of gaze, Network: Comput. Neural Syst. 10, 341-350.
27. Schölkopf, B. and Smola, A. (2002). LearningWith Kernels.MIT University Press, Cambridge,Mass., USA.
28. Tatler, B.W., Baddeley, R. J. and Gilchrist, I. D. (2005). Visual correlates of fixation selection: effects of scale and time, Vision Research 45, 643-659.
29. Yarbus, A. L. (1967). Eye Movements and Vision. Plenum Press, New York, NY.
30. Zetzsche, C. and Barth, E. (1990). Fundamental limits of linear filters in the visual processing of two-dimensional signals, Vision Research 30, 1111-1117.
31. Zetzsche, C., Barth, E. and Wegmann, B. (1993). The importance of intrinsically two-dimensional image features in biological vision and picture coding, in: Digital Images and Human Vision, A. B. Watson (Ed.), pp. 109-138. MIT Press, Cambridge.
32. Zetzsche, C., Schill, K., Deubel, H., Krieger, G., Umkehrer, E. and Beinlich, S. (1998). Investigation of a sensorimotor system for saccadic scene analysis: an integrated approach, in: From Animals to Animats 5: Proceedings of the Fifth International Conference on Simulation of Adaptive Behavior, R. Pfeifer, B. Blumberg, J.-A. Meyer and S. W. Wilson (Eds), Vol.5, pp. 120-126. MIT Press, Cambridge, Mass., USA.