Decoding what people see from where they look: Predicting visual stimuli from scanpaths

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5395 LNAI, Issue , 2009, Pages 15-26

  Cerf, Moran ^a   Harel, Jonathan ^a   Huth, Alex ^a   Einhäuser, Wolfgang ^b   Koch, Christof ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b PHILIPPS UNIVERSITY MARBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ATTENTIONAL SHIFTS; CORRECTNESS RATES; DISCRIMINABILITY; IMAGE CONTENTS; POTENTIAL APPLICATIONS; SALIENCY MAPS; VISUAL STIMULUS;

BRAIN; DECODING; EYE MOVEMENTS; IMAGE SEGMENTATION;

COGNITIVE SYSTEMS;

EID: 63449140678     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-00582-4_2     Document Type: Conference Paper

References (28)

1. Young, M., Yamane, S.: Sparse population coding of faces in the inferotemporal cortex. Science 256(5061), 1327-1331 (1992)
2. Schwartz, E., Desimone, R., Albright, T., Gross, C.: Shape Recognition and Inferior Temporal Neurons. Proceedings of the National Academy of Sciences of the United States of America 80(18), 5776-5778 (1983)
3. Sato, T., Kawamura, T., Iwai, E.: Responsiveness of inferotemporal single units to visual pattern stimuli in monkeys performing discrimination. Experimental Brain Research 38(3), 313-319 (1980)
4. Perrett, D., Rolls, E., Caan, W.: Visual neurones responsive to faces in the monkey temporal cortex. Experimental Brain Research 47(3), 329-342 (1982)
5. Logothetis, N., Pauls, J., Poggio, T.: Shape representation in the inferior temporal cortex of monkeys. Current Biology 5(5), 552-563 (1995)
6. Hung, C, Kreiman, G., Poggio, T., DiCarlo, J.: Fast Readout of Object Identity from Macaque Inferior Temporal Cortex (2005)
7. Quiroga, R., Reddy, L., Koch, C, Fried, I.: Decoding Visual Inputs From Multiple Neurons in the Human Temporal Lobe. Journal of Neurophysiology 98(4), 1997 (2007)
8. Itti, L., Koch, C, Niebur, E., et al.: A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11), 1254-1259 (1998)
9. Dickinson, S., Christensen, H., Tsotsos, J., Olofsson, G.: Active object recognition integrating attention and viewpoint control. Computer Vision and Image Understanding 67(3), 239-260 (1997)
10. Koch, C, Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Hum. Neurobiol. 4(4), 219-227 (1985)
11. Yarbus, A.: Eye Movements and Vision. Plenum Press, New York (1967)
12. Goldstein, R., Woods, R., Peli, E.: Where people look when watching movies: Do all viewers look at the same place? Computers in Biology and Medicine 37(7), 957-964 (2007)
13. Privitera, C, Stark, L.: Evaluating image processing algorithms that predict regions of interest. Pattern Recognition Letters 19(11), 1037-1043 (1998)
14. Itti, L., Koch, C: Computational modeling of visual attention. Nature Rev. Neu-rosci. 2(3), 194-203 (2001)
15. Peters, R., Iyer, A., Itti, L., Koch, C: Components of bottom-up gaze allocation in natural images. Vision Res. 45(18), 2397-2416 (2005)
16. Tatler, B., Baddeley, R., Gilchrist, I.: Visual correlates of fixation selection: effects of scale and time. Vision Research 45(5), 643-659 (2005)
17. Cerf, M., Harel, J., Einhauser, W., Koch, C: Predicting human gaze using low-level saliency combined with face detection. In: Piatt, J., Koller, D., Singer, Y., Roweis, S. (eds.) Advances in Neural Information Processing Systems, vol. 20. MIT Press, Cambridge (2008)
18. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. Computer Vision and Pattern Recognition 1, 511-518 (2001)
19. Buswell, G.: How People Look at Pictures: A Study of the Psychology of Perception in Art. The University of Chicago press (1935)
20. Barton, J.: Disorders of face perception and recognition. Neurol. Clin. 21(2), 521-548 (2003)
21. Klin, A., Jones, W., Schultz, R., Volkmar, F., Cohen, D.: Visual Fixation Patterns During Viewing of Naturalistic Social Situations as Predictors of Social Competence in Individuals With Autism (2002)
22. Adolphs, R.: Neural systems for recognizing emotion. Curr. Op. Neurobiol. 12(2), 169-177 (2002)
23. Baddeley, R., Tatler, B.: High frequency edges (but not contrast) predict where we fixate: A Bayesian system identification analysis. Vision Research 46(18), 2824- 2833 (2006)
24. Einhauser, W., Konig, P.: Does luminance-contrast contribute to a saliency map for overt visual attention?. Eur. J. Neurosci. 17(5), 1089-1097 (2003)
25. Einhäuser, W., Kruse, W., Hoffmann, K, Konig, P.: Differences of monkey and human overt attention under natural conditions. Vision Res. 46(8-9), 1194-1209 (2006)
26. Navalpakkam, V., Itti, L.: Search goal tunes visual features optimally. Neuron 53(4), 605-617 (2007)
27. Kayser, C, Nielsen, K., Logothetis, N.: Fixations in natural scenes: Interaction of image structure and image content. Vision Res. 46(16), 2535-2545 (2006)
28. Einhäuser, W., Rutishauser, U., Frady, E., Nadler, S., König, P., Koch, C: The relation of phase noise and luminance contrast to overt attention in complex visual stimuli. J. Vis. 6(11), 1148-1158 (2006)