Fixations on low-resolution images

Journal of Vision

Volumn 11, Issue 4, 2011, Pages 1-20

  Judd, Tilke ^a   Durand, Fredo ^a   Torralba, Antonio ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Attention; Eye movement; Eye tracking; Fixations; Low resolution images; Predictability; Salience; Saliency maps

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; ATTENTION; EYE FIXATION; FEMALE; HUMAN; MALE; METHODOLOGY; MIDDLE AGED; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; RECEIVER OPERATING CHARACTERISTIC; SACCADIC EYE MOVEMENT;

ADOLESCENT; ADULT; ATTENTION; FEMALE; FIXATION, OCULAR; FORM PERCEPTION; HUMANS; MALE; MIDDLE AGED; PHOTIC STIMULATION; ROC CURVE; SACCADES; YOUNG ADULT;

EID: 80051777153     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/11.4.1     Document Type: Article

References (73)

1. Anstis, S. (1998). Picturing peripheral acuity. Perception, 27, 817-825.
2. Avraham, T., & Lindenbaum, M. (2009). Esaliency (Extended Saliency): Meaningful attention using stochastic image modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 693-708.
3. Bachmann, T. (1991). Identification of spatially quantized tachistoscopic images of faces: How many pixels does it take to carry identity? European Journal of Cognitive Psychology, 3, 85-103.
4. Bar, M. (2004). Visual objects in context. Nature Neuroscience Reviews, 5, 617-629.
5. Bar, M. (2007). The proactive brain: Using analogies and associations to generate predictions. Trends in Cognitive Sciences, 11, 280-289.
6. Biederman, I., Mezzanotte, R. J., & Rabinowitz, J. C. (1982). Scene perception: Detecting and judging objects undergoing relational violations. Cognitive Psychology, 14, 143-177.
7. Bruce, N., & Tsotsos, J. K. (2006). Saliency based on information maximization. Advances in Neural Information Processing Systems, 18, 155-162.
8. Bruce, N., & Tsotsos, J. K. (2009). Saliency, attention, and visual search: An information theoretic approach. Journal of Vision, 9(3):5, 1-24, http://www.journalofvision.org/content/9/3/5, doi:10.1167/9.3.5.
9. Buswell, G. T. (1935). How people look at pictures. A study of the psychology of perception in art. Chicago: University of Chicago Press.
10. Castelhano, M. S., & Henderson, J. M. (2008). The influence of color on perception of scene gist. Journal of Experimental Psychology: Human Perception and Performance, 34, 660-675.
11. Cerf, M., Harel, J., Einhäuser, W., & Koch, C. (2008). Predicting human gaze using low-level saliency combined with face detection. Advances in Neural Information Processing Systems, 20, 241-248.
12. De Graef, P., Christiaens, D., & d'Ydevalle, G. (1990). Perceptual effects of scene context on object identification. Psychological Research, 52, 317-329.
13. Ehinger, K. A., Hidalgo-Sotelo, B., Torralba, A.,&Oliva, A. (2009). Modeling search for people in 900 scenes: A combined source model of eye guidance. Visual Cognition, 17, 945-978.
14. Einhäuser, W., Rutishauser, U., & Koch, C. (2008). Taskdemands can immediately reverse the effects of sensorydriven saliency in complex visual stimuli. Journal of Vision, 8(2):2, 1-19, http://www.journalofvision.org/content/8/2/2, doi:10.1167/8.2.2.
15. Einhäuser, W., Spain, M., & Perona, P. (2008). Objects predict fixations better than early saliency. Journal of Vision, 8(14):18, 1-26, http://www.journalofvision.org/content/8/14/18, doi:10.1167/8.14.18.
16. Elazary, L., & Itti, L. (2008). Interesting objects are visually salient. Journal of Vision, 8(3):3, 1-15, http://www.journalofvision.org/content/8/3/3, doi:10.1167/8.3.3.
17. Friedman, A. (1979). Framing pictures: The role of knowledge in automatized encoding and memory of gist. Journal of Experimental Psychology: General, 108, 316-355.
18. Geisler, W. S., & Perry, J. S. (1998). A real-time foveated multi-resolution system for low-bandwidth video communication. In B. Rogowitz & T. Pappas (Eds.), Human Vision and Electronic Imaging, SPIE Proceedings (vol. 3299, pp. 294-305).
19. Harel, J., Koch, C., & Perona, P. (2006). Graph-based visual saliency. Advances in Neural Information Processing Systems, 19, 545-552.
20. Harmon, L. D., & Julesz, B. (1973). Masking in visual recognition: Effects of two-dimensional filtered noise. Science, 180, 1194-1197.
21. Henderson, J. M., Brockmole, J. R., Castelhano, M. S., & Mack, M. (2006). Visual saliency does not account for eye movements during visual search in real-world scenes. In R. van Gompel, M. Fischer, W. Murray, & R. Hill (Eds.), Eye movement research: Insights into mind and brain (pp. 537-562). Oxford, UK: Elsevier.
22. Henderson, J. M., McClure, K. K., Pierce, S.,&Schrock, G. (1997). Object identification without foveal vision: Evidence from an artificial scotoma paradigm. Perception & Psychophysics, 59, 323-346.
23. Henderson, J. M., Weeks, P. A., Jr., & Hollingworth, A. (1999). Effects of semantic consistency on eye movements during scene viewing. Journal of Experimental Psychology: Human Perception and Performance, 25, 210-228.
24. Hershler, O., & Hochstein, S. (2005). At first sight: A high-level pop out effect for faces. Vision Research, 45, 1707-1724.
25. Hershler, O., & Hochstein, S. (2006). With a careful look: Still no low-level confound to face pop-out. Vision Research, 46, 3028-3035.
26. Hou, X., & Zhang, L. (2007). Saliency detection: A spectral residual approach. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1-8).
27. Itti, L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40, 1489-1506.
28. Itti, L., Koch, C., & Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Vision, 20, 1254.
29. Judd, T., Durand, F., & Torralba, A. (2009). Learning to predict where humans look. Paper presented at the IEEE Conference on Computer Vision (ICCV).
30. Kayser, C., Nielsen, K. J., & Logothetis, N. K. (2006). Fixations in natural scenes: Interaction of image structure and image content. Vision Research, 46, 2535-2545.
31. Kienzle, W., Wichmann, F. A., Scholkopf, B., & Franz, M. O. (2007). A nonparametric approach to bottom-up visual saliency. In B. Scholkopf, J. C. Platt, & T. Hoffman (Eds.), NIPS (pp. 689-696).
32. Koch, C., & Ullman, S. (1985). Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology, 4, 219-227.
33. Le Meur, O., Le Callet, P., & Barba, D. (2007). Predicting visual fixations on video based on low-level visual features. Vision Research, 47, 2483-2498.
34. Li, Z. (2002). A saliency map in primary visual cortex. Trends in Cognitive Sciences, 6, 9-16.
35. Loftus, G. R., & Mackworth, N. H. (1978). Cognitive determinants of fixation location during picture viewing. Journal of Experimental Psychology: Human Perception and Performance, 4, 565-572.
36. Mannan, S., Ruddock, K. H., & Wooding, D. S. (1995). Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images. Spatial Vision, 9, 363-386.
37. McCotter, M., Gosselin, F., Sowden, P., & Schyns, P. G. (2005). The use of visual information in natural scenes. Visual Cognition, 12, 938-953.
38. Navalpakkam, V., & Itti, L. (2007). Search goal tunes visual features optimally. Neuron, 53, 605-617.
39. Neider, M. B., & Zelinsky, G. J. (2006). Scene context guides eye movements during visual search. Vision Research, 46, 614-621.
40. Niebur, E., & Koch, C. (1995). The attentive brain (pp. 163-186). Cambridge, MA: MIT Press.
41. Oliva, A. (2005). Gist of the scene. In L. Itti, G. Rees, & J. K. Tsotsos (Eds.), The encyclopedia of neurobiology of attention (pp. 251-256). San Diego, CA: Elsevier.
42. Oliva, A., & Schyns, P. G. (2000). Diagnostic colors mediate scene recognition. Cognitive Psychology, 41, 176-210.
43. Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision, 42, 145-175.
44. Oliva, A., Torralba, A., Castelhano, M., & Henderson, J. (2003). Top-down control of visual attention in object detection. Proceedings of the 2003 International Conference on Image Processing, 1, 253-256.
45. Parkhurst, D. J., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42, 107-123.
46. Parkhurst, D. J., & Niebur, E. (2003). Scene content selected by active vision. Spatial Vision, 16, 125-154.
47. Peters, R. J., Iyer, A., Itti, L., & Koch, C. (2005). Components of bottom-up gaze allocation in natural images. Vision Research, 45, 2397-2416.
48. Potter, M. C. (1975). Meaning in visual scenes. Science, 187, 965-966.
49. Potter, M. C., & Levy, E. I. (1969). Recognition memory for a rapid sequence of pictures. Journal of Experimental Psychology, 81, 10-15.
50. Privitera, C. M., & Stark, L. W. (2000). Algorithms for defining visual regions-of-interest: Comparison with eye fixations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 970-982.
51. Ramanathan, S., Katti, H., Sebe, N., Kankanhalli, M., & Chua, T.-S. (2010). An eye fixation database for saliency detection in images. Paper presented at the European Conference on Computer Vision.
52. Rao, R. P., Zelinsky, G. J., Hayhoe, M. M.,&Ballard, D. H. (2002). Eye movements in iconic visual search. Vision Research, 42, 1447-1463.
53. Renninger, L. W., Verghese, P., & Coughlan, J. (2007). Where to look next? Eye movements reduce local uncertainty. Journal of Vision, 7(3):6, 1-17, http://www.journalofvision.org/content/7/3/6, doi:10.1167/7.3.6.
54. Rosenholtz, R. (1999). A simple saliency model predicts a number of motion popout phenomena. Vision Research, 39, 3157-3163.
55. Schyns, P. G., & Oliva, A. (1997). Flexible, diagnosticallydriven, rather than fixed, perceptually determined scale selection in scene and face recognition. Perception, 26, 1027-1038.
56. Simoncelli, E. (2011). The Steerable Pyramid Toolbox. Available at http://www.cns.nyu.edu/~eero/steerpyr/.
57. Sinha, P., Balas, B. J., Ostrovsky, Y., & Russell, R. (2006). Face recognition by humans: 19 results all computer vision researchers should know about. Proceedings of the IEEE, 94, 1948-1962.
58. Tatler, B. W. (2007). The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(14):4, 1-17, http://www.journalofvision.org/content/7/14/4, doi:10.1167/7.14.4.
59. Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005). Visual correlates of fixation selection: Effects of scale and time. Vision Research, 45, 643-659.
60. Tatler, B. W., & Vincent, B. T. (2009). The prominence of behavioural biases in eye guidance. Visual Cognition, 17, 1029-1054.
61. Torralba, A. (2003). Modeling global scene factors in attention. Journal of the Optical Society of America A: Special Issue on Bayesian and Statistical Approaches to Vision, 20, 1407-1418.
62. Torralba, A. (2009). How many pixels make an image? Visual Neuroscience, 26, 123-131.
63. Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113, 766-786.
64. Tseng, C., Cameron, M., & Itti, L. (2009). Quantifying center bias of observers in free viewing of dynamic natural scenes. Journal of Vision, 9(7):4, 1-16, http://www.journalofvision.org/content/9/7/4, doi:10.1167/9.7.4.
65. Tsotsos, J. K., Culhane, S., Wai, W., Lai, Y., Davis, N., & Nuflo, F. (1995). Modeling visual attention via selective tuning. Artificial Intelligence, 78, 507-547.
66. Underwood, G., Foulsham, T., van Loon, E., Humphreys, L., & Bloyce, J. (2006). Eye movements during scene inspection: A test of the saliency map hypothesis. European Journal of Cognitive Psychology, 18, 321-343.
67. VanRullen, R. (2006). On second glance: Still no highlevel pop-out effect for faces. Vision Research, 46, 3017-3027.
68. van Zoest, W., Donk, M., & Theeuwes, J. (2004). The role of stimulus-driven and goal-driven control in saccadic visual selection. Journal of Experimental Psychology: Human Perception and Performance, 30, 746-759.
69. Velichkovsky, B., Pomplun, M., & Rieser, J. (1996). Attention and communication: Eye-movement-based research paradigms. In W. H. Zangemeister, H. S. Stiehl, & C. Freksa (Eds.), Visual attention & cognition (pp. 125-154). Amsterdam, The Netherlands: Elsevier.
70. William, J. (1981). Principles of psychology. Cambridge, MA: Harvard University Press. (Originally published in 1890)
71. Wolfe, J. M. (1998). Visual memory: What do you know about what you saw? Current Biology, 8, R303-R304.
72. Yarbus, A. L. (1967). Eye movements and vision. New York: Plenum.
73. Zhang, L., Tong, M. H., Marks, T. K., Shan, H., & Cottrell, G. W. (2008). SUN: A Bayesian framework for saliency using natural statistics. Journal of Vision, 8(7):32, 1-20, http://www.journalofvision.org/content/8/7/32, doi:10.1167/8.7.32.