Real-world vision: Selective perception and task

ACM Transactions on Applied Perception

Volumn 6, Issue 2, 2009, Pages

  Canosa, Roxanne L ^a,b  

^a ROCHESTER INSTITUTE OF TECHNOLOGY   (United States)

^b Rochester Institute of Technology   (United States)

Author keywords

Active vision; Eye tracking; Saliency modeling

Indexed keywords

ACTIVE PROCESS; ACTIVE VISION; CENTRAL FIXATIONS; COMPUTATIONAL MODELS; EYE-TRACKING; FOREGROUND OBJECTS; GOAL-ORIENTED; HUMAN SUBJECTS; HUMAN VISUAL SYSTEMS; REAL-WORLD; SALIENCY MODELING; SELECTIVE ATTENTIONS; SELECTIVE PERCEPTIONS; SELECTIVE PROCESS; SPECIFIC TASKS; TIGHTLY-COUPLED; VISUAL ATTENTIONS; VISUAL PERCEPTIONS; VISUAL SELECTIONS;

EXPERIMENTS; FEATURE EXTRACTION; LOCATION;

EYE MOVEMENTS;

EID: 63049124724     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1498700.1498705     Document Type: Article

References (72)

1. ANDREWS, T. J. AND COPPOLA, D. M. 1999. Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments. Vis. Res. 39, 2947-2953.
2. ARRINGTON, K. F. 2000. History of eye tracking methods. http://www.arringtonresearch.com.
3. BALLARD, D. H., HAYHOE, M. M., AND PELZ, J. B. 1995. Memory representations in natural tasks. J. Cogn. Neurosa. 7, 1, 66-80.
4. BONAIUTO, J. J. AND ITTI, L. 2005. Combining attention and recognition for rapid scene analysis. In Proceedings of IEEE-CVPR Workshop on Attention and Performance in Computer Vision (WAPCV '06). IEEE, Los Alamitos, CA, 1-6.
5. BRUCE, N. AND TSOTSOS, J. 2006. Saliency based on information maximization. In Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS '05). 155-162.
6. BURT, P. J. AND ADELSON, E. H. 1983. The laplacian pyramimd as a compact image code. IEEE Trans. Comm. 31, 4, 532-540.
7. BUSWELL, G. T. 1935. How People Look at Pictures: A Study of the Psychology of Perception in Art. University of Chicago Press, Chicago.
8. CANNY, F. F. 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Vis. 8, 769-798.
9. CANOSA, R. L. 2005. Modeling selective perception of complex natural scenes. Int. J. AI. 14, 1(2), 233-260.
10. CARMI, R. AND ITTI, L. 2006. Visual causes versus correlates of attentional selection in dynamic scenes. Vis. Res. 46, 26, 4333-4345.
11. CARPENTER, D. H. S. 1988. Movements of the Eyes. Pion, London.
12. CHAPMAN, D. 1991. Vision, Instruction, and Action. MIT Press, Cambridge, MA.
13. DESIMONE, R. AND DUNCAN, J. 1995. Neural mechanisms of selective visual attention. Ann. Rev. Neurosci. 18, 193-222.
14. EGETH, H. E. AND YANTIS, S. 1997. Visual attention: Control, representation, and time course. Ann. Rev. Psych. 48, 269-297.
15. EPELBOIM, J. AND SUPPES, P. 2001. A model of eye movements and visual working memory during problem solving in geometry. Vis. Res. 41, 1561-1574.
16. FAIRCHILD, M. D. 1998. Color Appearance Models. Addison-Wesley, Reading, MA.
17. FECTEAU, J. H. ANDMUNOZ, D. P. 2006. Salience, relevance, and firing: A priority map for target selection. TRENDS Cogn. Sci. 10, 8, 382-390.
18. FINDLAY, J. M. AND GILCHRIST, I. D. 2003. Active Vision: The Psychology of Looking and Seeing. Oxford University Press, Oxford, UK.
19. GABOR, D. 1946. Theory of communication. IEEE Proc. 93, 429-441.
20. GODIJN, R. AND THEEUWES, J. 2002. Programming of endogenous and exogenous saccades: Evidence for a competitive integration model. J. Exper. Psych. Hum. Percep. Perform. 28, 5, 1039-1054.
21. GOLDBERG, M. E., EGGERS, H. M., AND GOURAS, P. 1991. The ocular motor system. In Principles of Neural Science 3rd Ed. Appleton & Lange, Norwalk, CT, 660-679.
22. GOTTLIEB, J. P., KUSUNOKI, M., AND GOLDBERG, M. E. 1998. The representation of visual salience in monkey parietal cortex. Nature 391, 29, 481-484.
23. HARNAD, S. 1990. The symbol grounding problem. Physica D 42, 335-346.
24. HAYHOE, M. M. 2000. Vision using routines: A functional account of vision. Vis. Cogn. 7, 43-64.
25. HAYHOE, M. M., BALLARD, D. H., AND PELZ, J. B. 1994. Visual representations in natural tasks. In Proceedings of the Workshop on Visual Behaviors. IEEE, Los Alamitos, CA.
26. HEBB, D. O. 1949. The Organization of Behavior. John Wiley & Sons, New York.
27. HUBEL, D. H. AND WIESEL, T. N. 1968. Receptive fields and functional architecture of monkey striate cortex. J. Physiol. 195, 215-243.
28. HUNT, R. W. G. 1995. The Reproduction of Color 5th ed. Fountain Press, Kingston-Upon-Thames, England.
29. ITTI, L., KOCH, C., AND NIEBUR, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Patt. Anal. Mach. Intell. 20, 11, 1254-1259.
30. ITTI, L., REES, G., AND J. K. TSOTSOS, E. 2005. Neurobiology of Attention. Elsevier, San Diego, CA.
31. IVANOV, Y. AND BOBICK, A. 2000. Recognition of visual activities and interactions by stochastic parsing. IEEE Trans. Patt. Anal. Mach. Intell. 22, 8, 852-872.
32. KAUFMAN, L. AND RICHARDS, W. 1969. Spontaneous fixation tendencies for visual forms. Percept. Psychophys. 5, 2, 85-88.
33. KOWLER, E. 1995. Eye movements. In Visual Cognition 39 2nd Ed. MIT Press, Cambridge, MA.
34. LAND, M. L., MENNIE, N., AND RUSTED, J. 1999. The roles of vision and eye movements in the control of activities of daily living. Perception 28, 1311-1328.
35. LEMEUR, O., CALLET, P., BARBA, D., AND THOREAU, D. 2005. A coherent computational approach to model bottom-up visual attention. Trans. Patt. Anal. Mach. Intell. 28, 5, 802-817.
36. LOWE, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 2, 91-110.
37. MAGEE, D., NEEDHAM, C. J., SANTOS, P., COHN, A. G., AND HOGG, D. C. 2004. Autonomous learning for a cognitive agent using continuous models and inductive logic programming from audio-visual input. In Proceedings of the Workshop on Anchoring Symbols to Sensor Data 4 (AAI-04). AAAI, Menlo Park, CA, 17-24.
38. MANNO, J. L. AND SAKRISON, D. J. 1974. The effects of a visual fidelity criterion on the encoding of images. IEEE Trans. Inform. Theory 20, 4, 525-535.
39. MILANESE, R., WECHSLER, H., GIL, S., BOST, J., AND PUN, T. 1994. Integration of bottom-up and top-down cues for visual attention using non-linear relaxation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Los Alamitos, CA, 781-785.
40. MORAN, J. AND DESIMONE, R. 1985. Selective attention gates visual processing in the extrastriate cortex. Science 229, 782-784.
41. MORGAN, M. J., HOLE, G. J., AND GLENNERSTNER, A. 1990. Biases and sensitivities in geometrical illusions. Vis. Res. 30, 11, 1793-1810.
42. NAVALPAKKAM, V. AND ITTI, L. 2002. A goal oriented attention guidance model. In Proceedings of the 2nd Workshop on Biologically Motivated Computer Vision. Lecture Notes in Computer Science, Springer Verlag, Tubingen, Germany.
43. NAVALPAKKAM, V. AND ITTI, L. 2006. Top-down attention selection is fine grained. J. Vis. 6, 1180-1193.
44. NAVALPAKKAM, V. AND ITTI, L. 2007. Search goal tunes visual features optimally. Neuron 53, 4, 605-617.
45. NORTHDURFT, H. C. 2005. Salience of feature contrast. Neurobiol Attention, 233-239.
46. NOTON, D. AND STARK, L. 1971. Scan paths and saccadic eye movements while viewing and recognizing patterns. Vis. Res. 11, 929-942.
47. PALMER, S. E. 1999. Vision Science: Photons to Phenomenology. MIT Press, Cambridge, MA.
48. PARKHURST, D., LAW, K., AND NIEBUR, E. 2002. Modeling the role of salience in the allocation of overt visual attention. Vis. Res. 42, 1, 107-123.
49. PATTANAIK, S. N., FERWERDA, J. A., FAIRCHILD, M. D., AND GREENBERG, D. P. 1998. A multi-scale model of adaptation and spatial vision for realistic image display. In Proceedings of the ACM SIGGRAPH ACM, New York, 287-298.
50. PELZ, J. B. AND CANOSA, R. L. 2001. Oculomotor behavior and perceptual strategies in complex tasks. Vis. Res. 41, 3587-3596.
51. PELZ, J. B., CANOSA, R. L., AND BABCOCK, J. 2000. Extended tasks elicit complex eye movement patterns. In Proceedings of the ACM SIGCHI Eye-tracking Research and Applications Symposium. ACM, New York.
52. PETERS, R. J. AND ITTI, L. 2007. Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Los Alamitos, CA, 1-8.
53. PETERS, R. J. AND ITTI, L. 2008. Applying computational tools to predict gaze direction in interactive visual environments. ACM Trans. Appl. Percept. 5, 2.
54. PETERS, R. J., IYER, A., ITTI, L., AND KOCH, C. 2005. Components of bottom-up gaze allocation in natural images. Vis. Res. 45, 18, 2397-2416.
55. POSNER, M. I. 1980. Orienting of attention. Q. J. Exper. Psych 32, 3-25.
56. PRIVITERA, C. M. AND STARK, L.W. 2000. Algorithms for defining visual regions of interest: Comparison with eye fixations. IEEE Trans. Patt. Anal. Mach. Intell. 22, 970-982.
57. RAYNER, K. 1983. Eye Movements in Reading: Percpetual and Language Processes. Academic Press, New York.
58. RENSINK, R. A. 2000a. The dynamic representation of scenes. Vis. Cogn. 7, 17-42.
59. RENSINK, R. A. 2000b. Seeing, sensing, and scrutinizing. Vis. Res. 40, 1469-1487.
60. RENSINK, R. A., O'REGAN, J. K., AND CLARK, J. J. 1995. Image flicker is as good as saccades in making large scene changes invisible. Perception 24, 26-27.
61. RUBIN, E. 1921. Visuell Wahrgenommene Figuren. Glydenalske Boghandel, Copenhagen.
62. SANTOS, P., MAGEE, D., COHN, A., AND HOGG, D. 2004. Combining multiple answers for learning mathematical structures from visual observations. In Proceedings of the 16th European Conference on Artificial Intelligence 16. IOS Press, The Netherlands, 544-554.
63. TATLER, B. W., BADDELEY, R. J., AND GILCHRIST, I. D. 2005. Visual correlates of fixation selection: Effects of scale and time. Vis. Res. 45, 643-659.
64. THEEUWES, J. 2004. Top-down search strategies cannot override attentional capture. Psychonomic Bull. Rev. 11, 65-70.
65. TORRALBA, A. 2003. Modeling global scene factors in attention. J. Opt. Soc. Am. 20, 7, 1407-1418.
66. TORRALBA, A., OLIVA, A., CASTELHANO, M. S., AND HENDERSON, J. M. 2006. Contextual guidance of eye movements and attention in real-world scenes: The role of global features on object search. Psych. Rev. 113, 4, 766-786.
67. TREISMAN, A. AND GELADE, G. 1980. A feature integration theory of attention. Cogn. Psych. 12, 97-136.
68. ULLMAN, S. 1984. Visual routines. Cognition 18, 97-106.
69. VAN ZOEST, W., DONK, M., AND THEEUWES, J. 2004. The role of stimulus-driven and goal-driven control in saccadic visual selection. J. Exper. Psych. Hum. Percept. Perform. 30, 4, 746-759.
70. WALTHER, D. AND KOCH, C. 2006. Modeling attention to salient proto-objects. Neural Netw. 19, 1395-1407.
71. WALTHER, D., RUTISHAUSER, U., KOCH, C., AND PERONA, P. 2005. Selective visual attention enables learning and recognition of multiple objects in cluttered scenes. Comput. Vis. Image Understand. 100, 41-63.
72. YARBUS, A. 1967. Eye Movements and Vision L. A. Riggs, translator. Plenum Press, New York.