Visual search for arbitrary objects in real scenes

Attention, Perception, and Psychophysics

Volumn 73, Issue 6, 2011, Pages 1650-1671

  Wolfe, Jeremy M ^a,b   Alvarez, George A ^c   Rosenholtz, Ruth ^d   Kuzmova, Yoana I ^b   Sherman, Ashley M ^b  

^a HARVARD MEDICAL SCHOOL   (United States)

^b BRIGHAM AND WOMEN S HOSPITAL   (United States)

^c HARVARD UNIVERSITY   (United States)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Scene perception; Search; Visual search

Indexed keywords

ARTICLE; ASSOCIATION; ATTENTION; COLOR VISION; HUMAN; ORIENTATION; PATTERN RECOGNITION; PERCEPTIVE DISCRIMINATION; REACTION TIME; RECEPTIVE FIELD;

ATTENTION; COLOR PERCEPTION; CUES; DISCRIMINATION (PSYCHOLOGY); FIELD DEPENDENCE-INDEPENDENCE; HUMANS; ORIENTATION; PATTERN RECOGNITION, VISUAL; REACTION TIME;

EID: 79961202705     PISSN: 19433921     EISSN: 1943393X     Source Type: Journal    
DOI: 10.3758/s13414-011-0153-3     Document Type: Article

References (100)

1. Bar, M. (2004). Visual objects in context. Nature Reviews Neuroscience, 5, 617-629.
2. Bauer, B., Jolicœur, P., & Cowan, W. B. (1996). Visual search for colour targets that are or are not linearly-separable from distractors. Vision Research, 36, 1439-1466.
3. Biederman, I., Blickle, T. W., Teitelbaum, R. C., & Klatsky, G. J. (1988). Object search in nonscene displays. Journal of Experimental Psychology. Learning, Memory, and Cognition, 14, 456-467. doi: 10. 1037/0278-7393. 14. 3. 456.
4. Biederman, I., Glass, A. L., & Stacy, E. W. (1973). Searching for objects in real-world scenes. Journal of Experimental Psychology, 97, 22-27.
5. Biederman, I., Mezzanotte, R. J., & Rabinowitz, J. C. (1982). Scene perception: Detecting and judging objects undergoing relational violations. Cognitive Psychology, 14, 143-177.
6. Brady, T. F., Konkle, T., Alvarez, G. A., & Oliva, A. (2008). Visual long-term memory has a massive storage capacity for object details. Proceedings of the National Academy of Sciences, 105, 14325-14329. doi: 10. 1073/pnas. 0803390105.
7. Bravo, M. J., & Farid, H. (2004). Search for a category target in clutter. Perception, 33, 643-652.
8. Bravo, M. J., & Farid, H. (2007). The depth of distractor processing in search with clutter. Perception, 36, 812-829.
9. Bravo, M. J., & Farid, H. (2009). The specificity of the search template. Journal of Vision, 9(1), 34: 1-9.
10. Brockmole, J. R., & Henderson, J. M. (2006). Using real-world scenes as contextual cues for search. Visual Cognition, 13, 99-108. doi: 10. 1080/13506280500165188.
11. Carrasco, M., Evert, D. L., Chang, I., & Katz, S. M. (1995). The eccentricity effect: Target eccentricity affects performance on conjunction searches. Perception & Psychophysics, 57, 1241-1261.
12. Castelhano, M. S., & Heaven, C. (2010). The relative contribution of scene context and target features to visual search in scenes. Attention, Perception, & Psychophysics, 72, 1283-1297.
13. Castelhano, M. S., & Henderson, J. M. (2007). Initial scene representations facilitate eye movement guidance in visual search. Journal of Experimental Psychology. Human Perception and Performance, 33, 753-763.
14. Davenport, J. L., & Potter, M. C. (2004). Scene consistency in object and background perception. Psychological Sciences, 15, 559-564.
15. DiCarlo, J. J., & Cox, D. D. (2007). Untangling invariant object recognition. Trends in Cognitive Sciences, 11, 333-341.
16. Doi, H., & Ueda, K. (2007). Searching for a perceived stare in the crowd. Perception, 36, 773-780.
17. Droll, J., & Eckstein, M. (2008). Expected object position of two hundred fifty observers predicts first fixations of seventy seven separate observers during search. Journal of Vision, 8(6), 320a.
18. Duncan, J., & Humphreys, G. W. (1989). Visual search and stimulus similarity. Psychological Review, 96, 433-458. doi: 10. 1037/0033-295X. 96. 3. 433.
19. Eckstein, M. P., Drescher, B. A., & Shimozaki, S. S. (2006). Attentional cues in real scenes, saccadic targeting, and Bayesian priors. Psychological Science, 17, 973-980.
20. Egeth, H. E., Virzi, R. A., & Garbart, H. (1984). Searching for conjunctively defined targets. Journal of Experimental Psychology. Human Perception and Performance, 10, 32-39.
21. Ehinger, K. A., Hidalgo-Sotelo, B., Torralba, A., & Oliva, A. (2009). Modelling search for people in 900 scenes: A combined source model of eye guidance. Visual Cognition, 17, 945-978.
22. Enns, J. T. (1988). Three-dimensional features that pop-out in visual search. In D. Brogan (Ed.), Visual search (vol. 1) (Vol. 1). London: Taylor & Francis.
23. Enoch, J. M. (1959). Effect of the size of a complex display upon visual search. Journal of the Optical Society of America, 49, 280-286. doi: 10. 1364/JOSA. 49. 000280.
24. Foulsham, T., & Underwood, G. (2007). How does the purpose of inspection influence the potency of visual salience in scene perception? Perception, 36, 1123-1138.
25. Greene, M. R., & Oliva, A. (2008). Recognition of natural scenes from global properties: Seeing the forest without representing the trees. Cognitive Psychology, 58, 137-176.
26. Greene, M. R., & Oliva, A. (2009). The briefest of glances: The time course of natural scene understanding. Psychological Science, 20, 464-472.
27. Hamker, F. (2006). Modeling feature-based attention as an active top-down inference process. Biosystems, 86, 91-99.
28. Henderson, J. M., Brockmole, J. R., Castelhano, M. S., & Mack, M. (2007). Visual saliency does not account for eye movements during visual search in real-world scenes. In R. P. G. van Gompel, M. H. Fischer, W. S. Murray, & R. L. Hill (Eds.), Eye movements: A window on mind and brain (pp. 537-562). Amsterdam: Elsevier.
29. Henderson, J. M., & Ferreira, F. (2004). Scene perception for psycholinguists. In J. M. Henderson & F. Ferreira (Eds.), The interface of language, vision, and action: Eye movements and the visual world (pp. 1-58). New York: Psychology Press.
30. Henderson, J. M., Malcolm, G. L., & Schandl, C. (2009). Searching in the dark: Cognitive relevance drives attention in real-world scenes. Psychonomic Bulletin & Review, 16, 850-856.
31. Henderson, J. M., Weeks, P. A., Jr., & Hollingworth, A. (1999). The effects of semantic consistency on eye movements during complex scene viewing. Journal of Experimental Psychology. Human Perception and Performance, 25, 210-228. doi: 10. 1037/0096-1523. 25. 1. 210.
32. Hershler, O., & Hochstein, S. (2005). At first sight: a high-level pop out effect for faces. Vision Research, 45, 1707-1724.
33. Hershler, O., & Hochstein, S. (2006). With a careful look: Still no low-level confound to face pop-out. Vision Research, 46, 3028-3035. doi: 10. 1016/j. visres. 2006. 03. 023.
34. Hidalgo-Sotelo, B., Oliva, A., & Torralba, A. (2005). Human learning of contextual priors for object search: Where does the time go? Paper presented at the 3rd International Workshop on Attention and Performance in Computer Vision, Washington, DC.
35. Hollingworth, A. (2004). Constructing visual representations of natural scenes: The roles of short- and long-term visual memory. Journal of Experimental Psychology. Human Perception and Performance, 30, 519-537.
36. Hollingworth, A. (2006a). Scene and position specificity in visual memory for objects. Journal of Experimental Psychology. Learning, Memory, and Cognition, 32, 58-69.
37. Hollingworth, A. (2006b). Visual memory for natural scenes: Evidence from change detection and visual search. Visual Cognition, 14, 781-807.
38. Hollingworth, A. (2009). Two forms of scene memory guide visual search: Memory for scene context and memory for the binding of target object to scene location. Visual Cognition, 17, 273-291.
39. Hollingworth, A., & Henderson, J. M. (1999). Object identification is isolated from scene semantic constraint: Evidence from object type and token discrimination. Acta Psychologica, 102, 319-343.
40. Hollingworth, A., & Henderson, J. M. (2000). Semantic informativeness mediates the detection of changes in natural scenes. Visual Cognition, 7, 213-235.
41. Hollingworth, A., & Henderson, J. M. (2002). Accurate visual memory for previously attended objects in natural scenes. Journal of Experimental Psychology. Human Perception and Performance, 28, 113-136.
42. Hwang, A. D., Wang, H.-C., & Pomplun, M. (2011). Semantic guidance of eye movements in real-world scenes. Vision Research, 51, 1192-1205. doi: 10. 1016/j. visres. 2011. 03. 010.
43. Itti, L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40, 1489-1506.
44. Itti, L., & Koch, C. (2001). Computational modelling of visual attention. Nature Reviews Neuroscience, 2, 194-203.
45. Joubert, O. R., Rousselet, G. A., Fize, D., & Fabre-Thorpe, M. (2007). Processing scene context: Fast categorization and object interference. Vision Research, 47, 3286-3297.
46. Kingsley, H. L. (1932). An experimental study of search. The American Journal of Psychology, 44, 314-318. doi: 10. 2307/1414831.
47. Koene, A. R., & Zhaoping, L. (2007). Feature-specific interactions in salience from combined feature contrasts: Evidence for a bottom-up saliency map in V1. Journal of Vision, 7(7), 6: 1-14. doi: 10. 1167/7. 7. 6.
48. Konkle, T., Brady, T. F., Alvarez, G. A., & Oliva, A. (2010). Scene memory is more detailed than you think: The role of categories in visual long-term memory. Psychological Science, 21, 1551-1556. doi: 10. 1177/0956797610385359.
49. Kunar, M. A., Flusberg, S., & Wolfe, J. M. (2008a). The role of memory and restricted context in repeated visual search. Perception & Psychophysics, 70, 314-328. doi: 10. 3758/PP. 70. 2. 314.
50. Kunar, M., Flusberg, S., & Wolfe, J. (2008b). Why don't people use memory when repeatedly searching though an over-learned visual display? Journal of Vision, 8(6), 311a.
51. Kwak, H., Dagenbach, D., & Egeth, H. (1991). Further evidence for a time-independent shift of the focus of attention. Perception & Psychophysics, 49, 473-480.
52. Li, F. F., VanRullen, R., Koch, C., & Perona, P. (2002). Rapid natural scene categorization in the near absence of attention. Proceedings of the National Academy of Sciences, 99, 9596-9601.
53. Malcolm, G. L., & Henderson, J. M. (2009). The effects of target template specificity on visual search in real-world scenes: Evidence from eye movements. Journal of Vision, 9(11), 8: 1-13.
54. Motter, B. C., & Belky, E. J. (1998). The guidance of eye movements during active visual search. Vision Research, 38, 1805-1815.
55. Navalpakkam, V., & Itti, L. (2005). Modeling the influence of task on attention. Vision Research, 45, 205-231.
56. Neider, M. B., & Zelinsky, G. J. (2006). Scene context guides eye movements during visual search. Vision Research, 46, 614-621. doi: 10. 1016/j. visres. 2005. 08. 025.
57. Neider, M. B., & Zelinsky, G. J. (2008). Exploring set size effects in scenes: Identifying the objects of search. Visual Cognition, 16, 1-10. doi: 10. 1080/13506280701381691.
58. Neider, M. B., & Zelinsky, G. J. (2010). Exploring the perceptual causes of search set-size effects in complex scenes. Perception, 39, 780-794. doi: 10. 1068/p6428.
59. Newell, F. N., Brown, V., & Findlay, J. M. (2004). Is object search mediated by object-based or image-based representations? Spatial Vision, 17, 511-541.
60. Nothdurft, H.-C. (1993). The role of features in preattentive vision: Comparison of orientation, motion and color cues. Vision Research, 33, 1937-1958. doi: 10. 1016/0042-6989(93)90020-W.
61. Olds, E. S., Graham, T. J., & Jones, J. A. (2009). Feature head-start: Conjunction search following progressive feature disclosure. Vision Research, 49, 1428-1447.
62. Oliva, A. (2005). Gist of the scene. In L. Itti, G. Rees, & J. Tsotsos (Eds.), Neurobiology of attention (pp. 251-257). San Diego: Academic.
63. Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision, 42, 145-175.
64. Oliva, A., Wolfe, J. M., & Arsenio, H. C. (2004). Panoramic search: The interaction of memory and vision in search through a familiar scene. Journal of Experimental Psychology. Human Perception and Performance, 30, 1132-1146.
65. Pomplun, M. (2006). Saccadic selectivity in complex visual search displays. Vision Research, 46, 1886-1900. doi: 10. 1016/j. visres. 2005. 12. 003.
66. Reddy, L., & VanRullen, R. (2007). Spacing affects some but not all visual searches: Implications for theories of attention and crowding. Journal of Vision, 7(2), 3: 1-17.
67. Rosenholtz, R., Chan, S., & Balas, B. (2009). A crowded model of visual search. Journal of Vision, 9(8), 1197a.
68. Rosenholtz, R., Li, Y., & Nakano, L. (2007). Measuring visual clutter. Journal of Vision, 7(2), 17: 1-22.
69. Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008). LabelMe: A database and web-based tool for image annotation. International Journal of Computer Vision, 77, 157-173.
70. Sanders, A. F., & Donk, M. (1996). Visual search. In O. Neumann & A. F. Sanders (Eds.), Handbook of perception and action: Vol. 3. Attention (pp. 43-77). London: Academic.
71. Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113, 766-786. doi: 10. 1037/0033-295X. 113. 4. 766.
72. Townsend, J. T. (1971). A note on the identification of parallel and serial processes. Perception & Psychophysics, 10, 161-163.
73. Townsend, J. T. (1990). Serial and parallel processing: Sometimes they look like Tweedledum and Tweedledee but they can (and should) be distinguished. Psychological Science, 1, 46-54.
74. Townsend, J. T., & Wenger, M. J. (2004). The serial-parallel dilemma: A case study in a linkage of theory and method. Psychonomic Bulletin & Review, 11, 391-418. doi: 10. 3758/BF03196588.
75. Treisman, A. (1993). The perception of features and objects. In A. Baddeley & L. Weiskrantz (Eds.), Attention: Selection, awareness, and control (pp. 5-35). Oxford: Oxford University Press, Clarendon Press.
76. Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12, 97-136. doi: 10. 1016/0010-0285(80)90005-5.
77. VanRullen, R. (2006). On second glance: Still no high-level pop-out effect for faces. Vision Research, 46, 3017-3027. doi: 10. 1016/j. visres. 2005. 07. 009.
78. Vickery, T. J., King, L.-W., & Jiang, Y. (2005). Setting up the target template in visual search. Journal of Vision, 5(1), 8: 81-92. doi: 10. 1167/5. 1. 8.
79. Vlaskamp, B. N. S., & Hooge, I. T. C. (2006). Crowding degrades saccadic search performance. Vision Research, 46, 417-425. doi: 10. 1016/j. visres. 2005. 04. 006.
80. Võ, M. L. H., & Henderson, J. M. (2009). Does gravity matter? Effects of semantic and syntactic inconsistencies on the allocation of attention during scene perception. Journal of Vision, 9(3), 24: 1-15.
81. Võ, M. L.-H., & Henderson, J. M. (2010). The time course of initial scene processing for eye movement guidance in natural scene search. Journal of Vision, 10(3), 14: 1-13.
82. Võ, M. L. H., & Wolfe, J. M. (2010). The role of incidential object fixations in repeated search: Looking AT versus looking FOR an object in a scene. Visual Cognition, 18, 1533-1536.
83. Võ, M. L.-H., & Wolfe, J. M. (2011). Does repeated search in scenes need memory? Looking AT versus looking FOR objects in scenes. Manuscript submitted for publication.
84. Williams, C. C. (2010). Not all visual memories are created equal. Visual Cognition, 18, 201-228.
85. Williams, M. A., Moss, S. A., Bradshaw, J. L., & Mattingley, J. B. (2005). Look at me, I'm smiling: Visual search for threatening and nonthreatening facial expressions. Visual Cognition, 12, 29-50. doi: 10. 1080/13506280444000193.
86. Wolfe, J. M. (1994). Visual search in continuous, naturalistic stimuli. Vision Research, 34, 1187-1195.
87. Wolfe, J. M. (1998a). Visual search. In H. Pashler (Ed.), Attention (pp. 13-74). Hove: Psychology Press.
88. Wolfe, J. M. (1998b). What can 1 million trials tell us about visual search? Psychological Science, 9, 33-39. doi: 10. 1111/1467-9280. 00006.
89. Wolfe, J. M. (2007). Guided search 4. 0: Current progress with a model of visual search. In W. Gray (Ed.), Integrated models of cognitive systems (pp. 99-119). New York: Oxford University Press.
90. Wolfe, J. M. (2010). Bound to guide: A surprising, preattentive role for conjunctions in visual search. Journal of Vision, 10(7), 1289a.
91. Wolfe, J. M., Cave, K. R., & Franzel, S. L. (1989). Guided search: An alternative to the Feature Integration model for visual search. Journal of Experimental Psychology. Human Perception and Performance, 15, 419-433.
92. Wolfe, J. M., & Horowitz, T. S. (2004). What attributes guide the deployment of visual attention and how do they do it? Nature Reviews Neuroscience, 5, 495-501.
93. Wolfe, J. M., Horowitz, T. S., Kenner, N., Hyle, M., & Vasan, N. (2004). How fast can you change your mind? The speed of top-down guidance in visual search. Vision Research, 44, 1411-1426. doi: 10. 1016/j. visres. 2003. 11. 024.
94. Wolfe, J. M., Klempen, N., & Dahlen, K. (2000). Post-attentive vision. Journal of Experimental Psychology. Human Perception and Performance, 26, 693-716.
95. Wolfe, J. M., O'Neill, P. E., & Bennett, S. C. (1998). Why are there eccentricity effects in visual search? Perception & Psychophysics, 60, 140-156.
96. Wolfe, J. M., Palmer, E. M., & Horowitz, T. S. (2010). Reaction time distributions constrain models of visual search. Vision Research, 50, 1304-1311.
97. Wolfe, J. M., & Reynolds, J. H. (2008). Visual search. In A. I. Basbaum, A. Kaneko, G. M. Shepherd, & G. Westheimer (Eds.), The senses: A comprehensive reference (Vol. 2, pp. 275-280). San Diego: Academic.
98. Wolfe, J. M., & van Wert, M. J. (2010). Varying target prevalence reveals two dissociable decision criteria in visual search. Current Biology, 20, 121-124. doi: 10. 1016/j. cub. 2009. 11. 066.
99. Yang, H., & Zelinsky, G. J. (2009). Visual search is guided to categorically-defined targets. Vision Research, 49, 2095-2103. doi: 10. 1016/j. visres. 2009. 05. 017.
100. Zelinsky, G. (2008). A theory of eye movements during target acquisition. Psychological Review, 115, 787-835. doi: 10. 1037/a0013118.