The role of context in object recognition

Trends in Cognitive Sciences

Volumn 11, Issue 12, 2007, Pages 520-527

  Oliva, Aude ^a   Torralba, Antonio ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; INFORMATION ANALYSIS; REAL TIME SYSTEMS; STATISTICAL METHODS; VISUALIZATION;

CONTEXTUAL INFERENCE; STATISTICAL SUMMARY; VISUAL SYSTEM;

OBJECT RECOGNITION;

EXPERIENTIAL LEARNING; EYE MOVEMENT; HUMAN; IMAGE ANALYSIS; IMAGE PROCESSING; INFORMATION PROCESSING; OBJECT RELATION; RECOGNITION; REVIEW; VISUAL MEMORY; VISUAL ORIENTATION; VISUAL SYSTEM;

ANIMALS; ATTENTION; EYE MOVEMENTS; HUMANS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; RECOGNITION (PSYCHOLOGY);

EID: 36548999696     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tics.2007.09.009     Document Type: Review

References (70)

1. Auckland M.E., et al. Non-target objects can influence perceptual processes during object recognition. Psychon. Bull. Rev. 14 (2007) 332-337
2. Biederman I., et al. Scene perception: detecting and judging objects undergoing relational violations. Cognit. Psychol. 14 (1982) 143-177
3. Davenport J.L., and Potter M.C. Scene consistency in object and background perception. Psychol. Sci. 15 (2004) 559-564
4. Friedman A. Framing pictures: the role of knowledge in automatized encoding and memory of gist. J. Exp. Psychol. Gen. 108 (1979) 316-355
5. Gordon R.D. Attentional allocation during the perception of scenes. J. Exp. Psychol. Hum. Percept. Perform. 30 (2004) 760-777
6. Henderson J.M., et al. Effects of semantic consistency on eye movements during scene viewing. J. Exp. Psychol. Hum. Percept. Perform. 25 (1999) 210-228
7. Palmer S.E. The effects of contextual scenes on the identification of objects. Mem. Cognit. 3 (1975) 519-526
8. Hollingworth A., and Henderson J.M. Does consistent scene context facilitate object detection. J. Exp. Psychol. Gen. 127 (1998) 398-415
9. Torralba A., et al. Contextual guidance of attention in natural scenes: the role of global features on object search. Psychol. Rev. 113 (2006) 766-786
10. Torralba A. Modeling global scene factors in attention. J. Opt. Soc. Am. A 20 (2003) 1407-1418
11. Hoiem D., et al. Putting objects in perspective. Proc. IEEE Comp. Vis. Pattern Recog. 2 (2006) 2137-2144
12. Bar M. Visual objects in context. Nat. Rev. Neurosci. 5 (2004) 617-629
13. Bar M., and Aminoff E. Cortical analysis of visual context. Neuron 38 (2003) 347-358
14. Goh J.O.S., et al. Cortical areas involved in object, background, and object-background processing revealed with functional magnetic resonance adaptation. J. Neurosci. 24 (2004) 10223-10228
15. Aminoff E., et al. The parahippocampal cortex mediates spatial and non-spatial associations. Cereb. Cortex 27 (2007) 1493-1503
16. Gronau, N. et al. Integrated contextual representation for objects' identities and their locations. J. Cogn. Neurosci. (in press)
17. Hock H.S., et al. Contextual relations: the influence of familiarity, physical plausibility, and belongingness. Percept. Psychophys. 16 (1974) 4-8
18. Torralba A. Contextual priming for object detection. Int. J. Comput. Vis. 53 (2003) 169-191
19. Eckstein M.P., et al. Attentional cues in real scenes, saccadic targeting and Bayesian priors. Psychol. Sci. 17 (2006) 973-980
20. Peters R.J., and Itti L. Computational mechanisms for gaze direction in interactive visual environments. Proceedings of the 2006 Symposium on Eye Tracking Research and Applications. San Diego, California, March 27-29, 2006 (2006), ACM 27-32
21. Murphy K.P., et al. Using the forest to see the trees: a graphical model relating features, objects and scenes. Adv. in Neural Information Processing Systems 16 (2003) 1499-1507
22. Chun M.M., and Jiang Y. Top-down attentional guidance based on implicit learning of visual covariation. Psychol. Sci. 10 (1999) 360-365
23. Green C., and Hummel J.E. Familiar interacting object pairs are perceptually grouped. J. Exp. Psychol. Hum. Percept. Perform. 32 (2006) 1107-1119
24. Fiser J., and Aslin R.N. Unsupervised statistical learning of higher-order spatial structures from visual scenes. Psychol. Sci. 12 (2001) 499-504
25. Fiser J., and Aslin R.N. Encoding multi-element scenes: statistical learning of visual feature hierarchies. J. Exp. Psychol. Gen. 134 (2005) 521-537
26. Chun M.M., and Jiang Y. Contextual cueing: Implicit learning and memory of visual context guides spatial attention. Cognit. Psychol. 36 (1998) 28-71
27. Jiang Y., and Chun M.M. Contextual cueing: reciprocal influences between attention and implicit learning. In: Jimenez L. (Ed). Attention and Implicit Learning (2003), John Benjamins Publishing Company 277-296
28. Jiang Y., and Wagner L.C. What is learned in spatial contextual cueing: configuration or individual locations?. Percept. Psychophys. 66 (2004) 454-463
29. Chua K.P., and Chun M.M. Implicit scene learning is viewpoint-dependent. Percept. Psychophys. 65 (2003) 72-80
30. Brockmole J.R., et al. Contextual cueing in naturalistic scenes: global and local contexts. J. Exp. Psychol. Learn. Mem. Cogn. 32 (2006) 699-706
31. Brady T., and Chun M.M. Spatial constraints on learning in visual search: modeling contextual cuing. J. Exp. Psychol. Hum. Percept. Perform. 33 (2007) 798-815
32. Song J.-H., and Jiang Y. Connecting the past with the present: how do humans match an incoming visual display with visual memory?. J. Vis. 5 (2005) 322-330
33. Olson I.R., and Chun M.M. Perceptual constraints on implicit learning of spatial context. Vis. Cogn. 9 (2002) 273-302
34. Peterson M.S., and Kramer A.F. Attentional guidance of the eyes by contextual information and abrupt onsets. Percept. Psychophys. 63 (2001) 1239-1249
35. Hidalgo-Sotelo B., et al. Human learning of contextual priors for object search: where does the time go?. Proceedings of the 3rd Workshop on Attention and Performance in Computer Vision at the Int. CVPR (2005), IEEE Computer Society 1063-1069
36. Kunar M.A., et al. Does contextual cueing guide the deployment of attention?. J. Exp. Psychol. Hum. Percept. Perform. 33 (2007) 816-828
37. Land M.F., and Hayhoe M.M. In what ways do eye movements contribute to everyday activities?. Vision Res. 41 (2001) 3559-3565
38. Oliva A., et al. Panoramic Search: the interaction of memory and vision in search through a familiar scene. J. Exp. Psychol. Hum. Percept. Perform. 30 (2004) 1132-1146
39. Ullman S., et al. Visual features of intermediate complexity and their use in classification. Nat. Neurosci. 5 (2002) 682-687
40. Ariely D. Seeing sets: Representation by statistical properties. Psychol. Sci. 12 (2001) 157-162
41. Alvarez, G. and Oliva, A. The representation of simple ensemble visual features outside the focus of attention. Psychological Science (in press)
42. Chong S.C., and Treisman A. Representation of statistical properties. Vision Res. 43 (2003) 393-404
43. Chong S.C., and Treisman A. Attentional spread in the statistical processing of visual displays. Percept. Psychophys. 67 (2005) 1-13
44. Chong S.C., and Treisman A. Statistical processing: computing the average size in perceptual groups. Vision Res. 45 (2005) 891-900
45. Chubb C., et al. The three dimensions of human visual sensitivity to first-order contrast statistics. Vision Res. 47 (2007) 2237-2248
46. Rosenholtz R., et al. Measuring Visual Clutter. J. Vis. 7 (2007) 1-22
47. Greene, M.R. and Oliva, A. (2006) Natural scene categorization from the conjunction of ecological global properties. In Proceedings of the Twenty-Eighth Annual Conference of the Cognitive Science Society. (Vol. 1), pp. 291-296, Cognitive Science Society
48. Oliva A., and Torralba A. Building the gist of a scene: the role of global image features in recognition. Prog. Brain Res. 155 (2005) 23-36
49. Forsyth D.A., and Ponce J. Computer Vision. A Modern Approach (2003), Prentice Hall
50. Oliva A., and Torralba A. Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42 (2001) 145-175
51. Torralba A., and Oliva A. Statistics of natural images categories. Network Comput. Neural Syst. 14 (2003) 391-412
52. Fei-Fei, L. and Perona, P. (2005) A bayesian hierarchical model for learning natural scene categories. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) (Vol. 2), pp. 524-531, IEEE Computer Society
53. Lazebnik, S. et al. (2006) Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In Proceeding of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06) (Vol. 2), pp. 2169-2178, IEEE Computer Society
54. Vailaya A., et al. On image classification: city images vs. landscapes. Pattern Recognit. 31 (1998) 1921-1935
55. Bosch A., et al. Scene classification via pLSA. Lecture Notes in Computer Science 3954 (2006) 517-530
56. Vogel J., and Schiele B. Semantic Modeling of Natural Scenes for Content-Based Image Retrieval. Int. J. Comput. Vis 72 (2006) 133-157
57. Najemnik J., and Geisler W.S. Optimal eye movement strategies in visual search. Nature 434 (2005) 387-391
58. Thorpe S., et al. Speed of processing in the human visual system. Nature 381 (1996) 520-522
59. Potter M.C. Meaning in visual scenes. Science 187 (1975) 965-966
60. Neider M.B., and Zelinski G.J. Scene context guides eye movements during visual search. Vision Res. 46 (2006) 614-621
61. Over E.A.B., et al. Coarse-to-fine eye movement strategy in visual search. Vision Res. 47 (2007) 2272-2280
62. Itti L., and Koch C. Computational Modeling of Visual Attention. Nat. Rev. Neurosci 2 (2001) 194-203
63. Tsotsos J.K., et al. Modeling visual-attention via selective tuning. Artif. Intell. 78 (1995) 507-545
64. Hollingworth A., and Henderson J.M. Testing a conceptual locus for the inconsistent object change detection advantage in real-world scenes. Mem. Cognit. 31 (2003) 930-940
65. Russell, B. et al. (2007) LabelMe: a database and web-based tool for image annotation. MIT AI Lab Memo AIM-2005-025
66. Davenport J.L. Consistency effects between objects in scenes. Mem. Cognit. 35 (2007) 393-401
67. Epstein R., and Kanwisher N. A Cortical Representation of the Local Visual Environment. Nature 392 (1998) 598-601
68. Kanwisher N. The ventral visual object pathway in humans: evidence from fMRI. In: Chalupa J., and Werner J.S. (Eds). The Visual Neurosciences (2003), MIT Press 1179-1189
69. Walker Renninger L., and Malik J. When is scene identification just texture recognition?. Vision Res. 44 (2004) 2301-2311
70. Smeulders A.W.M., et al. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intel. 22 (2000) 1349-1380