Flexible visual processing of spatial relationships

Cognition

Volumn 122, Issue 2, 2012, Pages 210-227

  Franconeri, Steven L ^a   Scimeca, Jason M ^a   Roth, Jessica C ^a   Helseth, Sarah A ^a   Kahn, Lauren E ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Attention; Binding; Comparison; Selection; Spatial language; Spatial relationships

Indexed keywords

ARTICLE; DECISION MAKING; DYNAMICS; ELECTROPHYSIOLOGY; EVENT RELATED POTENTIAL; HUMAN; HUMAN EXPERIMENT; PERCEPTION; PRIORITY JOURNAL; SPATIAL ORIENTATION; VISION;

ADULT; ATTENTION; CEREBRAL CORTEX; ELECTROENCEPHALOGRAPHY; EYE MOVEMENTS; HUMANS; PHOTIC STIMULATION; SPACE PERCEPTION;

EID: 84155165336     PISSN: 00100277     EISSN: 18737838     Source Type: Journal    
DOI: 10.1016/j.cognition.2011.11.002     Document Type: Article

References (140)

1. Abrahamse E.L., Van der Lubbe R.H.J. Endogenous orienting modulates the Simon effect: Critical factors in experimental design. Psychological Research 2008, 72:261-272.
2. Altmann G.T.M., Kamide Y. Discourse-mediation of the mapping between language and the visual world: Eye-movements and mental representation. Cognition 2009, 111:55-71.
3. Atchley P., Kramer A.F. Object and space-based attentional selection in three-dimensional space. Visual Cognition 2001, 8(1):1-32.
4. Bahcall D.O., Kowler E. Attentional interference at small spatial separations. Vision Research 1999, 39(1):71-86.
5. Biederman I. Recognition-by-components: A theory of human image understanding. Psychological Review 1987, 94(2):115-147.
6. Biederman I., Lescroart M., Hayworth K. Sensitivity to object-centered relations in LOC [Abstract]. Journal of Vision 2007, 7(9):1030.
7. Borst G., Kosslyn S.M. Varying the scope of attention alters the encoding of categorical and coordinate spatial relations. Neuropsychologia 2010, 48:2769-2772.
8. Brandt S.A., Stark L.W. Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of Cognitive Neuroscience 1997, 9:27-38.
9. Cantlon J.F., Platt M.L., Brannon E.M. Beyond the number domain. Trends in Cognitive Sciences 2009, 13(2):83-91.
10. Carlson L.A. Selecting a reference frame. Spatial Cognition and Computation 2000, 1(4):365-379.
11. Carlson L.A., Logan G.D. Using spatial terms to select an object. Memory & Cognition 2001, 29:883-892.
12. Carlson L.A., Logan G.D. Attention and spatial language. Neurobiology of attention 2005, 330-336. Elsevier, San Diego, CA. L. Itti, G. Rees, J. Tsotsos (Eds.).
13. Carrasco M., Evert D.L., Chang I., Katz S.M. The eccentricity effect: Target eccentricity affects performance on conjunction searches. Perception & Psychophysics 1995, 57(8):1241-1261.
14. Cavanagh P. Attention routines and the architecture of selection. Cognitive neuroscience of attention 2004, 13-28. Guilford Press, New York, NY. M. Posner (Ed.).
15. Cave K.R., Zimmerman J.M. Flexibility in spatial attention before and after practice. Psychological Science 1997, 8:399-403.
16. Chabris C.F., Kosslyn S.M. How do the cerebral hemispheres contribute to encoding spatial relations?. Current Directions in Psychological Science 1998, 7(1):8-14.
17. Clark H.H., Chase W.G. On the process of comparing sentences against pictures. Cognitive Psychology 1972, 3(3):472-517.
18. Cohen J.Y., Heitz R.P., Schall J.D., Woodman G.F. On the origin of event-related potentials indexing covert attentional selection during visual search. Journal of Neurophysiology 2009, 102:2375-2386.
19. Crawford L.E., Regier T., Huttenlocher J. Linguistic and non-linguistic spatial categorization. Cognition 2000, 75:209-235.
20. Cuijpers R.H., Kappers A.M., Koenderink J.J. On the role of external reference frames on visual judgements of parallelity. Acta Psychologica 2001, 108:283-302.
21. Dessalegn B., Landau B. More than meets the eye: The role of language in binding and maintaining feature conjunctions. Psychological Science 2008, 19(2):189-195.
22. Eimer M. The N2pc component as an indicator of attentional selectivity. Electroencephalography and Clinical Neurophysiology 1996, 99(3):225-234.
23. Enns J.T., Rensink R.A. Influence of scene-based properties on visual search. Science 1990, 247:721-723.
24. Eriksen C.W., Schultz D.W. Retinal locus and acuity in visual information processing. Bulletin of the Psychonomic Society 1977, 9(2):81-84.
25. Feigenson L., Dehaene S., Spelke E.S. Core systems of number. Trends in Cognitive Sciences 2004, 8(7):307-314.
26. Fodor J., Pylyshyn Z.W. Connectionism and cognitive architecture. Cognition 1988, 28:3-71.
27. Franconeri, S. L. (in press). In D. Resiberg (Ed.). The nature and status of visual resources. Oxford University Press.
28. Franconeri S.L., Bemis D.K., Alvarez G.A. Number estimation relies on a set of segmented objects. Cognition 2009, 113:1-13.
29. Gentner D., Loewenstein J. Relational language and relational thought. Language, literacy, and cognitive development 2002, 87-120. LEA, Mahwah, NJ. J. Byrnes, E. Amsel (Eds.).
30. Ghirardelli T.G., Folk C.L. Spatial cuing in a stereoscopic display: Evidence for a 'depth-blind' attentional spotlight. Psychonomic Bulletin & Review 1996, 3:81-86.
31. Gleitman L., January D., Nappa R., Trueswell J. On the give and take between event apprehension and utterance formulation. Journal of Memory and Language 2007, 57(4):544-569.
32. Gottlieb J. From thought to action: The parietal cortex as a bridge between perception, action, and cognition. Neuron 2007, 53:9-16.
33. Gray C.M., Singer W. Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. Proceedings of the National Academy of Sciences USA 1989, 86:1698-1702.
34. Griffin Z.M., Bock K. What the eyes say about speaking. Psychological Science 2000, 11:274-279.
35. Guzman-Martinez E., Leung P., Franconeri S.L., Grabowecky M., Suzuki S. Rapid eye-fixation training without eye tracking. Psychonomic Bulletin & Review 2009, 16:491-496.
36. Halford G.S., Wilson W.H., Phillips S. Relational knowledge: The foundation of higher cognition. Trends in Cognitive Sciences 2010, 14(11):497-505.
37. Hayward W. After the viewpoint debate: Where next in object recognition?. Trends in Cognitive Sciences 2003, 7(10):425-427.
38. Hayward W.G., Tarr M.J. Spatial language and spatial representation. Cognition 1995, 55:39-84.
39. Hayworth, K. J. (2009). PhD thesis. Explicit encoding of spatial relations in the human visual system: Evidence from functional neuroimaging.
40. Hayworth K., Lescroart M., Biederman I. Explicit relation coding in the Lateral Occipital Complex [Abstract]. Journal of Vision 2008, 8(6):35.
41. He Z.J., Nakayama K. Visual attention to surfaces in three-dimensional space. Proceedings of the National Academy of Sciences of the USA 1995, 92:11155-11159.
42. Henderson J.M., Hollingworth A. High-level scene perception. Annual Review of Psychology 1999, 50:243-271.
43. Hickey C., Di Lollo V., McDonald J.J. Electrophysiological indices of target and distractor processing in visual search. Journal of Cognitive Neuroscience 2009, 21:760-775.
44. Hilimire M.R., Mounts J.R.W., Parks N.A., Corballis P.M. Competitive interaction degrades target selection: An ERP study. Psychophysiology 2009, 46:1080-1089.
45. Hillyard S.A., Galambos R. Eye movement artifact in the CNV. Electroencephalography and Clinical Neurophysiology 1970, 28:173-182.
46. Hillyard S.A., Vogel E.K., Luck S.J. Sensory gain control (amplification) as a mechanism of selective attention: Electrophysiological and neuroimaging evidence. Philosophical Transactions of the Royal Society: Biological Sciences 1998, 393:1257-1270.
47. Holcombe A.O., Cavanagh P. Early binding of feature pairs for visual perception. Nature Neuroscience 2001, 4(2):127-128.
48. Holcombe A.O., Linares D., Vaziri-Pashkam M. Perceiving spatial relations via attentional tracking and shifting. Current Biology 2011, 21(13):1135-1139.
49. Holden M., Curby K., Newcombe N.S., Shipley T.F. A category adjustment approach to memory for spatial location in natural scenes. Journal of Experimental Psychology: Learning, Memory and Cognition 2010, 36:590-604.
50. Hopf J.M., Boehler C.N., Luck S.J., Tsotsos J.K., Heinze H.J., Schoenfeld A.M. Direct neurophysiological evidence for spatial suppression surrounding the focus of attention in vision. Proceedings of the National Academy of Sciences 2006, 103:1053-1058.
51. Hopf J.M., Luck S.J., Girelli M., Hagner T., Mangun G.R., Scheich H., et al. Neural sources of focused attention in visual search. Cerebral Cortex 2000, 10(12):1233-1241.
52. Huang L., Pashler H. Attention capacity and task difficulty in visual search. Cognition 2005, 94:B101-B111.
53. Hummel J.E. Where view-based theories break down: The role of structure in shape perception and object recognition. Cognitive dynamics: Conceptual change in humans and machines 2000, 157-185. Erlbaum, Mahwah, NJ. E. Dietrich, A. Markman (Eds.).
54. Hummel, J. E. (in press). Object recognition. In D. Reisberg (Ed.) Oxford handbook of cognitive psychology. Oxford, England: Oxford University Press.
55. Hummel J.E., Biederman I. Dynamic binding in a neural network for shape recognition. Psychological Review 1992, 99:480-517.
56. Hummel J.E., Holyoak K.J. A symbolic-connectionist theory of relational inference and generalization. Psychological Review 2003, 110:220-264.
57. Hyun J.-S., Woodman G.F., Luck S.J. The role of attention in the binding of surface features to locations. Visual Cognition 2009, 17:10-24.
58. Jager G., Postma A. On the hemispheric specialization for categorical and coordinate spatial relations: A review of the current evidence. Neuropsychologia 2003, 41(4):504-515.
59. Jewell G., McCourt M.E. Pseudoneglect: A review and meta-analysis of performance factors in line bisection tasks. Neuropsychologia 2000, 38:93-110.
60. Jolicoeur P., Ullman S., Mackay L. Curve tracing: A possible basic operation in the perception of spatial relations. Memory & Cognition 1986, 14:129-140.
61. Kadosh R.C., Lammertyn J., Izard V. Are numbers special? An overview of chronometric, neuroimaging, developmental and comparative studies of magnitude representation. Progress in Neurobiology 2008, 84(2):132-147.
62. Kimchi R. Primacy of holistic processing and global/local paradigm: A critical review. Psychological Bulletin 1992, 112(1):24-38.
63. Kosslyn S.M. Seeing and imagining in the cerebral hemispheres: A computational approach. Psychological Review 1987, 94:148-175.
64. Laeng B., Okubo M., Saneyoshi A., Michimata C. Processing spatial relations with different apertures of attention. Cognitive Science 2010, 35(2):297-329.
65. Levinthal B., Franconeri S.L. Common fate grouping as feature selection. Psychological Science 2011, 22(9):1132-1137.
66. Lipinsky J., Spencer J.P., Samuelson L.K. Corresponding delay-dependent biases in spatial language and spatial memory. Psychological Research 2009, 74(3):337-351.
67. Logan G.D. Spatial attention and the apprehension of spatial relations. Journal of Experimental Psychology: Human Perception and Performance 1994, 20(5):1015-1036.
68. Logan G.D. Linguistic and conceptual control of visual spatial attention. Cognitive Psychology 1995, 28(2):103-174.
69. Logan G.D., Sadler D.D. A computational analysis of the apprehension of spatial relations. Language and space 1996, 493-529. MIT Press, Cambridge, MA. P. Bloom, M.A. Peterson, L. Nadel, M. Garrett (Eds.).
70. Logan G.D., Zbrodoff N.J. Selection for cognition: Cognitive constraints on visual spatial attention. Visual Cognition 1999, 6:55-81.
71. Luck, S. J. (in press). Electrophysiological correlates of the focusing of attention within complex visual scenes: N2pc and related components. In S. J. Luck, & E. S. Kappenman (Eds.), Oxford handbook of event-related potential components. New York: Oxford University Press.
72. Luck S.J., Fan S., Hillyard S.A. Attention-related modulation of sensory-evoked brain activity in a visual search task. Journal of Cognitive Neuroscience 1993, 5:188-195.
73. Luck S.J., Ford M.A. On the role of selective attention in visual perception. Proceedings of the National Academy of Science 1998, 95:825-830.
74. Luck S.J., Girelli M., McDermott M.T., Ford M.A. Bridging the gap between monkey neurophysiology and human perception: An ambiguity resolution theory of visual selective attention. Cognitive Psychology 1997, 33:64-87.
75. Luck S.J., Hillyard S.A. Electrophysiological correlates of feature analysis during visual search. Psychophysiology 1994, 31:291-308.
76. Marrara M.T., Moore C.M. Role of perceptual organization while attending in depth. Perception & Psychophysics 2000, 62:786-799.
77. McClelland J.L., Rumelhart D.E. An interactive activation model of context effects in letter perception: Part 1. An account of Basic Findings. Psychological Review 1981, 88:375-407.
78. McCourt M.E., Jewell G. Visuospatial attention in line bisection: Stimulus modulation of pseudoneglect. Neuropsychologia 1999, 37(7):843-855.
79. Meck W.H., Church R.M. A mode control model of counting and timing processes. Journal of Experimental Animal Behavior 1983, 9:320-334.
80. Miller G. The magical number seven, plus or minus two. Psychological Review 1956, 63:81.
81. Milner A model for visual shape recognition. Psychological Review 1974, 81:521-535.
82. Moore C.M., Elsinger C.L., Lleras A. Visual attention and the apprehension of spatial relations: The case of depth. Perception & Psychophysics 2001, 63:595-606.
83. Moran J., Desimone R. Selective attention gates visual processing in the extrastriate cortex. Science 1985, 229:782-784.
84. Mou W., McNamara T.P. Intrinsic frames of reference in spatial memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 2002, 28:162-170.
85. Navon D. Forest before trees: The precedence of global features in visual perception. Cognitive Psychology 1977, 9:353-383.
86. Nicoletti R., Umilta C. Attention shifts produce spatial stimulus codes. Psychological Research 1994, 56:144-150.
87. Noë A., O'Reagan J. Perception, attention and the grand illusion. Psyche: An Interdisciplinary. Journal of Research on Consciousness 2000, 6(15).
88. Noton D., Stark L. Eye movements and visual perception. Scientific American 1971, 224(6):35-43.
89. Oliva A., Torralba A. The role of context in object recognition. Trends in Cognitive Sciences 2007, 11(12):520-527.
90. Palmer J. Mechanisms of displacement discrimination with and without perceived movement. Journal of Experimental Psychology: Human Perception and Performance 1986, 12:411-421.
91. Palmer J. Mechanisms of displacement discrimination with a visual reference. Vision Research 1986, 12:1939-1947.
92. Palmer J. Set-size effects in visual search: The effect of attention is independent of the stimulus for simple tasks. Vision Research 1994, 13:1703-1721.
93. Pinel P., Piazza M., Le Bihan D., Dehaene S. Distributed and overlapping cerebral representations of number, size, and luminance during comparative judgments. Neuron 2004, 41:983-993.
94. Pinker S. Mental imagery and the third dimension. Journal of Experimental Psychology: General 1980, 109:254-371.
95. Proctor R.W., Lu C.-H. Referential coding and attention-shifting accounts of the Simon effect. Psychological Research 1994, 56:185-195.
96. Pylyshyn Z.W. The role of location indexes in spatial perception: A sketch of the FINST spatial-index model. Cognition 1989, 32:65-97.
97. Ramachandran V.S. Perception of shape from shading. Nature 1988, 331(14):163-166.
98. Rayner K., Duffy S.A. Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity. Memory & Cognition 1986, 14(3):191-201.
99. Reddy L., VanRullen R. Spacing affects some but not all visual searches: Implications for theories of attention and crowding. Journal of Vision 2007, 7(2):1-17.
100. Regier T., Carlson L.A. Grounding spatial language in perception: An empirical and computational investigation. Journal of Experimental Psychology: General 2001, 130(2):273-298.
101. Reichardt W. Movement perception in insects. Processing of optical data by organisms & machines 1969, 465-493. Academic Press, New York, NY. W. Reichardt (Ed.).
102. Rensink R.A. The dynamic representation of scenes. Visual Cognition 2000, 7(1-3):17-42.
103. Reynolds J.H., Desimone R. The role of neural mechanisms of attention in solving the binding problem. Neuron 1999, 24(1):19-29.
104. Rieser J. Access to knowledge of spatial structure at novel points of observation. Journal of Experimental Psychology: Learning, Memory and Cognition 1989, 15(6):1157-1165.
105. Rosielle L.J., Crabb B.T., Cooper E.E. Attentional coding of categorical relations in scene perception: Evidence from the flicker paradigm. Psychonomic Bulletin & Review 2002, 9(2):319-326.
106. Rubichi S., Nicoletti R., Iani C., Umilta C. The Simon effect occurs in relation to the direction of an attention shift. Journal of Experimental Psychology: Human Perception and Performance 1997, 5:1353-1364.
107. Ryan J.D., Villate C. Building visual representations: The binding of relative spatial relationships across time. Visual Cognition 2009, 17:254-272.
108. Sanocki T., Sulman N. Priming of simple and complex scenes: Rapid function from the intermediate level. Journal of Experimental Psychology: Human Perception and Performance 2009, 35:735-774.
109. Serences J.T., Yantis S. Selective visual attention and perceptual coherence. Trends in Cognitive Sciences 2006, 10:38-45.
110. Shah P., Mayer R.E., Hegarty M. Graphs as aids to knowledge construction: Signaling techniques for guiding the process of graph comprehension. Journal of Educational Psychology 1999, 91:690-702.
111. Shelton A.L., McNamara T.P. Systems of spatial reference in human memory. Cognitive Psychology 2001, 43:274-310.
112. Shiu L.-P., Pashler H. Spatial attention and vernier acuity. Vision Research 1995, 35:337-343.
113. Stoffer T.H. Attentional focusing and spatial stimulus-response compatibility. Psychological Research 1991, 53:127-135.
114. Stoffer T.H., Umilta C. Spatial coding with reference to the focus of attention in S-R compatibility and the Simon effect. Theoretical issues in S-R compatibility 1997, 181-208. North-Holland, Amsterdam. B. Hommel, W. Prinz (Eds.).
115. Tanaka K. Columns for complex visual object features in the inferotemporal cortex: Clustering of cells with similar but slightly different stimulus selectivities. Cerebral Cortex 2003, 13:90-99.
116. Tanaka J.W., Farah M.J. The holistic representation of faces. Analytic and holistic processes in the perception of faces, objects, and scenes 2006, 53-91. Oxford University Press, New York, NY. M. Peterson, G. Rhodes (Eds.).
117. Tarr M.J., Bulthoff H.H. Image-based object recognition in man, monkey and machine. Cognition 1998, 67(1-2):1-20.
118. Taylor H.A., Tversky B. Spatial mental models derived from survey and route descriptions. Journal of Memory and Language 1992, 31:261-282.
119. Taylor H.A., Tversky B. Perspective in spatial descriptions. Journal of Memory and Language 1996, 35:371-391.
120. Theeuwes J., Atchley P., Kramer A.F. Attentional control within three-dimensional space. Journal of Experimental Psychology: Human Perception and Performance 1998, 24:1476-1485.
121. Todd J., Marois R. Capacity limit of visual sort-term memory in human posterior parietal cortex. Nature 2004, 428(15):751-754.
122. Treisman A. The binding problem. Current Opinion in Neurobiology 1996, 6:171-178.
123. Treisman A., Gelade G. A feature-integration theory of attention. Cognitive Psychology 1980, 12:97-136.
124. Treisman A., Schmidt H. Illusory conjunctions in the perception of objects. Cognitive Psychology 1982, 14:107-141.
125. Ullman S. Visual routines. Cognition 1984, 18(1-3):97-159.
126. VanRullen R. Binding hardwired versus on-demand feature conjunctions. Visual Cognition 2009, 17(1-2):103-119.
127. Vickery T.J., King L.W., Jiang Y. Setting up the target template in visual search. Journal of Vision 2005, 5:81-92.
128. Walsh V. A theory of magnitude: Common cortical metrics of time, space and quantity. Trends in Cognitive Sciences 2003, 7:483-488.
129. Wang R.F. Spatial representations and spatial updating. The psychology of learning and motivation: 42. Advances in research and theory: Cognitive vision 2003, 109-156. Academic Press, San Diego, CA. D.E. Irwin, B.H. Ross (Eds.).
130. Wang Q., Cavanagh P., Green M. Familiarity and pop-out in visual search. Perception & Psychophysics 1994, 56:495-500.
131. Wolfe J.M. Guided Search 2.0: A revised model of visual search. Psychonomic Bulletin & Review 1994, 1(2):202-238.
132. Wolfe J.M. What can 1,000,000 trials tell us about visual search?. Psychological Science 1998, 9(1):33-38.
133. Wolfe J.M., O'Neill P., Bennett S.C. Why are there eccentricity effects in visual search? Visual and attentional hypotheses. Perception & Psychophysics 1998, 60:140-156.
134. Woodman G.F., Luck S.J. Electrophysiological measurement of rapid shifts of attention during visual search. Nature 1999, 400:867-869.
135. Woodman G.F., Luck S.J. Serial deployment of attention during visual search. Journal of Experimental Psychology: Human Perception and Performance 2003, 29:121-138.
136. Xu, L. & Franconeri, S. L. (in press). The head of the table: The location of the spotlight of attention may determine the 'front' of ambiguous objects. Journal of Neuroscience.
137. Xu Y., Chun M.M. Selecting and perceiving multiple visual objects. Trends in Cognitive Sciences 2009, 13:167-174.
138. Yantis S. On analog movements of visual attention. Perception & Psychophysics 1988, 43:203-206.
139. Yeshurun Y., Carrasco M. Spatial attention improves performance in spatial resolution tasks. Vision Research 1999, 39:293-306.
140. Zacks J., Tversky B. Bars and lines: A study of graphic communication. Memory and Cognition 1999, 27:1073-1079.