Thinking outside the brain: Spatial indices to visual and linguistic information

The Interface of Language, Vision, and Action: Eye Movements and the Visual World

Volumn , Issue , 2004, Pages 161-190

  Spivey, Michael J ^a   Richardson, Daniel C ^b   Fitneva, Stanka A ^c  

^a Department of Obstetrics Gynecology   (United States)

^b STANFORD UNIVERSITY   (United States)

^c QUEEN S UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84908988962     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203488430     Document Type: Chapter

References (119)

1. Alibali, M. W., Heath D. C., & Myers, H. J. (2001). Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44, 169-188.
2. Antrobus, J. S., Antrobus, J. S., Singer, J. L. (1964). Eye movements accompanying daydreaming, visual imagery, and thought suppression. Journal of Abnormal and Social Psychology, 69, 244-252.
3. Baddeley, A. D. (1986). Working memory. Oxford: Oxford University Press.
4. Ballard, D. H. (1989). Behavioral constraints on animate vision. Image and Vision Computing, 7, 3-9.
5. Ballard, D. H., Hayhoe, M. M., & Pelz, J. B. (1995). Memory representations in natural tasks. Journal of Cognitive Neuroscience, 7, 66-80.
6. Ballard, D. H., Hayhoe, M. M., Pook, P. K., and Rao R. P. N. (1997). Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences, 20, 723-767.
7. Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577-660.
8. Barsalou, L. W., Niedenthal, P. M., Barbey, A. K., & Ruppert, J. A. (in press). Social embodiment. In B. H. Ross (Ed.), The psychology of learning and motivation (Vol. 43). San Diego, CA: Academic Press.
9. Bavelas, J. B., Chovil, N., Lawrie, D. A., & Wade, A. (1992). Interactive gestures. Discourse Processes, 15, 469-489.
10. Beer, R. (1989). Intelligence as adaptive behavior. New York: Academic Press.
11. Block, N. (1980). Introduction: what is functionalism? In N. Block (Ed.), Readings in philosophy of psychology (pp.171-184). Cambridge, MA: Harvard University Press.
12. Brandt, S. A., and Stark, L. W. (1997). Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of Cognitive Neuroscience, 9, 27-38.
13. Bridgeman, B., Van der Hejiden, A. H. C., Velichkovsky, B. M. (1994). A theory of visual stability across saccadic eye movements. Behavioral and Brain Sciences, 17, 247-292.
14. Brooks, R. (1991). Intelligence without representation. Artificial Intelligence, 47, 139 159.
15. Bryant, D. J. (1997). Representing space in language and perception. Mind and Language, 12, 239-264.
16. Chatterjee, A. (2001). Language and space: Some interactions. Trends in Cognitive Sciences, 5, 55-61.
17. Clark A. (2001). Reasons, robots and the extended mind. Mind and Language, 16, 121 145.
18. Clark, A., & Chalmers, D. (1998). The extended mind. Analysis, 58, 7-19.
19. Cole, M., & Engestroem, Y. (1997). A cultural historical approach to distributed cognition. In S. Gavriel (Ed), Distributed cognitions: Psychological and educational considerations (pp. 46).
20. Corbetta, M., & Shulman, G. L (1999). Human cortical mechanisms of visual attention during orienting and search. In G. Humphreys & J. Duncan, John (Eds.), Attention, space, and action: Studies in cognitive neuroscience (pp. 183-198). London: Oxford University Press.
21. Demarais, A. M., & Cohen, B. H. (1998). Evidence for image scanning eye movements during transitive inference. Biological Psychology, 49, 229-247.
22. Dewey, J. (1896). The reflex arc concept in psychology. Psychological Review, 3, 357 370.
23. Dreyfus, H. L. (1996). The current relevance of Merleau-Ponty's Phenomenology of Embodiment. Electronic Journal of Analytical Philosophy, 4 (Spring).
24. Duncker, K. (1945). On problem solving. Psychological Monographs, 58,5.doc"> No. 270.
25. Eich, J. E. (1980). The cue dependent nature of state dependent retrieval. Memory and Cognition, 8, 157-173.
26. Emmorey, K. (2001). Space on hand: The exploitation of signing space to illustrate abstract thought. In G. Merideth (Ed), Spatial schemas and abstract thought (pp. 147-174).
27. Emmorey, K. (2002). Language, cognition, and the brain: Insights from sign language research. Mahwah, NJ: Erlbaum.
28. Fodor, J A. (1980). Methodological solipsism considered as a research strategy in cognitive psychology. Behavioral and Brain Sciences, 3, 63-109.
29. Fodor, J. A. (1981). The mind body problem. Scientific American, 244, 114-123.
30. Frazier, L., & Rayner, K. (1982). Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences. Cognitive Psychology, 14, 178-210.
31. Gibbs, R. W. Jr. (1999). Intentions in the experience of meaning. NY: Cambridge University Press.
32. Gibson, J. J. (1950). The perception of the visual world. Boston: Houghton Mifflin.
33. Gibson, J. J. (1966). The senses considered as perceptual systems. Boston: Houghton Mifflin.
34. Gilmore, R. O., & Johnson, M. H. (1998). Learning what is where: Oculomotor contributions to the development of spatial cognition. In S. Francesca & G. Butterworth (Eds.), The development of sensory, motor and cognitive capacities in early infancy: From perception to cognition (pp. 25-47). Hove, UK: Psychology Press.
35. Glenberg, A. M, Schroeder, J. L., & Robertson, D. A. (1998). Averting the gaze disengages the environment and facilitates remembering. Memory and Cognition, 26, 651-658.
36. Glenberg, A. M., & Robertson, D. A. (1999). Indexical understanding of instructions. Discourse Processes, 28, 1-26.
37. Goldin-Meadow, S. (1997). When gestures and words speak differently. Current Directions in Psychological Science, 6, 138-143.
38. Grant, E. R., & Spivey, M. J. (2003). Eye movements and problem solving: Guiding attention guides thought. Psychological Science, 14, 462-466.
39. Greeno, J. G. (1998). The situativity of knowing, learning, and research. American Psychologist, 53, 5-26.
40. Haber, R. N. (1983). The impending demise of the icon: A critique of the concept of iconic storage in visual information processing. Behavioral and Brain Sciences, 6, 1-54.
41. Haith, M. M., Hazan, C., & Goodman, G. (1988). Expectation and anticipation of dynamic visual events by 3.5 month old babies. Child Development, 59, 467-479.
42. Haith, M. M., Wentworth, N., & Canfield, R. L (1993). The formation of expectations in early infancy. Advances in Infancy Research, 8, 251-297.
43. Hale, S M., & Simpson, H. M. (1970). Effects of eye movements on the rate of discovery and the vividness of visual images. Perception and Psychophysics, 9, 242-246.
44. Haney, C. (2002). Making law modern: Toward a contextual model of justice. Psychology, Public Policy, and Law, 8, 3-63.
45. Haugeland (1995). Mind embodied and embedded. In Y. Houng and J. Ho (Eds.), Mind and cognition. Taipei: Academia Sinica.
46. Hayhoe, M. M. (2000). Vision using routines: A functional account of vision. Visual Cognition, 7, 43-64.
47. Hayhoe, M. M., Bensinger, D. G, & Ballard, D. H. (1998). Task constraints in visual working memory. Vision Research, 38, 125 137.
48. Hebb, D. O. (1968). Concerning imagery. Psychological Review, 75, 466-477.
49. Henderson, J. M. (1993). Visual attention and saccadic eye movements. In G. d'Ydewalle & J. Van Rensbergen (Eds.), Perception and cognition: Advances in eye movement research. Studies in visual information processing (Vol. 4, pp. 37-50). Amsterdam, Netherlands: North Holland/Elsevier Science Publishers.
50. Hewitt, J., & Scardamalia, M. (1998). Design principles for distributed knowledge building processes. Educational Psychology Review, 10, 75-96.
51. Hoffman, J. E. (1998). Visual attention and eye movements. In H. Pashler (Ed.), Attention (pp. 119-153). Hove, UK: Psychology Press.
52. Hollingshead, A. B. (1998). Retrieval processes in transactive memory systems. Journal of Personality and Social Psychology, 74, 659-671.
53. Hollingworth, A., & Henderson, J. M. (2002). Accurate visual memory for previously attended objects in natural scenes. Journal of Experimental Psychology: Human Perception and Performance, 28, 113-136.
54. Hollingworth, A., Williams, C. C. & Henderson, J. M. (2001). To see and remember: Visually specific information is retained in memory from previously attended objects in natural scenes. Psychonomic Bulletin and Review, 8, 761-768.
55. Hutchins, E. (1995). Cognition in the wild. Cambridge, MA: MIT Press.
56. Irwin, D. E. (1993). Perceiving an integrated visual world. In D. Meyer & S. Kornblum (Eds.), Attention and performance 14: Synergies in experimental psychology, artificial intelligence, cognitive neuroscience (pp. 121-142). Cambridge, MA: The MIT Press.
57. Jarvilehto, T. (1998). The theory of the organism environment system: I. Description of the theory. Integrative Physiological and Behavioral Science, 33, 321-334.
58. Johnson, M. K., Hashtroudi, S., & Lindsay, D. S. (1993). Source monitoring. Psychological Bulletin, 114, 3-28.
59. Jonasse, R. (1995). Collectively seeing the wind: Distributed cognition in smoke-jumping. Mind, Culture, and Activity, 2, 81-101.
60. Jones, S. S., & Smith, L. B. (1993). The place of perception in children's concepts. Cognitive Development, 8, 113-139.
61. Juarrero, A. (1999). Dynamics in action. Cambridge, MA: MIT Press.
62. Kelso, J. A. S. (1995). Dynamic patterns. Cambridge, MA: MIT Press.
63. Kendon, A. (1967). Some functions of gaze direction in social interaction. Acta Psychologica, 26, 22-63.
64. Kirsh, D. (1995). The intelligent use of space. Artificial Intelligence, 73, 31-68.
65. Kirsh, D., & Maglio, P. (1994). On distinguishing epistemic from pragmatic action. Cognitive Science, 18, 513-549.
66. Knoblich, G., & Jordan, S. (2000). Constraints of embodiedness on action coordination. In L. R. Gleitman and A. K. Joshi, (Eds.), Proceedings of the 22nd annual conference of the Cognitive Science Society (pp. 764-769). Mahwah, NJ: Lawrence Erlbaum Associates.
67. Lakoff, G. (1987). Women, fire, and dangerous things: What categories reveal about the mind. Chicago: University of Chicago Press.
68. Lakoff, G. (1997). The internal structure of the self. In U. Neisser & D. A. Jopling, (Eds.), The conceptual self in context: Culture, experience, self understanding. The Emory symposia in cognition (pp. 92-113). New York: Cambridge University Press.
69. Larson, J. R, Jr, & Christensen, C., Franz, T. M., & Abbott, A. S. (1998). Diagnosing groups: The pooling, management, and impact of shared and unshared case information in team based medical decision making. Journal of Personality and Social Psychology, 75, 93-108.
70. Le Bon, G. (1916). The crowd, a study of the popular mind. London: T.F. Unwin.
71. Leslie, A. M., Xu, F., Tremoulet, P, & Scholl, B. J. (1998). Indexing and the object concept: Developing "what" and "where" systems. Trends in Cognitive Sciences, 2, 10-18.
72. Levelt, W. J., Richardson, G., & la Heij, W. (1985). Pointing and voicing in deictic expressions. Journal of Memory and Language, 24, 133-164.
73. Lévy, P. (1997). Collective intelligence: Mankinds emerging world in cyberspace. New York: Plenum Press.
74. Marr, D. (1980). Vision: A computational investigation into the human representation and processing of visual information. New York: W.H. Freeman.
75. McClamrock, R. A. (1995). Existential cognition: computational minds in the world. Chicago: University of Chicago Press.
76. McConkie, G. W., & Currie, C. B. (1996). Visual stability across saccades while viewing complex pictures. Journal of Experimental Psychology: Human Perception and Performance, 22, 563-581.
77. McNeill, D. (1992). Hand and mind: what gestures reveal about thought. Chicago: University of Chicago Press.
78. Merleau-Ponty, M. (1962). Phenomenology of perception ( C. Smith, Trans.). New York: Humanities Press.
79. Neisser, U. (1967). Cognitive psychology. Englewood Cliffs, NJ: Prentice Hall.
80. Newell, A. (1990). Unified theories of cognition. Cambridge, MA: Harvard University Press.
81. Nowak, A., Vallacher, R. R., & Burnstein, E. (1998). Computational social psychology: A neural network approach to interpersonal dynamics. In W. Liebrand & A. Nowak, (Eds.), Computer modeling of social processes (pp. 97-125). London: Sage Publications.
82. O'Regan, J K. (1992). Solving the "real" mysteries of visual perception: The world as an outside memory. Canadian Journal of Psychology, 46, 461-488.
83. O'Regan, J. K., Deubel, H., Clark, J. J., & Rensink, R. A. (2000). Picture changes during blinks: Looking without seeing and seeing without looking. Visual Cognition, 7, 191-211.
84. O'Regan, J K., & Noe, A. (2001). A sensorimotor account of vision and visual consciousness. Behavioral and Brain Sciences, 24, 939-1031.
85. O'Regan, J. K., Rensink, R. A., & Clark, J. J. (1999). Change-blindness as a result of 'mudsplashes'. Nature, 398, 34.
86. Pedersen, M. K., & Larsen, M. H. (2001). Distributed knowledge management based on product state models the case of decision support in health care administration. Decision Support Systems, 31, 139-158.
87. Pirolli, P., and Card, S. (1999). Information foraging. Psychological Review, 106, 643 675.
88. Putnam, H. (1975). The meaning of 'meaning'. In K. Gunderson (Ed.), Language, mind, and knowledge. Minneapolis: University of Minnesota Press.
89. Pylyshyn, Z. W. (1989). The role of location indexes in spatial perception: A sketch of the FINST spatial index model. Cognition, 32, 65-97.
90. Pylyshyn, Z. W. (2001). Visual indexes, preconceptual objects, and situated vision. Cognition, 80, 127-158.
91. Pylyshyn, Z. W., & Storm, R. W. (1988). Tracking multiple independent targets: Evidence for a parallel tracking mechanism. Spatial Vision, 3, 179-197.
92. Rauscher, F. H., Krauss, R. M. & Chen, Y. (1996). Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science, 7, 226-231.
93. Rensink, R. A., O'Regan, J. K., & Clark, J. J. (1997). To see or not to see: The need for attention to perceive changes in scenes. Psychological Science, 8, 368-373.
94. Richardson, D. C., & Kirkham, N. Z. (in press). Multi modal events and moving locations: Eye movements of adults and 6 month olds reveal dynamic spatial indexing. Journal of Experimental Psychology: General
95. Richardson, D. C. & Spivey, M. J. (2000). Representation, space and Hollywood Squares: looking at things that aren't there anymore. Cognition, 76, 269-295.
96. Richardson, D. C., Spivey, M. J., Barsalou, L., & McRae, K. (2003). Spatial representations activated during real-time comprehension of verbs. Cognitive Science, 27, 767-780.
97. Ross, D. (1997). Critical notice of Ron Mc-Clamrock's "Existential Cognition." Canadian Journal of Philosophy, 27, 271-284.
98. Ruggieri, V. (1999). The running horse stops: The hypothetical role of the eyes in imagery of movement. Perceptual and Motor Skills, 89, 1088-1092.
99. Ryle, G. (1949). The concept of mind. New York: Barnes & Noble.
100. Scholl, B. J., & Leslie, A. M. (1999). Explaining the infant's object concept: Beyond the perception/cognition dichotomy. In E. Lepore & Z. Pylyshyn (Eds.), What is cognitive science? (pp. 26-73). Oxford: Blackwell.
101. Scholl, B. J., & Pylyshyn, Z. W. (1999). Tracking multiple items through occlusion: Clues to visual objecthood. Cognitive Psychology, 38, 259-290.
102. Segal, G. (2001). A slim book about narrow content. Cambridge, MA: MIT Press.
103. Simons, D. J. (2000). Current approaches to change blindness. Visual Cognition, 7, 1-15.
104. Simons, D. J., & Levin, D. T. (1998). Failure to detect changes to people during a real world interaction. Psychonomic Bulletin and Review, 5, 644-649.
105. Spivey, M. J., & Geng, J. J. (2001). Oculomotor mechanisms activated by imagery and memory: eye movements to absent objects. Psychological Research, 65, 235-241.
106. Spivey, M. J., Tyler, M. J., Richardson, D. C., & Young, E. E. (2000). Eye movements during comprehension of spoken scene descriptions. Proceedings of the 22nd annual conference of the Cognitive Science Society (pp. 487-492). Mahwah, NJ: Erlbaum.
107. Stary, C., & Stumptner, M. (1992). Representing organizational changes in distributed problem solving environments. IEEE Transactions on Systems, Man, and Cybernetics, 22, 1168-1177.
108. Suchman, L. A. (1987). Plans and situated actions: The problem of human-machine communication. Cambridge: Cambridge University Press.
109. Tanenhaus, M., Spivey Knowlton, M., Eberhard, K., & Sedivy, J. (1995). Integration of visual and linguistic information during spoken language comprehension. Science, 268, 1632-1634.
110. Thelen, E., & Smith, L. B. (1994). A dynamic systems approach to the development of cognition and action. Cambridge, MA: MIT Press.
111. Tipper, S. P. & Behrmann, M. (1996). Object centered not scene based visual neglect. Journal of Experimental Psychology: Human Perception and Performance, 22, 1261-1278.
112. Turvey. M. T. (1977). Contrasting orientations to the theory of visual information processing. Psychological Review, 84, 67-88.
113. Van Orden, G. C., & Holden, J. C. (2002). Intentional contents and self control. Ecological Psychology, 14, 87-109.
114. Van Orden, G. C., Holden, J. C., & Turvey, M. T. (2003). Self-organization of cognitive performance. Journal of Experimental Psychology: General, 132, 331-350.
115. Wang, R. F. (1999). Representing a stable environment by egocentric updating and invariant representations. Spatial Cognition and Computation, 1, 431-445.
116. Wilson, R. (1994). Wide computationalism. Mind, 103, 351-372.
117. Yantis, S., & Jonides, J. (1990). Abrupt visual onsets and selective attention: Voluntary versus automatic allocation. Journal of Experimental Psychology: Human Perception and Performance, 16, 121-134.
118. Yoo, Y., & Kanawattanachai, P. (2001). Developments of transactive memory systems and collective mind in virtual teams. International Journal of Organizational Analysis, 9, 187-208.
119. Zadeh, L. A. (1973). Outline of a new approach to the analysis of complex systems and decision processes. IEEE Transactions on Systems, Man, and Cybernetics, 3, 28-44.