Moving through imagined space: Mentally simulating locomotion during spatial description reading

Acta Psychologica

Volumn 134, Issue 1, 2010, Pages 110-124

  Brunyé, Tad T ^a,b   Mahoney, Caroline R ^a,b   Taylor, Holly A ^a  

^a TUFTS UNIVERSITY   (United States)

^b US Army NSRDEC   (United States)

Author keywords

Distance perception; Embodiment; Mental model; Reading time; Spatial memory

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; AUDITORY STIMULATION; COMPREHENSION; DECISION MAKING; DEPTH PERCEPTION; DISTANCE PERCEPTION; FEMALE; HUMAN; IMAGINATION; LOCOMOTION; MALE; ORIENTATION; REACTION TIME; READING; SEMANTICS; TIME PERCEPTION;

ACOUSTIC STIMULATION; ADOLESCENT; COMPREHENSION; DISTANCE PERCEPTION; FEMALE; HUMANS; IMAGINATION; JUDGMENT; LOCOMOTION; MALE; ORIENTATION; REACTION TIME; READING; SEMANTICS; SPACE PERCEPTION; TIME PERCEPTION; YOUNG ADULT;

EID: 77952236977     PISSN: 00016918     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.actpsy.2010.01.003     Document Type: Article

References (97)

1. Avraamides M.N. Spatial updating of environments described in texts. Cognitive Psychology 2003, 47(4):402-431.
2. Avraamides M.N., Loomis J.M., Klatzky R.L., Golledge R.G. Functional equivalence of spatial representations derived from vision and language: Evidence from allocentric judgments. Journal of Experimental Psychology: Learning, Memory, and Cognition 2004, 30(4):804-814.
3. Baddeley A.D. Working memory. Science 1992, 255:556-559.
4. Barsalou L.W. Situated conceptualization. Handbook of categorization in cognitive science 2005, 619-650. Elsevier, St. Louis. H. Cohen, C. Lefebvre (Eds.).
5. Barsalou L.W. Grounded cognition. Annual Review of Psychology 2008, 59:617-645.
6. Bergen B., Chang N. Embodied construction grammar in simulation-based language understanding. Construction grammars: Cognitive grounding and theoretical extensions 2005, 147-190. Benjamins, Amsterdam. J.-O. Ostman, M. Fried (Eds.).
7. Bergen B.K., Lindsay S., Matlock T., Narayanan S. Spatial and linguistic aspects of visual imagery in sentence comprehension. Cognitive Science 2007, 31:733-764.
8. Borghi A.M., Glenberg A.M., Kaschak M.P. Putting words in perspective. Memory and Cognition 2004, 32:863-873.
9. Bosco A., Sardone L., Scalisi T.G., Longoni A.M. Spatial models derived from verbal descriptions of fictitious environments: The influence of study time and the individual differences in visuo-spatial ability. Psychologische Beiträge 1996, 38:451-466.
10. Bower G.H., Morrow D.G. Mental models in narrative comprehension. Science 1990, 247:44-48.
11. Bower G.H., Rinck M. Selecting one among many referents in spatial situation models. Journal of Experimental Psychology: Learning, Memory, and Cognition 2001, 27:81-98.
12. Brunyé T.T., Taylor H.A. When goals constrain: Eye movements and memory for goal-oriented map study. Applied Cognitive Psychology 2009, 23:772-787.
13. Brunyé T.T., Ditman T., Mahoney C.R., Augustyn J.S., Taylor H.A. When you and I share perspectives: Pronouns modulate perspective-taking during narrative comprehension. Psychological Science 2009, 20:27-32.
14. Brunyé T.T., Rapp D.N., Taylor H.A. Representational flexibility and specificity following spatial descriptions of real world environments. Cognition 2008, 108:418-443.
15. Brunyé T.T., Taylor H.A. Working memory in developing and applying mental models from spatial descriptions. Journal of Memory and Language 2008, 58:701-729.
16. Brunyé T.T., Taylor H.A. Extended experience benefits spatial mental model development with route but not survey descriptions. Acta Psychologica 2008, 127:340-354.
17. Brunyé T.T., Taylor H.A., Rapp D.N., Spiro A.B. Learning procedures: The role of working memory in multimedia learning experiences. Applied Cognitive Psychology 2006, 20:917-940.
18. Büchel C., Sommer M. What causes stuttering?. PLoS Biology 2004, 2(2):e46.
19. Burgess N. Spatial memory: How egocentric and allocentric combine. Trends in Cognitive Sciences 2006, 10:551-557.
20. Cedrus Corporation. (2008). SuperLab Pro: Experimental laboratory software (version 4.0.7b) [computer software], San Pedro, CA.
21. Cocude M., Mellet E., Denis M. Visual and mental exploration of visuo-spatial configurations: behavioural and neuroimaging approaches. Psychological Research 1999, 62:93-106.
22. De Beni R., Pazzaglia F., Gyselinck V., Meneghetti C. Visuospatial working memory and mental representation of spatial descriptions. European Journal of Cognitive Psychology 2005, 17:77-95.
23. Denis M. Assessing the symbolic distance effect in mental images constructed from verbal descriptions: A study of individual differences in the mental comparison of distances. Acta Psychologica 2008, 127:197-210.
24. Denis M., Goncalves M.-R., Memmi D. Mental scanning of visual images generated from verbal descriptions: Towards a model of image accuracy. Neuropsychologia 1995, 33:1511-1530.
25. Denis M., Zimmer H.D. Analog properties of cognitive maps constructed from verbal descriptions. Psychological Research 1992, 54:286-298.
26. Deyzac E., Logie R.H., Denis M. Visuospatial working memory and the processing of spatial descriptions. British Journal of Psychology 2006, 97:217-243.
27. Ditman, T., Brunyé, T., Mahoney, C. R., & Taylor, H. A. (in press). Simulating an enactment effect: Pronouns guide action simulation during narrative comprehension. Cognition. doi:10.1016/j.cognition.2009.10.014.
28. Feldman J. From molecule to metaphor: A neural theory of language 2006, MIT Press, Cambridge, MA.
29. Fincher-Kiefer R. Perceptual components of situation models. Memory and Cognition 2001, 29:336-343.
30. Fischer M.H., Zwaan R.A. Embodied language: A review of the role of the motor system in language comprehension. Quarterly Journal of Experimental Psychology 2008, 61:825-850.
31. Glenberg A.M. What memory is for. Behavioral and Brain Sciences 1997, 20:1-55.
32. Glenberg A.M. Language and action: Creating sensible combinations of ideas. The Oxford Handbook of Psycholinguistics 2007, 361-370. Oxford University Press, Oxford. M.G. Gaskell (Ed.).
33. Glenberg A.M., Kaschak M.P. Grounding language in action. Psychonomic Bulletin and Review 2002, 9:558-565.
34. Glenberg A.M., Kaschak M.P. The body's contribution to language. The Psychology of Learning and Motivation 2003, 93-126. Academic, New York. B.H. Ross (Ed.).
35. Golledge R. Place recognition and wayfinding: Making sense of space. Geoforum 1992, 23:199-214.
36. Gyselinck V., De Beni R., Pazzaglia F., Meneghetti C., Mondoloni A. Working memory components and imagery instructions in the elaboration of a spatial mental model. Psychological Research 2007, 71(3):373-382.
37. Hegarty M., Waller D.A. Individual differences in spatial ability. The Cambridge handbook of visuospatial thinking 2005, 121-169. Cambridge University Press, New York. P. Shah, A. Miyake (Eds.).
38. Horton W.S., Rapp D.N. Out of sight, out of mind: Occlusion and the accessibility of information in narrative comprehension. Psychonomic Bulletin and Review 2003, 10:104-110.
39. Iachini T., Giusberti F. Metric properties of spatial images generated from locomotion: The effect of absolute size on mental scanning. European Journal of Cognitive Psychology 2004, 16:573-596.
40. Ishikawa T., Montello D.R. Spatial knowledge acquisition from direct experience in the environment: Individual differences in the development of metric knowledge and the integration of separately learned places. Cognitive Psychology 2006, 52:93-129.
41. Jones D.M., Macken W.J. Irrelevant tones produce an irrelevant speech effect: Implications for coding in phonological memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 1993, 19:369-381.
42. Jones D.M., Tremblay S. Interference in memory by process or content?. Psychonomic Bulletin and Review 2000, 7:550-558.
43. Kaschak M., Glenberg A. Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory and Language 2000, 43:508-529.
44. Kemmerer D. How words capture visual experience: The perspective from cognitive neuroscience. Words and the mind: How words capture human experience 2010, Oxford University Press, Oxford, UK. B. Malt, P. Wolff (Eds.).
45. Kemmerer D., Castillo J.G., Patterson S., Wiley C. Neuroanatomical distribution of five semantic components of verbs: Evidence from fMRI. Brain and Language 2008, 107:16-43.
46. Klatzky R.L., Lippa Y., Loomis J.M., Golledge R.G. Encoding, learning, and spatial updating of multiple object locations specified by 3-d sound, spatial language, and vision. Experimental Brain Research 2003, 149(1):48-61.
47. Kuipers B. The cognitive map: Could it have been any other way?. Spatial orientation: Theory, research, and application 1983, 345-359. Plenum Press, New York. H.L. Pick, L.P. Acredolo (Eds.).
48. Kurby C.A., Magliano J.P., Rapp D.N. Those voices in your head: Activation of auditory images during reading. Cognition 2009, 112:457-461.
49. Lee P., Tversky B. Costs of switching perspectives in route and survey descriptions. Proceedings of the 23th annual conference of the cognitive science society 2001, 574-579. Lawrence Erlbaum Associates, Mahwah, NJ. J. Moore, K. Stenning (Eds.).
50. Lee P.U., Tversky B. Interplay between visual and spatial: The effect of landmark descriptions on comprehension of route/survey spatial descriptions. Spatial Cognition and Computation 2005, 5:163-185.
51. Levinson S.C. Space in language and cognition: Explorations in cognitive diversity 2003, Cambridge University Press, Cambridge.
52. Lovelace K.L., Hegarty M., Montello D.R. Elements of good route directions in familiar and unfamiliar environments. COSIT'99 1999, 62-85. Springer-Verlag, Berlin. C. Freksa, D.M. Mark (Eds.).
53. Miyake A., Friedman N.P., Emerson M.J., Witzki A.H., Howerter A. The unity and diversity of executive functions and their contribution to complex " frontal lobe" tasks: A latent variable analysis. Cognitive Psychology 2000, 41:49-100.
54. Miyake A., Shah P. Toward unified theories of working memory: Emerging general consensus, unresolved theoretical issues, and future research directions. Models of working memory: Mechanisms of active maintenance and executive control 1999, 442-481. Cambridge University Press, New York. A. Miyake, P. Shah (Eds.).
55. Morrow D.G. Spatial models created from text. Naturalistic text comprehension 1994, 57-78. Ablex, Norwood, NJ. H. van Oostendorp, R.A. Zwaan (Eds.).
56. Morrow D.G., Bower G.H., Greenspan S.L. Updating situation models during narrative comprehension. Journal of Memory and Language 1989, 28:292-312.
57. Morrow D.G., Greenspan S.L., Bower G.H. Accessibility and situation models in narrative comprehension. Journal of Memory and Language 1987, 26:165-187.
58. Noordzij M.L., Postma A. Categorical and metric distance information in mental representations derived from route and survey descriptions. Psychological Research 2005, 69:221-232.
59. Noordzij M.L., Van der Lubbe R.H.J., Postma A. Strategic and automatic components in the processing of linguistic spatial relations. Acta Psychologica 2005, 119:1-20.
60. Noordzij M.L., Van der Lubbe R.H.J., Postma A. Electrophysiological support for strategic processing of spatial sentences. Psychophysiology 2006, 43:277-286.
61. Noordzij M.L., Zuidhoek S., Postma A. The influence of visual experience on the ability to form spatial mental models based on route and survey descriptions. Cognition 2006, 100:321-342.
62. Pazzaglia F., De Beni R., Meneghetti C. The effects of verbal and spatial interference in the encoding and retrieval of spatial and non-spatial texts. Psychological Research 2007, 71:484-494.
63. Perrig W., Kintsch W. Propositional and situational representations of text. Journal of Memory and Language 1985, 24:503-518.
64. Péruch P., Chabanne V., Nese M.-P., Thinus-Blanc C., Denis N. Comparing distances in mental images constructed from visual experience or verbal descriptions: The impact of survey versus route perspective. Quarterly Journal of Experimental Psychology 2006, 59:1950-1967.
65. Plaister T. Reading instruction for college level foreign students. TESOL Quarterly 1968, 2:164-168.
66. Prestopnik J.L., Roskos-Ewoldsen B. The relations among wayfinding strategy use, sense of direction, sex, familiarity, and wayfinding ability. Journal of Environmental Psychology 2000, 20:177-191.
67. Rapp D.N., Klug J.L., Taylor H.A. Character movement and the representation of space during narrative comprehension. Memory and Cognition 2006, 34(6):1206-1220.
68. Rapp D.N., Taylor H.A. Interactive dimensions in the construction of mental representations for text. Journal of Experimental Psychology: Learning, Memory, and Cognition 2004, 30:988-1001.
69. Rayner K. Eye movements in reading and information processing: Twenty years of research. Psychological Bulletin 1998, 124:372-422.
70. Richardson D.C., Spivey M.J., McRae K., Barsalou L.W. Spatial representations activated during real-time comprehension of verbs. Cognitive Science 2003, 27:767-780.
71. Rieser J.J., Pick H.L., Ashmead D.A., Garing A.E. The calibration of human locomotion and models of perceptual-motor organization. Journal of Experimental Psychology: Human Perception and Performance 1995, 21:480-497.
72. Rinck M., Bower G.H. Temporal and spatial distance in situation models. Memory and Cognition 2000, 28:1310-1320.
73. Ruby P., Decety J. Effect of subjective perspective taking during simulation of action: A PET investigation of agency. Nature Neuroscience 2001, 4:546-550.
74. Schneider L.F., Taylor H.A. How do you get there from here? Mental representations of route descriptions. Applied Cognitive Psychology 1999, 13:415-441.
75. Sereno S.C., Rayner K. Measuring word recognition in reading: Eye movements and event-related potentials. Trends in Cognitive Sciences 2003, 7:489-493.
76. Shelton A.L., McNamara T.P. Orientation and perspective dependence in route and survey learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 2004, 30:158-170.
77. Siegel A.W., White S.H. The development of spatial representations of large-scale environments. Advances in child development and behavior 1975, Vol. 10:9-55. Academic Press, New York.
78. Sperber D., Wilson D. Relevance: Communication and cognition 1986, Blackwell, Oxford.
79. Sperber D., Wilson D. Relevance: Communication and cognition 1995, Blackwell, Oxford. 2nd ed.
80. Stanfield R.A., Zwaan R.A. The effect of implied orientation derived from verbal context on picture recognition. Psychological Science 2002, 12:153-156.
81. Tajadura-Jiménez A., Valjamae A., Vastfjall D. Self-representation in mediated environments: The experience of emotions modulated by auditory-vibrotactile heartbeat. Cyber Psychology and Behavior 2008, 11:33-38.
82. Taylor H.A., Naylor S.J., Chechile N.A. Goal-specific influences on the representation of spatial perspective. Memory and Cognition 1999, 27:309-319.
83. Taylor H.A., Tversky B. Spatial mental models derived from survey and route descriptions. Journal of Memory and Language 1992, 31:261-292.
84. Taylor H.A., Tversky B. Descriptions and depictions of environments. Memory and Cognition 1992, 20:483-496.
85. Tettamanti M., Buccino G., Saccuman M.C., Gallese V., Danna M., Scifo P., et al. Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience 2005, 17:273-281.
86. Tversky B. Cognitive maps, cognitive collages, and spatial mental models. 716 1993, Springer, Berlin. A.U. Frank, I. Campari (Eds.).
87. van Asselen M., Fritschy E., Postma A. The influence of intentional and incidental learning on acquiring spatial knowledge during navigation. Psychological Research 2006, 70:151-156.
88. van Dijk T.A., Kintsch W. Strategies of discourse comprehension 1983, Academic Press, New York.
89. Waller D., Richardson A.R. Correcting distance estimates by interacting with immersive virtual environments: Effects of task and available sensory information. Journal of Experimental Psychology: Applied 2008, 14:61-72.
90. Wilson M. Six views of embodied cognition. Psychonomic Bulletin and Review 2002, 9:625-636.
91. Yaxley R.H., Zwaan R.A. Simulating visibility during language comprehension. Cognition 2007, 105:229-236.
92. Zwaan R.A. The immersed experience: Toward an embodied theory of language comprehension. The psychology of learning and motivation 2004, 35-62. Academic Press, New York. B.H. Ross (Ed.).
93. Zwaan R.A., Radvansky G.A. Situation models in language comprehension and memory. Psychological Bulletin 1998, 123:162-185.
94. Zwaan R.A., Rapp D.N. Discourse comprehension. Handbook of psycholinguistics 2006, 725-764. Elsevier, San Diego, CA. M.A. Gernsbacher, M.J. Traxler (Eds.).
95. Zwaan R.A., Stanfield R.A., Yaxley R.H. Language comprehenders mentally represent the shapes of objects. Psychological Science 2002, 13:168-171.
96. Zwaan R.A., Taylor L.J. Seeing, acting, understanding: Motor resonance in language comprehension. Journal of Experimental Psychology: General 2006, 135:1-11.
97. Zwaan R.A. Embodied cognition, perceptual symbols, and situation models. Discourse Processes 1999, 28:81-88.