What is the link between language and spatial images? Behavioral and neural findings in blind and sighted individuals

Acta Psychologica

Volumn 132, Issue 2, 2009, Pages 145-156

  Struiksma, Marijn E ^a   Noordzij, Matthijs L ^b   Postma, Albert ^a  

^a UTRECHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Amodal; Blind; Multimodal; Spatial imagery; Spatial language; Supramodal

Indexed keywords

ARTICLE; BLINDNESS; BRAIN MAPPING; DEPTH PERCEPTION; HUMAN; IMAGINATION; LANGUAGE; LINGUISTICS; MENTAL FUNCTION; PHYSIOLOGY; PSYCHOLOGICAL ASPECT;

BLINDNESS; BRAIN MAPPING; HUMANS; IMAGINATION; LANGUAGE; MENTAL PROCESSES; PSYCHOLINGUISTICS; SPACE PERCEPTION;

EID: 70349238956     PISSN: 00016918     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.actpsy.2009.04.002     Document Type: Article

References (99)

1. Aleman A., Van Lee L., Mantione M.H., Verkoijen I.G., and De Haan E.H. Visual imagery without visual experience: Evidence from congenitally totally blind people. NeuroReport 12 11 (2001) 2601-2604
2. Amedi A., Floel A., Knecht S., Zohary E., and Cohen L.G. Transcranial magnetic stimulation of the occipital pole interferes with verbal processing in blind subjects. Nature Neuroscience 7 11 (2004) 1266-1270
3. Amedi A., Raz N., Pianka P., Malach R., and Zohary E. Early 'visual' cortex activation correlates with superior verbal memory performance in the blind. Nature Neuroscience 6 7 (2003) 758-766
4. Avraamides M.N., Loomis J.M., Klatzky R.L., and Golledge R.G. Functional equivalence of spatial representations derived from vision and language: evidence from allocentric judgments. Journal of Experimental Psychology: Learning, Memory and Cognition 30 4 (2004) 801-814
5. Baciu M., Koenig O., Vernier M.P., Bedoin N., Rubin C., and Segebarth C. Categorical and coordinate spatial relations: fMRI evidence for hemispheric specialization. NeuroReport 10 6 (1999) 1373-1378
6. Barsalou L.W. Perceptual symbol systems. Behavioral and Brain Sciences 22 04 (1999) 577-660
7. Barsalou L.W. Grounded cognition. Annual Review of Psychology 59 1 (2008) 617-645
8. Barsalou L.W., Santos A., Simmons W.K., and Wilson C.D. Language and simulation in conceptual processing. In: De Vega M., Glenberg A.M., and Graesser A.C. (Eds). Symbols and embodiment: Debates on meaning and cognition (2008), Oxford University Press, Oxford 245-284
9. Bryant D.J. Representing space in language and perception. Mind and Language 12 3-4 (1997) 239-264
10. Burton H., and McLaren D.G. Visual cortex activation in late-onset, Braille naive blind individuals: An fMRI study during semantic and phonological tasks with heard words. Neuroscience Letters 392 1-2 (2006) 38-42
11. Burton H., Snyder A.Z., Diamond J.B., and Raichle M.E. Adaptive changes in early and late blind: A fMRI study of verb generation to heard nouns. Journal of Neurophysiology 88 6 (2002) 3359-3371
12. Byrne R.W., and Salter E. Distances and directions in the cognitive maps of the blind. Canadian Journal of Psychology 37 (1983) 293-299
13. Carpenter P.A., Just M.A., Keller T.A., Eddy W.F., and Thulborn K.R. Time course of fMRI-activation in language and spatial networks during sentence comprehension. NeuroImage 10 2 (1999) 216-224
14. Cattaneo Z., and Vecchi T. Supramodality effects in visual and haptic spatial processes. Journal of Experimental Psychology: Learning, Memory and Cognition 34 3 (2008) 631-642
15. Cattaneo Z., Vecchi T., Cornoldi C., Mammarella I., Bonino D., Ricciardi E., et al. Imagery and spatial processes in blindness and visual impairment. Neuroscience and Biobehavioral Reviews 32 8 (2008) 1346-1360
16. Chatterjee A. Language and space: Some interactions. Trends in Cognitive Sciences 5 2 (2001) 55-61
17. Chatterjee A. The neural organization of spatial thought and language. Seminars in Speech and Language 29 03 (2008) 226-238
18. Chomsky N. New horizons in the study of language and mind (2000), Cambridge University Press, Cambridge
19. Cohen L.G., Celnik P., Pascual-Leone A., Corwell B., Faiz L., Dambrosia J., et al. Functional relevance of cross-modal plasticity in blind humans. Nature 389 6647 (1997) 180-184
20. Cornoldi C., and De Beni R. Imagery and blindness. In: Della Sala S. (Ed). Tall tales about the mind and brain: Separating fact from fiction (2007), Oxford University Press, New York, NY, USA 369-379
21. Cornoldi C., De Beni R., Giusberti F., and Massironi M. Memory and imagery: A visual trace is not a mental image. In: Conway M., Gathercole S., and Cornoldi C. (Eds). Theories of memory (1998), Psychology Press, Hove, UK 87-110
22. Cornoldi C., Tinti C., Mammarella I.C., Re A.M., and Varotto D. Memory for an imagined pathway and strategy effects in sighted and in totally congenitally blind individuals. Acta Psychologica 130 1 (2009) 11-16
23. Creem S.H., and Proffitt D.R. Defining the cortical visual systems: "what", "where", and "how". Acta Psychologica 107 1-3 (2001) 43-68
24. Damasio H., Grabowski T.J., Tranel D., Ponto L.L., Hichwa R.D., and Damasio A.R. Neural correlates of naming actions and of naming spatial relations. NeuroImage 13 6 (2001) 1053-1064
25. De Beni R., and Cornoldi C. Imagery limitations in totally congenitally blind subjects. Journal of Experimental Psychology: Learning, Memory and Cognition 14 4 (1988) 650-655
26. De Vega M., Cocude M., Denis M., Rodrigo M.J., and Zimmer H.D. The interface between language and visuo-spatial representations. In: Denis M., Logie R.H., Cornoldi C., De Vega M., and Engelkamp J. (Eds). Imagery, language, and visuo-spatial thinking (2001), Psychology Press, Hove, England 109-136
27. Denis M. Assessing the symbolic distance effect in mental images constructed from verbal descriptions: A study of individual differences in the mental comparison of distances. Acta Psychologica 127 1 (2008) 197-210
28. Denis M., and Zimmer H.D. Analog properties of cognitive maps constructed from verbal descriptions. Psychological Research 54 4 (1992) 286-298
29. Denis M., Pazzaglia F., Cornoldi C., and Bertolo L. Spatial discourse and navigation: an analysis of route directions in the city of Venice. Applied Cognitive Psychology 13 2 (1999) 145-174
30. Dodds A.G., Howarth C.L., and Carter D.C. The mental maps of the blind: The role of previous visual experience. Journal of Visual Impairment and Blindness 76 (1982) 5-12
31. Farah M.J. The neural basis of mental imagery. Trends in Neuroscience 12 10 (1989) 395-399
32. Farah M.J., Hammond K.M., Levine D.N., and Calvanio R. Visual and spatial mental imagery: Dissociable systems of representation. Cognitive Psychology 20 4 (1988) 439-462
33. Farah M.J., Péronnet F., Gonon M.A., and Giard M.H. Electrophysiological evidence for a shared representational medium for visual images and visual percepts. Journal of Experimental Psychology: General 117 3 (1988) 248-257
34. Fauconnier G. Creativity, simulation, and conceptualization. Behavioral and Brain Sciences 22 (1999) 615
35. Freksa C., Barkowsky T., and Klippel A. Spatial symbol systems and spatial cognition: A computer science perspective on perception-based symbol processing. Behavioral and Brain Sciences 22 (1999) 616-617
36. Galati G., Lobel E., Vallar G., Berthoz A., Pizzamiglio L., and Le Bihan D. The neural basis of egocentric and allocentric coding of space in humans: A functional magnetic resonance study. Experimental Brain Research 133 2 (2000) 156-164
37. Ganis G., Thompson W.L., and Kosslyn S.M. Brain areas underlying visual mental imagery and visual perception: An fMRI study. Cognitive Brain Research 20 2 (2004) 226-241
38. Goyal M.S., Hansen P.J., and Blakemore C.B. Tactile perception recruits functionally related visual areas in the late-blind. NeuroReport 17 13 (2006) 1381-1384
39. Grefkes C., Weiss P.H., Zilles K., and Fink G.R. Crossmodal processing of object features in human anterior intraparietal cortex: An fMRI study implies equivalencies between humans and monkeys. Neuron 35 1 (2002) 173-184
40. Jackendoff R. Foundations of language: Brain, meaning, grammar, evolution (2002), Oxford University Press
41. Jager G., and Postma A. On the hemispheric specialization for categorical and coordinate spatial relations: A review of the current evidence. Neuropsychologia 41 (2003) 504-515
42. Jeannerod M. Mental imagery in the motor context. Neuropsychologia 33 11 (1995) 1419-1432
43. Kaski D. Revision: Is visual perception a requisite for visual imagery?. Perception 31 6 (2002) 717-731
44. Kemmerer D. The semantics of space: Integrating linguistic typology and cognitive neuroscience. Neuropsychologia 44 9 (2006) 1607-1621
45. Kerr N.H. The role of vision in "visual imagery" experiments: Evidence from the congenitally blind. Journal of Experimental Psychology: General 112 2 (1983) 265-277
46. Klatzky R.L., and Golledge R.G. Performance of blind and sighted persons on spatial tasks. Journal of Visual Impairment and Blindness 89 1 (1995) 70-82
47. Knauff M., and May E. Mental imagery, reasoning, and blindness. Quarterly Journal of Experimental Psychology 59 1 (2006) 161-177
48. Kobayashi M., Takeda M., Hattori N., Fukunaga M., Sasabe T., Inoue N., et al. Functional imaging of gustatory perception and imagery: "Top-down" processing of gustatory signals. NeuroImage 23 4 (2004) 1271-1282
49. Kosslyn S.M. Seeing and imagining in the cerebral hemispheres: A computational approach. Psychological Review 94 2 (1987) 148-175
50. Kosslyn S.M., Ball T.M., and Reiser B.J. Visual images preserve metric spatial information: Evidence from studies of image scanning. Journal of Experimental Psychology: Human Perception and Performance 4 1 (1978) 47-60
51. Kosslyn S.M., Ganis G., and Thompson W.L. Neural foundations of imagery. Nature Reviews Neuroscience 2 9 (2001) 635-642
52. Kosslyn S.M., Koenig O., Barrett A., Cave C.B., Tang J., and Gabrieli J.D. Evidence for two types of spatial representations: Hemispheric specialization for categorical and coordinate relations. Journal of Experimental Psychology: Human Perception and Performance 15 4 (1989) 723-735
53. Kosslyn S.M., Margolis J.A., Barrett A.M., Goldknopf E.J., and Daly P.F. Age differences in imagery abilities. Child Development 61 4 (1990) 995-1010
54. Kosslyn S.M., Pascual-Leone A., Felician O., Camposano S., Keenan J.P., Thompson W.L., et al. The role of area 17 in visual imagery: Convergent evidence from PET and rTMS. Science 284 5411 (1999) 167-170
55. Laeng B. Lateralization of categorical and coordinate spatial functions: A study of unilateral stroke patients. Journal of Cognitive Neuroscience 6 3 (1994) 189-203
56. Lambert S., Sampaio E., Mauss Y., and Scheiber C. Blindness and brain plasticity: Contribution of mental imagery? An fMRI study. Cognitive Brain Research 20 1 (2004) 1-11
57. Loomis J.M., Klatzky R.L., Avraamides M., Lippa Y., and Golledge R.G. Functional equivalence of spatial images produced by perception and spatial language. In: Mast F., and Jäncke J. (Eds). Spatial processing in navigation, imagery, and perception (2007), Springer, New York 29-48
58. Loomis J.M., Klatzky R.L., Golledge R.G., Cicinelli J.G., Pellegrino J.W., and Fry P.A. Nonvisual navigation by blind and sighted: Assessment of path integration ability. Journal of Experimental Psychology: General 122 1 (1993) 73-91
59. MacLeod C.M., Hunt E.B., and Mathews N.N. Individual differences in the verification of sentence-picture relationships. Journal of Verbal Learning and Verbal Behavior 17 5 (1978) 493-507
60. Mazard A., Laou L., Joliot M., and Mellet E. Neural impact of the semantic content of visual mental images and visual percepts. Cognitive Brain Research 24 3 (2005) 423-435
61. Mellet E., Bricogne S., Tzourio-Mazoyer N., Ghaëm O., Petit L., Zago L., et al. Neural correlates of topographic mental exploration: The impact of route versus survey perspective learning. NeuroImage 12 5 (2000) 588-600
62. Moyer R.S., and Bayer R.H. Mental comparison and the symbolic distance effect. Cognitive Psychology 8 (1976) 228-246
63. Noordzij M.L., Neggers S.F.W., Ramsey N.F., and Postma A. Neural correlates of locative prepositions. Neuropsychologia 46 5 (2008) 1576-1580
64. Noordzij M.L., and Postma A. Categorical and metric distance information in mental representations derived from route and survey descriptions. Psychological Research 69 3 (2005) 221-232
65. Noordzij M.L., Van der Lubbe R.H., and Postma A. Strategic and automatic components in the processing of linguistic spatial relations. Acta Psychologica 119 1 (2005) 1-20
66. Noordzij M.L., Van der Lubbe R.H., and Postma A. Electrophysiological support for strategic processing of spatial sentences. Psychophysiology 43 3 (2006) 277-286
67. Noordzij M.L., Zuidhoek S., and Postma A. The influence of visual experience on the ability to form spatial mental models based on route and survey descriptions. Cognition 100 2 (2006) 321-342
68. Noordzij M.L., Zuidhoek S., and Postma A. The influence of visual experience on visual and spatial imagery. Perception 36 1 (2007) 101-112
69. Noppeney U. The effects of visual deprivation on functional and structural organization of the human brain. Neuroscience and Biobehavioral Reviews 31 (2007) 1169-1180
70. Noppeney U., Friston K.J., Ashburner J., Frackowiak R.S.J., and Price C.J. Early visual deprivation induces structural plasticity in gray and white matter. Current Biology 15 13 (2005) R488-R490
71. Noppeney U., Friston K., and Price C. Effects of visual deprivation on the organization of the semantic system. Brain 126 7 (2003) 1620-1627
72. Ofan R.H., and Zohary E. Visual cortex activation in bilingual blind individuals during use of native and second language. Cerebral Cortex 17 6 (2007) 1249-1259
73. Paivio A. Imagery and verbal processes (1971), Holt, Rinehart, and Winston, New York
74. Paivio A. Comparisons of mental clocks. Journal of Experimental Psychology: Human Perception and Performance 4 1 (1978) 61-71
75. Pascual-Leone A., Amedi A., Fregni F., and Merabet L.B. The plastic human brain cortex. Annual Review of Neuroscience 28 (2005) 377-401
76. Postma A., Zuidhoek S., Noordzij M.L., and Kappers A.M.L. Differences between early-blind, late-blind, and blindfolded-sighted people in haptic spatial-configuration learning and resulting memory traces. Perception 36 (2007) 1253-1265
77. Postma A., Zuidhoek S., Noordzij M.L., and Kappers A.M.L. Haptic orientation perception benefits from visual experience: Evidence from early-blind, late-blind, and sighted people. Perception and Psychophysics 70 7 (2008) 1197-1206
78. Reichle E.D., Carpenter P.A., and Just M.A. The neural bases of strategy and skill in sentence-picture verification. Cognitive Psychology 40 4 (2000) 261-295
79. Reisberg D. Cognition: Exploring the science of the mind (1997), W.W. Norton and Company, New York
80. Ricciardi E., Bonino D., Gentili C., Sani L., Pietrini P., and Vecchi T. Neural correlates of spatial working memory in humans: A functional magnetic resonance imaging study comparing visual and tactile processes. Neuroscience 139 1 (2006) 339-349
81. Rieser J.J., Guth D.A., and Hill E.W. Sensitivity to perspective structure while walking without vision. Perception 15 (1986) 173-188
82. Röder B., Stock O., Bien S., Neville H., and Rösler F. Speech processing activates visual cortex in congenitally blind humans. European Journal of Neuroscience 16 5 (2002) 930-936
83. Sadato N., Okada T., Honda M., and Yonekura Y. Critical period for cross-modal plasticity in blind humans: A functional MRI study. NeuroImage 16 2 (2002) 389-400
84. Saito D.N., Okada T., Morita Y., Yonekura Y., and Sadato N. Tactile-visual cross-modal shape matching: a functional MRI study. Cognitive Brain Research 17 1 (2003) 14-25
85. Stevenson R.J., and Case T.I. Olfactory imagery: A review. Psychonomic Bulletin and Review 12 (2005) 244-264
86. Thinus-Blanc C., and Gaunet F. Representation of space in blind persons: Vision as a spatial sense?. Psychological Bulletin 121 1 (1997) 20-42
87. Tranel D., and Kemmerer D. Neuroanatomical correlates of locative prepositions. Cognitive Neuropsychology 21 7 (2004) 719-749
88. Trojano L., Conson M., Maffei R., and Grossi D. Categorical and coordinate spatial processing in the imagery domain investigated by rTMS. Neuropsychologia 44 9 (2006) 1569-1574
89. Trojano L., Grossi D., Linden D.E.J., Formisano E., Goebel R., Cirillo S., et al. Coordinate and categorical judgements in spatial imagery. An fMRI study. Neuropsychologia 40 10 (2002) 1666-1674
90. Uhl F., Kretschmer T., Lindinger G., Goldenberg G., Lang W., Oder W., et al. Tactile mental imagery in sighted persons and in patients suffering from peripheral blindness early in life. Electroencephalography and clinical Neurophysiology 91 4 (1994) 249-255
91. Vanlierde A., De Volder A.G., Wanet-Defalque M.-C., and Veraart C. Occipito-parietal cortex activation during visuo-spatial imagery in early blind humans. NeuroImage 19 3 (2003) 698-709
92. Vanlierde A., and Wanet-Defalque M.-C. Abilities and strategies of blind and sighted subjects in visuo-spatial imagery. Acta Psychologica 116 (2004) 205-222
93. Vecchi T. Visuo-spatial processing in congenitally blind people: Is there a gender-related preference?. Personality and Individual Differences 30 (2001) 1361-1370
94. Vecchi T., Tinti C., and Cornoldi C. Spatial memory and integration processes in congenital blindness. NeuroReport 15 18 (2004) 2787-2790
95. Wu L.-L., and Barsalou L.W. Perceptual simulation in conceptual combination: Evidence from property generation. Acta Psychologica 132 2 (2009) 173-189
96. Yoo S.S., Freeman D.K., McCarthy III J.J., and Jolesz F.A. Neural substrates of tactile imagery: A functional MRI study. NeuroReport 14 4 (2003) 581-585
97. Yoo S.S., Lee C.U., and Choi B.G. Human brain mapping of auditory imagery: Event-related functional MRI study. NeuroReport 12 14 (2001) 3045-3049
98. Zuidhoek S., Kappers A.M.L., Van der Lubbe R.H.J., and Postma A. Delay improves performance on a haptic spatial matching task. Experimental Brain Research 149 3 (2003) 320-330
99. Zwaan R.A., and Radvansky G.A. Situation models in language comprehension and memory. Psychological Bulletin 123 2 (1998) 162-185