Cross-linguistic sound symbolism and crossmodal correspondence: Evidence from fMRI and DTI

Brain and Language

Volumn 128, Issue 1, 2014, Pages 18-24

  Revill, Kate Pirog ^a   Namy, Laura L ^b   DeFife, Lauren Clepper ^b,c   Nygaard, Lynne C ^b  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b EMORY UNIVERSITY   (United States)

^c GEORGIA STATE UNIVERSITY   (United States)

Author keywords

Crossmodal correspondences; DTI; FMRI; Sound symbolism; Spoken language

Indexed keywords

ADULT; ARTICLE; BEHAVIORAL SCIENCE; CONTROLLED STUDY; CROSSMODAL CORRESPONDENCE; DIFFUSION TENSOR IMAGING; FEMALE; FRACTIONAL ANISOTROPY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; LEFT SUPERIOR LONGITUDINAL FASCICULUS; LEFT SUPERIOR PARIETAL CORTEX; LINGUISTICS; MALE; NERVE TRACT; NORMAL HUMAN; PARIETAL CORTEX; SOUND; SPEECH AND LANGUAGE; STIMULUS RESPONSE; SYMBOLISM; TASK PERFORMANCE; YOUNG ADULT;

CROSSMODAL CORRESPONDENCES; DTI; FMRI; SOUND SYMBOLISM; SPOKEN LANGUAGE;

ADOLESCENT; ADULT; BRAIN; BRAIN MAPPING; DIFFUSION TENSOR IMAGING; FEMALE; HUMANS; LANGUAGE; LINGUISTICS; MAGNETIC RESONANCE IMAGING; MALE; PARIETAL LOBE; SEMANTICS; SPEECH PERCEPTION; SYMBOLISM; YOUNG ADULT;

EID: 84888794787     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2013.11.002     Document Type: Article

References (59)

1. Aziz-Zadeh L., Fiebach C.J., Naranayan S., Feldman J., Dodge E., Ivry R.B. Modulation of the FFA and PPA by language related to faces and places. Social Neuroscience 2008, 3(3-4):229-238.
2. Bergen B.K. The psychological reality of phonaesthemes. Language 2004, 80(2):290-311.
3. Berlin B. Evidence for pervasive synaesthetic sound symbolism in ethnozoological nomenclature. Sound symbolism 1994, 77-93. Cambridge University Press, New York. L. Hinton, J. Nichols, J. Ohala (Eds.).
4. Brang D., Hubbard E.M., Coulson S., Huang M., Ramachandran V.S. Magnetoencephalography reveals early activation of V4 in grapheme-color synesthesia. Neuroimage 2010, 53(1):268-274.
5. Brang D., Taich Z., Hillyard S.A., Grabowecky M., Ramachandran V.S. Parietal connectivity mediates multisensory facilitation. Neuroimage 2013.
6. Brang D., Williams L.E., Ramachandran V.S. Grapheme-color synesthetes show enhanced crossmodal processing between auditory and visual modalities. Cortex 2012, 48(5):630-637.
7. Brown R.W., Black A.H., Horowitz A.E. Phonetic symbolism in natural languages. Journal of Abnormal Psychology 1955, 50(3):388-393.
8. Calvert G.A. Crossmodal processing in the human brain: Insights from functional neuroimaging studies. Cerebral Cortex 2001, 11(12):1110-1123.
9. Chao L.L., Weisberg J., Martin A. Experience-dependent modulation of category-related cortical activity. Cerebral Cortex 2002, 12(5):545-551.
10. Cox R.W. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research 1996, 29(3):162-173.
11. DeFife, L. C., Nygaard, L. C., & Namy, L. L. (in preparation). Cross-linguistic consistency and within-language variability of sound symbolism in natural languages.
12. Esterman M., Verstynen T., Ivry R.B., Robertson L.C. Coming unbound: disrupting automatic integration of synesthetic color and graphemes by transcranial magnetic stimulation of the right parietal lobe. Journal of Cognitive Neuroscience 2006, 18(9):1570-1576.
13. Gasser, M. (2004). The origins of arbitrariness in language. Paper presented at the Proceedings of the Cognitive Science Society.
14. Hickok G., Poeppel D. The cortical organization of speech processing. Nature Reviews Neuroscience 2007, 8:393-402.
15. Hockett C.F. The view from language: selected essays, 1948-1974 1977, University of Georgia Press, Athens.
16. Hua K., Zhang J., Wakana S., Jiang H., Li X., Reich D.S., et al. Tract probability maps in stereotaxic spaces: Analyses of white matter anatomy and tract-specific quantification. Neuroimage 2008, 39(1):336-347.
17. Hubbard E.M., Brang D., Ramachandran V.S. The cross-activation theory at 10. Journal of Neuropsychology 2011, 5(2):152-177.
18. Imai M., Kita S., Nagumo M., Okada H. Sound symbolism facilitates early verb learning. Cognition 2008, 109(1):54-65.
19. Jackendoff R. Foundations of language: Brain, meaning, grammar, evolution 2002, Oxford University Press, Oxford; New York.
20. Kita S. Two-dimensional semantic analysis of Japanese mimetics. Linguistics 1997, 35(2):379-415.
21. Kohler W. Gestalt psychology, an introduction to new concepts in modern psychology 1947, Liveright Pub. Corp, New York.
22. Kourtzi Z., Bulthoff H.H., Erb M., Grodd W. Object-selective responses in the human motion area MT/MST. Nature Neuroscience 2002, 5(1):17-18.
23. Kovic V., Plunkett K., Westermann G. The shape of words in the brain. Cognition 2010, 114(1):19-28.
24. Kunihira S. Effects of expressive voice on phonetic symbolism. Journal of Verbal Learning and Verbal Behavior 1971, 10(4):427-429.
25. Lancaster J.L., Tordesillas-Gutierrez D., Martinez M., Salinas F., Evans A., Zilles K., et al. Bias between MNI and Talairach coordinates analyzed using the ICBM-152 brain template. Human Brain Mapping 2007, 28(11):1194-1205.
26. Landau A.N., Aziz-Zadeh L., Ivry R.B. The influence of language on perception: listening to sentences about faces affects the perception of faces. Journal of Neuroscience 2010, 30(45):15254-15261.
27. Martino G., Marks L.E. Synesthesia: strong and weak. Current Directions in Psychological Science 2001, 10(2):61-65.
28. Maurer D., Pathman T., Mondloch C.J. The shape of boubas: sound-shape correspondences in toddlers and adults. Developmental Science 2006, 9(3):316-322.
29. Meteyard L., Zokaei N., Bahrami B., Vigliocco G. Visual motion interferes with lexical decision on motion words. Current Biology 2008, 18(17):R732-R733.
30. Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Brain Research. Cognitive Brain Research 2002, 14(1):115-128.
31. Monaghan P., Christiansen M.H., Chater N. The phonological-distributional coherence hypothesis: Cross-linguistic evidence in language acquisition. Cognitive Psychology 2007, 55(4):259-305.
32. Monaghan P., Christiansen M.H., Fitneva S.A. The arbitrariness of the sign: Learning advantages from the structure of the vocabulary. Journal of Experimental Psychology: General 2011, 140(3):325-347.
33. Namy, L. L., DeFife, L. C., Mathur, N. M., & Nygaard, L. C. (submitted). Cross-linguistic sound symbolism: Phonetic determinants of word meaning.
34. Neufeld J., Sinke C., Dillo W., Emrich H.M., Szycik G.R., Dima D., et al. The neural correlates of coloured music: A functional MRI investigation of auditory-visual synaesthesia. Neuropsychologia 2012, 50(1):85-89.
35. Neufeld J., Sinke C., Zedler M., Dillo W., Emrich H.M., Bleich S., et al. Disinhibited feedback as a cause of synesthesia: evidence from a functional connectivity study on auditory-visual synesthetes. Neuropsychologia 2012, 50(7):1471-1477.
36. Nuckolls J.B. The case for sound symbolism. Annual Review of Anthropology 1999, 28:225-252.
37. Nygaard L.C., Cook A.E., Namy L.L. Sound to meaning correspondences facilitate word learning. Cognition 2009, 112(1):181-186.
38. Ohala J. Cross-language use of pitch: An ethological view. Phonetica 1983, 40(1):1-18.
39. Ohala J.J. An ethological perspective on common cross-language utilization of F0 of voice. Phonetica 1984, 41(1):1-16.
40. Perniss P., Thompson R.L., Vigliocco G. Iconicity as a general property of language: Evidence from spoken and signed languages. Front Psychology 2010, 1:227.
41. Pinker S. Words and rules: The ingredients of language 1999, Basic Books, New York. 1st ed.
42. Ramachandran V.S., Hubbard E.M. Synesthesia - A window into perception, thought, and language. Journal of Consciousness Studies 2001, 8(12):3-34.
43. Revill K.P., Aslin R.N., Tanenhaus M.K., Bavelier D. Neural correlates of partial lexical activation. Proceedings of National Academy Science USA 2008, 105(35):13111-13115.
44. Robertson L.C. Binding, spatial attention and perceptual awareness. Nature Reviews Neuroscience 2003, 4(2):93-102.
45. Rouw R., Scholte H.S. Increased structural connectivity in grapheme-color synesthesia. Nature Neuroscience 2007, 10(6):792-797.
46. Sapir E. A study in phonetic symbolism. Journal of Experimental Psychology 1929, 12:225-239.
47. Saussure F.d. Course in general linguistics 1959, Philosophical Library, New York.
48. Saxe, R., Brett, M., & Kanwisher, N. (2006). Divide and conquer: a defense of functional localizers. Neuroimage, 30(4), 1088-1096; discussion 1097-1089.
49. Scott S.K., Blank C.C., Rosen S., Wise R.J. Identification of a pathway for intelligible speech in the left temporal lobe. Brain 2000, 123(Pt 12):2400-2406.
50. Sereno J.A., Jongman A. Phonological and form class relations in the lexicon. Journal of Psycholinguistic Research 1990, 19(6):387-404.
51. Smith S.M., Jenkinson M., Johansen-Berg H., Rueckert D., Nichols T.E., Mackay C.E., et al. Tract-based spatial statistics: Voxelwise analysis of multi-subject diffusion data. Neuroimage 2006, 31(4):1487-1505.
52. Spector F., Maurer D. Synesthesia: A new approach to understanding the development of perception. Developmental Psychology 2009, 45(1):175-189.
53. Spence C. Crossmodal correspondences: A tutorial review. Attenuation Percept Psychophysics 2011, 73(4):971-995.
54. Thompson R.L., Vinson D.P., Vigliocco G. The link between form and meaning in British sign language: Effects of iconicity for phonological decisions. Journal of Experimental Psychology. Learning, Memory, and Cognition 2010, 36(4):1017-1027.
55. Tzeng, C., Nygaard, L. C., & Namy, L. L. (submitted for publication). The specificity of sound symbolic correspondences in spoken language.
56. van Leeuwen T.M., den Ouden H.E., Hagoort P. Effective connectivity determines the nature of subjective experience in grapheme-color synesthesia. Journal of Neuroscience 2011, 31(27):9879-9884.
57. Vandermosten M., Boets B., Poelmans H., Sunaert S., Wouters J., Ghesquiere P. A tractography study in dyslexia: neuroanatomic correlates of orthographic, phonological and speech processing. Brain 2012, 135(Pt 3):935-948.
58. Willems R.M., Casasanto D. Flexibility in embodied language understanding. Front Psychology 2011, 2:116.
59. Wong F.C., Chandrasekaran B., Garibaldi K., Wong P.C. White matter anisotropy in the ventral language pathway predicts sound-to-word learning success. Journal of Neuroscience 2011, 31(24):8780-8785.