The sound of motion in spoken language: Visual information conveyed by acoustic properties of speech

Cognition

Volumn 105, Issue 3, 2007, Pages 681-690

  Shintel, Hadas ^a   Nusbaum, Howard C ^a  

^a UNIVERSITY OF CHICAGO   (United States)

Author keywords

Perceptual representations; Prosody; Spoken language comprehension

Indexed keywords

ACOUSTICS; ARTICLE; BEHAVIOR; CONTROLLED STUDY; HUMAN; HUMAN EXPERIMENT; LANGUAGE; LANGUAGE ABILITY; LEARNING; PERCEPTION; PRIORITY JOURNAL; SPEECH; VISION; VISUAL INFORMATION; VISUAL STIMULATION;

HUMANS; LANGUAGE; SOUND; SPEECH; SPEECH ACOUSTICS; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 34948909655     PISSN: 00100277     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cognition.2006.11.005     Document Type: Article

References (32)

1. Banse R., and Scherer K.R. Acoustic profiles in vocal emotion expression. Journal of Personality & Social Psychology 70 3 (1996) 614-636
2. Barsalou L. Perceptual symbol systems. Behavioral & Brain Sciences 22 (1999) 577-660
3. Bernstein I., and Edelstein B. Effects of some variations in auditory input upon visual choice reaction time. Journal of Experimental Psychology 87 (1971) 241-247
4. Birch S., and Clifton C. Focus, accent, and argument structure: effects on language comprehension. Language and Speech 38 (1995) 365-391
5. Bolinger D.L. Intonation across languages. In: Greenberg J.H., Ferguson C.A., and Moravcsik E.A. (Eds). Universals of human language phonology Vol. 2 (1964), Stanford University Press, Stanford, CA
6. Bolinger D. The inherent iconism of intonation. In: Haiman J. (Ed). Natural syntax: iconicity and erosion (1985), Cambridge University Press, Cambridge, UK
7. Bryant G.A., and Fox Tree J.E. Recognizing verbal irony in spontaneous speech. Metaphor & Symbol 17 2 (2002) 99-117
8. Dunlap W.P., Cortina J.M., Vaslow J.B., and Burke M.J. Meta-analysis of experiments with matched groups or repeated measures designs. Psychological Methods 1 2 (1996) 170-177
9. Fodor J.A. The language of thought (1975), Thomas Y. Crowell, New York
10. Freyd J.J. The mental representation of movement when static stimuli are viewed. Perception and Psychophysics 33 (1983) 575-581
11. Freyd J.J. Dynamic mental representation. Psychological Review 94 (1987) 427-438
12. Glenberg A.M., and Kaschak M.P. Grounding language in action. Psychological Bulletin & Review 9 (2002) 558-565
13. Glenberg A.M., and Robertson D.A. Symbol grounding and meaning: a comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language 43 (2000) 379-401
14. Goldin-Meadow S. The role of gesture in communication and thinking. Trends in Cognitive Science 3 (1999) 419-429
15. Gussenhoven C. Intonation and interpretation: phonetics and phonology. In: Bel B., and Marlien I. (Eds). Proceedings of the Speech Prosody 2002 Conference (2002), ProSig and Université de Provence Laboratoire Parole et Langage, Aix-en-Provence
16. Harnad S. The symbol grounding problem. Physica D 42 (1990) 335-346
17. Hockett C.F. The origin of speech. Scientific American 203 3 (1960) 88-96
18. Kourtzi Z., and Kanwisher N. Activation in human MT/MST by static images with implied motion. Journal of Cognitive Neuroscience 12 (2000) 48-55
19. Marks L.E. On cross-modal similarity: auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology: Human Perception & Performance 13 3 (1987) 384-394
20. McNeill D. Hand and mind: what gestures reveal about thought (1992), University of Chicago Press, Chicago
21. Melara R., and Marks L. Processes underlying dimensional interactions: correspondences between linguistic and nonlinguistic dimensions. Memory & Cognition 18 (1990) 477-495
22. Melara R., and O'Brien T. Interaction between synesthetically corresponding dimensions. Journal of Experimental Psychology: General 116 (1987) 323-336
23. Ohala J. The frequency code underlies the sound-symbolic use of voice pitch. In: Hinton L., Nichols J., and Ohala J. (Eds). Sound symbolism (1994), Cambridge University Press, Cambridge, UK
24. Peirce C.S. Division of signs. In: Hartshorne C., and Weiss P. (Eds). Collected papers of C.S. Peirce Vol. 2 (1932), Harvard University Press, Cambridge, MA
25. Pylyshyn Z.W. Computation and cognition: toward a foundation for cognitive science (1986), MIT Press, Cambridge, MA
26. Saussure F.de. Course in general linguistics (1959), McGraw-Hill, New York and London
27. Shintel H., Nusbaum H.C., and Okrent A. Analog acoustic expression in speech. Journal of Memory and Language 55 (2006) 167-177
28. Snedeker J., and Trueswell J. Using prosody to avoid ambiguity: Effects of speaker awareness and referential context. Journal of Memory and Language 48 (2003) 103-130
29. Stanfield R.A., and Zwaan R.A. The effect of implied orientation derived from verbal context on picture recognition. Psychological Science 12 2 (2001) 153-156
30. Zwaan R.A., and Madden C.J. In: Pecher D., and Zwaan R.A. (Eds). The grounding of cognition: the role of perception and action in memory, language, and thinking (2004), Cambridge University Press, Cambridge, UK
31. Zwaan R.A., Madden C.J., Yaxley R.H., and Aveyard M.E. Moving words: dynamic representations in language comprehension. Cognitive Science 28 (2004) 611-619
32. Zwaan R.A., Stanfield R.A., and Yaxley R.H. Language comprehenders mentally represent the shape of objects. Psychological Science 13 (2002) 168-171