Sounds exaggerate visual shape

Cognition

Volumn 124, Issue 2, 2012, Pages 194-200

  Sweeny, Timothy D ^a   Guzman Martinez, Emmanuel ^b   Ortega, Laura ^b   Grabowecky, Marcia ^b   Suzuki, Satoru ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Aspect ratio; Auditory visual; Crossmodal; Shape perception; Speech perception

Indexed keywords

ADAPTATION; ARTICLE; CLINICAL ARTICLE; CONTROLLED STUDY; GEOMETRY; HEARING; HUMAN; MOUTH; PERCEPTION; PRIORITY JOURNAL; SOUND; SPEECH ANALYSIS; VISION; VISUAL INFORMATION;

ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; HUMANS; PHONETICS; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 84862657239     PISSN: 00100277     EISSN: 18737838     Source Type: Journal    
DOI: 10.1016/j.cognition.2012.04.009     Document Type: Article

References (41)

1. Beauchamp M.S., Argall B.D., Bodurka J., Duyn J.H., Martin A. Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nature Neuroscience 2004, 7:1190-1192.
2. Bernstein I.H., Edelstein B.A. Effects of some variations in auditory input upon visual choice reaction time. Journal of Experimental Psychology 1971, 87:241-247.
3. Biederman I. Recognizing depth-rotated objects: A review of recent research and theory. Spatial Vision 2001, 13:241-253.
4. Brainard D.H. The psychophysics toolbox. Spatial Vision 1997, 10:433-436.
5. Calvert G.A., Bullmore E.T., Brammer M.J., Campbell R., Williams S.C.R., McGuire P.K., et al. Activation of auditory cortex during silent lip reading. Science 1997, 276:593-596.
6. Fadiga L., Craighero L., Buccino G., Rizzolatti G. Speech listening specifically modulates the excitability of tongue muscles: A TMS study. European Journal of Neuroscience 2002, 15:399-402.
7. Galantucci B., Fowler C.A., Turvey M.T. The motor theory of speech reviewed. Psychonomic Bulletin & Review 2006, 13:361-377.
8. Gallace A., Spence C. Multisensory synesthetic interactions in the speeded classification of visual size. Perception & Psychophysics 2006, 68:1191-1203.
9. Kayaert G., Biederman I., Vogels R. Shape tuning in macaque inferior temporal cortex. The Journal of Neuroscience 2003, 23:3016-3027.
10. Kleiner, M., Brainard, D., & Pelli, D. (2007). What's new in Psychtoolbox-3? Perception, 36 (ECVP Abstract Supplement).
11. Knill D.C. Surface orientation from texture: Ideal observers, generic observers and the information content of texture cues. Vision Research 1998, 38:1655-1682.
12. Knill D.C. Discriminating surface slant from texture: Comparing human and ideal observers. Vision Research 1998, 38:1683-1711.
13. Köhler W. Gestalt psychology 1947, Liveright, New York. 2nd ed.
14. Kuhl P.K., Meltzoff A.N. The bimodal perception of speech in infancy. Science 1982, 218:1138-1141.
15. Lavie N. Distracted and confused? Selective attention under load. Trends in Cognitive Sciences 2005, 9:75-82.
16. Liberman A.M., Mattingly I.G. The motor theory of speech revised. Cognition 1985, 21:1-36.
17. Marks L.E. Auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology: Human Perception and Performance 1987, 13:384-394.
18. Marks L.E. On perceptual metaphors. Metaphor and symbolic activity 1996, 11:39-66.
19. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976, 264:746-748.
20. Miller L.M., D'Esposito M. Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. The Journal of Neuroscience 2005, 25:5884-5893.
21. Nath A.R., Beauchamp M.S. Dynamic changes in superior temporal sulcus connectivity during perception of noisy audiovisual speech. The Journal of Neuroscience 2011, 31:1704-1714.
22. Parise C.V., Spence C. When birds of a feather flock together: Synesthetic correspondences modulate audiovisual integration in non-synesthetes. PLoS ONE 2009, 4:e5664.
23. Pelli D.G. The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision 1997, 10:437-442.
24. Pinsk M.A., Doniger G.M., Kastner S. Push-pull mechanism of selective attention in human extrastriate cortex. Journal of Neurophysiology 2004, 92:622-629.
25. Regan D., Hamstra S.J. Shape discrimination and the judgment of perfect symmetry: Dissociation of shape from size. Vision Research 1992, 32:1845-1864.
26. Sapir E. A study in phonetic symbolism. Journal of Experimental Psychology 1929, 12:225-239.
27. Schroeder C.E., Foxe J. Multisensory contributions to low-level, 'unisensory' processing. Current Opinion in Neurobiology 2005, 15:454-458.
28. Sherman A., Sweeny T.D., Grabowecky M., Suzuki S. Laughter exaggerates happy and sad faces depending on visual context. Psychonomic Bulletin & Review 2012, 1069-9384:1-7.
29. Skipper J.I., Nusbaum H.C., Small S.L. Listening to talking faces: Motor cortical activation during speech perception. NeuroImage 2005, 25:76-89.
30. Skipper J.I., van Wassenhove V., Nusbaum H.C., Small S.L. Hearing lips and seeing voices: How cortical areas supporting speech production mediate audiovisual speech perception. Cerebral Cortex 2007, 17:2387-2399.
31. Smith E., Grabowecky M., Suzuki S. Auditory-visual crossmodal integration in perception of face gender. Current Biology 2007, 17:1680-1685.
32. Suzuki S. Attentional selection of overlapped shapes: A study using brief aftereffects. Vision Research 2003, 43:549-561.
33. Suzuki S. High-level pattern coding revealed by brief shape aftereffects. Fitting the mind to the world: Adaptation and aftereffects in high-level vision. Advances in Visual Cognition Series 2005, Vol. 2. Oxford University Press.
34. Suzuki S., Cavanagh P. A shape-contrast effect for briefly presented stimuli. Journal of Experimental Psychology: Human Perception and Performance 1998, 24(5):1315-1341.
35. Sweeny T.D., Kim Y.J., Grabowecky M., Suzuki S. Internal curvature signal and noise in low- and high-level vision. Journal of Neurophysiology 2011, 105:1236-1257.
36. von Kriegstein K., Dogan O., Giraud A.-L., Kell C.A., Gruter T., Kleinschmidt A., et al. Simulation of talking faces in the human brain improves auditory speech recognition. Proceedings of the National Academy of Sciences, USA 2008, 105:6747-6752.
37. Watkins K.E., Strafella A.P., Paus T. Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia 2003, 41:989-994.
38. Wilson M. Six views of embodied cognition. Psychonomic Bulletin & Review 2002, 9:625-636.
39. Wolfe J. Short test flashes produce large tilt aftereffects. Vision Research 1984, 24:1959-1964.
40. Yehia H., Rubin P., Vatikiotis-Bateson E. Quantitative association of vocal tract and facial behavior. Speech Communication 1998, 26:23-43.
41. Young M.P., Yamane S. Sparse population coding of faces in the inferotemporal cortex. Science 1992, 256:1327-1331.