Aero-tactile integration in speech perception

Nature

Volumn 462, Issue 7272, 2009, Pages 502-504

  Gick, Bryan ^a,b   Derrick, Donald ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b HASKINS LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC IMAGERY; PERCEPTION; VISUAL ANALYSIS;

ARTICLE; HEARING; IMAGING; PRIORITY JOURNAL; SOUND; SPEECH PERCEPTION; TACTILE DISCRIMINATION; VISUAL INFORMATION;

ACOUSTIC STIMULATION; AIR PRESSURE; CUES; HAIR; HAND; HUMANS; NECK; RESEARCH DESIGN; SKIN PHYSIOLOGICAL PHENOMENA; SOUND; SPEECH PERCEPTION; TOUCH;

EID: 70849097393     PISSN: 00280836     EISSN: 14764687     Source Type: Journal    
DOI: 10.1038/nature08572     Document Type: Article

References (21)

1. Sumby, W. H. & Pollack, I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26, 212-215 (1954).
2. McGurk, H. & MacDonald, J. W. Hearing lips and seeing voices. Nature 264, 746-748 (1976).
3. Calvert, G. A. et al. Activation of auditory cortex during silent lipreading. Science 276, 593-596 (1997).
4. Calvert, G. A. & Campbell, R. Reading speech from still and moving faces: the neural substrates of visible speech. J. Cogn. Neurosci. 15, 57-70 (2003).
5. Diehl, R. L. & Kluender, K. R. On the objects of speech perception. Ecol. Psychol. 1, 121-144 (1989).
6. Fowler, C. & Dekle, D. Listening with eye and hand: crossmodal contributions to speech perception. J. Exp. Psychol. Hum. Percept. Perform. 17, 816-828 (1991).
7. Gick, B., Jóhannsdóttir, K. M., Gibraiel, D. & Mühlbauer, J. Tactile enhancement of auditory and visual speech perception in untrained perceivers. J. Acoust. Soc. Am. 123, EL72-EL76 (2008).
8. Sparks, D. W., Kuhl, P. K., Edmonds, A. E. & Gray, G. P. Investigating the MESA (multipoint electrotactile speech aid): the transmission of segmental features of speech. J. Acoust. Soc. Am. 63, 246-257 (1978).
9. Reed, C. M., Durlach, N. I., Braida, L. D. & Schultz, M. C. Analytic study of the Tadoma method: effects of hand position on segmental speech perception. J. Speech Hear. Res. 32, 921-929 (1989).
10. Bernstein, L. E., Demorest, M. E., Coulter, D. C. & O' Connell, M. P. Lipreading sentences with vibrotactile vocoders: performance of normal-hearing and hearing-impaired subjects. J. Acoust. Soc. Am. 90, 2971-2984 (1991).
11. Derrick, D., Anderson, P., Gick, B. & Green, S. Characteristics of air puffs produced in English 'pa': data and simulation. J. Acoust. Soc. Am. 125, 2272-2281 (2009).
12. Lisker, L. & Abramson, A. S. A cross-language study of voicing in initial stops: acoustical measurements. Word 20, 384-423 (1964).
13. Mizobuchi, K. et al. Single unit responses of human cutaneous mechanoreceptors to air-puff stimulation. Clin. Neurophysiol. 111, 1577-1581 (2000).
14. Sabah, N. H. Controlled stimulation for hair follicle receptors. J. Appl. Physiol. 36, 256-257 (1974).
15. Sangras, R., Kwon, O. C. & Faeth, G. M. Self-preserving properties of unsteady round nonbuoyant turbulent starting jets and puffs in still fluids. J. Heat Transfer 124, 460-469 (2002).
16. Diez, F. J., Sangras, R., Kwon, O. C. & Faeth, G. M. Erratum: ''Self-preserving properties of unsteady round nonbuoyant turbulent starting jets and puffs in still fluids. ASME J. Heat Transfer, 124, 460-469 (2002)''.
17. J. Heat Transfer 125, 204-205 (2003).
18. Stevens, K. N. Acoustic Phonetics Ch. 7 (MIT Press, 1998).
19. Weinstein, S. in The Skin Sense (ed. Kenshalo, D. R.) 195-222 (Thomas, 1968).
20. Fu, K.-M. G. et al. Auditory cortical neurons respond to somatosensory stimulation. J. Neurosci. 23, 7510-7515 (2003).
21. Ito, T., Tiede, M. & Ostry, D. J. Somatosensory function in speech perception. Proc. Natl Acad. Sci. USA 106, 1245-1248 (2009).