The perception and production of phones and tones: The role of rigid and non-rigid face and head motion

ISSP 2006 - Proceedings of the 7th International Seminar on Speech Production

Volumn , Issue , 2006, Pages 185-192

  Burnham, Denis ^a   Reynolds, Jessica ^a   Vatikiotis Bateson, Eric ^b   Yehia, Hani ^c   Ciocca, Valter ^d   Morris, Rua Haszard ^a   Hill, Harold ^e   Vignali, Guillaume ^a   Bollwerk, Sandra ^a   Tam, Helen ^a   Jones, Caroline ^f  

^a UNIVERSITY OF WESTERN SYDNEY   (Australia)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^c UFMG   (Brazil)

^d UNIVERSITY OF HONG KONG   (Hong Kong)

^e ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^f UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

LINGUISTICS; MICROCOMPUTERS; PRINCIPAL COMPONENT ANALYSIS; SPEECH RECOGNITION;

AUDITORY-VISUAL; FUNCTIONAL DATA ANALYSIS; FUNDAMENTAL FREQUENCIES; NON-RIGID MOTION; PERCEPTUAL INFORMATION; PRINCIPAL COMPONENT; SPEECH PERCEPTION; WORD IDENTIFICATION;

TELEPHONE SETS;

EID: 84907006006     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Burnham, D. K. (1992) Auditory-visual perception of Thai consonants by Thai and Australian listeners. Pan-Asiatic Linguistics, Bangkok: Chulalongkorn University Press, 531-545.
2. Burnham, D., Ciocca, V., & Stokes, S. (2001) Auditory-visual perception of lexical tone. Eurospeech Conference 2001, Aalsborg, Denmark, ISCA, Bonn, Germany, 395-398.
3. Burnham, D., Lau, S., Tam, H., & Schoknecht, C. (2001) Visual discrimination of Cantonese tone by tonal but non-Cantonese speakers, and by non-tonal language speakers. Auditory-Visual Speech Perception Conference 2001, Causal Productions, www.causal.on. net, 155-160.
4. 0 variations. In In T. Bunnell & W. Idsardi (Eds) Fourth International Conference on Spoken Language Processing. Vol 4, 2175-2178.
5. de Gelder, B., Bertelson, P., Vroomen, J., & Chen, H. C. (1995) Interlanguage differences in the McGurk effect for Dutch and Cantonese listeners. Proceedings of the Fourth European Conference on Speech Communication and Technology (1699-1702). Madrid.
6. McGurk, H, & McDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
7. Ramsay, J. O. & Silverman, B. W. (1997) Functional Data Analysis. Springer
8. Sekiyama K. (1997) Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects. Perception & Psychophysics, 59, 73-80.
9. Sekiyama, K. (1994) Differences in auditory-visual speech perception between Japanese and Americans: McGurk effect as a function of incompatibility. J. Acoust. Soc. Japan, 15, 143-158.
10. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
11. Vatiktiotis-Bateson, E., Kroos, C., Kuratate, T., Munhall, K. G., & Pitermann, M. (2000). Task constraints on robot realism: The case of talking heads. In K. Kamejima (Ed.), 9th IEEE Internat. Workshop on Robot & Human Interactive Comm. (RO-MAN 2000), (352-357). Osaka: IEEE.
12. Vignali, G. (2005a) Analysis of 3D multivariable data of expressive speech motion. Symposium, Cross-Modal Processing, Faces & Voices, ATR, Japan. Also http://www.vignali.net/~guillaume)
13. Vignali, G. (2005b) Study of the visual component of tone in Cantonese and Mandarin, and stress in English and Japanese. Report for MARCS Auditory Labs, April, 2005.
14. Vignali, G. (2005c) Relation between voice pitch and rigid and nonrigid head motion in Cantonese and Mandarin. Report for MARCS Auditory Labs (at CRSLP, Chulalongkorn Univ., Thailand).
15. Yehia, H., Kuratate, T., & Vatikiotis-Bateson, E. (2002), Linking facial animation, head motion, and speech acoustics, Journal of Phonetics, 30, No. 3, 555-568.