Lip shape and hand position fusion for automatic vowel recognition in cued speech for French

IEEE Signal Processing Letters

Volumn 16, Issue 5, 2009, Pages 339-342

  Heracleous, Panikos ^a   Aboutabit, Noureddine ^a   Beautemps, Denis ^a  

^a GIPSA LAB   (France)

Author keywords

Concatenative fusion; Cued Speech; HMM; Multistream HMM decision fusion; Vowel recognition

Indexed keywords

CONCATENATIVE FUSION; CUED SPEECH; HMM; MULTISTREAM HMM DECISION FUSION; VOWEL RECOGNITION;

AUDITION; GESTURE RECOGNITION; HIDDEN MARKOV MODELS; LINGUISTICS; SPEECH COMMUNICATION;

SPEECH RECOGNITION;

EID: 64249102006     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2009.2016011     Document Type: Article

References (15)

1. A. A. Montgomery and P. L. Jackson, "Physical characteristics of the lips underlying vowel lipreading performance," J. Acoust. Soc. Amer. vol. 73, no. 6, pp. 2134-2144, 1983.
2. G. Nicholls and D. Ling, "Cued speech and the reception of spoken language," J. Speech Hearing Res., vol. 25, pp. 262-269, 1982.
3. R. O. Cornett, "Cued Speech," Amer. Ann. Deaf, vol. 112, pp. 3-13, 1967.
4. R. M. Uchanski, L. A. Delhorne, A. K. Dix, C. M. Reed, L. D. Braida, and N. I. Durlach, "Automatic speech recognition to aid the hearing impaired: Current prospects for the automatic generation of Cued Speech," J. Rehab. Res. Develop., vol. 31, pp. 20-41, 1994.
5. J. Leybaert, "Phonology acquired through the eyes and spelling in deaf children," J. Exper. Child Psychol., vol. 75, pp. 291-318, 2000.
6. F. Destombes, Aides manuelles à la lecture labiale et perspectives d'aides automatiques. "Le Projet VIDVOX" Centre Scientifique IBM-France, pp. 35-36, 1982.
7. D. Beautemps, L. Girin, N. Aboutabit, G. Bailly, L. Besacier, G. Breton, T. Burger, A. Caplier, M. A. Cathiard, D. Chene, J. Clarke, F. Elisei, O. Govokhina, V. B. Le, M. Marthouret, S. Mancini, Y. Mathieu, P. Perret, B. Rivet, P. Sacher, C. Savariaux, S. Schmerber, J. F. Serignat, M. Tribout, and S. Vidal, "TELMA: Telephony for the hearing-impaired people. From models to user tests," in Proc. ASSISTH'2007, 2007, pp. 201-208.
8. G. Potamianos, C. Neti, G. Gravier, A. Garg, and A. W. Senior, "Recent advances in the automatic recognition of audiovisual speech," Proc. IEEE, vol. 91, no. 9, pp. 1306-1326, 2003.
9. N. Aboutabit, D. Beautemps, and L. Besacier, "Automatic identification of vowels in the Cued Speech context," in Proc. AVSP'07, 2007.
10. E. Fleetwood and M. Metzger, Cued Language Structure: An Analysis of Cued American English Based on Linguistic Principles. Silver Spring, MD: Calliope, 1998, 0-9654871-3-X.
11. N. Aboutabit, D. Beautemps, and L. Besacier, "Lips and hand modeling for recognition of the Cued Speech gestures: The French vowel case," Speech Commun., (subject to revision).
12. E. Owens and B. Blazek, "Visemes observed by hearing-impaired and normal-hearing adult viewers," J. Speech Hearing Res., vol. 28, pp. 381-393, 1985.
13. P. Merkx and J. Miles, "Automatic vowel classification in speech. An artificial neural network approach using cepstral feature analysis," Final Project for Math 196S pp. 1-14, 2005.
14. H. Bourlard and S. Dupont, "A new ASR approach based on independent processing and recombination of partial frequency bands," in Proc. ICSLP, 1996, pp. 426-429.
15. L. Gillick and S. Cox, "Some statistical issues in the comparison of speech recognition algorithms," in Proc. ICASSP89, 1989, pp. 532-535.