Audiovisual-to-articulatory speech inversion using active appearance models for the face and Hidden Markov Models for the dynamics

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2008, Pages 2237-2240

  Katsamanis, Athanassios ^a   Papandreou, George ^a   Maragos, Petros ^a  

^a NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

Author keywords

Articulatory; Audiovisual; Fusion; Hidden markov models; Speech inversion

Indexed keywords

ACOUSTICS; COMPUTATIONAL GRAMMARS; COMPUTER NETWORKS; DYNAMICS; FEATURE EXTRACTION; LEARNING SYSTEMS; MARKOV PROCESSES; OBJECT RECOGNITION; SIGNAL PROCESSING; SPEECH; SPEECH RECOGNITION;

ARTICULATORY; AUDIOVISUAL; FUSION; INTERNATIONAL CONFERENCES; SPEECH INVERSION;

HIDDEN MARKOV MODELS;

EID: 51449089369     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2008.4518090     Document Type: Conference Paper

References (14)

1. H. Kjellstrom, O. Engwall, and O. Balter, "Reconstructing tongue movements from audio and video," in Interspeech, 2006, pp. 2238-2241.
2. O. Engwall, "Introducing visual cues in acoustic-to-articulatory inversion," in INTERSPEECH, 2005, pp. 3205-3208.
3. J. Jiang, A. Alwan, P. A. Keating, E. T. Auer Jr., and L. E. Bernstein, "On the relationship between face movements, tongue movements, and speech acoustics," EURASIP Journal on Applied Signal Processing, vol. 11, pp. 1174-1188, 2002.
4. H. Yehia, P. Rubin, and E. Vatikiotis-Bateson, "Quantitative association of vocaltract and facial behavior," Sp. Comm., vol. 26, pp. 23-43, 1998.
5. K. Richmond, S. King, and P. Taylor, "Modelling the uncertainty in recovering articulation from acoustics," Computer Speech and Language, vol. 17, pp. 153-172, 2003.
6. S. Hiroya and M. Honda, "Estimation of articulatory movements from speech acoustics using an hmm-based speech production model," IEEE TSAP, vol. 12, no. 2, pp. 175-185, March 2004.
7. A. Katsamanis, G. Papandreou, and P. Maragos, "Audiovisual-to- articulatory speech inversion using hmms," in Proceedings of IEEE Int'l Workshop on Multimedia Signal Processing (MMSP 2007).
8. O. Engwall and J. Beskow, "Resynthesis of 3d tongue movements from facial data," in EUROSPEECH, 2003.
9. K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis, Acad. Press, 1979.
10. S. Dupont and J. Luettin, "Audio-visual speech modeling for continuous speech recognition," IEEE Tr. Multimedia, vol. 2, no. 3, pp. 141-151, 2000.
11. J. Beskow, "Rule-based visual speech synthesis," in Proc. of the 4th European Conference on Speech Communication and Technology (EUROSPEECH 95), 1995.
12. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, 2001.
13. P. Viola and M.J. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Conf. on Comp. Vision and Pat. Recog., 2001, vol. I, pp. 511-518.
14. J. Luettin, G. Potamianos, and C. Neti, "Asynchronous stream modeling for large vocabulary audio-visual speech recognition," in Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, 2001.