Mapping from speech to images using continuous state space models

Lecture Notes in Computer Science

Volumn 3361, Issue , 2005, Pages 136-145

  Lehn Schiøler, Tue ^a   Hansen, Lars Kai ^a   Larsen, Jan ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; CONTROL SYSTEMS; DATABASE SYSTEMS; IMAGE SEGMENTATION; MATHEMATICAL MODELS; STATE SPACE METHODS;

FACE SPACE; IMAGE SEQUENCE; SPEECH WAVEFORMS; TIMIT DATABASE;

SPEECH PROCESSING;

EID: 24144479990     PISSN: 03029743     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/978-3-540-30568-2_12     Document Type: Conference Paper

References (19)

1. Lewis, J.P.: Automated lip-sync: Background and techniques. J. Visualization and Computer Animation 2 (1991)
2. Goldenthal, W., Waters, K., Jean-Manuel, T.V., Glickman, O.: Driving synthetic mouth gestures: Phonetic recognition for faceme! In: Proc. Eurospeech '97, Rhodes, Greece (1997) 1995-1998
3. Ezzat, T., Poggio, T.: Mike talk: a talking facial display based on morphing visemes. Proc. Computer Animation IEEE Computer Society (1998) 96-102
4. Bregler, C., Covell, M., Slaney, M.: Video rewrite: driving visual speech with audio. In: Proceedings of the 24th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co. (1997) 353-360
5. Williams, J.J., Katsaggelos, A.K.: An hmm-based speech-to-video synthesizer. IEEE Transactions on Neural Networks 13 (2002)
6. Hong, P., Wen, Z., Huang, T.S.: Speech driven face animation. In Pandzic, I.S., Forchheimer, R., eds.: MPEG-4 Facial Animation: The Standard, Implementation and Applications. Wiley, Europe (2002)
7. Massaro, D.W., Beskow, J., Cohen, M.M., Fry, C.L., Rodriguez, T.: Picture my voice: Audio to visual speech synthesis using artificial neural networks. Proc. AVSP 99 (1999)
8. Brand, M.: Voice puppetry. In: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co. (1999) 21-28
9. Lavagetto, F.: Converting speech into lip movements: A multimedia telephone for hard of hearing people. IEEE Trans. on Rehabilitation Engineering 3 (1995)
10. McGurk, H., MacDonald, J.W.: Hearing lips and seeing voices. Nature 264 (1976) 746-748
11. Dupont, S., Luettin, J.: Audio-visual speech modelling for continuous speech recognition. IEEE Transactions on Multimedia (2000)
12. McAllister, D.F., Rodman, R.D., Bitzer, D.L., Freeman, A.S.: Speaker independence in automated lip-sync for audio-video communication. Comput. Netw. ISDN Syst. 30 (1998) 1975-1980
13. Cootes, T., Edwards, G., Taylor, C.: Active appearance models. Proc. European Conference on Computer Vision 2 (1998) 484-498
14. Matthews, I., Cootes, T., Bangham, J., Cox, S., Harvey, R.: Extraction of visual features for lipreading. Pattern Analysis and Machine Intelligence, IEEE Transactions on 24 (2002) 198-213
15. Stegmann, M.B., Ersbøll, B.K., Larsen, R.: FAME - a flexible appearance modelling environment. IEEE Transactions on Medical Imaging 22 (2003) 1319-1331
16. Kalman, R.E.: A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering 82 (1960) 35-45
17. Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. JRSSB 39 (1977) 1-38
18. Ghahramani, Z., Hinton, G.: Parameter estimation for linear dynamical systems. Technical report (1996) University of Toronto, CRG-TR-96-2.
19. Sanderson, C., Paliwal, K.K.: Polynomial features for robust face authentication. Proceedings of International Conference on Image Processing 3 (2002) 997-1000