Speaker independence in automated lip-sync for audio-video communication

Computer Networks

Volumn 30, Issue 20-21, 1998, Pages 1975-1980

  McAllister, David F ^a  

^a North Carolina State University   (United States)

Author keywords

Facial animation; Lip synchronization; Speech processing

Indexed keywords

ALGORITHMS; ANIMATION; COMPUTER SIMULATION; FOURIER TRANSFORMS; IMAGE COMMUNICATION SYSTEMS; SPEECH COMMUNICATION; SPEECH SYNTHESIS; SYNCHRONIZATION;

FACIAL ANIMATION; LIP SYNCHRONIZATION; SPEAKER INDEPENDENCE;

INTERACTIVE COMPUTER GRAPHICS;

EID: 0032207399     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0169-7552(98)00216-5     Document Type: Article

References (15)

1. S. Basu, A. Pentland, Recovering 3D lip structure from 2D observations using a model trained from video, in: Proc. Eur. Speech Conf. Assoc. Workshop on Audio-Visual Speech Processing, 1997, pp. 121-124.
2. C.M. Jones, S.S. Dlay, Automated lip synchronisation for human-computer interaction and special effect animation, in: Proc. Eur. Speech Conf. Assoc. '97, vol. 2, 1997, pp. 891-894.
3. B. Koster, R. Rodman, D. Bitzer, Automated lip-sync: direct translation of speech-sound to mouth shape, in: Proc. 28th Annual Asilomar Conf. on Signals, Systems and Computers, 1994, pp. 36-46.
4. B. Koster, Automatic lip-sync: direct translation of speech-sound to mouth-animation, Ph.D. Dissertation, Department of Computer Science, North Carolina State University, Raleigh, NC 27695, 1995.
5. F. Lavagetto, Time-delay neural networks for estimating lip movements from speech analysis: a useful tool in audio-video synchronization, IEEE Trans, on Circuits and Systems for Video Technology 7 (5) (1997) 786-800.
6. J.P. Lewis, Automated lip-sync: background and techniques, J. Visual. Comput. Animation 2 (4) (1991) 118-122.
7. D.F. McAllister, R.D. Rodman, D.L. Bitzer, A.S. Freeman, Lip synchronization for animation, in: SIGGRAPH '97 Visual Proc., 1997, pp. 225.
8. D.F. McAllister, R.D. Rodman, D.L. Bitzer, A.S. Freeman, Lip synchronization as an aid to the hearing impaired, in: Proc. AVIOS '97, 1997, pp. 233-248.
9. D.F. McAllister, R.D. Rodman, D.L. Bitzer, A.S. Freeman, Lip synchronization of speech, in: Proc. AVSP '97, 1997, pp. 133-136.
10. S. Morishima, H. Harashima, Facial animation synthesis for human-machine communication system, in: Proc. 5th Int. Conf. on Human-Computer Interaction, vol. 2, 1993, pp. 1085-1090.
11. F.I. Parke, K. Waters, Computer Facial Animation, A.K. Peters, Wellesley, MA, 1996.
12. J.A. Provine, T. Bruton, Lip synchronization in 3-D model based coding for video-conferencing, in: Proc. ISCAS '95, 1995, pp. 453-456.
13. L. Reveret, F. Garcia, C. Benoit, E. Vatikiotis-Bateson, An hybrid approach to orientation-free liptracking, in: Proc. Eur. Speech Conf. Assoc. Workshop on Audio-Visual Speech Processing, 1997, pp. 117-120.
14. M. Vogt, Interpreted multi-state lip models for audio-visual speech recognition, in: Proc. Eur. Speech Conf. Assoc. Workshop on Audio-Visual Speech Processing, 1997, pp. 125-128.
15. E. Yamamoto, S. Nakamura, K. Shikano, Speech to lip movement synthesis by HMM, in: Proc. Eur. Speech Conf. Assoc. Workshop on Audio-Visual Speech Processing, 1997, pp. 137-140.