Audio-to-visual conversion for multimedia communication

IEEE Transactions on Industrial Electronics

Volumn 45, Issue 1, 1998, Pages 15-22

  Rao, Ram R ^a,b   Chen, Tsuhan ^a,b,c   Mersereau, Russell M ^b,c  

^a LUCENT TECHNOLOGIES   (United States)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Image analysis; Image coding; Lip reading; Lip synchronization; Multimedia communication

Indexed keywords

ALGORITHMS; ANIMATION; IMAGE ANALYSIS; IMAGE CODING; SPEECH TRANSMISSION; VISUAL COMMUNICATION;

AUDIO TO VISUAL SPEECH CONVERSION; LIP SYNCHRONIZATION; MULTIMEDIAL COMMUNICATIONS; VISIBLE SPEECH;

VOICE/DATA COMMUNICATION SYSTEMS;

EID: 0031997085     PISSN: 02780046     EISSN: None     Source Type: Journal    
DOI: 10.1109/41.661300     Document Type: Article

References (20)

1. K. Aizawa, H. Harashima, and T. Saito, "Model-based synthesis image coding (MBASIC) system for a person's face," Signal Process.: Image Commun., vol. 1, no. 2, pp. 139-152, Oct. 1989.
2. F. I. Parke, "Parameterised models for facial animation," IEEE Computer Graphics and Applications, vol. 12, pp. 61-68, Nov. 1982.
3. K. Waters and T. M. Levergood, "DECface: An automatic lipsynchronization algorithm for synthetic faces," DEC Cambridge Research Laboratory, Cambridge, MA, Tech. Rep., Sept. 1993.
4. M. Cohen and D. Massaro, "What can visual speech synthesis tell visual speech recognition?" in Proc. 28th Annu. Asilomar Conf. Signals, Systems, and Computers, Pacific Grove, CA, Oct. 1994, pp. 566-571,.
5. K. Berger, Speechreading: Principles and Methods. Baltimore, MD National Educational Press, 1972.
6. Q. Summerfield, "Lipreading and audio-visual speech perception, Philos. Trans. R. Soc. London B, vol. 335, pp. 71-78, 1992.
7. W. Sumby and I. Pollack,"Visual contribution to speech intelligibility in noise," J. Acoust. Soc. Amer., vol. 26, no. 2, pp. 212-215, Mar. 1954.
8. H. McGurk and J. MacDonald, "Hearing lips and seeing voices," Nature vol. 164, pp. 746-748, Dec. 1976.
9. D. Massaro, "Speech perception by ear and eye," in Hearing by Eye: The Psychology of Lip-Reading, B. Dodd and R. Campbell, Eds. London, U.K.: Lawrence Erlbaum Associates, 1987, pp. 53-83.
10. L. R. Rabiner and B. H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
11. D. Titterington, A. Smith, and U. Makov, Statistical Analysis of Finite Mixture Distributions. New York: Wiley, 1985.
12. T. Chen, H. P. Graf, and K. Wang, "Lip-synchronization using speechassisted video processing," IEEE Signal Processing Lett., vol. 2, pp. 57-59, Apr. 1995.
13. S. Morishima, K. Aizawa, and H. Harashima, "An intelligent facial image coding driven by speech and phoneme," in Proc. IEEE ICASSP, Glasgow, U.K., 1989, pp. 1795-1798.
14. F. Lavagetto, "Converting speech into lip movements: A multimedia telephone for hard of hearing people," IEEE Trans. Rehab. Eng., vol. 3, pp. 90-102, Mar. 1995.
15. R. Rao and T. Chen, "Exploiting audio-visual correlation in coding of talking head sequences," in Proc. Picture Coding Symp., Melbourne, Australia, Mar. 1996, pp. 635-658.
16. Y. Linde, A. Buzo, and R. Gray, "An algorithm for vector quantizer design," IEEE Trans. Commun., vol. 28, pp. 84-95, Jan. 1980.
17. R. Lippmann, "An introduction to computing with neural nets," IEEE ASSP Mag., vol. 4, pp. 4-22, Apr. 1987.
18. A. Papoulis, Probability, Random Variables, and Stochastic Processes. New York: McGraw-Hill, 1991, pp. 201-205.
19. A. Yuille, P. Hallinan, and D. Cohen, "Feature extraction from faces using deformable templates," Int. J. Comput. Vis., vol. 8, no. 2, pp. 99-111, 1992.
20. G. Wolberg, Digital Image Warping. New York: IEEE Press, 1990.