Representation analysis and synthesis of lip images using dimensionality reduction

International Journal of Computer Vision

Volumn 67, Issue 3, 2006, Pages 297-312

  Aharon, Michal ^a   Kimmel, Ron ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Automatic lipreading; Dimension reduction; Image sequence processing; Locally linear embedding; Multidimensional scaling; Speech synthesis

Indexed keywords

AUTOMATIC PROGRAMMING; BEHAVIORAL RESEARCH; COMPUTATIONAL METHODS; IMAGE PROCESSING; MOTION ESTIMATION; REDUCTION; SPEECH SYNTHESIS;

AUTOMATIC LIPREADING; DIMENSION REDUCTION; IMAGE SEQUENCE PROCESSING; LOCALLY LINEAR EMBEDDING; MULTIDIMENSIONAL SCALING;

IMAGE ANALYSIS;

EID: 33646697511     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-006-5166-3     Document Type: Review

References (24)

1. Aharon, M. and Kimmel, R. 2004. Representation analysis and synthesis of lip images using dimensionality reduction. Technical Report CIS-2004-01, Technion - Israel Institute of Technology.
2. Bergen, J.R., Burt, P.J., Hingorani, R., and Peleg, S. 1992. A three-frame algorithm for estimating two component image motion. IEEE Trans on PAMI, 14(9).
3. Bregler, C., Covell, M., and Slaney, M. 1997. Video rewrite: Driving visual speech with audio. Computer Graphics. 31:353-360.
4. Borg, I. and Groenen, P. 1997. Modern Multidimensional Scaling-Theory and Applications. Springer-Verlag New York. Inc.
5. Bregler, C., Hild, H., Manke, S., and Waibel, A. 1993. Improving connected letter recognition by lipreading. In Proc. IEEE Int. Conf. on ASSP, pp. 557-560.
6. Bregler, C. and Omohundro, S.M. 1994. Surface learning with applications to lipreading. In NIPS. vol. 6, pp. 43-50.
7. Bregler, C., Omohundro, S.M., Covell, M., Slaney, M., Ahmad, S., Forsyth, D.A., and Feldman, J.A. 1998. Probabilistic models of verbal and body gestures. In Computer Vision in Man-Machine Interfaces, R. Cipolla and A, Pentland (eds). Cambridge University Press.
8. Donoho, D.L. and Grimes, C.E. 2003. Hessian eigenmaps: new locally linear embedding techniques for high-dimensional data. Proceedings of the National Academy of Arts and Sciences, 100(10):5591-5596.
9. Duchnowski, P., Hunke, M., Bsching, D., Meier, U., and Waibel, A. 1995, Toward movement-invariant automatic Hpreading and speech recognition. In Proc. ICASSP'95, pp. 109-112.
10. Fisher, C.G. 1968. Confusions among visually perceived consonants. Journal of Speech and Heating Research, 11(4):796-804.
11. Jacobs, D.W., Belhumeur, P.N., and Basri, R. 1998. Comparing images under variable illumination. In Proc. of CVPR. pp. 610-617.
12. Kalberer, G.A. and Van Gool, L. 2001. Lip animation based on observed 3d speech dynamics. In Proc. of SPIE, S. El-Hakim and A. Gruen, editors, vol. 4309, pp. 16-25.
13. Li, N., Dettmer, S., and Shah, M. 1997. Visually recognizing speech using eigensequences. In Motion-Based Recognition. Klwer Academic Publishing, pp. 345-371.
14. Lucas, B.D. and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In IJCAI81, pp. 674-679.
15. Luettin, J. 1997. Visual Speech And Speaker Recognition. PhD thesis. University of Sheffield.
16. Mase, A. and Pentland, K. 1991. Automatic lipreading by optical flow analysis. Technical Report Technical Report 117. MIT -Media Lab.
17. Malone, S.W., Tarazaga, P., and Trosset, M.W. 2000. Optimal dilations for metric multidimensional scaling. In Proceedings of the Statistical Computing Section.
18. Roweis, S.T. and Saul, L.K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science, 290:2323-2326.
19. Sakoe, H. and Chiba, S. 1978. Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. ASSP, ASSP-26:43-49.
20. Saul, L.K. and Roweis, S.T. 2003. Think globally, fit locally: Unsupervised learning of low dimensional manifolds. Journal of Machine Learning Research, pp. 119-155.
21. Schwartz, E.L., Shaw, A., and Wolfson, E. 1989. A numerical solution to the generalized mapmaker's problem: Flattening non convex polyhedral surfaces. 11 (9): 1005-1008.
22. Tenenbaum, J.B., de Silva, V., and Langford, J.C. 2000. A global geometric frame-work for nonlinear dimensionality reduction. Science. 290:2319-2123.
23. Vanroose, P., Kalberer, G.A., Wambacq, P., and Van Gool, L. 2002. From speech to 3D face animation. Procs. of BSIT.
24. Yacoob, Y. and Davis, L.S. 1996. Recognizing human facial expressions from long image sequences using optical flow. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(6).