Lip feature extraction based on audio-visual correlation

13th European Signal Processing Conference, EUSIPCO 2005

Volumn , Issue , 2005, Pages 389-392

  Sargin, M E ^a   Erzin, E ^a   Yemez, Y ^a   Tekalp, A M ^a  

^a KOÇ UNIVERSITY   (Turkey)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO FEATURES; AUDIO SIGNAL; AUDIO VISUAL SPEECH RECOGNITION; AUDIO-VISUAL; AUDIO-VISUAL CORRELATIONS; CANONICAL CORRELATION ANALYSIS; CONDITIONAL PROBABILITY ANALYSIS; DCT COEFFICIENTS; HIGHLY-CORRELATED; INTENSITY-BASED; LIP CONTOUR; LIP FEATURES; LIP SYNCHRONIZATION; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; SHAPE INFORMATION;

FEATURE EXTRACTION; SIGNAL PROCESSING;

SPEECH RECOGNITION;

EID: 84863652641     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Potamianos, G.; Neti, C.; Gravier, G.; Garg, A.; Senior, A.W., Recent advances in the automatic recognition of audiovisual speech, Proceedings of the IEEE, Vol.91, Iss.9, Sept. 2003 pp. 1306- 1326
2. Potamianos, G.; Neti, C.; Huang, J.; Connell, J.H.; Chu, S.; Libal, V.; Marcheret, E.; Haas, N.; Jiang, J., Towards practical deployment of audio-visual speech recognition, Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on, Vol.3, Iss., 17-21 May 2004 pp. iii- 777-80 vol.3
3. Gurbuz, S.; Tufekci, Z.; Patterson, E.; Gowdy, J.N., Independent information from visual features for multimodal speech recognition, SoutheastCon 2001. Proceedings. IEEE, Vol., Iss., 2001 sa. 221-228
4. Luhong Liang; Xiaoxing Liu; Yibao Zhao; Xiaobo Pi; Nefian, A.V., Speaker independent audio-visual continuous speech recognition, Multimedia and Expo, 2002. ICME '02. Proceedings. 2002 IEEE International Conference on, Vol.2, Iss., 2002 pp. 25- 28 vol.2
5. N. Eveno, A. Caplier, P.-Y. Coulon, "Accurate and Quasi- Automatic Lip Tracking," IEEE Trans. on Circuits and Systems for Video Technology vol. 14, Iss. 5, pp.706-715, May 2004.
6. A. Kanak, E. Erzin, Y. Yemez and A. M. Tekalp, "Speaker Identification Using Multimodal Audio- Video Processing," IEEE Int. Conf. on Image Processing, Barcelona, Spain, September 2003.
7. H.E. Cetingul, Y. Yemez, E. Erzin, A.M. Tekalp "Discriminative Lip-Motion Features for Biometric Speaker Identification," IEEE Int. Conf. on Image Processing, Singapore, 2004.
8. E. Erzin, Y. Yemez, A. M. Tekalp, "Multimodal Speaker Identification Using an Adaptive Classifier Cascade based on Modality Reliability," accepted for publication on IEEE Transactions on Multimedia, March 2004.
9. J.M. Odobez, P. Bouthemy, Robust multiresolution estimation of parametric motion models. Journal of Visual Communication and Image Representation, 6(4):348-365, December 1995.
10. H. Hotelling. Relations between two sets of variates. Biometrika, 28:321-377, 1936.