Audio-visual speech synchronization detection using a bimodal linear prediction model

2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009

Volumn , Issue , 2009, Pages 53-59

  Kumar, Kshitiz ^a   Navratil, Jiri ^b   Marcheret, Etienne ^b   Libal, Vit ^b   Ramaswamy, Ganesh ^b   Potamianos, Gerasimos ^c  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c INSTITUTE OF INFORMATICS AND TELECOMMUNICATIONS   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; MATHEMATICAL TRANSFORMATIONS; PREDICTIVE ANALYTICS; SYNCHRONIZATION;

ANALYTICAL APPROACH; AUDIO-VISUAL SPEECH; DISCRETE COSINES; LINEAR PREDICTION; LINEAR PREDICTION MODELS; MUTUAL INFORMATIONS; SPEAKER RECOGNITION; SYNCHRONY DETECTION;

SPEECH RECOGNITION;

EID: 70449586672     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2009.5204303     Document Type: Conference Paper

References (10)

1. Sphinx open source speech recognition engines, http: //cmusphinx. sourceforge.net/html/cmusphinx.php. 4
2. H. Bredin and G. Chollet. Audiovisual speech synchrony measure: Application to biometrics. EURASIP Journal on Advances in Signal Processing, 2007. 1, 2, 4, 6
3. D. Hardoon, S. Szedmak, and J. Shawe-Taylor. Canonical Correlation Analysis - An Overview with Application to Learning Methods. Royal Holloway, University of London, 2003. CSD-TR-03-102 4
4. J. Hershey and J. Movellan. Using audio-visual synchrony to locate sounds. In Advances in Neural Information Processing Systems 12, pages 813-819. MIT Press, 1999. 1, 2, 6
5. J. Hershey and P. Olsen. Approximating the Kullback Leibler divergence between Gaussian mixture models. In Proceedings of the IEEE Conference on Acoustics, Speech, and Signal Processing, volume 4, pages 317-320, 2007. 6
6. G. Iyengar, H. Nock, and C. Neti. Audio-visual synchrony for detection of monologues in video archives. In Proceedings of the IEEE International Conference on Multimedia and Expo, volume 1, pages 329-332, 2003. 1
7. K. Kumar, T. Chen, and R. Stern. Profile view lip reading. In Proceedings of the IEEE Conference on Acoustics, Speech, and Signal Processing, volume 4, pages 429-432, 2007. 4
8. H. Nock, G. Iyengar, and C. Neti. Speaker localisation using audio-visual synchrony: An empirical study. In Proceedings of the 10th ACM International Conference on Multimedia, pages 488-499, 2003. 2
9. L. Rabiner and B.-H. Juang. Fundamentals of Speech Recognition. Prentice-Hall Inc., 1993. 3
10. M. Slaney and M. Covell. Facesync: a linear operator for measuring synchronization of video facial images and audio tracks. In Advances in Neural Information Processing Systems 13, pages 814-820. MIT Press, 2000. 4