Audiovisual speech synchrony measure: Application to biometrics

Eurasip Journal on Advances in Signal Processing

Volumn 2007, Issue , 2007, Pages

  Bredin, Hervé ^a   Chollet, Ǵerard ^a  

^a INSTITUT TELECOM   (France)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO SYSTEMS; BIOMETRICS; DATABASE SYSTEMS; SYNCHRONIZATION;

ARTICULATORS; AUDIOVISUAL SPEECH; VISUAL SPEECH;

SPEECH PROCESSING;

EID: 34347337657     PISSN: 16876172     EISSN: 16876180     Source Type: Journal    
DOI: 10.1155/2007/70186     Document Type: Article

References (41)

1. G. Potamianos C. Neti J. Luettin I. Matthews G. Bailly E. Vatikiotis-Bateson P. Perrier Audio-visual automatic speech recognition: an overview. Issues in Visual and Audio-Visual Speech Processing 10 MIT Press Cambridge, Mass, USA 2004
2. T. Chen Audiovisual speech processing. IEEE Signal Processing Magazine 18 2001 1 9 21
3. C. C. Chibelushi F. Deravi J. S. Mason A review of speech-based bimodal recognition. IEEE Transactions on Multimedia 4 2002 1 23 37
4. J. P. Barker F. Berthommier Evidence of correlation between acoustic and visual features of speech. Proceedings of the 14th International Congress of Phonetic Sciences (ICPhS '99) San Francisco, Calif, USA 1999 199 202
5. H. Yehia hani@cpdee.ufmg.br P. Rubin E. Vatikiotis-Bateson Quantitative association of vocal-tract and facial behavior. Speech Communication 26 1-2 1998 23 43
6. E. Bailly-Baillière S. Bengio F. Bimbot The BANCA database and evaluation protocol. Proceedings of the 4th International Conference on Audioand Video-Based Biometric Person Authentication (AVBPA '03) Lecture Notes in Computer Science 2688 Guildford, UK 2003 625 638 Springer
7. J. Hershey J. Movellan M. S. Kearns S. A. Solla D. A. Cohn Audio-vision: using audio-visual synchrony to locate sounds. Advances in Neural Information Processing Systems 11 MIT Press Cambridge, Mass, USA 1999 813 819
8. H. Bredin A. Miguel I. H. Witten G. Chollet Detecting replay attacks in audiovisual identity verification. Proceedings of the 31st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '06) 1 Toulous, France 2006 621 624
9. J. W. Fisher III T. Darrell trevor@ai.mit.edu Speaker association with signal-level audiovisual fusion. IEEE Transactions on Multimedia 6 3 2004 406 413
10. G. Chetty M. Wagner "Liveness" verification in audio-video authentication. Proceedings of the 10th Australian International Conference on Speech Science and Technology(SST '04) Sydney, Australia 2004 358 363
11. R. Cutler L. Davis Look who's talking: speaker detection using video and audio correlation. Proceedings of IEEE International Conference on Multimedia and Expo (ICME '00) 3 New York, NY, USA 2000 1589 1592
12. G. Iyengar H. J. Nock C. Neti Audio-visual synchrony for detection of monologues in video archives. Proceedings of IEEE International Conference on Multimedia and Expo (ICME '03) 1 Baltimore, Md, USA 2003 329 332
13. H. J. Nock hnock@us.ibm.com G. Iyengar giyengar@us.ibm.com C. Neti cneti@us.ibm.com Assessing face and speech consistency for monologue detection in video. Proceedings of the 10th ACM international Conference on Multimedia (MULTIMEDIA '02) 2002 Juan-les-Pins, France 303 306
14. M. Slaney M. Covell FaceSync: a linear operator for measuring synchronization of video facial images and audio tracks. Advances in Neural Information Processing Systems 13 MIT Press Cambridge, Mass, USA 2000 814 820
15. D. A. Reynolds T. F. Quatieri R. B. Dunn Speaker verification using adapted Gaussian mixture models. Digital Signal Processing 10 2000 1-3 19 41
16. N. Sugamura F. Itakura Speech analysis and synthesis methods developed at ECL in NTT-from LPC to LSP. Speech Communications 5 1986 2 199 215
17. C. Bregler Y. Konig "Eigenlips" for robust speech recognition. Proceedings of the 19th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '94) 2 Adelaide, Australia 1994 669 672
18. M. Turk A. Pentland Eigenfaces for recognition. Journal of Cognitive Neuroscience 3 1 1991 71 86
19. R. Goecke B. Millar Statistical analysis of the relationship between audio and video speech parameters for Australian English. Proceedings of the ISCA Tutorial and Research Workshop on Audio Visual Speech Processing (AVSP '03) Saint-Jorioz, France 2003 133 138
20. N. Eveno nicolas.eveno@imag.fr L. Besacier laurent.besacier@imag.fr A speaker independent "liveness" test for audio-visual biometrics. Proceedings of the 9th European Conference on Speech Communication and Technology (EuroSpeech '05) Lisbon, Portugal 2005 3081 3084
21. N. Eveno nicolas.eveno@imag.fr L. Besacier laurent.besacier@imag.fr Co-inertia analysis for "liveness" test in audio-visual biometrics. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis (ISPA '05) Zagreb, Croatia 2005 257 261
22. N. Fox R. B. Reilly Audio-visual speaker identification based on the use of dynamic audio and visual features. Proceedings of the 4th International Conference on Audio-and Video-Based Biometric Person Authentication (AVBPA '03) Lecture Notes in Computer Science 2688 Springer Guildford, UK 2003 743 751
23. C. C. Chibelushi J. S. Mason F. Deravi Integrated person identification using voice and facial features. IEE Colloquium on Image Processing for Security Applications London, UK 4 1997 1 5
24. A. Hyvärinen Survey on independent component analysis. Neural Computing Surveys 2 1999 94 128
25. D. Sodoyer L. Girin C. Jutten J.-L. Schwartz Speech extraction based on ICA and audio-visual coherence. Proceedings of the 7th International Symposium on Signal Processing and Its Applications (ISSPA '03) 2 Paris, France 2003 65 68
26. P. Smaragdis M. Casey Audio/visual independent components. Proceedings of the 4th International Symposium on Independent Component Analysis and Blind Signal Separation (ICA '03) Nara, Japan 2003 709 714
27. ICA http://www.cis.hut.fi/projects/ica/fastica/
28. Canonical Correlation Analysis. http://people.imt.liu.se/∼magnus/cca/
29. S. Dolédec D. Chessel Co-inertia analysis: an alternative method for studying species-environment relationships. Freshwater Biology 31 1994 277 294
30. J. W. Fisher T. Darrell W. T. Freeman P. Viola T. K. Leen T. G. Dietterich V. Tresp Learning joint statistical models for audio-visual fusion and segregation. Advances in Neural Information Processing Systems 13 MIT Press Cambridge, Mass, USA 2001 772 778
31. D. Sodoyer sodoyer@icp.inpg.fr J.-L. Schwartz schwartz@icp.inpg.fr L. Girin girin@icp.inpg.fr J. Klinkisch jacob.klinkisch@gmx.de C. Jutten christian.jutten@inpg.fr Separation of audio-visual speech sources: a new approach exploiting the audio-visual coherence of speech stimuli. EURASIP Journal on Applied Signal Processing 2002 11 2002 1165 1173
32. L. R. Rabiner A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77 2 1989 257 286
33. S. Bengio S. Becker S. Thrun K. Obermayer An asynchronous hidden Markov model for audio-visual speech recognition. Advances in Neural Information Processing Systems 15 MIT Press Cambridge, Mass, USA 2003 1213 1220
34. H. Bredin G. Aversano C. Mokbel G. Chollet The biosecure talking-face reference system. Proceedings of the 2nd Workshop on Multimodal User Authentication (MMUA '06) Toulouse, France 2006
35. K. Messer J. Matas J. Kittler J. Luettin G. Maitre XM2VTSDB: the extended M2VTS database. Proceedings of International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA '99) Washington, DC, USA 1999 72 77
36. BT-DAVID http://eegalilee.swan.ac.uk/
37. S. Garcia-Salicetti C. Beumier G. Chollet BIOMET: a multimodal person authentication database including face, voice, fingerprint, hand and signature modalities. Proceedings of the 4th International Conference on Audio-and Video-Based Biometric Person Authentication (AVBPA '03) Guildford, UK 2003 845 853
38. A. F. Martin G. R. Doddington T. Kamm M. Ordowski M. Przybocki The DET curve in assessment of detection task performance. Proceedings of the 5th European Conference on Speech Communication and Technology (EuroSpeech '97) 4 Rhodes, Greece 1997 1895 1898
39. M. E. Sargin E. Erzin Y. Yemez A. M. Tekalp Multimodal speaker identification using canonical correlation analysis. Proceedings of the 31st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '06) 1 Toulouse, France 2006 613 616
40. Text Retrieval Conference Video Track. http://trec.nist.gov/
41. H. Bredin G. Chollet Audio-visual speech synchrony measure for talking-face identity verification. Proceedings of the 32nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '07) Honolulu, Hawaii, USA 2007