The use of temporal speech and lip information for multi-modal speaker identification via multi-stream HMMs

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 4, Issue , 2000, Pages 2389-2392

  Wark, T ^a   Sridharan, S ^a   Chandran, V ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

HIDDEN MARKOV MODELS; LOUDSPEAKERS; MARKOV PROCESSES; SIGNAL PROCESSING; AUDIO SYSTEMS; FEATURE EXTRACTION; LAGRANGE MULTIPLIERS; MATHEMATICAL MODELS; MULTIMEDIA SYSTEMS; PROBABILITY DISTRIBUTIONS; SPURIOUS SIGNAL NOISE; STATISTICAL METHODS;

AUDIO AND VISUAL INFORMATION; MULTI-MODAL SPEAKER IDENTIFICATION; MULTI-STREAM HIDDEN MARKOV MODEL; SPEAKER IDENTIFICATION; SPEAKER RECOGNITION SYSTEM; SPEECH INFORMATION; TEXT DEPENDENT SPEAKER IDENTIFICATION; VISUAL FEATURE; MULTI MODAL SPEAKER IDENTIFICATION; MULTI STREAM HIDDEN MARKOV MODEL;

SPEECH RECOGNITION;

EID: 0033692608     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2000.859322     Document Type: Conference Paper

References (12)

1. T. J. Wark, S. Sridharan, and V. Chandran, "An approach to statistical lip modelling for speaker identification via chromatic feature extraction", in Int. Conf. on Pattern Recognition, vol. 1, pp. 123-125, Aug. 1998.
2. T. Coianiz and L. Torresani, "Analysis and encoding of lip movements", in Int. Conf. on Audio- and Video-based Biometric Person Authentication, no. 1206 in Lecture Notes in Computer Science, pp. 53-60, Springer, 1997.
3. M. U. R. Sanchez, J. Matas, and J. Kittler, "Statistical chromacity models for lip-tracking with b-splines", in Int. Conf. on Audio and Video-based Biometric Person Authtication, no. 1206 in Lecture Notes in Computer Science, pp. 69-76, Springer, 1997.
4. G. Potamianos and H. P. Graf, "Discriminative training of hmm stream exponents", in Int. Conf. on Acoustics Speech and Signal Processing, vol. 6, pp. 3733-3736, 1998.
5. A. Rogozan, P. Deleglise, and M. Alissali, "Adaptive determinationof audio and visual weights for automatic speech recognition", in AVSP Workshop, ESCA, Sept. 1997.
6. P. Jourlin, J. Luettin, D. Genoud, and H. Wassner, "Acousticlabial speaker verification", in Audio and Video-Based Biometric Person Authentication, no. 1206 in Lecture Notes in Computer Science, pp. 319-326, Berlin: Springer-Verlag, 1997. ISBN 3-540-62660-3.
7. B. Due, "Fusion of audio and video information for multi modal person authentication", Pattern Recognition Letters, vol. 18, pp. 835-843, 1997.
8. U. Dieckmann, P. Plankensteiner, and T. Wagner, "Sesam: A biometric person identification system using sensor fusion", in Int. Conf. on Audio- and Video-based Biometric Person Authentication, no. 1206 in Lecture Notes in Computer Science, pp. 301-310, Springer, 1997.
9. T. Wark, S. Sridharan, and V. Chandran, "Robust speaker verification via fusion of speech and lip modalities", in Int. Conf. on Acoustics Speech and Signal Processing, vol. VI, pp. 3061-3064, 1999.
10. R. Mammone, X. Zhang, and R. Ramachandran, "Robust speaker recognition - a feature based approach", IEEE Signal Processing Magazine, pp. 58-71, Sept. 1996.
11. R. Curwen and A. Blake, Active Vision, ch. 3, pp. 39-57. Cambridge: MIT Press, 1992.
12. S. Pigeon, "The m2vts database", technical report, Laboratoire de Telecommunications et Teledetection, Place du Levant, 2-B-1348 Louvain-La-Neuve, Belgium, (http://www.tele.ucl.ac.be/M2VTS), 1996.