Multimodal speaker identification using an adaptive classifier cascade based on modality reliability

IEEE Transactions on Multimedia

Volumn 7, Issue 5, 2005, Pages 840-852

  Erzin, Engin ^a,b   Yemez, Yücel ^a,b   Tekalp, A Murat ^a,b,c,d  

^a IEEE   (Turkey)

^b KOÇ UNIVERSITY   (Turkey)

^c University of Rochester   (United States)

^d Koç University ^*  (Japan)

Author keywords

Classifier combining; Modality reliability; Multi modal speaker identification

Indexed keywords

CLASSIFIER COMBINING; MODALITY RELIABILITY; MULTI-MODAL SPEAKER IDENTIFICATION; OPEN-SET SPEAKER IDENTIFICATION SYSTEM;

CLASSIFIERS; DECISION MAKING; IDENTIFICATION (CONTROL SYSTEMS); PROBABILITY; PROBLEM SOLVING; RELIABILITY; SET THEORY;

ADAPTIVE SYSTEMS;

EID: 26844533276     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2005.854464     Document Type: Article

References (30)

1. N. Ratha, A. Senior, and R. M. Bolle, "Automated biometrics," Proc. ICAPR, pp. 445-474, May 2001.
2. J. Campbell, "Speaker recognition: a tutorial," Proc. IEEE, vol. 85, no. 9, pp. 1437-1462, Sep. 1997.
3. Y. Y. J. Zhang and M. Lades, "Face recognition: eigenface, elastic matching, and neural nets," Proc. IEEE, vol. 85, no. 9, pp. 1423-1435, Sep. 1997.
4. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cog. Neurosci., vol. 3, no. 1, pp. 586-591, Sep. 1991.
5. D. D. Zhang, Automated Biometrics. Norwell, MA: Kluwer, 2000.
6. A. Verma, T. Faruquie, C. Neti, and S. Basu, "Late integration in audio-visual continuous speech recognition," Automatic Speech Recognition and Understanding (ASRU), 1999.
7. J. Kittler, M. Hatef, R. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1998.
8. C. Sanderson and K. K. Paliwal, "Noise compensation in a person verification system using face and multiple speech features," Pattern Recognit., vol. 36, no. 2, pp. 293-302, Feb. 2003.
9. S. Ben-Yacoub, Y. Abdeljaoued, and E. Mayoraz, "Fusion of face and speech data for person identity verification," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1065-1074, Sep. 1999.
10. V. Chatzis, A. G. Borş, and I. Pitas, "Multimodal decision-level fusion for person authentication," IEEE Trans. Syst., Man, Cybern. A, Syst. Humans, vol. 29, no. 6, pp. 674-680, Nov. 1999.
11. R. Brunelli and D. Falavigna, "Person identification using multiple clues," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 10, pp. 955-966, Oct. 1995.
12. U. V. Chaudhari, G. N. Ramaswamy, G. Potamianos, and C. Neti, "Information fusion and decision cascading for audio-visual speaker recognition based on time-varying stream reliability prediction," in Proc. Int. Conf. Multimedia & Expo 2003 (ICME2003), vol. 3, Jul. 2003, pp. 9-12.
13. _, "Audio-visual speaker recognition using time-varying stream reliability prediction," in Proc. Int. Conf. Acoustics, Speech and Signal Processing 2003 (ICASSP 2003), vol. V, 2003, pp. 712-715.
14. T. Wark and S. Sridharan, "Adaptive fusion of speech and lip information for robust speaker identification," Digital Signal Process., vol. 11, no. 3, pp. 169-186, Jul. 2001.
15. P. Jourlin, J. Luettin, D. Genoud, and H. Wassner, "Acoustic-labial speaker verification," Pattern Recognit. Lett., vol. 18, no. 9, pp. 853-858, 1997.
16. M. R. Civanlar and T. Chen, "Password-free network security through joint use of audio and video," in Proc. SPIE Photonic, Nov. 1996, pp. 120-125.
17. S. Garcia-Salicetti, C. Beumier, G. Chollet, B. Dorizzi, J. L. les Jardins, J. Lunter, Y. Ni, and D. Petrovska-Delacretaz, Lecture Notes in Computer Science. Heidelberg, Germany: Springer-Verlag, Aug. 2003, vol. 2688, pp. 845-853.
18. R. Frischholz and U. Dieckmann, "BioID: a multimodal biometric identification system," J. IEEE Comput., vol. 33, no. 2, pp. 64-68, Feb. 2000.
19. L. A. Alexandre, A. C. Campilho, and M. Kamel, "Combining independent and unbiased classifiers using weighted average," in Proc. 15th Int. Conf. Pattern Recognition, vol. 2, 2000, pp. 3-7.
20. I. Bloch, "Information combination operators for data fusion: a comparative review with classification," IEEE Trans. Syst., Man, Cybern., vol. 26, no. 1, pp. 52-67, 1996.
21. H. Altincay and M. Demirekler, "Undesirable effects of output normalization in multiple classifier systems," Pattern Recognit. Lett., vol. 24, pp. 1163-1170, 2003.
22. _, "An information theoretic framework for weight estimation in the combination of probabilistic classifiers for speaker identification," J. Speech Commun., vol. 30, pp. 255-272, 2000.
23. K. Al-Ghoneim and B. V. K. V. Kumar, "Unified decision combination framework," Pattern Recognit., vol. 31, no. 12, pp. 2077-2089, 1998.
24. J. A. Benediktsson and P. H. Swain, "Consensus theoretic classification methods," IEEE Trans. Syst., Man, Cybern., vol. 22, no. 4, pp. 688-704, Apr. 1992.
25. N. Yoma and M. Villar, "Speaker verification in noise using a stochastic version of the weighted viterbi algorithm," IEEE Trans. Speech Audio Process., vol. 10, no. 3, pp. 158-166, Mar. 2002.
26. A. Rogozan, P. Deleglise, and M. Alissali, "Adaptive determination of audio and visual weights for automatic speech recognition," in Proc. AVSP Workshop, ESCA, 1997, pp. 61-64.
27. J. Kittler and F. M. Alkoot, "Sum versus vote fusion in multiple classifier systems," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 1, pp. 110-115, Jan. 2003.
28. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
29. E. Erzin, Y. Yemez, and A. M. Tekalp, "Joint audio-video processing for robust biometric speaker suidentification in car," in DSP for In-Vehicle and Mobile Systems, H. Abut, J. H. L. Hansen, and K. Takeda, Eds. Berlin/Heidelberg/New York: Springer-Verlag, 2004.
30. C. Neti, G. Potamianos, J. Luettin, I. Matthews, H. Glotin, and D. Vergyri, "Large-vocabulary audio-visual speech recognition: a summary of the Johns Hopkins summer 2000 workshop," in Proc. Workshop Multimedia Signal Processing, 2001, pp. 619-624.