Multimodal speaker segmentation and identification in presence of overlapped speech segments

Journal of Multimedia

Volumn 5, Issue 4, 2010, Pages 322-331

  Rozgić, Viktor ^a   Han, Kyu J ^a   Georgiou, Panayiotis G ^a   Narayanan, Shrikanth ^a  

^a University of Southern California   (United States)

Author keywords

Bayesian filtering; Joint probabilistic data association; Microphone array; Multimodal fusion; Parameter estimation; Speaker segmentation

Indexed keywords

BAYESIAN FILTERING; JOINT PROBABILISTIC DATA ASSOCIATION; MICROPHONE ARRAY; MULTI-MODAL FUSION; SPEAKER SEGMENTATIONS;

ARRAY PROCESSING; BAYESIAN NETWORKS; DECODING; HIDDEN MARKOV MODELS; LOUDSPEAKERS; MICROPHONES; SPEECH RECOGNITION; VITERBI ALGORITHM;

PARAMETER ESTIMATION;

EID: 78651568988     PISSN: 17962048     EISSN: None     Source Type: Journal    
DOI: 10.4304/jmm.5.4.322-331     Document Type: Article

References (32)

1. Augmented Multiparty Interaction Project, http://www.amiproject.org/.
2. Computers in Human Interaction Loop Project, http://chil.server.de/.
3. D. Gatica-Perez, G. Lathoud, J. M. Odobez, and I. Mc-Cowan, "Audiovisual probabilistic tracking of multiple speakers in meetings," IEEE Trans. on Audio, Speech and Language Processing, vol. 15, no. 2, pp. 601-616, February 2007.
4. G. Lathoud and I. McCowan, "Location based speaker segmentation," in Proc. ICASSP, 2003, pp. 621-624.
5. A. Jaimes, T. Okmura, T. Nagamine, and K. Hirata, "Memory cues for meeting video retrieval," in Proc. ACM Workshop of archival and retrieval of personal experiences, 2004, pp. 74-85.
6. I. McCowan, D. Gatica-Perez, S. Bengio, G. Lathoud, M. Barnard, and D.Zhang, "Automatic analysis of multimodal group actions in meetings," IEEE Trans. on PAMI, vol. 27, no. 3, pp. 305-317, March 2005.
7. I. Mikié, K. Huang, and M. Trivedi, "Activity monitoring and summarization for an intelligent meeting room," in Proc. IEEE Workshop on Human Motion, 2000, pp. 107-112.
8. C. Busso, S. Hernanz, C. W. Chu, S. I. Kwon, S. Lee, P. G. Georgiou, I. Cohen, and S. Narayanan, "Smart room: Participant and speaker localization and identification," in Proc. of the ICASSP, 2005, pp. 1117-1120.
9. C. Busso, P. Georgiou, and S. Narayanan, "Real-time monitoring of participants interaction in a meeting using audio-visual sensors," in Proc. ICASSP, 2007, pp. 685-688.
10. V. Rozgíc, C. Busso, P. G. Georgiou, and S. Narayanan, "Speaker tracking and segmentation with microphone array using mixture particle filter: Improvement of multimodal meeting monitoring system," in Proc. of Multi Media Signal Processing Conference, 2007, pp. 60-65.
11. R. J. Mammone, X. Zhang, and R. P. Ramachandran, "Robust speaker recognition: a feature-based approach," IEEE Signal Processing Magazine, vol. 13, no. 5, pp. 58-71, September 1996.
12. J. P. Campbell, "Speaker recognition: a tutorial," Proceedgins of the IEEE, vol. 85, no. 9, pp. 1437-1462, September 1997.
13. D. A. Reynolds, "An overview of automatic speaker recognition technology," in Proc. ICASSP, 2002, pp. 4072-4075.
14. F. Bimbot, J.-F. Bonastre, C. Fredouille, G. Gravier, I. Magrin-Chagnolleau, S. Meignier, T. Merlin, J. Ortega-Garćia, D. Petrovska-Delacŕetaz, and D. A. Reynolds, "A tutorial on text-independent speaker verification," EURASIP Journal on Applied Signal Processing, vol. 4, pp. 430-451, 2004.
15. D. E. Sturim, W. M. Campbell, and D. A. Reynolds, Classification Methods for Speaker Recognition, ser. Lecture Notes in Computer Science. Springer Berlin -Heidelberg, 2007, pp. 278-297.
16. J. Ajmera, G. Lathoud, and I. McCowan, "Clustering and segmenting speakers and their locations in meetings," in Proc. of the ICASSP, 2004, pp. 605-608.
17. M. Brandstein and D. Ward, Microphone Arrays: Signal Processing Techniques and Applications. Prentice Hall, 2001.
18. J. Chen, J. Benesty, and Y. Huang, "Time delay estimation in room acoustic environments: an overview," EURASIP Journal on Applied Signal Processing, pp. 170-187, January 2006.
19. D. A. Reynolds and R. C. Rose, "Robust text-independent speaker identification using Gaussian mixture speaker models," IEEE Trans. on Speech and Audio Processing, vol. 3, no. 1, pp. 72-83, 1995.
20. A. Doucet, N. DeFreitas, and N. Gordon, Sequential Monte Carlo Methods in Practice. Springer-Verlag, 2001.
21. A. Bain and D. Crisan, Fundamentals of Stochastic Filtering, ser. Stochastic Modelling and Applied Probability. Springer Verlag, 2008.
22. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. of IEEE, vol. 77, no. 2, pp. 257-286, 1989.
23. J. S. Liu, Monte Carlo Strategies in Scientific Computing, ser. Springer Series in Statistics. Springer Verlag, 2001.
24. D. Gamerman and H. F. Lopes, Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference, ser. Texts in Statistical Science Series. Chapman & Hall, 2006.
25. C. Rago, P. Willett, and R. Streit, "A comparison of the JPDAF and PMHT tracking," in Proc. ICASSP, 1995, pp. 3571-3574.
26. S. S. Chen and P. S. Gopalakrishnan, "Speaker, environment and channel change detection and clustering via the bayesian information criterion," in Proc. DARPA Broadcast News Transcription and Understanding Workshop, February 1998, pp. 127-132.
27. D. Liu and F. Kubala, "Fast speaker change detection for broadcast news transcription and indexing," in Proc. 6th European Conference on Speech Communication and Technology, September 1999, pp. 1031-1034.
28. P. Delacourt, D. Kryze, and C. J. Wellekens, "DISTBIC: A speaker-based segmentation for audio data indexing," Speech Communication, no. 32, pp. 111-126, 2000.
29. A. Vandecatseye and J.-P. Martens, "A fast, accurate and stream-based speaker segmentation and clustering algorithm," in Proc. Interspeech, September 2003, pp. 941-944.
30. S. E. Tranter and D. A. Reynolds, "An overview of automatic speaker diarization systems," IEEE Trans. of Audio, Speech and Language Processing, vol. 5, no. 14, pp. 1557-1565, 2006.
31. J. Makhoul, F. Kubala, R. Schwartz, and R. Weischedel, "Performance measures for information extraction," in Proc. of DARPA Broadcast News Workshop, 1999, pp. 249-252.
32. D. A. Forsyth and J. Ponce, Computer Vision, A Modern Approach. Prentice Hall., 2003.