Multi-modal speaker diarization of real-world meetings using compressed-domain video features

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2009, Pages 4069-4072

  Friedland, Gerald ^a   Hung, Hayley ^b   Yeo, Chuohao ^c  

^a INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Compressed domain features; Multi modal; Speaker extraction

Indexed keywords

ACOUSTIC FEATURES; AUDIO TRACK; COMPRESSED DOMAIN; COMPRESSED DOMAIN FEATURES; DATA SETS; ERROR RATE; IMPROVE-A; MULTI-MODAL; MULTI-MODAL APPROACH; PRIOR KNOWLEDGE; REAL-WORLD; SPEAKER DIARIZATION; SPEAKER EXTRACTION; STANDING-UP; VIDEO FEATURES;

ACOUSTICS; IMAGE COMPRESSION; SIGNAL PROCESSING;

FEATURE EXTRACTION;

EID: 70349214881     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2009.4960522     Document Type: Conference Paper

References (11)

1. Jinni A Harrigan, "Listeners' body movements and speaking turns," Communications Research, vol. 12, no. 2, pp. 233-250, April 1985.
2. Harriet J. Nock, Giridharan Iyengar, and Chalapathy Neti, "Speaker Localisation Using Audio-Visual Synchrony: An Empirical Study," Lecture Notes in Computer Science, vol. 2728, pp. 565-570, 2003.
3. JW Fisher III and T. Darrell, "Speaker association with signal-level audiovisual fusion," Multimedia, IEEE Transactions on, vol. 6, no. 3, pp. 406-413, 2004.
4. C. Zhang, P. Yin, Y. Rui, R. Cutler, and P. Viola, "Boosting-Based Multimodal Speaker Detection for Distributed Meetings," IEEE International Workshop on Multimedia Signal Processing (MMSP) 2006, 2006.
5. H. Vajaria, T. Islam, S. Sarkar, R. Sankar, and R. Kasturi, "Audio segmentation and speaker localization in meeting videos," Pattern Recognition, 2006. ICPR 2006. 18th International Conferenceon, vol. 2, pp. 1150-1153, 2006.
6. J.C. Carletta, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec, V. Karaiskos, W. Kraiij, M. Kronenthal, G. Lathoud, M. Lincoln, A. Lisowska, M. McCowan, W. Post, D. Reidsma, and P. Wellner, "The ami meeting corpus: A pre-announcement," in Joint Workshop on Machine Learning and Multimodal Interaction (MLMI), 2005.
7. C. Wooters and M. Huijbregts, "The ICSI RT07s speaker diarization system," in Proceedings of the Rich Transcription 2007 Meeting Recognition Evaluation Workshop, 2007.
8. Hayley Hung, Yan Huang, Chuohao Yeo, and Daniel Gatica-Perez, "Correlating audio-visual cues in a dominance estimation framework," in CVPR Workshop on Human Communicative Behavior Analysis, 2008.
9. Chuohao Yeo and Kannan Ramchandran, "Compressed domain video processing of meetings for activity estimation in dominance classification and slide transition detection," Tech. Rep. UCB/EECS-2008-79, EECS Department, University of California, Berkeley, Jun 2008.
10. S J McKenna, S Gong, and Y Raja, "Modelling facial colour and identity with gaussian mixtures," Pattern Recognition, vol. 31, no. 12, pp. 1883-1892, 1998.
11. J. Pardo, X. Anguera, and C. Wooters, "Speaker Diarization For Multiple-Distant-Microphone Meetings Using Several Sources of Information," IEEE Transactions on Computers, vol. 56, no. 9, pp. 1189, 2007.