Real-time meeting recognition and understanding using distant microphones and omni-directional camera

2010 IEEE Workshop on Spoken Language Technology, SLT 2010 - Proceedings

Volumn , Issue , 2010, Pages 424-429

  Hori, Takaaki ^a   Araki, Shoko ^a   Yoshioka, Takuya ^a   Fujimoto, Masakiyo ^a   Watanabe, Shinji ^a   Oba, Takanobu ^a   Ogawa, Atsunori ^a   Otsuka, Kazuhiro ^a   Mikami, Dan ^a   Kinoshita, Keisuke ^a   Nakatani, Tomohiro ^a   Nakamura, Atsushi ^a   Yamato, Junji ^a  

^a Nippon Telegraph and Telephone Corporation   (Japan)

Author keywords

Distant microphones; Meeting analysis; Speaker diarization; Speech enhancement; Speech recognition; Topic tracking

Indexed keywords

AUDIO PROCESSING; DISTANT MICROPHONES; FACE POSE; LOW-LATENCY; MEETING ANALYSIS; MICROPHONE ARRAYS; OMNIDIRECTIONAL CAMERAS; SPEAKER DIARIZATION; SPEECH RECOGNIZER; SPEECH SIGNALS; TOPIC TRACKING;

AUDIO SIGNAL PROCESSING; CAMERAS; INFORMATION ANALYSIS; MICROPHONES; SPEECH ENHANCEMENT; TRANSCRIPTION; WIRELESS SENSOR NETWORKS;

SPEECH RECOGNITION;

EID: 79951797950     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SLT.2010.5700890     Document Type: Conference Paper

References (24)

1. A.Waibel, M. Bett, and M. Finke, "Meeting browser: tracking and summarizing meetings," in Proc. DARPA Broadcast News Transcription and Understanding Workshop, 1998, pp. 281-286.
2. A. Janin, J. Ang, S. Bhagat, R. Dhillon, J. Edwards, J. Macías- Guarasa, N. Morgan, B. Peskin, E Shriberg, A. Stolcke, C. Wooters, and B. Wrede, "The ICSI meeting project: resources and research," in Proc. ICASSP'04 Meeting Recognition Workshop, 2004.
3. P. Wellner, M. Flynn, and M. Guillemot, "Browsing recorded meetings with Ferret," in Proc. ICMI-MLMI, 2004, pp. 12-21.
4. S. Renals, T. Hain, and H. Bourlard, "Recognition and understanding of meetings The AMI and AMIDA projects," in Proc. ASRU, 2007, pp. 238-247.
5. G. Tur, A. Stolcke, L. Voss, J. Dowding, B. Favre, R. Fernandez, M. Frampton, M. Frandsen, C. Frederickson, M. Graciarena, D. Hakkani-Tür, D. Kintzing, K. Leveque, S. Mason, J. Niekrasz, S. Peters, M. Purver, K. Riedhammer, E. Shriberg, J. Tien, D. Vergyri, and F. Yang, "The CALO meeting speech recognition and understanding system," in Proc. SLT, 2008.
6. K. Otsuka, S. Araki, K. Ishizuka, M. Fujimoto, M. Heinrich, and J. Yamato, "A realtime multimodal system for analyzing group meetings by combining face pose tracking and speaker diarization," in Proc. ICMI, 2008, pp. 257-264.
7. A. Popescu-Belis, P. Poller, and J. Kilgour, "A multimedia retrieval system using speech input," in Proc. ICMI-MLMI, 2009, pp. 223-224.
8. P. N. Garner, J. Dines, T. Hain, E. A. Hannani, M. Karafiát, D. Korchagin, M. Lincoln, V. Wan, and L. Zhang, "Real-time ASR from meetings," in Proc. Interspeech, 2009, pp. 2119-2122.
9. M. Fujimoto, K. Ishizuka, and T. Nakatani, "A study of mutual front-end processing method based on statistical model for noise robust speech recognition," in Proc. Interspeech, 2009, pp. 1235-1238.
10. T. Hori, "NTT Speech recognizer with Outlook On the Next generation: SOLON," in Proc. NTT Workshop on Communication Scene Analysis, 2004, pp. SP-6. [Online]. Available: www.kecl.ntt.co.jp/icl/signal/hori/publications/thori csa2004.pdf.
11. T. Yoshioka, T. Nakatani, T. Miyoshi, and H. G. Okuno, "Blind separation and dereverberation of speech mixtures by joint optimization," IEEE Transactions on Audio, Speech, and Language Processing, 2010, accepted for publication, doi:10.1109/TASL.2010.2045183.
12. S. Araki, M. Fujimoto, K. Ishizuka, H. Sawada, and S. Makino, "Speaker indexing and speech enhancement in real meeting / conversations," in Proc. ICASSP, 2008, vol. I, pp. 93-96.
13. C. H. Knapp and G. C. Carter, "The generalized correlation method for estimation of time delay," IEEE Trans. Acoust. Speech and Signal Processing, vol. 24, no. 4, pp. 320-327, 1976.
14. S. Araki, H. Sawada, R. Mukai, and S. Makino, "Underdetermined blind sparse source separation for arbitrarily arranged multiple sensors," Signal Processing, vol. 77, no. 8, pp. 1833-1847, Aug 2007.
15. M. Fujimoto and K. Ishizuka, "Noise robust voice activity detection based on switching Kalman filter," in Proc. Interspeech, 2007, pp. 2933-2936.
16. J. Sohn, N. S. Kim, and W. Sung, "A statistical model-based voice activity detection," IEEE Signal Processing Letters, vol. 6, no. 1, pp. 1-3, January 1999.
17. S. Furui, K. Maekawa, and H. Isahara, "A Japanese national project on spontaneous speech corpus and processing technology," in Proc. ASR, 2000, pp. 244-248.
18. T. Oba, T. Hori, and A. Nakamura, "A comparative study on methods of weighted language model training for reranking LVCSR n-best hypotheses," in Proc. ICASSP, 2010, pp. 5126-5129.
19. T. Hori, C. Hori, Y. Minami, and A. Nakamura, "Effi- cient WFST-based one-pass decoding with on-the-fly hypothesis rescoring in extremely large vocabulary continuous speech recognition," IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 4, pp. 1352-1365, 2007.
20. T. Hori and A. Nakamura, "Generalized fast on-the-fly composition algorithm for WFST-based speech recognition," in Proc. Interspeech- Eurospeech, 2005, pp. 557-560.
21. M. Saraclar, M. Riley, E. Bocchieri, and V. Goffin, "Towards automatic closed captioning: low latency real time broadcast news transcription," in Proc. ICSLP, 2002, pp. 1741-1744.
22. A. Temko, R. Malkin, C. Zieger, D. Macho, C. Nadeu, and M. Omologo, "CLEAR evaluation of acoustic event detection and classification systems," Multimodal Technologies for Perception of Humans, pp. 311-322, 2007.
23. T. Iwata, S. Watanabe, T. Yamada, and N. Ueda, "Topic tracking model for analyzing consumer purchase behavior," in Proc. IJCAI, 2009, pp. 1427-1432.
24. D. Mikami, K. Otsuka, and J. Yamato, "Memory-based particle filter for face pose tracking robust under complex dynamics," in Proc. CVPR, 2009, pp. 999-1006.