Detecting overlapping speech with long short-term memory recurrent neural networks

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 1668-1672

  Geiger, Jürgen T ^a   Eyben, Florian ^a   Schuller, Björn ^a,b   Rigoll, Gerhard ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF PASSAU   (Germany)

Author keywords

Long short term memory; Neural networks; Speaker diarization; Speech overlap detection

Indexed keywords

BRAIN; FORECASTING; NEURAL NETWORKS; RECURRENT NEURAL NETWORKS;

AUDIO FEATURES; FEATURE SETS; HMM-BASED SYSTEMS; LONG SHORT-TERM MEMORY; OVERLAP DETECTIONS; SPEAKER DIARIZATION; SPEECH-OVERLAPS;

SPEECH RECOGNITION;

EID: 84906242216     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. E. Shriberg, "Spontaneous Speech: How People Really Talk and Why Engineers Should Care, " in Proc. Eurospeech, Lisbon, Portugal, 2005, pp. 1781-1784.
2. K. Laskowski, M. Heldner, and J. Edlund, "On the Dynamics of Overlap in Multi-Party Conversation, " in Proc. Interspeech, Portland, OR, USA, 2012.
3. M. Wlodarczak, J. Simko, and P. Wagner, "Temporal entrainment in overlapped speech: Cross-linguistic study, " in Proc. Interspeech, Portland, OR, USA, 2012.
4. A. Gravano and J. Hirschberg, "Turn-taking cues in taskoriented dialogue, " Computer Speech & Language, vol. 25, no. 3, pp. 601-634, 2011.
5. E. Shriberg, A. Stolcke, and D. Baron, "Observations on Overlap: Findings and Implications for Automatic Processing of Multi-Party Conversation, " in Proc. Eurospeech, Aalborg, Denmark, 2001, pp. 1359-1362.
6. F. Brugnara, D. Falavigna, D. Giuliani, and R. Gretter, "Analysis of the Characteristics of Talk-show TV Programs, " in Proc. Interspeech, Portland, OR, USA, 2012.
7. H. Sun and B. Ma, "Study of Overlapped Speech Detection for NIST SRE Summed Channel Speaker Recognition, " in Proc. Interspeech, Florence, Italy, 2011, pp. 2345-2348.
8. M. Huijbregts, D. van Leeuwen, and C. Wooters, "Speaker Diarization Error Analysis Using Oracle Components, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 2, pp. 393-403, 2012.
9. K. Boakye, B. Trueba-Hornero, O. Vinyals, and G. Friedland, "Overlapped Speech Detection for Improved Diarization in Multi-Party Meetings, " in Proc. ICASSP, Las Vegas, NV, USA, 2008, pp. 4353-4356.
10. M. Zelenak and J. Hernando, "The Detection of Overlapping Speech with Prosodic Features for Speaker Diarization, " in Proc. Interspeech, Florence, Italy, 2011, pp. 1041-1044.
11. M. Zelenak, C. Segura, J. Luque, and J. Hernando, "Simultaneous speech detection with spatial features for speaker diarization, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 2, pp. 436- 446, 2012.
12. R. Vipperla, J. Geiger, S. Bozonnet, D. Wang, N. Evans, B. Schuller, and G. Rigoll, "Speech Overlap Detection and Attribution Using Convolutive Non-Negative Sparse Coding, " in Proc. ICASSP, Kyoto, Japan, 2012, pp. 4181- 4184.
13. J. Geiger, R. Vipperla, S. Bozonnet, N. Evans, B. Schuller, and G. Rigoll, "Convolutive Non-Negative Sparse Coding and New Features for Speech Overlap Handling in Speaker Diarization, " in Proc. Interspeech, Portland, OR, USA, 2012.
14. J. Geiger, R. Vipperla, N. Evans, B. Schuller, and G. Rigoll, "Speech Overlap Detection and Attribution Using Convolutive Non-Negative Sparse Coding: New Improvements and Insights, " in Proc. EUSIPCO, Bucharest, Romania, 2012, pp. 340-344.
15. S. H. Yella and F. Valente, "Speaker Diarization of Overlapping Speech based on Silence Distribution in Meeting Recordings, " in Proc. Interspeech, Portland, OR, USA, 2012.
16. S. H. Yella and H. Bourlard, "Improved Overlap Speech Diarization of Meeting Recordings using Long-Term Conversational Features, " in Proc. ICASSP, Vancouver, Canada, 2013.
17. Barry Chen, Qifeng Zhu, and Nelson Morgan, "Learning long-term temporal features in lvcsr using neural networks, " in Proc. Interspeech, Jeju Island, Korea, 2004, pp. 612-615.
18. S. Hochreiter and J. Schmidhuber, "Long short-term memory, " Neural Computation, vol. 9, no. 8, pp. 1735- 1780, 1997.
19. F. Eyben, F. Weninger, S. Squartini, and B. Schuller, "Real-life Voice Activity Detection with LSTM Recurrent Neural Networks and an Application to Hollywood Movies, " in Proc. ICASSP, Vancouver, Canada, 2013.
20. F. Eyben, M. Wöllmer, and B. Schuller, "openSMILE: The Munich Versatile and Fast Open-Source Audio Feature Extractor, " in Proc. ACM Multimedia (MM), Florence, Italy, 2010, pp. 1459-1462.
21. P. O. Hoyer, "Non-negative Matrix Factorization with Sparseness Constraints, " Journal of Machine Learning Research, vol. 5, pp. 1457-1469, 2004.
22. P. Smaragdis, "Convolutive Speech Bases and Their Application to Supervised Speech Separation, " IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 1, pp. 1-12, 2007.
23. D. Wang, R. Vipperla, and N. Evans, "Online pattern learning for non-negative convolutive sparse coding, " in Proc. Interspeech, Florence, Italy, 2011, pp. 65-68.
24. D.Wang, R. Vipperla, N. Evans, and T. F. Zheng, "Online non-negative convolutive pattern learning for speech signals, " IEEE Transactions on Signal Processing, vol. 61, no. 1, pp. 44-56, 2013.
25. S. Bozonnet, N. Evans, and C. Fredouille, "The LIAEurecom RT09 Speaker Diarization System: Enhancements in Speaker Modelling and Cluster Purification, " in Proc. ICASSP, Dallas, TX, USA, 2010, pp. 4958-4961.
26. A. Graves, S. Ferńandez, and J. Schmidhuber, " Multidimensional recurrent neural networks, " in Proc. of the 2007 International Conference on Artificial Neural Networks, Porto, Portugal, 2007.
27. J. Carletta, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec, V. Karaiskos, W. Kraaij, M. Kronenthal, et al., "The AMI meeting corpus: A preannouncement, " Machine Learning for Multimodal Interaction, pp. 28-39, 2006.
28. K. Boakye, O. Vinyals, and G. Friedland, "Improved Overlapped Speech Handling for Speaker Diarization, " in Proc. Interspeech, Florence, Italy, 2011, pp. 941-944.