Optimization and parallelization of monaural source separation algorithms in the openBliSSART toolkit

Journal of Signal Processing Systems

Volumn 69, Issue 3, 2012, Pages 267-277

  Weninger, Felix ^a   Schuller, Björn ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Audio source separation; Parallel computing; Speech enhancement

Indexed keywords

APPLICATION FRAMEWORKS; AUDIO EFFECTS; AUDIO SOURCE SEPARATION; AUDIO-RECOGNITION; COMPUTATION TIME; COMPUTE UNIFIED DEVICE ARCHITECTURES; END-USER APPLICATIONS; GRAPHICS PROCESSING UNITS; MATRIX FACTORIZATIONS; MEMORY USAGE; MONAURAL SOURCE; NUMERICAL OPTIMIZATIONS; PARALLEL PROCESSING; PARALLELIZATIONS; REALTIME PROCESSING; SEPARATION ALGORITHMS;

AUDIO ACOUSTICS; BENCHMARKING; BLIND SOURCE SEPARATION; COMPUTER GRAPHICS; FEATURE EXTRACTION; PARALLEL ARCHITECTURES; PARALLEL PROCESSING SYSTEMS; PROGRAM PROCESSORS; SIGNAL PROCESSING; SPEECH ENHANCEMENT;

ALGORITHMS;

EID: 84866042020     PISSN: 19398018     EISSN: 19398115     Source Type: Journal    
DOI: 10.1007/s11265-012-0673-7     Document Type: Article

References (38)

1. Battenberg, E., & Wessel, D. (2009). Accelerating nonnegative matrix factorization for audio source separation on multi-core and many-core architectures. In Proc. of 10th International Society for Music Information Retrieval conference (ISMIR) (pp. 501-506). Kobe, Japan.
2. Cichocki, A., Zdunek, R., Phan, A. H., & Amari, S. I. (2009). Nonnegative matrix and tensor factorizations. Wiley.
3. Cooke, M., Hershey, J. R., & Rennie, S. J. (2010). Monaural speech separation and recognition challenge. Computer Speech and Language, 24, 1-15.
4. Durrieu, J. L., Richard, G., David, B., & Févotte, C. (2010). Source/filter model for unsupervised main melody extraction from polyphonic audio signals. IEEE Transactions on Audio, Speech, and Language Processing, 18(3), 564-575.
5. Févotte, C., Bertin, N., & Durrieu, J. L. (2009). Nonnegative matrix factorization with the Itakura-Saito divergence: With application to music analysis. Neural Computation, 21(3), 793-830.
6. Frigo, M., &Johnson, S. G. (2005). The design and implementation of FFTW3. Proceedings of the IEEE, 93(2), 216-231. (Pubitemid 40851223)
7. Gemmeke, J., Virtanen, T., & Hurmalainen, A. (2011). Exemplar-based sparse representations for noise robust automatic speech recognition. IEEE Transactions on Audio, Speech, and Language Processing, 19(7), 2067-2080.
8. Gemmeke, J. F., Hurmalainen, A., Virtanen, T., & Sun, Y. (2011). Toward a practical implementation of exemplarbased noise robust ASR. In Proc. of EUSIPCO (pp. 1490-1494).
9. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009). The WEKA data mining software: An update. ACM SIGKDD Explorations Newsletter, 11, 10-18.
10. Heittola, T., Mesaros, A., Virtanen, T., & Eronen, A. (2011). Sound event detection in multisource environments using source separation. In Proc. of CHiME workshop (pp. 86-90). Florence, Italy.
11. Helen, M., & Virtanen, T. (2005). Separation of drums from polyphonic music using non-negative matrix factorization and support vector machine. In Proc. of EUSIPCO. Antalya, Turkey.
12. Hurmalainen, A., Gemmeke, J., & Virtanen, T. (2011). Nonnegative matrix deconvolution in noise robust speech recognition. In Proc. of ICASSP (pp. 4588-4591). Prague, Czech Republic.
13. Hyvärinen, A., Karhunen, J., & Oja, E. (2001). Independent component analysis. New York: Wiley.
14. Lee, D. D., & Seung, H. S. (2001). Algorithms for nonnegative matrix factorization. In Proc. of NIPS (pp. 556-562). Vancouver, Canada.
15. Mesaros, A., & Virtanen, T. (2009). Automatic recognition of lyrics in singing. EURASIP Journal on Audio, Speech, and Music Processing, Article ID 546047.
16. O'Grady, P. D., & Pearlmutter, B. A. (2007). Discovering convolutive speech phones using sparseness and nonnegativity constraints. In Proc. of ICA. London, UK.
17. Ozerov, A., Févotte, C., & Charbit, M. (2009). Factorial scaled hidden Markov model for polyphonic audio representation and source separation. In Proc. of WASPAA (pp. 121-124). Mohonk, NY, United States.
18. Ozerov, A., & Vincent, E. (2011). Using the FASST source separation toolbox for noise robust speech recognition. In Proc. of CHiME workshop (pp. 86-87). Florence, Italy.
19. Raj, B., Virtanen, T., Chaudhuri, S., & Singh, R. (2010). Nonnegative matrix factorization based compensation of music for automatic speech recognition. In Proc. of Interspeech. Makuhari, Japan.
20. Schmidt, M. N., & Olsson, R. K. (2006). Single-channel speech separation using sparse non-negative matrix factorization. In Proc. of Interspeech. Pittsburgh, PA, USA.
21. Schuller, B., Lehmann, A., Weninger, F., Eyben, F., & Rigoll, G. (2009). Blind enhancement of the rhythmic and harmonic sections by NMF: Does it help? In Proc. of the international conference on acoustics (NAG/DAGA 2009) (pp. 361-364). DEGA, Rotterdam, Netherlands.
22. Schuller, B., & Weninger, F. (2010). Discrimination of speech and non-linguistic vocalizations by non-negative matrix factorization. In Proc. of ICASSP (pp. 5054-5057). Dallas, TX, USA.
23. Schuller, B., Weninger, F., Wöllmer, M., Sun, Y., & Rigoll, G. (2010). Non-negative matrix factorization as noise-robust feature extractor for speech recognition. In Proc. of ICASSP (pp. 4562-4565). Dallas, TX, USA.
24. Smaragdis, P. (2007). Convolutive speech bases and their application to supervised speech separation. IEEE Transactions on Audio, Speech and Language Processing, 15(1), 1-14.
25. Smaragdis, P., & Brown, J. C. (2003). Non-negative matrix factorization for polyphonic music transcription. In Proc. of IEEE workshop on applications of signal processing to audio and acoustics (pp. 177-180). New Paltz, NY, USA.
26. Smaragdis, P., Raj, B., & Shashanka, M. (2007). Supervised and semi-supervised separation of sounds from singlechannel mixtures. In Proc. of ICA (pp. 414-421). Berlin: Springer.
27. Uhle, C., Dittmar, C., &Sporer, T. (2003). Extraction of drum tracks from polyphonic music using independent subspace analysis. In Proc. of ICA. Nara, Japan.
28. Vincent, E., Gribonval, R., & Févotte, C. (2006). Performance measurement in blind audio source separation. IEEE Transactions on Audio, Speech and Language Processing, 14(4), 1462-1469. (Pubitemid 46547636)
29. Virtanen, T. (2007). Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria. IEEE Transactions on Audio, Speech and Language Processing, 15(3), 1066-1074.
30. Wang, W., Cichocki, A., & Chambers, J. A. (2009). A multiplicative algorithm for convolutive non-negative matrix factorization based on squared Euclidean distance. IEEE Transactions on Signal Processing, 57(7), 2858-2864.
31. Weninger, F., Geiger, J., Wöllmer, M., Schuller, B., & Rigoll, G. (2011). The Munich 2011 CHiME challenge contribution: NMF-BLSTM speech enhancement and recognition for reverberated multisource environments. In Proc. of CHiME workshop (pp. 24-29). Florence, Italy.
32. Weninger, F., Lehmann, A., & Schuller, B. (2011). open-BliSSART: Design and evaluation of a research toolkit for blind source separation in audio recognition tasks. In Proc. of ICASSP (pp. 1625-1628). Prague, Czech Republic.
33. Weninger, F., Schuller, B., Batliner, A., Steidl, S., & Seppi, D. (2011). Recognition of nonprototypical emotions in reverberated and noisy speech by nonnegative matrix factorization. EURASIP Journal on Advances in Signal Processing, Special Issue on Emotion and Mental State Recognition from Speech, Article ID 838790, 16 pp.
34. Weninger, F., Schuller, B., Wöllmer, M., & Rigoll, G. (2011). Localization of non-linguistic events in spontaneous speech by non-negative matrix factorization and long short-term memory. In Proc. of ICASSP (pp. 5840-5843). Prague, Czech Republic.
35. Whaley, R. C., Petitet, A., & Dongarra, J. (2001). Automated empirical optimization of software and the ATLAS project. Parallel Computing, 27(1-2), 3-35. (Pubitemid 32264775)
36. Wilson, K. W., Raj, B., & Smaragdis, P. (2008). Regularized non-negative matrix factorization with temporal dependencies for speech denoising. In Proc. of Interspeech. Brisbane, Australia.
37. Yasuda, K. (2008). Accelerating density functional calculations with graphics processing unit. Journal of Chemical Theory and Computation, 4, 1230-1236.
38. Young, S. J., Evermann, G., Gales, M. J. F., Kershaw, D., Moore, G., Odell, J. J., et al. (2006). The HTK book version 3.4. Cambridge University Engineering Department, Cambridge, UK.