Variational regularized 2-D nonnegative matrix factorization

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 5, 2012, Pages 703-716

  Gao, Bin ^a   Woo, W L ^a   Dlay, S S ^a  

^a NEWCASTLE UNIVERSITY   (United Kingdom)

Author keywords

Audio process machine learning; nonnegative matrix factorization; single channel blind source separation; sparsity aware learning; variational regularization

Indexed keywords

ADAPTIVE REGULARIZATION; COMPUTATIONALLY EFFICIENT; MAXIMUM A POSTERIORI PROBABILITIES; NONNEGATIVE MATRIX FACTORIZATION; SINGLE CHANNEL BLIND SOURCE SEPARATIONS; SPARSITY-AWARE LEARNING; VARIATIONAL APPROACHES; VARIATIONAL REGULARIZATION;

BLIND SOURCE SEPARATION; PROBABILITY DISTRIBUTIONS;

MATRIX ALGEBRA;

EID: 84876153078     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2187925     Document Type: Article

References (39)

1. W. T. Zhang and S. T. Lou, "Iterative algorithm for joint zero diagonalization with application in blind source separation," IEEE Trans. Neural Netw., vol. 22, no. 7, pp. 1107-1118, Nov. 2011.
2. S. C. Alvarez, A. Cichocki, and L. C. Ribas, "An Iterative inversion approach to blind source separation," IEEE Trans. Neural Netw., vol. 11, no. 6, pp. 1423-1437, Nov. 2000.
3. G. Zhou, Z. Yang, S. Xie, and J. Yang, "Online blind source separation using incremental nonnegative matrix factorization with volume constraint," IEEE Trans. Neural Netw., vol. 22, no. 4, pp. 550-560, Nov. 2011.
4. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Proc. NIPS, 2000, pp. 556-562.
5. P. Paatero and U. Tapper, "Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values," Environmetrics, vol. 5, no. 2, pp. 111-126, 1994.
6. A. Ozerov and C. Févotte, "Multichannel nonnegative matrix factorization in convolutive mixtures for audio source separation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 550-563, Mar. 2010.
7. D. Lee and H. Seung, "Learning the parts of objects by nonnegative matrix factorization," Nature, vol. 401, no. 6755, pp. 788-791, 1999.
8. D. Donoho and V. Stodden, "When does non-negative matrix factorization give a correct decomposition into parts?" in Proc. Adv. Neural Inf. Process. Syst., vol. 17. 2003, pp. 1-8.
9. N. Bertin, R. Badeau, and E. Vincent, "Enforcing harmonicity and smoothness in Bayesian non-negative matrix factorization applied to polyphonic music transcription," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 538-5493, Mar. 2010.
10. E. Vincent, N. Bertin, and R. Badeau, "Adaptive harmonic spectral decomposition for multiple pitch estimation," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 3, pp. 528-537, Mar. 2010.
11. P. Smaragdis and J. C. Brown, "Non-negative matrix factorization for polyphonic music transcription," in Proc. IEEE Workshop Appl. Signal Process. Audio Acoust., Oct. 2003, pp. 177-180.
12. Y. C. Cho and S. Choi, "Nonnegative features of spectro-temporal sounds for classification," Pattern Recognit. Lett., vol. 26, no. 9, pp. 1327-1336, Jul. 2005.
13. M. D. Plumbley, "Algorithms for non-negative independent component analysis," IEEE Trans. Neural Netw., vol. 14, no. 3, pp. 534-543, May 2003.
14. R. Zdunek and A. Cichocki, "Nonnegative matrix factorization with constrained second-order optimization," Int. J. Signal Process., vol. 87, no. 8, pp. 1904-1916, 2007.
15. P. Sajda, S. Du, T. Brown, R. Stoyanova, D. Shungu, X. Mao, and L. Parra, "Nonnegative matrix factorization for rapid recovery of constituent spectra in magnetic resonance chemical shift imaging of the brain," IEEE Trans. Med. Imag., vol. 23, no. 12, pp. 1453-1465, Dec. 2004.
16. C.-J. Lin, "Projected gradient methods for nonnegative matrix factorization," Int. J. Neural Comput., vol. 19, no. 10, pp. 2756-2779, Oct. 2007.
17. O. Okun and H. Priisalu, "Unsupervised data reduction," Int. J. Signal Process., vol. 87, no. 9, pp. 2260-2267, 2007.
18. R. Kompass, "A generalized divergence measure for nonnegative matrix factorization," Int. J. Neural Comput., vol. 19, no. 3, pp. 780-791, 2007.
19. A. Cichocki, R. Zdunek, and S. I. Amari, "Csiszár's divergences for nonnegative matrix factorization: Family of new algorithms," in Proc. Int. Conf. Indepen. Comp. Anal. Blind Signal Separ., vol. 3889. Charleston, SC, Mar. 2006, pp. 32-39.
20. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," Int. J. Mach. Learn. Res., vol. 5, pp. 1457-1469, Aug. 2004.
21. K. Stadlthanner, F. J. Theis, C. G. Puntonet, and E. W. Lang, "Extended sparse nonnegative matrix factorization," in Proc. Artif. Neural Netw., vol. 3512. 2005, pp. 249-256.
22. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," Int. J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1998.
23. M. J. L. Orr, "Regularization in the selection of radial basis function centers," Int. J. Neural Comput., vol. 7, no. 3, pp. 606-623, May 1995.
24. A. T. Cemgil, "Bayesian inference for nonnegative matrix factorization models," Int. J. Comput. Intell. Neurosci., vol. 2009, p. 785152, Jan. 2009.
25. S. Moussaoui, D. Brie, A. Mohammad-Djafari, and C. Carteret, "Separation of non-negative mixture of non-negative sources using a Bayesian approach and MCMC sampling," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4133-4145, Nov. 2006.
26. M. N. Schmidt, O. Winther, and L. K. Hansen, "Bayesian non-negative matrix factorization," in Proc. 8th Int. Conf., Paraty, Brazil, 2009, pp. 540-547.
27. R. Salakhutdinov and A. Mnih, "Bayesian probabilistic matrix factorization using Markov chain Monte Carlo," in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 880-887.
28. M. Mørup and K. L. Hansen, "Tuning pruning in sparse non-negative matrix factorization," in Proc. 17th Eur. Signal Process. Conf., Glasgow, Scotland, 2009, pp. 1-5.
29. M. Morup and M. N. Schmidt, "Sparse non-negative matrix factor 2-D deconvolution," Inf. Math. Model., Univ. Denmark, Lyngby, Denmark, Tech. Rep., 2006.
30. M. N. Schmidt and M. Morup, "Nonnegative matrix factor 2-D deconvolution for blind single channel source separation," in Proc. Int. Conf. Indepen. Comp. Anal. Blind Signal Separat., vol. 3889. 2006, pp. 700-707.
31. M. Harva and A. Kaban, "Variational learning for rectified factor analysis," Signal Process., vol. 87, no. 3, pp. 509-527, 2007.
32. D. P. Bertsekas, Nonlinear Programming, 2nd ed. Belmont, MA: Athena Scientific, 1999.
33. Signal Separation Evaluation Campaign (SiSEC 2008). (2008) [Online]. Available: http://sisec.wiki.irisa.fr
34. E. Vincent, R. Gribonval, and C. Fevotte, "Performance measurement in blind audio source separation," IEEE Trans. Speech, Audio Lang. Process., vol. 14, no. 4, pp. 1462-1469, Jul. 2005.
35. D. L. Wang, "On ideal binary mask as the computational goal of auditory scene analysis," in Speech Separation by Humans and Machines, P. Divenyi, Ed. Norwell, MA: Kluwer, 2005, pp. 181-197.
36. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
37. T. Virtanen, "Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 3, pp. 1066-1074, Mar. 2007.
38. P. Smaragdis, "Non-negative matrix factor deconvolution; extraction of multiple sound sources from monophonic inputs," in Proc. 5th Int. Conf. Indepen. Comp. Anal. Blind Signal Separat., Grenada, Spain, Sep. 2004, pp. 1-8.
39. M. K. I. Molla and K. Hirose, "Single-mixture audio source separation by subspace decomposition of Hilbert spectrum," IEEE Trans. Audio, Speech Lang. Process., vol. 15, no. 3, pp. 893-900, Mar. 2007.