Supervised input space scaling for non-negative matrix factorization

Signal Processing

Volumn 92, Issue 8, 2012, Pages 1864-1874

  Driesen, J ^a   Van Hamme, H ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Automatic relevance determination; Document clustering; Feature selection; Machine learning; Pattern detection; Vocabulary acquisition

Indexed keywords

ARTIFICIAL INTELLIGENCE; FACTORIZATION; FEATURE EXTRACTION; LEARNING SYSTEMS;

ALGORITHM FOR SOLVING; AUTOMATIC RELEVANCE DETERMINATION; DOCUMENT CLUSTERING; LOW DIMENSIONAL STRUCTURE; NON-NEGATIVE MATRIX; NONNEGATIVE MATRIX FACTORIZATION; PATTERN DETECTION; VOCABULARY ACQUISITION;

MATRIX ALGEBRA;

EID: 84858080804     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2011.07.016     Document Type: Article

References (37)

1. H. Van hamme, HAC-models: a novel approach to continuous speech recognition, in: Proceedings of Interspeech 2008, Brisbane, Australia, 2008.
2. D. Lee, and H. Seung Learning the parts of objects by nonnegative matrix factorization Nature 401 1999 788 791
3. D.D. Lee, H.S. Seung, Algorithms for non-negative matrix factorization, in: Proceedings of NIPS 2001, Vancouver, British Columbia, Canada, 2001.
4. Z.-L. Wu, C.-h. Li, Topic detection in online discussion using non-negative matrix factorization, in: Proceedings of IEEE/WIC/ACM 2007, Washington, DC, USA, 2007.
5. P. Barman, N. Iqbal, S.-Y. Lee, Non-negative matrix factorization based text mining: feature extraction and classification, in: Neural Information Processing, Lecture Notes in Computer Science, vol. 4233, 2006, pp. 703712.
6. C. Yang, M. Ye, J. Zhao, Document clustering based on nonnegative sparse matrix factorization, in: Advances in Natural Computation, Lecture Notes in Computer Science, vol. 3611, 2005, pp. 557563.
7. W. Xu, X. Liu, Y. Gong, Document clustering based on non-negative matrix factorization, in: Proceedings of ACM SIGIR 2003, Toronto, Canada, 2003.
8. T.O. Virtanen, Monaural Sound Source Separation by Perceptually Weighted Non-Negative Matrix Factorization, Technical Report, Tampere University of Technology, 2007.
9. M. Kim, S. Choi, Monaural music source separation: Non-negativity, sparseness, and shift-invariance, in: Proceedings of ICA 2006, Charleston, South Carolina, 2006.
10. T. Hofmann, Probabilistic latent semantic analysis, in: Proceedings of UAI 1999, Stockholm, Sweden, 1999.
11. D.M. Blei, A.Y. Ng, and M.I. Jordan Latent dirichlet allocation Journal of Machine Learning Research 3 2003 993 1022
12. W. Buntine, Variational extensions to EM and multinomial PCA, in: Machine Learning: ECML 2002 2430, 2002, pp. 2334.
13. D.D. Lewis, Naive (Bayes) at forty: The independence assumption in information retrieval, in: Proceedings of CML 1998, London, UK, 1998.
14. Y. Chen, and J. Hua Non-negative matrix factorization for semi-supervised data clustering Knowledge and Information Systems 17 2008 355 379
15. Y. Chen, M. Rege, M. Dong, J. Hua, Incorporating user provided constraints into document clustering, in: Proceedings of ICDM 2007, Omaha, NE, USA, 2007.
16. T. Li, Y. Zhang, V. Sindhwani, A non-negative matrix tri-factorization approach to sentiment classification with lexical prior knowledge, in: Proceedings of ACL 2009, Stroudsburg, PA, USA, 20009.
17. M. Heiler, and C. Schnorr Learning sparse representations by non-negative matrix factorization and sequential cone programming Journal of Machine Learning Research 7 2006 1385 1407 (Pubitemid 44024595)
18. H. Van hamme, Integration of asynchronous knowledge sources in a novel speech recognition framework, in: Proceedings of ITRW 2008, Aalborg, Denmark, 2008.
19. I. Guyon, A. Elisseeff, An Introduction to Variable and Feature Selection, vol. 3, 2003, pp. 11571182.
20. C. Févotte, A.T. Cemgil, Nonnegative matrix factorizations as probabilistic inference in composite models, in: Proceedings of the EUSIPCO 2009, Glasgow, Scotland, 2009.
21. M. Nakano, H. Kameoka, J. Le Roux, Y. Kitano, N. Ono, S. Sagayama, Convergence-guaranteed multiplicative algorithms for nonnegative matrix factorization with β - divergence, in: Proceedings of the MLSP 2010, Kittila, Finland, 2010.
22. C. Févotte, N. Bertin, and J.L. Durrieu Nonnegative matrix factorization with the ItakuraSaito divergence: With application to music analysis Neural Computation 21 2009 793 830
23. P.O. Hoyer Non-negative matrix factorization with sparseness constraints Journal of Machine Learning Research 5 2005 1457 1470
24. H. Kim, and H. Park Sparse non-negative matrix factorizations via alternating non-negativity-constrained least squares for microarray data analysis Bioinformatics 23 2007 1495 1502 (Pubitemid 47244474)
25. H. Li, T. Adali, W. Wang, D. Emge, Non-negative matrix factorization with orthogonality constraints for chemical agent detection in raman spectra, Mystic, Connecticut, USA.
26. J. Yoo, S. Choi, Orthogonal nonnegative matrix factorization: Multiplicative updates on stiefel manifolds, in: Proceedings of IDEAL 2008, Daejeon, Korea, 2008.
27. D. Donoho, V. Stodden, When does non-negative matrix factorization give a correct decomposition into parts? in: Proceedings of the NIPS 2003, Whistler, British Columbia, Canada, 2003.
28. H. Laurberg, M. Græsbøll Christensen, M.D. Plumbley, L. Kai Hansen, and S. Holdt Jensen Theorems on positive data: on the uniqueness of NMF Computational Intelligence and Neuroscience 2008 2008
29. R.H. Byrd, P. Lu, and J. Nocedal A limited memory algorithm for bound constrained optimization SIAM Journal on Scientific and Statistical Computing 16 1995 1190 1208
30. S.M. Dipartimento, and S. Mizzaro Relevance: the whole history Journal of the American Society for Information Science 48 1997 810 832 (Pubitemid 127628564)
31. A. OBrien Relevance as an aid to evaluation in opac Journal of Information Science 16 1990 265 271
32. G.H. John, R. Kohavi, K. Pfleger, Irrelevant features and the subset selection problem, in: Proceedings of the ICML 1994, New Brunswick, NJ, USA, 1994, pp. 121129.
33. K.S. Jones A statistical interpretation of term specificity and its application in retrieval Journal of Documentation 28 1972 11 21
34. C. Elkan, Deriving TF-IDF as a fisher kernel, in: String Processing and Information Retrieval, Lecture Notes in Computer Science, vol. 3772, 2005, pp. 295300.
35. D. Hiemstra A probabilistic justification for using TF-IDF term weighting in information retrieval International Journal on Digital Libraries 3 2000 131 139
36. E. Gaussier, C. Goutte, Relation between pLSA and NMF and implications, in: Proceedings of the SIGIR 2005, Salvador, Brazil, 2005.
37. T. Joachims, A probabilistic analysis of the rocchio algorithm with tfidf for text categorization, in: Proceedings of the ICML 1997, San Francisco, CA, USA, 1997.