Multiplicative updates for the LASSO

Machine Learning for Signal Processing 17 - Proceedings of the 2007 IEEE Signal Processing Society Workshop, MLSP

Volumn , Issue , 2007, Pages 33-38

  Mørup, Morten ^a   Clemmensen, Line Harder ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER PROGRAMMING LANGUAGES; CONSTRAINT THEORY; CURVE FITTING; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; OPTIMIZATION; ROBOT LEARNING; SIGNAL PROCESSING;

IEEE SIGNAL PROCESSING SOCIETY; LEAST ABSOLUTE SHRINKAGE AND SELECTION OPERATOR; LEAST SQUARES MINIMIZATION; MACHINE-LEARNING; MULTIPLICATIVE UPDATES; NON-NEGATIVITY; UNCONSTRAINED OPTIMIZATION;

CONSTRAINED OPTIMIZATION;

EID: 48149104577     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MLSP.2007.4414278     Document Type: Conference Paper

References (21)

1. M. Mørup and L. H. Clemmensen, "Mulasso," http://www2.imm.dtu.dk/pubdb/views/edoc_download.php/5235/zip/imm5235.zip.
2. D.D. Lee and H.S. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol. 401, no. 6755, pp. 788-91, 1999.
3. D.D. Lee and H.S. Seung, "Algorithms for non-negative matrix factorization," in Advances in Neural Information Processing Systems, 2000, pp. 556-562.
4. C. Ding, T. Li, and M.I. Jordan, "Convex and seminonnegative matrix factorizations," LBNL Tech Report 60428, 2006.
5. R. Tibshirani, "Regression shrinkage and selection via the lasso," Journal of the Royal Statistical Society. Series B (Methodological), vol. 58, no. 1, pp. 267-288, 1996.
6. S.S. Chen, D.L. Donoho, and M.A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comp., vol. 20, no. 1, pp. 33-61, 1999.
7. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Annals of Statistics, vol. 32, no. 2, pp. 407-499, 2004.
8. S.C. Shaobing and D. Donoho, "Basis pursuit," 28th Asilomar conf. Signals, Systems Computers, 1994.
9. V. Guigue, A. Rakotomamonjy, and S. Canu, "Kernel basis pursuit," European Conference on Machine Learning, Porto, 2005.
10. 1-norm solution is also the sparsest solution," Communications on Pure and Applied Mathematics, vol. 59, no. 6, pp. 797-829, 2006.
11. T. Stanley, J. Kabalin, J. McNeal, I. Johnstone, H. Freiha, E. Redwine, and N. Yang, "Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate ii. radical prostatectomy treated patients," Journal of Urology, vol. 16, pp. 1076-1083, 1989.
12. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning, Springer, 2001.
13. N. Pochet, F. De Smet, A. K. Suykens, and L. R. De Moor Bart, "Systematic benchmarking of microarray data classification: assessing the role of nonlinearity and dimensionality reduction," Bioinformatics, vol. 20, no. 17, pp. 3185-95, 2004.
14. A. Alon, N. Barkai, D. A. Notterman, K. Gish, S. Ybarra, D. Mack, and A. J. Levine, "Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays," Proc. Natl. Acad. Sci. USA, 1999.
15. I. Hedenfalk, D. Duggan, Y. Chen, M. Radmacher, M. Bittner, R. Simon, P. Meltzer, B. Gutsterson, M. Esteller, M. Raffeld, Z. Yakhini, A. Ben-Dor, E. Dougherty, J. Kononen, L. Bubendorf, W. Fehrle, S. Pittaluga, S. Gruvberger, N. Loman, O. Johannsson, H. Olsson, B. Wilfond, G. Sauter, O.-P. Kallioniemi, A. Borg, and J. Trent, "Gene-expression profiles in hereditary breast cancer," The New England Journal of Medicine, vol. 344, pp. 539-548, 2001.
16. M.R. Osborne, B. Presnell, and B.A. Turlach, "A new approach to variable selection in least squares problems," IMA Journal of Numerical Analysis, vol. 20, no. 3, pp. 389-403, 2000.
17. F. Sha, L.K. Saul, and D.D. Lee, "Multiplicative updates for nonnegative quadratic programming in support vector machines," in Advances in Neural Information Processing Systems 15, 2002.
18. I. Drori and D.L. Donoho, "Solution of 11 minimization problems by lars/homotopy methods," in IEEE International Conference on Acoustics, Speech, and Signal Processing, 2006.
19. H. Zou and T. Hastie, "Regularization and variable selection via the elastic net," J. R. Statist. Soc. B, vol. 67, no. 2, pp. 301-320, 2005.
20. R. Tibshirani and M.A. Saunders, "Sparsity and smoothness via the fused lasso," J. R. Statist. Soc. B, vol. 67, no. 1, pp. 91-108, 2005.
21. S. Zhang, W. Wang, J. Ford, and F. Makedon, "Learning from incomplete ratings using non-negative matrix factorization," 6th SIAM Conference on Data Mining (SDM), 2006.