Multiplicative updates for L1-regularized linear and logistic regression

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4723 LNCS, Issue , 2007, Pages 13-24

  Sha, Fei ^a   Park, Y Albert ^b   Saul, Lawrence K ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; FACTORIZATION; MATRIX ALGEBRA; PROBLEM SOLVING; QUADRATIC PROGRAMMING;

LARGE-SCALE PROBLEMS; LEAST SQUARES APPROACH; LOGISTIC REGRESSION;

LEARNING SYSTEMS;

EID: 38049010389     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-74825-0_2     Document Type: Conference Paper

References (17)

1. Boyd, S.P., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)
2. Diego, J.M., Tegmark, M., Protopapas, P., Sandvik, H.B.: Combined reconstruction of weak and strong lensing data with WSLAP (2007), doi:10.1111/j.1365-2966.2007.11380.x
3. Efron, B., Hastie, T., Johnstone, I., Tibshirani, R.: Least angle regression. Annals of Statistics 32(2), 407-499 (2004)
4. Jaakkola, T., Jordan, M.I.: Bayesian parameter estimation via variational methods. Statistics and Computing 10, 25-37 (2000)
5. Kivinen, J., Warmuth, M.: Exponentiated gradient versus gradient descent for linear predictors. Information and Computation 132(1), 1-63 (1997)
6. 1-regularized logistic regression. JMLR 8, 1519-1555 (2007)
7. Krishnapuram, B., Carin, L., Figueiredo, M., Hartemink, A.: Sparse multinomial logistic regression: fast algorithms and generalization bounds. IEEE Transactions on Pattern Analysis and Intelligence 27(6), 957-968 (2005)
8. Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: Leen, T.K., Dietterich, T.G., Tresp, V. (eds.) Advances in Neural Information Processing Systems, vol. 13, pp. 556-562. MIT Press, Cambridge, MA (2001)
9. 1 regularized logistic regression. In: Proceedings of the Twenty First National Conference on Artificial Intelligence, Boston, MA (2006)
10. 1-norm sparse learning. In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP-06), Toulouse, France, vol. V, pp. 605-608 (2006)
11. McCallum, A.K.: Bow: a toolkit for statistical language modeling, text retrieval, classification and clustering (1996), http://www.cs.cmu.edu/ ~mccallum/bow
12. 2 regularization, and rotational invariance. In: Proceedings of the Twenty First International Conference on Machine Learning (ICML-04), Banff, Canada, pp. 78-85 (2004)
13. Sha, F., Lin, Y., Saul, L.K., Lee, D.D.: Multiplicative updates for nonnegative quadratic programming. Neural Computation 19, 2004-2031 (2007)
14. Sha, F., Saul, L.K., Lee, D.D.: Multiplicative updates for large margin classifiers. In: Proceedings of the Sixteenth Annual Conference on Computational Learning Theory (COLT-03), Washington D.C., pp. 188-202 (2003)
15. Tibshirani, R.: Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society B 58(1), 267-288 (1996)
16. Vapnik, V.: Statistical Learning Theory. Wiley, N.Y. (1998)
17. Wright, S.J.: Primal-Dual Interior Point Methods. SIAM, Philadelphia, PA (1997)