Large-scale sparse logistic regression

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2009, Pages 547-555

  Liu, Jun ^a   Chen, Jianhui ^a   Ye, Jieping ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Adaptive line search; L1 ball constraint; Logistic regression; Nesterov's method; Sparse learning

Indexed keywords

ADAPTIVE LINE SEARCH; L1-BALL CONSTRAINT; LOGISTIC REGRESSION; NESTEROV'S METHOD; SPARSE LEARNING;

BIOINFORMATICS; COMPUTER AIDED DIAGNOSIS; COMPUTER VISION; CONVEX OPTIMIZATION; LOGISTICS; PROBLEM SOLVING; REGRESSION ANALYSIS;

CONSTRAINED OPTIMIZATION;

EID: 70350663114     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1557019.1557082     Document Type: Conference Paper

References (35)

1. U. Alon, N. Barkai, D. A. Notterman, K. Gish, S.Ybarra, D.Mack, and A. J. Levine. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Cell Biology, 96:6745-6750, 1999.
2. M. P. Asgary, S. Jahandideh, P. Abdolmaleki, and A. Kazemnejad. Analysis and identification of β-turn types using multinomial logistic regression and artificial neural network. Bioinformatics, 23(23):3125-3130, 2007.
3. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, 2004.
4. J. R. Brzezinski. Logistic regression modeling for context-based classification. In DEXA '99: Proceedings of the 10th International Workshop on Database & Expert Systems Applications, pages 755-759, 1999.
5. M. Chang, W. Yih, and C. Meek. A logistic regression model for detecting prominences. In ACM SIGKDD International conference on Knowledge Discovery and Data mining, 1996.
6. J. Duchi, S. Shalev-Shwartz, Y. Singer, and C. Tushar. Efficient projection onto the l1-ball for learning in high dimensions. In International Conference on Machine Learning, 2008.
7. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani. Least angle regression. Annals of Statistics, 32(2):407-499, 2004.
8. S. Eyheramendy, E. Genkin, W. Ju, D.D. Lewis, and D. Madigan. Sparse bayesian classifiers for text categorization. Technical report.
9. J. Friedman, T. Hastie, and R. Tibshirani. Additive logistic regression: a statistical view of boosting. Annals of Statistics, 28:337-407, 2000.
10. J. Friedman, T. Hastie, and R. Tibshirani. Regularized paths for generalized linear models via coordinate descent. Technical report, Department of Statistics, Stanford University, 2008.
11. W. Fu. Penalized regressions: the bridge versus the lasso. Journal of Computational and Graphical Statistics, 7:397-416, 1998.
12. T. R. Golub, D. K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J. P. Mesirov, H. Coller, M. L. Loh, J. R. Downing, M. A. Caligiuri, C. D. Bloomfield, and E. S. Lander. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science, 286:531-537, 1999.
13. E.T. Hale, W. Yin, and Y. Zhang. A fixed-point continuation method for l1-regularized minimization with applications to compressed sensing. Technical report, CAAM TR07-07, 2007.
14. D. Jurafsky and J. H. Martin. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition. Prentice Hall, 2000.
15. S. S. Keerthi, K. B. Duan, S. K. Shevade, and A. N. Poo. A fast dual algorithm for kernel logistic regression. Machine Learning,61:151-165, 2005.
16. K. Koh, S. Kim, and S. Boyd. An interior-point method for large-scale l1-regularized logistic regression. Journal of Machine Learning Research, 8:1519-1555, 2007.
17. B. Krishnapuram and A. Hartemink. Sparse multinomial logistic regression: fast algorithms and generalization bounds. IEEE Trans. Pattern Analysis and Machine Intelligence, 27(6):957-968, 2005.
18. S. Lee, H. Lee, P. Abbeel, and A. Y. Ng. Efficient l1 regularized logistic regression. In The Twenty-first National Conference on Artificial Intelligence, 2006.
19. D. D. Lewis, Y. Yang, T. G. Rose, and F. Li. Rcv1: A new benchmark collection for text categorization research. Journal of Machine Learning Research, 5:361-397, 2004.
20. J. G. Liao and K. Chin. Logistic regression for disease classification using microarray data. Bioinformatics, 23(15):1945-1951, 2007.
21. J. Liu and J. Ye. Efficient euclidean projections in linear time. In International Conference on Machine Learning, 2009.
22. A. Maghbouleh. A logistic regression model for detecting prominences. In The Fourth International Conference on Spoken Language, 1996.
23. T. P. Minka. A comparison of numerical optimizers for logistic regression. Technical report, 2007.
24. A. Nemirovski. Efficient methods in convex programming. Lecture Notes, 1994.
25. Y. Nesterov. Introductory Lectures on Convex Optimization: A Basic Course. Kluwer Academic Publishers, 2003.
26. A.Y. Ng. Feature selection, l1 vs. l2 regularization, and rotational invariance. In International Conference on Machine Learning, 2004.
27. M.Y. Park and T. Hastie. l1 regularized path algorithm for generalized linear models. Journal of the Royal Statistical Society: Series B, 69:659-677, 2007.
28. S. Perkins, K. Lacker, and J. Theiler. Grafting: fast, incremental feature selection by gradient descent in function space. Journal of Machine Learning Research, 3:1333-1356, 2003.
29. M. A. Sartor, G. D. Leikauf, and M. Medvedovic. Lrpath: A logistic regression approach for identifying enriched biological groups in gene expression data. Bioinformatics, 25(2):211-217, 2008.
30. M. Schmidt, G. Fung, and R. Rosales. Fast optimization methods for l1 regularization: A comparative study and two new approaches. In The Eighteenth European Conference on Machine Learning, pages 286-297, 2007.
31. S. K. Shevade and S. S. Keerthi. A simple and efficient algorithm for gene selection using sparse logistic regression. Bioinformatics, 19(17):2246-2253, 2003.
32. J. Shi, W. Yin, S. Osher, and P. Sajda. A fast algorithm for large scale l1-regularized logistic regression. Technical report, CAAM TR08-07, 2008.
33. M. West, C. Blanchette, H. Dressman, E. Huang, S. Ishida, R. Spang, H. Zuzan, J. A. Olso, J. R. Marks, and J. R. Nevins. Predicting the clinical status of human breast cancer by using gene expression profiles. National Academy of Sciences, 98(20):11462-11467, 2001.
34. J. Zhu and T. Hastie. Kernel logistic regression and the import vector machine. Journal of Computational and Graphical Statistics, 14(1):1081-1088, 2001.
35. J. Zhu and T. Hastie. Classification of gene microarrays by penalized logistic regression. Biostatistics, 5(3):427-443, 2004.