Parallel large scale feature selection for logistic regression

Society for Industrial and Applied Mathematics - 9th SIAM International Conference on Data Mining 2009, Proceedings in Applied Mathematics

Volumn 3, Issue , 2009, Pages 1165-1176

  Singh, Sameer ^a   Kubica, Jeremy ^b   Larsen, Scott ^b   Sorokina, Daria ^c  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

^b GOOGLE INC   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE OPTIMIZATION; BACKFITTING; FEATURE EVALUATION; FEATURE SELECTION; LOGISTIC REGRESSION MODELS; LOGISTIC REGRESSIONS; PARALLELIZING; POTENTIAL FEATURES; VERY LARGE DATUM;

LOGISTICS;

REGRESSION ANALYSIS;

EID: 73449122656     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. S. Abe. Modified backward feature selection by cross validation. In 13th European Symposium On Artificial Neural Networks, 2005.
2. H. Almuallim and T. G. Dietterich. Learning with many irrelevant features. In Proceedings of the Ninth National Conference on Artificial Intelligence (AAAI-91), pages 547-552. AAAI Press, 1991.
3. A. Asuncion and D. Newman. UCI machine learning repository, 2007.
4. S. Balakrishnan and D. Madigan. Algorithms for sparse linear classifiers in the massive data setting. Journal of Machine Learning Research, 2008. to appear.
5. A. Buja, T. J. Hastie, and R. J. Tibshirani. Linear smoothers and additive models (with discussion). Annals of Statistics, 17:453-555, 1989.
6. R. Caruana, N. Karampatziakis, and A. Yessenalina. An empirical evaluation of supervised learning in high dimensions. In Proceedings of the 25th International Conference on Machine Learning, (ICML 2008), 2008.
7. M. Dash and H. Liu. Feature selection for classification. Intelligent Data Analysis - An International Journal, 1(3), 1997.
8. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In OSDI'04: Sixth Symposium on Operating System Design and Implementation, 2004.
9. S. Delia Pietra, V. Delia Pietra, and J. Lafferty. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):380-393, 1997.
10. S. Eyheramendy and D. Madigan. A novel feature selection score for text categorization. In Proceedings of the International Workshop on Feature Selection for Data Mining: Interfacing Machine Learning and Statistics, April 2005.
11. F. Fleuret. Fast binary feature selection with conditional mutual information. Journal of Machine Learning Research, 5:1531-1555, 2004.
12. J. H. Friedman and W. Stuetzle. Projection pursuit regression. Journal of the American Statistical Association, 76(376):817-823, December 1981.
13. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer, 2001.
14. G. H. John, R. Kohavi, and K. Pfleger. Irrelevant features and the subset selection problem. In Proceedings of the Eleventh International Conference on Machine Learning, (ICML 1994), pages 121-129. Morgan Kauffmann, 1994.
15. K. Kira and L. A. Rendell. The feature selection problem: Traditional methods and a new algorithm. In Proceedings of the Tenth National Conference on Artificial Intelligence (AAAI-92), pages 129-134. MIT Press, 1992.
16. P. Komarek and A. Moore. Making logistic regression a core data mining tool with tr-irls. In Proceedings of the 5th International Conference on Data Mining Machine Learning, page 4, 2005.
17. B. Krishnapuram, L. Carin, and A. J. Hartemink. Joint classifier and feature optimization for comprehensive cancer diagnosis using gene expression data. Journal of Computational Biology, 11(2-3):227-242, March 2004.
18. D. D. Lewis, Y. Yang, T. Rose, and F. Li. RCV1: A new benchmark collection for text categorization research. Journal of Machine Learning Research, 5:361-397, 2004.
19. A. McCallum. Efficiently inducing features of conditional random fields. In Conference on Uncertainty in Artificial Intelligence (UAI), 2003.
20. S. Perkins and J. Theiler. Online feature selection using grafting. In T. Fawcett and N. Mishra, editors, Machine Learning, Proceedings of the Twentieth International Conference (ICML 2003), August 21-24, 2003, Washington, DC, USA, pages 592-599. AAAI Press, 2003.
21. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, 58(1):267-288, 1996.
22. A. W. Whitney. A direct method of nonparametric measurement selection. IEEE Transactions on Computers, 20(9):1100-1103, 1971.