An efficient algorithm for weak hierarchical Lasso

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2014, Pages 283-292

  Liu, Yashu ^a   Wang, Jie ^a   Ye, Jieping ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

non convex; proximal operator; sparse learning; weak hierarchical lasso

Indexed keywords

EID: 84907029325     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2623330.2623665     Document Type: Conference Paper

References (32)

1. A. Beck and M. Teboulle. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1):183-202, 2009.
2. J. Bien, J. Taylor, and R. Tibshirani. A lasso for hierarchical interactions. The Annals of Statistics, 41(3):1111-1141, 2013.
3. J. Bien and R. Tibshirani. hierNet: A Lasso for Hierarchical Interactions, 2013. R package version 1.5.
4. R. J. Cadoret, W. R. Yates, G. Woodworth, M. A. Stewart, et al. Genetic-environmental interaction in the genesis of aggressivity and conduct disorders. Archives of General Psychiatry, 52(11):916, 1995.
5. E. J. Candes and J. Romberg. Quantitative robust uncertainty principles and optimally sparse decompositions. Foundations of Computational Mathematics, 6(2):227-254, 2006.
6. N. H. Choi, W. Li, and J. Zhu. Variable selection with the strong heredity constraint and its oracle property. Journal of the American Statistical Association, 105(489):354-364, 2010.
7. A. d'Aspremont, L. El Ghaoui, M. I. Jordan, and G. R. Lanckriet. A direct formulation for sparse pca using semidefinite programming. In NIPS, volume 16, pages 41-48, 2004.
8. C. Davatzikos, P. Bhatt, L. M. Shaw, K. N. Batmanghelich, and J. Q. Trojanowski. Prediction of mci to ad conversion, via mri, csf biomarkers, and pattern classification. Neurobiology of aging, 32(12):2322-e19, 2011.
9. J. F. Dawson and A. W. Richter. Probing three-way interactions in moderated multiple regression: development and application of a slope diference test. Journal of Applied Psychology, 91(4):917, 2006.
10. D. Devanand, G. Pradhaban, X. Liu, A. Khandji, S. De Santi, S. Segal, H. Rusinek, G. Pelton, L. Honig, R. Mayeux, et al. Hippocampal and entorhinal atrophy in mild cognitive impairment prediction of alzheimer disease. Neurology, 68(11):828-836, 2007.
11. T. C. Eley, K. Sugden, A. Corsico, A. M. Gregory, P. Sham, P. McGuffin, R. Plomin, and I. W. Craig. Gene-environment interaction analysis of serotonin system markers with adolescent depression. Molecular psychiatry, 9(10):908-915, 2004.
12. C. Fennema-Notestine, D. J. Hagler, L. K. McEvoy, A. S. Fleisher, E. H. Wu, D. S. Karow, and A. M. Dale. Structural mri biomarkers for preclinical and mild alzheimer's disease. Human brain mapping, 30(10):3238-3253, 2009.
13. J. Gatt, C. Nemeroff, C. Dobson-Stone, R. Paul, R. Bryant, P. Schofield, E. Gordon, A. Kemp, and L. Williams. Interactions between bdnf val66met polymorphism and early life stress predict brain and arousal pathways to syndromal depression and anxiety. Molecular psychiatry, 14(7):681-695, 2009.
14. P. Gong, J. Ye, and C. Zhang. Multi-stage multi-task feature learning. In NIPS, pages 1997-2005, 2012.
15. P. Gong, C. Zhang, Z. Lu, J. Huang, and J. Ye. A general iterative shrinkage and thresholding algorithm for non-convex regularized optimization problems. In ICML, 2013.
16. P. Gong, C. Zhang, Z. Lu, J. Huang, and J. Ye. GIST: General Iterative Shrinkage and Thresholding for Non-convex Sparse Learning. Tsinghua University, 2013.
17. T. Hastie, R. Tibshirani, J. Friedman, T. Hastie, J. Friedman, and R. Tibshirani. The elements of statistical learning, volume 2. Springer, 2009.
18. K. Koh, S.-J. Kim, and S. Boyd. An interior-point method for large-scale 1-regularized logistic regression. Journal of Machine learning research, 8(7), 2007.
19. H. Li, Y. Liu, P. Gong, C. Zhang, J. Ye, A. D. N. Initiative, et al. Hierarchical interactions model for predicting mild cognitive impairment (mci) to alzheimer's disease (ad) conversion. PloS one, 9(1):e82450, 2014.
20. Y. Liu, Z. Nie, J. Zhou, M. Farnum, V. A. Narayan, G. Wittenberg, and J. Ye. Sparse generalized functional linear model for predicting remission status of depression patients. In Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing, volume 19, pages 364-375. World Scientific, 2013.
21. D. A. Llano, G. Laforet, and V. Devanarayan. Derivation of a new adas-cog composite using tree-based multivariate analysis: prediction of conversion from mild cognitive impairment to alzheimer disease. Alzheimer Disease & Associated Disorders, 25(1):73-84, 2011.
22. D. C. Montgomery, E. A. Peck, and G. G. Vining. Introduction to linear regression analysis, volume 821. Wiley, 2012.
23. N. Parikh and S. Boyd. Proximal algorithms. Foundations and Trends in optimization, 1(3):123-231, 2013.
24. R. C. Petersen. Mild cognitive impairment clinical trials. Nature Reviews Drug Discovery, 2(8):646-653, 2003.
25. P. Radchenko and G. M. James. Variable selection using adaptive nonlinear interaction structures in high dimensions. Journal of the American Statistical Association, 105(492):1541-1553, 2010.
26. M. J. Somers. Organizational commitment, turnover and absenteeism: An examination of direct and interaction effects. Journal of Organizational Behavior, 16(1):49-58, 1995.
27. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), pages 267-288, 1996.
28. J. Ye, M. Farnum, E. Yang, R. Verbeeck, V. Lobanov, N. Raghavan, G. Novak, A. DiBernardo, V. A. Narayan, et al. Sparse learning and stability selection for predicting mci to ad conversion using baseline adni data. BMC neurology, 12(1):46, 2012.
29. M. Yuan, V. R. Joseph, and H. Zou. Structured variable selection and estimation. The Annals of Applied Statistics, pages 1738-1757, 2009.
30. P. Zhao, G. Rocha, and B. Yu. The composite absolute penalties family for grouped and hierarchical variable selection. The Annals of Statistics, 37(6A):3468-3497, 12 2009.
31. J. Zhou, J. Liu, V. A. Narayan, and J. Ye. Modeling disease progression via multi-task learning. NeuroImage, 78:233-248, 2013.
32. H. Zou, T. Hastie, and R. Tibshirani. Sparse principal component analysis. Journal of computational and graphical statistics, 15(2):265-286, 2006.