Learning Interactions via Hierarchical Group-Lasso Regularization

Journal of Computational and Graphical Statistics

Volumn 24, Issue 3, 2015, Pages 627-654

  Lim, Michael ^a   Hastie, Trevor ^b  

^a Stanford University ^*  (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Computer intensive; Logistic; Regression

Indexed keywords

EID: 84941778442     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.2014.938812     Document Type: Article

References (21)

1. F.Bach, (2008), “Exploring Large Feature Spaces With Hierarchical Multiple Kernel Learning,” in Advances in Neural Information Processing Systems (number 21), eds. D.Koller, D.Schuurmans, Y.Bengio, and L.Bottou, Cambridge, MA: MIT Press, pp. 105–112.
2. A.Beck,, and M.Teboulle, (2009), “A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems,” SIAM Journal on Imaging Sciences, 2, 183–202.
3. S.R.Becker,, E.J.Candes,, and M.C.Grant, (2011), “Templates for Convex Cone Problems With Applications to Sparse Signal Recovery,” Mathematical Programming Computation, 3, 165–218.
4. J.Bien,, J.Taylor,, and R.Tibshirani, (2013), “A Lasso for Hierarchical Interactions,” The Annals of Statistics, 41, 1111–1141.
5. C.Chen,, H.Schwender,, J.Keith,, R.Nunkesser,, K.Mengersen,, and P.Macrossan, (2011), “Methods for Identifying snp Interactions: A Review on Variations of Logic Regression, Random Forest and Bayesian Logistic Regression,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, 8, 1580–1591.
6. Y.Freund,, and R.E.Schapire, (1995), “A Decision-Theoretic Generalization of on-Line Learning and an Application to Boosting,” in Proceedings of the Second European Conference on Computational Learning Theory, EuroCOLT ’95, London, UK: Springer-Verlag, pp. 23–37.
7. J.H.Friedman, (2001), “Greedy Function Approximation: A Gradient Boosting Machine,” The Annals of Statistics, 29, 1189–1232.
8. L.Jacob,, G.Obozinski,, and J.-P.Vert, (2009), “Group Lasso With Overlap and Graph Lasso,” in Proceedings of the 26th Annual International Conference on Machine Learning, ICML ’09, New York, NY: ACM, pp. 433–440.
9. Y.Koren, (2009), “Collaborative Filtering With Temporal Dynamics,” in Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’09), pp. 447–456.
10. M.Miller,, G.Lind,, N.Li,, and S.-Y.Jang, (2007), “Genetic Analysis Workshop 15: Simulation of a Complex Genetic Model for Rheumatoid Arthritis in Nuclear Families Including a Dense snp Map With Linkage Disequilibrium Between Marker Loci and Trait Loci,” BMC Proceedings, 1–7, S4.
11. B.O’Donoghue,, and E.Candes, (2012), “Adaptive Restart for Accelerated Gradient Schemes,” Foundations of Computational Mathematics.
12. P.Radchenko,, and G.James, (2010), “Variable Selection Using Adaptive Non-Linear Interaction Structures in High Dimensions,” Journal of the American Statistical Association, 105, 1541–1553.
13. L.Rosasco,, M.Santoro,, S.Mosci,, A.Verri,, and S.Villa, (2010), “A Regularization Approach to Nonlinear Variable Selection,” in AISTATS 2010 Proceedings (Vol. 9 of Journal of Machine Learning Research), pp. 653–660.
14. I.Ruczinski,, C.Kooperberg,, and M.LeBlanc, (2003), “Logic Regression,” Journal of Computational and Graphical Statistics, 12, 475–511.
15. L.Scheffé, (1959), The Analysis of Variance, New York: Wiley.
16. H.Schwender,, and K.Ickstadt, (2008), “Identification of snp Interactions Using Logic Regression,” Biostatistics, 9, 187–198.
17. N.Simon,, J.Friedman,, T.Hastie,, and R.Tibshirani, (2013), “A Sparse-Group Lasso,” Journal of Computational and Graphical Statistics, 22, 231–245.
18. R.Tibshirani, (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
19. R.Tibshirani,, J.Bien,, J.Friedman,, T.Hastie,, N.Simon,, J.Taylor,, and R.J.Tibshirani, (2012), “Strong Rules for Discarding Predictors in Lasso-Type Problems,” Journal of the Royal Statistical Society, Series B,
20. M.Yuan,, and Y.Lin, (2006), “Model Selection and Estimation in Regression With Grouped Variables,” Journal of the Royal Statistical Society, Series B, 68, 49–67.
21. P.Zhao,, G.Rocha,, and B.Yu, (2009), “Grouped and Hierarchical Model Selection Through Composite Absolute Penalties,” The Annals of Statistics, 37, 3468–3497.