Output Feature Augmented Lasso

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn 2015-January, Issue January, 2014, Pages 680-686

  Zhang, Changqing ^a   Han, Yahong ^a   Guo, Xiaojie ^b   Cao, Xiaochun ^a,b  

^a TIANJIN UNIVERSITY   (China)

^b University of Chinese Academy of Sciences   (China)

Author keywords

alternating direction minimizing; Lasso; multiple output prediction; structured learning

Indexed keywords

CONSTRAINED OPTIMIZATION; FORECASTING; LAGRANGE MULTIPLIERS; MAPPING;

ALTERNATING DIRECTIONS; APPLICATION SPECIFIC; AUGMENTED LAGRANGIAN METHODS; GENERALIZATION ABILITY; LASSO; MULTIPLE OUTPUTS; NONLINEAR DEPENDENCIES; STRUCTURED LEARNING;

DATA MINING;

EID: 84936936908     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2014.103     Document Type: Conference Paper

References (37)

1. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection, " Journal of Machine Learning Research, vol. 3, pp. 1157-1182, 2003.
2. R. Tibshirani, "Regression shrinkage and selection via the lasso, " Journal of the Royal Statistical Society. Series B (Methodological), pp. 267-288, 1996.
3. A. J. Rothman, E. Levina, and J. Zhu, " Sparse multivariate regression with covariance estimation," Journal of Computational and Graphical Statistics, vol. 19, no. 4, pp. 947-962, 2010.
4. S. Kim, K.-A. Sohn, and E. P. Xing, " A multivariate regression approach to association analysis of a quantitative trait network," Bioinformatics, vol. 25, no. 12, pp. 204-212, 2009.
5. L. Breiman and J. H. Friedman, "Predicting m ultivariate responses in multiple linear regression," Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol. 59, no. 1, pp. 3-54, 1997.
6. L. Bo and C. Sminchisescu, "Structured output-Associative regression, " in CVPR, 2009.
7. M. A. Nicolaou, H. Gunes, and M. Pantic, " Output-Associative rvm regression for dimensional and continuous emotion prediction," in FG, 2011.
8. K. Balasubramanian and G. Lebanon, "The landmark selection method for multiple output prediction, " in ICML, 2012.
9. P. Zhao, G. Rocha, and B. Yu, "Grouped and hierar chical model selection through composite absolute penalties," Department of Statistics, UC Berkeley, Tech. Rep, vol. 703, 2006.
10. X. Chen, S. Kim, Q. Lin, J. G. Carbonell, and E. P. Xing, " Graphstructured multi-task regression and an efficient optimization method for general fused lasso," arXiv preprint arXiv:1005.3579, 2010.
11. S. Kim and E. P. Xing, "Tree-guided group lasso for multi-respo nse regression with structured sparsity, with an application to eqtl mapping," The Annals of Applied Statistics, vol. 6, no. 3, pp. 1095-1117, 2012.
12. V. Roth, "The generalized lasso, " IEEE Tra nsactions on Neural Networks, vol. 15, no. 1, pp. 16-28, 2004.
13. P. Ravikumar, J. Lafferty, H. Liu, and L. Wasserman, " Sparse additive models," Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol. 71, no. 5, pp. 1009-1030, 2009.
14. L. Huang, J. Jia, B. Yu, B.-G. Chun, P. Maniatis, and M. Naik, " Predicting execution time of computer programs using sparse polynomial regression," in NIPS, 2010.
15. M. Yamada,W. Jitkrittum,L. Sigal,E. P. Xing,M. Sugiyama High-dimensional feature selection by feature-wise kernelized lasso Neural Computation 26, 1, 185-207, 2014.
16. J. Bien, J. Taylor, and R. Tibshirani, "A lasso for hierarchical interactions, " The Annals of S tatistics, vol. 41, no. 3, pp. 1111-1141, 2013.
17. M. Schmidt, "Least squares optimization with l1-norm regularization, " Project Report, University of British Columbia, 2005.
18. S. K. Shevade and S. S. Keerthi, " A simple and efficient algorithm for gene selection using sparse logistic regression," Bioinformatics, vol. 19, no. 17, pp. 2246-2253, 2003.
19. Z. Lin, M. Chen, and Y. Ma, " The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices," preprint, 2010.
20. Z. Lin, A. Ganesh, J. Wright, L. Wu, M. Chen, and Y. Ma, " Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix," Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), vol. 61, 2009.
21. J.-F. Cai, E. J. Candés, and Z. Shen, " A singular value thresholding algorithm for matrix completion," SIAM Journal on Optimization, vol. 20, no. 4, pp. 1956-1982, 2010.
22. G. O bozinski, B. Taskar, and M. I. Jordan, "Multi-task feature selection, " Statistics Department, UC Berkeley, Tech. Rep, 2006.
23. C. Zhu, R. H. Byrd, P. Lu, and J. Nocedal, "Algorithm 778: L-bfgs b: Fortran subroutines for large-scale bound-constrained optimization," ACM Transactions on Mathematical Software (TOMS), vol. 23, no. 4, pp. 550-560, 1997.
24. Y. Altun, M. Belkin, and D. A. Mcallester, " Maximum margin semisupervised learning for structured variables," in NIPS, 2005.
25. A. Kulesza and F. Pereira, "Structured learning with approximate inference, " in NIPS, 2007.
26. J. R. Doppa, A. Fern, and P. Tadepalli, "Hc-search: Learning heuristics and cost functions for structured prediction, " in AAAI, 2013.
27. M. B. Blaschko and C. H. Lampert, "Learning t o localize objects with structured output regression," in ECCV, 2008.
28. C.-N. J. Yu and T. Joachims, "Learning structural svms with latent variables, " in ICML, 2009.
29. J. Nocedal and S. Wright, Numerical Optimization. New York: Springer, 2006.
30. J. Yang and Y. Zhang, "Alternating direction algorithms for-1-problems in compressive sensing, " SIAM journal on scientific computing, vol. 33, no. 1, pp. 250-278, 2011.
31. T. Zhang, " Adaptive forward-backward greedy algorithm for sparse learning with linear models," in NIPS, 2008.
32. J. J. Hull, "A database for handwritten text recognition research, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, no. 5, pp. 550-554, 1994.
33. J. Weston, O. Chapelle, A. Elisseeff, B. Schölkopf, and V. Vapnik, " Kernel dependency estimation," in NIPS, 2002.
34. H. Zou, "The adaptive lasso and its oracle properties, " Journal of the American statistical association, vol. 101, no. 476, pp. 1418-1429, 2006.
35. Y. Zhang and J. Schneider, "Maximum margin output coding, " in ICML, 2012.
36. Y. Zhang,J. Schneider Multi-label output codes using canonical correlation analysis Journal of Machine Learning Research 15, 873-882, 2011.
37. D. Hsu, S. M. Kakade, J. Langford, and T. Zhang, " Multi-label prediction via compressed sensing," in NIPS, 2009.