Adaptive multi-task sparse learning with an application to fMRI study

Proceedings of the 12th SIAM International Conference on Data Mining, SDM 2012

Volumn , Issue , 2012, Pages 212-223

  Chen, Xi ^a   He, Jinghui ^b   Lawrence, Rick ^b   Carbonell, Jaime G ^a  

^a Carnegie Mellon University ^*  (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA MINING; SAMPLING; SEMANTICS;

ASYMPTOTIC PROPERTIES; COGNITIVE SCIENCE; FINITE SAMPLE PERFORMANCE; LEARNING METHODS; LEARNING PROBLEM; MODEL ESTIMATION; ORACLE PROPERTIES; VARIABLE SELECTION;

LEARNING SYSTEMS;

EID: 84875095701     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972825.19     Document Type: Conference Paper

References (29)

1. R. K. Ando and T. Zhang. A framework for learning predictive structures from multiple tasks and unlabeled data. Journal of Machine Learning Research, 6:1817- 1853, 2005.
2. A. Argyriou, T. Evgeniou, and M. Pontil. Convex multi-task feature learning. Machine Learning, 73(3):243-273, 2008.
3. F. Bach. Consistency of the group lasso and multiple kernel learning. Journal of Machine Learning Re- search, 1179-1225:2008, 9.
4. A. Beck and M. Teboulle. A fast iterative shrinkage thresholding algorithm for linear inverse problems. SIAM Journal of Image Science, 2(1):183-202, 2009.
5. R. Caruana. Multitask learning. Machine Learning Journal, 28:41-75, 1997.
6. J. Duchi and Y. Singer. Efficient online and batch learning using forward backward splitting. Journal of Machine Learning Research, 10:2899-2934, 2009.
7. T. Evgeniou and M. Pontil. Regularized multitask learning. In ACM SIGKDD, 2004.
8. J. Fan and R. Li. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96:1348-1360, 2001.
9. J. Fan and R. Li. Statistical challenges with high dimensionality: Feature selection in knowledge discovery. In Proceedings of the Madrid International Congress of Mathematicians, 2006.
10. S. Lee, J. Zhu, and E. P. Xing. Adatpive multitask lasso: with applications to eqtl detection. In Advances in Neural Information Processing Systems (NIPS), 2010.
11. H. Liu, M. Palatucci, and J. Zhang. Blockwise coordinate descent procedures for the multi-task lasso, with applications to neural semantic basis discovery. In Inernational Conference on Machine Learning, 2009.
12. J. Liu, S. Ji, and J. Ye. Multi-task feature learning via efficient ℓ2;1-norm minimization. In Conference on Uncertainty in Artiffcial Intelligence (UAI), 2009.
13. K. Lounici, A. B. Tsybakov, M. Pontil, and S. A. V. D. Geer. Taking advantage of sparsity in multi-task learning. In Conference on Learning Theory (COLT), 2009.
14. T. M. Mitchell, S. V. Shinkareva, A. Carlson, K.-M. Chang, V. L. Malave, R. A. Mason, and M. A. Just. Predicting human brain activity associated with the meanings of nouns. Science, 320:1191, 2008.
15. Y. Nardi and A. Rinaldo. On the asymptotic properties of the group lasso estimator for linear models. Electronic Journal of Statistics, 2:605-633, 2008.
16. S. Negahban and M. J. Wainwright. Simultaneous support recovery in high dimensions: Benefits and perils of block ℓ1/ℓ1-regularization. IEEE Transactions on Information Theory, 57 (6):3841-3863, 2011.
17. Y. Nesterov. Gradient methods for minimizing composite objective function. Technical report, Universit catholique de Louvain, Center for Operations Research and Econometrics (CORE), 2007.
18. G. Obozinski, B. Taskar, and M. I. Jordan. Highdimensional union support recovery in multivariate regression. In Advances in Neural Information Process- ing Systems (NIPS). MIT Press, 2008.
19. G. Obozinski, B. Taskar, and M. I. Jordan. Joint covariate selection and joint subspace selection for multiple classification problems. Statistics and Computing, 20:231-252, 2010.
20. M. Palatucci, D. Pomerleau, G. Hinton, and T. Mitchell. Zero-shot learning with semantic output codes. In Advances in Neural Information Processing Systems (NIPS), 2009.
21. A. Quattoni, M. Collins, and D. Trevor. Transfer learning for image classification with sparse prototype representations. In IEEE Conference on Computer Vision and Pattern Recognition, 2008.
22. R. Rockafellar. Convex Analysis. Princeton Univ. Press, 1996.
23. S. Thrum and L. Pratt. Learning to Learn. Kluwer Academic Publishers, 1998.
24. H. Wang and C. Leng. A note on adaptive group lasso. Computational Statistics and Data Analysis, 52:5277- 5286, 2008.
25. K. Yu, V. Tresp, and A. Schwaighofer. Learning gaussian processes from multiple tasks. In International Conference on Machine Learning (ICML), 2005.
26. M. Yuan and Y. Lin. Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society: Series B, 68:49-67, 2006.
27. H. Zou. The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101(476):1418-1429, 2006.
28. H. Zou and T. Hastie. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B, 67(2):301-320, 2005.
29. H. Zou and H. Zhang. On the adaptive elastic-net with a diverging number of parameters. Annals of Statistics, 37(4):1733-1751, 2009.