Robust multi-task feature learning

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2012, Pages 895-903

  Gong, Pinghua ^a   Ye, Jieping ^b   Zhang, Changshui ^a  

^a TSINGHUA UNIVERSITY   (China)

^b ARIZONA STATE UNIVERSITY   (United States)

Author keywords

feature selection; multi task learning; outlier tasks detection

Indexed keywords

EMPIRICAL STUDIES; FEATURE LEARNING; GRADIENT DESCENT; HIGH DIMENSIONAL DATA; MULTITASK LEARNING; NOISE LEVELS; OPTIMIZATION PROBLEMS; REAL WORLD DATA; REAL-WORLD APPLICATION; SPARSITY PATTERNS; THEORETICAL BOUNDS; THEORETICAL RESULT; TWO-COMPONENT;

DATA MINING; FEATURE EXTRACTION; LEARNING ALGORITHMS;

STATISTICS;

EID: 84866007553     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2339530.2339672     Document Type: Conference Paper

References (44)

1. R. Ando and T. Zhang. A framework for learning predictive structures from multiple tasks and unlabeled data. JMLR, 6:1817-1853, 2005.
2. A. Argyriou, T. Evgeniou, and M. Pontil. Convex multi-task feature learning. Machine Learning, 73(3):243-272, 2008.
3. F. Bach, R. Jenatton, J. Mairal, and G. Obozinski. Optimization with sparsity-inducing penalties. Arxiv preprint arXiv:1108.0775, 2011.
4. B. Bakker and T. Heskes. Task clustering and gating for bayesian multitask learning. JMLR, 4:83-99, 2003.
5. J. Baxter. A model of inductive bias learning. Journal of Artificial Intelligence Research, 12:149-198, 2000.
6. A. Beck and M. Teboulle. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1):183-202, 2009.
7. P. Bickel, Y. Ritov, and A. Tsybakov. Simultaneous analysis of lasso and dantzig selector. The Annals of Statistics, 37(4):1705-1732, 2009.
8. R. Caruana. Multitask learning. Machine Learning, 28(1):41-75, 1997.
9. J. Chen, J. Liu, and J. Ye. Learning incoherent sparse and low-rank patterns from multiple tasks. In SIGKDD, pages 1179-1188, 2010.
10. J. Chen, J. Zhou, and J. Ye. Integrating low-rank and group-sparse structures for robust multi-task learning. In SIGKDD, pages 42-50, 2011.
11. T. Evgeniou and M. Pontil. Regularized multi-task learning. In SIGKDD, pages 109-117, 2004.
12. P. Gong, K. Gai, and C. Zhang. Efficient euclidean projections via piecewise root finding and its application in gradient projection. Neurocomputing, pages 2754-2766, 2011.
13. R. Horn and C. Johnson. Matrix analysis. Cambridge University Press, 1990.
14. L. Jacob, F. Bach, and J. Vert. Clustered multi-task learning: A convex formulation. NIPS, 2008.
15. A. Jalali, P. Ravikumar, S. Sanghavi, and C. Ruan. A dirty model for multi-task learning. NIPS, 2010.
16. Z. Kang, K. Grauman, and F. Sha. Learning with whom to share in multi-task feature learning. In ICML, 2011.
17. S. Kim and E. Xing. Tree-guided group lasso for multi-task regression with structured sparsity. In ICML, 2009.
18. N. Lawrence and J. Platt. Learning to learn with the informative vector machine. In ICML, 2004.
19. 2,1-norm minimization. In UAI, pages 339-348, 2009.
20. J. Liu, S. Ji, and J. Ye. Slep: Sparse learning with efficient projections. Arizona State University, 2009.
21. J. Liu, L. Yuan, and J. Ye. An efficient algorithm for a class of fused lasso problems. In SIGKDD, pages 323-332, 2010.
22. K. Lounici, M. Pontil, A. Tsybakov, and S. Van De Geer. Taking advantage of sparsity in multi-task learning. In COLT, 2009.
23. 1,∞- regularization. NIPS, 21, 2008.
24. S. Negahban and M. Wainwright. Estimation of (near) low-rank matrices with noise and high-dimensional scaling. The Annals of Statistics, 39(2):1069-1097, 2011.
25. Y. Nesterov. Introductory lectures on convex optimization: A basic course. Springer Netherlands, 2004.
26. Y. Nesterov. Gradient methods for minimizing composite objective function. Center for Operations Research and Econometrics (CORE), Catholic University of Louvain, Tech. Rep, 76, 2007.
27. G. Obozinski, B. Taskar, and M. Jordan. Multi-task feature selection. Statistics Department, UC Berkeley, Tech. Rep, 2006.
28. S. Parameswaran and K. Weinberger. Large margin multi-task metric learning. NIPS, 23:1867-1875, 2010.
29. T. Pong, P. Tseng, S. Ji, and J. Ye. Trace norm regularization: Reformulations, algorithms, and multi-task learning. SIAM Journal on Optimization, 20(6):3465-3489, 2010.
30. N. Quadrianto, A. Smola, T. Caetano, S. Vishwanathan, and J. Petterson. Multitask learning without label correspondences. NIPS, 2010.
31. A. Schwaighofer, V. Tresp, and K. Yu. Learning gaussian process kernels via hierarchical bayes. NIPS, 17:1209-1216, 2005.
32. S. Thrun and J. O'Sullivan. Discovering structure in multiple learning tasks: The tc algorithm. In ICML, pages 489-497, 1996.
33. D. Wallace. Bounds on normal approximations to student's and the chi-square distributions. The Annals of Mathematical Statistics, pages 1121-1130, 1959.
34. Y. Xue, X. Liao, L. Carin, and B. Krishnapuram. Multi-task learning for classification with dirichlet process priors. JMLR, 8:35-63, 2007.
35. X. Yang, S. Kim, and E. Xing. Heterogeneous multitask learning with joint sparsity constraints. NIPS, 23, 2009.
36. K. Yu, V. Tresp, and A. Schwaighofer. Learning gaussian processes from multiple tasks. In ICML, pages 1012-1019, 2005.
37. L. Yuan, J. Liu, and J. Ye. Efficient methods for overlapping group lasso. NIPS, 2011.
38. J. Zhang, Z. Ghahramani, and Y. Yang. Learning multiple related tasks using latent independent component analysis. NIPS, 18:1585-1592, 2006.
39. Y. Zhang and D. Yeung. Multi-task learning using generalized t process. In AISTATS, 2010.
40. Y. Zhang and D. Yeung. Transfer metric learning by learning task relationships. In SIGKDD, pages 1199-1208, 2010.
41. Y. Zhang, D. Yeung, and Q. Xu. Probabilistic multi-task feature selection. NIPS, 2010.
42. J. Zhou, J. Chen, and J. Ye. Clustered multi-task learning via alternating structure optimization. NIPS, 2011.
43. J. Zhou, J. Chen, and J. Ye. MALSAR: Multi-tAsk Learning via StructurAl Regularization. Arizona State University, 2012.
44. J. Zhou, L. Yuan, J. Liu, and J. Ye. A multi-task learning formulation for predicting disease progression. In SIGKDD, pages 814-822, 2011.