Generalized SMO algorithm for SVM-based multitask learning

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 6, 2012, Pages 997-1003

  Cai, Feng ^a   Cherkassky, Vladimir ^a  

^a University of Minnesota   (United States)

Author keywords

Classification; learning with structured data; multitask learning; quadratic optimization; sequential minimal optimization; support vector machine (SVM); SVM+

Indexed keywords

MULTITASK LEARNING; QUADRATIC OPTIMIZATION; SEQUENTIAL MINIMAL OPTIMIZATION; STRUCTURED DATA; SVM;

CLASSIFICATION (OF INFORMATION); LEARNING ALGORITHMS; LINEARIZATION; OPTIMIZATION; QUADRATIC PROGRAMMING;

SUPPORT VECTOR MACHINES;

EID: 84875912085     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2187307     Document Type: Article

References (21)

1. B. Bakker and T. Heskes, "Task clustering and gating for Bayesian multitask learning," J. Mach. Learn. Res., vol. 4, pp. 83-89, Dec. 2003.
2. R. Ando and T. Zhang, "A framework for learning predictive structures from multiple tasks and unlabeled data," J. Mach. Learn. Res., vol. 6, pp. 1817-1853, Dec. 2005.
3. X. Liao and L. Carin, "Radial basis function network for multi-task learning," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2005, pp. 795-802.
4. R. Raina, A. Y. Ng, and D. Koller, "Constructing informative priors using transfer learning," in Proc. Int. Conf. Mach. Learn., Pittsburgh, PA, Jun. 2006, pp. 713-720.
5. N. D. Lawrence and J. Platt, "Learning to learn with the informative vector machine," in Proc. Int. Conf. Mach. Learn., Alberta, BC, Canada, 2004, pp. 1-65.
6. A. Argyriou, T. Evgeniou, and M. Pontil, "Multi-task feature learning," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2006, pp. 41-48.
7. G. Obozinski, B. Taskar, and M. Jordan, "Multi-task feature selection," in Proc. Int. Conf. Mach. Learn. Workshop Struct. Knowl. Transfer Mach. Learn., Pittsburgh, PA, Jun. 2006.
8. Y. Amit, M. Fink, N. Srebro, and S. Ullman, "Uncovering shared structures in multiclass classification," in Proc. Int. Conf. Mach. Learn., Corvallis, OR, Jun. 2007, pp. 17-24.
9. L. Liang and V. Cherkassky, "Connection between SVM+ and multitask learning," in Proc. IEEE Int. Joint Conf. Neural Netw., Hong Kong, Jun. 2008, pp. 2048-2054.
10. L. Liang, F. Cai, and V. Cherkassky, "Predictive learning with structured (grouped) data," Neural Netw., vol. 22, nos. 5-6, pp. 766-773, 2009.
11. T. Evgeniou and M. Pontil, "Regularized multi-task learning," in Proc. 10th Conf. Knowl. Disc. Data Mining, Seattle, WA, Aug. 2004, pp. 109-117.
12. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, Sep. 1995.
13. V. N. Vapnik, Empirical Inference Science Afterword of 2006. New York: Springer-Verlag, 2006.
14. I. W. Tsang, J. T. Kwok, and P. Cheung, "Core vector machines: Fast SVM training on very large data sets," J. Mach. Learn. Res., vol. 6, pp. 363-392, Apr. 2005.
15. J. Platt, "Sequential minimal optimization: A fast algorithm for training support vector machines," Microsoft Research, Seattle, WA, Tech. Rep. MSR-TR-98-14, 1998.
16. S. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy, "Improvements to Platt's SMO algorithm for SVM classifier design," Dept. Mech. Prod. Eng., National Univ. Singapore, Singapore, Tech. Rep.- CD-99-14, 1999.
17. R.-E. Fan, P.-H. Chen, and C.-J. Lin, "Working set selection using second order information for training SVM," J. Mach. Learn. Res., vol. 6, pp. 243-264, Nov. 2005.
18. D. Pechyony, R. Izmailov, A. Vashist, and V. N. Vapnik, "SMO-style algorithms for learning using privileged information," in Proc. Int. Conf. Data Mining, Las Vegas, NV, Jul. 2010, pp. 1-7.
19. M. Grant and S. Boyd. (2010, Dec.). CVX: MATLAB Software for Disciplined Convex Programming, Version 1.21 [Online]. Available: http://cvxr.com/cvx
20. J. Platt, "Using sparseness and analytic QP to speed training of support vector machines," in Advances in Neural Information Processing Systems, vol. 11. Cambridge, MA: MIT Press, 1999.
21. Y. Xue, X. Liao, L. Carin, and B. Krishnapuram, "Multi-task learning for classification with Dirichlet process priors," J. Mach. Learn. Res., vol. 8, pp. 35-63, Jan. 2007.