Multi-task learning with one-class SVM

Neurocomputing

Volumn 133, Issue , 2014, Pages 416-426

  He, Xiyan ^a   Mourot, Gilles ^a   Maquin, Didier ^a   Ragot, José ^a   Beauseroy, Pierre ^b   Smolarz, André ^b   Grall Maës, Edith ^b  

^a CENTRE DE RECHERCHE EN AUTOMATIQUE DE NANCY   (France)

^b UNIVERSITÉ DE TECHNOLOGIE DE TROYES   (France)

Author keywords

Diagnostics; Machine learning; Multi task learning; Multiple sources; One class SVM

Indexed keywords

LEARNING SYSTEMS; OPTIMIZATION; PLASMA DIAGNOSTICS;

GENERALIZATION PERFORMANCE; HIGH-DIMENSIONAL; MULTIPLE SOURCE; MULTITASK LEARNING; ONE CLASS-SVM; ONE-CLASS SUPPORT VECTOR MACHINE; OPTIMIZATION PROGRAMS; TASK RELATEDNESS;

SUPPORT VECTOR MACHINES;

ALGORITHM; ARTICLE; CALCULATION; CONTROLLED STUDY; DATA ANALYSIS; KERNEL METHOD; MACHINE LEARNING; MATHEMATICAL COMPUTING; MULTITASK LEARNING METHOD; NONLINEAR SYSTEM; NORMAL DISTRIBUTION; PRIORITY JOURNAL; PROCESS OPTIMIZATION; SUPPORT VECTOR MACHINE;

EID: 84894563160     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.12.022     Document Type: Article

References (37)

1. J. Bi, T. Xiong, S. Yu, M. Dundar, R.B. Rao, An improved multi-task learning approach with applications in medical diagnosis, in: Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases - Part I, Antwerp, Belgium, 2008, pp. 117-132.
2. V.W. Zheng, S.J. Pan, Q. Yang, J.J. Pan, Transferring multi-device localization models using latent multi-task learning, in: Proceedings of the Twenty-third National Conference on Artificial Intelligence, Chicago, IL, USA, 2008, pp. 1427-1432.
3. Pan S.J., Yang Q. A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 2010, 22(10):1345-1359.
4. Ozawa S.R., Roussinov D.A. A multitask learning model for online pattern recognition. IEEE Trans. Neural Netw. 2009, 20(3):430-445.
5. Birlutiu A., Groot P., Heskes T. Multi-task preference learning with an application to hearing aid personalization. Neurocomputing 2010, 73:1177-1185.
6. Du L., Wang P., Liu H., Pan M., Chen F., Bao Z. Bayesian spatiotemporal multitask learning for radar HRRP target recognition. IEEE Trans. Signal Process. 2011, 59(7):3182-3196.
7. Caruana R. Multitask learning. Mach. Learn. 1997, 28:41-75.
8. T. Jebara, Multi-task feature and kernel selection for SVMS, in: Proceedings of the Twenty-first International Conference on Machine Learning, Banff, Alberta, Canada, 2004.
9. Argyriou A., Evgeniou T., Pontil M. Convex multi-task feature learning. Mach. Learn. 2008, 73:243-272.
10. Q. Gu, J. Zhou, Learning the shared subspace for multi-task clustering and transductive transfer classification, in: Proceedings of the Ninth IEEE International Conference on Data Mining, Miami, FL, USA, 2009, pp. 159-168.
11. Obozinski G., Taskar B., Jordan M.I. Joint covariate selection and joint subspace selection for multiple classification problems. Stat. Comput. 2010, 20:231-252.
12. H. Yang, I. King, M.R. Lyu, Online learning for multi-task feature selection, in: Proceedings of the Nineteenth International Conference on Information and Knowledge Management, Toronto, Canada, 2010, pp. 1693-1696.
13. S. Ben-David, R. Schuller, Exploiting task relatedness for multiple task learning, in: Proceedings of the Sixteenth Annual Conference on Computational Learning Theory and the Seventh Kernel Workshop, Washington DC, USA, 2003, pp. 567-580.
14. Ben-David S., Borbely R.S. A notion of task relatedness yielding provable multiple-task learning guarantees. Mach. Learn. 2008, 73:273-287.
15. Evgeniou T., Micchelli C.A., Pontil M. Learning multiple tasks with kernel methods. J. Mach. Learn. Res. 2005, 6:615-637.
16. T. Evgeniou, M. Pontil, Regularized multi-task learning, in: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, WA, USA, 2004, pp. 109-117.
17. Widmer C., Toussaint N., Altun Y., Ratsch G. Inferring latent task structure for multitask learning by multiple kernel learning. BMC Bioinformat. 2010, 11(Suppl. 8):S5.
18. H. Yang, I. King, M.R. Lyu, Multi-task learning for one-class classification, in: Proceedings of the International Joint Conference on Neural Networks, Barcelona, Spain, 2010, pp. 1-8.
19. Y. Ji, S. Sun, Y. Lu, Multitask multiclass privileged information support vector machines, in: Proceedings of the Twenty-first International Conference on Pattern Recognition, 2012, pp. 2323-2326.
20. X. Xie, S. Sun, Multitask twin support vector machines, in: Neural Information Processing, Lecture Notes in Computer Science, vol. 7664, Springer, Berlin Heidelberg, 2012, pp. 341-348.
21. Ji Y., Sun S. Multitask multiclass support vector machines. model and experiments. Pattern Recognit. 2013, 46(3):914-924.
22. B.E. Boser, I.M. Guyon, V.N. Vapnik, A training algorithm for optimal margin classifiers, in: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, Pittsburgh, PA, USA, 1992, pp. 144-152.
23. Vapnik V.N. The Nature of Statistical Learning Theory 1995, Springer-Verlag, New York.
24. K.M. Chai, Generalization errors and learning curves for regression with multi-task Gaussian processes, in: Advances in Neural Information Processing Systems 22, 2009, pp. 279-287.
25. T. Heskes, Empirical Bayes for learning to learn, in: Proceedings of the Seventeenth International Conference on Machine Learning, San Francisco, CA, USA, 2000, pp. 367-374.
26. Skolidis G., Sanguinetti G. Bayesian multitask classification with Gaussian process priors. IEEE Trans. Neural Netw. 2011, 22(12):2011-2021.
27. Schölkopf B., Platt J.C., Shawe-Taylor J., Smola A.J., Williamson R.C. Estimating the support of a high-dimensional distribution. Neural Comput. 2001, 13(7):1443-1471.
28. Tax D.M.J., Duin R.P.W. Support vector domain description. Pattern Recognit. Lett. 1999, 20(11-13):1191-1199.
29. L. Tarassenko, P. Hayton, N. Cerneaz, M. Brady, Novelty detection for the identification of masses in mammograms, in: Proceedings of the Fourth IEEE International Conference on Artificial Neural Networks, Cambridge, UK, 1995, pp. 442-447.
30. Ritter G., Gallegos M.T. Outliers in statistical pattern recognition and an application to automatic chromosome classification. Pattern Recognit. Lett. 1997, 18:525-539.
31. E. Eskin, Anomaly detection over noisy data using learned probability distributions, in: Proceedings of the Seventeenth International Conference on Machine Learning, San Francisco, CA, USA, 2000, pp. 255-262.
32. Singh S., Markou M. An approach to novelty detection applied to the classification of image regions. IEEE Trans. Knowl. Data Eng. 2004, 16(4):396-407.
33. T. Kato, H. Kashima, M. Sugiyama, K. Asai, Multi-task learning via conic programming, in: Advances in Neural Information Processing Systems, vol. 20, 2008, pp. 737-744.
34. X. He, G. Mourot, D. Maquin, J. Ragot, P. Beauseroy, A. Smolarz, E. Grall-Maës, One-class svm in multi-task learning, in: Advances in Safety, Reliability and Risk Management, ESREL 2011, Troyes, France, 2011, pp. 486-494.
35. Schölkopf B., Smola A.J. Learning with Kernels. Support Vector Machines, Regularization, Optimization, and Beyond 2001, MIT Press, Cambridge, MA, USA.
36. A. Smolarz, Etude qualitative du modèle auto-binomial appliqué à la synthèse de texture, in: XXIXèmes Journées de Statistique, Carcassonne, France, 1997, pp. 712-715.
37. Sánchez-Fernández M., de Prado-Cumplido M., Arenas-García J., Pérez-Cruz F. SVM multiregression for nonlinear channel estimation in multiple-input multiple-output systems. IEEE Trans. Signal Process. 2004, 52(8):2298-2307.