A multiple kernel framework for inductive semi-supervised SVM learning

Neurocomputing

Volumn 90, Issue , 2012, Pages 46-58

  Tian, Xilan ^a   Gasso, Gilles ^a   Canu, Stéphane ^a  

^a University of Rouen   (France)

Author keywords

BCI application; DC programming; Inductive semi supervised learning; Multiple kernel learning; Transductive SVM

Indexed keywords

BENCHMARK DATA; D-C PROGRAMMING; MULTIPLE KERNEL LEARNING; MULTIPLE KERNELS; SEMI-SUPERVISED; SEMI-SUPERVISED ALGORITHM; SEMI-SUPERVISED LEARNING; TRANSDUCTIVE SVM;

NEURAL NETWORKS;

COMPUTER APPLICATIONS;

ARTICLE; DIFFERENCE OF CONVEX FUNCTION PROGRAMMING; ELECTROENCEPHALOGRAM; INFORMATION PROCESSING; KERNEL METHOD; LEARNING ALGORITHM; PRIORITY JOURNAL; STATISTICAL ANALYSIS; SUPPORT VECTOR MACHINE; TRANSDUCTIVE SUPPORT VECTOR MACHINE;

EID: 84860231071     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.12.036     Document Type: Article

References (31)

1. Qin J., Li Y., Sun W. A semisupervised support vector machines algorithm for BCI systems. Comput. Intell. Neurosci. 2007, 1687-5265.
2. Li Y., Guan C., Li H., Chin Z. A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system. Pattern Recognition Lett. 2008, 29:1285-1294.
3. Panicker R.C., Sadasivan P., Sun Y. Adaptation in p300 brain-computer interfaces: a two-classifier cotraining approach. IEEE Trans. Biomed. Eng. 2010, 57(12):2927-2935.
4. Liao X., Yao D., Li C. Transductive SVM for reducing the training effort in BCI. J. Neural Eng. 2007, 4:246-254.
5. Zhong J., Lei X., Yao D. Semi-supervised learning based on manifold in BCI. J. Electron. Sci. Technol. China 2009, 7(1):22-26.
6. Vapnik V., Sterin A. On structural risk minimization or overall risk in a problem of pattern recognition. Autom. Remote Control 1977, 10:1495-1503.
7. O. Chapelle, A. Zien, Semi-supervised classification by low density separation, in: Tenth International Workshop on Artificial Intelligence and Statistics (AISTATS 2005), Barbados, 2005, pp. 57-64.
8. T. Joachims, Transductive inference for text classification using support vector machines, in: Proceedings of the Sixteenth International Conference on Machine Learning (ICML 99), Bled, Slovenia, 1999, pp. 200-209.
9. X. Zhu, Z. Ghahramani, Learning from Labeled and Unlabeled Data with Label Propagation, Technical Report CMU-CALD-02-107, Carnegie Mellon University, 2002.
10. T. Joachims, et al., Transductive learning via spectral graph partitioning, in: Proceedings of the Twentieth International Conference on Machine Learning (ICML 2003), ICML, Washington, USA, 2003, pp. 290-297.
11. Belkin M., Niyogi P., Sindhwani V. Manifold regularization: a geometric framework for learning from label and unlabeled examples. J. Mach. Learning Res. 2006, 7:2399-2434.
12. Chapelle O., Sindhwani V., Keerthi S.S. Optimization techniques for semi-supervised support vector machines. J. Mach. Learning Res. 2008, 9:203-233.
13. Mallapragada P.K., Jin R., Jain A.K., Liu Y. Semiboost: boosting for semi-supervised learning. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31(11):2000-2014.
14. A. Goldberg, X. Zhu, A. Singh, Z. Xu, R. Nowak, Multi-manifold semi-supervised learning, in: Proceedings of the Twelfth International Conference on Artificial Intelligence and Statistics (AISTATS 2009), Florida, USA, 2009.
15. G. Dai, D. Yeung, Kernel selection for semi-supervised kernel machines, in: Proceedings of the Twenty-fourth International Conference on Machine Learning (ICML 2007), Corvalis, Oregon, USA, 2007, pp. 185-192.
16. Z. Xu, R. Jin, J. Zhu, I. King, M. Lyu, Z. Yang, Adaptive regularization for transductive support vector machine, in: Y. Bengio, D. Schuurmans, J. Lafferty, C.K.I. Williams, A. Culotta (Eds.), Proceedings of the Twenty-third Annual Conference on Neural Information Processing Systems (NIPS'09), Vancouver, Canada, 2009, pp. 2125-2133.
17. Rakotomamonjy A., Bach F., Canu S., Grandvalet Y. Simplemkl. J. Mach. Learning Res. 2008, 9:2491-2521.
18. Tao P.D., An L.T.H. Dc optimization algorithms for solving the trust region subproblem. SIAM J. Optim. 1998, 8(2):476-505.
19. Michael S., Navin L.T., Thilo H., Martin B., Jeremy H.N., Niels B., Wolfgang R., Bernhard S. Robust EEG channel selection across subjects for brain computer interfaces. EURASIP J. Appl. Signal Process. 2005, 2005(19):3103-3112.
20. K.P. Bennett, A. Demiriz, Semi-supervised support vector machines, in: Advances in Neural Information Processing Systems, MIT Press, 1998, pp. 368-374.
21. M. Seeger, Learning with Labeled and Unlabeled Data, Technical Report, Institute for ANC, Edinburgh, UK, 2000. http://lapmal.epfl.ch/papers/review.pdf.
22. V. Sindhwani, S.S. Keerthi, O. Chapelle, Deterministic annealing for semi-supervised kernel machines, in: International Conference on Machine Learning, 2006, pp. 841-848. doi:10.1145/1143844.1143950.
23. Wang J., Shen X., Pan W. On efficient large margin semisupervised learning: method and theory. J. Mach. Learning Res. 2009, 10:719-742. 10.1145/1577069.1577094.
24. Collobert R., Sinz F., Weston J., Bottou L. Large scale transductive SVMs. J. Mach. Learning Res. 2006, 7:1687-1712.
25. B. Zhao, F. Wang, C. Zhang, Cuts3vm: a fast semi-supervised svm algorithm, in: Proceeding of the Fourteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD'08, ACM, New York, NY, USA, 2008, pp. 830-838.
26. V. Sindhwani, P. Niyogi, M. Belkin, Beyond the point cloud: from transductive to semi-supervised learning, in: Proceedings of the Twenty-second International Conference on Machine Learning (ICML 2005), ACM Press, 2005, pp. 824-831.
27. Z. Xu, R. Jin, H. Yang, I. King, M. Lyu, Simple and efficient multiple kernel learning by group lasso, in: Proceedings of the Twenty-seventh International Conference on Machine Learning (ICML 2010), Haifa, Israel, 2010, pp. 1175-1182.
28. Kloft M., Brefeld U., Sonnenburg S., Zien A. Lp-norm multiple kernel learning. J. Mach. Learning Res. 2011, 12:953-997.
29. Yuille A.L., Rangarajan A. The concave-convex procedure. Neural Comput. 2003, 15(4):915-936.
30. A.J. Smola, S. Vishwanathan, T. Hofmann, Kernel methods for missing variables, in: Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, 2005, pp. 325-332.
31. Rockafellar R. Convex Analysis 1996, Princeton University Press.