Semisupervised Incremental Support Vector Machine Learning Based on Neighborhood Kernel Estimation

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Volumn 47, Issue 10, 2017, Pages 2677-2687

  Wang, Jing ^a   Yang, Daiwei ^a   Jiang, Wei ^a   Zhou, Jinglin ^a  

^a BEIJING UNIVERSITY OF CHEMICAL TECHNOLOGY   (China)

Author keywords

Incremental training; neighborhood kernel estimation (KE); semisupervised scheme; support vector machine (SVM)

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS;

INCREMENTAL SUPPORT VECTOR MACHINE; INCREMENTAL TRAINING; KERNEL ESTIMATION; LEARNING EFFICIENCY; MACHINE LEARNING COMMUNITIES; PENICILLIN FERMENTATION PROCESS; RBF NEURAL NETWORK; SEMI-SUPERVISED;

SUPPORT VECTOR MACHINES;

EID: 85029946984     PISSN: 21682216     EISSN: 21682232     Source Type: Journal    
DOI: 10.1109/TSMC.2017.2667703     Document Type: Article

References (42)

1. C. L. P. Chen and C.-Y. Zhang, "Data-intensive applications, challenges, techniques and technologies: A survey on big data," Inf. Sci., vol. 275, pp. 314-347, Aug. 2014.
2. A. Singla, S. Patra, and L. Bruzzone, "A novel classification technique based on progressive transductive SVM learning," Pattern Recognit. Lett., vol. 42, pp. 101-106, Jun. 2014.
3. C. Chen et al., "Adaptive fuzzy asymptotic control of MIMO systems with unknown input coefficients via a robust Nussbaum gain based approach," IEEE Trans. Fuzzy Syst., to be published, doi: 10.1109/TFUZZ.2016.2604848.
4. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
5. Y.-J. Liu and S. C. Tong, "Optimal control-based adaptive NN design for a class of nonlinear discrete-time block-triangular systems," IEEE Trans. Cybern., vol. 46, no. 11, pp. 2670-2680, Nov. 2016.
6. C. L. P. Chen, D. C. Tao, and X. G. You, "Big learning in social media analytics," Neurocomputing, vol. 204, pp. 1-2, Sep. 2016.
7. B. Fan, X. J. Lu, and H.-X. Li, "Probabilistic inference-based least squares support vector machine for modeling under noisy environment," IEEE Trans. Syst., Man, Cybern., Syst., vol. 46, no. 12, pp. 1703-1710, Dec. 2016.
8. P. J.-H. Hu et al., "Managing clinical use of high-alert drugs: A supervised learning approach to pharmacokinetic data analysis," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 37, no. 4, pp. 481-492, Jul. 2007.
9. Y. Wang et al., "Learning can improve the blood glucose control performance for type 1 diabetes mellitus," Diabetes Technol. Ther., vol. 19, no. 1, pp. 41-48, Jan. 2017.
10. D. Zhao, Z. Lin, and Y. Q. Wang, "Integrated state/disturbance observers for two-dimensional linear systems," IET Control Theory Appl., vol. 9, no. 9, pp. 1373-1383, Jun. 2015.
11. Y.-J. Liu, J. Li, S. C. Tong, and C. L. P. Chen, "Neural network controlbased adaptive learning design for nonlinear systems with full-state constraints," IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 7, pp. 1562-1571, Jul. 2016
12. D. Zhao, D. Shen, and Y. Q. Wang, "Fault diagnosis and compensation for two-dimensional discrete time systems with sensor faults and time varying delays," Int. J. Robust Nonlin. Control, pp. 1-25, Jan. 2017, to be published, doi: 10.1002/rnc.3742.
13. G. X. Wen, C. L. P. Chen, Y.-J. Liu, and Z. Liu, "Neural network-based adaptive leader-following consensus control for a class of nonlinear multiagent state-delay systems," IEEE Trans. Cybern., to be published, doi: 10.1109/TCYB.2016.2608499.
14. T. I. Dhamecha, R. Singh, and M. Vatsa, "On incremental semi-supervised discriminant analysis," Pattern Recognit., vol. 52, pp. 135-147, Apr. 2016.
15. P. K. Mallapragada, R. Jin, A. K. Jain, and Y. Liu, "SemiBoost: Boosting for semi-supervised learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 2000-2014, Nov. 2009.
16. M. R. Sabuncu, B. T. T. Yeo, K. V. Leemput, B. Fischl, and P. Golland, "A generative model for image segmentation based on label fusion," IEEE Trans. Med. Imag., vol. 29, no. 10, pp. 1714-1729, Oct. 2010.
17. K. Zhang, R. Gonzalez, B. Huang, and G. Ji, "Expectation-maximization approach to fault diagnosis with missing data," IEEE Trans. Ind. Electron., vol. 62, no. 2, pp. 1231-1240, Feb. 2015.
18. Y.-J. Liu and S. Tong, "Barrier Lyapunov functions for Nussbaum gain adaptive control of full state constrained nonlinear systems," Automatica, vol. 76, pp. 143-152, Feb. 2017.
19. Y. Li, C. Guan, H. Li, and Z. Chin, "A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system," Pattern Recognit. Lett., vol. 29, no. 9, pp. 1285-1294, Jul. 2008.
20. Y. He and D. Zhou, "Self-training from labeled features for sentiment analysis," Inf. Process. Manag., vol. 47, no. 4, pp. 606-616, Jul. 2011.
21. M. Darnstadt, H. U. Simon, and B. Szörényi, "Supervised learning and co-training," Theor. Comput. Sci., vol. 519, pp. 68-87, Jan. 2014.
22. Y.-J. Liu, S. C. Tong, C. L. P. Chen, and D.-J. Li, "Neural controller design-based adaptive control for nonlinear MIMO systems with unknown hysteresis inputs," IEEE Trans. Cybern., vol. 46, no. 1, pp. 9-19, Jan. 2016, doi: 10.1109/TCYB.2015.2388582.
23. J. X. Huang, J. Miao, and B. He, "High performance query expansion using adaptive co-training," Inf. Process. Manag., vol. 49, no. 2, pp. 441-453, Mar. 2013.
24. M.-F. Balcan and A. Blum, "A discriminative model for semi-supervised learning," J. ACM, vol. 57, pp. 517-527, Mar. 2008.
25. Z.-H. Zhou and M. Li, "Semisupervised regression with cotrainingstyle algorithms," IEEE Trans. Knowl. Data Eng., vol. 19, no. 11, pp. 1479-1493, Nov. 2007.
26. B.-W. Chen, C.-Y. Chen, and J.-F. Wang, "Smart homecare surveillance system: Behavior identification based on state-transition support vector machines and sound directivity pattern analysis," IEEE Trans. Syst., Man, Cybern., Syst., vol. 43, no. 6, pp. 1279-1289, Nov. 2013.
27. J. Sun, H. Li, and H. Adeli, "Concept drift-oriented adaptive and dynamic support vector machine ensemble with time window in corporate financial risk prediction," IEEE Trans. Syst., Man, Cybern., Syst., vol. 43, no. 4, pp. 801-813, Jul. 2013.
28. Y.-F. Li and Z.-H. Zhou, "Towards making unlabeled data never hurt," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 1, pp. 175-188, Jan. 2014.
29. D. Needell, N. Srebro, and R. Ward, "Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm," Math. Program., vol. 2, pp. 1-25, Feb. 2015.
30. M. Markov, M. Saghafi, I. A. Hiskens, and H. Dankowicz, "Continuation techniques for reachability analysis of uncertain power systems," in Proc. IEEE Int. Symp. Circuits Syst., Melbourne, VIC, Australia, 2014, pp. 1816-1819.
31. H. M. Le, H. A. L. Thi, and M. C. Nguyen, "Sparse semi-supervised support vector machines by DC programming and DCA," Neurocomputing, vol. 153, pp. 62-76, Apr. 2015.
32. F. K. W. Chan, H. C. So, W.-K. Ma, and K. W. K. Lui, "A flexible semi-definite programming approach for source localization problems," Digit. Signal Process., vol. 23, no. 2, pp. 601-609, Mar. 2013.
33. M. S. Mehmetoglu, E. Akyol, and K. Rose, "A deterministic annealing approach to optimization of zero-delay source-channel codes," in Proc. IEEE Inf. Theory Workshop, Seville, Spain, 2013, pp. 1-5.
34. S. Nakariyakul, "A comparative study of suboptimal branch and bound algorithms," Inf. Sci., vol. 278, pp. 545-554, Sep. 2014.
35. T. C. Liu, Y. Yang, G.-B. Huang, Y. K. Yeo, and Z. P. Lin, "Driver distraction detection using semi-supervised machine learning," IEEE Trans. Intell. Transp. Syst., vol. 17, no. 4, pp. 1108-1120, Apr. 2016.
36. G. B. Huang, S. Song, J. N. D. Gupta, and C. Wu, "Semi-supervised and unsupervised extreme learning machines," IEEE Trans. Cybern., vol. 44, no. 12, pp. 2405-2417, Dec. 2014.
37. H. J. Bierens, "The Nadaraya-Watson kernel regression function estimator," in Topics in Advanced Econometrics. New York, NY, USA: Cambridge Univ. Press, 1994, pp. 212-247.
38. A. Golbabai, S. Seifollahi, and M. Javidi, "Normalized RBF networks: Application to a system of integral equations," Phys. Scripta, vol. 78, no. 1, pp. 1302-1314, Jul. 2008.
39. Y.-H. Cheng, J. I. Jie, and X.-S. Wang, "Semi-supervised support vector regression based on help-training," Control Decis., vol. 27, no. 2, pp. 205-210, Feb. 2012.
40. G. Birol, C. Ündey, and A. Cinar, "A modular simulation package for fed-batch fermentation: Penicillin production," Comput. Chem. Eng., vol. 26, no. 11, pp. 1553-1565, Nov. 2002.
41. J. Wang, H. T. Wei, L. L. Cao, and Q. B. Jin, "Soft-transition sub-PCA fault monitoring of batch processes," Ind. Eng. Chem. Res., vol. 52, no. 29, pp. 9879-9888, Jun. 2013.
42. B. Gu et al., "Incremental learning for y-support vector regression," Neural Netw., vol. 67, pp. 140-150, Mar. 2015.