A fuzzy model with online incremental SVM and margin-selective gradient descent learning for classification problems

IEEE Transactions on Fuzzy Systems

Volumn 22, Issue 2, 2014, Pages 324-337

  Cheng, Wei Yuan ^a   Juang, Chia Feng ^a  

^a NATIONAL CHUNG HSING UNIVERSITY   (Taiwan)

Author keywords

Fuzzy classifiers (FCs); fuzzy neural networks; incremental learning; incremental support vector machines (ISVMs); neural fuzzy systems

Indexed keywords

CLUSTERING ALGORITHMS; FUZZY NEURAL NETWORKS; FUZZY SETS; FUZZY SYSTEMS; KNOWLEDGE ENGINEERING;

FUZZY CLASSIFICATION; FUZZY CLASSIFIERS; GENERALIZATION ABILITY; GRADIENT DESCENT ALGORITHMS; INCREMENTAL LEARNING; INCREMENTAL SUPPORT VECTOR MACHINE; NEURAL FUZZY SYSTEMS; PARAMETER LEARNING;

SUPPORT VECTOR MACHINES;

EID: 84897563527     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2013.2254492     Document Type: Article

References (53)

1. J. Gama, Knowledge Discovery From Data Streams. Boca Raton, FL, USA: CRC, 2010
2. P. Angelov, D. Filev, and N. Kasabov, Evolving Intelligent Systems-Methodology and Applications. New York, NY, USA: Wiley-IEEE Press, 2010
3. S. Wan and L. E. Banta, "Parameter incremental learning algorithm for neural networks," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1424-1438, Nov. 2006 (Pubitemid 44824257)
4. N. Kasabov, Evolving Connectionist Systems: The Knowledge Engineering Approach, 2nd ed. London, U.K.: Springer-Verlag, 2007
5. C. F. Juang and C. T. Lin, "An on-line self-constructing neural fuzzy inference network and its applications," IEEE Trans. Fuzzy Syst., vol. 6, no. 1, pp. 12-32, Feb. 1998
6. N. E. Mitrakis, J. B. Theocharis, and V. Petridis, "A multilayered neurofuzzy classifier with self-organizing properties," Fuzzy Sets Syst., vol. 159, no. 23, pp. 3132-3159, 2008
7. E. D. Lughofer, "FLEXFIS: A robust incremental learning approach for evolving Takagi-Sugeno fuzzy models," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1393-1410, Dec. 2008
8. C. F. Juang and Y. W. Tsao, "A self-evolving interval type-2 fuzzy neural networkwith on-line structure and parameter learning," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1411-1424, Dec. 2008
9. P. P. Angelov and X. Zhou, "Evolving fuzzy-rule-based classifiers from data streams," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1462-1475, Dec. 2008
10. J. C. Huhn and E. Hullermeier, "FR3: A fuzzy rule learner for inducing reliable classifiers," IEEE Trans. Fuzzy Syst., vol. 17, no. 1, pp. 138-149, Feb. 2009
11. G. D. Wu and P. H. Huang, "A maximizing-discriminability-based selforganizing fuzzy network for classification problems," IEEE Trans. Fuzzy Syst., vol. 18, no. 2, pp. 362-373, Apr. 2010
12. A. Lemos, W. Caminhas, and F. Gomide, "Multivariable Gaussian evolving fuzzy modeling system," IEEE Trans. Fuzzy Syst., vol. 19, no. 1, pp. 91-104, Feb. 2011
13. H. J. Song, C. Y. Miao, R. Wuyts, Z. Q. Shen, M. DHondt, and F. Catthoor, "An extension to fuzzy cognitive maps for classification and prediction," IEEE Trans. Fuzzy Syst., vol. 19, no. 1, pp. 116-135, Feb. 2011
14. C. S. Chen, "Robust self-organizing neural-fuzzy control with uncertainty observer for MIMO nonlinear systems," IEEE Trans. Fuzzy Syst., vol. 19, no. 4, pp. 694-706, Aug. 2011
15. Z. Chen, S. Aghakhani, J. Man, and S. Dick, "ANCFIS: A neurofuzzy architecture employing complex fuzzy sets," IEEE Trans. Fuzzy Syst., vol. 19, no. 2, pp. 305-322, Apr. 2011
16. G. D. Wu, Z. W. Zhu, and P. H. Huang, "A TS-Type maximizingdiscriminability-based recurrent fuzzy network for classification problems," IEEE Trans. Fuzzy Syst., vol. 19, no. 2, pp. 339-352, Apr. 2011
17. C. F. Juang, T. C. Chen, and W. Y. Cheng, "Speedup of implementing fuzzy neural networks with high-dimensional inputs through parallel processing on graphic processing units," IEEE Trans. Fuzzy Syst., vol. 19, no. 4, pp. 717-728, Aug. 2011
18. Y. C. Chen, N. R. Pal, and I. F. Chung, "An integrated mechanism for feature selection and fuzzy rule extraction for classification," IEEE Trans. Fuzzy Syst., vol. 20, no. 4, pp. 683-698, Aug. 2012
19. G. Cauwenberghs and T. Poggio, "Incremental and decremental support vector machine learning," in Advances in Neural Information Processing Systems, T. K. Leen, T. G. Dietterich, and V. Tresp, Eds. Cambridge, MA, USA: MIT Press, 2000, vol. 13, pp. 409-415
20. C. P. Diehl and G. Cauwenberghs, "SVM incremental learning, adaptation and optimization," in Proc. Int. Joint Conf. Neural Netw., 2003, pp. 2685-2690
21. A. Shilton, M. Palaniswami, D. Ralph, and A. C. Tsoi, "Incremental training of support vector machines," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 114-131, Jan. 2005 (Pubitemid 40241914)
22. P. Laskov, C.Gehl, S. Kruger, andK. R.Muller, "Incremental support vector learning: Analysis, implementation and applications," Mach. Learn. Res., vol. 7, pp. 1909-1936, 2006 (Pubitemid 44477117)
23. M. Karasuyama and I. Takeuchi, "Multiple incremental decremental learning of support vector machines," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1048-1059, Jul. 2010
24. S. Ertekin, L. Bottou, and C. L. Giles, "Nonconvex online support vector machines," IEEE Trans. Pattern Anal.Mach. Intell., vol. 33, no. 2, pp. 368-381, Feb. 2011
25. R. Roscher, B. Waske, and W. Forstner, "Incremental import vector machines for classifying hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 50, no. 9, pp. 3463-3473, Sep. 2012
26. N. Cristianini and J. S.-Taylor, An Introduction to Support Vector Machines And Other Kernel-based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000
27. X. Yang, G. Zhang, J. Lu, and J. Ma, "A kernel fuzzy c-means clusteringbased fuzzy support vector machine algorithm for classification problems with outliers or noises," IEEE Trans. Fuzzy Syst., vol. 19, no. 1, pp. 105-115, Feb. 2011
28. P. Mitra, C. A. Murthy, and S. K. Pal, "Data condensation in large databases by incremental learning with support vectormachines," in Proc. Int. Conf. Pattern Recog., 2000, pp. 708-711
29. C. Domeniconi and D. Gunopulos, "Incremental support vector machine construction," in Proc. Int. Conf. Data Mining, 2001, pp. 589-592
30. S. Ruping, "Incremental learning with support vector machines," in Prof. Int. Conf. Data Mining, 2001, pp. 641-642
31. K. Ikeda and T. Yamasaki, "Incremental support vectormachines and their geometrical analyses," Neurocomputing, vol. 70, pp. 2528-2533, 2007 (Pubitemid 46825352)
32. S. Cheng and F. Y. Shih, "An improved incremental training algorithm for support vector machines using active query," Pattern Recog., vol. 40, pp. 964-971, 2007 (Pubitemid 44667752)
33. C. F. Juang and C. D. Hsieh, "A locally recurrent fuzzy neural network with support vector regression for dynamic system modeling," IEEE Trans. Fuzzy Syst., vol. 18, no. 2, pp. 261-273, Apr. 2010
34. C. F. Juang, R. B. Huang, andW. Y. Cheng, "An interval type-2 fuzzy neural network with support vector regression for noisy regression problems," IEEE Trans. Fuzzy Syst., vol. 18, no. 4, pp. 686-699, Aug. 2010
35. C. F. Juang and C. D. Hsieh, "A fuzzy system constructed by rule generation and iterative linear SVR for antecedent and consequent parameter optimization," IEEE Trans. Fuzzy Syst., vol. 20, no. 2, pp. 372-384, Apr. 2012
36. Y. Chen and J. Z. Wang, "Support vector learning for fuzzy rule-based classification systems," IEEE Trans. Fuzzy Syst., vol. 11, no. 6, pp. 716-728, Dec. 2003
37. C. T. Lin, C. M. Yeh, S. F. Liang, J. F. Chung, and N. Kumar, "Supportvector-based fuzzy neural network for pattern classification," IEEE Trans. Fuzzy Syst., vol. 14, no. 1, pp. 31-41, Feb. 2006 (Pubitemid 43263926)
38. S. M. Zhou and J. Q. Gan, "Constructing L2-SVM-based fuzzy classifiers in high-dimensional space with automatic model selection and fuzzy rule ranking," IEEE Trans. Fuzzy Syst., vol. 15, no. 3, pp. 398-409, Jun. 2007 (Pubitemid 46971552)
39. C. F. Juang, S. H. Shiu, and S. J. Shiu, "Fuzzy system learned through fuzzy clustering and support vector machine for human skin color segmentation," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 37, no. 6, pp. 1077-1087, Nov. 2007
40. C. F. Juang, S. H. Chiu, and S. W. Chang, "A self-organizing TS-type fuzzy network with support vector learning and its application to classification problems," IEEE Trans. Fuzzy Syst., vol. 15, no. 5, pp. 998-1008, Oct. 2007
41. C. F. Juang and G. C. Chen, "A TS fuzzy system learned through a support vector machine in principal component space for real-time object detection," IEEE Trans. Ind. Electron., vol. 59, no. 8, pp. 3309-3320, Aug. 2012
42. G. C. Chen and C. F. Juang, "Object detection using color entropies and a fuzzy classifier," IEEE Comput. Intell. Mag., vol. 8, no. 1, pp. 33-45, Feb. 2013
43. W. Y. Cheng and C. F. Juang, "An incremental support vector machinetrained TS-type fuzzy system for on-line classification problems," Fuzzy Sets Syst., vol. 163, no. 1, pp. 24-44, Jan. 2011
44. B. Scholkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA, USA: MIT Press, 2002, ch. 7
45. C. W. Hsu and C. J. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-525, Mar. 2002
46. C. F. Juang, C. M. Hsiao, and C. H. Hsu, "Hierarchical cluster-based multi-species particle swarm optimization for fuzzy system optimization," IEEE Trans. Fuzzy Syst., vol. 18, no. 1, pp. 14-26, Feb. 2010
47. C. F. Juang and Y. C. Chang, "Evolutionary group-based particle swarmoptimized fuzzy controller with application to mobile robot navigation in unknown environments," IEEE Trans. Fuzzy Syst., vol. 19, no. 2, pp. 379-392, Apr. 2011
48. C. F. Juang and P. H. Chang, "Designing fuzzy rule-based systems using continuous ant colony optimization," IEEE Trans. Fuzzy Syst., vol. 18, no. 1, pp. 138-149, Feb. 2010
49. C. H. Hsu and C. F. Juang, "Evolutionary robot wall-following control using type-2 fuzzy controller with species-DE activated continuousACO," IEEE Trans. Fuzzy Syst., vol. 21, no. 1, pp. 100-112, Feb. 2013
50. C. F. Juang, "Temporal problems solved by dynamic fuzzy network based on genetic algorithmwith variable-length chromosomes," Fuzzy Sets Syst., vol. 142, no. 2, pp. 199-219, Mar. 2004
51. J. Alcala-Fdez, R. Alcala, and F. Herrera, "A fuzzy association rulebased classification model for high-dimensional problems with genetic rule selection and lateral tuning," IEEE Trans. Fuzzy Syst., vol. 19, no. 5, pp. 857-872, Oct. 2011
52. M. Antonelli, P. Ducange, and F. Marcelloni, "Genetic training instance selection in multiobjective evolutionary fuzzy systems: A coevolutionary approach," IEEE Trans. Fuzzy Syst., vol. 20, no. 2, pp. 276-290, Apr. 2012
53. R. Hosseini, S. D. Qanadli, S. Barman, M. Mazinani, T. Ellis, and J. Dehmeshki, "An automatic approach for learning and tuning Gaussian interval type-2 fuzzy membership functions applied to lung CAD classification system," IEEE Trans. Fuzzy Syst., vol. 20, no. 2, pp. 224-234, Apr. 2012.