Support Vector Learning for Fuzzy Rule-Based Classification Systems

IEEE Transactions on Fuzzy Systems

Volumn 11, Issue 6, 2003, Pages 716-728

  Chen, Yixin ^a,b   Wang, James Z ^b  

^a The Research Institute for Children   (United States)

^b Pennsylvania State University   (United States)

Author keywords

Fuzzy classifier; Fuzzy systems; Kernel methods; Pattern classification; Statistical learning theory; Support vector machines

Indexed keywords

COMPUTATIONAL COMPLEXITY; ERROR ANALYSIS; IDENTIFICATION (CONTROL SYSTEMS); LAGRANGE MULTIPLIERS; LAPLACE TRANSFORMS; LARGE SCALE SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; PATTERN RECOGNITION; PRINCIPAL COMPONENT ANALYSIS;

FUZZY CLASSIFIERS; KERNEL METHODS; STATISTICAL LEARNING THEORY; SUPPORT VECTOR MACHINES (SVM);

FUZZY SETS;

EID: 0346076782     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2003.819843     Document Type: Article

References (65)

1. S. Abe and R. Thawonmas, "A fuzzy classifier with ellipsoidal regions," IEEE Trans. Fuzzy Syst., vol. 5, pp. 358-368, June 1997.
2. P. L. Bartlett, "For valid generalization, the size of the weights is more important than the size of the network," in Advances in Neural Information Processing Systems, M. C. Mozer, M. I. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press, 1997, vol. 9, pp. 134-140.
3. C. L. Blake and C. J. Merz. (1998) UCI repository of machine learning databases. Dept. Inform. Comput. Sci., Univ. California, Irvine, Irvine, CA. [Online]. Available: http://www.ics.uci.edu/̃mlearn/MLRepository
4. P. S. Bradley and O. L. Mangasarian, "Feature selection via concave minimization and support vector machines," in Proc. 15th Int. Conf. Machine Learning, San Francisco, CA, 1998, pp. 82-90.
5. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining Knowledge Discovery, vol. 2, no. 2, pp. 121-167, 1998.
6. C. J. C. Burges and B. Schölkopf, "Improving the accuracy and speed of support vector machines," in Advances in Neural Information Processing Systems, M. C. Mozer, M. I. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press, 1997, vol. 9, pp. 375-381.
7. C.-C. Chang and C.-J. Lin. (2001) LIBSVM: A library for support vector machines, Taiwan. [Online]. Available: http://www.csie.ntu.edu.tw/̃cjlin/libsvm
8. S.-M. Chen, Y.-J. Horng, and C.-H. Lee, "Document retrieval using fuzzy-valued concept networks," IEEE Trans. Syst., Man, Cybern. B, vol. 31, pp. 111-118, Jan. 2001.
9. C.-K. Chiang, H.-Y. Chung, and J.-J. Lin, "A self-learning fuzzy logic controller using genetic algorithms with reinforcements," IEEE Trans. Fuzzy Syst., vol. 5, pp. 460-467, June 1997.
10. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
11. J. A. Dickerson and B. Kosko, "Fuzzy function approximation with ellipsoidal rules," IEEE Trans. Syst., Man, Cybern. B, vol. 26, pp. 542-560, July 1996.
12. D. Dubois and H. Prade, "Operations on fuzzy numbers," Int. J. Syst. Sci., vol. 9, no. 6, pp. 613-626, 1978.
13. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2000.
14. M. R. Emami, I. B. Türksen, and A. A. Goldenberg, "Development of a systematic methodology of fuzzy logic modeling," IEEE Trans. Neural Networks, vol. 6, pp. 346-361, June 1998.
15. S. Geman, E. Bienenstock, and R. Doursat, "Neural networks and the bias/variance dilemma," Neural Comput., vol. 4, no. 1, pp. 1-58, 1992.
16. M. G. Genton, "Classes of kernels for machine learning: A statistics perspective," J. Mach. Learn. Res., vol. 2, pp. 299-312, 2001.
17. R. J. Hathaway and J. C. Bezdek, "Fuzzy c-means clustering of incomplete data," IEEE Trans. Syst., Man, Cybern. B, vol. 31, pp. 735-744, Sept. 2001.
18. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.
19. H. Ishibuchi and T. Nakashima, "Effect of rule weights in fuzzy rule-based classification systems," IEEE Trans. Fuzzy Syst., vol. 9, pp. 506-515, Aug. 2001.
20. H. Ishibuchi, K. Nozaki, N. Yamamoto, and H. Tanaka, "Construction of fuzzy classification systems with rectangular fuzzy rules using genetic algorithms," Fuzzy Sets Syst., vol. 65, pp. 237-253, 1994.
21. J.-S. R. Jang and C. T. Sun, "Functional equivalence between radial basis function networks and fuzzy inference systems," IEEE Trans. Neural Networks, vol. 4, pp. 156-159, Feb. 1993.
22. J.-S. R. Jang and C.-T. Sun, "Neuro-fuzzy modeling and control," Proc. IEEE, vol. 83, pp. 378-406, Mar. 1995.
23. T. Joachims, "Making large-scale SVM learning practical," in Advances in Kernel Methods-Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 169-184.
24. N. K. Kasabov, "Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems," Fuzzy Sets Syst., vol. 82, no. 2, pp. 135-149, 1996.
25. L. Kaufman, "Solving the quadratic programming problem arising in support vector classification," in Advances in Kernel Methods-Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 147-167.
26. F. Klawon and P. E. Klement, Mathematical Analysis of Fuzzy Classifiers, ser. Lecture Notes in Computer Science. New York: Springer-Verlag, 1997, vol. 1280, pp. 359-370.
27. G. Klir and B. Yuan, Fuzzy Sets and Fuzzy Logic: Theory and Applications. Upper Saddle River, NJ: Prentice-Hall, 1995.
28. B. Kosko, "Fuzzy systems as universal approximators," IEEE Trans. Comput., vol. 43, pp. 1329-1333, Nov. 1994.
29. L. I. Kuncheva, "How good are fuzzy if-then classifiers," IEEE Trans. Syst., Man, Cybern. B, vol. 30, pp. 501-509, July 2000.
30. C. C. Lee, "Fuzzy logic in control systems: Fuzzy logic controller - part I, part II," IEEE Trans. Systems, Man, Cybern., vol. 20, pp. 404-435, Apr. 1990.
31. O. L. Mangasarian, "Generalized support vector machines," in Advances in Large Margin Classifiers, A. J. Smola, P. L. Bartlett, B. Schölkopf, and D. Schuurmans, Eds. Cambridge, MA: MIT Press, 2000, pp. 135-146.
32. J. Mercer, "Functions of positive and negative type and their connection with the theory of integral equations," Phil. Trans. Royal Soc. London, vol. A209, pp. 415-446, 1909.
33. S. Mitaim and B. Kosko, "The shape of fuzzy sets in adaptive function approximation," IEEE Trans. Fuzzy Syst., vol. 9, pp. 637-656, Aug. 2001.
34. S. Miyamoto, "Two approaches for information retrieval through fuzzy associations," IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 123-130, Feb. 1989.
35. K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf, "An introduction to kernel-based learning algorithms, " IEEE Trans. Neural Networks, vol. 12, pp. 181-202, Apr. 2001.
36. P. J. Pacini and B. Kosko, "Adaptive fuzzy frequency hopper," IEEE Trans. Commun., vol. 43, pp. 2111-2117, June 1995.
37. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods-Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 185-208.
38. R. Rovatti, "Fuzzy piecewise multilinear and piecewise linear systems as universal approximators in Sobolev norms," IEEE Trans. Fuzzy Syst., vol. 6, pp. 235-249, Apr. 1998.
39. F. Sattar and D. B. H. Tay, "Enhancement of document images using multiresolution and fuzzy logic techniques," IEEE Signal Processing Lett., vol. 6, pp. 249-252, Oct. 1999.
40. B. Schölkopf, A. J. Smola, and K.-R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1998.
41. B. Schölkopf, K.-K. Sung, C. Surges, F. Girosi, P. Niyogi, T. Poggio, and V. Vapnik, "Comparing support vector machines with Gaussian kernels to radial basis function classifiers," IEEE Trans. Signal Processing, vol. 45, pp. 2758-2765, Nov. 1997.
42. M. Setnes, "Supervised fuzzy clustering for rule extraction," IEEE Trans. Fuzzy Syst., vol. 8, pp. 416-424, Aug. 2000.
43. M. Setnes and R. Babuška, "Rule base reduction: Some comments on the use of orthogonal transforms," IEEE Trans. Syst., Man, Cybern. C, vol. 31, pp. 199-206, Apr. 2001.
44. R. Silipo and M. R. Berthold, "Input features' impact on fuzzy decision process," IEEE Trans. Syst., Man, Cybern. B, vol. 30, pp. 821-834, Nov. 2000.
45. A. J. Smola, B. Schölkopf, and K.-R. Müller, "The connection between regularization operators and support vector kernels," Neural Networks, vol. 11, no. 4, pp. 637-649, 1998.
46. M. Sugeno and G. T. Kang, "Structure identification of fuzzy model," Fuzzy Sets Syst., vol. 28, pp. 15-33, 1988.
47. Y. Suzuki, K. Itakura, S. Saga, and J. Maeda, "Signal processing and pattern recognition with soft computing," Proc. IEEE, vol. 89, pp. 1297-1317, Sept. 2001.
48. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its applications to modeling and control," IEEE Trans. Syst., Man, Cybern., vol. SMC-15, pp. 116-132, Feb. 1985.
49. K. Tang, K. Man, Z. Liu, and S. Kwong, "Minimal fuzzy memberships and rules using hierarchical genetic algorithms," IEEE Trans. Ind. Electron., vol. 45, pp. 162-169, Jan. 1998.
50. R. Thawonmas and S. Abe, "Function approximation based on fuzzy rules extracted from partitioned numerical data," IEEE Trans. Syst., Man, Cybernetics B, vol. 29, pp. 525-534, July 1999.
51. V. Vapnik, Estimation of Dependences Based on Empirical Data (in Russian). Moscow: Nauka, 1979.
52. _, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
53. _, Statistical Learning Theory. New York: Wiley, 1998.
54. V. Vapnik and A. Chervonenkis, "On the uniform convergence of relative frequencies of events to theirs probabilities," Theory of Probab. Applicat., vol. 16, no. 2, pp. 264-280, 1971.
55. V. Vapnik, S. E. Golowich, and A. Smola, "Support vector method for function approximation, regression estimation, and signal processing," in Advances in Neural Information Processing Systems, M. C. Mozer, M. I. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press, 1997, vol. 9, pp. 281-287.
56. L. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximation, and orthogonal least-squares learning," IEEE Trans. Neural Networks, vol. 3, pp. 807-814, Oct. 1992.
57. L.-X. Wang, Adaptive Fuzzy Systems And Control: Design and Stability Analysis. Upper Saddle River, NJ: Prentice-Hall, 1994.
58. _, "Analysis and design of hierarchical fuzzy systems," IEEE Trans. Fuzzy Syst., vol. 7, pp. 617-624, Oct. 1999.
59. C.-C. Wong and C.-C. Chen, "A GA-based method for constructing fuzzy systems directly from numerical data," IEEE Trans. Syst., Man, Cybern. B, vol. 30, pp. 904-911, Nov. 2000.
60. S. Wu, M. J. Er, and Y. Gao, "A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks," IEEE Trans. Fuzzy Syst., vol. 9, pp. 578-594, Aug. 2001.
61. J. Yen, "Fuzzy logic - a modern perspective," IEEE Trans. Knowledge Data Eng., vol. 11, pp. 153-165, Jan. 1999.
62. J. Yen and L. Wang, "Application of statistical information criteria for optimal fuzzy model construction," IEEE Trans. Fuzzy Syst., vol. 6, pp. 362-372, June 1998.
63. H. Ying, "General SISO Takagi-Sugeno fuzzy systems with linear rule consequent are universal approximators," IEEE Trans. Fuzzy Syst., vol. 6, pp. 582-587, Aug. 1998.
64. L. A. Zadeh, "Fuzzy sets," Inform, Control, vol. 8, pp. 338-353, 1965.
65. H.-J. Zimmermann, Fuzzy Set Theory and its Applications, Norwell, MA: Kluwer, 1991.