An ε-Margin Nonlinear Classifier Based on Fuzzy if-then Rules

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 34, Issue 1, 2004, Pages 68-76

  Łȩski, Jacek M ^a,b  

^a SILESIAN UNIVERSITY OF TECHNOLOGY   (Poland)

^b INSTITUTE OF MEDICAL TECHNOLOGY AND EQUIPMENT   (Poland)

Author keywords

Classifier design; Committee machines; Fuzzy if then rules; Local and global learning; VCtheory

Indexed keywords

APPROXIMATION THEORY; CHARACTER RECOGNITION; CLASSIFIERS; COMMUNICATION; COMPUTER VISION; DATA MINING; DATABASE SYSTEMS; DIAGNOSIS; FUNCTIONS; FUZZY SETS; LEARNING SYSTEMS; PARAMETER ESTIMATION; PROBLEM SOLVING; ROBUSTNESS (CONTROL SYSTEMS);

CLASSIFIER DESIGN; COMMITTEE MACHINES; FUZZY IF-THEN RULES; LOCAL AND GLOBAL LEARNING; VAPNIK-CHERVONENKIS (VC) THEORY;

PATTERN RECOGNITION;

EID: 10744225883     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2002.805811     Document Type: Article

References (32)

1. P. L. Bartlett, "For valid generalization, the size of the weights is more important than the size of the network," Neural Inform. Process. Syst., vol. 9, pp. 134-140, 1997.
2. _, "The sample complexity of pattern classification with neural networks: The size of the weights is more important then the size of network," IEEE Trans. Inform. Theory, vol. 44, pp. 525-536, Feb. 1998.
3. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. New York: Plenum, 1982.
4. B. Boser, I. Guyon, and V. Vapnik, "A training algorithm for optimal margin classifiers," in Proc. 5th Annu. Workshop Comput. Learning Theory, Pittsburgh, PA, 1992, pp. 144-152.
5. G. Cauwenberghs and T. Poggio, "Incremental and decremental support vector machine learning," in Advanced Neural Information Processing Systems. Cambridge, MA: MIT Press, 2001, vol. 13.
6. E. Czogala and J. Leski, Fuzzy and Neuro-Fuzzy Intelligent Systems. Heidelberg, Germany: Physica-Verlag, Springer-Verlag, 2000.
7. L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. New York: Springer-Verlag, 1996.
8. R. Detrano, A. Janosi, W. Steinbrunn, M. Pfisterer, J. Schmid, S. Sandhu, K. Guppy, S. Lee, and V. Froelicher, "International application of a new probability algorithm for the diagnosis of coronary artery disease," Amer. J. Cardiol., vol. 64, pp. 304-310, 1989.
9. T. G. Dietterich, "Ensemble learning," in The Handbook of the Brain Theory and Neural Networks, 2nd ed, M. A. Arbib, Ed. Cambridge, MA: MIT Press, 2002.
10. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
11. K. Fukunaga, Introduction to Statistical Pattern Recognition. San Diego, CA: Academic, 1990.
12. G. H. Golub and C. F. Van Loan, Matrix Computations. Baltimore, MD: Johns Hopkins Univ. Press, 1989.
13. R. Herbrich, T. Graepel, and C. Campbell, "Bayes point machines," J. Machine Learning Res., vol. 1, pp. 245-279, 2001.
14. S. Haykin, Neural Networks. A Comprehensive Foundation, 2nd ed. Upper Saddle River: Prentice-Hall, 1999.
15. Y.-C. Ho and R. L. Kashyap, "An algorithm for linear inequalities and its applications," IEEE Trans. Elect. Comput., vol. 14, pp. 683-688, 1965.
16. _, "A class of iterative procedures for linear inequalities," J.SIAM Contr., vol. 4, pp. 112-115, 1966.
17. P. J. Huber, Robust Statistics. New York: Wiley, 1981.
18. T. Joachims, "Making large-scale support vector machine learning practical," in Advances in Kernel Methods - Support Vector Learning, B. Schölkopf, J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 169-184.
19. Y. Liu and X. Yao, "Ensemble learning via negative correlation," Neural Networks, vol. 12, pp. 1399-1404, 1999.
20. O. L. Mangasarian and D. R. Musicant, "Lagrangian Support Vector Machines," Data Mining Inst., Comput. Sci. Dept., Univ. Wisconsin, Madison, WI, 00-06, 2000.
21. D. Miller, A. V. Rao, K. Rose, and A. Gersho, "A global optimization technique for statistical classifier design," IEEE Trans. Signal Processing, vol. 44, pp. 3108-3121, Dec. 1996.
22. N. J. Nilsson, Learning Machines: Foundations of Trainable Pattern-Classifying Systems. New York: McGraw-Hill, 1965.
23. E. Osuna, R. Freund, and F. Girosi, "An improved training algorithm for support vector machines," Proc. IEEE Workshop Neural Networks Signal Process., pp. 276-285, 1997.
24. J. Platt, "Sequential minimal optimization: A fast algorithm for training support vector machines," in Advances in Kernel Methods - Support Vector Learning, B. Schölkopf, J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 185-208.
25. B. D. Ripley, Pattern Recognition and Neural Networks. Cambridge, U.K.: Cambridge Univ. Press, 1996.
26. S. B. Thrun, J. Bala, E. Bloedorn, I. Bratko, B. Cestnik, J. Cheng, K. De Jong, S. Deroski, S. E. Fahlman, D. Fisher, R. Hamann, K. Kaufman, S. Keller, I. Kononenko, J. Kreuziger, R. S. Michalski, T. Mitchell, P. Pachowicz, Y. Reich, H. Vafaie, W. Van de Welde, W. Wenzel, J. Wnek, and J. Zhang, "The MONK'S problems. A performance comparison of different learning algorithms," Carnegie Mellon Univ., Pittsburgh, PA, Scientific Rep. CMU-CS-91-197, 1991.
27. V. Tresp, "Scaling kernel-based systems to large data sets," Data Mining Knowledge Discovery, vol. 5, no. 3, pp. 1-18, 2001.
28. J. T. Tou and R. C. Gonzalez, Pattern Recognition Principles. London, U.K.: Adison-Wesley, 1974.
29. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
30. _, Statistical Learning Theory. New York: Wiley, 1998.
31. _, "An overview of statistical learning theory," IEEE Trans. Neural Networks, vol. 10, pp. 988-999, May 1999.
32. A. Webb, Statistical Pattern Recognition. London, U.K.: Arnold, 1999.