From minimum enclosing ball to fast fuzzy inference system training on large datasets

IEEE Transactions on Fuzzy Systems

Volumn 17, Issue 1, 2009, Pages 173-184

  Chung, Fu Lai ^a   Deng, Zhaohong ^b   Wang, Shitong ^b  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^b JIANGNAN UNIVERSITY   (China)

Author keywords

Core vector machine (CVM); Fuzzy inference systems (FISs); Gaussian mixture model (GMM); Minimum enclosing ball (MEB)

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); FUZZY INFERENCE; FUZZY SYSTEMS; LEARNING ALGORITHMS; MAGNETOSTRICTIVE DEVICES; MIXTURES; OBJECT RECOGNITION; SPHERES; SUPPORT VECTOR MACHINES; TRELLIS CODES; VECTORS;

A CENTERS; CORE VECTOR MACHINE (CVM); DATA MODELING; DATA SET SIZES; DENSITY ESTIMATORS; FUZZY INFERENCE SYSTEMS (FISS); GAUSSIAN MIXTURE MODEL (GMM); KERNEL METHODS; LARGE DATA SETS; MACHINE-LEARNING; MAMDANI; MINIMUM ENCLOSING BALL (MEB); MUTUAL TRANSFORMATIONS; PATTERN CLASSIFICATIONS; REAL DATA SETS; SCALABLE METHODS; SPACE COMPLEXITY; TIME COMPLEXITY; TRAINING ALGORITHMS; TRAINING METHODS; UPPER BOUNDS;

APPROXIMATION ALGORITHMS;

EID: 60549113059     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2008.2006620     Document Type: Article

References (38)

1. J. Yen and R. Langari, Fuzzy Logic: Intelligence,Control, and Information. Englewood Cliffs, NJ: Prentice Hall, 1999.
2. W. Pedrycz and F. Gomide, Fuzzy Systems Engineering. Hoboken, NJ: Wiley, 2007.
3. S. T. Wang, Neural-fuzzy Systems and Their Application. Beijing, China: Publishing House of Beijing Aeronautical University, 1998.
4. I. W. Tsang, J. T. Kwok, and P. M. Cheung, "Core vector machines: Fast SVMtraining on large datasets," J. Mach. Learn. Res., vol. 6, pp. 363-392, 2005.
5. M. Bǎdoiu and K. L. Clarkson, "Optimal core sets for balls," presented at the DIMACS Workshop Comput. Geom., Piscataway, NJ, Nov. 2002.
6. M. Bǎdoiu, S. Har-Peled, and P. Indyk, "Approximate clustering via core sets," in Proc. 34th Annu. ACM Symp. Theory Comput., Montreal, QC, Canada, 2002, pp. 250-257.
7. B. Schölkopf and A. J. Smola, Learning with Kernels. Cambridge, MA: MIT Press, 2001.
8. I. W. Tsang, J. T. Kwok, and J. M. Zurada, "Generalized core vector machines," IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 1126-1140, Sep. 2006.
9. D. Tax and R. Duin, "Support vector domain description," Pattern Recog. Lett., vol. 20, no. 14, pp. 1191-1199, 1999.
10. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
11. P. Kumar, J. S. B. Mitchell, and A. Yildirim, "Approximate minimum enclosing balls in high dimensions using core-sets," ACM J. Exp. Algorithmics, vol. 8, Article No. 1.1, 2003.
12. F. Nielsen and R. Nock, "Approximating smallest enclosing balls," in Proc. Int. Conf. Comput. Sci. Appl., vol. 3045, pp. 147-157, 2004.
13. S. Asharaf, M. N. Murty, and S. K. Shevade, "Multiclass core vector machine," in Proc. 24th ICML, Corvalis, OR, 2007, pp. 41-48.
14. I. W. Tsang, A. Kocsor, and J. T. Kwok, "Simpler core vector machines with enclosing balls," in Proc. 24th ICML, 2007, pp. 911-918.
15. M. Girolami and C. He, "Probability density estimation from optimally condensed data samples," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 10, pp. 1253-1264, Oct. 2003.
16. C. F. Lin and S. D. Wang, "Fuzzy support vector machine," IEEE Trans. Neural Netw., vol. 13, pp. 464-471, Mar. 2002.
17. J. H. Chiang and P. Y. Hao, "A new kernel-based fuzzy clustering approach: Support vector clustering with cell growing," IEEE Trans. Fuzzy Syst., vol. 11, no. 4, pp. 518-527, Aug. 2003.
18. Y. Chen and J. Z. Wang, "Support vector learning for fuzzy rule-based classification systems," IEEE Trans. Fuzzy Syst., vol. 11, no. 6, pp. 716-728, Dec. 2003.
19. S. M. Zhou and J. Q. Gan, "Constructing L2-SVM-based fuzzy classifiers in high-dimensional space with automatic model selection and fuzzy rule ranking," IEEE Trans. Fuzzy Syst., vol. 15, no. 3, pp. 398-409, Jun. 2007.
20. M. T. Gan, M. Hanmandlu, and A. Tan, "From a Gaussian mixture model to additive fuzzy systems," IEEE Trans. Fuzzy Syst., vol. 13, no. 3, pp. 303-316, Jun. 2005.
21. E. H. Mamdani, "Application of fuzzy logic to approximate reasoning using linguistic systems," IEEE Trans. Comput., vol. 26, no. 12, pp. 1182-1191, Dec. 1977.
22. P. M. Larsen, "Industrial applications of fuzzy logic control," Int. J. Man-Mach. Stud., vol. 12, pp. 3-10, 1980.
23. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its application to modeling and control," IEEE Trans. Syst., Man, Cybern., vol. SMC-15, no. 1, pp. 116-132, Jan. 1985.
24. M. F. Azeem,M. Hanmandlu, and N. Ahmad, "Generalization of adaptive neuro-fuzzy inference systems," IEEE Trans. Neural Netw., vol. 11, no. 6, pp. 1332-1346, Nov. 2000.
25. C. He and M. Girolami, "Novelty detection employing an L2 optimal nonparametric density estimator," Pattern Recog. Lett., vol. 25, no. 12, pp. 1389-1397, 2004.
26. G. McLachlan and D. Peel, Finite Mixture Models. New York: Wiley, 2000.
27. G. Kollios, D. Gunopulos, N. Koudas, and S. Berchtold, "Efficient biased sampling for approximate clustering and outlier detection in large datasets," IEEE Trans. Knowl. Data Eng., vol. 15, no. 5, pp. 1170-1187, Sep./Oct. 2003.
28. F. Sha, L. Saul, and D. D. Lee, "Multiplicative updates for nonnegative quadratic programming in support vector machines," Univ. Pennsylvania, Klingerstown, Tech. Rep. MSCIS-02-19, 2002.
29. B. Schölkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson, "Estimating the support of a high-dimensional distribution," Neural Comput., vol. 13, pp. 1443-1471, 2001.
30. A. Smola and B. Schölkopf, "Sparse greedy matrix approximation for machine learning," in Proc. 17th Int. Conf. Mach. Learn., Stanford, CA, Jun. 2000, pp. 911-918.
31. J.-S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference systems," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May 1993.
32. G. B. Huang, Q. Y. Zhu, and C. K. Siew, "Extreme learning machine: Theory and applications," Neurocomputing, vol. 70, no. 3, pp. 489-501, 2006.
33. P. D.Wasserman, Advanced Methods in Neural Computing. NewYork: Van Nostrand, 1993, pp. 155-161.
34. G. B. Huang, N. Y. Liang, H. J. Rong, P. Saratchandran, and N. Sundararajan, "On-line sequential extreme learning machine," in Proc. IASTED Int. Conf. Comput. Intell. (CI 2005), Calgary, Canada, Jul. 4-6, pp. 250-257.
35. J. S. R. Jang, C. T. Sun, and E.Mizutani, Neuro-Fuzzy and Soft-Computing. Upper Saddle River, NJ: Prentice-Hall, 1997.
36. F. L. Chung, S. T.Wang, Z. H. Deng, and D.W. Hu, "CATSMLP: Towards a robust and interpretable multilayer perceptron with sigmoid activation functions," IEEE Trans. Syst., Man Cybern. B, Cybern., vol. 36, no. 6, pp. 1319-1331, Dec. 2006.
37. G. E. P. Box and G. M. Jenkins, Time Series Analysis, Forecasting and Control, 2nd ed. San Francisco, CA: Holden Day, 1976.
38. (2008). [Online]. Available: http://www.liaad.up.pt/~ltorgo/Regression/ DataSets.html