Fast modular network implementation for support vector machines

IEEE Transactions on Neural Networks

Volumn 16, Issue 6, 2005, Pages 1651-1663

  Huang, Guang Bin ^a   Mao, K Z ^a   Siew, Chee Kheong ^a   Huang, De Shuang ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b INSTITUTE OF INTELLIGENT MACHINES   (China)

Author keywords

Large complex problems; Modular network; Neural quantizer modular; Region computing; Support vector machines (SVMs)

Indexed keywords

APPROXIMATION THEORY; COMPUTATIONAL COMPLEXITY; LAGRANGE MULTIPLIERS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MATHEMATICAL MODELS; OPTIMIZATION;

LARGE COMPLEX PROBLEM; MODULAR NETWORK; NEURAL QUANTIZER MODULAR; REGION COMPUTING; SUPPORT VECTOR MACHINES;

FEEDFORWARD NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; METHODOLOGY; THEORETICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 28244472255     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2005.857952     Document Type: Article

References (27)

1. E. Osuna, R. Freund, and F. Girosi, "Training support vector machines: an application to face detection," in Proc. CVPR'97, Jun. 17-19, 1997.
2. T. Joachims, "Making large-scale support vector machine learning practical," in Advances in Kernel Methods: Support Vector Machines, B. Schölkopf, C. Burges, and A. Smola, Eds. Cambridge: MIT Press, 1998.
3. A. Smola and B. Schölkopf, "A Tutorial on Support Vector Regression,", NeuroCOLT2 Tech. Rep. NC2-TR-1998-030, 1998.
4. J.-X. Dong, C. Y. Suen, and A. Krzyzak, "A fast SVM training algorithm," Int. J. Pattern Recogn. Artif. Intell., vol. 17, no. 3, pp. 367-384, 2003.
5. light - Support Vector Machine. Dep. Computer Science, Cornell Univ., Ithaca, NY [Online] http:// svm-light.joachims.org/
6. R. Collobert, S. Bengio, and Y. Bengio, "A parallel mixtures of SVMs for very large scale problems," Neural Comput., vol. 14, pp. 1105-1114, 2002.
7. R. Collobert, Y. Bengio, and S. Bengio, "Scaling large learning problems with hard parallel mixtures," Int. J. Pattern Recogn. Artific. Intell., vol. 17, no. 3, pp. 349-365, 2003.
8. V. Tresp, "A Bayesian committee machine," Neural Comput., vol. 12, pp. 2719-2741, 2000.
9. V. Tresp, "Scaling kernel-based systems to large data sets," Data Mining and Knowledge Discovery, vol. 5, no. 3, 2001.
10. G.-B. Huang, "Learning capability and storage capacity of two-hidden-layer feedforward networks," IEEE Trans. Neural Netw., vol. 14, no. 2, pp. 274-281, 2003.
11. J. T.-Y. Kwok, "Support vector mixture for classification and regression problems," in Proc. Int. Conf. Pattern Recogn. (ICPR'98), Brisbane, Australia, Aug. 1998, pp. 255-258.
12. M. Schmitt, "On the complexity of computing and learning with multiplicative neural networks," Neural Comput., vol. 14, pp. 241-301, 2001.
13. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
14. V. N. Vapnik Statistical Learning Theory. New York: Wiley, 1998.
15. C. Cortes and V. N. Vapnik, "Support vector networks," Machine Learning, vol. 20, pp. 273-297, 1995.
16. S. Haykin, Neural Networks: A Comprehensive Foundation. Englewood Cliffs, NJ: Prentice-Hall, 1999.
17. J. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods: Support Vector Machines, B. Schölkopf, C. Burges, and A. Smola. Eds. Cambridge: MIT Press, 1998.
18. C.-C. Chang and C.-J. Lin. (2003) LIBSVM - A Library for Support Vector Machines. Dep. Computer Science and Information Engineering, National Taiwan Univ., Taiwan. [Online] http://www.csie.ntu.edu.tw/~cjlin/libsvm/
19. J. Platt, "Sequential minimal optimization: A fast algorithm for training support vector machines,", Microsoft Res. Tech. Rep. MSR-TR-98-14, 1998.
20. S. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy, "Improvement to Platt's SMO algorithm for SVM classifier design," Neural Comput., vol. 13, pp. 637-649, 2001.
21. Y. LeCun. (2003) The MNIST Database of Handwritten Digits. NEC Res. Inst., [Online] http://yann.lecun.com/exdb/mnist/
22. K.-M. Lin and C.-J. Lin, "A study on reduced support vector machines," IEEE Trans. Neural Netw., vol. 14, no. 6, pp. 1449-1459, 2003.
23. C. Blake and C. Merz. (1998) UCI Repository of Machine Learning Databases. Dep. Information and Computer Sciences. Univ. California, Irvine. [Online] http://www.ics.uci.edu/~mlearn/MLRepository.html
24. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, "Adaptive mixtures of local experts," Neural Comput., vol. 3, pp. 79-87, 1991.
25. M. I. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithm," Neural Comput., vol. 6, pp. 181-214, 1994.
26. Y. LeCun, L. Bottou, G. B. Orr, and K.-R. Müller. Efficient backprop, in Lecture notes in computer science (also from cite-seer.ist.psu.edu/lecun98efficient.html), vol. 1524, pp. 9-50, 1998.
27. G.-B. Huang and C.-K. Siew, "Extreme learning machine: RBF network case," in Proc. 8th Int. Conf. Control, Automation, Robotics and Vision, (ICARCV 2004), Kunming, China, Dec. 6-9, 2004.