An improvement of extreme learning machine for compact single-hidden-layer feedforward neural networks

International Journal of Neural Systems

Volumn 18, Issue 5, 2008, Pages 433-441

  Huynh, Hieu Trung ^a   Won, Yonggwan ^a   Kim, Jung Ja ^b  

^a Chonnam National University   (South Korea)

^b Chonbuk National University   (South Korea)

Author keywords

Compact SLFN; Extreme learning machine; Neural networks; Regularized least squares

Indexed keywords

ALGORITHMS; CURVE FITTING; EDUCATION; EVOLUTIONARY ALGORITHMS; FEEDFORWARD NEURAL NETWORKS; LEARNING SYSTEMS; NEURAL NETWORKS; POWDERS;

ANALYTICAL DETERMINATIONS; COMPACT SLFN; DATA SETS; DIFFERENTIAL EVOLUTION ALGORITHMS; EXTREME LEARNING MACHINE; EXTREME LEARNING MACHINES; GENERALIZATION PERFORMANCES; HIDDEN LAYERS; HIDDEN UNITS; HIGH SPEEDS; INPUT FEATURES; INPUT WEIGHTS; ITERATIVE PROCESSES; NEW APPROACHES; OPTIMAL PARAMETERS; OUTPUT WEIGHTS; RANDOM CHOICES; REAL APPLICATIONS; REGULARIZED LEAST SQUARES;

LEARNING ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER PROGRAM; COMPUTER SIMULATION; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; SOFTWARE;

EID: 55749087656     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065708001695     Document Type: Article

References (28)

1. D. Nguyen and B. Widrow, Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights, Int.'l Joint Conf. Neural Networks, Vol. 3 (San Diego, CA, 1990), pp. 21-26.
2. Jim Y. F. Yam and Tommy W. S. Chow. Feedforward networks training speed enhancement by optimal initialization of the synaptic coefficients, IEEE Trans. on Neural Networks 12 (2) (2001) 430-434.
3. Karayiannis and A. N. Venetsanopoulos, "Artificial neural networks: Learning algorithms, performance evaluation, and applications, Kluver Academic, Boston, MA, (1993).
4. Y. LeCun, L. Bottou, G. B. Orr and K.-R. Müller, Efficient backprop, Lecture Notes in Computer Science 1524 (1998) 9-50.
5. Syed Muhammad Aqil Burney, Tahseen Ahmed Jilani and Genial Ardil, A comparison of first and second order training algorithms for artificial neural networks, International Journal of Computational Intelligence 1 (2004) 218-224.
6. L. S. Nghia, J. Sjöberg and M. Viberg, Adaptive neural nets filter using a recursive levenbergmarquardt search direction, Proc. Asilomar Conf. Signals, Syst., Comput. 1-4 (Nov. 1998) 697-701.
7. S. Dumais, J. Platt and D. Heckerman, Inductive learning algorithms and representations for text categorization, Proc. Int'l Conf. Information and Knowledge Management (1998) 148-154.
8. C. W. Hsu and C. J. Lin, A comparison of methods for multi-class support vector machines, IEEE Trans. on Neural Networks 13 (2) (2002) 415-425.
9. Shu-Xia Lu and Xi-Zhao Wang, A Comparison among four SVM Classification Methods: LSVM, NLSVM, SSVM and NSVM, Proc. of Int'l Conf. on Machine Learning and Cybernetics, (August 2004) 4277-4282.
10. T. Joachims, Text categorization with support vector machines: Learning with many relevant features, Proc. Eur. Conf. Machine Learning (1998) 137-142.
11. O. Chapelle, V. Vapnik, O. Bousquet and S. Mukherjee, Choosing multiple parameters for support vector machines, Machine Learning 46 (1) (2002) 131-159.
12. D. Decoste and K. Wagstaff, Alpha seeding for support vector machines, Proc. Int'l Conf. Knowledge Discovery and Data Mining (2000) 345-349.
13. S. S. Keerthi, Efficient tuning of SVM hyperparameters using radius/margin bound and iterative algorithms, IEEE Trans. Neural Networks 13 (5) (2002) 1225-1229.
14. G.-B. Huang, Y.-Q. Chen and H. A. Babri, Classification ability of single hidden layer feedforward neural networks, IEEE Trans. on Neural Networks 11 (3) (2000) 799-801.
15. G.-B. Huang, L. Chen and C.-K. Siew, Universal approximation using incremental constructive feedforward networks with random hidden nodes, IEEE Trans. on Neural Networks 17 (4) (2006) 879-892.
16. G.-B. Huang and L. Chen, Convex incremental extreme learning machine, Neurocomputing 70 (2007) 3056-3062.
17. G.-B. Huang, Q.-Y. Zhu and C.-K. Siew, Extreme learning machine: Theory and applications, Neurocomputing 70 (2006) 489-501.
18. G.-B. Huang, Q.-Y. Zhu and C.-K. Siew, Extreme learning machine: A new learning scheme for feedforward neural networks, Proc. of Int'l Joint Conf. on Neural Networks, (July 2004).
19. Q.-Y. Zhu, A. K. Qin, P. N. Suganthan and G.-B. Huang, Evolutionary extreme learning machine, Pattern Recognition 38 (2005) 1759-1763.
20. D. Serre, Matrices: Theory and Applications, Springer (New York, 2002).
21. R. Storn and K. Price, Differential evolution - A simple and efficient heuristic for global optimization over continuous spaces, Journal of Global Optimization 11 (1997) 341-359.
22. A. N. Tikhonov and A. V. Arsenin, Solution of ill-posed Problems, (Winston & Son, Washingston, 1977).
23. P. L. Bartlett, The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network, IEEE Trans. On Inform. Theory 44 (2) (1998) 525-536.
24. R. Ghosh and B. Verma, A hierarchical method for finding optimal architecture and weights using evolutionary least square based learning, International Journal of Neural Systems 12 (2003) 13-24.
25. C. J. Merz and P. M. Murphy, UCI Repository of machine learning databases, Dept. of Inform. Comp. Sci., Univ. California. Available: http://mlearn.ics.uci.edu/databases/
26. T. R. Golub, D. K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J. P. Mesirov, H. Coller, M. L. Loh, J. R. Downing, M. A. Caligiuri, C. D. Bloomfield and E. S. Lander, Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring, Science 286 (5439) (1999) 531-537.
27. D. Singh, P. G. Febbo, K. Ross, D. G. Jackson, J. Manola, C. Ladd, P. Tamayo, A. A. Renshaw, A. von D'Amico, J. P. Richie, E. S. Lander, M. Loda, P. W. Kantoff, T. R. Golub and W. R. Sellers, Gene expression correlates of clinical prostate cancer behavior, Cancer Cell 1 (2002) 203-209.
28. L. J. Van, T. Veer, H. Dai, M. J. V. De Vijver, Y. D. He, A. A. M. Hart, M. Mao, H. L. Peterse, K. V. Der Kooy, M. J. Marton, A. T. Witteveen, G. J. Schreiber, R. M. Kerkhoven, C. Roberts, P. S. Linsley, R. Bernards and S. H. Friend, Gene expression profiling predicts clinical outcome of breast cancer, Nature 415 (2002) 530-536.