Regularized online sequential learning algorithm for single-hidden layer feedforward neural networks

Pattern Recognition Letters

Volumn 32, Issue 14, 2011, Pages 1930-1935

  Huynh, Hieu Trung ^a,b,c   Won, Yonggwan ^a  

^a Chonnam National University   (South Korea)

^b Ho Chi Minh City University of Industry   (Viet Nam)

^c NGUYEN TAT THANH UNIVERSITY   (Viet Nam)

Author keywords

ELM; Multiobjective training algorithms; Neural networks; Online learning algorithm; OS ELM; ReOS ELM

Indexed keywords

ELM; MULTIOBJECTIVE TRAINING ALGORITHMS; ONLINE LEARNING ALGORITHM; OS-ELM; REOS-ELM;

E-LEARNING; LEARNING SYSTEMS; NETWORK LAYERS; NEURAL NETWORKS; PROBLEM SOLVING; RADIAL BASIS FUNCTION NETWORKS;

LEARNING ALGORITHMS;

EID: 80052829448     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2011.07.016     Document Type: Article

References (24)

1. L. Bartlett The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network IEEE Trans. Inform. Theory 44 2 1998 525 536
2. J. Demsar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30 (Pubitemid 43022939)
3. E. DeVito, A. Caponnetto, and L. Rosasco Model selection for regularized least-squares algorithm in learning theory Foundations of Computational Mathematics vol. 5 2005 Springer-Verlag New York pp. 59-85, No. 1
4. O.J. Dunn Multiple comparisons among means J. Amer. Statist. Assoc. 56 1961 52 64
5. Frank, A., Asuncion, A., 2010. UCI Machine learning repository. Irvine, University of California. .
6. N.P. Galatsanos, and A.K. Katsaggelos Methods for choosing the regularization parameter and estimating the noise variance in image restoration and their relation IEEE Trans. Image Process. 1 3 1992 322 336
7. Gene H. Golub, and Charles F. van Loan Matrix Computations 3rd ed. 1996 Johns Hopkins University Press Baltimore
8. G.-B. Huang, and C.-K. Siew Extreme learning machine with randomly assigned RBF kernels Internat. J. Inform. Technol. 11 2005 16 24
9. G.-B. Huang, P. Saratchandran, and N. Sundararajan An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks IEEE Trans. Systems Man Cybernet., B, Cybern. 34 6 2004 2284 2292
10. G.-B. Huang, P. Saratchandran, and N. Sundararajan A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation IEEE Trans. Neural Networks 16 1 2005 57 67 (Pubitemid 40241910)
11. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew Extreme learning machine: Theory and applications Neurocomputation 7 2006 489 501 (Pubitemid 44615772)
12. V. Kadirkamanathan, and M. Niranjan A function estimation approach to sequential learning with neural networks Neural Comput. 5 1993 954 975
13. I. Kokshenev, and A.P. Braga A multi-objective approach to RBF network learning Neurocomputing 71 2008 1203 1209
14. Y. LeCun, L. Bottou, G.B. Orr, and K.-R. Muller Efficient BackProp Lect. Notes Comput. Sci. 1524 1998 9 50 (Pubitemid 128162408)
15. N.-Y. Liang, G.-H. Huang, P. Saratchandran, and N. Sundararajan A fast and accurate online sequential learning algorithm for feedforward networks IEEE Trans. Neural Networks 17 2006 1411 1423 (Pubitemid 44824256)
16. Matlab Toolboxes. The Mathworks, Natick, MA. Available from: .
17. Nemenyi, P.B., 1963. Distribution-free multiple comparisons. PhD thesis, Princeton University.
18. Rosasco, L., Caponnetto, A., De Vito, E., De Giovannini, U., Odone, F., 2004. Learning, regularization and ill-posed inverse problems. In: The 18th Conf. on Neural Information Processing Systems, NIPS2004.
19. V. Strassen Gaussian elimination is not optimal Numer. Math. 13 1969 354 356
20. R. de A. Teixeira, A.P. Braga, Ricardo H.C. Takahashi, and R.R. Saldanha Improving generalization of MLPs with multi-objective optimization Neurocomputing 35 2000 189 194
21. A.N. Tikhonov, and A.V. Arsenin Solution of Ill-Posed Problems 1977 Winston & Son Washington
22. D.A.G. Vieira, J.A. Vasconcelos, and W.M. Caminhas Controlling the parallel layer perceptron complexity using a multiobjective learning algorithm Neural Comput. Appl. 16 2007 317 325
23. D.A.G. Vieira, Ricardo H.C. Takahashi, V. Palade, J.A. Vasconcelos, and W.M. Caminhas The Q-norm complexity measure and the minimum gradient method: A novel approach to the machine learning structural risk minimization problem IEEE Trans. Neural Networks 19 8 2008 1415 1430
24. L. Yingwei, N. Sundararajan, and P. Saratchandran Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm IEEE Trans. Neural Networks 9 2 1998 308 318 (Pubitemid 128743638)