A sequential learning algorithm for self-adaptive resource allocation network classifier

Neurocomputing

Volumn 73, Issue 16-18, 2010, Pages 3012-3019

  Suresh, S ^a   Dong, Keming ^b   Kim, H J ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b Korea University   (South Korea)

Author keywords

Extended Kalman filter; Multi category classification; Resource allocation network; Self adaptive control parameters; Sequential learning

Indexed keywords

CLASSIFICATION PERFORMANCE; COMPUTATION TIME; CONTROL PARAMETERS; DECISION FUNCTIONS; IMBALANCED DATA SETS; MISCLASSIFICATIONS; MULTI-CATEGORY CLASSIFICATION; NETWORK PARAMETERS; PERFORMANCE EVALUATION; RESOURCE ALLOCATION NETWORK; SELF ADAPTIVE CONTROL; SELF-ADAPTIVE; SEQUENTIAL LEARNING; SEQUENTIAL LEARNING ALGORITHM; TRAINING DATA; TRAINING SAMPLE; TRAINING TIME;

CLASSIFICATION (OF INFORMATION); CLASSIFIERS; CONTROL SYSTEM ANALYSIS; EXTENDED KALMAN FILTERS; LEARNING ALGORITHMS; NETWORK ARCHITECTURE; POSITION CONTROL; RESOURCE ALLOCATION; SPEECH RECOGNITION;

ADAPTIVE CONTROL SYSTEMS;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; DATA ANALYSIS; LEARNING ALGORITHM; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; PREDICTION; PRIORITY JOURNAL; SAMPLING ERROR; SELF ADAPTIVE RESOURCE ALLOCATION NETWORK; SEQUENTIAL ANALYSIS;

EID: 78649975292     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.07.003     Document Type: Article

References (23)

1. Amari S. Theory of adaptive pattern classifiers. IEEE Trans. EC 1967, 16(3):299-307.
2. C. Blake, C. Merz, UCI repository of machine learning databases, University of California, Irvine, Department of Information and Computer Sciences URL: (〈〉), 1998). http://archive.ics.uci.edu/ml/.
3. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, National Taiwan University, Taiwan, Department of Computer Science and Information Engineering, URL 2003. http://www.csie.ntu.edu.tw/cjlin/libsvm/.
4. Cristianini N., Taylor J.S. An Introduction to Support Vector Machines 2000, Cambridge University Press, Cambridge, UK.
5. Suresh S., Sundararajan N., Saratchandran P. A sequential multi-category classifier using radial basis function networks. Neurocomputing 2008, 71(1):1345-1358.
6. Huang G.-B., Saratchandran P., Sundararajan N. An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks. IEEE Trans. Syst., Man Cybern., Part B 2004, 34(6):2284-2292.
7. Kadirkamanathan V., Niranjan M. A function estimation approach to sequential learning with neural networks. Neural Comput. 1993, 5:954-975.
8. Liang N.-Y., Huang G.-B., Saratchandran P., Sundararajan N. A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans. Neural Networks 2006, 17(6):1411-1423.
9. Lu Y.W., Sundararajan N., Saratchandran P. A sequential minimal radial basis function (RBF) neural network learning algorithm. IEEE Trans. Neural Networks 1998, 9(2):308-318.
10. Huang G.-B., Chen L. Convex incremental extreme learning machine. Neurocomputing 2007, 70(16-18):3056-3062.
11. Platt J.C. A resource allocating network for function interpolation. Neural Comput. 1991, 3(2):213-225.
12. Yan L., Sundararajan N., Saratchandran P. Analysis of minimal radial basis function network algorithm for real-time identification of nonlinear dynamic systems. IEE Proc. Part-D: Control Theory Appl. 2000, 147(4):476-484.
13. Lu Y., Sundararajan N., Saratchandran P. A sequential learning scheme for function approximation using minimal radial basis function (RBF) neural networks. Neural Comput. 1997, 9(2):461-478.
14. Fritzke B. Fast learning with incremental radial basis function networks. Neural Process. Lett. 1994, 1(1):2-5.
15. B. Fritzke, A growing neural gas network learns topologies, in: G. Tesauro, D.S. Touretzky, T.K. Leen (Eds.), Advances in Neural Information Processing Systems, vol. 7, 1995, pp. 625-632.
16. Engelbrecht A.P. A new pruning heuristic based on variance analysis of sensitivity information. IEEE Trans. Neural Networks 2001, 12(6):1386-1399.
17. Suresh S., Sundararajan N., Saratchandran P. Risk sensitive hinge loss functions for sparse multi-category classification problems. Inf. Sci. 2008, 178(12):2621-2638.
18. Zhang T. Statistical behavior and consistency of classification methods based on convex risk minimization. Ann. Stat. 2003, 32(1):56-85.
19. Suresh S., Babu R.V., Kim H.J. No-reference image quality assessment using modified extreme learning machine classifier. Appl. Soft Comput. 2009, 9(2):541-552.
20. Cauwenberghs G., Poggio T. Incremental and decremental support vector machine learning. Advances in Neural Information Processing Systems (NIPS 2000) 2001, vol. 13. MIT Press, Cambridge, MA.
21. Puskorius G.V., Feldkamp L.A. Neurocontrol of nonlinear dynamics systems with Kalman filter trained recurrent networks. IEEE Trans. Neural Networks 1994, 5(2):279-297.
22. Babu R.V., Suresh S., Makur A. Online adaptive radial basis function networks for robust object tracking. Comput. Vision Image Understanding 2010, 114(3):297-310.
23. Suresh S., Saraswathi S., Sundararajan N. Performance enhancement of extreme learning machine for multi-category sparse data classification problems. Eng. Appl. Artif. Intell. 2010, 23(7):1149-1157.