Robust single-hidden layer feedforward network-based pattern classifier

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 12, 2012, Pages 1974-1986

  Man, Zhihong ^a   Lee, Kevin ^a   Wang, Dianhui ^b   Cao, Zhenwei ^a   Khoo, Suiyang ^c  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^b LA TROBE UNIVERSITY   (Australia)

^c DEAKIN UNIVERSITY   (Australia)

Author keywords

Discrete Fourier transform; feedforward networks; pattern classification; regularization theory

Indexed keywords

CLASSIFICATION SCHEME; FEED-FORWARD NETWORK; FREQUENCY COMPONENTS; LINEARLY SEPARABLE; NOISY ENVIRONMENT; PATTERN CLASSIFIER; REGULARIZATION THEORY; SIMULATION EXAMPLE;

DISCRETE FOURIER TRANSFORMS; PATTERN RECOGNITION; VECTORS;

NETWORK LAYERS;

EID: 84876918446     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2218616     Document Type: Article

References (38)

1. S. Haykin, Neural Networks and Learning Machines, 3rd ed. Englewood Cliffs, NJ: Prentice-Hall, 2009.
2. S. Haykin, Adaptive Filter Theory, 3rd ed. Englewood Cliffs, NJ: Prentice-Hall, 1996.
3. X. Yao, "Evolving artificial neural networks," Proc. IEEE, vol. 87, no. 9, pp. 1423-1447, Sep. 1999.
4. G. Zhang, "Neural networks for classification: A survey," IEEE Trans. Syst. Man Cybern. C, Appl. Rev., vol. 30, no. 4, pp. 451-462, Nov. 2000.
5. J. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computations. Reading, MA: Addison-Wesley, 1991.
6. D. H. Wang, Y.-S. Kim, S. C. Park, C. S. Lee, and Y. K. Han, "Learning based neural similarity metrics for multimedia data mining," Soft Comput., vol. 11, no. 4, pp. 335-340, 2007.
7. I. Mrazova and D. H. Wang, "Improved generalization of neural classifiers with enforced internal representation," Neurocomputing, vol. 70, nos. 16-18, pp. 2940-2952, Oct. 2007.
8. D. H. Wang and P. Bao, "Enhancing the estimation of plant Jacobian for adaptive neural inverse control," Neurocomputing, vol. 34, nos. 1-4, pp. 99-115, Sep. 2000.
9. P. Bao and D. H. Wang, "An edge-preserving image reconstruction using neural network," Int. J. Math. Imag. Vis., vol. 14, no. 2, pp. 117-130, Mar. 2001.
10. J. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computations. Reading, MA: Addison-Wesley, 1991.
11. Z. Man, S. Liu, H. Wu, and X. Yu, "A new adaptive back-propagation algorithm based on Lyapunov stability theory for neural networks," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1580-1591, Nov. 2006.
12. A. Hirose and S. Yoshida, "Generalization characteristics of complexvalued feedforward neural networks in relation to signal coherence," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 4, pp. 541-551, Apr. 2012.
13. R. Zhang, Y. Lan, G.-B. Huang, and Z.-B. Xu, "Universal approximation of extreme learning machine with adaptive growth of hidden nodes," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 2, pp. 365-371, Feb. 2012.
14. G.-B. Huang, L. Chen, and C. Siew, "Universal approximation using incremental constructive feedforaward neural networks with random hidden notes," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 879-892, Jul. 2006.
15. G.-B. Huang and H. A. Babri, "Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions," IEEE Trans. Neural Netw., vol. 9, no. 1, pp. 224-228, Jan. 1998.
16. G.-B. Huang, Q. Zhu, and C. Siew, "Extreme learning machine: Theory and application," Neurocomputing, vol. 70, nos.1-3, pp. 489-501, Dec. 2006.
17. G.-B. Huang, Q.-Y. Zhu, K. Z. Mao, C.-K. Siew, P. Saratchandran, and N. Sundararajan, "Can threshold networks be trained directly?" IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 53, no. 3, pp. 187-191, Mar. 2006.
18. G.-B. Huang and L. Chen, "Convex incremental extreme learning machine," Neurocomputing, vol. 70, nos. 16-18, pp. 3056-3062, Oct. 2007.
19. G.-B. Huang and L. Chen, "Enhanced random search based incremental extreme learning machine," Neurocomputing, vol. 71, nos. 16-18, pp. 3460-3468, Oct. 2008.
20. G.-B. Huang, D. H. Wang, and Y. Lan, "Extreme learning machines: A survey," Int. J. Mach. Learn. Cybern., vol. 2, no. 2, pp. 107-122, 2011.
21. W. Deng, Q. Zheng, and L. Chen, "Regularized extreme learning machine," in Proc. IEEE Symp. Comput. Intell. Data Mining, Mar. 2009, pp. 389-385.
22. M. Anthony and P. L. Bartlett, Neural Network Learning: Theoretical Foundations. Cambridge, U.K.: Cambridge Univ. Press, 1999.
23. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
24. L. Devroye, L. Gyorfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. New York: Springer-Verlag, 1996.
25. R. Duda and P. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
26. L. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth, 1984.
27. Z. Man, K. Lee, D. H. Wang, Z. Cao, and C. Miao, "A new robust training algorithm for a class of single hidden layer neural networks," Neurocomputing, vol. 74, no. 16, pp. 2491-2501, Sep. 2011.
28. K. Lee, Z. Man, D. H. Wang, and Z. Cao, "Classification of bioinformatics dataset using finite impulse response extreme learning machine for cancer diagnosis," Neural Comput. Appl., Jan. 2012, to be published.
29. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Trans. Syst., Man, Cybern., B, Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
30. S. M. Kuo, B. H. Lee, and W. Tian, Real-Time Digital Signal Processing. New York: Wiley, 2007.
31. C. H. Phillips, J. M. Parr, and E. A. Riskin, Signals, Systems and Transforms. Englewood Cliffs, NJ: Prentice-Hall, 2003.
32. S. Kumar, Neural Networks. New York: McGraw-Hill, 2006.
33. I. W. Sandberg, "Approximation theorems for discrete-time systems," IEEE Trans. Circuits Syst., vol. 38, no. 5, pp. 564-566, May 1991.
34. S. S. Rao, Engineering Optimization: Theory and Practice. New York: Wiley, 1996.
35. F. S. Hillier and G. J. Lieberman, Introduction to Operations Research. New York: McGraw-Hill, 2005.
36. F. Girosi, M. Joenes, and T. Poggio, "Regularization theory and neural networks architectures," Neural Comput., vol. 7, no. 2, pp. 219-269, 1995.
37. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
38. K. Ogata, Modern Control Engineering, 4th ed. Englewood Cliffs, NJ: Prentice-Hall, 2002.