Extreme learning machine with fuzzy activation function

NCM 2009 - 5th International Joint Conference on INC, IMS, and IDC

Volumn , Issue , 2009, Pages 303-307

  Hieu, Trung Huynh ^a   Yonggwan, Won ^a  

^a Chonnam National University   (South Korea)

Author keywords

Activation function; Extreme learning machine; Fuzzy; SLFN

Indexed keywords

ACTIVATION FUNCTIONS; EFFICIENT LEARNING; EXTREME LEARNING MACHINE; GRADIENT-DESCENT; HARDWARE IMPLEMENTATIONS; HIDDEN LAYERS; INPUT WEIGHTS; ITERATIVE PROCESS; LEARNING SPEED; NETWORK WEIGHTS; NONLINEAR ACTIVATION FUNCTIONS; RANDOM CHOICE; REAL APPLICATIONS; SIGMOIDAL ACTIVATION FUNCTIONS; SINGLE-HIDDEN LAYER FEEDFORWARD NEURAL NETWORKS;

HARDWARE; INFORMATION MANAGEMENT; LEARNING SYSTEMS; NEURAL NETWORKS; RADIAL BASIS FUNCTION NETWORKS; SEMICONDUCTOR STORAGE;

LEARNING ALGORITHMS;

EID: 73549097097     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NCM.2009.206     Document Type: Conference Paper

References (20)

1. D. Nguyen and B. Widrow, "Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights", Int'l Joint Conf. Neural Neural Networks, vol. 3, San Diego, CA, (1990) 21-26.
2. Jim Y. F. Yam and Tommy W. S. Chow, "Feedforward Networks Training Speed Enhancement by Optimal Initialization of the Synaptic Coefficients", IEEE Trans. On Neural NetWorks, vol. 12, no. 2, (2001) 430-434.
3. Karayiannis and A. N. Venetsanopoulos, "Artificial neural networks: learning algorithms, performance evaluation, and applications", Kluver Academic (Boston, MA, 1993).
4. Y. LeCun, L. Bottou, G. B. Orr, and K.-R. Müller, "Efficient backprop", Lecture Notes in Computer Science, Vol. 1524, (1998) 9-50.
5. Syed Muhammad Aqil Burney, Tahseen Ahmed Jilani, and Cemal Ardil, "A Comparison of First and Second Order Training Algorithms for Artificial Neural Networks", International Journal of Computational Intelligence, Vol. 1, (2004) 218-224.
6. L. S. Nghia, J. Sjöberg and M. Viberg, "Adaptive neural nets filter using a recursive levenberg-marquardt search direction", Proc. Asilomar Conf. Signals, Syst., Comput., vol. 1-4, (Nov. 1998) 697-701.
7. G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, "Extreme learning machine: Theory and applications", Neurocomputing, vol. 70 (2006) 489-501.
8. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximatiors", Neural Networks, vol. 2, pp. 359-366, 1989.
9. G. Cybenko, "Approximation by superpositions of a sigmoidal function", Mathematics of Control, Signals and Systems, vol. 2, no. 4, pp. 303-314, 1989.
10. K. Funahashi, " On the approximate realization of continuous mappings by neural networks", Neural Networks, vol. 2, pp. 183-192, 1989.
11. K. Hornik, "Approximation capabilities of multilayer feedforward networks," Neural Networks, vol. 4, pp. 251-257, 1991.
12. M. Leshno, V. Y. Lin, A. Pinkus, and S. Schocken, "Multilayer feedforward networks with a nonpolynomial activation function can approximate any function," Neural Networks, vol. 6, pp. 861-867, 1993.
13. Y. Ito, "representation of functions by superpositions of a step or sigmoidal function and their applications to neural network theory", Neural networks, vol. 4, pp. 385-394, 1991.
14. d by linear combinations of shifted rotations of a sigmoid function with and without scaling," Neural Networks, vol. 5, pp. 105-115, 1992.
15. -n) by multilayer feedforward networks and related problems", IEEE Trans. on Neural Networks, vol. 6, no. 1, pp.25-30, 1995.
16. G.-B. Huang and H. A Babri, "General Approximation Theorem on Feedforward Networks", Proc. of Int'l Conf. on Information, Communication and Signal Processing (ICIS'97), 1997, pp. 698-702.
17. G.-B. Huang and H. A. Babri, "Upper bounds on the number of hidden Neurons in Feedforward Networks with arbitrary bounded nonlinear activation functions", IEEE Trans. on Neural Systems, vol. 9, no. 1, 1998, pp.224-229.
18. D. Serre, "Matrices: Theory and Applications", Springer, (New York, 2002).
19. Emilio Soria-Olivas, José D. Martín-Guerrero, Gustavo Camps-Valls, Antonio J. Serrano-López, Javier Calpe-Maravilla, and Luis Gómez-Chove, "A Low-Complexity Fuzzy Activation Function", IEEE Trans. on Neural Networks, vol. 14, no. 6, 2003, pp. 1576-1579.
20. C. J. Merz and P. M. Murphy, "UCI Repository of machine learning databases", Dept. of Inform. Comp. Sci., Univ. California. Available: http://mlearn.ics.uci.edu/databases/