Evolutionary algorithm for training compact single hidden layer feedforward neural networks

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2008, Pages 3028-3033

  Huynh, Hieu Trung ^a   Won, Yonggwan ^a  

^a Chonnam National University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

CURVE FITTING; EVOLUTIONARY ALGORITHMS; FEEDFORWARD NEURAL NETWORKS; LEARNING ALGORITHMS; LEARNING SYSTEMS; POWDERS;

DIFFERENTIAL EVOLUTION ALGORITHMS; EXTREME LEARNING MACHINES; FUNCTION APPROXIMATIONS; GENERALIZATION PERFORMANCES; HIDDEN LAYERS; HIDDEN UNITS; INPUT WEIGHTS; INVERSION OPERATIONS; LEARNING SPEEDS; LEAST SQUARES SCHEMES; NEW APPROACHES; OUTPUT WEIGHTS; RANDOM SELECTIONS; TRAINING ALGORITHMS;

NEURAL NETWORKS;

EID: 56349113344     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2008.4634225     Document Type: Conference Paper

References (17)

1. D. Nguyen and B. Widrow, "Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights", Int'l Joint Conf. Neural Neural Networks, vol. 3, San Diego, CA, 1990, pp.21-26.
2. Jim Y. F. Yam and Tommy W. S. Chow, "Feedforward Networks Training Speed Enhancement by Optimal Initialization of the Synaptic Coefficients", IEEE Trans. On Neural Networks, vol. 12, no. 2, 2001, pp.430-434.
3. Karayiannis and A. N. Venetsanopoulos: Artificial neural networks: learning algorithms, performance evaluation, and applications. Kluver Academic, Boston, MA (1993).
4. Y. LeCun, L. Bottou, G. B. Orr, and K.-.R. Müller: Efficient backprop, Lecture Notes in Computer Science, vol. 1524, 1998, pp.9-50.
5. Syed Muhammad Aqil Burney, Tahseen Ahmed Jilani, and Cemal Ardil: A Comparison of First and Second Order Training Algorithms for Artificial Neural Networks. International Journal of Computational Intelligence, vol. 1, 2004, pp.218-224.
6. L. S. Nghia, J. Sjöberg and M. Viberg, "Adaptive neural nets filter using a recursive levenberg-marquardt search direction", proc. Asilomar Conf. Signals, Syst., Comput., vol. 1-4, Nov. 1998, pp.697-701.
7. th IEEE Workshop Neural Net. Signal Process., no. 4-6, Sep. 2002, pp. 129-138.
8. S. Lawrence, and C. L. Giles, "Overfitting and neural networks: conjugate gradient and backpropagation", Proc. of the IEEE-INNS-ENNS Int'l Joint Conf. on Neural networks, vol. 1, July 2000, pp. 114-119.
9. Z. P. Liu, J. P. Castagna, "Avoiding overfitting caused by noise using a uniform training mode", Int'l Joint Conf. on Neural Networks, vol. 3, July 1999, pp. 1788-1793.
10. G.-B. Huang, "Learning capability and storage capacity of two-hidden-layer feedforward networks", IEEE Transactions on Neural Networks, vol. 14, no. 2, 2003, pp.274-281.
11. G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, "Extreme learning machine: A New Learning Scheme for Feedforward Neural Networks", Proc. of Int'l Joint Conf. on Neural Networks, July 2004.
12. G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, "Extreme learning machine: Theory and applications", Neurocomputing, 2006, vol. 70, pp. 489-501.
13. H.T. Huynh and Y.Won, "Small Number of Hidden Units for ELM with Two-Stage Linear Model", IEICE Trans. on Information and Systems, vol. E91-D, no. 4, (April 2008).
14. Q.-Y. Zhu, A. K. Qin, P. N. Suganthan, G.-H. Huang, "Evolutionary Extreme Learning Machine", Pattern recognition, vol. 38, (2005), pp.1759-1763.
15. D. Serre, "Matrices: Theory and Applications", Springer, (New York, 2002).
16. R. Storn, K. Price, "Differential Evolution - A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces", Journal of Global Optimization, vol. 11, (1997) 341-359.
17. P. L. Bartlett, "The Sample Complexity of Pattern Classification with Neural networks: The Size of the Weights is More Important than the Size of the Network", IEEE Trans. On Inform. Theory, vol. 44, no. 2, (1998) 525-536.