A fast constructive learning algorithm for single-hidden-layer neural networks

2004 8th International Conference on Control, Automation, Robotics and Vision (ICARCV)

Volumn 3, Issue , 2004, Pages 1907-1911

  Zhu, Qin Yu ^a   Huang, Guang Bin ^a   Siew, Chee Kheong ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

CONSTRUCTIVE MODELS; EXTREME LEARNING MACHINES (ELM); OUTPUT VECTORS; SINGLE-HIDDEN-LAYER NEURAL NETWORKS;

BACKPROPAGATION; ITERATIVE METHODS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; MATRIX ALGEBRA; PARAMETER ESTIMATION; PROBLEM SOLVING; VECTORS;

NEURAL NETWORKS;

EID: 21244490908     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. G.-B. Huang, Q.-Y. Zhu, and C.-K. Slew, "Extreme learning machine: A new learning scheme of feedforward neural networks," in Proceedings of 2004 International Joint Conference on Neural Networks (IJCNN'2004), (Budapest, Hungary), July 2004.
2. D. E. Rumellhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error propagation," Parallel Distribution Processing: Explanations in the Microstructure of Cognition, vol. 1, pp. 318-362, 1986.
3. S. Abid, F. Fnaiech, and M. Najim, "A fast feedforward training algorithm using a modified form of the standard backpropagation algorithm," IEEE Transactions on Neural Networks, vol. 12, no. 2, pp. 424 -430, 2001.
4. A. Parlos, B. Fernandez, A. Atiya, J. Muthusami, and W. Tsai, "An accelerating learning algorithm for multilayer perceptron networks," IEEE Transactions on Neural Networks, vol. 5, pp. 493-497, 1994.
5. X. H. Yu, G. A. Chen, and S. X. Cheng, "Dynamic learning rate optimization of the back-propagation algorithm," IEEE Transactions on Neural Networks, vol. 6, pp. 669-677, 1995.
6. E. Baum, "On the capabilities of multilayer perceptrons," Journal of Complexity, vol. 4, pp. 193-215, 1988.
7. G.-B. Huang, "Learning capability and storage capacity of two-hidden-layer feedforward networks," IEEE Transactions on Neural Networks, vol. 14, no. 2, pp. 274 -281, 2003.
8. G.-B. Huang and H. A. Babri, "Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions," IEEE Transactions on Neural Networks, vol. 9, no. 1, pp. 224-229, 1998.
9. D. Serre, Matrix: Theory and Application. New York: Springer-Verlag Inc, 2002.
10. P. Bartlett, "The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network," IEEE Transactions on Information Theory, vol. 44, no. 2, pp. 525-536, 1998.
11. P. L. Bartlett, "For valid generalization the size of the weights is more important than the size of the network," in Advances in Neural Information Processing Systems (M. C. Mozer, M. I. Jordan, and T. Petsche, eds.), vol. 9, pp. 134-140, The MIT Press, 1997.
12. M. T. Hagan and M. B. Menhaj, "Training feedforward networks with the marquardt algorithm," IEEE Transactions on Neural Networks, vol. 5, no. 6, pp. 989-993, 1994.
13. M. T. Hagan, H. B. Demuth, and M. H. Beale, Neural Network Design, Boston: MA: PWS Publishing, 1996.