Training single hidden layer feedforward neural networks by singular value decomposition

ICCIT 2009 - 4th International Conference on Computer Sciences and Convergence Information Technology

Volumn , Issue , 2009, Pages 1300-1304

  Huynh, Hieu Trung ^a   Won, Yonggwan ^a  

^a Chonnam National University   (South Korea)

Author keywords

Neural network; SLFNs; SVD; SVD neural classifier; Training algorithms

Indexed keywords

ACTIVATION FUNCTIONS; HIDDEN UNITS; IMPROVING PERFORMANCE; NETWORK PARAMETERS; NEURAL CLASSIFIERS; SINGLE-HIDDEN LAYER FEEDFORWARD NEURAL NETWORKS; SLFNS; SVD(SINGULAR VALUE DECOMPOSITION); TRAINING ALGORITHMS; TRAINING METHODS;

ALGORITHMS; CLASSIFIERS; COMPUTATIONAL COMPLEXITY; COMPUTER SCIENCE; INFORMATION TECHNOLOGY; SINGULAR VALUE DECOMPOSITION;

FEEDFORWARD NEURAL NETWORKS;

EID: 77749317296     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCIT.2009.170     Document Type: Conference Paper

References (18)

1. G.-B. Huang and H.A. Babri, "Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions", IEEE Trans. on Neural Networks, vol. 9, no. 1, pp. 224-229, 1998.
2. G.-B. Huang, Y.-Q. Chen, and H. A. Babri, "Classification Ability of Single Hidden Layer Feedforward Neural Networks", IEEE Trans. on Neural Networks, vol. 11, no. 3, pp. 799-801, 2000.
3. D. Nguyen and B. Widrow, "Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights", Int'l Joint Conf. Neural Neural Networks, vol. 3, San Diego, CA, pp. 21-26, 1990.
4. Jim Y. F. Yam and Tommy W. S. Chow, "Feedforward Networks Training Speed Enhancement by Optimal Initialization of the Synaptic Coefficients", IEEE Trans. On Neural NetWorks, vol. 12, no. 2, pp. 430-434, 2001.
5. Karayiannis and A. N. Venetsanopoulos, "Artificial neural networks: learning algorithms, performance evaluation, and applications", Kluver Academic, Boston, MA, 1993.
6. Y. LeCun, L. Bottou, G. B. Orr, and K.-R. Müller, "Efficient backprop", Lecture Notes in Computer Science, vol. 1524, pp. 9-50, 1998.
7. Syed Muhammad Aqil Burney, Tahseen Ahmed Jilani, and Cemal Ardil, "A Comparison of First and Second Order Training Algorithms for Artificial Neural Networks", International Journal of Computational Intelligence, vol. 1, pp. 218-224, 2004.
8. L. S. Nghia, J. Sjöberg and M. Viberg, "Adaptive neural nets filter using a recursive levenberg-marquardt search direction", Proc. Asilomar Conf. Signals, Syst., Comput., vol. 1-4, pp. 697-701, Nov. 1998.
9. S. Lawrence and C.L. Giles, "Overfitting and neural networks: Conjugate gradient and backpropagation", Proc. IEEE-INNS-ENNS Int'l Joint Conf. on Neural Networks, vol. 1, pp. 114-119, July 2000.
10. Z.P. Liu and J.P. Castagna, "Avoiding overfittingcaused by noise using a uniform training mode", Int'l Joint Conf. on Neural Networks, vol. 3, pp. 1788-1793, July 1999.
11. G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, "Extreme learning machine: Theory and applications", Neurocomputing, vol. 70, pp. 489-501, 2006.
12. Hieu Trung Huynh and Yonggwan Won, "Small number of hidden units for ELM with two-stage linear model", IEICE Trans. on Information and Systems, vol. E91-D, no. 4, pp. 1042-1049, April 2008.
13. Hieu Trung Huynh, Yonggwan Won, and Jung-ja Kim, "An improvement of extreme learning machine for compact single-hidden-layer feedforward neural networks", International Journal of Neural Systems, vol. 18, no. 5, pp. 433-441, 2008.
14. A. N. Tikhonov and A. V. Arsenin, "Solution of ill-posed problems", Winston & Son, Washingston, 1977.
15. Q.-Y. Zhu, A.K. Qin, P.N. Suganthan, G.-B. Huang, "Evolutionary Extreme Learning Machine", Pattern Recognition, vol. 38, pp. 1759-1763, 2005.
16. R. Storn and K. Price, "Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces", Journal of global optimization 11, pp. 341-359, 1997.
17. Hieu Trung Huynh and Yonggwan Won, "Evolutionary algorithm for training compact single hidden layer feedforward neural networks", Int'l joint conference on neural networks (IJCNN2008), pp. 3027-3032, 2008.
18. R. Ghosh and B. Verma, "A hierarchical method for finding optimal architecture and weights using evolutionary least square based learning", International Journal of neural Systems, vol. 12, pp. 13-24, 2003.