Variable step search algorithm for MLP training

Proceedings of the Eighth IASTED International Conference on Artificial Intelligence and Soft Computing

Volumn , Issue , 2004, Pages 215-220

  Kordos, Mirosław ^a   Duch, Włodzisław ^b,c  

^a SILESIAN UNIVERSITY OF TECHNOLOGY   (Poland)

^b NICOLAUS COPERNICUS UNIVERSITY   (Poland)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Learning algorithms; MLP; Neural networks; Search algorithms

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL COMPLEXITY; ERROR ANALYSIS; GRADIENT METHODS; LEARNING ALGORITHMS; OPTIMIZATION; TRANSFER FUNCTIONS;

LEVENBERG-MARQUARDT ALGORITHM; MLP; MULTILAYER PERCEPTRON (MLP); SEARCH ALGORITHMS; VARIABLE STEP SEARCH ALGORITHM (VSS);

MULTILAYER NEURAL NETWORKS;

EID: 10444251065     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. W. Duch, M. Kordos, "Search-based Training for Logical Rule Extraction by Multilayer Perceptron", Int. Conf. on Artificial Neural Networks (ICANN), Istanbul, June 2003, pp. 86-89
2. W. Duch, M. Kordos, "Multilayer Perceptron Trained with Numerical Gradient", Int. Conf. on Artificial Neural Networks (ICANN), Istanbul, June 2003, pp. 106-109
3. Ananth Ranganathan, "The Levenberg-Marquardt Algorithm"
4. D. Marquardt, "An algorithm for least-squares estimation of nonlinear parameters", SIAM J. Appl. Math., 1963, Vol. 11, pp.431-441.
5. N.N.R. Ranga Suri, Dipti Deodhare, P. Nagabhushan, "Parallel Levenberg-Marquardt-based Neural Network Training on Linux Cluster - A Case Study"
6. Fang Wang et al. "Neural Network Structures and Training Algorithms for RF and Microwave Applications"
7. Moller, M. F., "A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning," Neural Networks, vol. 6, pp. 525-533, 1993.
8. M. Gallagher, "Multi-layer Perceptron Error Surfaces: Visualization, Structure and Modeling", PhD Thesis, University of Queensland, 2000
9. M. Gallagher, T. Downs, "Visualization of Learning in Multi-layer Perceptron Networks using PCA", IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics, vol.33, pp 28-34.
10. M. Kordos, W. Duch, "On Some Factors Influencing MLP Error Surface", 7th Int. Conf. on Artificial Intelligence and Soft Computing (ICAISC), Zakopane, Poland, June 2004, pp.217-222
11. C.J. Mertz, P.M. Murphy, UCI repository of machine learning databases, http://www.ics.uci.edu/~mlearn/MLRepository.html
12. W. Duch, "Support Vector Neural Training", IEEE Transactions on Neural Networks, 2004 (submitted)
13. E. Micheli-Tzanakou (ed) "Supervised and Unsupervised Pattern Recognition: Feature Extraction and Computational Intelligence", CRC Press 2001