A survey of factors influencing MLP error surface

Control and Cybernetics

Volumn 33, Issue 4, 2004, Pages 611-631

  Kordos, Miroslaw ^a   Duch, Włodzisław ^b,c  

^a SILESIAN UNIVERSITY OF TECHNOLOGY   (Poland)

^b NICOLAUS COPERNICUS UNIVERSITY   (Poland)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Error surface; Learning trajectory; MLP; Neural networks; Visualization

Indexed keywords

DYNAMICS; EXTRAPOLATION; LEARNING SYSTEMS; TRAJECTORIES; VECTORS; VISUALIZATION;

ERROR FUNCTIONS; ERROR SURFACE; LEARNING TRAJECTORIES; NEURAL LEARNING PROCESS;

NEURAL NETWORKS;

EID: 21844468239     PISSN: 03248569     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (13)

1. DENKER, J., SCHWARTZ, D., WITTNER, B., SOLLA, S., and HOWARD, R., JACKEL, L., HOPFIELD, J.J. (1987) Automatic learning, rule extraction and generalization. Complex Systems 1, 887-922.
2. DUCH, W. and JANKOWSKI, N. (1999) Survey of neural transfer functions. Neural Computing Surveys 2, 163-213.
3. DUCH, W., ADAMCZAK, R. and GRA̧BCZEWSKI, K. (2001) A new methodology of extraction, optimization and application of crisp and fuzzy logical rules. IEEE Transactions on Neural Networks 12, 277-306.
4. KORDOS, M. and DUCH, W. (2003) Search-based Training for Logical Rule Extraction by Multilayer Perceptron. Proc. of Int. Conf. on Artificial Neural Networks (ICANN), Istanbul, June 2003, 86-89.
5. KORDOS, M. and DUCH, W. (2003) Multilayer Perceptron Trained with Numerical Gradient. Proc. of Int. Conf. on Artificial Neural Networks (ICANN), Istanbul, June 2003, 106-109.
6. KORDOS, M. and DUCH, W. (2004) Variable Step Search Algorithm for MLP Training. The 8th IASTED Int. Conf. on Artificial Intelligence and Soft Computing, Marbella, Spain, Sept. 2004, 215-221.
7. GALLAGHER, M. and DOWNS, T. (2003) Visualization of Learning in Multi-layer Perceptron Networks using PCA. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics 33, 28-34.
8. HYVARINEN, A. and OJA, E. (2002) Independent Component Analysis: A Tutorial. http://www.cis.hut.fi/projects/ica
9. LEVIN, A.U., LEEN, T.K. and MOODY, J.E. (1994) Fast Pruning Using Principal Components. Advances in Neural Information Processing 6, 35-42.
10. MERTZ, C.J. and MURPHY, P.M. (1999) UCI repository of machine learning data-bases, http://www.ics.uci.edu/ mlearn/MLRepository.html
11. MOLLER, M.F. (1993) A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning. Neural Networks, 6, 525-533.
12. RANGANATHAN, A. (2004) The Levenberg-Marquardt Algorithm. http://www.cc.gatech.edu/people/home/ananth
13. SUSSMANN, H.J. (1992) Uniqueness of the weights for minimal feedforward nets with a given input-output map. Neural Networks 5, 589-593.