A comparative study of fast neural network learning algorithms

Proceedings of the IEEE International Conference on Systems, Man and Cybernetics

Volumn 2, Issue , 2002, Pages 24-29

  Fnaiech, Farhat ^a   Abid, Sabeur ^a   Ellala, Nizar ^a   Cheriet, Mohamed ^b  

^a UNIVERSITY OF TUNIS   (Tunisia)

^b Laboratoire d'Imagerie de Vision et d'Intelligence Artificielle (LIVIA)   (Canada)

Author keywords

Error function; Fast algorithms; Learning pattern; Loss function; Multilayer perception (MLP); Neural Networks (NN); Performance index

Indexed keywords

ALGORITHMS; BACKPROPAGATION; COMPUTATIONAL COMPLEXITY; COMPUTER AIDED INSTRUCTION; COMPUTER SIMULATION; MULTILAYER NEURAL NETWORKS; OPTIMIZATION;

PERFORMANCE INDICES;

LEARNING SYSTEMS;

EID: 0036979408     PISSN: 08843627     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. D.R. Hush and B.G. Horne, "Progress in supervised neural networks", IEEE Signal Processing Magazine, pp. 8-39. January 1993.
2. R.P. Lippmann, "An introduction to computing with neural nets", IEEE Acoustics, Speech and Signal Processing Magazine. 4(2):4-22. April 1987.
3. A. Cichocki and R. Unbehauen "Neural Network for Optimization and SignalProcessing" John Wiley &Sons Ltd. Baffins Lane, Chchester. West Sussex PO19 1UD, England 1993.
4. B. Widrow, M.A.Lehr "30 Years of adaptative Neural Networks: Perceptron, Madaline, and Backpropagation" Proceedingns of the IEEE, vol.78, N0.9, pp: 1415-1442, September 1990.
5. J.K. Kruschke and J.R. Movellan, "Benifits of gain: speeded learning and minimal layers in back-propagation networks", IEEE Trans. On System and Cybernetics, vol. 21, 1991, pp. 273-280.
6. F.R. Hampel, E.N. Ronchetti, P. Rousser and W.A. Stachel, "Robust statistics - The approach Based on Influence Functions", New York: John Wiley, 1987.
7. C. Darken and J. Moody, "Towards faster stochastic gradient search", in the book Advances in Neural information Processing systems 4, Morgan Kaufman, San Mateo 1991, pp. 1009-1016.
8. N.B. Karayiannis and A.N.Venetsanopoulos "Fast learning algorithm for neural networks", IEEE Trans, on Circuits and Systems, vol. 39, 1992, pp. 453-474.
9. R.A. Jacobs, "Increased rates of convergence through learning rate adaptation", Neural Networks, vol. 1, 1988, pp. 295-307.
10. E.M. Johansson, F.V. Dowla and D.M. Goodman, "Backpropagation learning for multilayer feed-forward networks using the conjugate gradient methods", Int. Journal of Neural Systems, vol. 2, 1992, pp.291-301.
11. M R. Azimi-Sadjadi and R. J. Liou "Fast Learning Process of multilayer Neural Network Using Recursive Least Squares Method" IEEE Transactions on Signal Processing, Vol 40 No, 2, February 1992.
12. R. S. Scalero and N. Tepedelenglioglu, "A Fast New Algorithm for Training Feedforward Neural Networks" IEEE Transactions on signal processing. Vol 40. No, 1, January 1992.
13. st septembre 1994 (European signal processing conference) Eidumbrg, Scottland, UK.
14. Y. Liguni, H. Sakai, and H. Tokumaru "A Real-Time Algorithm for Multilayred Neural Network Based on the Extended Kalman Filter" IEEE Transactions on Signal Processing, Vol.40 No,4,April 1992.
15. M. T. Hagon and M. B. Menhaj "Training feedforward networks with the Markard algorithm" IEEE Transactions on Neural Networks, Vol. 5, pp. 989, November 1994.
16. S. Abid, F.Fnaiech and M. Najim: "A Fast Feed-Forward Training algorithm using A Modified Form of the standard Back Propagation Algorithm" IEEE Trans. Neural Network Vol.12, No 2, March 2001.
17. M. G. Bellanger, "Adaptive digital filters and signal analysis", Marcel Dekker Inc., 1987.