A new mixed least mean square and least mean fourth algorithm for multilayer perceptron fast training

Intelligent Automation and Soft Computing

Volumn 17, Issue 3, 2011, Pages 287-308

  Abid, Sabeur ^a,b   Fnaiech, Farhat ^a,b   Jervis, B W ^c  

^a UNIVERSITY OF TUNIS   (Tunisia)

^b Département Génie Electrique et Informatique Industrielle   (France)

^c NONE   (United Kingdom)

Author keywords

Fast training algorithms; Least mean fourth power error; Least mean squared error; Multilayer perceptron (MLP); Standard back propagation (SBP) algorithm

Indexed keywords

EID: 84855403769     PISSN: 10798587     EISSN: None     Source Type: Journal    
DOI: 10.1080/10798587.2011.10643149     Document Type: Article

References (22)

1. S. Abid, F. Fnaiech, and M. Najim: "A Fast Feed-Forward Training algorithm using A Modified Form of the standard Back Propagation Algorithm" IEEE Trans. Neural Network Vol.12, No 2, 2001.
2. F. Fnaiech, S. Abid, N. Ellala, and M. Cheriet, "A comparative study of fast neural networks learning algorithms, " IEEE International Conference on Systems, Man and Cybernetics, Oct. 6-9, 2002, Hammamet, Tunisia.
3. A. Cichocki and R. Unbehauen, "Neural Network for optimization and signal processing, " John Wiley & Sons Ltd. Baffins Lane, Chechester. West Sussex PO19 1UD, England, 1993.
4. C. Charalambous, "Conjugate gradient algorithm for efficient training of artificial neural networks, " IEEE Proc., vol. 139. no: 3. pp. 301-310, 1992.
5. R. A. Jacobs, "Increased Rates of Convergence through Learning Rate Adaptation, " Neural Networks. vol.1. no. 4, pp. 295-308, 1988.
6. J. K. Kruschke and J. R. Movellan, "Benefits of gain: speeded learning and minimal layers in back-propagation networks, " IEEE Trans. On System and Cybernetics, vol. 21, pp. 273-280, 1991.
7. C. Darken and J. Moody, "Towards faster stochastic gradient search, " in the book Advances in Neural information Processing systems 4, Morgan Kaufman, San Mateo, pp. 1009-1016, 1991.
8. E.M. Johansson, F.V. Dowla, and D.M. Goodman, "Backpropagation learning for multilayer feed-forward networks using the conjugate gradient methods, " Int. Journal of Neural Systems, vol. 2, pp. 291-301, 1992.
9. A. Zerguine "A Time-Varying Normalized Mixed-Norm LMS-LMF Algorithm, " 11th European Signal Processing Conference EUSIPCO 2002, Paper coded #394. Toulouse, France, 2002.
10. E. Walach and B. Widrow, "The Least Mean Fourth (LMF) Adaptive Algorithm and its family, " IEEE Trans. Inf. Theory, vol. IT-30, pp. 275-283, 1984.
11. P. I. Hubscher, J. C.M. Bermudez, and V. H. Nascimento, "A Mean-Square Stability Analysis of the Least Mean Fourth Adaptive Algorithm" IEEE Transactions on Signal Processing, Volume 55, Issue 8, Page(s):4018-4028, 2007.
12. V. H. Nascimento and J. C. M. Bermudez, "Probability of divergence for the least-mean fourth algorithm" IEEE Transactions on Signal Processing, Volume 54, Issue 4, Page(s):1376-1385, 2006.
13. H. Kianoush, M. Aman, A. Hooman, and H. Kahaei, Mohammad, "New Classes of LMS and LMF Adaptive Algorithms, " Third international conference on Information and Communication Technologies: From Theory to Applications, ICTTA' 2008. Page(s):1-5, 2008.
14. N. Fnaiech, S. Abid, F. Fnaiech, and M. Cheriet, "A modified version of a formal pruning algorithm based on local relative variance analysis, " First International Symposium on Control, Communications, and Signal Processing: ISCCSP 2004, 21-24, Hammamet, Tunisia, 2004.
15. B. W. Jervis, M. R. Staatchi, A. Lacey, T. Roberts, E; M. Allen, N. R. Hudson, S. Oke, and M. Grimsley, "Artificial neural network and spectrum analysis methods for detecting brain diseases from the CNV response in the electroencephalogram, " IEE Proc. PtA, Science, Measurement, and Technology, 141:No 6, Nov. 432-440.
16. B. W. Jervis, E. M. Allen, T. E. Johnson, M. J. Nichols, and N. R. Hudson, "The application of pattern recognition techniques to the contingent negative variation for the differentiation of subject categories, " IEEE Trans. MBE-31: No 4, 342-348, 1984.
17. J. Vonsattel, "Neuropathalogic of Huntington's disease: Dynamics of the striatal neuropathological changes, including unusual findings and differential diagnosis. Movement Disorders, " 7: suppl 1, 185.
18. C. Berezinski, "Algorithmique Numérique, " Paris, France: Edition Marketing, 1988.
19. D. Graupe, "Time series analisys, " Identification Adaptive Filtering. Malabar, FL: Krieger, 1984.
20. S. Haykin, "Adaptive Filter Theory, " Prentice-Hall, Englewood Cliffs, NJ, 1991.
21. T. P. Vogl, J. K. Mangis. A. K. Zigler, W. T. Zink, and D. L. Alkon, "Accelerating the convergence of the backpropagation method, " Bio. Cybern. vol. 59, pp. 256-264, 1988.
22. S. Kollias and D. Anastassiou. "An adaptive least squares algorithm for the efficient training of artificial neural networksn" IEEE Trans. Circ. Syst. Vol. 36, no. 8, pp. 1092-1101, 1989.