AVLR-EBP: A Variable step size approach to speed-up the convergence of Error Back-Propagation algorithm

Neural Processing Letters

Volumn 33, Issue 2, 2011, Pages 201-214

  Didandeh, Arman ^a   Mirbakhsh, Nima ^a   Amiri, Ali ^b   Fathy, Mahmood ^c  

^a INSTITUTE FOR ADVANCED STUDIES IN BASIC SCIENCES IASBS   (Iran)

^b UNIVERSITY OF ZANJAN   (Iran)

^c IRAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Iran)

Author keywords

Algorithm; Classification; EBP; MLP; Neural Networks

Indexed keywords

BREAST CANCER; CLASSIFICATION; CONVERGENCE PROPERTIES; CONVERGENCE TIME; CRITICAL ISSUES; DATA CLASSIFICATION; DATA MINING ALGORITHM; DATA SETS; EBP; ENGINEERING PROBLEMS; ERROR BACK-PROPAGATION; HIGH-SPEED CONVERGENCE; LEARNING RATES; MATHEMATICAL ANALYSIS; MLP; MULTI-LAYERED; PERCEPTRON; SIMULATION RESULT; SPEED-UPS; VARIABLE LEARNING RATE; VARIABLE STEP SIZE;

ADAPTIVE FILTERING; ADAPTIVE FILTERS; BACKPROPAGATION ALGORITHMS; DATA MINING; DISEASES; LEARNING ALGORITHMS; NEURAL NETWORKS; STANDARDS; WINE;

CONVERGENCE OF NUMERICAL METHODS;

EID: 79956113937     PISSN: 13704621     EISSN: 1573773X     Source Type: Journal    
DOI: 10.1007/s11063-011-9173-1     Document Type: Article

References (14)

1. Amiri A, Fathy M, Amintoosi M, Sadoghi-Yazdi H (2007) Modified quantized input variable step size LMS, QX-VSS LMS algorithm applied to signal prediction. Proceeidings of 4th IEEE GCC Conference, pp 162-168
2. Abid S, Fnaiech F, Jervis BW, Cheriet M (2005) Fast training of multilayer perceptrons with a mixed norm algorithm. IEEE International Joint Conference on Neural Networks Proceedings, pp 1018-1022 (Pubitemid 44055591)
3. Fnaiech F, Abid S (2008) Fast training of multilayer perceptrons with least mean fourth (LMF) algorithm. Int J Soft Comput 3:359-367
4. Frank A, Asuncion A (2010) UCI machine learning repository. [http://archive.ics.uci.edu/ml]. University of California, School of Information and Computer Science, Irvine, CA
5. Haykin S (1998) Neural networks, a comprehensive foundation, 2nd edn. Prentice Hall International Inc., McMaster University, Hamilton, Ontario, Canada
6. Hur M, Choi JY, Baek J-S, Seo JS (2008) Generalized normalized gradient descent algorithm based on estimated a posteriori error. Proceeding of the 10th International Conference on Advanced Communication Technology, pp 23-26 (Pubitemid 351720468)
7. Magoulas GD, Vrahatis MN, Androulakis GS (1999) Improving the convergence of the backpropagation algorithm using learning rate adaptation methods. Neural Comput 11:1769-1796
8. Plagianakos VP, Vrahatis MN, Magoulas GD (1999) Nonmonotone methods for backpropagation training with adaptive learning r. International Joint Conference on Neural Networks, pp 1762-1767 (Pubitemid 30593208)
9. Reymond HK, Edward WJ (1992) A variable step size LMS algorithm. IEEE Transaction on Signal Processing 40(7):1633-1642
10. Sadoghi-Yazdi H, Lotfizad M, Fathy M (2006) Car tracking by quantized input LMS, QX-LMS algorithm in traffic scenes. IEE Proceeding on Vision, Image and Signal Processing 153(1):37-45
11. Semeion research center of sciences of communication, via Sersale 117, 00128 Rome, Italy Tattile Via Gaetano Donizetti, 1-3-5, 25030 Mairano (Brescia), Italy
12. Shao H, Wu W (2006) Convergence of BP algorithm with variable learning rates for FNN training. Proceedings of the 5th Mexican international Conference on Artificial intelligence, pp 245-252
13. Wu W, Feng G, Li X (2002) Training multilayer perceptrons via minimization of sum of ridge functions. Adv Comput Math 17:331-347 (Pubitemid 37130904)
14. Zhao X-Y, Lai K-S, Dai D-M (2007) An improved BP algorithm and its application in classification of surface defects of steel plate. Int J Iron Steel Res 14(2):52-55