Online sliding-window based for training MLP networks using advanced conjugate gradient

Proceedings - 2011 IEEE 7th International Colloquium on Signal Processing and Its Applications, CSPA 2011

Volumn , Issue , 2011, Pages 112-116

  Izzeldin, Huzaifa ^a   Asirvadam, Vijanth S ^a   Saad, Nordin ^a  

^a DEPARTMENT OF CHEMICAL ENGINEERING   (Malaysia)

Author keywords

back propagation; neural network; nonlinear conjugate gradient; sliding window learning

Indexed keywords

CONJUGATE GRADIENT; CONJUGATE GRADIENT ALGORITHMS; FIRST ORDER; MULTI LAYER PERCEPTRON; NONLINEAR CONJUGATE GRADIENT; OFF-LINE LEARNING; OFFLINE DATA; ONLINE LEARNING; SECOND ORDERS; SLIDING WINDOW-BASED; SLIDING-WINDOW; SYSTEM VARIABLES; TIME VARYING;

BACKPROPAGATION ALGORITHMS; CONJUGATE GRADIENT METHOD; NEURAL NETWORKS; SIGNAL PROCESSING; TIME VARYING NETWORKS;

E-LEARNING;

EID: 79957506568     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CSPA.2011.5759854     Document Type: Conference Paper

References (16)

1. T. Heskes and W. Wiegerinck, "A Theoretical Comparison of Batch- Mode, On-Line, Cyclic, and Almost-Cyclic Learning," IEEE Transaction on Neural Networks, vol. I, 1996, pp. 919-925.
2. P.M. Ferreira and A.E. Ruano, "Online Sliding-Window Methods for Process Model Adaptation," IEEE Transactions on Instrumentation and Measurement, vol. 58, Sep. 2009, pp. 3012-3020.
3. a Ruano, E. Crispim, E. Conceicao, and M. Lucio, "Prediction of building's temperature using neural networks models," Energy and Buildings, vol. 38, Jun. 2006, pp. 682-694.
4. V.S. Asirvadam, "On-line Learning and Construction of Neural Networks," 2002.
5. L. Lujung, System Identification Theory for the User, New Jersey: Prentice Hall PTR, 1999.
6. M. Norgaard, O. Ravan, N.K. Poulsen, and L.K. Hansen, Neural Networks for Modelling and Control of Dynamic Systems A Practitioner's Handbook, London: Springer-Verlag London Limited, 2000.
7. T. Chow and S.-Y. Cho, Neural Networks and Computing Learning Algorithms and Applications, London: Imperial College Press, 2007.
8. S.V. Vaerenbergh, J. Vía, and I. Santamaría, "Nonlinear System Identification using a New Sliding-Window Kernel RLS Algorithm," Journal of Communications, vol. 2, May. 2007, pp. 1-8.
9. V.S. Asirvadam, "Adaptive Regularizer for Recursive Neural Network Training Algorithms," 2008 11th IEEE International Conference on Computational Science and Engineering - Workshops, Jul. 2008, pp. 89-94.
10. D.E. Rumelhart, E.G. Hinton, and R.J. Williams, "Learning Internal Representations by Error Propagation," Parallel distributed processing: explorations in the microstructure of cognition, Cambridge MA: MIT press, 1996, pp. 318-362.
11. S. McLoone, M.D. Brown, G. Irwin, and a Lightbody, "A hybrid linear/nonlinear training algorithm for feedforward neural networks.," IEEE transactions on neural networks / a publication of the IEEE Neural Networks Council, vol. 9, Jan. 1998, pp. 669-84.
12. W.W. Hager and H. Zhang, "A survey of nonlinear conjugate gradient methods," Science, 2005.
13. M.F. Moller, "A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning," Journal of Neural Networks, vol. 6, 1993, pp. 525-533.
14. J. Nocedal and S. Wright, Numerical Optimization, USA: Springer Science+Business Media, LLC, 2006.
15. W.W. Hager and H. Zhang, "Algorithm 851 : CG DESCENT , a Conjugate Gradient Method with Guaranteed Descent," vol. 32, 2006, pp. 113-137.
16. T. Heckenthaler and S. Engell, "Approximately time-optimal fuzzy control of a two-tank system," IEEE Control Systems Magazine, vol. 14, Jun. 1994, pp. 24-30.