Implementing the Levenberg-Marquardt algorithm on-line: A sliding window approach with early stopping

IFAC Proceedings Volumes (IFAC-PapersOnline)

Volumn 37, Issue 16, 2004, Pages 49-54

  Dias, Fernando Morgado ^a   Antunes, Ana ^a   Vieira, José ^b   Mota, Alexandre Manuel ^c  

^a INSTITUTO POLITÉCNICO DE SETÚBAL   (Portugal)

^b INSTITUTO POLITÉCNICO DE CASTELO BRANCO   (Portugal)

^c UNIVERSITY OF AVEIRO   (Portugal)

Author keywords

Artificial neural networks; Direct training; Levenberg Marquardt algorithm; On line training; Specialized training

Indexed keywords

ITERATIVE METHODS; NEURAL NETWORKS; ONLINE SYSTEMS;

EARLY STOPPING; HYBRID DIRECT/SPECIALIZED EVALUATION PROCEDURE; LEVENBERG-MARQUARDT ALGORITHM; ONLINE TRAINING; REAL SYSTEMS; SLIDING WINDOW; SPECIALIZED TRAINING; TRUST REGION;

E-LEARNING;

EID: 85046443327     PISSN: 14746670     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1016/S1474-6670(17)30849-2     Document Type: Conference Paper

References (11)

1. Levenberg, K., “A method for the solution of certain problems in least squares”. Quart. Appl. Math., 2:164—168, 1944.
2. Marquardt, D., “An algorithm for least-squares estimation of nonlinear parameters”, SIAM J. Appl. Math., 11:431—441, 1963.
3. Nørgaard, M., O. Ravn, N. K. Poulsen, and L. K. Hansen, “Neural Networks for Modelling and Control of Dynamic Systems. Springer, 2000.
4. Ferreira, P., E. Faria, and A. Ruano, “Neural network models in greenhouse air temperature prediction”, Neurocomputing, 43, no. 1-4:51-75, 2002.
5. Ngia, Lester S. H., “System Modeling Using Basis Functions and Application to Echo Cancelation”, PhD thesis, Department of Signals and Systems School of Electrical and Computer Engineering, Chalmers University of Technology, 2000.
6. Morgan, N. and H. Bourlard, “Generalization and parameter estimation in feedforward nets: Some experiments”, Advances in Neural Information Processing Systems, Ed. D.Touretzsky, Morgan Kaufmann, pages 630—637, 1990.
7. Sjöberg, J., “Non-Linear System Identification with Neural Networks”, PhD thesis, Dept. of Electrical Engineering, Linköping University, Suécia, 1995.
8. Nørgaard, M. (1996a), “System Identification and Control with Neural Networks”, PhD Thesis, Department of Automation, Technical University of Denmark.
9. Nørgaard, M. (1996b), “Neural Network System Identification Toolbox for MATLAB”, Technical Report.
10. Nørgaard, M. (1996c), “Neural Network Control Toolbox for MATLAB”, Technical Report.
11. th WSEAS Int. Conf. on Algorithms, Cientific Computing, Modelling and Computation (ASCOMS’04), Cancun, 2004.