Analysis of weight decay regularisation in NNARX nonlinear identification

Proceedings of 2009 5th International Colloquium on Signal Processing and Its Applications, CSPA 2009

Volumn , Issue , 2009, Pages 355-361

  Rahiman, Mohd Hezri Fazalul ^a   Taib, Mohd Nasir ^a   Adnan, Ramli ^a   Salleh, Yusof Md ^a  

^a UNIVERSITI TEKNOLOGI MARA   (Malaysia)

Author keywords

Essential oil extraction system identification; Levenberg Marquardt algorithm (LMA); Neural network autoregressive with exogenous input (NNARX); Steam temperature modelling; Weight decay regularisation

Indexed keywords

ESSENTIAL OIL EXTRACTION SYSTEM IDENTIFICATION; LEVENBERG-MARQUARDT ALGORITHM (LMA); NEURAL NETWORK AUTOREGRESSIVE WITH EXOGENOUS INPUT (NNARX); STEAM TEMPERATURE MODELLING; WEIGHT DECAY REGULARISATION;

DECAY (ORGANIC); DISTILLATION; MATHEMATICAL MODELS; NEURAL NETWORKS; SIGNAL PROCESSING; STEAM;

NONLINEAR NETWORK ANALYSIS;

EID: 70349914917     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CSPA.2009.5069250     Document Type: Conference Paper

References (20)

1. H. Demuth, M. Beale and M. Hagan, Neural Network Toolbox User's Guide, 4th ed. Natick, USA: The Mathworks Inc., 2005.
2. J. Sjoberg and L. Ljung, "Overtraining, Regularization and Searching for Minimum in Neural Networks," in Preprint 4th IFAC Symp. on Adaptive Systems in Control and Signal Processing. Grenoble, France, 1992, pp. 669-674.
3. J. Sjoberg and L. Ljung, "Overtraining, Regularization and Searching for Minimum with Application to Neural Nets," International Journal of Control, vol. 62, pp. 1391-1407, 1995.
4. J. Sjoberg, "Nonlinear black-box structures - Some approaches and some examples (Report CTH-TE-47)," in Proc. Second World Automation Congress, Montpellier, France, 1996.
5. D. L. Yu and J. B. Gomm, "Implementation of neural network predictive control to a multivariable chemical reactor," Control Engineering Practice, pp. 1315-1323, 2003.
6. M. Basso, L. Giarre, S. Groppi and G. Zappa, "NARX models of an industrial power plant gas turbine," IEEE Transactions on Control Systems Technology, vol. 13, pp. 599-604, 2005.
7. I. A. Maio, I. S. Stievano and E. G. Canavero, "NARX approach to black-box modeling of circuit elements," in Proc. IEEE International Symposium on Circuits and Systems, 1998, pp. 411-414.
8. S. M. Ahmad, M. H. Shaheed, A. J. Chipperfield and M. O. Tokhi, "Nonlinear modelling of a twin rotor MIMO system using radial basis function networks," in Proc. IEEE National Aerospace and Electronics Conference (NAECON 2000), 2000, pp. 313-320.
9. F. Previdi, M. Lovera and S. Mambretti, "Identification of the rainfallrunoff relationship in urban drainage networks," Control Engineering Practice, vol. 7, pp. 1489-1504, 1999.
10. S. Mollov, R. Babuska, J. Abonyi and H. B. Verbruggen, "Effective optimization for fuzzy model predictive control," IEEE Transactions on Fuzzy Systems, vol. 12, pp. 661-675, 2004.
11. F. D. Palma and L. Magni, "A multi-model structure for model predictive control," Annual Reviews in Control, vol. 28, pp. 47-52, 2004.
12. T. A. Johansen and B. A. Foss, "Empirical modeling of a heat transfer process using local models and interpolation," in Proc. American Control Conference, 1995, pp. 3654-3658.
13. L. Ljung and T. Glad, Modeling of dynamic systems. New Jersey: PTR Prentice-Hall, Inc., 1994.
14. E. Ikonen and K. Najim, Advanced process identification and control. New York: Marcel Dekker, Inc., 2002.
15. M. Norgaard, O. Ravn, N. K. Poulsen and L. K. Hansen, Neural Networks for modelling and control of dynamic systems. London: Springer-Verlag London Ltd, 2000.
16. J. Jantzen, "Introduction To Perceptron Networks," Technical University of Denmark, Lyngby, Denmark, Technical Report 98-H 873 1998.
17. L. Ljung, System Identification: Theory for the User, 2nd ed. New Jersey: Prentice Hall PTR, 1999.
18. D. C. Montgomery, G. C. Runger and N. F. Hubele, Engineering Statistics, 3rd ed: John Wiley & Sons, Inc., 2004.
19. H. Feng, Y. Shu, S. Wang and M. Ma, "SVM-Based Models for Predicting WLAN Traffic," in Proc. IEEE International Conference on Communications, 2006, pp. 597-602.
20. A. S. Weigend and N. A. Gershenfeld, Time Series Prediction: Forecasting the Future and Understanding the Past. Reading, MA: Addison-Wesley, 1994.