A Hammerstein recurrent neurofuzzy network with an online minimal realization learning algorithm

IEEE Transactions on Fuzzy Systems

Volumn 16, Issue 6, 2008, Pages 1597-1612

  Wang, Jeen Shing ^a   Chen, Yen Ping ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Minimal realization; Order determination; Recurrent neurofuzzy network; State space model; System identification

Indexed keywords

BENCHMARKING; EDUCATION; LEARNING SYSTEMS; LINEAR SYSTEMS; METROPOLITAN AREA NETWORKS; NONLINEAR SYSTEMS;

MINIMAL REALIZATION; ORDER DETERMINATION; RECURRENT NEUROFUZZY NETWORK; STATE-SPACE MODEL; SYSTEM IDENTIFICATION;

LEARNING ALGORITHMS;

EID: 58149525400     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2008.2005929     Document Type: Article

References (47)

1. R. Babuška and H. Verbruggen, "Neuro-fuzzy methods for nonlinear system identification," Annu. Rev. Control, vol. 27, no. 1, pp. 73-85, 2003.
2. E. W. Bai and D. Li, "Convergence of the iterative Hammerstein system identification algorithm," IEEE Trans. Autom. Control, vol. 49, no. 11, pp. 1929-1940, Nov. 2004.
3. N. E. Barabanov and D. V. Prokhorov, "Stability analysis of discrete-time recurrent neural networks," IEEE Trans. Neural Netw. vol. 13, no. 2, pp. 292-303, Mar. 2002.
4. S. A. Bilings and S. Y. Fakhouri, "Identification of a class of nonlinear systems using correlation analysis," in Proc. Inst. Elect. Eng., vol. 125, pp. 691-697, 1978.
5. J. D. Bomberger and D. E. Seborg, "Determination of model order for NARX models directly from input-output data," J. Process Control, vol. 8, no. 5, pp. 459-468, 1998.
6. P. Campolucci, A. Uncini, F. Piazza, and B. D. Rao, "Online learning algorithms for locally recurrent neural networks," IEEE Trans. Neural Netw., vol. 10, no. 2, pp. 253-271, Mar. 1999.
7. F. H. I. Chang and R. Luus, "A noniterative method for identification using Hammerstein model," IEEE Trans. Autom. Control, vol. AC-16, no. 5, pp. 464-468, Oct. 1971.
8. G. Chen, Y. Chen, and H. Ogmen, "Identifying chaotic systems via a Wiener-type cascade model," IEEE Control Syst. Mag., vol. 17, no. 5, pp. 29-36, Oct. 1997.
9. S. Chen, F. N. Cowan, and P.M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Netw., vol. 2, no. 2, pp. 302-309, Mar. 1991.
10. S. L. Chiu, "Fuzzy model identification based on cluster estimation," J. Intell. Fuzzy Syst., vol. 2, pp. 267-278, 1994.
11. E. K. P. Chong and S. H. Zak, An Introduction to Optimization, 2nd ed. New York: Wiley, 2001.
12. H. A. Duwaish and M. N. Karim, "A new method for the identification of Hammerstein model," Automatica, vol. 33, no. 10, pp. 1871-1875, 1997.
13. J. L. Elman, "Finding structure in time," Cogn. Sci., vol. 14, pp. 179-211, 1990.
14. M. Gori, M. Mozer, A. C. Tosi, and R. L.Watrous, "Presenting the special issue on recurrent neural networks for sequence processing," Neurocomputing, vol. 15, pp. 181-182, 1997.
15. V. Gorrini and H. Bersini, "Recurrent fuzzy systems," in Proc. IEEE Int. Conf. Fuzzy Syst., Orlando, FL, Jun. 26-29, 1994, vol. 1, pp. 193-198.
16. W. Greblicki and M. Pawlak, "Identification of discrete Hammerstein systems using kernel regression estimates," IEEE Trans. Autom. Control, vol. AC-31, no. 1, pp. 74-77, Jan. 1986.
17. S. Guillaume, "Designing fuzzy inference systems from data: An interpretability-oriented review," IEEE Trans. Fuzzy Syst., vol. 9, no. 3, pp. 426-443, Jun. 2001.
18. X. He and H. Asada, "A new method for identifying orders of input-output models for nonlinear dynamic systems," in Proc. Autom. Control Conf., San Francisco, CA, Jun. 1993, pp. 2520-2523.
19. A. Janczak, "Neural network approach for identification of Hammerstein systems," Int. J. Control, vol. 76, no. 17, pp. 1749-1766, 2003.
20. L. Jia, M. S. Chiu, and S. S. Ge, "A noniterative neuro-fuzzy based identification method for Hammerstein processes," J. Process Control vol. 15, no. 7, pp. 749-761, 2005.
21. C. F. Juang, "A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms," IEEE Trans. Fuzzy Syst., vol. 10, no. 2, pp. 155-170, Apr. 2002.
22. C. F. Juang, "A hybrid genetic algorithm and particle swarm optimization for recurrent network design," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 2, pp. 997-1006, Apr. 2004.
23. C. F. Juang and K. C. Ku, "A recurrent fuzzy network for fuzzy temporal sequence processing and gesture recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 4, pp. 646-658, Aug. 2005.
24. C. F. Juang and C. T. Lin, "An online self-constructing neural fuzzy inference network and its applications," IEEE Trans. Fuzzy Syst., vol. 6, no. 1, pp. 12-32, Feb. 1998.
25. C. F. Juang and C. T. Lin, "A recurrent self-organizing neural fuzzy inference network," IEEE Trans. Neural Netw., vol. 10, no. 4, pp. 828-845, Jul. 1999.
26. C. F. Juang and C. T. Lin, "Noisy speech processing by recurrently adaptive fuzzy filters," IEEE Trans. Fuzzy Syst., vol. 9, no. 1, pp. 139-152, Feb. 2001.
27. C. H. Lee and C. C. Teng, "Identification and control of dynamic systems using recurrent fuzzy neural networks," IEEE Trans. Fuzzy Syst., vol. 8, no. 4, pp. 349-366, Aug. 2000.
28. F. J. Lin and R. J. Wai, "Hybrid control using recurrent fuzzy neural network for linear induction motor servo drive," IEEE Trans. Fuzzy Syst., vol. 9, no. 1, pp. 102-115, Feb. 2001.
29. C. T. Lin, C. M. Yeh, J. F. Chung, S. F. Liang, and H. C. Pu, "Support-vector-based fuzzy neural networks," Int. J. Comput. Intell Res., vol. 1, no. 2, pp. 138-150, 2005.
30. L. Ljung, System Identification: Theory for the User. Upper Saddle River, NJ: Prentice-Hall, 1999.
31. P. A. Mastorocostas and J. B. Theocharis, "A recurrent fuzzy-neural model for dynamic system identification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 2, pp. 176-190, Apr. 2002.
32. P. A. Mastorocostas and J. B. Theocharis, "An orthogonal least-squares method for recurrent fuzzy-neural modeling," Fuzzy Sets Syst., vol. 140, pp. 285-300, 2003.
33. S. Mitra and Y. Hayashi, "Neuro-fuzzy rule generation: Survey in soft computing framework," IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 748-768, May 2000.
34. K. S. Narendra and P. G. Gallmax, "An iterative method for the identification of nonlinear systems using a Hammerstein model," IEEE Trans. Autom. Control, vol. AC-11, no. 3, pp. 546-550, Jul. 1966.
35. D. G. Schultz and J. L. Melsa, State Functions and Linear Control Systems. New York: McGraw-Hill, 1967.
36. B. De Schutter, "Minimal state-space realization in linear system theory: An overview," J. Comput. Appl. Math., vol. 121, no. 1/2, pp. 331-354, 2000.
37. V. Strejc, State Space Theory of Discrete Linear Control. New York: Wiley, 1981.
38. K. Tanabe, "Projection method for solving a singular system of linear equations and its applications," Numer. Math., vol. 17, pp. 203-214, 1971.
39. J. Theocharis and G. Vachtsevanost, "Recursive learning algorithms for training fuzzy recurrent models," Int. J. Intell. Syst., vol. 11, pp. 1059-1098, 1996.
40. A. C. Tsoi and A. D. Back, "Locally recurrent globally feedforward networks: A critical review of architectures," IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 229-239, Mar. 1994.
41. A. C. Tsoi and A. D. Back, "Discrete time recurrent neural network architectures: A unifying review," Neurocomputing, vol. 15, pp. 183-223, 1997.
42. A. Varga, H. J. M. Stecncken, M. Tomlinson, and D. Joncs, "The NOISEX-92 study on the effect of additive noise automatic speech recognition," in Description of RSG. 10 and Esprit SAM Experiment and Database. Malvern, U.K.: DRA Speech Res., 1992.
43. J. S. Wang and Y. P. Chen, "A fully automated recurrent neural network for unknown dynamic system identification and control," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 56, no. 6, pp. 1363-1372, Jun. 2006.
44. J. S.Wang and C. S. G. Lee, "Self-adaptive neuro-fuzzy inference systems for classification applications," IEEE Trans. Fuzzy Syst. vol. 10, no. 6, pp. 790-802, Dec. 2002.
45. P. Werbos, "Beyond regression: New tools for prediction and analysis in the behavior sciences" Ph.D. dissertation, Harvard Univ., Cambridge, MA, Aug. 1974.
46. B. Widrow and S. D. Stearns, Adaptive Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1985.
47. J. Zhang and A. J. Morris, "Recurrent neuro-fuzzy networks for nonlinear processmodeling," IEEE Trans. Neural Netw., vol. 10, no. 2, pp. 313-326, Mar. 1999.