A new class of wavelet networks for nonlinear system identification

IEEE Transactions on Neural Networks

Volumn 16, Issue 4, 2005, Pages 862-874

  Billings, Stephen A ^a   Wei, Hua Liang ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Nonlinear autoregressive with exogenous inputs (NARX) models; Nonlinear system identification; Orthogonal least squares (OLS); Wavelet networks (WNs)

Indexed keywords

LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; NEURAL NETWORKS; NONLINEAR CONTROL SYSTEMS; REGRESSION ANALYSIS; WAVELET TRANSFORMS;

NONLINEAR AUTOREGRESSIVE WITH EXOGENOUS INPUTS MODELS; NONLINEAR SYSTEM IDENTIFICATION; ORTHOGONAL LEAST SQUARES; WAVELET NETWORKS;

IDENTIFICATION (CONTROL SYSTEMS);

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; COMPUTER ANALYSIS; COMPUTER SIMULATION; EVALUATION; FUZZY LOGIC; MATHEMATICAL COMPUTING; METHODOLOGY; NONLINEAR SYSTEM; SIGNAL PROCESSING; STATISTICAL MODEL; STATISTICS;

ALGORITHMS; COMPUTER SIMULATION; COMPUTING METHODOLOGIES; FUZZY LOGIC; MODELS, BIOLOGICAL; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED; STOCHASTIC PROCESSES;

EID: 23044434528     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2005.849842     Document Type: Article

References (60)

1. C. K. Chui, An Introduction to Wavelets. New York: Academic, 1992.
2. I. Daubechies, Ten Lectures on Wavelets. Philaelphia, PA: SIAM, 1992.
3. Y. Meyer, Wavelets: Algorithms and Applications. Philaelphia, PA: SIAM, 1993.
4. S. Chen, S. A. Billings, and P. M. Grant, "Nonlinear system identification using neural networks," Int. J. control, vol. 51, pp. 1191-1214, Jun. 1990.
5. S. Chen and S. A. Billings, "Neural networks for nonlinear system modeling and identification," Int. J. Control, vol. 56, pp. 319-346, Aug. 1992.
6. S. Chen, S. A. Billings, and P. M. Grant, "Recursive hybrid algorithm for nonlinear system identification using radial basis function networks," Int. J. Control, vol. 55, pp. 1051-1070, May 1992.
7. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Netw., vol. 2, no. 2, pp. 252-262, Mar. 1991.
8. S. A. Billings, H. B. Jamaluddin, and S. Chen, "Properties of neural networks with applications to modeling nonlinear dynamic systems," Int. J. Control, vol. 55, pp. 193-224, Jan. 1992.
9. S. A. Billings and S. Chen, "The determination of multivadable nonlinear models for dynamic systems using neural networks," in Neural Network Systems Techniques and Applications, C. T. Leondes, Ed. New York: Academic, 1998, pp. 231-278.
10. P. S. Sastry, G. Santharam, and K. P. Unnikrishnan, "Memory neuron networks for identification and control of dynamical systems," IEEE Trans. Neural Netw., vol. 5, no. 3, pp. 306-319, May 1994.
11. S. Haykin, Neural Networks: A Comprehensive Foundation. New York: Macmillan, 1994.
12. T. N. Lin, B. G. Horne, P. Tino, and C. L. Giles, "Learning long-term dependencies in NARX recurrent neural networks," IEEE Trans. Neural Netw., vol. 7, no. 6, pp. 1329-1338, Nov. 1996.
13. K. S. Narendra and S. Mukhopadhyay, "Adaptive control using neural networks and approximate models" IEEE Trans. Neural Netw., vol. 8, no. 3, pp. 475-485, May 1997.
14. N. B. Karayiannis and M. M. Randolph, "On the construction and training of reformulated radial basis function networks," IEEE Trans. Neural Netw., vol. 14, no. 4, pp. 835-846, Jul. 2003.
15. I. Rivals and L. Personnaz, "Neural-network construction and selection in nonlinear modeling," IEEE Trans. Neural Netw., vol. 14, no. 4, pp. 804-819, Jul. 2003.
16. R. J. Wal and H. H. Chang, "Backstepping wavelet neural network control for indirect field-oriented induction motor drive," IEEE Trans. Neural Netw., vol. 15, no. 2, pp. 367-382, Mar. 2004.
17. H. H. Szu, B. Telfer, and S. Kadambe, "Neural network adaptive wavelets for signal representation and classification," Opt. Eng., vol. 31, pp. 1907-1916, Sep. 1992.
18. Q. H. Zhang and A. Benveniste, "Wavelet networks," IEEE Trans. Neural Netw., vol. 3, no. 6, pp. 889-898, Nov. 1992.
19. Y. C. Pari and P. S. Krishnaprasad, "Analysis and synthesis of feedforward neural networks using discrete affine wavelet transforms," IEEE Trans. Neural Netw., vol. 4, no. 1, pp. 73-85, Jan. 1993.
20. J. G. Daugman, "Complete discrete 2-D gabor transforms by neural networks for image analysis and compression," IEEE Trans. Acoust., Speech, Signal Process., vol. 36, no. 7, pp. 1169-1179, Jul. 1988.
21. H. Dickhaus and H. Heinrich, "Classfying biosignals with wavlet networks," IEEE Eng. Med. Biol. Mag., vol. 15, no. 5, pp. 103-111, Sep. 1996.
22. S. Pittner, S. V. Kamarthi, and Q. G. Gao, "Wavelet networks for sensor signal classification in flank wear assessment," J. Intell. Manufact., vol. 9, pp. 315-322, Aug. 1990.
23. K. W. Wong and A. C.-S. Leung, "On-line successive synthesis of wavelet networks," Neural Process. Lett., vol. 7, pp. 91-100, Apr. 1998.
24. E. A. Rying, G. L. Bilbro, and J. C. Lu, "Focused local learning with wavelet neural networks," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 304-319, Mar. 2002.
25. L. Y. Cao, Y. G. Hong, H. P. Fang, and G. W. He, "Predicting chaotic time series with wavelet networks," Phys. D, vol. 85, pp. 225-238, Jul. 1995.
26. D. Allingham, M. West, and A. Mees, "Wavelet reconstruction of nonlinear dynamics," Int. J. Bifurcat. Chaos, vol. 8, pp. 2191-2201, Nov. 1998.
27. Y. Oussar and G. Dreyfus, "Initialization by selection for wavelet network training," Neurocomput., vol. 34, pp. 131-143, Sep. 2000.
28. J. H. Friedman, "Multivariate adaptive regression splines," Ann. Statist., vol. 19, pp. 1-67, Mar. 1991.
29. Z. H. Chen, "Fitting multivariate regression functions by interaction spline models," J. Roy. Stat. Soc. B Met., vol. 55, pp. 473-491, 1993.
30. J. Zhang, G. G. Walter, Y. Miao, and W. N. W. Lee, "Wavelet neural networks for function learning," IEEE Trans. Signal Process., vol. 43, no. 6, pp. 1485-1497, Jun. 1995.
31. Q. H. Zhang, "Using wavelet network in nonparametric estimation," IEEE Trans. Neural Netw., vol. 8, no. 2, pp. 227-236, Mar. 1997.
32. S. Ferrari, M. Maggioni, and N. A. Borghese, "Multoresolution approximation with hierarchical radial basis functions networks," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 178-188, Jan. 2004.
33. D. Coca and S. A. Billings, "Continuous-time system identification for linear and nonlinear system identification using wavelet decompositions," Int. J. Bifurcat. Chaos, vol. 7, pp. 87-96, Jan. 1997.
34. S. A. Billings and D. Coca, "Discrete wavelet models for identification and qualitative analysis of chaotic systems," Int. J. Bifurcat. Chaos, vol. 9, pp. 1263-1284, Jul. 1999.
35. S. A. Billings, S. Chen, and M. J. Korenberg, "Identification of MIMO nonlinear systems suing a forward regression orthogonal estimator," Int. J. Control, vol. 49, pp. 2157-2189, Jun. 1989.
36. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their application to nonlinear system identification," Int. J. Control, vol. 50, pp. 1873-1896, Nov. 1989.
37. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least-squares learning algorithm for radial basis function networks," IEEE Trans. Neural Netw., vol. 2, no. 2, pp. 302-309, Mar. 1991.
38. I. J. Leontaritis and S. A. Billings, "Input-output parametric models for nonlinear systems-part I: Deterministic nonlinear systems; part II: Stochastic nonlinear systems," Int. J. Control, vol. 41, pp. 303-344, 1985.
39. J. Process Conte, "Nonlinear input/output modeling," J. Process Contr., vol. 5, pp. 197-211, Aug. 1995.
40. J. Process Conte, "Nonlinear process identification," in Nonlinear Process Control, M. A. Henson and D. E. Seborg, Eds. Englewood Cliffs, NJ: Prentice-Hall, 1997, pp. 11-110.
41. L. A. Aguirre, "Application of global models in the identification, analysis and control of nonlinear dynamics and chaos" Ph.D. dissertation, Dept. Autom. Control Syst. Eng, Univ. Sheffield, Sheffield, U.K., 1994.
42. N. Chiras, "Linear and nonlinear modeling of gas turbine engines," Ph.D. dissertation, School Electron., Univ. Glamorgan, Wales, U.K., 2002.
43. R. K. Pearson, Discrete-Time Dynamic Models. Oxford, U.K.: Oxford Univ. Press, 1999.
44. G. Y. Li, C. Rosenthal, and H. Rabits, "High dimensional model representations," J. Phys. Chem. A, vol. 105, pp. 7765-7777, Aug. 2001.
45. H. L. Wei and S. A. Billings, "A unified wavelet-based modeling framework for nonlinear system identification: The WANARX model structure," Int. J. Control, vol. 77, pp. 351-366, Mar. 2004.
46. J. Gonzalez, I. Rojas, J. Ortega, H. Pomares, F. J. Fernandez, and A. F. Diaz, "Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis functions networks for function approximation," IEEE Trans. Neural Netw., vol. 14, no. 6, pp. 1478-1495, Nov. 2003.
47. S. G. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, pp. 674-693, Jul. 1989.
48. S. G. Mallat, A Wavelet Tour of Signal Processing. New York: Academic, 1998.
49. L. X. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximations, and orthogonal least squares learning," IEEE Trans. Neural Netw., vol. 3, no. 5, pp. 807-814, Sep. 1992.
50. X. Hong and C. J. Harris, "Nonlinear model structure detection using optimum experimental design and orthogonal least squares" IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 435-439, Mar. 2001.
51. X. Hong, P. M. Sharkey, and K. Warwick, "A robust nonlinear identification algorithm using PRESS statistic and forward regression," IEEE Trans. Neural Netw., vol. 14, no. 2, pp. 454-458, Mar. 2003.
52. S. A. Billings and H. L. Wei, "The wavelet-NARMAX representation: A hybrid model structure combining polynomial models with multiresolution wavelet decompositions," Int. J. Syst. Sci., to be published.
53. S. A. Billings and W. S. F. Voon, "Correlation based model validity tests for nonlinear models," Int. J. Control, vol. 44, pp. 235-244, Jul. 1986.
54. S. A. Billings and Q. M. Zhu, "Nonlinear model validation using correlation tests," Int. J. Control, vol. 60, pp. 1107-1120, Dec. 1994.
55. D. Coca, "A class of wavelet multiresolution decompositions for nonlinear system identification and signal processing," Ph.D., Dept. Autom. Control Syst. Eng., Univ. Sheffield, Sheffield, U.K., 1996.
56. H. L. Wei, S. A. Billings, and J. Liu, "Term and variable selection for nonlinear system identification," Int. J. Control, vol. 77, pp. 86-110, Jan. 2004.
57. M. C. Mackey and L. Glass, "Oscillation and chaos in physiological control systems," Science, vol. 197, pp. 287-289, Jul. 1977.
58. R. Bone, M. Crucianu, and J.-P. A. de Beauville, "Learning long-term dependences by the selective additional time-delayed connetions to recurrent neural networks," Neurocomput., vol. 48, pp. 251-266, Oct. 2002.
59. M. Casdagli, "Nonlinear prediction of chaotic time series," Phys. D, vol. 35, pp. 335-356, May 1989.
60. S. Soltani, "On the use of wavelet decomposition for time series prediction," Neurocomput., vol. 48, pp. 267-277, Oct. 2002.