On Estimation of a Class of Nonlinear Systems by the Kernel Regression Estimate

IEEE Transactions on Information Theory

Volumn 36, Issue 1, 1990, Pages 141-152

  Krzyzak, Adam ^a  

^a Dept of Electrical and Computer Engineering   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

MATHEMATICAL TECHNIQUES--ESTIMATION;

DISCRETE HAMMERSTEIN SYSTEMS; KERNEL REGRESSION ESTIMATE; MULTIPLE-INPUT SINGLE-OUTPUT SYSTEMS; NONLINEAR SYSTEMS;

SYSTEMS SCIENCE AND CYBERNETICS;

EID: 0025234172     PISSN: 00189448     EISSN: 15579654     Source Type: Journal    
DOI: 10.1109/18.50380     Document Type: Article

References (45)

1. T. W. Anderson, The Statistical Analysis of Time Series. New York: Wiley, 1971.
2. S. A. Billings, “Identification of nonlinear systems—A survey,” Proc. Inst. Elec. Eng., vol. 127, pt. D, no. 6, pp. 277–285, 1980.
3. S. A. Billings and S. Y. Fakhouri, “Nonlinear system identification using the Hammerstein model,” hit. J. Syst. Sci., vol. 10, pp. 567–578, 1979.
4. G. E. P. Box and G. M. Jenkins, Time Series Analysis Forecasting and Control. San Francisco, CA: Holden Day, 1976.
5. D. R. Brillinger, Time Series: Data Analysis and Theory. San Francisco, CA: Holden-Day, 1981.
6. P. J. Brockwell and R. A. Davis, Time Series: Theory and Methods. New York: Springer-Verlag, 1987.
7. P. E. Caines, Linear stochastic Systems. New York: Wiley, 1988.
8. S. Cambanis and E. Masry, “On the reconstruction of the covariance of stationary Gaussian process observed through zero-memory nonlinearities,” IEEE Trans. Inform. Theory, vol. IT-24, pp. 485–494, 1978.
9. F. H. I. Chang and R. Luus, “A noniterative method for identification using the Hammerstein model,” IEEE Trans. Automat. Contr., vol. AC-16, pp. 464–468, 1971.
10. P. C. Chow and H. J. Chizeck, “Recursive identification of dynamic systems with time-varying memoryless nonlinearities having deadbands,” in Proc. 1987 American Contr. Conf., 1987, pp. 1155–1157.
11. L. Devroye and T. J. Wagner, “Distribution-free consistency results in nonparametric discrimination and regression function estimation,” Ann. Statist., vol. 8, pp. 231–239, 1980.
12. L. Devroye and F. Machell, “Data structures in kernel density estimates,” IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 360–366, 1985.
13. L. Devroye, A Course in Density Estimation. Boston, MA: Birkhauser, 1987.
14. L. Devroye and A. Krzyzak, “An equivalence theorem for LI convergence of the kernel regression estimate,” J. Statist. Planning and Inference, vol. 23, pp. 71–82, 1989.
15. N. Dunford and J. T. Schwartz, Linear Operators, Part I. General Theory. New York: Interscience, 1957.
16. J. Durbin, “Efficient estimation of parameters in moving-average models,” Biometrica, vol. 46, pp. 306–316, 1959.
17. W. A. Fuller, Introduction to Statistical Time Series. New York: Wiley, 1976.
18. P. G. Gallman, “An iterative method for identification of nonlinear systems using a Uryson model,” IEEE Trans. Automat. Contr., vol. AC-20, pp. 771–775, 1975.
19. P. G. Gallman, “A comparison of two Hammerstein model identification algorithms,” IEEE Trans. Automat. Contr., vol. AC-21, pp. 124–126, 1976.
20. W. Greblicki and A. Krzyzak, “Asymptotic properties of kernel estimates of a regression function,” J. Statist. Planning Inference, vol. 4, pp. 81–90, 1980.
21. W. Greblicki. A. Krzyzak, and M. Pawlak, “Distribution-free point wise consistency of kernel regression estimate,” Ann. Statist., vol. 12, pp. 1570–1575, 1984.
22. W. Greblicki and M. Pawlak, “Identification of discrete Hammerstein systems using kernel regression estimates,” IEEE Trans. Automat. Contr., vol. AC-31, pp. 74–77, 1986.
23. H. O. Hartley, “The Gauss-Newton method for the fitting of nonlinear regression functions by least squares,” Technometrics, vol. 3, pp. 269–280, 1961.
24. N. D. Haist, F. H. I. Chang, and R. Luus, “Nonlinear identification in the presence of correlated noise using a Hammerstein model,” IEEE Trans. Automat. Contr., vol. AC-18, pp. 552–555, 1973.
25. T. C. Hsia, System Identification. Lexington, MA: D. C. Heath, 1977.
26. A. Klzyiak and M. Pawlak, “Distribution-free consistency of a nonparametric kernel regression estimate and classification,” IEEE Trans. Inform. Theory, vol. IT-30, pp. 78-81, 1984.
27. A. Krzyiak, “The rates of convergence of kernel regression estimates and classification rules,” IEEE Trans. Inform. Theory, vol. IT-32, pp. 662-679. 1986.
28. M. Kung and B. F. Womack, “Discrete-time adaptive control of linear dynamic systems with a two-segment piecewise-linear asymmetric nonlinearity,” IEEE Trans. Automat. Contr., vol. AC-29. pp. 170-172, 1984.
29. M. Loeve, Probahiliy Theory: II. New York: Springer, 1978.
30. E. Masry and S. Cambains, ”Signal identification after noisy, nonlinear transformations.” IEEE Trans. Inform. Theory, vol. IT-26, pp. 50-58.1980.
31. E. Masry and S. Cambains, “Consistent estimation of continuous-time signals from nonlinear transformations of noisy samples,” IEEE Trans. Inform. Theory, vol. IT-27, pp. 84-96, 1981.
32. T. E. McCannon, W. C. Gallagher, D. Mmoo-Hamedani, and G. L. Wise, “On the design of nonlinear discrete-time predictors,” IEEE Trans. Injorm. Theory, vol. IT-28, p. 366-371. 1982.
33. T. F. McCannon, and W. C. Gallagher, “On a class of random processes exhibiting optimal nonlinear one-step predictors,” IEEE Traits. Inform. Theory, vol. IT-27, pp. 652-654, 1981.
34. R. E. Mortensen. Random Signals and Systems., New York: Wiley. 1987.
35. E. A. Nadaraya, “On estimating regression.” Theor. Probab. Appl., vol. 9. pp. 141-142. 1964.
36. K. S. Narendra and P. G. Gallman, “An iterative method for the identification of nonlinear systems using the Hammerstein model,” IEEE Trans. Automur. Contr., vol. AC-11, pp. 546-550, 1966.
37. M. Niedzwiecki, “On a method of identification of nonlinear static characteristic of a Hammerstein system,” Arch. Automat. Telemech., vol. 25, pp. 51-62, 1980 (in Polish).
38. M. B. Priestley, Spectral Analysis and Time Series. New York: Academic, 1981.
39. C. Spiegelman and J. Sacks. “Consistent window estimation in nonparametric regression,” Ann. Statist., vol. 8, pp. 240-246, 1980.
40. J. C. Stapleton and S. C. Baas, “Adaptive noise cancellation for a class of nonlinear. dynamic reference channels.” IEEE Trans. Circuits Syst., vol. CAS-32, pp. 143-150, 1985.
41. C. Stone. “Optimal rates of convergence for nonparametric estimators,” Ann. Statist., vol. 8,. pp. 1348-1360, 1980.
42. C. Stone. “Optimal global rates of convergence for nonparametric regression.” Ann. Statist., vol. 10, pp. 1040-1053, 1982.
43. M. A. L. Thathachar and S. Ramaswamy, “Identification of a class of nonlinear systems,” Int. J. Contr., vol. 18. pp. 741-752. 1973.
44. G. S. Watson. “Smooth regression analysis,” Sankhya, Ser. A, vol.26, pp. 355-372. 1964.
45. R. L. Wheeden and A. Zygmund, Measure and Integral. New York: Marcel Dekker, 1977.