Using wavelet network in nonparametric estimation

IEEE Transactions on Neural Networks

Volumn 8, Issue 2, 1997, Pages 227-236

  Zhang, Qinghua ^a  

^a CAMPUS DE BEAULIEU   (France)

Author keywords

Neural network; Nonparametric regression; System identification; Wavelets

Indexed keywords

ALGORITHMS; ESTIMATION; IDENTIFICATION (CONTROL SYSTEMS); MATHEMATICAL MODELS; NONLINEAR CONTROL SYSTEMS; REGRESSION ANALYSIS; WAVELET TRANSFORMS;

NONLINEAR SYSTEM IDENTIFICATION; NONPARAMETRIC REGRESSION ESTIMATION; WAVELET NETWORK; WAVELETS;

NEURAL NETWORKS;

EID: 0031098254     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.557660     Document Type: Article

References (43)

1. C. K. Chui, Ed., Wavelets: A Tutorial in Theory and Applications. New York: Academic, 1992.
2. M. B. Ruskai, G. Beylkin, R. Coifman, I. Daubechies, S. Mallat, Y. Meyer, and L. Raphael, Eds., Wavelets and Their Applications. Boston, MA: Jones and Bartlett, 1992.
3. A. Benveniste, A. Juditsky, B. Delyon, Q. Zhang, and P. Y. Glorennec, "Wavelets in identification," in Proc. SYSID'94, 10th IFAC Symp. Syst. Identification, Copenhagen, Denmark, 1994.
4. G. Cybenko, "Approximation by superposition of a sigmoidal function," Math. Contr., Signals, Systems, vol. 2, pp. 303-314, 1989.
5. K. Hornik, "Multilayer feedforward networks are universal approximators," Neural Networks, vol. 2, 1989.
6. A. Barron, "Universal approximation bounds for superpositions of a sigmoidal function," IEEE Trans. Inform. Theory, vol. 39, 1993.
7. T. Poggio and F. Girosi, "Networks for approximation and learning," Proc. IEEE, vol. 78, no. 9, pp. 1481-1497, 1990.
8. J. Sjöberg, H. Hjalmarsson, and L. Ljung, "Neural networks in identification," in Proc. SYSID'94, 10th IFAC Symp. Syst. Identification, Copenhagen, Denmark, 1994.
9. Q. Zhang and A. Benveniste, "Wavelet networks," IEEE Trans. Neural Networks, vol. 3, pp. 889-898, Nov. 1992.
10. J. Hong, "Identification of stable systems by wavelet transform and artificial neural networks," Ph.D. dissertation, Univ. Pittsburgh, PA, 1992.
11. Y. C. Pati and P. S. Krishnaprasad, "Analysis and synthesis of feedforward neural networks using discrete affine wavelet transformations," IEEE Trans. Neural Networks, vol. 4, pp. 73-85, Jan. 1993.
12. B. R. Bakshi and G. Stephanopoulos, "Wave-net: A multiresolution hierarchical neural network with localized learning," Amer. Inst. Chem. Eng. J., vol. 39, pp. 57-81, Jan. 1993.
13. M. K. Tsatsanis and G. B. Giannakis, "Time-varying system identification and model validation using wavelets," IEEE Trans. Signal Processing, vol. 41, pp. 3512-3523, 1993.
14. V. Kreinovich, O. Sirisaengtaksin, and S. Cabrera, "Wavelet neural networks are asymptotically optimal approximators for functions of one variable," in Proc. IEEE Int. Conf. Neural Networks, Orlando, FL, June 1994, pp. 299-304.
15. B. Delyon, A. Juditsky, and A. Benveniste, "Accuracy analysis for wavelet approximations," IEEE Trans. Neural Networks, vol. 6, pp. 332-348, 1995.
16. I. Daubechies, Ten Lectures on Wavelets, CBMS-NSF regional series in applied mathematics. Philadelphia, PA: SIAM, 1992.
17. S. A. Tretter, Introduction to Discrete-Time Signal Processing. New York: Wiley, 1976.
18. 2(R)," Trans. Amer. Math. Soc., vol. 315, no. 1, pp. 69-8, 1989.
19. A. Cohen, "Biorthogonal wavelets," in Wavelets: A Tutorial in Theory and Applications, C. K. Chui, Ed. New York: Academic, 1992, pp. 123-152.
20. J. Duffin and A. C. Schaeffer, "A class of nonharmonic Fourier series," Amer. Math. Soc., vol. 72, pp. 341-336, 1952.
21. T. Kugarajah and Q. Zhang, "Multidimensional wavelet frames," IEEE Trans. Neural Networks, vol. 6, pp. 1552-1556, Nov. 1995.
22. N. Draper and H. Smith, Applied Regression Analysis, Series in Probability and Mathematical Statistics, 2nd ed. New York: Wiley, 1981.
23. W. R. Dillon and M. Goldstein, Multivariate Analysis: Method and Applications. New York: Wiley, 1984.
24. A. Sen and M. Srivastava, Regression Analysis: Theory, Methods, and Applications. New York: Springer-Verlag, 1990.
25. A. Björck, "Numerics of Gram-Schmidt orthogonalization," Linear Algebra Applicat., vol. 197-198, pp. 297-316, 1994.
26. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their application to nonlinear system identification," Int. J. Contr., vol. 50, no. 5, pp. 1873-1896, 1989.
27. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Networks, vol. 2, pp. 302-309, Mar. 1991.
28. L. Ljung, System Identification: Theory for the User, Prentice-Hall Information and System Sciences Series. Englewood Cliffs, NJ: Prentice-Hall, 1987.
29. J. Rissanen, "Modeling by shortest data description," Automatica, vol. 14, pp. 465-471, 1978.
30. M. Stone, "Cross-validity choice and assessment of statistical predictors," J. Roy. Statist. Soc., vol. 36, pp. 111-147, 1974.
31. R. D. Snee, "Validation of regression models, methods and examples," Technometrics, vol. 19, pp. 415-428, 1977.
32. L and generalized cross-validation in ridge regression and application to the spline smoothing," Ann. Statist., vol. 14, pp. 1101-1112, 1986.
33. L and generalized cross-validation: Discrete index set," Ann. Statist., vol. 15, pp. 958-975, 1987.
34. J. E. Moody, "Note on generalization, regularization, and architecture selection in nonlinear learning systems," in Neural Networks for Signal Processing, B. H. Juang, S. Y. Kung, and C. A. Kamm, Eds., in Proc. 1991 IEEE Wkshp., 1991, pp. 1-10,.
35. H. Akaike, "Statistical predictor identification," Ann. Inst Math. Statist., vol. 22, pp. 203-217, 1970.
36. C. Mallows, "Statistical predictor identification," Technometrics, vol. 15, pp. 661-675, 1973.
37. J. Sjöberg, Q. Zhang, L. Ljung, A. Benveniste, B. Deylon, P-Y. Glorennec, H. Hjalmarsson, and A. Juditsky, "Nonlinear black-box modeling in system identification: A unified overview," Automatica, vol. 31, no. 12, pp. 1691-1724, 1995.
38. A. Juditsky, H. Hjalmarsson, A. Benveniste, B. Deylon, L. Ljung, J. Sjöberg, and Q. Zhang, "Nonlinear black-box models in system identification: Mathematical foundations," Automatica, vol. 31, no. 12, pp. 1725-1750, 1995.
39. G. D'Ans, D. Gottlieb, and P. Kokotovic, "Optimal control of bacterial growth," Automatica, vol. 8, pp. 729-736, 1972.
40. S. Aborhey and D. Williamson, "State and parameter estimation of microbial growth processes," Automatica, vol. 14, no. 5, pp. 493-498, 1978.
41. J.-P. Gauthier, H. Hammouri, and S. Othman, "A simple observer for nonlinear systems, application to bioreactors," IEEE Trans. Automat. Contr., vol. 37, pp. 875-880, 1992.
42. M. Vogt, "Combination of radial basis function neural networks with optimized learning vector quantization," in Proc. IEEE Int. Conf. Neural Networks. Piscataway, NJ: IEEE, 1993, pp. III-1841-1846.
43. D. L. Donoho and I. M. Johnstone, "Adapting to unknown smoothness via wavelet shrinkage," J. Amer. Statist. Assoc., vol. 90, no. 432, pp. 1200-1224, Dec. 1995.