Generalized regression neural networks in time-varying environment

IEEE Transactions on Neural Networks

Volumn 15, Issue 3, 2004, Pages 576-596

  Rutkowski, Leszek ^a,b  

^a CZESTOCHOWA UNIVERSITY OF TECHNOLOGY   (Poland)

^b Dept of Artificial Intelligence   (Poland)

Author keywords

Convergence properties; Generalized regression neural networks (GRNN); Orthogonal series kernel; Parzen kernel; Time varying environment

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; LEARNING SYSTEMS; PROBABILITY DISTRIBUTIONS; REGRESSION ANALYSIS;

GENERALIZED REGRESSION NEURAL NETWORKS; ORTHOGONAL SERIES KERNEL; PARZEN KERNEL; TIME-VARYING ENVIRONMENT;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; ENVIRONMENT; REGRESSION ANALYSIS; TIME;

ENVIRONMENT; NEURAL NETWORKS (COMPUTER); REGRESSION ANALYSIS; TIME FACTORS;

EID: 2542511591     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2004.826127     Document Type: Article

References (43)

1. A. E. Albert and L. A. Gardner, Stochastic Approximation and Nonlinear Regression. Cambridge, MA: The MIT Press, 1967.
2. G. Alexits, Convergence Problems of Ortogonal Series, Akademiai Kiado, Hungary: Budapest, 1961.
3. E. M. Braverman and L. I. Rozonoer, "Convergence of random processes in machine learning theory," Automat. Remote Contr., vol. 30, pp. 44-64, 1969.
4. P. Burrascano, "Learning vector quantization for the probabilistic neural network," IEEE Trans. Neural Networks, vol. 2, pp. 458-461, 1991.
5. L. Carleson, "On convergence and growth of partial sums of Fourier series," Acta Math., vol. 116, pp. 135-137, 1966.
6. K. L. Chung, "On a stochastic approximation method," Ann. Math. Statist., vol. 25, pp. 463-483, 1954.
7. H. I. Davies, "Strong consistency of a sequential estimator of a probability density function," Bull. Math. Statist., vol. 15, pp. 49-53, 1973.
8. L. P. Devroye, "On the pointwise and the integral convergence of recursive kernel estimates of probability densities," Utilitias Math., vol. 15, pp. 113-128, 1979.
9. L. P. Devroye, "On the almost everywhere convergence of nonparametric regression function estimates," Ann. Stat., vol. 9, pp. 1310-1309, 1981.
10. 1 View, U.K.: Wiley, 1983.
11. S. Dupač, "A dynamic stochastic approximation method," Ann. Math. Stat., vol. 36, pp. 1695-1702, 1965.
12. R. L. Eubank, Spline Smoothing and Nonparametric Regression. New York and Basel: Marcel Dekker, 1988.
13. W. Greblicki and A. Krzyżak, "Asymptotic properties of kernel estimates of a regression function," J. Statist. Planning Inference, vol. 4, pp. 81-90, 1980.
14. W. Greblicki, A. Krzyżak, and M. Pawlak, "Distribution-free pointwise consistency of kernel regression estimate," Ann. Stat., vol. 12, pp. 1570-1575, 1984.
15. W. Greblicki and M. Pawlak, "Classification using the Fourier series estimate of multivariate density function," IEEE Trans. Syst., Man., Cybern., vol. 11, pp. 726-730, 1981.
16. L. Györfi, M. Kohler, A. Krzyżak, and H. Walk, A Distribution-Free Theory of Nonparametric Regression. New York, NY: Springer Verlag, 2002.
17. L. Ljung, System Identification: Theory for the User. Englewood Cliffs, NJ: Prentice-Hall, 1987.
18. K. Z. Mao, K.-C. Tan, and W. Ser, "Probabilistic neural-network structure determination for pattern classification," IEEE Trans. Neural Networks, vol. 11, pp. 1009-1016, 2000.
19. E. A. Nadaraya, "On estimating regression," Theory of Probab. Applicat., vol. 9, pp. 141-142, 1964.
20. S. M. Nikolsy, A Course of Mathematical Analysis, Moscow: Mir, 1977.
21. A. Pagan and A. Ullah, Nonparametric Econometrics. London: Cambridge Univ. Press., 1999.
22. D. W. Patterson, Artificial Neural Networks, Theory, and Applications. Englewood Cliffs, NJ: Prentice-Hall, 1995.
23. L. Rutkowski, "Sequential estimates of probability densities by orthogonal series and their application in pattern classification," IEEE Trans. Syst., Man, Cybern., vol. SMC-10, no. 12, pp. 918-920, 1980.
24. ____, "Sequential estimates of a regression function by orthogonal series with applications in discrimination," in Lectures Notes in Statistics, vol. 8, New York, 1981, pp. 236-244.
25. ____, "Identification of MISO nonlinear regressions in the presence of a wide class of disturbances," IEEE Trans. Inform. Theory, vol. 37, pp. 214-216, 1991.
26. ____, "Multiple Fourier series procedures for extraction of nonlinear regressions from noisy data," IEEE Trans. Signal Processing, vol. 41, pp. 3062-3065, 1993.
27. ____, New Soft Computing Techniques for System Modeling, Pattern Classification, and Image Processing. New York: Springer Verlag, 2004.
28. L. Rutkowski and K. Cpalka, "Flexible neuro-fuzzy systems," IEEE Trans. Neural Networks, vol. 14, pp. 554-574, 2003.
29. L. Rutkowski, "Adaptive probabilistic neural networks for pattern classification in time-varying environment," IEEE Trans. Neural Networks, vol. 15, 2004.
30. G. Sansone, Orthogonal Functions. New York: Interscience, 1959.
31. P. Sjölin, "Convergence almost everywhere of certain singular integrals and multiple fourier series," Ark. Math., vol. 9, pp. 65-90, 1971.
32. T. Söderström and P. Stoica, System Identification. Englewood Cliffs, NJ: Prentice-Hall, 1989.
33. D. F. Specht, "Probabilistic neural networks," Neural Netw., vol. 3, pp. 109-118, 1990.
34. ____, "Probabilistic neural networks and the polynomial adaline as complementary techniques for classification," IEEE Trans. Neural Networks, vol. 1, pp. 111-121, 1990.
35. ____, "A general regression neural network," IEEE Trans. Neural Networks, vol. 2, pp. 568-576, 1991.
36. ____, "Enhancements to the probabilistic neural networks," in Proc. IEEE Int. Joint Conf., Neural Networks, Baltimore, MD, 1992, pp. 761-768.
37. G. Szegö, "Orthogonal polynomials," Amer. Math. Soc. Coll. Publ., vol. 23, 1959.
38. J. R. Thompson and R. A. Tapia, "Nonparametric function estimation, modeling and simulation," in SIAM, Philadelphia, PA, 1990.
39. G. G. Walter, "Properties of Hermite series estimation of probability density," Ann. Stat., vol. 5, pp. 1258-1264, 1977.
40. W. Watanabe, "On convergence of asymptotically optimal discriminant functions for pattern classification problems," Bull. Math. Statist., vol. 16, pp. 23-34, 1974.
41. G. S. Watson, "Smooth regression analysis," Sankhya Series A, vol. 26, pp. 359-372, 1964.
42. H. Yamato, "Sequential estimation of a continuous probability density function and the mode," Bull. Math. Statist., vol. 14, pp. 1-12, 1971.
43. P. V. Yee and S. Haykin, Regularized Radial Basis Function Networks, Theory, and Applications. New York: Wiley, 2001.