Density estimation through convex combinations of densities: Approximation and estimation bounds

Neural Networks

Volumn 10, Issue 1, 1997, Pages 99-109

  Zeevi, Assaf J ^a   Meir, Ronny ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

approximation error; convergence rates; density estimation; maximum likelihood; mixture models

Indexed keywords

DENSITY ESTIMATION; MAXIMUM LIKELIHOOD; MIXTURE MODELS;

APPROXIMATION THEORY; COMPUTATIONAL COMPLEXITY; CONVERGENCE OF NUMERICAL METHODS; ERRORS; MATHEMATICAL MODELS; PROBABILITY DENSITY FUNCTION;

ESTIMATION;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; LEARNING; PRIORITY JOURNAL;

EID: 0031037819     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(96)00037-8     Document Type: Article

References (17)

1. Adams, R. A. (1975). Sobolev spaces. New York: Academic Press.
2. Amari, S. I., & Murata, N. (1993). Statistical theory of learning curves under entropie loss criterion. Neural Computation, 5, 140-153.
3. Barron, A. R. (1993). Universal approximation bound for superpositions of a sigmoidal function. IEEE Transactions on Information Theory, IT-39, 930-945.
4. Barron, A. R. (1994). Approximation and estimation bounds for artificial neural networks. Machine Learning, 4, 115-133.
5. Barron, A. R., & Sheu, C. H. (1991). Approximation of density functions by sequences of exponential families. Annals of Statistics, 1(3), 1347-1369.
6. Barron, A. R., & Cover, T. M. (1991). Minimum complexity density estimation. IEEE Transactions on Information Theory, IT-37(4), 1034-1054.
7. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of Royal Statistical Society, B39, 1-38.
8. 1 view. New York: John Wiley.
9. Fergusson, T. (1967). Mathematical statistics: a decision theoretic approach. New York: Academic Press.
10. Geman, S., & Gwang, C. R. (1982). Nonparametric maximum likelihood estimation by the method of sieves. Annals of Statistics, 10(2), 401-414.
11. Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991). Adaptive mixtures of local experts. Neural Computation, 3, 79-87.
12. Johnson, N. L., & Kotz, S. (1972). Distributions in statistics. Continuous univariate distributions - 2. New York: John Wiley.
13. Jordan, M . I., & Jacobs, R. A. (1994). Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6, 181-214.
14. Jordan, M. I., & Xu, L. (in press). Convergence results for the EM approach to mixtures of expert architectures. Neural Networks.
15. Le Cam, L. (1990). Asymptotics in statistics: some basic concepts. Berlin: Springer-Verlag.
16. Mhaskar, H. (1995). Versatile Gaussian networks. Unpublished manuscript.
17. Park, J., & Sandberg, I. W. (1991). Universal approximation using radial-basis function networks. Neural Computation, 3, 246-257.