A recursive algorithm for mixture of densities estimation

IEEE Transactions on Information Theory

Volumn 59, Issue 10, 2013, Pages 6893-6906

  Sancetta, Alessio ^a  

^a UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Boosting; copula; elliptic distribution; empirical characteristic function; Hilbert space; location model; recursive algorithm

Indexed keywords

BOOSTING; COPULA; ELLIPTIC DISTRIBUTION; EMPIRICAL CHARACTERISTIC FUNCTION; LOCATION MODELING; RECURSIVE ALGORITHMS;

APPROXIMATION ALGORITHMS; ESTIMATION; HILBERT SPACES; MIXTURES; VECTOR SPACES;

ITERATIVE METHODS;

EID: 84884371473     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2013.2272456     Document Type: Article

References (33)

1. M. A. Arcones and E. Giné, "On the bootstrap of and statistics," Ann. Statist., vol. 20, pp. 655-674, 1992.
2. A. R. Barron, "Universal approximation bounds for superpositions of a sigmoidal function," IEEE Trans. Inf.Theory, vol. 39, no. 3, pp. 930-944, May 1993.
3. N. H. Bingham, C. M. Goldie, and J. L. Teugels, Regular Variation. Cambridge, U.K.: Cambridge Univ. Press, 1989.
4. S. Boucheron, G. Lugosi, and P. Massart, "Concentration inequalities using the entropy method," Ann. Probab., vol. 31, pp. 1583-1614, 2003. (Pubitemid 36881408)
5. M. Carrasco and J.-P. Florens, "Efficient GMM estimation using the empirical characteristic function," IDEIWorking Paper vol. 140, 2002.
6. L. Devroye and L. Gyorfi, "Distribution and density estimation," in Principles of Nonparametric Learning, L. Gyorfi, Ed. Vienna, Austria: Springer-Verlag, 2002, vol. 434, CISM Courses and Lectures, pp. 211-270.
7. A. Feuerverger and P. McDunnough, "On the efficiency of empirical characteristic function procedures," J. Roy. Statist. Soc., ser. B, vol. 43, pp. 20-27, 1981a.
8. A. Feuerverger and P. McDunnough, "On some Fourier methods for inference," J. Amer. Statist. Assoc., vol. 76, pp. 379-387, 1981b.
9. J. H. Friedman, "Greedy function approximation: A gradient boosting machine," Ann. Statist., vol. 29, pp. 1189-1232, 2001. (Pubitemid 33405972)
10. J. K. Ghosh and R.V. Ramamoorthi, Bayesian Nonparametrics. New York, NY, USA: Springer-Verlag, 2003.
11. S.Ghosal, J. K. Ghosh, andR. V. Ramamoorthi, "Posterior consistency of Dirichlet mixtures in density estimation," Ann. Statist., vol. 27, pp. 143-158, 1999.
12. S. Ghosal and A.W. van der Vaart, "Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities," Ann. Statist., vol. 29, pp. 1233-1263, 2001. (Pubitemid 33405973)
13. L. Hua and H. Joe, "Tail Order and intermediate tail dependence of multivariate copulas," J. Multivariate Anal., vol. 102, pp. 1454-1471, 2011.
14. L. Jones, "A simple lemma on greedy approximation in Hilbert space and convergence rates for projection pursuit regression and neural network training," Ann. Statist., vol. 20, pp. 608-613, 1992.
15. Y. Kano, "Consistency property of elliptical probability density functions," J. Multivariate Anal., vol. 51, pp. 139-147, 1994.
16. J. Klemelä, "Density estimation with stagewise optimization of the empirical risk," Mach. Learning, vol. 67, pp. 169-195, 2007.
17. A. Ledford and J. Tawn, "Statistics for near independence in multivariate extreme values," Biometrika, vol. 83, pp. 169-187, 1996.
18. J. Q. Li and A. R. Barron, "Mixture density estimation," in Advances in Neural Information Processing Systems, S. A. Solla, T. K. Leen, and K. Mueller, Eds. Cambridge, MA, USA: MIT Press, 2000, vol. 12, pp. 279-285.
19. A. Lijoi, I. Pruenster, and S. G. Walker, "On consistency of nonparametric normal mixtures for Bayesian density estimation," J. Amer. Statist. Assoc., vol. 100, pp. 1292-1296, 2005. (Pubitemid 41801276)
20. B. Lindsay, Mixture Models: Theory, Geometry and Applications. Hayward, CA, USA: IMS, 1995.
21. H. Manner and J. Segers, "Tails of correlation mixtures of elliptical copulas," Insurance: Math. Econ., vol. 48, pp. 153-160, 2011.
22. R. Martin, "An approximate Bayesian marginal likelihood approach for estimating finite mixtures," Commun. Statist.: Simul. Comput., vol. 42, pp. 1533-1548, 2013.
23. R. Martin and J. K. Ghosh, "Stochastic approximation and Newton's estimate of a mixing distribution," Statist. Sci., vol. 23, pp. 365-382, 2008.
24. R. Martin and S. T. Tokdar, "Semiparametric inference in mixture models with predictive recursion marginal likelihood," Biometrika, vol. 98, pp. 567-582, 2011.
25. M. A. Newton, "On a nonparametric recursive estimator of the mixing distribution," Sankhy? Ser. A 64, vol. 64, pp. 306-322, 2002.
26. K. Pearson, "Contributions to the mathematical theory of evolution," Philosoph. Trans. Roy. Soc. A, vol. 185, pp. 71-110, 1894.
27. A. Rakhlin, D. Panchenko, and S. Mukherjee, "Risk bounds for mixture density estimation," ESAIM: Probab. Statist., vol. 9, pp. 220-229, 2005. (Pubitemid 41643444)
28. A. Sancetta and S. E. Satchell, "Changing correlation and equity portfolio diversification failure for linear factor models during market declines," Appl. Math. Finance, vol. 14, pp. 227-242, 2007.
29. R. J. Serfling, Approximation Theorems of Mathematical Statistics. New York, NY, USA: Wiley, 1980.
30. J. Sethuraman, "A constructive definition of Dirichlet priors," Statistica Sinica, vol. 4, pp. 639-650, 1994.
31. S. T. Tokdar, R. Martin, and J. K. Ghosh, "Consistency of a recursive estimate of mixing distributions," Ann. Statist., vol. 37, pp. 250-2522, 2009.
32. C. F. J. Wu, "On the convergence properties of the EM algorithm," Ann. Statist., vol. 11, pp. 95-103, 1983.
33. J. Yu, "Empirical characteristic function estimation and its applications," Econ. Rev., vol. 23, pp. 93-123, 2004. (Pubitemid 38956316)