A functional EM algorithm for mixing density estimation via nonparametric penalized likelihood maximization

Journal of Computational and Graphical Statistics

Volumn 18, Issue 2, 2009, Pages 481-504

  Liu, Lei ^a   Levine, Michael ^b   Zhu, Yu ^b  

^a HealthCare Interactive   (United States)

^b PURDUE UNIVERSITY   (United States)

Author keywords

Mixture model; Nonparametric maximum penalized likelihood estimate; Ordinary differential equation with boundary conditions

Indexed keywords

EID: 77950649478     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/jcgs.2009.07111     Document Type: Article

References (42)

1. Adams, R. (1975), Sobolev Spaces, New York: Academic Press.
2. Ascher, U. M., Mattheij, R. M., and Russell, R. D. (1988), Numerical Solution of Boundary Value Problems for Ordinary Differential Equations, Englewood Cliffs, NJ: Prentice Hall.
3. Clarke, F. H., and Vinter, R. B. (1990), "A Regularity Theory for Variational Problems With Higher Order Derivatives," Transactions of the American Mathematical Society, 320, 227-251.
4. De Montricher, G. M., Tapia, R. A., and Thompson, J. R. (1975), "Nonparametric Maximum Likelihood Estimation of Probability Densities by Penalty Function Methods," The Annals of Statistics, 3, 1329-1348.
5. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977), "Maximum Likelihood From Incomplete Data via the EM Algorithm," Journal of the Royal Statistical Society, Ser. B, 39, 1-38.
6. Eggermont, P., and LaRiccia, V. (2001), Maximum Penalized Likelihood: Volume I, Density Estimation, New York: Springer.
7. Eggermont, P. P. B., and LaRiccia, V. N. (1995), "Maximum Smoothed Likelihood Density Estimation for Inverse Problems," The Annals of Statistics, 23, 199-220.
8. Eggermont, P., and LaRiccia, V. (1997), "Nonlinearly Smoothed EM Density Estimation With Automated Smoothing Parameter Selection for Nonparametric Deconvolution Problems," Journal of the American Statistical Association, 92, 1451-1458.
9. Fan, J. (1991), "On the Optimal Rates of Convergence for Nonparametric Deconvolution Problems," The Annals of Statistics, 19, 1257-1272.
10. Fan, J., and Koo, J.-Y. (2002), "Wavelet Deconvolution," IEEE Transactions on Information Theory, 48, 734-747.
11. Good, I. J., and Gaskins, R. A. (1971), "Nonparametric Roughness Penalties for Probability Densities," Biometrika, 58, 255-277.
12. Goutis, C. (1997), "Nonparametric Estimation of a Mixing Density via the Kernel Method," Journal of the American Statistical Association, 92, 1445-1450.
13. Green, P. J. (1990), "On the Use of the EM Algorithm for Penalized Likelihood Estimation," Journal of the Royal Statistical Society, Ser. B, 52, 443-452.
14. Gu, C. (1992), "Cross-Validating Non-Gaussian Data," Journal of Computational and Graphical Statistics, 1, 169-179.
15. Gu, C. (1993), "Smoothing Spline Density Estimation: A Dimensionless Automatic Algorithm," Journal of the American Statistical Association, 88, 495-504.
16. Gu, C., and Qiu, C. (1993), "Smoothing Spline Density Estimation: Theory," The Annals of Statistics, 21, 217-234.
17. Hall, P., and Marron, J. S. (1991), "Local Minima in Cross-Validation Functions," Journal of the Royal Statistical Society, Ser. B, 53, 245-252.
18. Izenman, A. J. (1991), "Recent Developments in Nonparametric Density Estimation," Journal of the American Statistical Association, 86, 205-224.
19. Johnstone, I. M., and Silverman, B. W. (1990), "Speed of Estimation in Positron Emission Tomography and Related Inverse Problems," The Annals of Statistics, 18, 251-280.
20. Jones, M. C., and Silverman, B. W. (1989), "An Orthogonal Series Density Estimation Approach to Reconstructing Positron Emission Tomography Images," Journal of Applied Statistics, 16, 177-191.
21. Jones, M. C., Marron, J. S., and Sheather, S. J. (1996), "A Brief Survey of Bandwidth Selection for Density Estimation," Journal of the American Statistical Association, 91, 401-407.
22. Klonias, V. K. (1982), "Consistency of a Nonparametric Penalized Likelihood Estimator of the Probability Desity Function," The Annals of Statistics, 10, 811-824.
23. Koo, J.-Y., and Chung, H.-Y. (1998), "Log-Density Estimation in Linear Inverse Problems," The Annals of Statistics, 26, 335-362.
24. Koo, J.-Y., and Park, B. U. (1996), "B-Splines Deconvolution Based on the EM Algorithm," Journal of Statistical Computation and Simulation, 54, 275-288.
25. Laird, N. (1978), "Nonparametric Maximum Likelihood Estimation of a Mixing Distribution," Journal of the American Statistical Association, 73, 805-811.
26. Laird, N. M., and Louis, T. A. (1991), "Smoothing the Non-Parametric Estimate of a Prior Distribution by Roughening: An Empirical Study," Computational Statistics and Data Analysis, 12, 27-38.
27. Leonard, T. (1978), "Density Estimation, Stochastic Processes and Prior Information," Journal of the Royal Statistical Society, Ser. B, 40, 113-132.
28. Lindsay, B. G. (1983a), "The Geometry of Mixture Likelihoods: A General Theory," The Annals of Statistics, 11, 86-94.
29. Lindsay, B. G. (1983b), "The Geometry of Mixture Likelihoods, Part II: The Exponential Family," The Annals of Statistics, 11, 783-792.
30. Lindsay, B. G. (1995), Mixture Models: Theory, Geometry, and Applications, Hayward, CA: Institute of Mathematical Statistics/Alexandria, VA: American Statistical Association.
31. Liu, L. (2005), "On the Estimation of Mixing Distributions: NPMLE and NPMPLE," Ph.D. thesis, Department of Statistics, Purdue University.
32. Magder, L. S., and Zeger, S. L. (1996), "A Smooth Nonparametric Estimate of a Mixing Distribution Using Mixtures of Gaussians," Journal of the American Statistical Association, 91, 1141-1151.
33. Pensky, M., and Vidakovic, B. (1999), "Adaptive Wavelet Estimator for Nonparametric Density Deconvolution," The Annals of Statistics, 27, 2033-2053.
34. Silverman, B. W. (1982), "On the Estimation of a Probability Density Function by the Maximum Penalized Likelihood Method," The Annals of Statistics, 10, 795-810.
35. Silverman, B. W. (1986), Density Estimation for Statistics and Data Analysis, London/New York: Chapman & Hall.
36. Silverman, B.W., Jones, M. C., Wilson, J. D., and Nychka, D.W. (1990), "A Smoothed EM Approach to Indirect Estimation Problems, With Particular Reference to Stereology and Emission Tomography," Journal of the Royal Statistical Society, Ser. B, 52, 271-324.
37. Stefanski, L., and Carroll, R. J. (1990), "Deconvoluting Kernel Density Estimators," Statistics, 21, 169-184.
38. Szkutnik, Z. (2003), "Doubly Smoothed EM Algorithm for Statistical Inverse Problems," Journal of the American Statistical Association, 98, 178-190.
39. Tapia, R. A., and Thompson, J. R. (1978), Nonparametric Probability Density Estimation, Baltimore, MD: Johns Hopkins University Press.
40. Vardi, Y., Shepp, L. A., and Kaufman, L. (1985), "A Statistical Model for Positron Emission Tomography," Journal of the American Statistical Association, 80, 8-20.
41. Wahba, G. (1990), Spline Models for Observational Data, Philadelphia, PA: SIAM.
42. Zhang, C.-H. (1990), "Fourier Methods for Estimating Mixing Densities and Distributions," The Annals of Statistics, 18, 806-831.