Maximum likelihood estimation of a log-concave density and its distribution function: Basic properties and uniform consistency

Bernoulli

Volumn 15, Issue 1, 2009, Pages 40-68

  Dümbgen, Lutz ^a   Rufibach, Kaspar ^b  

^a UNIVERSITY OF BERN   (Switzerland)

^b UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Adaptivity; Bracketing; Exponential inequality; Gap problem; Hazard function; Method of caricatures; Shape constraints

Indexed keywords

EID: 62749189131     PISSN: 13507265     EISSN: None     Source Type: Journal    
DOI: 10.3150/08-BEJ141     Document Type: Article

References (48)

1. Anevski, D. (1994). Estimating the derivative of a convex density. Technical report, Dept. of Mathematical Statistics, Univ. Lund.
2. Anevski, D. (2003). Estimating the derivative of a convex density. Statist. Neerlandica 57 245-257.
3. Bagnoli, M. and Bergstrom, T. (2005). Log-concave probability and its applications. Econ. Theory 26 445-469.
4. Balabdaoui, F. and Wellner, J.A. (2007). A Kiefer-Wolfowitz theorem for convex densities. IMS Lecture Notes Monograph Series 2007 55 1-31.
5. Balabdaoui, F. and Wellner, J.A. (2008). Estimation of a k-monotone density: Limit distribution theory and the spline connection. Ann. Statist. 35 2536-2564.
6. Balabdaoui, R, Rufibach, K. and Wellner, J.A. (2008). Limit distribution theory for maximum likelihood estimation of a log-concave density. Ann. Statist. To appear.
7. Barlow, E.B., Bartholomew, D.J., Bremner, J.M. and Brunk, H.D. (1972). Statistical Inference under Order Restrictions. The Theory and Application of Isotonic Regression. New York: Wiley.
8. Barlow, E.B. and Proschan, F. (1975). Statistical Theory of Reliability and Life Testing Probability Models. New York: Holt, Reinhart and Winston.
9. Brooks, S. (1998). MCMC convergence diagnosis via multivariate bounds on log-concave densities. Ann. Statist. 26 398-433.
10. Chang, G. and Walther, G. (2007). Clustering with mixtures of log-concave distributions. Comp. Statist. Data Anal. 51 6242-6251.
11. Donoho, D.L., Johnstone, I.M., Kerkyacharian, G. and Picard, D. (1996). Density estimation by wavelet thresholding. Ann. Statist. 24 508-539.
12. Dümbgen, L. (1998). New goodness-of-fit tests and their application to nonparametric confidence sets. Ann. Statist. 26 288-314.
13. Dümbgen, L., Freitag S, and Jongbloed, G. (2004). Consistency of concave regression, with an application to current status data. Math. Methods Statist. 13 69-81.
14. Dümbgen, L., Hüsler, A. and Rufibach, K. (2007). Active set and EM algorithms for log-concave densities based on complete and censored data. Technical Report 61, IMSV, Univ. Bern. arXiv:0707.4643.
15. Dijmbgen, L., Rufibach, K. and Wellner, J.A. (2007). Marshall's lemma for convex density estimation. In Asymptotics: Particles, Processes and Inverse Problems (E. Cator, G. JongbIoed, C. Kraaikamp, R. Lopuhad and J.A. Wellner, eds.) 101-107. IMS Lecture Notes-Monograph Series 55.
16. Dümbgen, L. and Rufibach, K. (2008). Maximum likelihood estimation of a log-concave density and its distribution function: Basic properties and uniform consistency. Technical Report 66, IMSV, Univ. Bern. arxiv:0709.0334.
17. Eggermont, P.P.B. and LaRiccia, V.N. (2000). Maximum likelihood estimation of smooth monotone and unimodal densities. Ann. Statist. 28 922-947.
18. Giné, E. and Nickl, R. (2007). Uniform central limit theorems for kernel density estimators. Probab. Theory Related Fields 141 333-387.
19. Giné, E. and Nickl, R. (2008). An exponential inequality for the distribution function of the kernel density estimator, with applications to adaptive estimation. Probab. Theory Related Fields. To appear.
20. Grenander, U. (1956). On the theory of mortality measurement, part II. Skand. Aktuarietidskrift 39 125-153.
21. Groeneboom, P. (1985). Estimating a monotone density. In Proc. Berkeley Conf. in Honor of Jerzy Neyman and Jack Kiefer II (L.M. LeCam and R.A. Ohlsen, eds.) 539-555.
22. Groeneboom, P. (1988). Brownian motion with a parabolic drift and Airy functions. Probab. Theory Related Fields 81 79-109.
23. Groeneboom, P., Jongbloed, G. and Wellner, J.A. (2001). Estimation of a convex function: Characterization and asymptotic theory. Ann. Statist. 29 1653-1698.
24. Groeneboom, P., Jongbloed, G. and Wellner, J.A. (2008). The support reduction algorithm for computing nonparametric function estimates in mixture models. Scand. J. Statist. To appear.
25. Hall, P., Huang, L.S., Gifford, J.A. and Gijbels, I. (2001). Nonparametric estimation of hazard rate under the constraint of monotonicity. J. Comput. Graph. Statist. 10 592-614.
26. Hall, P. and van Keilegom, I. (2005). Testing for monotone increasing hazard rate. Ann. Statist. 33 1109-1137.
27. Hampel, F.R. (1987). Design, modelling and analysis of some biological datasets. In Design, Data and Analysis, By Some Friends of Cuthbert Daniel (C.L. Mallows, ed.). New York: Wiley.
28. Jonker, M. and van der Vaart, A. (2001). A semi-parametric model for censored and passively registered data. Bernoulli 7 1-31.
29. Khas'minskii, R.Z. (1978). A lower bound on the risks of nonparametric estimates of densities in the uniform metric. Theory Prob. Appl. 23 794-798.
30. Kiefer, J. and Wolfowitz, J. (1976). Asymptotically minimax estimation of concave and convex distribution functions. Z. Wahrsch. Verw. Gebiete 34 73-85.
31. Kulikov, V.N. and Lopuhaä, H.P. (2006). The behavior of the NPMLE of a decreasing density near the boundaries of the support. Ann. Statist. 34 742-768.
32. Marshall, A.W. (1970). Discussion of Barlow and van Zwet's paper. In Nonparametric Techniques in Statistical Inference. Proceedings of the First International Symposium on Nonparametric Techniques held at Indiana University, June, 1969 (M.L. Puri, ed.) 174-176. Cambridge Univ. Press.
33. Meyer, C.M. and Woodroofe, M. (2004). Consistent maximum likelihood estimation of a unimodal density using shape restrictions. Canad. J. Statist. 32 85-100.
34. Müller, S. and Rufibach, K. (2008). Smooth tail index estimation. J. Stat. Comput. Simul. To appear.
35. Pat, J., Woodroofe, M. and Meyer, M. (2006). Estimating a Polya frequency function. In Complex Datasets and Inverse problems: Tomography, Networks and Beyond (R. Liu, W. Strawderman and C.-H. Zhang, eds.) 239-249. IMS Lecture Notes - Monograph Series 54.
36. Prékopa, A. (1971). Logarithmic concave measures with application to stochastic programming. Acta Sci. Math. 32 301-316.
37. Rao, P. (1969). Estimation of a unimodal density. Sankhya Ser. A 31 23-36.
38. Robertson, T., Wright, F.T. and Dykstra, R.L. (1988). Order Restricted Statistical Inference. Wiley, New York.
39. Rufibach, K. (2006). Log-concave density estimation and bump hunting for i.i.d. observations. Ph.D. dissertation, Univ. Bern and Göttingen.
40. Rufibach, K. (2007). Computing maximum likelihood estimators of a log-concave density function. J. Statist. Comput. Simul. 77 561-574.
41. Rufibach, K. and Dümbgen, L. (2006). logcondens: Estimate a log-concave probability density from i.i.d. observations. R package version 1.3.0.
42. Sengupta, D. and Paul, D. (2005). Some tests for log-concavity of life distributions. Preprint. Available at http://anson.ucdavis.edu/~debashis/ techrep/logconca.pdf.
43. Silverman, B.W. (1982). On the estimation of a probability density function by the maximum penalized likelihood method. Ann. Statist. 10 795-810.
44. Stute, W. (1982). The oscillation behaviour of empirical processes. Ann. Probab. 10 86-107.
45. Silverman, B.W. (1986). Density Estimation for Statistics and Data Analysis. London: Chapman and Hall.
46. Walther, G. (2002). Detecting the presence of mixing with multiscale maximum likelihood. J. Amer Statist. Assoc. 97 508-514.
47. Wegman, E.J. (1970). Maximum likelihood estimation of a unimodal density function. Ann. Math. Statist. 41457-471.
48. Woodroofe, M. and Sun, J. (1993). A penalized maximum likelihood estimate of f (0+) when f is non-increasing. Ann. Statist. 3 501-515.