Convex optimization, shape constraints, compound decisions, and empirical bayes rules

Journal of the American Statistical Association

Volumn 109, Issue 506, 2014, Pages 674-685

  Koenker, Roger ^a   Mizera, Ivan ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Empirical Bayes; Kiefer Wolfowitz maximum likelihood estimator; Mixture models

Indexed keywords

EID: 84907503852     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2013.869224     Document Type: Article

References (31)

1. Andersen, E. D. (2010), "The MOSEK Optimization Tools Manual, Version 6.0," available at http://www.mosek.com. [677]
2. Beckett, L., and Diaconis, P. (1994), "Spectral Analysis for Discrete Longitudinal Data," Advances in Mathematics, 103, 107-128. [682]
3. Berlinet, A., and Roland, C. (2007), "Acceleration Schemes With Application to the EM Algorithm," Computational Statistics and Data Analysis, 51, 3689-3702. [677]
4. Brown, L. (2008), "In-Season Prediction of Batting Averages: A Field Test of Empirical Bayes and Bayes Methodologies," The Annals of Applied Statistics, 2, 113-152. [674,680]
5. Brown, L., and Greenshtein, E. (2009), "Non-Parametric Empirical Bayes and Compound Decision Approaches to Estimation of a High Dimensional Vector of Normal Means," The Annals of Statistics, 37, 1685-1704. [674,679]
6. Bunea, F., Tsybakov, A. B., Wegkamp, M. H., and Barbu, A. (2010), "Spades and Mixture Models," The Annals of Statistics, 38, 2525-2558. [683]
7. Cule, M., Samworth, R., and Stewart, M. (2010), "Computing the Maximum Likelihood Estimator of a Multidimensional Log-Concave Density, With Discussion," Journal of the Royal Statistical Society, Series B, 72, 545-600. [675]
8. Dümbgen, L., and Rufibach, K. (2009), "Maximum Likelihood Estimation of a Log-Concave Density: Basic Properties and Uniform Consistency," Bernoulli, 15, 40-68. [675]
9. Efron, B. (2010), Large-Scale Inference: Empirical Bayes Methods for Estimation, Testing, and Prediction, Cambridge: Cambridge University Press. [674]
10. Efron, B. (2011), "Tweedie’s Formula and Selection Bias," Journal of the American Statistical Association, 106, 1602-1614. [674]
11. Groeneboom, P., Jongbloed, G., and Wellner, J. A. (2001), "Estimation of a Convex Function: Characterization and Asymptotic Theory," The Annals of Statistics, 29, 1653-1698. [675]
12. Groeneboom, P., Jongbloed, G., and Wellner, J. A. (2008), "The Support Reduction Algorithm for Computing Non-Parametric Function Estimates in Mixture Models," Scandinavian Journal of Statistics, 35, 385-399. [678]
13. Heckman, J., and Singer, B. (1984), "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, 52, 63-132. [676]
14. Jiang, W., and Zhang, C.-H. (2009), "General Maximum Likelihood Empirical Bayes Estimation of Normal Means," The Annals of Statistics, 37, 1647-1684. [674,676,677,679]
15. Jiang, W., and Zhang, C.-H. (2010), "Empirical Bayes In-Season Prediction of Baseball Batting Averages," in Borrowing Strength: Theory Powering Applications: A Festschrift for Lawrence D. Brown (Vol. 6) Institute for Mathematical Statistics, pp. 263-273. [680]
16. Johnstone, I., and Silverman, B. (2004), "Needles and Straw in Haystacks: Empirical Bayes Estimates of Possibly Sparse Sequences," The Annals of Statistics, 1594-1649. [677,679]
17. Kiefer, J., and Wolfowitz, J. (1956), "Consistency of the Maximum Likelihood Estimator in the Presence of Infinitely Many Incidental Parameters," The Annals of Mathematical Statistics, 27, 887-906. [674,676]
18. Koenker, R. (2013), REBayes: Empirical Bayes Estimation and Inference in R, R package version 0.31, available at http://CRAN.R-project.org/package=REBayes. [677]
19. Koenker, R., and Mizera, I. (2010), "Quasi-Concave Density Estimation," The Annals of Statistics, 38, 2998-3027. [675,677,684]
20. Koenker, R., and Mizera, I. (2013), "Convex Optimization in R," Journal of Statistical Software, forthcoming. [678]
21. Laird, N. (1978), "Nonparametric Maximum Likelihood Estimation of a Mixing Distribution," Journal of the American Statistical Association, 73, 805-811. [674,676]
22. Lindsay, B. (1983), "The Geometry of Mixture Likelihoods: A General Theory," The Annals of Statistics, 11, 86-94. [684]
23. Liu, J. (1996), "Nonparametric Hierarchical Bayes via Sequential Imputations," The Annals of Statistics, 24, 911-930. [682]
24. Robbins, H. (1956), "An Empirical Bayes Approach to Statistics," in Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability (Vol. I), Berkeley, CA: University of California Press. [674]
25. Rockafellar, R. T. (1970), Convex Analysis, Princeton, NJ: Princeton University Press. [675]
26. Rockafellar, R. T. (1971), "Integrals Which are Convex Functionals, II," Pacific Journal of Mathematics, 39, 439-469. [684]
27. Saunders, M. A. (2003), "PDCO: A Primal-Dual Interior Solver for Convex Optimization," available at http://www.stanford.edu/group/ SOL/software/pdco.html. [677]
28. Seregin, A., and Wellner, J. A. (2010), "Nonparametric Estimation of Multivariate Convex-Transformed Densities," The Annals of Statistics, 38, 3751-3781. [675]
29. van Houwelingen, J., and Stijnen, T. (1983), "Monotone Empirical Bayes Estimators for the Continuous One-Parameter Exponential Family," Statistica Neerlandica, 37, 29-43. [674]
30. Varadhan, R. (2011), SQUAREM: Squared Extrapolation Methods for Accelerating Fixed-Point Iterations, R package version 2010.12-1, available at http://CRAN.R-project.org/package=SQUAREM. [682]
31. Varadhan, R., and Roland, C. (2008), "Simple and Globally Convergent Methods for Accelerating the Convergence of any EM Algorithm," Scandinavian Journal of Statistics, 35, 335-353. [677]