Empirical bayes density regression

Statistica Sinica

Volumn 17, Issue 2, 2007, Pages 481-504

  Dunson, David B ^a  

^a NATIONAL INSTITUTE OF ENVIRONMENTAL HEALTH SCIENCES   (United States)

Author keywords

Conditional density estimation; Dirichlet process; EM algorithm; Gaussian mixture sieve; Gibbs sampling; Nonlinear regression; Nonparametric Bayes; Smoothing

Indexed keywords

EID: 34547499089     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (45)

1. Bashtannyk, D. M. and Hyndman, R. J. (2001). Bandwidth selection for kernel conditional density estimation. Comput. Statist. Data Anal. 36, 279-298.
2. Blackwell D. and MacQueen J. B. (1973). Ferguson distributions via Pólya urn schemes. Ann. Statist. 1, 353-355.
3. Celeux, G. and Diebolt, J. (1985). The SEM algorithm: A probabilistic teacher algorithm derived from the EM algorithm for the mixture problem. Comput. Statist. Quarterly 2, 73-82.
4. Cifarelli, D. and Regazzini, E. (1978). Problemi statistici non parametrici in condizioni di scambialbilita parziale e impiego di medie associative. Technical Report. Quaderni Istituto Matemática Finanziaria, Turin.
5. De Iorio, M. D., Müller, P., Rosner, G. L. and MacEachern, S. N. (2004). An ANOVA model for dependent random measures. J. Amer. Statist. Assoc. 99, 205-215.
6. Duan, J. A., Guindani, M. and Gelfand, A. E. (2005). Generalized spatial Dirichlet process models. ISDS Discussion Paper 2005-23, Duke University, Durham, NC.
7. Dunson, D. B., Pillai, N. and Park, J-H. (2007). Bayesian density regression. J. Roy. Statist. Soe. Ser. B 69, 163-183.
8. Dunson, D. B. (2006). Bayesian dynamic modeling of latent trait distributions. Biostatistics 7, 551-568.
9. Escobar, M. D. and West, M. (1995). Bayesian density estimation and inference using mixtures. J. Amer. Statist. Assoc. 90, 577-588.
10. Escobar, M. D. and West, M. (1998). Computing nonparametric hierarchical models. In Prac-tical Nonparametric and Semiparametric Bayesian Statistics (Edited by D. Dey, P. Müller and D. Sinha), 1-22. Springer-Verlag, New York.
11. Fan, J. Q., Yao, Q. and Tong, H. (1996). Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems. Biometrika 83, 189-206.
12. Fan, J. Q. and Yim, T. H. (2004). A cross validation method for estimating conditional densities. Biometrika 91, 819-834.
13. Ferguson, T. S. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist. 1, 209-230.
14. Gelfand, A. E., Kottas, A., and MacEachern, S. N. (2005). Bayesian nonparametric spatial modeling with Dirichlet process Mixing. J. Amer. Statist. Assoc. 100, 1021-1035.
15. Genovese, C. R. and Wasserman, L. (2000). Rates of convergence for the Gaussian mixture sieve. Ann. Statist. 28, 1105-1127.
16. Ghosal, S., Ghosh, J. K. and Ramamoorthi, R. V. (1999). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27, 143-158.
17. Ghosal, S. and Van der Vaart, A. W. (2001). Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities. Ann. Statist. 29, 1233-1263.
18. Giudici, P., Mezzetti, M. and Muliere, P. (2003). Mixtures of Dirichlet process priors for variable selection in survival analysis. J. Statist. Plann. Inference 111, 101-115.
19. Griffin, J. E. and Steel, M. F. J. (2006). Order-based dependent Dirichlet processes. J. Amer. Statist. Assoc. 101, 179-194.
20. Hall, P., Wolff, R. C. L. and Yao, Q. W. (1999). Methods for estimating a conditional distribution function. J. Amer. Statist. Assoc. 94, 154-163.
21. Hyndman, R. J., Bashtannyk, D. M. and Grunwald, G. K. (1996). Estimating and visualizing conditional densities. J. Comput. Graph. Statist. 5, 315-336.
22. Hyndman, R. J. and Yao, Q. (2002). Nonparametric estimation and symmetry tests for conditional density functions. J. Nonparametr. Stat. 14, 259-278.
23. Jacobs, R. A., Jordan, M. L., Nowlan, S. J. and Hinton, G. E. (1991). Adaptive mixtures of local experts. Neural Computation 3, 79-87.
24. Jiang, W. and Tanner, M. A. (1999). Hierarchical mixtures-of-experts for exponential family regression models: Approximation and maximum likelihood estimation. Ann. Statist. 27, 987-1011.
25. Jordan, M. I. and Jacobs, R. A. (1994). Hierarchical mixtures of experts and the EM algorithm. Neural Computation 6, 181-214.
26. Koenker, R., Ng, P. and Portnoy, S. (1994). Quantile smoothing splines. Biometrika 81, 673-680.
27. Liu, J. S. (1996). Nonparametric hierarchical Bayes via sequential imputations. Ann. Statist. 24, 911-930.
28. MacEachern, S. N. (1999). Dependent nonparametric processes. Proceedings of the Bayesian Section of the American Statistical Association, 50-55.
29. MacEachern, S. N. and Müller, P. (1998). Estimating mixtures of Dirichlet process models. J. Comput. Graph. Statist. 7, 223-238.
30. McAuliffe, J. D., Blei, D. M. and Jordan, M. I. (2006). Nonparametric empirical Bayes for the Dirichlet process mixture model. Statist. Comput. 16, 5-14.
31. McLachlan, G. J. and Krishnan, T. (1997). The EM Algorithm and Extensions. Wiley, New York.
32. Meng, X. L. and Rubin, D. B. (1993). Maximum likelihood estimation via the ECM algorithm: A general framework. Biometrika 80, 267-278.
33. Mira A. and Petrone, S. (1996). Bayesian hierarchical nonparametric inference for change point problems. Bayesian Statist. 5, 693-703.
34. Müller, P., Erkanli, A. and West, M. (1996). Bayesian curve fitting using multivariate normal mixtures. Biometrika 83, 67-79.
35. Müller, P. and Quintana, F. A. (2004). Nonparametric Bayesian data analysis. Statist. Sci. 19, 95-110.
36. Müller, P., Quintana, F. and Rosner, G. (2004). A method for combining inference across related nonparametric Bayesian models. J. Roy. Statist. Soc. Ser. B 66, 735-749.
37. Sethuraman, J. (1994). A constructive definition of the Dirichlet process prior. Statist. Sinica 2, 639-650.
38. Slama, R., Kold-Jensen, T., Scheike, T., Ducot, B., Spira, A. and Keiding, N. (2004). How would a decline in sperm concentration over time influence the probability of pregnancy. Epidemiology 15, 458-465.
39. Stein, M. (1990). A comparison of generalized cross validation and modified maximum likelihood estimation for estimating the parameters of a stochastic process. Ann. Statist. 18, 1139-1157.
40. Tomlinson, G. and Escobar, M. (1999). Analysis of densities. Technical Report. University of Toronto, Toronto.
41. Viele, K. and Tong, B. (2000). Modeling with mixtures of linear regressions. Statist. Comput. 12, 315-330.
42. Wahba, G. (1985). A comparison of GCV and GML for choosing the smoothing parameter in the generalized spline smoothing problem. Ann. Statist. 13, 1378-1402.
43. Wecker, M. and Ansley, C. (1983). The signal extraction approach to nonlinear regression and spline smoothing. J. Amer. Statist. Assoc. 78, 81-89.
44. Wei, G. C. G. and Tanner, M. A. (1990). A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithms. J. Amer. Statist. Assoc. 85, 699-704.
45. Yu, K. and Jones, M. C. (1998). Local linear quantile regression. J. Amer. Statist. Assoc. 93, 228-237.