Approximation of conditional densities by smooth mixtures of regressions

Annals of Statistics

Volumn 38, Issue 3, 2010, Pages 1733-1766

  Norets, Andriy ^a  

^a PRINCETON UNIVERSITY   (United States)

Author keywords

Bayesian conditional density estimation; Finite mixtures of normal distributions; Mixtures of experts; Smoothly mixing regressions

Indexed keywords

EID: 77951494583     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/09-AOS765     Document Type: Article

References (25)

1. ALBERT, J. H. and CHIB, S. (1993). Bayesian analysis of binary and polychotomous response data. J. Amer. Statist. Assoc. 88 669-679. MR1224394
2. GEWEKE, J. and KEANE, M. (2007). Smoothly mixing regressions. J. Econometrics 138 252-290. MR2380699
3. GHOSH, J. and RAMAMOORTHI, R. (2003). Bayesian Nonparametrics, 1st ed. Springer, New York. MR1992245
4. HOTZ, J. and MILLER, R. (1993). Conditional choice probabilities and the estimation of dynamic models. Rev. Econom. Stud. 60 497-530. MR1236835
5. JACOBS, R. A., JORDAN, M. I., NOWLAN, S. J. and HINTON, G. E. (1991). Adaptive mixtures of local experts. Neural Comput. 3 79-87. Available at http://dx.doi.org/10.1162/neco.1991.3.1.79.
6. JANSEN, R. C. (1993). Maximum likelihood in a generalized linear finite mixture model by using the em algorithm. Biometrics 49 227-231.
7. JIANG, W. and TANNER, M. (1999). Hierarchical mixtures-of-experts for exponential family regression models: Approximation and maximum likelihood estimation. Ann. Statist. 27 987-1011. MR1724038
8. JONES, P. and MCLACHLAN, G. J. (1992). Fitting finite mixture models in a regression context. Aust. N. Z. J. Stat. 34 233-240.
9. JORDAN, M. and XU, L. (1995). Convergence results for the em approach to mixtures of experts architectures. Neural Networks 8 1409-1431.
10. JORDAN, M. I. and JACOBS, R. A. (1994). Hierarchical mixtures of experts and the EM algorithm. Neural Comput. 6 181-214.
11. KIEFER, N. M. (1978). Discrete parameter variation: Efficient estimation of a switching regression model. Econometrica 46 427-434. MR0483200
12. LI, J. Q. andBARRON, A. R. (1999).Mixture density estimation. In Advances in Neural Information Processing Systems 12 279-285. MIT Press, Cambridge, MA.
13. MAIOROV, V. andMEIR, R. (1998). Approximation bounds for smooth functions in c(rd) by neural and mixture networks. Neural Networks, IEEE Transactions 9 969-978.
14. MCLACHLAN, G. and PEEL, D. (2000). Finite Mixture Models. Wiley, New York. MR1789474
15. NORETS, A. and PELENIS, J. (2009). Bayesian modeling of joint and conditional distributions. Unpublished manuscript, Princeton Univ.
16. PENG, F., JACOBS, R. A. and TANNER, M. A. (1996). Bayesian inference in mixtures-of-experts and hierarchical mixtures-of-experts models with an application to speech recognition. J. Amer. Statist. Assoc. 91 953-960.
17. QUANDT, R. E. and RAMSEY, J. B. (1978). Estimating mixtures of normal distributions and switching regressions. J. Amer. Statist. Assoc. 73 730-738. MR0521324
18. ROEDER, K. andWASSERMAN, L. (1997). Practical bayesian density estimation using mixtures of normals. J. Amer. Statist. Assoc. 92 894-902. MR1482121
19. RUST, J. (1996). Numerical dynamic programming in economics. In Handbook of Computational Economics (H. Amman, D. Kendrick and J. Rust, eds.). North-Holland, Amsterdam. Available at http://gemini.econ.umd.edu/jrust/sdp/ndp. pdf. MR1416619
20. TANNER, M. A. andWONG, W. H. (1987). The calculation of posterior distributions by data augmentation. J. Amer. Statist. Assoc. 82 528-540. MR0898357
21. VILLANI, M., KOHN, R. and GIORDANI, P. (2009). Regression density estimation using smooth adaptive Gaussian mixtures. J. Econometrics 153 155-173.
22. WEDEL, M. and DESARBO, W. (1995). A mixture likelihood approach for generalized linear models. J. Classification 12 21-55.
23. WOOD, S., JIANG, W. and TANNER, M. (2002). Bayesian mixture of splines for spatially adaptive nonparametric regression. Biometrika 89 513-528. MR1929159
24. ZEEVI, A., MEIR, R. and MAIOROV, V. (1998). Error bounds for functional approximation and estimation using mixtures of experts. IEEE Trans. Inform. Theory 44 1010-1025. MR1616675
25. ZEEVI, A. J. and MEIR, R. (1997). Density estimation through convex combinations of densities: Approximation and estimation bounds. Neural Networks 10 99-109.