Fast kernel conditional density estimation: A dual-tree Monte Carlo approach

Computational Statistics and Data Analysis

Volumn 54, Issue 7, 2010, Pages 1707-1718

  Holmes, Michael P ^a   Gray, Alexander G ^a   Isbell Jr , Charles Lee ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Dual tree; Fast algorithms; Kernel conditional density estimation; Large datasets; Monte Carlo; Scalability

Indexed keywords

CONDITIONAL DENSITY; DUAL-TREE; FAST ALGORITHMS; LARGE DATASETS; MONTE CARLO;

APPROXIMATION ALGORITHMS; ESTIMATION; MONTE CARLO METHODS; SCALABILITY;

COMPUTATIONAL EFFICIENCY;

EID: 77949570107     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2010.01.011     Document Type: Article

References (28)

1. Bashtannyk D.M., and Hyndman R.J. Bandwidth selection for kernel conditional density estimation. Computational Statistics & Data Analysis 36 3 (2001) 279-298
2. Boyer, G.F., Riegel, R.N., Gray, A.G., 2007. A parallel N-body data mining framework, in: NIPS Workshop on Efficient Machine Learning.
3. de Freitas N., Wang Y., Mahdaviani M., and Lang D. Fast Krylov methods for N-body learning. Advances in Neural Information Processing Systems (NIPS) 18 (2005)
4. Fan J., Yao Q., and Tong H. Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems. Biometrika 83 1 (1996) 189-206
5. Fan J., and Yim T.H. A crossvalidation method for estimating conditional densities. Biometrika 91 4 (2004) 819-834
6. Gooijer J.G.D., and Zerom D. On conditional density estimation. Statistica Neerlandica 57 2 (2003) 159-176
7. Gray, A.G., 2004. Fast kernel matrix-vector multiplication with application to Gaussian process regression. Tech. rep., Carnegie Mellon Computer Science Department.
8. Gray A.G., and Moore A.W. N-body problems in statistical learning. Advances in Neural Information Processing Systems (NIPS) 13 (2000)
9. Gray, A.G., Moore, A.W., 2003a. Nonparametric density estimation: Toward Computational Tractability, in: SIAM International Conference on Data Mining, SDM.
10. Gray, A.G., Moore, A.W., 2003b. Rapid evaluation of multiple density models, in: Workshop on Artificial Intelligence and Statistics, AISTATS.
11. Gray, A.G., Moore, A.W., 2003c. Very fast multivariate kernel density estimation via computational geometry, in: Proceedings of the ASA Joint Statistical Meeting.
12. Gray, A.G., Moore, A.W., 2004. Fast computation of the pair correlation and n-point correlation functions, in: Conference on Computational Physics.
13. Gray, A.G., Moore, A.W., Nichol, R.C., Connolly, A.J., Genovese, C., Wasserman, L., 2004. Multi-tree methods for statistics on very large datasets in astronomy, in: Ochsenbein, F., Allen, M.G., Egret, D., Astronomical Data Analysis Software and Systems, ADASS, XIII.
14. Gray, A., Riegel, R., 2006. Large-scale kernel discriminant analysis with application to quasar discovery, in: Proceedings in Computational Statistics, CompStat.
15. Hansen, B.E., 2004. Nonparametric conditional density estimation, unpublished manuscript. URL: www.economics.ucr.edu/seminars/fall04/BruceHansen.pdf.
16. Holmes, M.P., 2009. Multi-tree Monte Carlo methods for fast, Scalable Machine Learning. Ph.D. Thesis, Georgia Institute of Technology.
17. Holmes, M.P., Gray, A.G., Isbell, Jr. C.L., 2007. Fast nonparametric conditional density estimation, in: Uncertainty in Artificial Intelligence, UAI.
18. Hyndman R.J., Bashtannyk D.M., and Grunwald G.K. Estimating and visualizing conditional densities. Journal of Computation and Graphical Statistics 5 4 (1996) 315-336
19. Klaas, M., Briers, M., de Freitas, N., Doucet, A., 2006. Fast particle smoothing: If I had a million particles, in: International Conference on Machine Learning, ICML.
20. 2 Monte Carlo: The marginal particle filter. in: Uncertainty in Artificial Intelligence, UAI.
21. Klaas, M., Lang, D., de Freitas, N., 2005b. Fast maximum a posteriori inference in Monte Carlo state spaces, in: International Conference on Artificial Intelligence and Statistics, AISTATS.
22. March, W., Gray, A., 2007. Large-scale Euclidean MST and hierarchical clustering, in: NIPS Workshop on Efficient Machine Learning.
23. Moore, A., Connolly, A., Genovese, C., Gray, A., Grone, L., Kanidoris, II N., Nichol, R., Schneider, J., Szalay, A., Szapudi, I., Wasserman, L., 2000. Fast algorithms and efficient statistics: N-point correlation functions. in: Mining the Sky: Proceedings of the MPA/ESO/MPE Astrophysics Symposium.
24. Riegel, R., Gray, A., Richards, G., 2008. Massive-scale kernel discriminant analysis: Mining for quasars, in: SIAM International Conference on Data Mining.
25. Rosenblatt M. Conditional probability density and regression estimators. In: Krishnaiah P.R. (Ed). Multivariate Analysis II (1969), Academic Press, New York 25-31
26. Shen Y., Ng A.Y., and Seeger M. Neural Information Processing Systems (NIPS) (2006)
27. Silverman B.W. Density Estimation for Statistics and Data Analysis. Monographs on Statistics and Probability vol. 26 (1986), Chapman & Hall
28. Stender, N., 2006. Essays on marketing engineering. Ph.D. Thesis, University of Aarhaus, Denmark.