Supervised dimension reduction using Bayesian mixture modeling

Journal of Machine Learning Research

Volumn 9, Issue , 2010, Pages 501-508

  Mao, Kai ^a   Liang, Feng ^b   Mukherjee, Sayan ^a  

^a DUKE UNIVERSITY   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Dirichlet process; Factor models; Grassman manifold; Inverse regression; Supervised dimension reduction

Indexed keywords

DIMENSION REDUCTION; DIRICHLET PROCESS; FACTOR MODEL; GRASSMAN MANIFOLD; INVERSE REGRESSION;

SOFTWARE ENGINEERING;

ARTIFICIAL INTELLIGENCE;

EID: 84862284396     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (38)

1. Absil, P.-A., R. Mahony, and R. Sepulchre (2004). Riemannian geometry of grassmann manifolds with a view on algorithmic computation. Acta Applicandae Mathematicae, 199-220.
2. Belkin, M. and P. Niyogi (2004). Semi-Supervised Learning on Riemannian Manifolds. Machine Learning 56(1-3), 209-239.
3. Cook, R. (2007). Fisher lecture: Dimension reduction in regression. Statistical Science 22(1), 1-26.
4. Cook, R. and S. Weisberg (1991). Discussion of "sliced inverse regression for dimension reduction". J. Amer. Statist. Assoc. 86, 328-332.
5. Donoho, D. and C. Grimes (2003). Hessian eigenmaps: new locally linear embedding techniques for high dimensional data. Proceedings of the National Academy of Sciences 100, 5591-5596.
6. Dunson, D. B. and J. Park (2008). Kernel stick-breaking processes. Biometrika 89, 268-277.
7. Dunson, D. B., X. Ya, and C. Lawrence (2008). The matrix stick-breaking process: Flexible bayes meta-analysis. J. Amer. Statist. Assoc., 317-327.
8. Escobar,M. andM.West (1995). Bayesian density estimation and inference using mixtures. J. Amer. Statist. Assoc., 577-588.
9. Ferguson, T. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist., 209-230.
10. Ferguson, T. (1974). Prior distributions on spaces of probability measures. Ann. Statist., 615-629.
11. Fisher, R. (1936). The use of multiplemeasurements in taxonomic problems. Annual Eugenics 7(II), 179-188.
12. Friedman, J. H. and W. Stuetzle (1981). Projection pursuit regression. J. Amer. Statist. Assoc., 817-823.
13. Gelfand, A., A. Kottas, and S. N. MacEachern (2005). Bayesian nonparametric spatial modeling with dirichlet process mixing. J. Amer. Statist. Assoc. (471), 1021-1035.
14. Globerson, A. and S. Roweis (2006). Metric learning by collapsing classes. In Advances in Neural Information Processing Systems 18, pp. 451-458.
15. Goldberger, J., S. Roweis, G. Hinton, and R. Salakhutdinov (2005). Neighbourhood component analysis. In Advances in Neural Information Processing Systems 17, pp. 513-520.
16. Griffin, J. and M. Steel (2006). Order-based dependent dirichlet processes. J. Amer. Statist. Assoc., 179-194.
17. Hastie and Tibshirani (1994). Discriminant analysis by Gaussian mixtures. J. Roy.Statist. Soc. Ser. B 58, 155-176.
18. Hastie, T. and R. Tibshirani (1996a). Discriminant adaptive nearest neighbor classification. In IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 607-615.
19. Hastie, T. and R. Tibshirani (1996b). Discriminant analysis by Gaussian mixtures. J. Roy.Statist. Soc. Ser. B 58(1), 155-176.
20. He, X. and P. Niyogi (2004). Locality preserving projections. In Advances in Neural Information Processing Systems 16.
21. Iorio, M. D., P. Müller, G. L. Rosner, and S. N. MacEachern (2004). An anova model for dependent random measures. J. Amer. Statist. Assoc., 205-215.
22. Karcher, H. (1977). Riemannian center of mass and mollifier smoothing. Comm. Pure Appl. Math. (5).
23. Kendall, W. S. (1990). Probability, convexity and harmonic maps with small image. i. uniqueness and fine existence. Proc. London Math. Soc. (2), 371-406.
24. Li, K. (1991). Sliced inverse regression for dimension reduction. J. Amer. Statist. Assoc. 86, 316-342.
25. Li, K. (1992). On principal Hessian directions for data visualization and dimension reduction: another application of Stein's lemma. Ann. Statist. 97, 1025-1039.
26. Lopes, H. F. and M. West (2004). Bayesian model assessment in factor analysis. statsinica 14, 41-67.
27. MacEachern, S. and P. Müller (1998). Estimating mixture of dirichlet process models. Journal of Computational and Graphical Statistics 7, 223-238.
28. MacEachern, S. N. (1999). Dependent nonparametric processes. ASA Proceedings of the Section on Bayesian Statistical Science.
29. Mukherjee, S. and Q. Wu (2006). Estimation of gradients and coordinate covariation in classification. J. Mach. Learn. Res. 7, 2481-2514.
30. Mukherjee, S., Q.Wu, and D.-X. Zhou (2010). Learning gradients and feature selection on manifolds. Bernoulli. in press.
31. Mukherjee, S. and D. Zhou (2006). Learning coordinate covariances via gradients. J. Mach. Learn. Res. 7, 519-549.
32. Roweis, S. and L. Saul (2000). Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science 290, 2323-2326.
33. Sethuraman, J. (1994). A constructive definition of Dirichlet priors. 4, 639-650.
34. Sugiyama, M. (2007). Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis. J. Mach. Learn. Res. 8, 1027-1061.
35. Tenenbaum, J., V. de Silva, and J. Langford (2000). A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science 290, 2319-2323.
36. Tokdar, S., Y. Zhu, and J. Ghosh (2008). A bayesian implementation of sufficient dimension reduction in regression. Technical report, Purdue Univ.
37. Wu, Q., F. Liang, and S. Mukherjee (2008). Localized sliced inverse regression. Technical report, ISDS, Duke Univ.
38. Xia, Y., H. Tong, W. Li, and L.-X. Zhu (2002). An adaptive estimation of dimension reduction space. J. Roy.Statist. Soc. Ser. B 64(3), 363-410.