Two-manifold problems with applications to nonlinear system identification

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 1, Issue , 2012, Pages 623-630

  Boots, Byron ^a   Gordon, Geoffrey J ^a  

^a Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROACHES TO LEARNING; CROSS-COVARIANCE; INTERCONNECTED LEARNING; LIMITED DATA; SPECTRAL DECOMPOSITION;

ALGORITHMS; NONLINEAR DYNAMICAL SYSTEMS;

LEARNING SYSTEMS;

EID: 84867112111     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Belkin, Mikhail and Niyogi, Partha. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15:1373-1396, 2002.
2. Boots, Byron and Gordon, Geoff. Predictive state temporal difference learning. In Lafferty, J., Williams, C. K. I., Shawe-Taylor, J., Zemel, R.S., and Culotta, A. (eds.), Advances in Neural Information Processing Systems 23, pp. 271-279. 2010.
3. Boots, Byron, Siddiqi, Sajid M., and Gordon, Geoffrey J. Closing the learning-planning loop with predictive state representations. In Proceedings of Robotics: Science and Systems VI, 2010.
4. Boots, Byron, Siddiqi, Sajid, and Gordon, Geoffrey. An online spectral learning algorithm for partially observable nonlinear dynamical systems. In Proceedings of the 25th National Conference on Artificial Intelligence (AAAI-2011), 2011.
5. Bradtke, Steven J. and Barto, Andrew G. Linear least-squares algorithms for temporal difference learning. In Machine Learning, pp. 22-33, 1996.
6. Chen, Guisheng, Yin, Junsong, and Li, Deyi. Neighborhood smoothing embedding for noisy manifold learning. In GrC, pp. 136-141, 2008.
7. Cook, R. Dennis and Yin, Xiangrong. Theory and methods: Special invited paper: Dimension reduction and visualization in discriminant analysis (with discussion). Australian and New Zealand Journal of Statistics, 43(2): 147-199, 2001.
8. Fukumizu, K., Bach, F., and Gretton, A. Consistency of kernel canonical correlation analysis. Technical Report 942, Institute of Statistical Mathematics, Tokyo, Japan, 2005.
9. Fukumizu, Kenji, Bach, Francis R., Jordan, Michael I., and Williams, Chris. Dimensionality reduction for supervised learning with reproducing kernel Hilbert spaces. Journal of Machine Learning Research, 5:2004, 2004.
10. Ham, Jihun, Lee, Daniel D., Mika, Sebastian, and Schlkopf, Bernhard. A kernel view of the dimensionality reduction of manifolds, 2003.
11. Ham, Jihun, Lee, Daniel, and Saul, Lawrence. Semisupervised alignment of manifolds. In Cowell, Robert G. and Ghahramani, Zoubin (eds.), 10th International Work- shop on Artificial Intelligence and Statistics, pp. 120-127, 2005.
12. Hotelling, Harold. The most predictable criterion. Journal of Educational Psychology, 26:139-142, 1935.
13. Hsu, Daniel, Kakade, Sham, and Zhang, Tong. A spectral algorithm for learning hidden Markov models. In COLT, 2009.
14. Jolliffe, I. T. Principal component analysis. Springer, New York, 2002.
15. Lawrence, Neil D. Spectral dimensionality reduction via maximum entropy. In Proc. AISTATS, 2011.
16. Li, Ker-Chau. Sliced inverse regression for dimension reduction. Journal of the American Statistical Association, 86(414):pp. 316-327, 1991.
17. Mahadevan, Vijay, Wong, Chi Wah, Pereira, Jose Costa, Liu, Tom, Vasconcelos, Nuno, and Saul, Lawrence. Maximum covariance unfolding: Manifold learning for bimodal data. In Advances in Neural Information Processing Systems 24, 2011.
18. Nilsson, Jens, Sha, Fei, and Jordan, Michael I. Regression on manifolds using kernel dimension reduction. In ICML, pp. 697-704, 2007.
19. Pearl, Judea. Causality: models, reasoning, and inference. Cambridge University Press, 2000.
20. Reinsel, Gregory C. and VeIu, Rajabather Palani. Multivariate Reduced-rank Regression: Theory and Applications. Springer, 1998.
21. Roweis, Sam T. and Saul, Lawrence K. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323-2326, December 2000.
22. Schölkopf, Bernhard, Smola, Alex J., and Müller, Klaus-Robert. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10(5):1299-1319, 1998.
23. Siddiqi, Sajid, Boots, Byron, and Gordon, Geoffrey J. Reduced-rank hidden Markov models. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS-2010), 2010.
24. Smola, A.J., Gretton, A., Song, L., and Schölkopf, B. A Hilbert space embedding for distributions. In Takimoto, E. (ed.), Algorithmic Learning Theory, Lecture Notes on Computer Science. Springer, 2007.
25. Song, L., Boots, B., Siddiqi, S. M., Gordon, G. J., and Smola, A. J. Hilbert space embeddings of hidden Markov models. In Proc. 27th Intl. Conf. on Machine Learning (ICML), 2010.
26. Tenenbaum, Joshua B., Silva, Vin De, and Langford, John. A global geometric framework for nonlinear dimensionality reduction. Science, 290:2319-2323, 2000. doi: 10.1126/science.290.5500.2319.
27. Van Overschee, P. and De Moor, B. Subspace Identification for Linear Systems: Theory, Implementation, Applications. Kluwer, 1996.
28. Wang, Chang and Mahadevan, Sridhar. A general framework for manifold alignment. In Proc. AAAI, 2009.
29. Weinberger, Kilian Q., Sha, Fei, and Saul, Lawrence K. Learning a kernel matrix for nonlinear dimensionality reduction. In In Proceedings of the 21st International Conference on Machine Learning, pp. 839-846. ACM Press, 2004.
30. Zhan, Yubin and Yin, Jianping. Robust local tangent space alignment. In ICONIP (1), pp. 293-301, 2009.
31. Zhan, Yubin and Yin, Jianping. Robust local tangent space alignment via iterative weighted PCA. Neurocomputing, 74(11):1985-1993, 2011.