Statistical consistency of kernel canonical correlation analysis

Journal of Machine Learning Research

Volumn 8, Issue , 2007, Pages 361-383

  Fukumizu, Kenji ^a   Bach, Francis R ^b   Gretton, Arthur ^c  

^a INSTITUTE OF STATISTICAL MATHEMATICS   (Japan)

^b PSL RESEARCH UNIVERSITY   (France)

^c MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

Canonical correlation analysis; Consistency; Hilbert space; Kernel; Regularization

Indexed keywords

FUNCTION EVALUATION; MATHEMATICAL OPERATORS; MATHEMATICAL TECHNIQUES; PARAMETER ESTIMATION; STATISTICAL METHODS;

CANONICAL CORRELATION ANALYSIS (CCA); CONSISTENCY; HILBERT SPACE; KERNEL; REGULARIZATION;

CORRELATION METHODS;

EID: 33847186281     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (30)

1. Shotaro Akaho. A kernel method for canonical correlation analysis. In Proceedings of International Meeting on Psychometric Society (IMPS2001), 2001.
2. Theodore W. Anderson. An Introduction to Multivariate Statistical Analysis. John Wiley & Sons, third edition, 2003.
3. Nachman Aronszajn. Theory of reproducing kernels. Transactions of the American Mathematical Society, 69(3):337-404, 1950.
4. Francis R. Bach and Michael I. Jordan. Kernel independent component analysis. Journal of Machine Learning Research, 3:1-48, 2002.
5. Charles R. Baker. Joint measures and cross-covariance operators. Transactions of the American Mathematical Society, 186:273-289, 1973.
6. Leo Breiman and Jerome H. Friedman. Estimating optimal transformations for multiple regression and correlation. Journal of the American Statistical Association, 80:580-598, 1985.
7. Andreas Buja. Remarks on functional canonical variates, alternating least squares methods and ACE. The Annals of Statistics, 18(3):1032-1069, 1990.
8. Nello Cristianini and John Shawe-Taylor. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, 2000.
9. Nelson Dunford and Jacob T. Schwartz. Linear Operators, Part II. Interscience, 1963.
10. Kenji Fukumizu, Francis R. Bach, and Michael I. Jordan. Dimensionality reduction for supervised learning with reproducing kernel Hilbert spaces. Journal of Machine Learning Research, 5:73-99, 2004.
11. Micheal J. Greenacre. Theory and Applications of Correspondence Analysis. Academic Press, London, 1984.
12. Arthur Gretton, Olivier Bousquet, Alexander J. Smola, and Bernhard Schölkopf. Measuring statistical dependence with hilbert-schmidt norms. In S. Jain, H. U. Simon, and E. Tomita, editors, 16th International Conference on Algorithmic Learning Theory, pages 63-77. Springer, 2005a.
13. Arthur Gretton, Alexander J. Smola, Olivier Bousquet, R. Herbrich, A. Belitski, M. Augath, Y. Murayama, J. Pauls, B. Schölkopf, and N. Logothetis. Kernel constrained covariance for dependence measurement. In AISTATS, volume 10, 2005b.
14. Charles W. Groetsch. The Theory of Tikhonov Regularization for Fredholm Equations of the First Kind. Pitman, 1984.
15. David R. Hardoon, John Shawe-Taylor, and Ola Friman. KCCA for fMRI analysis. In Proceedings of Medical Image Understanding and Analysis (London), 2004.
16. Guozhong He, Hans-Georg Müller, and Jane-Ling Wang. Functional canonical analysis for square integrable stochastic procersses. Journal of Multivariate Analysis, 85:54-77, 2003.
17. Peter D. Lax. Functional Analysis. Wiley, 2002.
18. Sue E. Leurgans, Rana A. Moyeed, and Bernard W. Silverman. Canonical correlation analysis when the data are curves. Journal of the Royal Statistical Society, Series B, 55(3):725-740, 1993.
19. Thomas Melzer, Michael Reiter, and Horst Bischof. Nonlinear feature extraction using generalized canonical correlation analysis. In Proceedings of International Conference on Artificial Neural Networks (ICANN), pages 353-360, 2001.
20. Sebastian Mika, Gunnar Rätsch, Jason Weston, Bernhard Schölkopf, and Klaus-Robert Müller. Fisher discriminant analysis with kernels. In Y.-H. Hu, J. Larsen, E. Wilson, and S. Douglas, editors, Neural Networks for Signal Processing, volume IX, pages 41-48. IEEE, 1999.
21. Michael Reed and Barry Simon. Functional Analysis. Academic Press, 1980.
22. Alfréd Rényi. Probability Theory. Horth-Holland, 1970.
23. Bernhard Schölkopf and Alexander J. Smola. Learning with Kernels. MIT Press, 2002.
24. Bernhard Schölkopf, Alexander Smola, and Klaus-Robert Müller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10:1299-1319, 1998.
25. Ingo Steinwart, Don Hush, and Clint Scovel. An explicit description of the reproducing kernel Hilbert spaces of Gaussian RBF kernels. Technical Report LA-UR-04-8274, Los Alamos National Laboratory, 2004.
26. Hiromichi Suetani, Yukito Iba, and Kazuyuki Aihara. Detecting hidden synchronization of chaotic dynamical systems: A kernel-based approach. Journal of Physics A: Mathematical and General, 39:10723-10742, 2006.
27. Nikolai N. Vakhania, Vazha I. Tarieladze, and Sergei A. Chobanyan. Probability Distributions on Banach Spaces. D. Reidel Publishing Company, 1987.
28. Ard W. van der Vaart. Asymptotic Statistics. Cambridge University Press, 1998.
29. Yoshihiro Yamanishi, Jean-Philippe Vert, Akihiro Nakaya, and Minoru Kanehisa. Extraction of correlated gene clusters from multiple genomic data by generalized kernel canonical correlation analysis. Bioinformatics, 19:323i-330i, 2003.
30. Laurent Zwald and Gilles Blanchard. On the convergence of eigenspaces in kernel principal component analysis. In Y. Weiss, B. Schölkopf, and J. Platt, editors, Advances in Neural Information Processing Systems 18. MIT Press, Cambridge, MA, 2006.