Efficient dimensionality reduction for canonical correlation analysis

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 1, 2013, Pages 347-355

  Avron, Haim ^a   Boutsidis, Christos ^a   Toledo, Sivan ^b   Zouzias, Anastasios ^c  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b TEL AVIV UNIVERSITY   (Israel)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

CANONICAL CORRELATION ANALYSIS; DIMENSIONALITY REDUCTION; EXACT ALGORITHMS; FAST ALGORITHMS; INPUT MATRICES;

ALGORITHMS;

EID: 84897484728     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Ailon, N. and Liberty, E. Fast dimension reduction using Rademacher series on dual BCH codes. In SODA, 2008.
2. Avron, H., Maymounkov, P., and Toledo, S. Blendenpik: Supercharging LAPACK's least-squares solver. SIAM Journal on Scientific Computing, 32(3):1217-1236, 2010.
3. Avron, Haim, Boutsidis, Christos, Toledo, Sivan, and Zouzias, Anastasios. Efficient dimensionality reduction for canonical correlation analysis. CoRR, abs/1209.2185, 2012.
4. Björck, A. and Golub, G.H. Numerical methods for computing angles between linear subspaces. Mathematics of computation, 27(123):579-594, 1973.
5. Boutsidis, C. and Drineas, P. Random projections for the nonnegative least-squares problem. Linear Algebra and its Applications, 431(5-7):760-771, 2009.
6. Boutsidis, C., Zouzias, A., and Drineas, P. Random projections for κ-means clustering. In NIPS, 2010.
7. Chaudhuri, K., Kakade, S. M., Livescu, K., and Sridharan, K. Multi-view clustering via canonical correlation analysis. In ICML, pp. 129-136, 2009.
8. Dhillon, P., Rodu, J., Foster, D., and Ungar, L. Using CCA to improve CCA: A new spectral method for estimating vector models of words. In ICML, 2012.
9. Dhillon, P. S., Foster, D., and Ungar, L. Multi-view learning of word embeddings via CCA. In NIPS, 2011.
10. Drineas, P., Mahoney, M.W., Muthukrishnan, S., and Sarlós, T. Faster least squares approximation. Numerische Mathematik, 117(2):217-249, 2011.
11. Drineas, P., Magdon-Ismail, M., Mahoney, M. W., and Woodruff, D. P. Fast approximation of matrix coherence and statistical leverage. In ICML, 2012.
12. Golub, G.H. and Zha, H. The canonical correlations of matrix pairs and their numerical computation. IMA Volumes in Mathematics and its Applications, 69:27-27, 1995.
13. Halko, N., Martinsson, P.G., and Tropp, J.A. Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions. SIAM Review, 53(2):217-288, 2011.
14. Hotelling, H. Relations between two sets of variates. Biometrika, 28(3/4):321-377, 1936.
15. Ipsen, I. and Wentworth, T. The effect of coherence on sampling from matrices with orthonormal columns, and preconditioned least squares problems. Arxiv preprint arXiv:1203.4809, 2012.
16. Kim, T.-K., Kittler, J., and Cipolla, R. Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans. Pattern Anal. Mach. Intell., 29(6): 1005-1018, 2007. (Pubitemid 46667413)
17. Rokhlin, V. and Tygert, M. A fast randomized algorithm for overdetermined linear least-squares regression. Proceedings of the National Academy of Sciences, 105(36):13212, 2008.
18. Sarlós, T. Improved approximation algorithms for large matrices via random projections. In FOCS, 2006.
19. Snoek, C. G. M., Worring, M., van Gemert, J. C., Geusebroek, J. M., and Smeulders, A. W. M. The challenge problem for automated detection of 101 semantic concepts in multimedia. In Proceedings of the ACM international conference on Multimedia, pp. 421-430, 2006.
20. Su, Y., Fu, Y., Gao, X., and Tian, Q. Discriminant learning through multiple principal angles for visual recognition. Image Processing, IEEE Transactions on, 21(3):1381-1390, March 2012.
21. Sun, L., Ji, S., and Ye, J. A least squares formulation for canonical correlation analysis. In ICML, pp. 1024-1031, 2008.
22. Sun, L., Ceran, B., and Ye, J. A scalable two-stage approach for a class of dimensionality reduction techniques. In KDD, pp. 313-322, 2010.
23. Talwalkar, Ameet and Rostamizadeh, Afshin. Matrix coherence and the nystrom method. In UAI, pp. 572-579, 2010.
24. Tropp, J. Improved analysis of the subsampled randomized Hadamard transform. Adv. Adapt. Data Anal., special issue, "Sparse Representation of Data and Images", 2011.