Deep canonical correlation analysis

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 3, 2013, Pages 2284-2292

  Andrew, Galen ^a   Arora, Raman ^b   Bilmes, Jeff ^a   Livescu, Karen ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FEEDFORWARD NEURAL NETWORKS; LEARNING SYSTEMS; LINEAR TRANSFORMATIONS;

CANONICAL CORRELATION ANALYSIS; KERNEL CANONICAL CORRELATION ANALYSIS; NON-LINEAR TRANSFORMATIONS; NONLINEAR EXTENSION; NONPARAMETRIC METHODS; PARAMETRIC METHOD; REAL-WORLD DATASETS; SIGMOID FUNCTION;

MATHEMATICAL TRANSFORMATIONS;

EID: 84897553529     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (40)

1. Akaho, S. A kernel method for canonical correlation analysis. In Proc. Int'l Meeting on Psychometric Society, 2001.
2. Anderson, T. W. An Introduction to Multivariate Statistical Analysis (2nd edition). John Wiley and Sons, 1984.
3. Arora, R. and Livescu, K. Kernel CCA for multi-view learning of acoustic features using articulatory measurements. In Symp. on Machine Learning in Speech and Language Processing, 2012.
4. Arora, R. and Livescu, K. Multi-view CCA-based acoustic features for phonetic recognition across speakers and domains. In Int. Conf. on Acoustics, Speech, and Signal Processing, 2013.
5. Bach, F. R. Consistency of trace norm minimization. J. Mach. Learn. Res., 9:1019-1048, June 2008.
6. Bach, F. R. and Jordan, M. I. Kernel independent component analysis. J. Mach. Learn. Res., 3:1-48, 2002.
7. Bengio, Y. and Delalleau, O. Justifying and generalizing contrastive divergence. Neural Computation, 21(6):1601-1621, 2009.
8. Blaschko, M. B. and Lampert, C. H. Correlational spectral clustering. In CVPR, 2008.
9. Chaudhuri, K., Kakade, S. M., Livescu, K., and Sridharan, K. Multi-view clustering via canonical correlation analysis. In ICML, 2009.
10. Choukri, K. and Chollet, G. Adaptation of automatic speech recognizers to new speakers using canonical correlation analysis techniques. Speech Comm., 1:95-107, 1986.
11. Davis, S. B. and Mermelstein, P. Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences. IEEE Trans. Acoustics, Speech, and Signal Proc., 28(4):357-366, 1980. (Pubitemid 11464930)
12. De Bie, T. and De Moor, B. On the regularization of canonical correlation analysis. In Proc. Int'l Conf. on Independent Component Analysis and Blind Source Separation, 2003.
13. Dhillon, P., Foster, D., and Ungar, L. Multi-view learning of word embeddings via CCA. In NIPS, 2011.
14. Ek, C. H., Torr, P. H., and Lawrence, N. D. Ambiguity modelling in latent spaces. In MLMI, 2008.
15. Haghighi, A., Liang, P., Berg-Kirkpatrick, T., and Klein, D. Learning bilingual lexicons from monolingual corpora. In ACL-HLT, 2008.
16. Hardoon, D. R., Szedmák, S., and Shawe-Taylor, J. Canonical correlation analysis: An overview with application to learning methods. Neural Computation, 16(12):2639-2664, 2004. (Pubitemid 39604012)
17. Hardoon, D. R., Mourao-Miranda, J., Brammer, M., and Shawe-Taylor, J. Unsupervised analysis of fMRI data using kernel canonical correlation. Neuroimage, 37(4):1250-1259, 2007. (Pubitemid 47385288)
18. Hinton, G. E. and Salakhutdinov, R. R. Reducing the dimensionality of data with neural networks. Science, 313(5786):504-507, 2006. (Pubitemid 44148451)
19. Hinton, G. E., Osindero, S., and Teh, Y.-W. A fast learning algorithm for deep belief nets. Neural computation, 18 (7):1527-1554, 2006. (Pubitemid 44024729)
20. Hotelling, H. Relations between two sets of variates. Biometrika, 28(3/4):321-377, 1936.
21. Kakade, S. M. and Foster, D. P. Multi-view regression via canonical correlation analysis. In COLT, 2007.
22. Kim, T. K., Wong, S. F., and Cipolla, R. Tensor canonical correlation analysis for action classification. In CVPR, 2007.
23. Le, Q. V., Ngiam, J., Coates, A., Lahiri, A., Prochnow, B., and Ng, A. Y. On optimization methods for deep learning. In ICML, 2011.
24. LeCun, Y. and Cortes, C. The MNIST database of handwritten digits, 1998.
25. Lewis, A. S. Derivatives of spectral functions. Mathematics of Operations Research, 21(3):576-588, 1996.
26. Mardia, K. V., Kent, J. T., and Bibby, J. M. Multivariate Analysis. Academic Press, 1979.
27. Melzer, T., Reiter, M., and Bischof, H. Nonlinear feature extraction using generalized canonical correlation analysis. In ICANN, 2001.
28. Montanarella, L., Bassami, M., and Breas, O. Chemometric classification of some European wines using pyrolysis mass spectrometry. Rapid Communications in Mass Spectrometry, 9(15):1589-1593, 1995.
29. Ngiam, J., Khosla, A., Kim, M., Nam, J., Lee, H., and Ng, A. Y. Multimodal deep learning. In ICML, 2011.
30. Nocedal, J. and Wright, S. J. Numerical Optimization. Springer, New York, 2nd edition, 2006.
31. Petersen, K. B. and Pedersen, M. S. The matrix cookbook, Nov 2012. URL http://www2. imm.dtu.dk/pubdb/p.php?3274.
32. Rudzicz, F. Adaptive kernel canonical correlation analysis for estimation of task dynamics from acoustics. In ICASSP, 2010.
33. Salakhutdinov, R. and Hinton, G. E. Deep Boltzmann machines. In AISTATS, 2009.
34. Sargin, M. E., Yemez, Y., and Tekalp, A. M. Audiovisual synchronization and fusion using canonical correlation analysis. IEEE. Trans. Multimedia, 9(7):1396-1403, 2007.
35. Slaney, M. and Coveil, M. FaceSync: A linear operator for measuring synchronization of video facial images and audio tracks. In NIPS, 2000.
36. Srivastava, N. and Salakhutdinov, R. Multimodal learning with deep Boltzmann machines. In NIPS, 2012.
37. Vert, J.-P. and Kanehisa, M. Graph-driven features extraction from microarray data using diffusion kernels and kernel CCA. In NIPS, 2002.
38. Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.-A. Extracting and composing robust features with denoising autoencoders. In ICML. ACM, 2008.
39. Vinokourov, A., Shawe-Taylor, J., and Cristianini, N. Inferring a semantic representation of text via cross-language correlation analysis. In NIPS, 2003.
40. Westbury, J. R. X-ray microbeam speech production database user's handbook. Waisman Center on Mental Retardation & Human Development, U. Wisconsin, Madison, WI, version 1.0 edition, June 1994.