A general framework for association analysis of heterogeneous data

Annals of Applied Statistics

Volumn 12, Issue 3, 2018, Pages 1700-1726

  Li, Gen ^a   Gaynanova, Irina ^b  

^a Department of Medicine   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Association coefficient; Exponential family; Generalized linear model; Inter battery factor analysis; Joint and individual structure; Matrix decomposition

Indexed keywords

EID: 85053332408     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/17-AOAS1127     Document Type: Article

References (42)

1. BACH, F. R. and JORDAN, M. I. (2005). A probabilistic interpretation of canonical correlation analysis. Technical Report 688, Dept. Statistics, Univ. California, Berkeley, Berkeley, CA.
2. BARRINGTON, L., CHAN, A., TURNBULL, D. and LANCKRIET, G. (2007). Audio information retrieval using semantic similarity. In International Conference on Acoustics, Speech and Signal Processing 2 725-728. IEEE, New York.
3. BERTIN-MAHIEUX, T., ECK, D., MAILLET, F. and LAMERE, P. (2008). Autotagger: A model for predicting social tags from acoustic features on large music databases. J. New Music Res. 37 115-135.
4. BJÖRCK, K. and GOLUB, G. H. (1973). Numerical methods for computing angles between linear subspaces. Math. Comp. 27 579-594.
5. BROWNE, M. W. (1979). The maximum-likelihood solution in inter-battery factor analysis. Br. J. Math. Stat. Psychol. 32 75-86. MR0553146
6. CHAUDHURI, K., KAKADE, S. M., LIVESCU, K. and SRIDHARAN, K. (2009). Multi-view clustering via canonical correlation analysis. In Proceedings of the 26th Annual International Conference on Machine Learning 129-136. ACM, New York.
7. CHEN, X. and LIU, H. (2012). An efficient optimization algorithm for structured sparse cca, with applications to eqtl mapping. Stat. Biosci. 4 3-26.
8. CHEN, M., GAO, C., REN, Z. and ZHOU, H. H. (2013). Sparse cca via precision adjusted iterative thresholding. ArXiv preprint. Available at arXiv:1311.6186.
9. CHENG, J., LI, T., LEVINA, E. and ZHU, J. (2017). High-dimensional mixed graphical models. J. Comput. Graph. Statist. 26 367-378. MR3640193
10. COLLINS, M., DASGUPTA, S. and SCHAPIRE, R. E. (2001). A generalization of principal components analysis to the exponential family. In NIPS’01: Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic 617-624. MIT Press, Cambridge, MA.
11. ELLIS, D. P., WHITMAN, B., BERENZWEIG, A. and LAWRENCE, S. (2002). The quest for ground truth in musical artist similarity. In ISMIR 2002 Conference Proceedings: Third International Conference on Music Information Retrieval: October 13–17, 2002, IRCAM-Centre Pompidou, Paris, France.
12. GOLDSMITH, J., ZIPUNNIKOV, V. and SCHRACK, J. (2015). Generalized multilevel function-on-scalar regression and principal component analysis. Biometrics 71 344-353.
13. GOLUB, G. H. and VAN LOAN, C. F. (2013). Matrix Computations, 4th ed. Johns Hopkins Studies in the Mathematical Sciences. Johns Hopkins Univ. Press, Baltimore, MD. MR3024913
14. GOTO, M. and HIRATA, K. (2004). Recent studies on music information processing. Acoust. Sci. Technol. 25 419-425.
15. HASTIE, T., TIBSHIRANI, R. and WAINWRIGHT, M. (2015). Statistical Learning with Sparsity: The Lasso and Generalizations. CRC Press, Boca Raton, FL.
16. HERLOCKER, J. L., KONSTAN, J. A. and RIEDL, J. (2000). Explaining collaborative filtering recommendations. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work 241-250. ACM, New York.
17. HOTELLING, H. (1936). Relations between two sets of variates. Biometrika 28 321-377.
18. JIA, Y., SALZMANN, M. and DARRELL, T. (2010). Factorized latent spaces with structured sparsity. Adv. Neural Inf. Process. Syst. 982-990.
19. JOHNSON, N. L., KOTZ, S. and BALAKRISHNAN, N. (1997). Discrete Multivariate Distributions 165. Wiley, New York.
20. KLAMI, A., VIRTANEN, S. and KASKI, S. (2010). Bayesian exponential family projections for coupled data sources. In The Twenty-Sixth Conference on Uncertainty in Artificial Intelligence 286-293. AUAI Press.
21. KLAMI, A., VIRTANEN, S. and KASKI, S. (2013). Bayesian canonical correlation analysis. J. Mach. Learn. Res. 14 965-1003.
22. LANDGRAF, A. J. and LEE, Y. (2015). Generalized principal component analysis: Projection of saturated model parameters. Technical Report 892, Department of Statistics, Ohio State Univ.
23. LI, G. and GAYNANOVA, I. (2018). Supplement to “A general framework for association analysis of heterogeneous data.” DOI:10.1214/17-AOAS1127SUPP.
24. LI, Q., CHENG, G., FAN, J. and WANG, Y. (2018). Embracing the blessing of dimensionality in factor models. J. Amer. Statist. Assoc. 113 380-389. MR3803472
25. LOCK, E. F., HOADLEY, K. A., MARRON, J. S. and NOBEL, A. B. (2013). Joint and individual variation explained (JIVE) for integrated analysis of multiple data types. Ann. Appl. Stat. 7 523-542.
26. LOGAN, B. (2000). Mel frequency cepstral coefficients for music modeling. In International Symposium on Music Information Retrieval (ISMIR).
27. LUO, C., LIU, J., DEY, D. K. and CHEN, K. (2016). Canonical variate regression. Biostatistics 17 468-483.
28. MCCULLAGH, P. and NELDER, J. A. (1989). Generalized Linear Models, 2nd ed. Chapman & Hall, London. [Second edition of MR0727836.] MR3223057
29. SHE, Y. (2013). Reduced rank vector generalized linear models for feature extraction. Stat. Interface 6 197-209.
30. TRYGG, J. and WOLD, S. (2003). O2-PLS, a two-block (X-Y) latent variable regression (LVR) method with an integral OSC filter. J. Chemom. 17 53-64.
31. TSOUMAKAS, G., SPYROMITROS-XIOUFIS, E., VILCEK, J. and VLAHAVAS, I. (2011). Mulan: A Java library for multi-label learning. J. Mach. Learn. Res. 12 2411-2414.
32. TUCKER, L. R. (1958). An inter-battery method of factor analysis. Psychometrika 23 111-136. MR0099737
33. TURNBULL, D., BARRINGTON, L., TORRES, D. and LANCKRIET, G. (2007). Towards musical query-by-semantic-description using the cal500 data set. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 439-446. ACM, New York.
34. TURNBULL, D., BARRINGTON, L., TORRES, D. and LANCKRIET, G. (2008). Semantic annotation and retrieval of music and sound effects. IEEE/ACM Trans. Audio Speech Lang. Process. 16 467-476.
35. VIRTANEN, S., KLAMI, A. and KASKI, S. (2011). Bayesian cca via group sparsity. In Proceedings of the 28th International Conference on Machine Learning (ICML 2011) 457-464. ACM, New York.
36. WESTERHUIS, J. A., KOURTI, T. and MACGREGOR, J. F. (1998). Analysis of multiblock and hierarchical PCA and PLS models. J. Chemom. 12 301-321.
37. WITTEN, D. M., TIBSHIRANI, R. and HASTIE, T. (2009). A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis. Biostatistics 10 513-534.
38. YANG, D., MA, Z. and BUJA, A. (2014). A sparse singular value decomposition method for high-dimensional data. J. Comput. Graph. Statist. 23 923-942. MR3270704
39. YANG, Z., NING, Y. and LIU, H. (2014). On semiparametric exponential family graphical models. ArXiv preprint. Available at arXiv:1412.8697.
40. ZHOU, G., CICHOCKI, A., ZHANG, Y. and MANDIC, D. P. (2016a). Group component analysis for multiblock data: Common and individual feature extraction. IEEE Trans. Neural Netw. Learn. Syst. 27 2426-2439.
41. ZHOU, G., ZHAO, Q., ZHANG, Y., ADALI, T., XIE, S. and CICHOCKI, A. (2016b). Linked component analysis from matrices to high-order tensors: Applications to biomedical data. Proc. IEEE 104 310-331.
42. ZOH, R. S., MALLICK, B., IVANOV, I., BALADANDAYUTHAPANI, V., MANYAM, G., CHAP-KIN, R. S., LAMPE, J. W. and CARROLL, R. J. (2016). PCAN: Probabilistic correlation analysis of two non-normal data sets. Biometrics 72 1358-1368. MR3591620