Group Factor Analysis

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 9, 2015, Pages 2136-2147

  Klami, Arto ^a   Virtanen, Seppo ^b   Leppaaho, Eemeli ^b   Kaski, Samuel ^a,b  

^a UNIVERSITY OF HELSINKI   (Finland)

^b AALTO UNIVERSITY   (Finland)

Author keywords

Factor analysis (FA); multiview learning; probabilistic algorithms; structured sparsity.

Indexed keywords

ACTIVATION ANALYSIS; CLUSTERING ALGORITHMS; MULTIVARIANT ANALYSIS;

CANONICAL CORRELATION ANALYSIS; HIERARCHICAL LEVEL; HIGH DIMENSIONAL DATA; LATENT VARIABLE MODELING; MULTI-VIEW LEARNING; PROBABILISTIC ALGORITHM; STRUCTURED SPARSITIES; VARIATIONAL INFERENCE;

FACTOR ANALYSIS;

EID: 85027929051     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2376974     Document Type: Article

References (40)

1. L. L. Thurstone, "Multiple factor analysis," Psychological Rev., vol. 38, no. 5, pp. 406-427, 1931.
2. C. M. Bishop, "Bayesian PCA," in Advances in Neural Information Processing Systems, vol. 11. Cambridge, MA, USA: MIT Press, 1999, pp. 382-388.
3. S. Virtanen, A. Klami, S. A. Khan, and S. Kaski, "Bayesian group factor analysis," in Proc. 15th Int. Conf. Artif. Intell. Statist., 2012, pp. 1269-1277.
4. R. P. McDonald, "Three common factor models for groups of variables," Psychometrika, vol. 35, no. 1, pp. 111-128, 1970.
5. M. W. Browne, "Factor analysis of multiple batteries by maximum likelihood," Brit. J. Math. Statist. Psychol., vol. 33, no. 2, pp. 184-199, 1980.
6. L. R. Tucker, "An inter-battery method of factor analysis," Psychometrika, vol. 23, no. 2, pp. 111-136, 1958.
7. M.W. Browne, "The maximum-likelihood solution in inter-battery factor analysis," Brit. J. Math. Statist. Psychol., vol. 32, no. 1, pp. 75-86, 1979.
8. Y. Jia, M. Salzmann, and T. Darrell, "Factorized latent spaces with structured sparsity," in Advances in Neural Information Processing Systems, vol. 23. Red Hook, NY, USA: Curran & Associates Inc., 2010, pp. 982-990.
9. K. Van Deun, T. F. Wilderjans, R. A. van den Berg, A. Antoniadis, and I. Van Mechelen, "A flexible framework for sparse simultaneous component based data integration," BMC Bioinformat., vol. 12, no. 1, p. 448, 2011.
10. S. K. Gupta, D. Phung, B. Adams, and S. Venkatesh, "A Bayesian framework for learning shared and individual subspaces from multiple data sources," in Advances in Knowledge Discovery and Data Mining. Berlin, Germany: Springer-Verlag, 2011, pp. 136-147.
11. S. K. Gupta, D. Q. Phung, and S. Venkatesh, "A Bayesian nonparametric joint factor model for learning shared and individual subspaces from multiple data sources," in Proc. 12th SIAM Int. Conf. Data Mining, 2012, pp. 200-211.
12. A. Damianou, C. Ek, M. Titsias, and N. Lawrence, "Manifold relevance determination," in Proc. 29th Int. Conf. Mach. Learn., 2012, pp. 145-152.
13. A. Klami, S. Virtanen, and S. Kaski, "Bayesian canonical correlation analysis," J. Mach. Learn. Res., vol. 14, no. 1, pp. 899-937, 2013.
14. A. Klami and S. Kaski, "Probabilistic approach to detecting dependencies between data sets," Neurocomputing, vol. 72, nos. 1-3, pp. 39-46, 2008.
15. S. Virtanen, A. Klami, and S. Kaski, "Bayesian CCA via group sparsity," in Proc. 28th Int. Conf. Mach. Learn., 2011, pp. 457-464.
16. J. Aitchison, "The statistical analysis of compositional data," J. Roy. Statist. Soc., Ser. B (Methodological), vol. 44, no. 2, pp. 139-177, 1982.
17. A. Ilin and T. Raiko, "Practical approaches to principal component analysis in the presence of missing values," J. Mach. Learn. Res., vol. 11, pp. 1957-2000, Mar. 2010.
18. O. Dikmen and C. Févotte, "Nonnegative dictionary learning in the exponential noise model for adaptive music signal representation," in Advances in Neural Information Processing Systems, vol. 24. Red Hook, NY, USA: Curran & Associates Inc., 2011, pp. 2267-2275.
19. C. Archambeau and F. R. Bach, "Sparse probabilistic projections," in Advances in Neural Information Processing Systems, vol. 21. Cambridge, MA, USA: MIT Press, 2009, pp. 73-80.
20. F. Deleus and M. M. Van Hulle, "Functional connectivity analysis of fMRI data based on regularized multiset canonical correlation analysis," J. Neurosci. Methods, vol. 197, no. 1, pp. 143-157, 2011.
21. X. Qu and X. Chen, "Sparse structured probabilistic projections for factorized latent spaces," in Proc. 20th ACM Int. Conf. Inf. Knowl. Manage., 2011, pp. 1389-1394.
22. E. F. Lock, K. A. Hoadley, J. S. Marron, and A. B. Nobel, "Joint and individual variation explained (JIVE) for integrated analysis of multiple datatypes," Ann. Appl. Statist., vol. 7, no. 1, pp. 523-542, 2013.
23. P. Ray, L. Zheng, J. Lucas, and L. Carin, "Bayesian joint analysis of heterogeneous genomics data," Bioinformat., vol. 30, no. 10, pp. 1370-1376, 2014.
24. M. West, "Bayesian factor regression models in the 'large p, small n' paradigm," in Bayesian Statistics 7: Proc. 7th Valencia Int. Meeting., vol. 7, pp. 733-742, 2003.
25. N. Chen, J. Zun, and E. P. Xing, "Predictive subspace learning for multiview data: A large margin approach," in Advances in Neural Information Processing Systems. Red Hook, NY, USA: Curran & Associates Inc., 2010, pp. 361-369.
26. P. Rai, and H. Daumé, III, "The infinite hierarchical factor regression model," in Advances in Neural Information Processing Systems, vol. 21. Red Hook, NY, USA: Curran & Associates Inc., 2009, pp. 1321-1328.
27. M. Yuan and Y. Li, "Model selection and estimation in regression with grouped variables," J. Roy. Statist. Soc., Ser. B (Statist. Methodol.), vol. 68, no. 1, pp. 49-67, 2006.
28. P. Breheny and J. Huang, "Group descent algorithms for nonconvex penalized linear and logistic regression models with grouped predictors," in Statistics and Computing. New York, NY, USA: Springer-Verlag, 2013, pp. 1-15.
29. K. J. Friston, "Functional and effective connectivity in neuroimaging: A synthesis," Human Brain Mapping, vol. 2, nos. 1-2, pp. 56-78, 1994.
30. S. M. Smith et al., "Correspondence of the brain's functional architecture during activation and rest," Proc. Nat. Acad. Sci. USA, vol. 106, no. 31, pp. 13040-13045, 2009.
31. K. J. Friston, C. D. Frith, P. F. Liddle, and R. S. Frackowiak, "Functional connectivity: The principal-component analysis of large (PET) data sets," J. Cerebral Blood Flow Metabolism, vol. 13, no. 1, pp. 5-14, 1993.
32. V. Alluri, P. Toiviainen, I. P. Jaäskelaïnen, E. Glerean, M. Sams, and E. Brattico, "Large-scale brain networks emerge from dynamic processing of musical timbre, key and rhythm," NeuroImage, vol. 59, no. 4, pp. 3677-3689, 2012.
33. M. Jenkinson, C. F. Beckmann, T. E. Behrens, M. W. Woolrich, and S. M. Smith, "FSL," NeuroImage, vol. 62, no. 2, pp. 782-790, 2012.
34. R. S. Desikan et al., "An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest," NeuroImage, vol. 31, no. 3, pp. 968-980, 2006.
35. J. Diedrichsen, J. H. Balster, J. Flavell, E. Cussans, and N. Ramnani, "A probabilistic MR atlas of the human cerebellum," NeuroImage, vol. 46, no. 1, pp. 39-46, 2009.
36. S. A. Khan et al., "Comprehensive data-driven analysis of the impact of chemoinformatic structure on the genome-wide biological response profiles of cancer cells to 1159 drugs," BMC Bioinformat., vol. 13, no. 112, pp. 1-15, May 2012.
37. J. Lamb et al., "The connectivity map: Using gene-expression signatures to connect small molecules, genes, and disease," Science, vol. 313, no. 5795, pp. 1929-1935, 2006.
38. R. A. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval. New York, NY, USA: ACM, 1999.
39. A. Klami, G. Bouchard, and A. Tripathi, "Group-sparse embeddings in collective matrix factorization," in Proc. Int. Conf. Learn. Represent., 2014.
40. X. Chen, S. Chen, H. Xue, and X. Zhou, "A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data," Pattern Recognit., vol. 45, no. 5, pp. 2005-2018, 2012.