Bayesian CP factorization of incomplete tensors with automatic rank determination

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 9, 2015, Pages 1751-1763

  Zhao, Qibin ^a,b   Zhang, Liqing ^b   Cichocki, Andrzej ^a,c  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

^c SYSTEMS RESEARCH INSTITUTE   (Poland)

Author keywords

Bayesian inference; image synthesis; tensor completion; Tensor factorization; tensor rank determination

Indexed keywords

BAYESIAN NETWORKS; FACTORIZATION; IMAGE PROCESSING; INFERENCE ENGINES;

BAYESIAN INFERENCE; IMAGE SYNTHESIS; TENSOR COMPLETION; TENSOR FACTORIZATION; TENSOR RANKS;

TENSORS;

EID: 84939249854     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2392756     Document Type: Article

References (44)

1. T. Kolda, and B. Bader. "Tensor decompositions, and applications". SIAM Rev., vol. 51, no. 3, pp. 455-500, 2009
2. A. Cichocki, R. Zdunek, A. H. Phan, and S. I. Amari, Nonnegative Matrix, and Tensor Factorizations. New York, NY, USA: Wiley, 2009
3. D. Xu, and S. Yan. "Semi-supervised bilinear subspace learning". IEEE Trans. Image Process., vol. 18, no. 7, pp. 1671-1676, Jul. 2009
4. D. Xu, S. Yan, L. Zhang, S. Lin, H.-J. Zhang, and T. S. Huang. "Reconstruction, and recognition of tensor-based objects with concurrent subspaces analysis". IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 1, pp. 36-47, Jan. 2008
5. D. Xu, S. Yan, S. Lin, T. S. Huang, and S.-F. Chang. "Enhancing bilinear subspace learning by element rearrangement". IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1913-1920, Oct. 2009
6. L. R. Tucker. "Some mathematical notes on three-mode factor analysis". Psychometrika, vol. 31, no. 3, pp. 279-311, 1966
7. R. A. Harshman. "Foundations of the PARAFAC procedure: Models, and conditions for an "explanatory" multimodal factor analysis". UCLA Working Papers Phonetics, vol. 16, pp. 1-84, 1970
8. R. Bro. "PARAFAC. Tutorial, and applications". Chemom. Intell. Lab. Syst., vol. 38, no. 2, pp. 149-171, 1997
9. M. Sørensen, L. De Lathauwer, P. Comon, S. Icart, and L. Deneire. "Canonical polyadic decomposition with orthogonality constraints". SIAM J. Matrix Anal. Appl., vol. 33, pp. 1190-1213, 2012
10. E. Acar, D. M. Dunlavy, T. G. Kolda, and M. Mørup. "Scalable tensor factorizations for incomplete data". Chemom. Intell. Lab. Syst., vol. 106, no. 1, pp. 41-56, 2011
11. L. Sorber, M. Van Barel, and L. De Lathauwer. "Optimizationbased algorithms for tensor decompositions: Canonical polyadic decomposition, decomposition in rank-(lr, lr, 1) terms, and a new generalization". SIAM J. Opt., vol. 23, no. 2, pp. 695-720, 2013
12. D. Kressner, M. Steinlechner, and B. Vandereycken. "Low-rank tensor completion by Riemannian optimization". BIT Numer. Math., vol. 54, no. 2, pp. 447-468, Jun. 2014
13. J. Liu, P. Musialski, P. Wonka, and J. Ye. "Tensor completion for estimating missing values in visual data". IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 208-220, Jan. 2013
14. M. Signoretto, Q. T. Dinh, L. De Lathauwer, and J. A. Suykens. "Learning with tensors: A framework based on convex optimization, and spectral regularization". Mach. Learn., pp. 1-49, 2013
15. J. Huang, S. Zhang, H. Li, and D. Metaxas. "Composite splitting algorithms for convex optimization". Comput. Vis. Image Understanding, vol. 115, no. 12, pp. 1610-1622, 2011
16. S. Gandy, B. Recht, and I. Yamada. "Tensor completion, and lown-rank tensor recovery via convex optimization". Inverse Probl., vol. 27, no. 2, p. 025010, 2011
17. H. Tan, B. Cheng, W. Wang, Y.-J. Zhang, and B. Ran. "Tensor completion via a multi-linear low-n-rank factorization model". Neurocomputing, vol. 133, pp. 161-169, 2014
18. G. Zhong, and M. Cheriet. "Large margin low rank tensor analysis". Neural Comput., vol. 26, no. 4, pp. 761-780, 2014
19. A. Krishnamurthy, and A. Singh. "Low-rank matrix, and tensor completion via adaptive sampling". in Proc. Adv. Neural Inform. Process. Syst., 2013, pp. 836-844
20. Y.-L. Chen, C.-T. Hsu, and H.-Y. Liao. "Simultaneous tensor decomposition, and completion using factor priors". IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 3, pp. 577-591, Mar. 2014
21. A. Narita, K. Hayashi, R. Tomioka, and H. Kashima. "Tensor factorization using auxiliary information". Data Min. Knowl. Discov., vol. 25, no. 2, pp. 298-324, 2012
22. J. Ha stad. "Tensor rank is NP-complete". J. Algorithms, vol. 11, no. 4, pp. 644-654, 1990
23. B. Alexeev, M. A. Forbes, and J. Tsimerman. "Tensor rank: Some lower, and upper bounds". in Proc. IEEE 26th Annu. Conf. Comput. Complexity, 2011, pp. 283-291
24. P. Bürgisser, and C. Ikenmeyer. "Geometric complexity theory, and tensor rank". in Proc. 43rd Annu. ACM Symp. Theory Comput., 2011, pp. 509-518
25. V. De Silva, and L.-H. Lim. "Tensor rank, and the ill-posedness of the best low-rank approximation problem". SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1084-1127, 2008
26. E. S. Allman, P. D. Jarvis, J. A. Rhodes, and J. G. Sumner. "Tensor rank, invariants, inequalities, and applications". SIAM J. Matrix Anal. Appl., vol. 34, no. 3, pp. 1014-1045, 2013
27. R. Salakhutdinov, and A. Mnih. "Probabilistic matrix factorization". in Proc. Adv. Neural Inform. Process. Syst., 2008, vol. 20, pp. 1257-1264
28. R. Salakhutdinov, and A. Mnih. "Bayesian probabilistic matrix factorization using Markov chain Monte Carlo". in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 880-887
29. S. D. Babacan, M. Luessi, R. Molina, and A. K. Katsaggelos. "Sparse Bayesian methods for low-rank matrix estimation". IEEE Trans. Signal Process., vol. 60, no. 8, pp. 3964-3977, Aug. 2012
30. Y. J. Lim, and Y. W. Teh. "Variational Bayesian approach to movie rating prediction". in Proc. KDD Cup Workshop, 2007, pp. 15-21
31. N. D. Lawrence, and R. Urtasun. "Non-linear matrix factorization with Gaussian processes". in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 601-608
32. B. Lakshminarayanan, G. Bouchard, and C. Archambeau. "Robust Bayesian matrix factorisation". in Proc. Int. Conf. Artif. Intell. Stat., 2011, pp. 425-433
33. W. Chu, and Z. Ghahramani. "Probabilistic models for incomplete multi-dimensional arrays". in JMLR Workshop Conf. Proc., 2009, vol. 5, pp. 89-96
34. S. Gao, L. Denoyer, P. Gallinari, and J. GUO. "Probabilistic latent tensor factorization model for link pattern prediction in multirelational networks". J. China Univ. Posts Telecommun., vol. 19, pp. 172-181, 2012
35. L. Xiong, X. Chen, T.-K. Huang, J. Schneider, and J. G. Carbonell. "Temporal collaborative filtering with Bayesian probabilistic tensor factorization". in Proc. SIAM Data Min., 2010, vol. 2010
36. K. Hayashi, T. Takenouchi, T. Shibata, Y. Kamiya, D. Kato, K. Kunieda, K. Yamada, and K. Ikeda. "Exponential family tensor factorization for missing-values prediction, and anomaly detection". in Proc. IEEE 10th Int. Conf. Data Min., 2010, pp. 216-225
37. Z. Xu, F. Yan, and A. Qi. "Infinite Tucker decomposition: Nonparametric Bayesian models for multiway data analysis". in Proc. 29th Int. Conf. Mach. Lear., 2012, pp. 1023-1030
38. D. J. MacKay. "Bayesian methods for backpropagation networks". in Models of Neural Networks III. New York, NY, USA: Springer, 1996, pp. 211-254
39. M. E. Tipping. "Sparse Bayesian learning, and the relevance vector machine". J. Mach. Learn. Res., vol. 1, pp. 211-244, 2001
40. C. M. Bishop. "Bayesian PCA". in Proc. Adv. Neural Inform. Process. Syst., 1999, pp. 382-388
41. J. M. Winn, and C. M. Bishop. "Variational message passing". J. Mach. Learn. Res., vol. 6, pp. 661-694, 2005
42. L. Sorber, M. V. Barel, and L. D. Lathauwer. (2013). Tensorlab v1.0 [Online]. Available: http://esat.kuleuven.be/sista/tensorlab
43. A. H. Phan, A. Cichocki, P. Tichavsky, G. Luta, and A. J. Brockmeier. "Tensor completion through multiple Kronecker product decomposition." in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 2013, pp. 3233-3237
44. P. Paysan, R. Knothe, B. Amberg, S. Romdhani, and T. Vetter. "A 3D face model for pose, and illumination invariant face recognition". in Proc. 6th IEEE Int. Conf. Adv. Video Signal Based Surveill., 2009, pp. 296-301