Tensors for data mining and data fusion: Models, applications, and scalable algorithms

ACM Transactions on Intelligent Systems and Technology

Volumn 8, Issue 2, 2016, Pages

  Papalexakis, Evangelos E ^a   Faloutsos, Christos ^b   Sidiropoulos, Nicholas D ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Carnegie Mellon University ^*  (United States)

^c University of Minnesota   (United States)

Author keywords

Multi Aspect data; Multi way analysis; Tensor decomposition; Tensor factorization; Tensors

Indexed keywords

ARTS COMPUTING; BIG DATA; DATA FUSION; TENSORS;

DATA MINING COMMUNITY; FUTURE RESEARCH DIRECTIONS; MULTI ASPECTS; MULTI-WAY ANALYSIS; SCALABLE ALGORITHMS; STATE-OF-THE-ART PERFORMANCE; TENSOR DECOMPOSITION; TENSOR FACTORIZATION;

DATA MINING;

EID: 84994031868     PISSN: 21576904     EISSN: 21576912     Source Type: Journal    
DOI: 10.1145/2915921     Document Type: Article

References (150)

1. Evrim Acar, Canan Aykut-Bingol, Haluk Bingol, Rasmus Bro, and B ulent Yener. 2007. Multiway analysis of epilepsy tensors. Bioinformatics 23, 13 (2007), i10-i18. DOI:http://dx.doi.org/10.1093/bioinformatics/btm210.
2. Evrim Acar, Seyit A. Ç amtepe, Mukkai S. Krishnamoorthy, and B ulent Yener. 2005. Modeling and multiway analysis of chatroom tensors. In Intelligence and Security Informatics. Springer, 256-268. DOI:http://dx.doi.org/10.1007/1142799521.
3. Evrim Acar, Daniel M. Dunlavy, and Tamara G. Kolda. 2009. Link prediction on evolving data using matrix and tensor factorizations. In Proceedings of the 2009 IEEE International Conference on Data Mining Workshops (ICDMW'09). 262-269. DOI:http://dx.doi.org/10.1109/ICDMW.2009.54.
4. Evrim Acar, Daniel M. Dunlavy, and Tamara G. Kolda. 2011. A scalable optimization approach for fitting canonical tensor decompositions. Journal of Chemometrics 25, 2 (2011), 67-86. DOI:http://dx.doi.org/10.1002/cem.1335.
5. Evrim Acar, Daniel M. Dunlavy, Tamara G. Kolda, and Morten Mørup. 2010. Scalable tensor factorizations with missing data. In SIAM International Conference on Data Mining (SDM). SIAM, 701-712. DOI:http://dx.doi.org/10.1137/1.9781611972801.61.
6. Evrim Acar, Daniel M. Dunlavy, Tamara G. Kolda, and Morten Mørup. 2011. Scalable tensor factorizations for incomplete data. Chemometrics and Intelligent Laboratory Systems 106, 1 (March 2011), 41-56. DOI:http://dx.doi.org/10.1016/j.chemolab.2010.08.004.
7. Evrim Acar, Gozde Gurdeniz, Morten A. Rasmussen, Daniela Rago, Lars O. Dragsted, and Rasmus Bro. 2012. Coupled matrix factorization with sparse factors to identify potential biomarkers in metabolomics. In IEEE International Conference on Data Mining Workshops (ICDMW). IEEE, 1-8. DOI:http://dx.doi.org/10.1109/icdmw.2012.17.
8. Evrim Acar, Tamara G. Kolda, and Daniel M. Dunlavy. 2011. All-At-once optimization for coupled matrix and tensor factorizations. In Proceedings of Mining and Learning with Graphs (MLG'11). https://www.cs.purdue.edu/mlg2011/papers/paper4.pdf.
9. Evrim Acar, Anders J. Lawaetz, Morten Rasmussen, and Rasmus Bro. 2013. Structure-revealing data fusion model with applications in metabolomics. In 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'13). IEEE, 6023-6026. DOI:http://dx.doi.org/10.1109/embc.2013.6610925.
10. Evrim Acar, Evangelos E. Papalexakis, Morten A. Rasmussen, Anders J. Lawaetz, Mathias Nilsson, and Rasmus Bro. 2014. Structure-revealing data fusion. BMC Bioinformatics 15, 1 (2014), 239. DOI:http://dx.doi.org/10.1186/1471-2105-15-239.
11. Evrim Acar, George Plopper, and B ulent Yener. 2012. Coupled analysis of in vitro and histology tissue samples to quantify structure-function relationship. PloS One 7, 3 (2012), e32227. DOI:http://dx.doi.org/10.1371/journal.pone.0032227.
12. Evrim Acar and B ulent Yener. 2009. Unsupervised multiway data analysis: A literature survey. IEEE Transactions on Knowledge and Data Engineering, 21, 1 (2009), 6-20. DOI:http://dx.doi.org/10.1109/tkde.2008.112.
13. Rakesh Agrawal, Behzad Golshan, and Evangelos Papalexakis. 2015a. A study of distinctiveness in web results of two search engines. In 24th International Conference on World Wide Web, Web Science Track. ACM. DOI:http://dx.doi.org/10.1145/2740908.2743060.
14. Rakesh Agrawal, Behzad Golshan, and Evangelos Papalexakis. 2015b. Whither social networks for web search? In 21st ACM SIGKDD Conference on Knowledge Discovery and Data Mining. Sydney, Australia. DOI:http://dx.doi.org/10.1145/2783258.2788571.
15. Animashree Anandkumar, Rong Ge, Daniel Hsu, Sham M. Kakade, and Matus Telgarsky. 2014. Tensor decompositions for learning latent variable models. Journal of Machine Learning Research 15, 1 (2014), 2773-2832.
16. Miguel Araujo, Spiros Papadimitriou, StephanGunnemann, Christos Faloutsos, Prithwish Basu, Ananthram Swami, Evangelos E. Papalexakis, and Danai Koutra. 2014. Com2: Fast automatic discovery of temporal ('comet') communities. In Advances in Knowledge Discovery and Data Mining. Springer, 271-283. DOI:http://dx.doi.org/10.1007/978-3-319-06605-923.
17. Woody Austin, Grey Ballard, and Tamara G.Kolda. 2016. Parallel tensor compression for large-scale scientific data. In Proceedings of the 30th IEEE International Parallel & Distributed Processing Symposium (IPDPS'16).
18. Brett W. Bader, Richard A. Harshman, and Tamara G. Kolda. 2007. Temporal analysis of semantic graphs using ASALSAN. In 7th IEEE International Conference on Data Mining, 2007 (ICDM'07). IEEE, 33-42. DOI:http://dx.doi.org/10.1109/icdm.2007.54.
19. Brett W. Bader and Tamara G. Kolda. 2007. Efficient MATLAB computations with sparse and factored tensors. SIAM Journal on Scientific Computing 30, 1 (Dec. 2007), 205-231. DOI:http://dx.doi.org/10.1137/060676489.
20. Brett W. Bader and Tamara G. Kolda. 2015.MATLAB Tensor Toolbox Version 2.6. Available online. (February 2015). http://www.sandia.gov/∼tgkolda/TensorToolbox/.
21. Jonas Ballani, Lars Grasedyck, and Melanie Kluge. 2013. Black box approximation of tensors in hierarchical Tucker format. Linear Algebra and Its Applications 438, 2 (2013), 639-657. DOI:http://dx.doi.org/10.1016/j.laa.2011.08.010.
22. Arindam Banerjee, Sugato Basu, and Srujana Merugu. 2007. Multi-way clustering on relation graphs. In SIAM International Conference on Data Mining (SDM). Vol. 7. SIAM, 145-156. DOI:http://dx.doi.org/10.1137/1.9781611972771.14.
23. Alex Beutel, Abhimanu Kumar, Evangelos Papalexakis, Partha Pratim Talukdar, Christos Faloutsos, and Eric P. Xing. 2014. FLEXIFACT: Scalable flexible factorization of coupled tensors on hadoop. In SIAM InternationalConference on Data Mining (SDM). SIAM. DOI:http://dx.doi.org/10.1137/1.9781611973440.13.
24. David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. Journal of Machine Learning Research 3 (2003), 993-1022.
25. Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, and Jonathan Eckstein. 2011. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning 3, 1 (2011), 1-122. DOI:http://dx.doi.org/10.1561/2200000016.
26. John W. Brewer. 1978. Kronecker products and matrix calculus in system theory. IEEE Transactions on Circuits and Systems 25, 9 (1978), 772-781. DOI:http://dx.doi.org/10.1109/tcs.1978.1084534.
27. Rasmus Bro. 1998. Multi-way Analysis in the Food Industry: Models, Algorithms, and Applications. Ph.D. Dissertation. Københavns Universitet'Københavns Universitet', LUKKET: 2012 Det Biovidenskabelige Fakultet for Fødevarer, Veterinærmedicin og NaturressourcerFaculty of Life Sciences, LUKKET: 2012 Institut for FødevarevidenskabDepartment of Food Science, 2012 Institut for Fødevarevidenskab, 2012 Kvalitet og TeknologiDepartment of Food Science, Quality & Technology.
28. Rasmus Bro and Claus A. Andersson. 1998. Improving the speed of multiway algorithms: Part II: Compression. Chemometrics and Intelligent Laboratory Systems 42, 1 (1998), 105-113. DOI:http://dx.doi.org/10.1016/s0169-7439(98)00011-2.
29. Rasmus Bro and Henk A. L. Kiers. 2003. A new efficient method for determining the number of components in PARAFAC models. Journal of Chemometrics 17, 5 (2003), 274-286. DOI:http://dx.doi.org/10.1002/cem.801.
30. Cesar F. Caiafa and Andrzej Cichocki. 2010. Generalizing the column-row matrix decomposition to multi-way arrays. Linear Algebra Applications 433, 3 (2010), 557-573. DOI:http://dx.doi.org/10.1016/j.laa.2010.03.020.
31. J. Douglas Carroll and Jih-Jie Chang. 1970. Analysis of individual differences in multidimensional scaling via an N-way generalization of 'Eckart-Young' decomposition. Psychometrika 35, 3 (1970), 283-319. DOI:http://dx.doi.org/10.1007/bf02310791.
32. J. Douglas Carroll, Sandra Pruzansky, and Joseph B. Kruskal. 1980. CANDELINC: A general approach to multidimensional analysis of many-way arrays with linear constraints on parameters. Psychometrika 45, 1 (1980), 3-24. DOI:http://dx.doi.org/10.1007/bf02293596.
33. Kai-Wei Chang, Wen-Tau Yih, and Christopher Meek. 2013. Multi-relational latent semantic analysis. In Proceedings of the 2013 Conference on EmpiricalMethods in Natural Language Processing (EMNLP'13). 1602-1612.
34. Kai-Wei Chang, Wen-Tau Yih, Bishan Yang, and Christopher Meek. 2014. Typed tensor decomposition of knowledge bases for relation extraction. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP'14). 1568-1579. DOI:http://dx.doi.org/10.3115/v1/d14-1165.
35. Peter A. Chew, Brett W. Bader, Tamara G. Kolda, and Ahmed Abdelali. 2007. Cross-language information retrieval using PARAFAC2. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 143-152. DOI:http://dx.doi.org/10.1145/1281192.1281211.
36. Eric C. Chi and Tamara G. Kolda. 2012. On tensors, sparsity, and nonnegative factorizations. SIAM Journal of Matrix Analysis & Applications 33, 4 (2012), 1272-1299. DOI:http://dx.doi.org/10.1137/110859063.
37. Luca Chiantini and Giorgio Ottaviani. 2012. On generic identifiability of 3-Tensors of small rank. SIAM Journal of Matrix Analysis & Applications 33, 3 (2012), 1018-1037. DOI:http://dx.doi.org/10.1137/110829180.
38. Joon Hee Choi and S. Vishwanathan. 2014. DFacTo: Distributed factorization of tensors. In Advances in Neural Information Processing Systems 27, Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger (Eds.). Curran Associates, 1296-1304. http://papers.nips.cc/paper/5395-dfacto-distributed-factorization-of-Tensors.pdf.
39. Andrzej Cichocki, Danilo Mandic, Lieven De Lathauwer, Guoxu Zhou, Qibin Zhao, Cesar Caiafa, and Huy Anh Phan. 2015. Tensor decompositions for signal processing applications: From twoway to multiway component analysis. IEEE Signal Processing Magazine 32, 2 (2015), 145-163. DOI:http://dx.doi.org/10.1109/msp.2013.2297439.
40. Andrzej Cichocki, Rafal Zdunek, Anh Huy Phan, and S. Amari. 2009. Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-Way Data Analysis and Blind Source Separation. John Wiley & Sons.
41. Jeremy E. Cohen, Rodrigo Cabral Farias, and Pierre Comon. 2015. Fast decomposition of large nonnegative tensors. IEEE Signal Processing Letters 22, 7 (2015), 862-866. DOI:http://dx.doi.org/10.1109/lsp.2014.2374838.
42. Joao Paulo C. L. da Costa, Martin Haardt, and F. Romer. 2008. Robust methods based on the HOSVD for estimating the model order in PARAFAC models. In 5th Sensor Array and Multichannel Signal Processing Workshop, 2008 (SAM'08). IEEE, 510-514. DOI:http://dx.doi.org/10.1109/sam.2008.4606923.
43. Ian Davidson, Sean Gilpin, Owen Carmichael, and Peter Walker. 2013. Network discovery via constrained tensor analysis of fMRI data. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 194-202. DOI:http://dx.doi.org/10.1145/2487575.2487619.
44. Andre L. F. De Almeida and Alain Y. Kibangou. 2014. Distributed large-scale tensor decomposition. In 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'14). DOI:http://dx.doi.org/10.1109/icassp.2014.6853551.
45. Lieven De Lathauwer, Bart De Moor, and Joos Vandewalle. 2000. A multilinear singular value decomposition. SIAM Journal on Matrix Analysis and Applications 21, 4 (2000), 1253-1278. DOI:http://dx.doi.org/10.1137/s0895479896305696.
46. S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman. 1990. Indexing by latent semantic analysis. Journal of the American Society for Information Science 41, 6 (Sept. 1990), 391-407. DOI:http://dx.doi.org/10.1002/(SICI)1097-4571(199009)41:6-391::AID-ASI1-3.0.CO;2-9.
47. Petros Drineas, Ravi Kannan, and Michael W. Mahoney. 2006. Fast Monte Carlo algorithms for matrices III: Computing a compressed approximate matrix decomposition. SIAM Journal on Computing 36, 1 (2006), 184. DOI:http://dx.doi.org/10.1137/s0097539704442702.
48. Daniel M. Dunlavy, Tamara G. Kolda, and Evrim Acar. 2011. Temporal link prediction using matrix and tensor factorizations. ACM Transactions on Knowledge Discovery from Data 5, 2 (Feb. 2011). DOI:http://dx.doi.org/10.1145/1921632.1921636.
49. Dora Erdos and Pauli Miettinen. 2013. Walk'n'merge: A scalable algorithm for boolean tensor factorization. In 2013 IEEE 13th International Conference on Data Mining (ICDM'13). IEEE, 1037-1042. DOI:http://dx.doi.org/10.1109/icdm.2013.141.
50. Beyza Ermiş, Evrim Acar, and A. Taylan Cemgil. 2015. Link prediction in heterogeneous data via generalized coupled tensor factorization. Data Mining and Knowledge Discovery 29, 1 (2015), 203-236. DOI:http://dx.doi.org/10.1007/s10618-013-0341-y.
51. Lars Grasedyck. 2010. Hierarchical singular value decomposition of tensors. SIAM Journal of Matrix Analysis & Applications 31, 4 (2010), 2029-2054. DOI:http://dx.doi.org/10.1137/090764189.
52. Lars Grasedyck, Daniel Kressner, and Christine Tobler. 2013. A literature survey of low-rank tensor approximation techniques. GAMM-Mitteilungen 36, 1 (2013), 53-78. DOI:http://dx.doi.org/10.1002/gamm.201310004.
53. Wolfgang Hackbusch and Stefan K uhn. 2009. A new scheme for the tensor representation. Journal of Fourier Analysis and Applications 15, 5 (2009), 706-722. DOI:http://dx.doi.org/10.1007/s00041-009-9094-9.
54. Samantha Hansen, Todd Plantenga, and Tamara G. Kolda. 2015. Newton-based optimization for Kullback- Leibler nonnegative tensor factorizations. Optimization Methods and Software 30, 5 (April 2015), 1002- 1029. DOI:http://dx.doi.org/10.1080/10556788.2015.1009977.
55. Richard A. Harshman. 1970. Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multimodal factor analysis. UCLA Working Papers in Phonetics 16 (1970), 1-84.
56. Richard A. Harshman. 1972. PARAFAC2: Mathematical and technical notes. UCLA Working Papers in Phonetics 22 (1972), 30-44.
57. Richard A. Harshman. 1978. Models for analysis of asymmetrical relationships among N objects or stimuli. In 1st Joint Meeting of the Psychometric Society and the Society for Mathematical Psychology. McMaster University, Hamilton, Ontario.
58. Richard A. Harshman. 1984. How can I know if its real? A Catalog of Diagnostics for Use with Three-Mode Factor Analysis and Multidimensional Scaling. 566-591.
59. Richard A. Harshman, Sungjin Hong, and Margaret E. Lundy. 2003. Shifted factor analysis-Part I: Models and properties. Journal of Chemometrics 17, 7 (2003), 363-378. DOI:http://dx.doi.org/10.1002/cem.808.
60. Lifang He, Xiangnan Kong, S. Yu Philip, Ann B. Ragin, Zhifeng Hao, and Xiaowei Yang. 2014. Dusk: A dual structure-preserving kernel for supervised tensor learning with applications to neuroimages. Matrix 3, 1 (2014), 2. DOI:http://dx.doi.org/10.1137/1.9781611973440.15.
61. Frank L. Hitchcock. 1927. The expression of a tensor or a polyadic as a sum of products. Journal of Mathematics and Physics 6, 1 (1927), 164-189. DOI:http://dx.doi.org/10.1002/sapm192761164.
62. Joyce C. Ho, Joydeep Ghosh, and Jimeng Sun. 2014. Marble: High-Throughput phenotyping from electronic health records via sparse nonnegative tensor factorization. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 115-124. DOI:http://dx.doi.org/10.1145/2623330.2623658.
63. Furong Huang, Sergiy Matusevych, Anima Anandkumar, Nikos Karampatziakis, and Paul Mineiro. 2014. Distributed latent Dirichlet allocation via tensor factorization. Neural Information Processing Systems (NIPS) Optimization Workshop 2014.
64. Furong Huang, U. N. Niranjan, Mohammad Umar Hakeem, and Animashree Anandkumar. 2013. Fast detection of overlapping communities via online tensor methods. arXiv preprint arXiv:1309.0787 (2013).
65. ByungSoo Jeon, L. S. I. Jeon, and U. Kang. 2016. SCouT: Scalable coupled matrix-Tensor factorization algorithm and discoveries. In International Conference on Data Engineering (ICDE). IEEE.
66. Inah Jeon, Evangelos E. Papalexakis, U. Kang, and Christos Faloutsos. 2015. Haten2: Billion-scale tensor decompositions. In International Conference on Data Engineering (ICDE). DOI:http://dx.doi.org/10.1109/icde.2015.7113355.
67. Meng Jiang, Peng Cui, Fei Wang, Xinran Xu, Wenwu Zhu, and Shiqiang Yang. 2014. FEMA: Flexible evolutionary multi-faceted analysis for dynamic behavioral pattern discovery. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1186-1195. DOI:http://dx.doi.org/10.1145/2623330.2623644.
68. Tao Jiang and Nicholas D. Sidiropoulos. 2004. Kruskal's permutation lemma and the identification of CANDECOMP/PARAFAC and bilinear models with constant modulus constraints. IEEE Transactions on Signal Processing 52, 9 (2004), 2625-2636. DOI:http://dx.doi.org/10.1109/tsp.2004.832022.
69. U. Kang, Evangelos Papalexakis, Abhay Harpale, and Christos Faloutsos. 2012. Gigatensor: Scaling tensor analysis up by 100 times-Algorithms and discoveries. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 316-324. DOI:http://dx.doi.org/10.1145/2339530.2339583.
70. Alexandros Karatzoglou, Xavier Amatriain, Linas Baltrunas, and Nuria Oliver. 2010. Multiverse recommendation: N-dimensional tensor factorization for context-Aware collaborative filtering. In Proceedings of the 4th ACM Conference on Recommender Systems. ACM, 79-86. DOI:http://dx.doi.org/10.1145/1864708.1864727.
71. Henk A. L. Kiers. 1993. An alternating least squares algorithm for PARAFAC2 and three-way DEDICOM. Computational Statistics & Data Analysis 16, 1 (1993), 103-118. DOI:http://dx.doi.org/10.1016/0167-9473(93)90247-q.
72. Henk A. L. Kiers and Albert Kinderen. 2003. A fast method for choosing the numbers of components in Tucker3 analysis. British Journal of Mathematical and Statistical Psychology 56, 1 (2003), 119-125. DOI:http://dx.doi.org/10.1348/000711003321645386.
73. Henk A. L. Kiers. 1997. Weighted least squares fitting using ordinary least squares algorithms. Psychometrika 62, 2 (June 1997), 215-266. DOI:http://dx.doi.org/10.1007/BF02295279.
74. Mijung Kim and K. Selcuk Candan. 2012. Decomposition-by-normalization (DBN): Leveraging approximate functional dependencies for efficient tensor decomposition. In Proceedings of the 21st ACM International Conference on Information and KnowledgeManagement. ACM, 355-364. DOI:http://dx.doi.org/10.1145/2396761.2396809.
75. Eleftherios Kofidis and Phillip A. Regalia. 2002. On the best rank-1 approximation of higher-order supersymmetric tensors. SIAM Journal on Matrix Analysis & Applications 23, 3 (2002), 863-884. DOI:http://dx.doi.org/10.1137/s0895479801387413.
76. Tamara G. Kolda and Brett W. Bader. 2009. Tensor decompositions and applications. SIAM Reviews 51, 3 (2009). DOI:http://dx.doi.org/10.1137/07070111x.
77. Tamara G. Kolda, Brett W. Bader, and Joseph P. Kenny. 2005. Higher-order web link analysis using multilinear algebra. In 5th IEEE International Conference on Data Mining. IEEE, 8-pp. DOI:http://dx.doi.org/10.1109/icdm.2005.77.
78. Tamara G. Kolda and Jackson R. Mayo. 2011. Shifted power method for computing tensor eigenpairs. SIAM Journal on Matrix Analysis & Applications 32, 4 (Oct. 2011), 1095-1124. DOI:http://dx.doi.org/10.1137/100801482.
79. Tamara G. Kolda and Jimeng Sun. 2008. Scalable tensor decompositions for multi-Aspect data mining. In 8th IEEE International Conference on Data Mining, 2008 (ICDM'08). IEEE, 363-372. DOI:http://dx.doi.org/10.1109/icdm.2008.89.
80. Daniel Kressner and Christine Tobler. 2012. Htucker-A matlab toolbox for tensors in hierarchical Tucker format. Mathicse, EPF Lausanne (2012).
81. Joseph B. Kruskal. 1977. Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics. Linear Algebra and Its Applications 18, 2 (1977), 95-138. DOI:http://dx.doi.org/10.1016/0024-3795(77)90069-6.
82. Daniel D. Lee and H. Sebastian Seung. 1999. Learning the parts of objects by non-negative matrix factorization. Nature 401, 6755 (1999), 788-791. DOI:http://dx.doi.org/10.1038/44565.
83. Athanasios P. Liavas and Nicholas D. Sidiropoulos. 2015. Parallel algorithms for constrained tensor factorization via alternating direction method of multipliers. IEEE Transactions on Signal Processing, 63, 20 (2015), 5450-5463. DOI:http://dx.doi.org/10.1109/tsp.2015.2454476.
84. Yu-Ru Lin, Jimeng Sun, Paul Castro, Ravi Konuru, Hari Sundaram, and Aisling Kelliher. 2009. Metafac: Community discovery via relational hypergraph factorization. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 527-536. DOI:http://dx.doi.org/10.1145/1557019.1557080.
85. Ji Liu, Przemyslaw Musialski, PeterWonka, and Jieping Ye. 2013. Tensor completion for estimating missing values in visual data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1 (2013), 208-220. DOI:http://dx.doi.org/10.1109/iccv.2009.5459463.
86. Haiping Lu, Konstantinos N. Plataniotis, and Anastasios N. Venetsanopoulos. 2011. A survey of multilinear subspace learning for tensor data. Pattern Recognition 44, 7 (2011), 1540-1551. DOI:http://dx.doi.org/10.1016/j.patcog.2011.01.004.
87. Machine Learning Department. 2016. CarnegieMellonUniversity. Read theWeb. http://rtw.ml.cmu.edu/rtw/.(Lastaccessed:2/13/2016).
88. Michael W. Mahoney, Mauro Maggioni, and Petros Drineas. 2008. Tensor-CUR decompositions for tensor-based data. SIAM Journal on Matrix Analysis & Applications 30, 3 (2008), 957-987. DOI:http://dx.doi.org/10.1137/060665336.
89. Ching-Hao Mao, Chung-Jung Wu, Evangelos E. Papalexakis, Christos Faloutsos, and Tien-Cheu Kao. 2014. MalSpot:Multi2 malicious network behavior patterns analysis. In Pacific Asia Conference on Knowledge Discovery and Data Mining (PAKDD) 2014. DOI:http://dx.doi.org/10.1007/978-3-319-06608-01.
90. K. Maruhashi, F. Guo, and C. Faloutsos. 2011. MultiAspectForensics: Pattern mining on large-scale heterogeneous networks with tensor analysis. In Proceedings of the 3rd International Conference on Advances in Social Network Analysis and Mining. DOI:http://dx.doi.org/10.1109/asonam.2011.80.
91. Saskia Metzler and Pauli Miettinen. 2015. Clustering boolean tensors. Data Mining and Knowledge Discovery 29, 5 (2015), 1343-1373. DOI:http://dx.doi.org/10.1007/s10618-015-0420-3.
92. Pauli Miettinen. 2011. Boolean tensor factorizations. In 2011 IEEE 11th International Conference on Data Mining (ICDM'11). IEEE, 447-456. DOI:http://dx.doi.org/10.1109/icdm.2011.28.
93. Shahin Mohammadi, David Gleich, Tamara Kolda, and Ananth Grama. 2016. Triangular alignment (TAME): A tensor-based approach for higher-order network alignment. IEEE/ACM Transactions on Computational Biology and Bioinformatics (2016).
94. Morten Mørup and Lars Kai Hansen. 2009. Automatic relevance determination for multi-way models. Journal of Chemometrics 23, 7-8 (2009), 352-363. DOI:http://dx.doi.org/10.1002/cem.1223.
95. Morten Mørup, Lars Kai Hansen, Sidse Marie Arnfred, Lek-Heng Lim, and Kristoffer Hougaard Madsen. 2008. Shift-invariant multilinear decomposition of neuroimaging data. NeuroImage 42, 4 (2008), 1439- 1450. DOI:http://dx.doi.org/10.1016/j.neuroimage.2008.05.062.
96. Morten Mørup, Lars Kai Hansen, and Kristoffer Hougaard Madsen. 2011. Modeling latency and shape changes in trial based neuroimaging data. In 2011 Conference Record of the 45th Asilomar Conference on Signals, Systems and Computers (ASILOMAR'11). IEEE, 439-443. DOI:http://dx.doi.org/10.1109/acssc.2011.6190037.
97. Yang Mu, Wei Ding, Melissa Morabito, and Dacheng Tao. 2011. Empirical discriminative tensor analysis for crime forecasting. In Knowledge Science, Engineering and Management. Springer, 293-304. DOI:http://dx.doi.org/10.1007/978-3-642-25975-326.
98. Atsuhiro Narita, Kohei Hayashi, Ryota Tomioka, and Hisashi Kashima. 2012. Tensor factorization using auxiliary information. Data Mining and Knowledge Discovery 25, 2 (2012), 298-324. DOI:http://dx.doi.org/10.1007/978-3-642-23783-632.
99. Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. 2011. A three-way model for collective learning on multi-relational data. In Proceedings of the 28th International Conference on Machine Learning (ICML'11). 809-816.
100. Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. 2012. Factorizing YAGO: Scalable machine learning for linked data. In Proceedings of the 21st International Conference on World Wide Web. ACM, 271-280. DOI:http://dx.doi.org/10.1145/2187836.2187874.
101. Dimitri Nion, Kleanthis N. Mokios, Nicholas D. Sidiropoulos, and Alexandros Potamianos. 2010. Batch and adaptive PARAFAC-based blind separation of convolutive speech mixtures. IEEE Transactions on Audio, Speech, and Language Processing, 18, 6 (2010), 1193-1207. DOI:http://dx.doi.org/10.1109/tasl.2009.2031694.
102. Dimitri Nion and Nicholas D. Sidiropoulos. 2009. Adaptive algorithms to track the PARAFAC decomposition of a third-order tensor. IEEE Transactions on Signal Processing, 57, 6 (2009), 2299-2310. DOI:http://dx.doi.org/10.1109/tsp.2009.2016885.
103. Ivan V. Oseledets. 2011. Tensor-Train decomposition. SIAM Journal on Scientific Computing 33, 5 (2011), 2295-2317. DOI:http://dx.doi.org/10.1137/090752286.
104. Pentti Paatero. 1997. Aweighted non-negative least squares algorithm for three-way "PARAFAC" factor analysis. Chemometrics and Intelligent Laboratory Systems 38, 2 (Oct. 1997), 223-242. DOI:http://dx.doi.org/10.1016/S0169-7439(97)00031-2.
105. Evangelia Pantraki and Constantine Kotropoulos. 2015. Automatic image tagging and recommendation via PARAFAC2. In 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP'15). IEEE, 1-6. DOI:http://dx.doi.org/10.1109/mlsp.2015.7324363.
106. Evangelos E. Papalexakis and Christos Faloutsos. 2015. Fast efficient and scalable core consistency diagnostic for the PARAFAC decomposition for big sparse tensors. In 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'15). IEEE. DOI:http://dx.doi.org/10.1109/icassp.2015.7179011.
107. Evangelos E. Papalexakis, Leman Akoglu, and Dino Ienco. 2013. Do more views of a graph help? Community detection and clustering in multi-graphs. In 2013 16th International Conference on Information Fusion (FUSION'13). IEEE, 899-905.
108. Evangelos E. Papalexakis, Christos Faloutsos, and Nicholas D. Sidiropoulos. 2012. ParCube: Sparse parallelizable tensor decompositions. In Machine Learning and Knowledge Discovery in Databases. Springer, 521-536. DOI:http://dx.doi.org/10.1007/978-3-642-33460-339.
109. Evangelos E. Papalexakis, Tom M. Mitchell, Nicholas D. Sidiropoulos, Christos Faloutsos, Partha Pratim Talukdar, and Brian Murphy. 2014. Turbo-SMT: Accelerating coupled sparse matrixtensor factorizations by 200x. In SIAM International Conference on Data Mining (SDM). SIAM. DOI:http://dx.doi.org/10.1137/1.9781611973440.14.
110. Evangelos E. Papalexakis, Nicholas D. Sidiropoulos, and Rasmus Bro. 2013. From k-means to higher-way co-clustering: Multilinear decomposition with sparse latent factors. IEEE Transactions on Signal Processing, 61, 2 (2013), 493-506. DOI:http://dx.doi.org/10.1109/tsp.2012.2225052.
111. Jing Peng, Daniel Dajun Zeng, Huimin Zhao, and Fei-yue Wang. 2010. Collaborative filtering in social tagging systems based on joint item-Tag recommendations. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management. ACM, 809-818. DOI:http://dx.doi.org/10.1145/1871437.1871541.
112. Ioakeim Perros, Robert Chen, Richard Vuduc, and Jimeng Sun. 2015. Sparse hierarchical tucker factorization and its application to healthcare. In 2015 IEEE 15th International Conference on Data Mining (ICDM'15). IEEE. DOI:http://dx.doi.org/10.1109/icdm.2015.29.
113. Anh-Huy Phan and Andrzej Cichocki. 2009. Block decomposition for very large-scale nonnegative tensor factorization. In 2009 3rd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP'09). IEEE, 316-319. DOI:http://dx.doi.org/10.1109/camsap.2009.5413268.
114. Anh-Huy Phan, Petr Tichavsḱy, and Andrzej Cichocki. 2013. Low complexity damped Gauss-Newton algorithms for CANDECOMP/PARAFAC. SIAM Journal on Matrix Analysis & Applications 34, 1 (Jan. 2013), 126-147. DOI:http://dx.doi.org/10.1137/100808034.
115. Niranjay Ravindran, Nicholas D. Sidiropoulos, Shaden Smith, and George Karypis. 2014. Memoryefficient parallel computation of tensor and matrix products for big tensor decomposition. In 2014 48th Asilomar Conference on Signals, Systems and Computers. IEEE, 581-585. DOI:http://dx.doi.org/10.1109/acssc.2014.7094512.
116. Steffen Rendle. 2010. Factorization machines. In 2010 IEEE 10th International Conference on Data Mining (ICDM'10). IEEE, 995-1000. DOI:http://dx.doi.org/10.1109/icdm.2010.127.
117. Steffen Rendle and Lars Schmidt-Thieme. 2010. Pairwise interaction tensor factorization for personalized tag recommendation. In Proceedings of the 3rd ACM International Conference on Web Search and Data Mining. ACM, 81-90. DOI:http://dx.doi.org/10.1145/1718487.1718498.
118. Ruslan Salakhutdinov and Andriy Mnih. 2008. Bayesian probabilistic matrix factorization using Markov chain Monte Carlo. In Proceedings of the 25th International Conference on Machine Learning. ACM, 880-887. DOI:http://dx.doi.org/10.1145/1390156.1390267.
119. Aaron Schein, John Paisley, David M. Blei, and Hanna Wallach. 2015. Bayesian poisson tensor factorization for inferring multilateral relations from sparse dyadic event counts. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1045-1054. DOI:http://dx.doi.org/10.1145/2783258.2783414.
120. Amnon Shashua and Tamir Hazan. 2005. Non-negative tensor factorization with applications to statistics and computer vision. In Proceedings of the 22nd International Conference on Machine Learning. ACM, 792-799. DOI:http://dx.doi.org/10.1145/1102351.1102451.
121. Kijung Shin and U. Kang. 2014. Distributed methods for high-dimensional and large-scale tensor factorization. In 2014 IEEE International Conference on Data Mining (ICDM'14). IEEE, 989-994. DOI:http://dx.doi.org/10.1109/icdm.2014.78.
122. Nicholas Sidiropoulos, Evangelos Papalexakis, and Christos Faloutsos. 2014. Parallel randomly compressed cubes: A scalable distributed architecture for big tensor decomposition. IEEE Signal Processing Magazine 31, 5 (2014), 57-70. DOI:http://dx.doi.org/10.1109/msp.2014.2329196.
123. Nicholas D. Sidiropoulos and Rasmus Bro. 2000. On the uniqueness of multilinear decomposition of N-way arrays. Journal of Chemometrics 14, 3 (2000), 229-239. DOI:http://dx.doi.org/10.1002/1099-128X(200005/06)14:3-229::AID-CEM587-3.0.CO;2-N.
124. Nicholas D. Sidiropoulos and Anastasios Kyrillidis. 2012. Multi-way compressed sensing for sparse low-rank tensors. IEEE Signal Processing Letters 19, 11 (2012), 757-760. DOI:http://dx.doi.org/10.1109/lsp.2012.2210872.
125. Ajit P. Singh and Geoffrey J. Gordon. 2008. Relational learning via collective matrix factorization. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 650-658. DOI:http://dx.doi.org/10.1145/1401890.1401969.
126. Age K. Smilde, Johan A. Westerhuis, and Ricard Boqúe. 2000. Multiway multiblock component and covariates regression models. Journal of Chemometrics 14, 3 (2000), 301-331. DOI:http://dx.doi.org/10.1002/1099-128x(200005/06)14:3-301::aid-cem594-3.0.co;2-h.
127. Shaden Smith, Niranjay Ravindran, Nicholas D. Sidiropoulos, and George Karypis. 2015. SPLATT: Efficient and parallel sparse tensor-matrix multiplication. In 29th IEEE International Parallel & Distributed Processing Symposium. DOI:http://dx.doi.org/10.1109/ipdps.2015.27.
128. A. Stegeman, J. M. F. ten Berge, and L. De Lathauwer. 2006. Sufficient conditions for uniqueness in CANDECOMP/PARAFAC and INDSCAL with random component matrices. Psychometrika 71, 2 (2006), 219-229. DOI:http://dx.doi.org/10.1007/s11336-006-1278-2.
129. Fabian M. Suchanek, Gjergji Kasneci, and Gerhard Weikum. 2007. Yago: A core of semantic knowledge unifying wordnet and wikipedia. In 16th International World Wide Web Conference (WWW'07). 697-706. DOI:http://dx.doi.org/10.1145/1242572.1242667.
130. Jimeng Sun, Dacheng Tao, and Christos Faloutsos. 2006. Beyond streams and graphs: Dynamic tensor analysis. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 374-383. DOI:http://dx.doi.org/10.1145/1150402.1150445.
131. Jimeng Sun, Charalampos E. Tsourakakis, Evan Hoke, Christos Faloutsos, and Tina Eliassi-Rad. 2008. Two heads better than one: Pattern discovery in time-evolving multi-Aspect data. Data Mining and Knowledge Discovery 17, 1 (2008), 111-128. DOI:http://dx.doi.org/10.1007/978-3-540-87479-919.
132. Jian-Tao Sun, Hua-Jun Zeng, Huan Liu, Yuchang Lu, and Zheng Chen. 2005. CubeSVD: A novel approach to personalized web search. In Proceedings of the 14th International Conference on World Wide Web. ACM, 382-390. DOI:http://dx.doi.org/10.1145/1060745.1060803.
133. Yizhou Sun, Jiawei Han, Xifeng Yan, Philip S. Yu, and Tianyi Wu. 2011. Pathsim: Meta path-based top-k similarity search in heterogeneous information networks. International Conference on Very Large Data Bases (VLDB) (2011).
134. Dacheng Tao, Mingli Song, Xuelong Li, Jialie Shen, Jimeng Sun, Xindong Wu, Christos Faloutsos, and Stephen J. Maybank. 2008. Bayesian tensor approach for 3-D face modeling. IEEE Transactions on Circuits and Systems for Video Technology, 18, 10 (2008), 1397-1410. DOI:http://dx.doi.org/10.1109/tcsvt.2008.2002825.
135. Jos M. F. ten Berge and Nikolaos D. Sidiropoulos. 2002. On uniqueness in CANDECOMP/PARAFAC. Psychometrika 67, 3 (2002), 399-409. DOI:http://dx.doi.org/10.1007/bf02294992.
136. Marieke E. Timmerman and Henk A. L. Kiers. 2000. Three-mode principal components analysis: Choosing the numbers of components and sensitivity to local optima. British Journal of Mathematical and Statistical Psychology 53, 1 (2000), 1-16. DOI:http://dx.doi.org/10.1348/000711000159132.
137. Giorgio Tomasi and Rasmus Bro. 2005. PARAFAC and missing values. Chemometrics and Intelligent Laboratory Systems 75, 2 (2005), 163-180. DOI:http://dx.doi.org/10.1016/j.chemolab.2004.07.003.
138. Giorgio Tomasi and Rasmus Bro. 2006. A comparison of algorithms for fitting the PARAFAC model. Computational Statistics & Data Analysis 50, 7 (2006), 1700-1734. DOI:http://dx.doi.org/10.1016/j.csda.2004.11.013.
139. Charalampos E. Tsourakakis. 2010. MACH: Fast randomized tensor decompositions. In SIAM International Conference on Data Mining (SDM). SIAM, 689-700. DOI:http://dx.doi.org/10.1137/1.9781611972801.60.
140. L. R. Tucker. 1966. Some mathematical notes on three-mode factor analysis. Psychometrika 31, 3 (1966), 279-311. DOI:http://dx.doi.org/10.1007/bf02289464.
141. Alex M. Vasilescu and Demetri Terzopoulos. 2002. Multilinear analysis of image ensembles: Tensorfaces. Computer Vision ECCV 2002 (2002), 447-460. DOI:http://dx.doi.org/10.1007/3-540-47969-430.
142. Yilun Wang, Yu Zheng, and Yexiang Xue. 2014. Travel time estimation of a path using sparse trajectories. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'14). ACM, New York, NY, 25-34. DOI:http://dx.doi.org/10.1145/2623330.2623656.
143. Tom Wilderjans, Eva Ceulemans, and Iven Van Mechelen. 2009. Simultaneous analysis of coupled data blocks differing in size: A comparison of two weighting schemes. Computational Statistics & Data Analysis 53, 4 (2009), 1086-1098. DOI:http://dx.doi.org/10.1016/j.csda.2008.09.031.
144. Liang Xiong, Xi Chen, Tzu-Kuo Huang, Jeff G. Schneider, and Jaime G. Carbonell. 2010. Temporal collaborative filtering with Bayesian probabilistic tensor factorization. In SIAM International Conference on Data Mining (SDM). Vol. 10. SIAM, 211-222. DOI:http://dx.doi.org/10.1137/1.9781611972801.19.
145. Tatsuya Yokota, Andrzej Cichocki, and Yukihiko Yamashita. 2012. Linked PARAFAC/CP tensor decomposition and its fast implementation for multi-block tensor analysis. In Neural Information Processing. Springer, 84-91. DOI:http://dx.doi.org/10.1007/978-3-642-34487-911.
146. Fuzheng Zhang, Nicholas Jing Yuan, David Wilkie, Yu Zheng, and Xing Xie. 2015. Sensing the pulse of urban refueling behavior: A perspective from taxi mobility. ACM Transactions on Intelligent Systems and Technology (TIST) 6, 3 (2015), 37. DOI:http://dx.doi.org/10.1145/2644828.
147. Q. Zhao, L. Zhang, and A. Cichocki. 2015. Bayesian CP factorization of incomplete tensors with automatic rank determination. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37 (2015), 1751- 1763. DOI:http://dx.doi.org/10.1109/tpami.2015.2392756.
148. Vincent Wenchen Zheng, Bin Cao, Yu Zheng, Xing Xie, and Qiang Yang. 2010. Collaborative filtering meets mobile recommendation: A user-centered approach. In AAAI International Conference on Artificial Intelligence (AAAI). Vol. 10. 236-241.
149. Vincent W. Zheng, Yu Zheng, Xing Xie, and Qiang Yang. 2012. Towards mobile intelligence: Learning from GPS history data for collaborative recommendation. Artificial Intelligence 184 (2012), 17-37. DOI:http://dx.doi.org/10.1016/j.artint.2012.02.002.
150. Yu Zheng, Tong Liu, Yilun Wang, Yanmin Zhu, Yanchi Liu, and Eric Chang. 2014. Diagnosing New York City's noises with ubiquitous data. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 715-725. DOI:http://dx.doi.org/10.1145/2632048.2632102.