GigaTensor: Scaling tensor analysis up by 100 times - Algorithms and discoveries

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2012, Pages 316-324

  Kang, U ^a   Papalexakis, Evangelos ^a   Harpale, Abhay ^a   Faloutsos, Christos ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

big data; distributed computing; hadoop; mapreduce; tensor

Indexed keywords

ANOMALY DETECTION; BIG DATUM; DATA CENTERS; DATA EXPLOSION; DATA-MINING TOOLS; HADOOP; HYPERLINKS; KNOWLEDGE BASE; KNOWLEDGE BASIS; MAP-REDUCE; MULTIDIMENSIONAL ARRAYS; PETABYTES; SOCIAL NETWORKS; TENSOR ANALYSIS; TENSOR DECOMPOSITION; TREND DETECTION; WEB GRAPHS;

ALGORITHMS; DATA MINING; DISTRIBUTED COMPUTER SYSTEMS; FAULT TOLERANT COMPUTER SYSTEMS; GREENHOUSE GASES; HYPERTEXT SYSTEMS; KNOWLEDGE BASED SYSTEMS;

TENSORS;

EID: 84866052446     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2339530.2339583     Document Type: Conference Paper

References (34)

1. Hadoop information. http://hadoop.apache.org/.
2. E. Acar, C. Aykut-Bingol, H. Bingol, R. Bro, and B. Yener. Multiway analysis of epilepsy tensors. Bioinformatics, 23(13):i10-i18, 2007.
3. C.A. Andersson and R. Bro. The n-way toolbox for matlab. Chemometrics and Intelligent Laboratory Systems, 52(1):1-4, 2000.
4. B. W. Bader and T. G. Kolda. Efficient MATLAB computations with sparse and factored tensors. SIAM Journal on Scientific Computing, 30(1):205-231, December 2007.
5. B.W. Bader, R.A. Harshman, and T.G. Kolda. Temporal analysis of social networks using three-way dedicom. Sandia National Laboratories TR SAND2006-2161, 2006.
6. B.W. Bader and T.G. Kolda. Matlab tensor toolbox version 2.2. Albuquerque, NM, USA: Sandia National Laboratories, 2007.
7. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, New York, NY, USA, 2004.
8. R. Bro. Parafac. tutorial and applications. Chemometrics and intelligent laboratory systems, 38(2):149-171, 1997.
9. A. Carlson, J. Betteridge, B. Kisiel, B. Settles, E. R. Hruschka Jr., and T. M. Mitchell. Toward an architecture for never-ending language learning. In AAAI, 2010.
10. P.A. Chew, B.W. Bader, T.G. Kolda, and A. Abdelali. Cross-language information retrieval using parafac2. In KDD, 2007.
11. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In OSDI, pages 137-150, 2004.
12. S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6):391-407, September 1990.
13. C. Eckart and G. Young. The approximation of one matrix by another of lower rank. Psychometrika, 1(3):211-218, 1936.
14. R.A. Harshman. Foundations of the parafac procedure: Models and conditions for an"explanatory" multimodal factor analysis. 1970.
15. U. Kang, D. H. Chau, and C. Faloutsos. Mining large graphs: Algorithms, inference, and discoveries. In ICDE, pages 243-254, 2011.
16. U. Kang, B. Meeder, and C. Faloutsos. Spectral analysis for billion-scale graphs: Discoveries and implementation. In PAKDD (2), pages 13-25, 2011.
17. U. Kang, H. Tong, J. Sun, C.-Y. Lin, and C. Faloutsos. Gbase: a scalable and general graph management system. In KDD, pages 1091-1099, 2011.
18. U. Kang, C. E. Tsourakakis, and C. Faloutsos. Pegasus: A peta-scale graph mining system. In ICDM, pages 229-238, 2009.
19. J.M. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM, 46(5):604-632, 1999.
20. T.G. Kolda and B.W. Bader. The tophits model for higher-order web link analysis. In Workshop on Link Analysis, Counterterrorism and Security, volume 7, pages 26-29, 2006.
21. T.G. Kolda and B.W. Bader. Tensor decompositions and applications. SIAM review, 51(3), 2009.
22. T.G. Kolda and J. Sun. Scalable tensor decompositions for multi-aspect data mining. In ICDM, 2008.
23. R. Lämmel. Google's mapreduce programming model - revisited. Science of Computer Programming, 70:1-30, 2008.
24. C. Liu, H. c. Yang, J. Fan, L.-W. He, and Y.-M. Wang. Distributed nonnegative matrix factorization for web-scale dyadic data analysis on mapreduce. In WWW, pages 681-690, 2010.
25. K. Maruhashi, F. Guo, and C. Faloutsos. Multiaspectforensics: Pattern mining on large-scale heterogeneous networks with tensor analysis. In ASONAM, 2011.
26. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig latin: a not-so-foreign language for data processing. In SIGMOD '08, pages 1099-1110, 2008.
27. E.E. Papalexakis and N.D. Sidiropoulos. Co-clustering as multilinear decomposition with sparse latent factors. In ICASSP, 2011.
28. R. Penrose. A generalized inverse for matrices. In Proc. Cambridge Philos. Soc, volume 51, pages 406-413. Cambridge Univ Press, 1955.
29. N.D. Sidiropoulos, G.B. Giannakis, and R. Bro. Blind parafac receivers for ds-cdma systems. Signal Processing, IEEE Transactions on, 48(3):810-823, 2000.
30. J. Sun, S. Papadimitriou, and P. S. Yu. Window-based tensor analysis on high-dimensional and multi-aspect streams. In ICDM, pages 1076-1080, 2006.
31. J.T. Sun, H.J. Zeng, H. Liu, Y. Lu, and Z. Chen. Cubesvd: a novel approach to personalized web search. In WWW, 2005.
32. D. Tao, X. Li, X. Wu, W. Hu, and S.J. Maybank. Supervised tensor learning. KAIS, 13(1):1-42, 2007.
33. D. Tao, M. Song, X. Li, J. Shen, J. Sun, X. Wu, C. Faloutsos, and S.J. Maybank. Bayesian tensor approach for 3-d face modeling. IEEE TCSVT, 18(10):1397-1410, 2008.
34. L.R. Tucker. Some mathematical notes on three-mode factor analysis. Psychometrika, 31(3):279-311, 1966.