PARAFAC algorithms for large-scale problems

Neurocomputing

Volumn 74, Issue 11, 2011, Pages 1970-1984

  Huy Phan, Anh ^a   Cichocki, Andrzej ^b  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b SYSTEMS RESEARCH INSTITUTE   (Poland)

Author keywords

Alternating least squares; Canonical polyadic decomposition (CP); Hierarchical ALS; Large scale dataset; Multiway classification; PARAFAC; Parallel computing; Tensor factorization

Indexed keywords

ALTERNATING LEAST SQUARES; CANONICAL POLYADIC DECOMPOSITION (CP); DATA SETS; HIERARCHICAL ALS; MULTI-WAY CLASSIFICATION; PARAFAC; PARALLEL COMPUTING; TENSOR FACTORIZATION;

ALGORITHMS; FACTORIZATION; PARALLEL ARCHITECTURES; TENSORS;

MATRIX ALGEBRA;

ALGORITHM; ARTICLE; CLASSIFICATION; DATA ANALYSIS; ELECTROENCEPHALOGRAM; FACTORIAL ANALYSIS; PARALLEL FACTOR ANALYSIS ALGORITHM; PRIORITY JOURNAL; VALIDITY;

EID: 79955992666     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.06.030     Document Type: Article

References (29)

1. Cichocki A., Zdunek R., Phan A.-H., Amari S. Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation 2009, Wiley, Chichester.
2. Kolda T., Bader B. Tensor decompositions and application. SIAM Review 2009, 51(3):455-500.
3. Sun J., Tao D., Faloutsos C. Beyond streams and graphs: dynamic tensor analysis. Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2006, 374-383.
4. J. Sun, Incremental pattern discovery on streams, graphs and tensors, Ph.D. Thesis, CMU-CS-07-149, 2007.
5. Carroll J., Chang J. Analysis of individual differences in multidimensional scaling via an n-way generalization of Eckart-Young decomposition. Psychometrika 1970, 35(3):283-319.
6. Tomasi G., Bro R. A comparison of algorithms for fitting the PARAFAC model. Computational Statistics and Data Analysis 2006, 50(7):1700-1734.
7. Harshman R. Foundations of the PARAFAC procedure: models and conditions for an explanatory multimodal factor analysis. UCLA Working Papers in Phonetics 1970, 16:1-84.
8. A. Cichocki, A.-H. Phan, Fast local algorithms for large scale nonnegative matrix and tensor factorizations, IEICE 92-A(3) 708-721 (2009) (invited paper).
9. Goreinov S., Tyrtyshnikov E., Zamarashkin N. A theory of pseudo-skeleton approximations. Linear Algebra and Applications 1997, 261:1-21.
10. Phan A.-H., Cichocki A. Multi-way nonnegative tensor factorization using fast hierarchical alternating least squares algorithm (HALS). Proceedings of The 2008 International Symposium on Nonlinear Theory and its Applications, Budapest, Hungary 2008.
11. M. Mørup, L. Hansen, J. Parnas, S. Arnfred, Decomposing the time-frequency representation of EEG using non-negative matrix and multi-way factorization, Technical Report, 2006. URL http://www2.imm.dtu.dk/pubdb/p.php?4144.
12. Daube-Witherspoon M., Muehllehner G. An iterative image space reconstruction algorithm suitable for volume ECT. IEEE Transactions on Medical Imaging 1986, 5:61-66.
13. De Pierro A. On the relation between the ISRA and the EM algorithm for positron emission tomography. IEEE Transactions on Medial Imaging 1993, 12(2):328-333.
14. Lantéri H., Soummmer R., Aime C. Comparison between ISRA and RLA algorithms: use of a Wiener filter based stopping criterion. Astronomy and Astrophysics Supplemantary Series 1999, 140:235-246.
15. Eggermont P., LaRiccia V. Maximum smoothed likelihood density estimation for inverse problems. Annals of Statistics 1995, 23(1):199-220.
16. Lee D., Seung H. Learning of the parts of objects by non-negative matrix factorization. Nature 1999, 401:788-791.
17. Andersson C., Bro R. Improving the speed of multi-way algorithms: part I. Tucker3. Chemometrics Intelligent Laboratory Systems 1998, 42:93-103.
18. R. Bro, Multi-way analysis in the food industry-models, algorithms, and applications, Ph.D. Thesis, University of Amsterdam, Holland, 1998.
19. Rajih M., Comon P. Enhanced line search: a novel method to accelerate PARAFAC. SIAM Journal on Matrix Analysis and Applications 2008, 30(3):1128-1147.
20. Sidiropoulos N., Giannakis G., Bro R. Blind parafac receivers for ds-cdma systems. IEEE Transactions on Signal Processing 2000, 48(3):810-823.
21. D. Nion, L. De Lathauwer, A tensor-based blind ds-cdma receiver using simultaneous matrix diagonalization, in: Proceedings of SPAWC 07, IEEE Workshop on Signal Processing Advances in Wireless Communications, Helsinki, Finland, 2007, URL. http://publi-etis.ensea.fr/2007/ND07.
22. E. Acar, C. Bingol, H. Bingol, R. Bro, B. Yener, Computational analysis of epileptic focus localization, in: Proceedings of The Fourth IASTED International Conference on Biomedical Engineering BioMED2006, Innsbruck, Austria, 2006, pp. 317-322.
23. Yu Y., Petropulu A.P. PARAFAC-based blind estimation of possibly underdetermined convolutive MIMO systems. IEEE Transactions on Signal Processing 2007, 56:111-124.
24. C. Brunner, R. Leeb, G. R. Muller-Putz, A. Schlogl, BCI competition 2008-Graz data set A, 2008.
25. van der Maaten L., Hinton G. Visualizing data using t-sne. Journal of Machine Learning Research 2008, 9:2579-2605.
26. Savas B., Eldén L. Handwritten digit classification using higher order singular value decomposition. Pattern Recognition 2007, 40(3):993-1003. doi: http://dx.doi.org/10.1016/j.patcog.2006.08.004.
27. P. Paatero, A weighted non-negative least squares algorithm for threeway PARAFAC factor analysis, Chemometrics Intelligent Laboratory Systems, vol. 38, no. 2, pp. 223-242, 1997.
28. P. Tichavský, Z. Koldovský, Simultaneous search for all modes in multilinear models, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP10), 2010.
29. Phan A.-H., Cichocki A. Tensor decompositions for feature extraction and classification of high dimensional datasets. Nonlinear Theory and Its Applications, IEICE (invited paper) 2010, 1(1):37-68.