A further improvement of a fast damped Gauss-Newton algorithm for candecomp-parafac tensor decomposition

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 5964-5968

  Tichavsky, Petr ^a   Phan, Anh Huy ^b   Cichocki, Andrzej ^b  

^a INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

^b RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

canonical polyadic decomposition; damped Gauss Newton algorithm; Multilinear models

Indexed keywords

APPROXIMATE HESSIANS; CANONICAL POLYADIC DECOMPOSITIONS; GAUSS-NEWTON ALGORITHM; MULTILINEAR MODELS; STATE OF THE ART; TENSOR DECOMPOSITION;

ALGORITHMS; GAUSSIAN DISTRIBUTION; SIGNAL PROCESSING;

TENSORS;

EID: 84883806052     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6638809     Document Type: Conference Paper

References (26)

1. C.M. Andersson and R. Bro, "Practical aspects of PARAFAC modelling of fluorescence excitation-emission data," Journal of Chemometrics, vol. 17, pp. 200-215, 2003.
2. R. Bro, Multi-way Analysis in the Food Industry-Mod-els, Algorithms, and Applications, Ph.D. Thesis, Univer-sity of Amsterdam, Holland, 1998.
3. G. Tomasi, Practical and Computational Aspects in Chemometric Data Analysis, Ph.D. Thesis, Frederiks-berg, Denmark, 2006.
4. L. De Lathauwer and J. Castaing, "Tensor-based tech-niques for the blind separation of DS-CDMA signals," Signal Processing, vol. 87, no. 2, pp. 322-336, feb 2007.
5. N.D. Sidiropoulos and R. Bro, "PARAFAC techniques for signal separation," in Signal Processing Advances in Communications, P. Stoica, G. Giannakis, Y. Hua, and L. Tong, Eds., vol. 2, chapter 4. Prentice-Hall, Upper Saddle River, NJ, USA, 2000.
6. M. Mørup, L. K. Hansen, C. S. Herrmann, J. Parnas, and S. M. Arnfred, "Parallel factor analysis as an exploratory tool for wavelet transformed event-related EEG," NeuroImage, vol. 29, no. 3, pp. 938-947, 2006.
7. H. Becker, P. Comon, L. Albera, M. Haardt, and I. Mer-let, "Multi-way space-time-wave-vector analysis for EEG source separation," Signal Processing, vol. 92, no. 4, pp. 1021-1031, 2012.
8. B.W. Bader, M.W. Berry, and M. Browne, "Discussion tracking in Enron email using PARAFAC," in Survey of Text Mining II, M. W. Berry and M. Castellanos, Eds., pp. 147-163. Springer London, 2008.
9. D. M. Dunlavy, T. G. Kolda, and E. Acar, "Temporal link prediction using matrix and tensor factorizations," ACM Transactions on Knowledge Discovery from Data, vol. 5, no. 2, pp. Article 10, 27 pages, February 2011.
10. D. Gonzalez, A. Ammar, F. Chinesta, and E. Cueto, "Recent advances on the use of separated representa-tions," International Journal for Numerical Methods in Engineering, vol. 81, no. 5, pp. 637-659, 2010.
11. A. Shashua and T. Hazan, "Non-negative tensor factor-ization with applications to statistics and computer vi-sion," in Proc. of the 22-th International Conference on Machine Learning (ICML), Bonn, Germany, 2005, pp. 792-799, ICML.
12. I. Ibraghimov, "Application of the three-way decompo-sition for matrix compression," Numerical Linear Al-gebra with Applications, vol. 9, no. 6-7, pp. 551-565, 2002.
13. T.G. Kolda and B.W. Bader, "Tensor decompositions and applications," SIAM Review, vol. 51, no. 3, pp. 455-500, September 2009.
14. A. Cichocki, R. Zdunek, A.H. Phan and S.I. Amari, Nonnegative Matrix and Tensor Factorizations: Appli-cations to Exploratory Multi-way Data Analysis and Blind Source Separation, Wiley, 2009.
15. C. Hayashi and F. Hayashi, "A new algorithm to solve PARAFAC-model," Behaviormetrika, vol. 11, pp. 49-60, 1982.
16. P. Paatero, "Least-squares formulation of robust non-negative factor analysis," Chemometrics and Intelligent Laboratory Systems, vol. 37, pp. 23-35, 1997.
17. G. Tomasi and R. Bro, "A comparison of algorithms for fitting the PARAFAC model", Computational Statistics and Data Analysis, vol. 50, pp. 1700-1734, 2006.
18. A.-H. Phan, P. Tichavsky, and A. Cichocki, "Low com-plexity damped Gauss-Newton algorithms for CAN-DECOMP /PARAFAC," http://arxiv.org/abs/ 1205.2584, SIAM Journal on Linear algebra and Application, ac-cepted for publication.
19. B. C. Mitchell and D. S. Burdick, "Slowly converging PARAFAC sequences: Swamps and two-factor degen-eracies," Journal of Chemometrics, vol. 8, pp. 155168, 1994.
20. P. Paatero, "A weighted non-negative least squares al-gorithm for three-way PARAFAC factor analysis", Chemometrics and Intelligent Laboratory Systems, vol. 38, pp. 223-242, 1997.
21. G. Tomasi, INDAFAC and PARAFAC3W. http://www.models.kvl/dk/source/ indafac/index.asp, 2003.
22. G. Tomasi, "Recent developments in fast algorithms for fitting the PARAFAC model," Greece, 2006, TRICAP.
23. P. Tichavsky, Z. Koldovsky, "Simultaneous search for all modes in multilinear models", Proc. ICASSP 2010, Dallas, TX, March 14-19, 2010, pp. 4114-4117.
24. C. A. Anderson and R. Bro, "The n-way toolbox for MATLAB", Chemometrics and Intelligent Laboratory Systems, vol. 52, pp. 1-4, 2000.
25. K. Madsen, H. B. Nielsen, O. Tingleff, "Methods for nonlinear least squares problems, second ed.", Depart-ment of Mathematical Modelling, Technical University of Denmark, Lyngby, Denmark, 2004.
26. A.-H. Phan, P. Tichavsky, and A. Cichocki, "On fast computation of gradients for CAN-DECOMP/PARAFAC algorithms," CoRR, vol. abs/1204.1586, 2012, submitted for publication.