메뉴 건너뛰기




Volumn 61, Issue 19, 2013, Pages 4834-4846

Fast alternating LS algorithms for high order CANDECOMP/PARAFAC tensor factorizations

Author keywords

ALS; CANDECOMP PARAFAC (CP); Canonical decomposition; Gradient; Tensor factorization

Indexed keywords

ALS; CANDECOMP/PARAFAC; CANONICAL DECOMPOSITION; HIGHER-ORDER TENSOR; KHATRI-RAO PRODUCTS; MEMORY REQUIREMENTS; SEPARATED REPRESENTATION; TENSOR FACTORIZATION;

EID: 84883782927     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2013.2269903     Document Type: Article
Times cited : (149)

References (52)
  • 1
    • 0002740437 scopus 로고
    • Foundations of the PARAFAC procedure: Models and conditions for an explanatory multimodal factor analysis
    • R. A. Harshman, "Foundations of the PARAFAC procedure: Models and conditions for an explanatory multimodal factor analysis," UCLA Working Papers in Phonet. , vol. 16, pp. 1-84, 1970
    • (1970) UCLA Working Papers in Phonet , vol.16 , pp. 1-84
    • Harshman, R.A.1
  • 2
    • 34250499792 scopus 로고
    • Analysis of individual differences in multidimensional scaling via an -way generalization of Eckart-Young decomposition
    • J. D. Carroll and J. J. Chang, "Analysis of individual differences in multidimensional scaling via an -way generalization of Eckart-Young decomposition," Psychometrika, vol. 35, no. 3, pp. 283-319, 1970
    • (1970) Psychometrika , vol.35 , Issue.3 , pp. 283-319
    • Carroll, J.D.1    Chang, J.J.2
  • 3
    • 0038218259 scopus 로고    scopus 로고
    • Practical aspects of PARAFAC modelling of fluorescence excitation-emission data
    • C. M. Andersson and R. Bro, "Practical aspects of PARAFAC modelling of fluorescence excitation-emission data," J. Chemometr., vol. 17, pp. 200-215, 2003
    • (2003) J. Chemometr , vol.17 , pp. 200-215
    • Andersson, C.M.1    Bro, R.2
  • 4
    • 33750178584 scopus 로고    scopus 로고
    • Tensor-based techniques for the blind separation of DS-CDMA signals
    • DOI 10.1016/j.sigpro.2005.12.015, PII S0165168406001745
    • L. De Lathauwer and J. Castaing, "Tensor-based techniques for the blind separation of DS-CDMA signals," Signal Process., vol. 87, no. 2, pp. 322-336, Feb. 2007 (Pubitemid 44602255)
    • (2007) Signal Processing , vol.87 , Issue.2 , pp. 322-336
    • De Lathauwer, L.1    Castaing, J.2
  • 5
    • 0003374296 scopus 로고    scopus 로고
    • PARAFAC techniques for signal separation
    • P. Stoica, G. Giannakis, Y. Hua, and L. Tong, Eds. Upper Saddle River, NJ, USA Prentice-Hall, ch. 4
    • N. D. Sidiropoulos and R. Bro, "PARAFAC techniques for signal separation," in Signal Processing Advances in Communications, P. Stoica, G. Giannakis, Y. Hua, and L. Tong, Eds. Upper Saddle River, NJ, USA: Prentice-Hall, 2000, vol. 2, ch. 4
    • (2000) Signal Processing Advances in Communications , vol.2
    • Sidiropoulos, N.D.1    Bro, R.2
  • 6
    • 0026000010 scopus 로고
    • Topographic component (Parallel Factor) analysis of multichannel evoked potentials: Practical issues in trilinear spatiotemporal decomposition
    • A. S. Field and D. Graupe, "Topographic component (Parallel Factor) analysis of multichannel evoked potentials: Practical issues in trilinear spatiotemporal decomposition," Brain Topogr., vol. 3, no. 4, pp. 407-423, 1991
    • (1991) Brain Topogr , vol.3 , Issue.4 , pp. 407-423
    • Field, A.S.1    Graupe, D.2
  • 7
    • 31044456392 scopus 로고    scopus 로고
    • Parallel Factor Analysis as an exploratory tool for wavelet transformed event-related EEG
    • DOI 10.1016/j.neuroimage.2005.08.005, PII S1053811905005896
    • M. Morup, L. K. Hansen, C. S. Herrmann, J. Parnas, and S. M. Arnfred, "Parallel factor analysis as an exploratory tool for wavelet transformed event-related EEG," NeuroImage, vol. 29, no. 3, pp. 938-947, 2006 (Pubitemid 43121218)
    • (2006) NeuroImage , vol.29 , Issue.3 , pp. 938-947
    • Morup, M.1    Hansen, L.K.2    Herrmann, C.S.3    Parnas, J.4    Arnfred, S.M.5
  • 9
    • 84883779264 scopus 로고    scopus 로고
    • A surrogate accelerated Bayesian inverse analysis of the HyShot II supersonic combustion data
    • Iaccarino Center For Turbulent Research G.
    • P. Constantine, A. Doostan, Q.Wang, and G. Iaccarino, Center for Turbulent Research, "A surrogate accelerated Bayesian inverse analysis of the HyShot II supersonic combustion data," in Proc. Summer Program, 2010, AIAA-2011-2037
    • (2010) Proc. Summer Program , pp. 2011-2037
    • Constantine, P.1    Doostan, A.2    Wang, Q.3
  • 10
    • 36248941211 scopus 로고    scopus 로고
    • Tensor-product approximation to operators and functions in high dimensions
    • DOI 10.1016/j.jco.2007.03.007, PII S0885064X07000532
    • W. Hackbusch and B. N. Khoromskij, "Tensor-product approximation to operators and functions in high dimensions," J. Complex., vol. 23, no. 4-6, pp. 697-714, 2007 (Pubitemid 350122963)
    • (2007) Journal of Complexity , vol.23 , Issue.4-6 , pp. 697-714
    • Hackbusch, W.1    Khoromskij, B.N.2
  • 11
    • 83955162378 scopus 로고    scopus 로고
    • Multi-way space-time-wave-vector analysis for EEG source separation
    • H. Becker, P. Comon, L. Albera, M. Haardt, and I. Merlet, "Multi-way space-time-wave-vector analysis for EEG source separation," Signal Process., vol. 92, no. 4, pp. 1021-1031, 2012
    • (2012) Signal Process , vol.92 , Issue.4 , pp. 1021-1031
    • Becker, H.1    Comon, P.2    Albera, L.3    Haardt, M.4    Merlet, I.5
  • 12
    • 84892000258 scopus 로고    scopus 로고
    • Discussion tracking in Enron email using PARAFAC
    • M. W. Berry and M. Castellanos, Eds. London, U.K. Springer
    • B. W. Bader, M. W. Berry, and M. Browne, "Discussion tracking in Enron email using PARAFAC," in Survey of Text Mining II, M. W. Berry and M. Castellanos, Eds. London, U.K.: Springer, 2008, pp. 147-163
    • (2008) Survey of Text Mining II , pp. 147-163
    • Bader, B.W.1    Berry, M.W.2    Browne, M.3
  • 13
    • 79952552980 scopus 로고    scopus 로고
    • Temporal link prediction using matrix and tensor factorizations
    • Feb, Article 10, 27 pages
    • D. M. Dunlavy, T. G. Kolda, and E. Acar, "Temporal link prediction using matrix and tensor factorizations," ACM Trans. Knowl. Discov. Data, vol. 5, no. 2, Feb. 2011, pp. Article 10, 27 pages
    • (2011) ACM Trans. Knowl. Discov. Data , vol.5 , Issue.2
    • Dunlavy, D.M.1    Kolda, T.G.2    Acar, E.3
  • 15
    • 74349124379 scopus 로고    scopus 로고
    • Recent advances on the use of separated representations
    • D. González, A. Ammar, F. Chinesta, and E. Cueto, "Recent advances on the use of separated representations," Int. J. Numer. Methods Eng., vol. 81, no. 5, pp. 637-659, 2010
    • (2010) Int. J. Numer. Methods Eng , vol.81 , Issue.5 , pp. 637-659
    • González, D.1    Ammar, A.2    Chinesta, F.3    Cueto, E.4
  • 16
    • 0002317063 scopus 로고
    • PARAFAC2: Mathematical and technical notes
    • R. A. Harshman, "PARAFAC2: Mathematical and technical notes," UCLA Working Papers in Phonet., vol. 22, pp. 30-44, 1972
    • (1972) UCLA Working Papers in Phonet , vol.22 , pp. 30-44
    • Harshman, R.A.1
  • 17
    • 48749101457 scopus 로고
    • Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics
    • J. B. Kruskal, "Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics," Linear Algebra and Its Appl., vol. 18, no. 2, pp. 95-138, 1977
    • (1977) Linear Algebra and Its Appl , vol.18 , Issue.2 , pp. 95-138
    • Kruskal, J.B.1
  • 18
    • 0033653594 scopus 로고    scopus 로고
    • On the uniqueness of multilinear decomposition of N-way arrays
    • N. D. Sidiropoulos and R. Bro, "On the uniqueness of multilinear decomposition of N-way arrays," J. Chemometr., vol. 14, no. 3, pp. 229-239, 2000
    • (2000) J. Chemometr , vol.14 , Issue.3 , pp. 229-239
    • Sidiropoulos, N.D.1    Bro, R.2
  • 20
    • 66849099206 scopus 로고    scopus 로고
    • Enhanced line search: A novel method to accelerate PARAFAC
    • M. Rajih, P. Comon, and R. A. Harshman, "Enhanced line search: A novel method to accelerate PARAFAC," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1128-1147, 2008
    • (2008) SIAM J. Matrix Anal. Appl , vol.30 , Issue.3 , pp. 1128-1147
    • Rajih, M.1    Comon, P.2    Harshman, R.A.3
  • 21
    • 34249278670 scopus 로고    scopus 로고
    • Ph.D. thesis Food Science, Quality and Technol., The Royal Veterinary and Agricultural Univ., Frederiksberg, Denmark
    • G. Tomasi, "Practical and computational aspects in chemometric data analysis," Ph.D. thesis, Food Science, Quality and Technol., The Royal Veterinary and Agricultural Univ., Frederiksberg, Denmark, 2006
    • (2006) Practical and Computational Aspects in Chemometric Data Analysis
    • Tomasi, G.1
  • 22
    • 81455128183 scopus 로고    scopus 로고
    • New ALS methods with extrapolating search directions and optimal step size for complex-valued tensor decompositions
    • Y. Chen, D. Han, and L. Qi, "New ALS methods with extrapolating search directions and optimal step size for complex-valued tensor decompositions," IEEE Trans. Signal Process., vol. 59, no. 12, pp. 5888-5898, 2011
    • (2011) IEEE Trans. Signal Process , vol.59 , Issue.12 , pp. 5888-5898
    • Chen, Y.1    Han, D.2    Qi, L.3
  • 23
    • 0000925933 scopus 로고    scopus 로고
    • A three-step algorithm for CANDECOMP/PARAFAC analysis of large data sets with multicollinearity
    • H. A. L. Kiers, "A three-step algorithm for CANDECOMP/PARAFAC analysis of large data sets with multicollinearity," J. Chemometr., vol. 12, no. 3, pp. 155-171, 1998 (Pubitemid 128478959)
    • (1998) Journal of Chemometrics , vol.12 , Issue.3 , pp. 155-171
    • Kiers, H.A.L.1
  • 24
    • 79951898361 scopus 로고    scopus 로고
    • A scalable optimization approach for fitting canonical tensor decompositions
    • Feb
    • E. Acar, D. M. Dunlavy, and T. G. Kolda, "A scalable optimization approach for fitting canonical tensor decompositions," J. Chemometr., vol. 25, no. 2, pp. 67-86, Feb. 2011
    • (2011) J. Chemometr , vol.25 , Issue.2 , pp. 67-86
    • Acar, E.1    Dunlavy, D.M.2    Kolda, T.G.3
  • 26
    • 0030775193 scopus 로고    scopus 로고
    • A weighted non-negative least squares algorithm for three-way 'PARAFAC' factor analysis
    • DOI 10.1016/S0169-7439(97)00031-2, PII S0169743997000312
    • P. Paatero, "A weighted non-negative least squares algorithm for three-way PARAFAC factor analysis," Chemometr. Intell. Lab. Syst., vol. 38, no. 2, pp. 223-242, 1997 (Pubitemid 27512497)
    • (1997) Chemometrics and Intelligent Laboratory Systems , vol.38 , Issue.2 , pp. 223-242
    • Paatero, P.1
  • 28
    • 84875661105 scopus 로고    scopus 로고
    • Low complexity damped Gauss-Newton algorithms for CANDECOMP/PARAFAC
    • A.-H. Phan, P. Tichavský, and A. Cichocki, "Low complexity damped Gauss-Newton algorithms for CANDECOMP/PARAFAC," SIAM J. Matrix Anal. Appl., vol. 34, no. 1, pp. 126-147, 2013
    • (2013) SIAM J. Matrix Anal. Appl , vol.34 , Issue.1 , pp. 126-147
    • Phan, A.-H.1    Tichavský, P.2    Cichocki, A.3
  • 29
    • 80051650265 scopus 로고    scopus 로고
    • Fast damped Gauss-Newton algorithm for sparse and nonnegative tensor factorization
    • Speech, Signal Process. (ICASSP)
    • A.-H. Phan, P. Tichavský, and A. Cichocki, "Fast damped Gauss-Newton algorithm for sparse and nonnegative tensor factorization," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2011, pp. 1988-1991
    • (2011) Proc IEEE Int. Conf. Acoust , pp. 1988-1991
    • Phan, A.-H.1    Tichavský, P.2    Cichocki, A.3
  • 30
    • 33746356349 scopus 로고    scopus 로고
    • A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization
    • DOI 10.1137/040608830
    • L. De Lathauwer, "A link between the canonical decomposition inmultilinear algebra and simultaneousmatrix diagonalization," SIAMJ. Matrix Anal. Appl., vol. 28, pp. 642-666, 2006 (Pubitemid 47109355)
    • (2006) SIAM Journal on Matrix Analysis and Applications , vol.28 , Issue.3 , pp. 642-666
    • De Lathauwer, L.1
  • 32
    • 40749124427 scopus 로고    scopus 로고
    • Blind identification of underdetermined mixtures by simultaneous matrix diagonalization
    • DOI 10.1109/TSP.2007.908929
    • L. De Lathauwer and J. Castaing, "Blind identification of underdetermined mixtures by simultaneous matrix diagonalization," IEEE Trans. Signal Process., vol. 56, no. 3, pp. 1096-1105, 2008 (Pubitemid 351386270)
    • (2008) IEEE Transactions on Signal Processing , vol.56 , Issue.3 , pp. 1096-1105
    • De Lathauwer, L.1    Castaing, J.2
  • 33
    • 49749096526 scopus 로고    scopus 로고
    • Efficient MATLAB computations with sparse and factored tensors
    • B. W. Bader and T. G. Kolda, "Efficient MATLAB computations with sparse and factored tensors," SIAM J. Scientif. Comput., vol. 30, pp. 205-231, 2007
    • (2007) SIAM J. Scientif. Comput , vol.30 , pp. 205-231
    • Bader, B.W.1    Kolda, T.G.2
  • 35
    • 33845525246 scopus 로고    scopus 로고
    • Algorithm 862: MATLAB tensor classes for fast algorithm prototyping
    • DOI 10.1145/1186785.1186794
    • B. W. Bader and T. G. Kolda, "Algorithm 862: MATLAB tensor classes for fast algorithm prototyping," ACM Trans. Math. Software, vol. 32, no. 4, pp. 635-653, 2006 (Pubitemid 44927149)
    • (2006) ACM Transactions on Mathematical Software , vol.32 , Issue.4 , pp. 635-653
    • Bader, B.W.1    Kolda, T.G.2
  • 36
    • 84883786549 scopus 로고    scopus 로고
    • Recent developments in fast algorithms for fitting the PARAFAC model
    • G. Tomasi, "Recent developments in fast algorithms for fitting the PARAFAC model," in Proc. TRICAP, Crete, Greece, 2006 [Online]. Available: http://www.telecom.tuc.gr/nikos/TRICAP2006main/TomasiTRICAP2006. ppt
    • (2006) Proc. TRICAP, Crete, Greece
    • Tomasi, G.1
  • 37
    • 76849084705 scopus 로고    scopus 로고
    • PLS Toolbox
    • Eigenvector Research, Inc., PLS Toolbox [Online]. Available: http:// www.eigenvector.com/software/-pls-toolbox.htm 2012
    • Eigenvector Research, Inc
  • 39
    • 68649096448 scopus 로고    scopus 로고
    • Tensor decompositions and applications
    • Sep
    • T. G. Kolda and B. W. Bader, "Tensor decompositions and applications," SIAM Rev., vol. 51, no. 3, pp. 455-500, Sep. 2009
    • (2009) SIAM Rev , vol.51 , Issue.3 , pp. 455-500
    • Kolda, T.G.1    Bader, B.W.2
  • 41
    • 85162707890 scopus 로고
    • The expression of a tensor or a polyadic as a sum of products
    • F. L. Hitchcock, "The expression of a tensor or a polyadic as a sum of products," J. Math. Phys., vol. 6, pp. 164-189, 1927
    • (1927) J. Math. Phys , vol.6 , pp. 164-189
    • Hitchcock, F.L.1
  • 43
    • 84875651157 scopus 로고    scopus 로고
    • Cramér-Rao-induced bounds for CANDECOMP/PARAFAC tensor decomposition
    • P. Tichavský, A.-H. Phan, and Z. Koldovský, "Cramér-Rao-induced bounds for CANDECOMP/PARAFAC tensor decomposition," IEEE Trans. Signal Process., vol. 61, no. 8, pp. 1986-1997, 2013
    • (2013) IEEE Trans. Signal Process , vol.61 , Issue.8 , pp. 1986-1997
    • Tichavský, P.1    Phan, A.-H.2    Koldovský, Z.3
  • 44
    • 84883806052 scopus 로고    scopus 로고
    • A further improvement of a fast damped GAUSS-NEWTON algorithm for CANDECOMPPARAFAC tensor decomposition
    • Speech, Signal Process. (ICASSP)
    • P. Tichavský, A.-H. Phan, and A. Cichocki, "A further improvement of a fast damped GAUSS-NEWTON algorithm for CANDECOMPPARAFAC tensor decomposition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2013, pp. 5964-5968
    • (2013) Proc IEEE Int. Conf. Acoust , pp. 5964-5968
    • Tichavský, P.1    Phan, A.-H.2    Cichocki, A.3
  • 45
    • 33947514540 scopus 로고    scopus 로고
    • ERPWAVELAB a toolbox for multi-channel analysis of time-frequency transformed event related potentials
    • M. Morup, L. K. Hansen, and S. M. Arnfred, "ERPWAVELAB a toolbox for multi-channel analysis of time-frequency transformed event related potentials," J. Neurosci. Methods, vol. 161, no. 2, pp. 361-368, 2006
    • (2006) J. Neurosci. Methods , vol.161 , Issue.2 , pp. 361-368
    • Morup, M.1    Hansen, L.K.2    Arnfred, S.M.3
  • 46
    • 79955473170 scopus 로고    scopus 로고
    • Iterative methods for the canonical decomposition of multi-way arrays: Application to blind underdetermined mixture identification
    • A. Karfoul, L. Albera, and L. De Lathauwer, "Iterative methods for the canonical decomposition of multi-way arrays: Application to blind underdetermined mixture identification," Signal Process., vol. 91, no. 8, pp. 1789-1802, 2011
    • (2011) Signal Process , vol.91 , Issue.8 , pp. 1789-1802
    • Karfoul, A.1    Albera, L.2    De Lathauwer, L.3
  • 47
    • 84882471720 scopus 로고    scopus 로고
    • 2.22-Multilinear models: Iterative methods
    • S. Brown, R. Tauler, and B. Walczak, Eds. Oxford, U.K Elsevier
    • G. Tomasi and R. Bro, "2.22-Multilinear models: Iterative methods," in Comprehensive Chemometrics: Chemical and Biochemical Data Analysis, S. Brown, R. Tauler, and B. Walczak, Eds. Oxford, U.K.: Elsevier, 2009, pp. 411-451
    • (2009) Comprehensive Chemometrics: Chemical and Biochemical Data Analysis , pp. 411-451
    • Tomasi, G.1    Bro, R.2
  • 48
    • 74449093261 scopus 로고    scopus 로고
    • Fast local algorithms for large scale nonnegativematrix and tensor factorizations
    • A. Cichocki and A.-H. Phan, "Fast local algorithms for large scale nonnegativematrix and tensor factorizations," IEICE Trans., vol. 92-A, no. 3, pp. 708-721, 2009
    • (2009) IEICE Trans , vol.92 , Issue.3 , pp. 708-721
    • Cichocki, A.1    Phan, A.-H.2
  • 49
    • 70449371517 scopus 로고    scopus 로고
    • On the tensor SVD and the optimal low rank orthogonal approximation of tensors
    • Jan
    • J. Chen and Y. Saad, "On the tensor SVD and the optimal low rank orthogonal approximation of tensors," SIAM J.Matrix Anal. Appl., vol. 30, no. 4, pp. 1709-1734, Jan. 2009
    • (2009) SIAM J.Matrix Anal. Appl , vol.30 , Issue.4 , pp. 1709-1734
    • Chen, J.1    Saad, Y.2
  • 50
    • 0029945198 scopus 로고    scopus 로고
    • Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human
    • C. Tallon-Baudry, O. Bertrand, C. Delpuech, and J. Pernier, "Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human," J. Neurosci., vol. 16, no. 13, pp. 4240-4249, 1996 (Pubitemid 26192419)
    • (1996) Journal of Neuroscience , vol.16 , Issue.13 , pp. 4240-4249
    • Tallon-Baudry, C.1    Bertrand, O.2    Delpuech, C.3    Pernier, J.4
  • 51
    • 78751515806 scopus 로고    scopus 로고
    • Tensor decompositions for feature extraction and classification of high dimensional datasets
    • (invited paper)
    • A.-H. Phan and A. Cichocki, "Tensor decompositions for feature extraction and classification of high dimensional datasets," IEICE Nonlin. Theory and Its Appl., vol. 1, pp. 37-68, 2010, (invited paper)
    • (2010) IEICE Nonlin. Theory and Its Appl , vol.1 , pp. 37-68
    • Phan, A.-H.1    Cichocki, A.2


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.