Enhanced line search: A novel method to accelerate parafac

SIAM Journal on Matrix Analysis and Applications

Volumn 30, Issue 3, 2008, Pages 1128-1147

  Rajih, Myriam ^a   Comon, Pierre ^a   Harshman, Richard A ^b  

^a UNIVERSITY OF NICE SOPHIA ANTIPOLIS   (France)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Acceleration; Alternating least squares (ALS); Bottlenecks; Collinear factors; Degeneracy; Enhanced line search (ELS); Line search; PARAFAC; Swamps

Indexed keywords

ALTERNATING LEAST SQUARES (ALS); BOTTLENECKS; COLLINEAR FACTORS; DEGENERACY; ENHANCED LINE SEARCH (ELS); LINE SEARCH; PARAFAC; SWAMPS;

APPROXIMATION THEORY; EXTRAPOLATION; WETLANDS;

LANDING;

EID: 66849099206     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/06065577     Document Type: Article

References (28)

1. C. A. ANDERSSON AND R. BRO, The n-way toolbox for MATLAB, Chemom. Intell. Lab. Syst., 52 (2000), pp. 1-4.
2. R. BRO, Multi-way Analysis in the Food Industry: Models, Algorithms, and Applications, Ph.D. thesis, University of Amsterdam, Amsterdam, The Netherlands, 1998.
3. J. D. CARROLL AND J. J. CHANG, Analysis of individual differences in multidimensional scaling via n-way generalization of Eckart-Young decomposition, Psychometrika, 35 (1970), pp. 283-319.
4. R. B. CATTELL, Parallel proportional profiles and other principles for determining the choice of factors by rotation, Psychometrika, 9 (1944), pp. 267-283.
5. R. B. CATTELL AND A. K. S. CATTELL, Factor rotation for proportional profiles: Analytical solution and an example, British Journal of Statistical Psychology, 8 (1955), pp. 83-92.
6. P. COMON, Blind channel identification and extraction of more sources than sensors, in Proceedings of the SPIE Conference, San Diego, 1998, pp. 2-13. Republished in IEEE Trans. Signal Process, 52 (2004), pp. 11-22.
7. P. COMON AND M. RAJIH, Blind identification of under-determined mixtures based on the characteristic function, in ICASSP'05, vol. IV, Philadelphia, 2005, pp. 1005-1008.
8. A. FRANC, Etude Algébrique des Multitableaux: Apports de I'algèbre Tensorielle, Ph.D. thesis, University of Montpellier II, Montpellier, France, 1992.
9. R. A. HARSHMAN, Foundations of the Parafac procedure: Models and conditions for an explanatory multimodal factor analysis, UCLA Working Papers in Phonetics, 16 (1970), pp. 1-84.
10. R. A. HARSHMAN, Determination and proof of minimum uniqueness conditions for PARAFAC1, UCLA Working Papers in Phonetics, 22 (1972), pp. 111-117.
11. R. A. HARSHMAN, The Problem and Nature of Degenerate Solutions or Decomposition of 3-way Arrays, 2004. Discussion presented at the American Institute of Mathematics Tensor Decompsition Workshop, Palo Alto, CA. Slides available online at http:// publish.uwo.ca/̃harshman.
12. R. A. HARSHMAN, A Note on Several Different Kinds of PARAFAC Degeneracy and Other Ill-Conditioning, 2007, unpublished.
13. R. A. HARSHMAN AND S. HONG, "Stretch" versus "slice" methods for representing three-way structure via matrix notation, J. Chemom., 16 (2002), pp. 198-205.
14. R. A. HARSHMAN AND M. E. LUNDY, The PARAFAC model for three-way factor analysis and multidimensional scaling, in Research Methods for Multimode Data Analysis, H. G. Law, C. W. Snyder, J. Hattie, and R. P. McDonald, eds., Praeger, New York, 1984, pp. 122-215, also available online at http://publish.uwo.ca/̃harshman/lawch5.pdf.
15. R. A. HARSHMAN AND M. E. LUNDY, Conditions governing full and partial Parafac uniqueness when two loading matrices have full column rank, submitted, 2007.
16. J. B. KRUSKAL, Three-way arrays: Rank and uniqueness of trilinear decompositions with applications to arithmetic complexity and statistics, Linear Algebra Appl., 18 (1977), pp. 95-138.
17. J. B. KRUSKAL, Rank, decomposition, and uniqueness for 3-way and n-way arrays, in Multiway Data Analysis, R. Coppi and S. Bolasco, eds., Elsevier Science, North-Holland, 1989, pp. 7-18.
18. L. DE LATHAUWER, Signal Processing Based on Multilinear Algebra, Ph.D. thesis, K. U. Leuven, E. E. Department -ESAT, Belgium, 1997.
19. L. DE LATHAUWER, A link between the canonical decomposition in multilinear algebra and simultaneous matrix diagonalization, SIAM J. Matrix Anal. Appl., 28 (2006), pp. 642-666.
20. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, Computation of the canonical decomposition by means of simultaneous generalized Schur decomposition, SIAM J. Matrix Anal. Appl., 26 (2004), pp. 295-327.
21. S. E. LEURGANS, R. T. ROSS, AND R. B. ABEL, A decomposition for three-way arrays, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 1064-1083.
22. P. PAATERO, The multilinear engine-A table-driven, least squares program for solving multilinear problems, including the n-way parallel factor analysis model, J. Comput. Graph. Statist., 8 (1999), pp. 854-888.
23. W. S. RAYENS AND B. C. MITCHELL, Two-factor degeneracies and a stabilization of PARAFAC, Chemom. Intell. Lab. Syst., 38 (1997), pp. 173-181.
24. R. T. ROSS AND S. LEURGANS, Component resolution using multilinear models, Methods En-zymol., 246 (1995), pp. 679-700.
25. E. SANCHEZ AND B. R. KOWALSKI, Tensorial resolution: A direct trilinear decomposition, J. Chemom., 4 (1990), pp. 29-45.
26. N. D. SIDIROPOULOS AND R. BRO, On the uniqueness of multilinear decomposition of n-way arrays, J. Chemom., 14 (2000), pp. 229-239.
27. A. SMILDE, R. BRO, AND P. GELADI, Multi-way Analysis with Applications in the Chemical Sciences, Wiley, Chichester, UK, 2004.
28. G. TOMASI, Practical and Computational Aspects in Chemometric Data Analysis, Ph.D. thesis, Royal Veterinary and Agricultural University, Frederiksberg, Denmark, 2006.