Automatic relevance determination for multi-way models

Journal of Chemometrics

Volumn 23, Issue 7-8, 2009, Pages 352-363

  Mørupa, Morten ^a   Hansena, Lars Kai ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

Automatic relevance determination; CandeComp PARAFAC; Model order estimation; Tucker

Indexed keywords

AUTOMATIC RELEVANCE DETERMINATION; BAYESIAN FRAMEWORKS; CANDECOMP; CANDECOMP/PARAFAC; MODEL ORDER ESTIMATION; MULTI-WAY MODELING; NUMBER OF COMPONENTS; PARAFAC; SIMPLE++; TUCK;

EID: 70349663945     PISSN: 08869383     EISSN: 1099128X     Source Type: Journal    
DOI: 10.1002/cem.1223     Document Type: Article

References (40)

1. Murakami T, Kroonenberg PM. Three-mode models and individual differences in semantic differential data. Multivariate Behav. Res. 2003; 38(2): 247-283.
2. Nørgaard L, Ridder C. Rank annihilation factor analysis applied to flow injection analysis with photodiode-array detection. Chemom. Intell. Lab. Syst. 1994; 23(1): 107-114.
3. Smilde AK, Tauller R, Saurina J, Bro R. Calibration methods for complex second-order data. Anal. Chim. Acta 1999; 398: 237-251.
4. Vasilescu MAO, Terzopoulos D. Multilinear analysis of image ensembles: tensorfaces. In ECCV'02: Proceedings of the 7th European Conference on Computer Vision-Part I. Springer-Verlag: London, UK, 2002; 447-460.
5. Acar E, Camtepe SA, Krishnamoorthy MS, Yener B. Modeling and multiway analysis of chatroom tensors. Intell. Sec. Inform., LNCS 2005; 3495: 256-268.
6. Omberg L, Golub GH, Alter O. A tensor higher-order singular value decomposition for integrative analysis of dna microarray data from different studies. Proc. Natl Acad. Sci. (PNAS) 2007; 104(47): 18371-18376.
7. Mørup M, Hansen LK, Hermann CS, Parnas J, Arnfred SM. Parallel factor analysis as an exploratory tool for wavelet transformed event-related eeg. NeuroImage 2006; 29(3): 938-947.
8. Andersen AH, Rayens WS. Structure-seeking multilinear methods for the analysis of fmri data. NeuroImage 2004; 22: 728-739.
9. Sidiropoulos ND, Bro R, Giannakis GB. Parallel factor analysis in sensor array processing. IEEE Trans. Signal Process. 2000; 48(8): 2377-2388.
10. Tucker LR. Some mathematical notes on three-mode factor analysis. Psychometrika 1966; 31: 279-311.
11. Carroll JD, Chang JJ. Analysis of individual differences in multidimensional scaling via an N-way generalization of 'Eckart-Young' decomposition. Psychometrika 1970; 35: 283-319.
12. Harshman RA. Foundations of the PARAFAC procedure: models and conditions for an 'explanatory' multi-modal factor analysis. UCLA WPP 1970; 16: 1-84.
13. De Lathauwer L, De Moor B, Vandewalle J. Multilinear singular value decomposition. SIAM J. Matrix Anal. Appl. 2000; 21(4): 1253-1278.
14. Harshman RA, Lundy ME. Data preprocessing and the extended parafac model. In Research Methods for Multimode Data Analysis, Law HG, Snyder CW, Jr, Hattie JA, McDonald RP (eds). Praeger: New York, 1984; 216-281.
15. Kruskal JB. Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics. Linear Algebra Appl. 1977; 18: 95-138.
16. Kiers HAL. Joint orthomax rotation of the core and component matrices resulting from three-mode principal component analysis. J. Classif. 1998; 15: 245-263.
17. Mørup M, Hansen LK, Arnfred SM. Algorithms for sparse non-negative Tucker. Neural Comput. 2008; 20(8): 2112-2131.
18. Timmerman ME, Kiers HAL. Three-mode principal components analysis: choosing the numbers of components and sensitivity to local optima. Br. J. Math. Stat. Psychol. 2000; 53: 1-16.
19. Ceulemans E, Kiers HAL. Selecting among three-mode principal component models of different types and complexities: a numerical convex hull based method. Br. J.Math. Stat. Psychol. 2006; 59(1): 133-150.
20. Schwarz G. Estimating the dimension of a model. Ann. Stat. 1978; 6(2): 461-464.
21. Akaike H. A new look at the statistical model identification. IEEE Trans. Automat. Contr. 1974; 19(6): 716-723.
22. Bro R, Kjeldahl K, Smilde AK, Kiers HAL. Cross-validation of component models: a critical look at current methods. Anal. Bioanal. Chem. 2008; 390(5): 1241-1251.
23. Strother SC, Anderson J, Hansen LK, Kjems U, Kustra R, Sidtis J, Frutiger S, Muley S, LaConte S, Rottenberg D. The quantitative evaluation of functional neuroimaging experiments: the npairs data analysis framework. NeuroImage 2002; 15(4): 747-771.
24. Bro R, Kiers HAL. A new efficient method for determining the number of components in parafac models. J. Chemom. 2003; 17(5): 274-286.
25. de Lathauwer L, de Moor Bart, Vandewalle J. On the best rank-1 and rank-(r1,r2,...,rn) approximation of higher-order tensors. SIAM J. Matrix Anal. Appl. 2000; 21(4): 1324-1342.
26. Kiers HAL, der Kinderen A. A fast method for choosing the numbers of components in tucker3 analysis. Br. J. Math. Stat. Psychol. 2003; 56: 119-125.
27. Mackay DJC. Bayesian interpolation. Neural Comput. 1992; 4: 415-447.
28. Bishop CM. Pattern Recognition and Machine Learning (Information Science and Statistics). Springer: New York, NY, USA, 2006.
29. (Alan) Qi Y, Minka TP, Picard RW, Ghahramani Z. Predictive automatic relevance determination by expectation propagation. In ICML'04: Proceedings of the 21st International Conference on Machine Learning. ACM: New York, NY, USA, 2004; 85.
30. Donoho D. For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution. Commun. Pure Appl. Math. 2006; 59(6): 797-829.
31. Kaiser HF. The varimax criterion for analytic rotation in factor analysis. Psychometrica 1958; 23: 187-200.
32. Mørup M. Decomposition methods for unsupervised learning. PhD Thesis, Technical University of Denmark, 2008.
33. Andersson CA, Bro R. Improving the speed of multi-way algorithms: part I. Tucker3. Chemom. Intell. Lab. Syst. 1998; 42: 93-103.
34. Kolda TG, Bader BW. Tensor decompositions and applications. SIAM Rev., 2008 (in press).
35. Tibbing ME. Sparse bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 2001; 1: 211-244.
36. Hansen LK, Madsen KH, Lehn-Schiøler T. Adaptive regularization of noisy linear inverse problems. In Proceedings of Eusipco 2006, 2006.
37. Bro R. Parafac: tutorial and applications. Chemom. Intell. Lab. Syst. 1997; 38: 149-171.
38. Bro R. Exploratory study of sugar production using fluorescence spectroscopy and multi-way analysis. Chemom. Intell. Lab. Syst. 1999; 46: 133-147.
39. Riu J, Bro R. Jack-knife estimation of standard errors and outlier detection in parafac models. Chemom. Intell. Lab. Syst. 2003; 65(1): 35-49.
40. Beal MJ. Variational algorithms for approximate bayesian inference. PhD Thesis, University of London, 2003.