Multivariate multilinear regression

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 6, 2012, Pages 1560-1573

  Su, Ya ^a   Gao, Xinbo ^b   Li, Xuelong ^c   Tao, Dacheng ^d  

^a TSINGHUA UNIVERSITY   (China)

^b XIDIAN UNIVERSITY   (China)

^c INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^d UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Active appearance model (AAM); multivariate linear regression (MLR); principal component regression (PCR); under sample problem (USP)

Indexed keywords

ACTIVE APPEARANCE MODELS; ALTERNATIVE PROJECTION; CLOSED FORM SOLUTIONS; COMPUTATIONAL COSTS; DATA SETS; FEATURE SPACE; FITTING PROCEDURE; IN-DEPTH INVESTIGATION; MULTI-LINEAR REGRESSION; MULTIVARIATE LINEAR REGRESSIONS; PRINCIPAL COMPONENT REGRESSION; PRINCIPAL COMPONENTS; REGRESSION COEFFICIENT; REGRESSION MATRICES; REGRESSION METHOD; REGRESSION PROBLEM; SAMPLE SIZES; SELECTION PROBLEMS; TRAINING SAMPLE; UNDER SAMPLE PROBLEM (USP);

IMAGE RECOGNITION; REGRESSION ANALYSIS;

PRINCIPAL COMPONENT ANALYSIS;

EID: 84869863663     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2195171     Document Type: Article

References (56)

1. Signal-to-Noise Ratio. [Online]. Available: http://en.wikipedia.org/wiki/ Signal-to-noise-ratio
2. E. Acar and B. Yener, "Unsupervised multiway data analysis: A literature survey," IEEE Trans. Knowl. Data Eng., vol. 21, no. 1, pp. 6-20, Jan. 2009.
3. C. M. Bishop, Pattern Recognition and Machine Learning. Berlin, Germany: Springer-Verlag, 2007.
4. R. Bro, "Exploratory study of sugar production using fluorescence spectroscopy and multi-way analysis," Chemometrics Intell. Lab. Syst., vol. 46, no. 2, pp. 133-147, Mar. 1999.
5. R. Bro, "Multiway calibration. Multilinear Pls," J. Chemometrics, vol. 10, no. 1, pp. 47-61, Jan./Feb. 1996.
6. T. Ching-Ting and J. J. J. Lien, "Automatic location of facial feature points and synthesis of facial sketches using direct combined model," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1158-1169, Aug. 2010.
7. F. Conditions and A. H. Richard, "Foundations of the Parafac procedure: Models and conditions for an 'Explanatory' multi-modal factor analysis," UCLA Working Papers Phonetics, vol. 16, no. 1, pp. 1-84, 2009.
8. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," in Proc. Eur. Conf. Comput. Vis., 1998, vol. 2, pp. 484-498.
9. T. F. Cootes and C. J. Taylor, "On representing edge structure for model matching," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2001, vol. 1, pp. 1114-1119.
10. L. De Lathauwer, "Signal processing based on multilinear algebra," Ph.D. dissertation, Katholike Universiteit Leuven, Leuven, Belgium, 1997.
11. U. Depczynski, V. J. Frost, and K. Molt, "Genetic algorithms applied to the selection of factors in principal component regression," Analytica Chimica Acta, vol. 420, no. 2, pp. 217-227, Sep. 2000.
12. F. Dornaika and J. Ahlberg, "Fast and reliable active appearance model search for 3-D face tracking," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 4, pp. 1838-1853, Aug. 2004.
13. N. Draper, H. Smith, and E. Pownell, Applied Regression Analysis, New York: Wiley, vol. 706, 1998.
14. X. Gao, Y. Su, X. Li, and D. Tao, "A review of active appearance models," IEEE Trans. Syst.,Man, Cybern. C, Appl. Rev., vol. 40, no. 2, pp. 145-158, Mar. 2010.
15. X. Gao, Y. Yang, D. Tao, and X. Li, "Discriminative optical flow tensor for video semantic analysis," Comput. Vis. Image Understand., vol. 113, no. 3, pp. 372-383, Mar. 2009.
16. S. P. Gurden, J. A. Westerhuis, R. Bro, and A. K. Smilde, "A comparison of multiway regression and scaling methods," Chemometrics Intell. Lab. Syst., vol. 59, no. 1/2, pp. 121-136, Nov. 2001.
17. I. T. Jolliffe, "A note on the use of principal components in regression," J. Roy. Statist. Soc. C, Appl. Statist., vol. 31, no. 3, pp. 300-303, 1982.
18. P. Kittipanya-ngam and T. F. Cootes, "The effect of texture representations on AAM performance," in Proc. Int. Conf. Pattern Recog., 2006, vol. 2, pp. 328-331.
19. D. Kleinbaum, L. Kupper, and K. Muller, "Applied Regression Analysis and Other Multivariable Methods," Florence, KY: Duxbury Pr, 2007.
20. T. G. Kolda and B. W. Bader, "Tensor decompositions and applications," SIAM Rev., vol. 51, no. 3, pp. 455-500, Aug. 2009.
21. P. M. Kroonenberg, Three-Mode Principal Component Analysis: Theory and Applications. Leiden, The Netherlands: DWSO Press, 1983.
22. X. Li, S. Lin, S. Yan, and D. Xu, "Discriminant locally linear embedding with high-order tensor data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 2, pp. 342-352, Apr. 2008.
23. K. Liu, Y.-Q. Cheng, and J.-Y. Yang, "Algebraic feature extraction for image recognition based on an optimal discriminant criterion," Pattern Recog., vol. 26, no. 6, pp. 903-911, Jun. 1993.
24. H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "MPCA: Multilinear principal component analysis of tensor objects," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 18-39, Jan. 2008.
25. H. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Multilinear principal component analysis of tensor objects for recognition," in Proc. Int. Conf. Pattern Recog., 2006, vol. 2, pp. 776-779.
26. P. Lucey, J. F. Cohn, I. Matthews, S. Lucey, S. Sridharan, J. Howlett, and K. M. Prkachin, "Automatically detecting pain in video through facial action units," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 3, pp. 664-674, Jun. 2011.
27. B. Mertens, T. Fearn, andM. Thompson, "The efficient cross-validation of principal components applied to principal component regression," Statist. Comput., vol. 5, no. 3, pp. 227-235, 1995.
28. K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre, Xm2vtsdb: The Extended M2vts Database. [Online]. Available: http://www.ee. surrey. ac.uk/CVSSP/xm2vtsdb/
29. Y. Mu, D. Tao, X. Li, and F. Murtagh, "Biologically inspired tensor features," Cognit. Comput., vol. 1, no. 4, pp. 327-341, 2009.
30. J. Nilsson, S. de Jong, and A. K. Smilde, "Multiway calibration in 3D QSAR," J. Chemometrics, vol. 11, no. 6, pp. 511-524, Nov./Dec. 1997.
31. M. M. Nordstrøm, M. Larsen, J. Sierakowski, and M. B. Stegmann, "The Imm Face Database - An Annotated Dataset of 240 Face Images," . [Online]. Available: http://www2.imm.dtu.dk/pubdb/views/ publication-details. php?id=3160
32. P. Sanguansat, W. Asdornwised, S. Jitapunkul, and S. Marukatat, "Twodimensional linear discriminant analysis of principle component vectors for face recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2006, vol. 2, pp. 2164-2170.
33. I. M. Scott, T. F. Cootes, and C. J. Taylor, "Improving appearance model matching using local image structure," in Proc. Int. Conf. Inf. Process. Med. Imag., 2003, pp. 258-269.
34. A. Shashua and A. Levin, "Linear image coding for regression and classification using the tensor-rank principle," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2001, vol. 1, pp. 42-49.
35. A. K. Smilde and H. A. L. Kiers, "Multiway covariates regression models," J. Chemometrics, vol. 13, no. 1, pp. 31-48, Jan./Feb. 1999.
36. A. K. Smilde, J. A. Westerhuis, and R. Boqué, "Multiway multiblock component and covariates regression models," J. Chemometrics, vol. 14, no. 3, pp. 301-331, May/Jun. 2000.
37. M. B. Stegmann, "Active appearance models: Theory, extensions & cases," M.S. thesis, Technical University of Denmark, Kongens Lyngby, Denmark, 2000.
38. M. B. Stegmann and R. Larsen, "Multi-band modelling of appearance," Image Vis. Comput., vol. 21, no. 1, pp. 61-67, Jan. 2003.
39. Y. Su, D. Tao, X. Li, and X. Gao, "Texture representation in Aam using gabor wavelet and local binary patterns," in Proc. IEEE Int. Conf. Syst., Man Cybern., 2009, pp. 3274-3279.
40. J. Sun, "A correlation principal component regression analysis of NIR data," J. Chemometrics, vol. 9, no. 1, pp. 21-29, Jan./Feb. 1995.
41. J. Sun, D. Tao, S. Papadimitriou, P. S. Yu, and C. Faloutsos, "Incremental tensor analysis: Theory and applications," ACM Trans. Knowl. Discovery Data, vol. 2, no. 3, pp. 1-37, Oct. 2008.
42. D. Tao, X. Li, X. Wu, W. Hu, and S. Maybank, "Supervised tensor learning," Knowl. Inf. Syst., vol. 13, no. 1, pp. 1-42, 2007.
43. D. Tao, X. Li, X. Wu, and S. Maybank, "Tensor rank one discriminant analysis - A convergent method for discriminative multilinear subspace selection," Neurocomputing, vol. 71, no. 10-12, pp. 1866-1882, Jun. 2008.
44. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and Gabor features for Gait recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
45. D. Tao, M. Song, X. Li, J. Shen, J. Sun, X. Wu, F. C., and S. J. Maybank, "Bayesian tensor approach for 3-D face modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 10, pp. 1397-1410, Oct. 2008.
46. D. Tao, J. Sun, J. Shen, X. Wu, X. Li, S. J. Maybank, and C. Faloutsos, "Bayesian tensor analysis," in Proc. IEEE Int. Joint Conf. Neural Netw., 2008, pp. 1402-1409.
47. D. Tao, J. Sun, X. Wu, X. Li, J. Shen, S. J. Maybank, and C. Faloutsos, "Probabilistic tensor analysis with Akaike and Bayesian information criteria," in Proc. Int. Conf. Neural Inf. Process., 2008, pp. 791-801.
48. L. Tucker, "Some mathematical notes on three-mode factor analysis," Psychometrika, vol. 31, no. 3, pp. 279-311, Sep. 1966.
49. Q.Wang, F. Chen, andW. Xu, "Tracking by third-order tensor representation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 2, pp. 385- 396, Apr. 2011.
50. J. Wen, X. Gao, Y. Yuan, D. Tao, and J. Li, "Incremental tensor biased discriminant analysis: A new color-based visual tracking method," Neurocomputing, vol. 73, no. 4-6, pp. 827-839, Jan. 2010.
51. S. Wold, P. Geladi, K. Esbensen, and J. Öhman, "Multi-way principal components-and PLS-analysis," J. Chemometrics, vol. 1, no. 1, pp. 41- 56, Jan. 1987.
52. S. Wold, A. Ruhe, H. Wold, and W. J. Dunn, "The collinearity problem in linear regression. The Partial Least Squares (PLS) approach to generalized inverses," SIAM J. Sci. Stat. Comput., vol. 5, no. 3, pp. 735-743, 1984.
53. J. Yang, D. Zhang, A. F. Frangi, and J.-Y. Yang, "Two-dimensional Pca: A new approach to appearance-based face representation and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp. 131-137, Jan. 2004.
54. J. Ye, "Generalized low rank approximations of matrices," in Proc. Int. Conf. Mach. Learn., 2004, pp. 887-894.
55. J. Zhang, J. Pu, C. Chen, and R. Fleischer, "Low-resolution gait recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 986- 996, Aug. 2010.
56. L. Zhang, L. Zhang, D. Tao, and X. Huang, "A multifeature tensor for remote-sensing target recognition," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 2, pp. 374-378, Mar. 2011.