Multilinear subspace learning: Dimensionality reduction of multidimensional data

Multilinear Subspace Learning: Dimensionality Reduction of Multidimensional Data

Volumn , Issue , 2013, Pages 1-263

  Lu, Haiping ^a   Plataniotis, Konstantinos N ^a   Venetsanopoulos, Anastasios N ^a  

^a NONE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

BIG DATA; DIGITAL STORAGE; DISTRIBUTED COMPUTER SYSTEMS; LEARNING SYSTEMS; MATLAB; MEDICAL IMAGING; PATTERN RECOGNITION; TENSORS;

DIMENSIONALITY REDUCTION; EMERGING APPLICATIONS; MOBILE INTERNET; MULTIDIMENSIONAL DATA; NETWORKING TECHNOLOGY; SUBSPACE LEARNING; SYSTEM LEVELS; TRADITIONAL TECHNIQUES;

DATA REDUCTION;

EID: 85007104298     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/b16252     Document Type: Book

References (389)

1. Workshop on Algorithms for Modern Massive Data Sets, 2006, 2008, 2010. URL http://www.stanford.edu/group/mmds/.
2. NSF Workshop on Future Directions in Tensor-Based Computation and Modeling, 2009. URL http://www.cs.cornell.edu/cv/TenWork/FinalReport.pdf.
3. Acar, E. and Yener, B. Unsupervised multiway data analysis: A literature survey. IEEE Transactions on Knowledge and Data Engineering, 21(1): 6–20, October 2009.
4. Acar, E., Bingol, C.A., Bingol, H., Bro, R., and Yener, B. Seizure recognition on epilepsy feature tensor. In Proc. 29th International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 4273–4276, 2007.
5. Aja-Fernández, S., d. L. García, R., Tao, D., and Li (Eds.), X. Tensors in Image Processing and Computer Vision. Springer, 2009.
6. Akaike, H. Information theory and an extension of the maximum likelihood principle. In Breakthroughs in statistics, pp. 610–624. Springer, 1992.
7. Allwein, E. L., Schapire, R. E., and Singer, Y. Reducing multiclass to binary: A unifying approach for margin classifiers. Journal of Machine Learning Research, 1:113–141, September 2000.
8. Amari, S.I. Natural gradient works efficiently in learning. Neural Computation, 10(2):251–276, 1998.
9. Anderson, T. W. An Introduction to Multivariate Statistical Analysis. Wiley, New York, third edition, 2003.
10. Antonini, M., Barlaud, M., Mathieu, P., and Daubechies, I. Image coding using wavelet transform. IEEE Transactions on Image Processing, 1(2): 205–220, 1992.
11. Armbrust, M., Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al. A view of cloud computing. Communications of the ACM, 53(4):50–58, 2010.
12. Arulampalam, M. S., Maskell, S., Gordon, N., and Clapp, T. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing, 50(2):174–188, 2002.
13. Ayers, J., Davis, J.L., and Rudolph, A. Neurotechnology for Biomimetic Robots. MIT Press, 2002.
14. Bader, B. W. and Kolda, T. G. Algorithm 862: MATLAB tensor classes for fast algorithm prototyping. ACM Transactions on Mathematical Software, 32(4):635–653, December 2006.
15. Bader, B. W. and Kolda, T. G. Efficient MATLAB computations with sparse and factored tensors. SIAM Journal on Scientific Computing, 30(1):205– 231, December 2007.
16. Barker, M. and Rayens, W. Partial least squares for discrimination. Journal of Chemometrics, 17(3):166–173, 2003.
17. Barnathan, M. Mining Complex High-Order Datasets. PhD thesis, Temple University, 2010.
18. Barnathan, M., Megalooikonomou, V., Faloutsos, C., Mohamed, F High-order analysis of spatiotemporal data. In Proc. Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 246–253, 2010.
19. Bartlett, M. S., Movellan, J. R., and Sejnowski, T. J. Face recognition by independent component analysis. IEEE Transactions on Neural Networks, 13(6):1450–1464, November 2002.
20. Beckmann, C. F. and Smith, S. M. Tensorial extensions of independent component analysis for multisubject fMRI analysis. NeuroImage, 25(1):294–311, 2005.
21. Beckmann, C. F. and Smith, S. M. Probabilistic independent component analysis for functional magnetic resonance imaging. IEEE Transactions on Medical Imaging, 23(2):137–152, 2004.
22. Belhumeur, P. N., Hespanha, J. P., and Kriegman, D. J. Eigenfaces vs. fisher-faces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):711–720, July 1997.
23. Belkin, M. and Niyogi, P. Laplacian eigenmaps and spectral techniques for embedding and clustering. In Advances in Neural Information Processing Systems (NIPS), pp. 585–591, 2001.
24. Belkin, M. and Niyogi, P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15(6):1373–1396, June 2003.
25. Belkin, M. and Niyogi, P. Semi-supervised learning on Riemannian manifolds. Machine Learning, 56(1):209–239, 2004.
26. Bell, A. J. and Sejnowski, T. J. An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7(6):1129– 1159, 2000.
27. Bie, T., Cristianini, N., and Rosipal, R. Eigenproblems in pattern recognition. Handbook of Geometric Computing, pp. 129–167, 2005.
28. Bishop, C. M. Bayesian PCA. In Advances in Neural Information Processing Systems (NIPS), pp. 382–388, 1999.
29. Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., and Müller, K.-R. Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Processing Magazine, 25(1):41–56, January 2008.
30. Boulgouris, N. V., Plataniotis, K. N., and Hatzinakos, D. An angular transform of gait sequences for gait assisted recognition. In Proc. IEEE International Conference on Image Processing, volume 2, pp. 857–860, October 2004.
31. Boulgouris, N. V., Hatzinakos, D., and Plataniotis, K. N. Gait recognition: A challenging signal processing technology for biometrics. IEEE Signal Processing Magazine, 22(6):78–90, November 2005.
32. Boulgouris, N. V., Plataniotis, K. N., and Hatzinakos, D. Gait recognition using linear time normalization. Pattern Recognition, 39(5):969–979, 2006.
33. Bowyer, K. W., Chang, K., and Flynn, P. A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition. Computer Vision and Image Understanding, 101(1):1–15, January 2006.
34. Boyd, J. E. Video phase-locked loops in gait recognition. In Proc. IEEE Conference on Computer Vision, volume 1, pp. 696–703, July 2001.
35. Brand, M. Incremental singular value decomposition of uncertain data with missing values. In Proc. European Conference on Computer Vision, pp. 707–720, 2002.
36. Breiman, L. Arcing classifiers. The Annals of Statistics, 26(3):801–849, 1998.
37. Breiman, L. Bagging predictors. Machine Learning, 24(2):123–140, 1996.
38. Bro, R. Multi-way calibration. Multi-linear PLS. Journal of Chemometrics, 10(1):47–61, 1996.
39. Bro, R. and De Jong, S. A fast non-negativity-constrained least squares algorithm. Journal of Chemometrics, 11(5):393–401, 1997.
40. Burges, C. J. C. Dimension reduction: A guided tour. Foundations and Trends in Machine Learning, 2(4):275–365, 2010.
41. Burges, C.J.C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2(2):121–167, 1998.
42. Cai, D., He, X., Han, J., and Zhang, H. J. Orthogonal Laplacianfaces for face recognition. IEEE Transactions on Image Processing, 15(11):3608–3614, November 2006.
43. Cardoso, J.-F. Super-symmetric decomposition of the fourth-order cumulant tensor. Blind identification of more sources than sensors. In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3109–3112, 1991.
44. Cardoso, J.-F. Blind signal separation: statistical principles. Proceedings of the IEEE, 86(10):2009–2025, 1998.
45. Cardoso, J.-F. and Souloumiac, A. Blind beamforming for non-Gaussian signals. IEE Proceedings-F, 140(6):362–370, December 1993.
46. Carroll, J. D. and Chang, J. J. Analysis of individual differences in multidimensional scaling via an N-way generalization of “Eckart-Young” decomposition. Psychometrika, 35:283–319, 1970.
47. Cattell, R.B. “Parallel proportional profiles” and other principles for determining the choice of factors by rotation. Psychometrika, 9(4):267–283, 1944.
48. Cattell, R.B. The three basic factor-analytic research designs — Their interrelations and derivatives. Psychological Bulletin, 49(5):499–520, 1952.
49. Chang, C.C. and Lin, C.J. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST), 2(3): 1–27, 2011.
50. Chapelle, O., Schölkopf, B., Zien, A., et al. Semi-Supervised Learning, volume 2. MIT Press, Cambridge, MA, 2006.
51. Chaudhuri, K., Kakade, S. M., Livescu, K., and Sridharan, K. Multi-view clustering via canonical correlation analysis. In Proc. International Conference on Machine Learning, pp. 129–136, 2009.
52. Chellappa, R., Roy-Chowdhury, A., and Zhou, S. Recognition of Humans and Their Activities Using Video. Morgan & Claypool Publishers, San Rafael, CA, 2005.
53. Chen, C., Zhang, J., and Fleischer, R. Distance approximating dimension reduction of Riemannian manifolds. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 40(1):208–217, 2010.
54. Cichocki, A., Zdunek, R., Phan, A. H., and Amari, S. Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-Way Data Analysis and Blind Source Separation. John Wiley & Sons Ltd., Chichester West Sussex, United Kingdom, 2009.
55. Coifman, R. R. and Lafon, S. Diffusion maps. Applied and Computational Harmonic Analysis, 21(1):5–30, July 2006.
56. Colombo, A., Cusano, C., and Schettini, R. 3D face detection using curvature analysis. Pattern Recognition, 39(3):444–455, March 2006.
57. Comon, P. Independent component analysis, a new concept? Signal Processing, 36(3):287–314, 1994.
58. Comon, P. and Mourrain, B. Decomposition of quantics in sums of powers of linear forms. Signal Processing, 53:93–108, 1996.
59. Comon, P., Luciani, X., and De Almeida, A.L.F. Tensor decompositions, alternating least squares and other tales. Journal of Chemometrics, 23(7-8):393–405, 2009.
60. Cootes, T. F., Edwards, G. J., and Taylor, C. J. Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6): 681–685, June 2001.
61. Cristianini, N. and Shawe-Taylor, J. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press, United Kingdom, 2000.
62. Cunado, D., Nixon, M. S., and Carter, J. N. Automatic extraction and description of human gait models for recognition purposes. Computer Vision and Image Understanding, 90(1):1–41, January 2003.
63. Dai, G. and Yeung, D. Y. Tensor embedding methods. In Proc. Twenty-First National Conference on Artificial Intelligence, pp. 330–335, July 2006.
64. Dalal, N. and Triggs, B. Histograms of oriented gradients for human detection. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume 1, pp. 886–893, 2005.
65. Daubechies, I. The wavelet transform, time-frequency localization and signal analysis. IEEE Transactions on Information Theory, 36(5):961–1005, 1990.
66. De la Torre, F. A least-squares framework for component analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, (34):1041– 1055, 2012.
67. N) approximation of higher-order tensors. SIAM Journal of Matrix Analysis and Applications, 21(4):1324–1342, 2000a.
68. De Lathauwer, L., De Moor, B., and Vandewalle, J. A multilinear singular value decomposition. SIAM Journal of Matrix Analysis and Applications, 21(4):1253–1278, 2000b.
69. De Lathauwer, L., De Moor, B., and Vandewalle, J. Dimensionality reduction in higher-order-only ICA. In Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics, pp. 316–320, 1997.
70. De Lathauwer, L., De Moor, B., and Vandewalle, J. Independent component analysis and (simultaneous) third-order tensor diagonalization. IEEE Transactions on Signal Processing, 49(10):2262–2271, 2001.
71. N) reduction in multilinear algebra. Linear Algebra and its Applications, 391:31–55, November 2004.
72. Dean, J. and Ghemawat, S. MapReduce: Simplified data processing on large clusters. Communications of the ACM, 51(1):107–113, 2008.
73. Delorme, A. and Makeig, S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1):9–21, 2004.
74. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. Imagenet: A large-scale hierarchical image database. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255, 2009.
75. Dhillon, P. S., Foster, D., and Ungar, L. Multi-view learning of word embeddings via CCA. In Advances in Neural Information Processing Systems (NIPS), pp. 199–207, 2011.
76. Domingos, P. A few useful things to know about machine learning. Communications of the ACM, 55(10):78–87, 2012.
77. Domingos, P. The role of occam’s razor in knowledge discovery. Data Mining and Knowledge Discovery, 3(4):409–425, 1999.
78. Dorogovtsev, S. N., Goltsev, A. V., and Mendes, J. F. Pseudofractal scale-free web. Physical Review E, 65(6):066122, 2002.
79. Duda, R. O., Hart, P. E., and Stork, D. G. Pattern Classification. Wiley Interscience, New York, second edition, 2001.
80. Edelman, A., Arias, T.A., and Smith, S.T. The geometry of algorithms with orthogonality constraints. SIAM Journal on Matrix Analysis and Applications, 20(2):303–353, 1998.
81. Elgammal, A., Harwood, D., and Davis, L.S. Non-parametric model for background subtraction. In Proc. IEEE International Conference on Computer Vision FRAME-RATE Workshop, 1999.
82. Faber, N. M., Bro, R., and Hopke, P. K. Recent developments in CAN-DECOMP/PARAFAC algorithms: A critical review. Chemometrics and Intelligent Laboratory Systems, 65(1):119–137, January 2003
83. Feng, G. C. and Yuen, P. C. Variance projection function and its application to eye detection for human face recognition. Pattern Recognition Letters, 19(9):899–906, 1998.
84. Feng, G. C. and Yuen, P. C. Multi-cues eye detection on gray intensity image. Pattern Recognition, 34(5):1033–1046, 2001.
85. Ferryman, J. and Shahrokni, A. Pets2009: Dataset and challenge. In Proc. 2009 Twelfth IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS-Winter), pp. 1–6, December 2009.
86. Fisher, R.A. The use of multiple measurements in taxonomic problems. Annals of Human Genetics, 7(2):179–188, 1936.
87. Forman, S.D., Cohen, J.D., Fitzgerald, M., Eddy, W.F., Mintun, M.A., and Noll, D.C. Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): Use of a cluster-size threshold. Magnetic Resonance in Medicine, 33(5):636–647, 1995.
88. Foster, J. P., Nixon, M. S., and Prügel-Bennett, A. Automatic gait recognition using area-based metrics. Pattern Recognition Letters, 24(14):2489–2497, October 2003.
89. Freeman, W.T. Where computer vision needs help from computer science. In Proc. Twenty-Second Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 814–819, 2011.
90. Freund, Y. and Schapire, R. E. Experiments with a new boosting algorithm. In Proc. of the Thirteenth International Conference on Machine Learning, pp. 148–156, 1996.
91. Freund, Y. and Schapire, R. E. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1):119–139, 1997.
92. Freund, Y. and Schapire, R. E. A short introducion to boosting. Journal of Japanese Society for Artificial Intelligence, 14(5):771–780, 1999.
93. Friedlander, M.P. and Hatz, K. Computing non-negative tensor factorizations. Optimisation Methods and Software, 23(4):631–647, 2008.
94. Friedman, J., Hastie, T., and Tibshirani, R. The Elements of Statistical Learning, volume 1. Springer Series in Statistics, 2001.
95. Friedman, J. H. Regularized discriminant analysis. Journal of the American Statistical Association, 84(405):165–175, March 1989.
96. Fukunaga, K. Introduction to Statistical Pattern Recognition. Academic Press, Boston, MA, 1990.
97. Gang, L., Yong, Z., Liu, Y.-L., and Jing, D. Three dimensional canonical correlation analysis and its application to facial expression recognition. In Proc. International Conference on Intelligent Computing and Information Science, pp. 56–61, 2011.
98. Gao, Q., Zhang, L., Zhang, D., and Xu, H. Independent components extraction from image matrix. Pattern Recognition Letters, 31(3):171–178, February 2010a.
99. Gao, X., Yang, Y., Tao, D., and Li, X. Discriminative optical flow tensor for video semantic analysis. Computer Vision and Image Understanding, 113 (3):372–383, March 2009.
100. Gao, X., Li, X., Feng, J., and Tao, D. Shot-based video retrieval with optical flow tensor and HMMs. Pattern Recognition Letters, 30(2):140–147, January 2010b.
101. Gold, B., Morgan, N., and Ellis, D., Speech and Audio Signal Processing. Wiley Online Library, 2011.
102. Grant, M. G., Shutler, J. D., Nixon, M. S., and Carter, J. N. Analysis of a human extraction system for deploying gait biometrics. In Proc. IEEE Southwest Symposium on Image Analysis and Interpretation, pp. 46–50, March 2004.
103. Green, R. D. and Guan, L. Quantifying and recognizing human movement patterns from monocular video images Part II: Applications to biometrics. IEEE Transactions on Circuits and Systems for Video Technology, 14(2): 191–198, February 2004.
104. Greub, W. H. Multilinear Algebra. Springer-Verlag, Berlin, 1967.
105. Guan, Z., Wang, C., Chen, Z., Bu, J., and Chen, C. Efficient face recognition using tensor subspace regression. Neurocomputing, 73(13):2744–2753, 2010.
106. Guo, J., Li, Y., Wang, G., and Zeng, J. Batch process monitoring based on multilinear principal component analysis. In International Conference on Intelligent System Design and Engineering Application (ISDEA), volume 1, pp. 413–416, 2010.
107. Guo, J., Liu, Y., and Yuan, W. Palmprint recognition based on phase congruency and two-dimensional principal component analysis. In Proc. 4th International Congress on Image and Signal Processing, volume 3, pp. 1527– 1530, 2011.
108. Guo, W., Kotsia, I., and Patras, I. Tensor learning for regression. IEEE Transactions on Image Processing, 21(2):816–827, 2012.
109. Hackbusch, W. Tensor Spaces and Numerical Tensor Calculus, volume 42. Springer, Berlin, 2012.
110. Hamming, R. You and your research. In Kaiser JF Transcription of the Bell Communications Research Colloquium Seminar, 1986.
111. Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., and Stahel, W.A. Robust Statistics: The Approach Based on Influence Functions, volume 114. Wiley, New York, 2011.
112. Han, J. and Kamber, M. Data Mining: Concepts and Techniques. Morgan Kaufmann, 2006.
113. Han, X.H., Chen, Y.W., and Ruan, X. Multilinear supervised neighborhood embedding of a local descriptor tensor for scene/object recognition. IEEE Transactions on Image Processing, 21(3):1314–1326, 2012.
114. Hao, Z., He, L., Chen, B., and Yang, X. A linear support higher-order tensor machine for classification. IEEE Transactions on Image Processing, 22(7): 2911–2920, 2013.
115. Hardoon, D., Szedmak, S., and Shawe-Taylor, J. Canonical correlation analysis: An overview with application to learning methods. Neural Computation, 16(12):2639–2664, 2004.
116. Harshman, R. Generalization of canonical correlation to N-way arrays. In Poster at the 34th Annual Meeting of the Statistical Society Canada, May 2006.
117. Harshman, R. A. Foundations of the PARAFAC procedure: Models and conditions for an “explanatory” multi-modal factor analysis. UCLA Working Papers in Phonetics, 16:1–84, 1970.
118. Hazan, T., Polak, S., and Shashua, A. Sparse image coding using a 3D non-negative tensor factorization. In Proc. IEEE Conference on Computer Vision, volume 1, pp. 50–57, 2005.
119. He, X. Incremental semi-supervised subspace learning for image retrieval. In ACM Conference on Multimedia 2004, pp. 2–8, October 2004.
120. He, X., Cai, D., and Niyogi, P. Tensor subspace analysis. In Advances in Neural Information Processing Systems 18 (NIPS), pp. 499–506, 2005a.
121. He, X., Yan, S., Hu, Y., Niyogi, P., and Zhang, H. Face recognition using Laplacianfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(3):328–340, March 2005b.
122. Hillis, D. M. and Bull, J. J. An empirical test of bootstrapping as a method for assessing confidence in phylogenetic analysis. Systematic Biology, 42(2): 182–192, 1993.
123. Hinton, G.E. and Salakhutdinov, R.R. Reducing the dimensionality of data with neural networks. Science, 313(5786):504–507, 2006.
124. Hinton, G.E., Osindero, S., and Teh, Y.W. A fast learning algorithm for deep belief nets. Neural Computation, 18(7):1527–1554, 2006.
125. Hitchcock, F. L. Multiple invariants and generalized rank of a p-way matrix or tensor. Journal of Mathematical Physics, 7(1):39–79, 1927a.
126. Hitchcock, F. L. The expression of a tensor or a polyadic as a sum of products. Journal of Mathematical Physics, 6(1):164–189, 1927b.
127. Ho, T. K. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8): 832–844, August 1998.
128. Höskuldsson, A. PLS regression methods. Journal of Chemometrics, 2(3): 211–228, 1988.
129. Hotelling, H. Analysis of a complex of statistical variables into principal components. Journal of Educational Psychology, 24(6):417–441, 1933.
130. Hotelling, H. Relations between two sets of variables. Biometrika, 28(3/4): 312–377, 1936.
131. Howe, D., Costanzo, M., Fey, P., Gojobori, T., Hannick, L., Hide, W., Hill, D. P, Kania, R., Schaeffer, M., St. Pierre, S., et al. Big data: The future of biocuration. Nature, 455(7209):47–50, 2008.
132. Hsu, R.-L., Abdel-Mottaleb, M., and Jain, A. K. Face detection in color images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5):696–706, 2002.
133. Hua, G., Viola, P. A., and Drucker, S. M. Face recognition using discrim-inatively trained orthogonal rank one tensor projections. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, June 2007.
134. Hyvärinen, A. Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10(3):626–634, May 1999.
135. Hyvärinen, A. and Oja, E. Independent component analysis: Algorithms and applications. Neural Networks, 13(4-5):411–430, 2000.
136. Hyvärinen, A., Karhunen, J., and Oja, E. Independent Component Analysis. John Wiley & Sons, 2001.
137. Inoue, K., Hara, K., and Urahama, K. Robust multilinear principal component analysis. In Proc. IEEE Conference on Computer Vision, pp. 591–597, 2009.
138. Inoue, K. and Urahama, K. Non-iterative two-dimensional linear discriminant analysis. In Proc. International Conference on Pattern Recognition, volume 2, pp. 540–543, 2006.
139. Jackson, J.E. A User’s Guide to Principal Components. Wiley, New York, 1991.
140. Jain, A. K., Ross, A., and Prabhakar, S. An introduction to biometric recognition. IEEE Transactions on Circuits and Systems for Video Technology, 14(1):4–20, January 2004a.
141. Jain, A. K., Chellappa, R., Draper, S. C., Memon, N., Phillips, P. J., and Vetro, A. Signal processing for biometric systems. IEEE Signal Processing Magazine, 24(6):146–152, November 2007.
142. Jain, A.K. and Farrokhnia, F. Unsupervised texture segmentation using Gabor filters. Pattern Recognition, 24(12):1167–1186, 1991.
143. Jia, C.C., Wang, S.J., Peng, X.J., Pang, W., Zhang, C.Y., Zhou, C.G., and Yu, Z.Z. Incremental multi-linear discriminant analysis using canonical correlations for action recognition. Neurocomputing, 83:56–63, 2011.
144. Jin, Z., Yang, J. Y., Hu, Z. S., and Lou, Z. Face recognition based on the uncorrelated discriminant transformation. Pattern Recognition, 34:1405– 1416, 2001a.
145. Jin, Z., Yang, J. Y., Tang, Z. M., and Hu, Z. S. A theorem on the uncorrelated optimal discriminant vectors. Pattern Recognition, 34(10):2041–2047, October 2001b.
146. Jolliffe, I. T. Principal Component Analysis. Springer Series in Statistics, second edition, 2002.
147. Jørgensen, B. and Goegebeur, Y. Module 7: Partial least squares regression i, 2007. URL http://statmaster.sdu.dk/courses/ST02/module07/module.pdf.
148. Kaelbling, L.P., Littman, M.L., and Moore, A.W. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4:237–285, 1996.
149. Kale, A. Algorithms for Gait-Based Human Identification from a Monocular Video Sequences. PhD thesis, Department of Electrical and Computer Engineering, University of Maryland, College Park, 2003. URL http://www.cs.uky.edu/~amit/thesis.pdf.
150. Kale, A., Rajagopalan, A. N., Sunderesan, A., Cuntoor, N., Roy-Chowdhury, A., Krueger, V., and Chellappa, R. Identification of humans using gait. IEEE Transactions on Image Processing, 13(9):1163–1173, September 2004.
151. Kang, U., Papalexakis, E., Harpale, A., and Faloutsos, C. Gigatensor: Scaling tensor analysis up by 100 times-algorithms and discoveries. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge discovery and Data Mining, pp. 316–324, 2012.
152. Kearns, M. and Valiant, L. G. Crytographic limitations on learning Boolean formulae and finite automata. Journal of the Association for Computing Machinery, 41(1):67–95, January 1994.
153. Khan, Y. and Gotman, J. Wavelet based automatic seizure detection in intracerebral electroencephalogram. Clinical Neurophysiology, 114(5):898–908, 2003.
154. Kim, T.-K. and Cipolla, R. Canonical correlation analysis of video volume tensors for action categorization and detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(8):1415–1428, 2009.
155. Kim, T.K., Kittler, J., and Cipolla, R. Discriminative learning and recognition of image set classes using canonical correlations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(6):1005–1018, 2007.
156. Kittler, J., Hatef, M., Duin, R. P. W., and Matas, J. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3): 226–239, March 1998.
157. Kivinen, J., Smola, A.J., and Williamson, R.C. Online learning with kernels. IEEE Transactions on Signal Processing, 52(8):2165–2176, 2004.
158. Kofidis, E. and Regalia, P.A. Tensor approximation and signal processing applications. Contemporary Mathematics, 280:103–134, 2001.
159. Kofidis, E. and Regalia, P.A. On the best rank-1 approximation of higher-order supersymmetric tensors. SIAM Journal on Matrix Analysis and Applications, 23(3):863–884, 2002.
160. Kokiopoulou, E., Chen, J., and Saad, Y. Trace optimization and eigenproblems in dimension reduction methods. Numerical Linear Algebra with Applications, 18(3):565–602, 2011.
161. Kolda, T. G. Orthogonal tensor decompositions. SIAM Journal of Matrix Analysis and Applications, 23(1):243–255, 2001.
162. Kolda, T. G. and Bader, B. W. Tensor decompositions and applications. SIAM Review, 51(3):455–500, September 2009.
163. Kolda, T.G. A counterexample to the possibility of an extension of the Eckart– Young low-rank approximation theorem for the orthogonal rank tensor decomposition. SIAM Journal on Matrix Analysis and Applications, 24(3): 762–767, 2003.
164. Kolda, T.G. and Sun, J. Scalable tensor decompositions for multi-aspect data mining. In Proc. IEEE International Conference on Data Mining, pp. 363– 372, 2008.
165. Kong, H., Wang, L., Teoh, E. K., Wang, J.-G., and Venkateswarlu, R. A framework of 2D Fisher discriminant analysis: application to face recognition with small number of training samples. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume 2, pp. 1083–1088, 2005.
166. Kotsia, I. and Patras, I. Multiplicative update rules for multilinear support tensor machines. In Proceedings of the 20th International Conference on Pattern Recognition, pp. 33–36, 2010a.
167. Kotsia, I. and Patras, I. Relative margin support tensor machines for gait and action recognition. In Proceedings of the ACM International Conference on Image and Video Retrieval, pp. 446–453, 2010b.
168. Kroonenberg, P. Three-Mode Principal Component Analysis: Theory and Applications. Leiden: DSWO Press, 1983.
169. Kroonenberg, P. and Leeuw, J. Principal component analysis of three-mode data by means of alternating least squares algorithms. Psychometrika, 45 (1):69–97, 1980.
170. Kruskal, J.B. Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics. Linear Algebra and Its Applications, 18(2):95–138, 1977.
171. Kwak, N. Principal component analysis based on l1-norm maximization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(9):1672– 1680, 2008.
172. Lang, S. Algebra. Addison Wesley, Reading, MA, 1984.
173. Law, M. H. C. and Jain, A. K. Incremental nonlinear dimensionality reduction by manifold learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(3):377–391, March 2006.
174. Lawrence, N.D. Gaussian process latent variable models for visualisation of high dimensional data. Advances in Neural Information Processing Systems (NIPS), 16:329–336, 2004.
175. Lebedev, L. P. and Cloud, M. J. Tensor Analysis. World Scientific, Singapore, 2003.
176. Lee, C. S. and Elgammal, A. Towards scalable view-invariant gait recognition: Multilinear analysis for gait. In Proc. International Conference on Audio and Video-Based Biometric Person Authentication, pp. 395–405, July 2005.
177. Lee, D.D. and Seung, H.S. Learning the parts of objects by non-negative matrix factorization. Nature, 401(6755):788–791, 1999.
178. Lee, K.C. and Kriegman, D. Online learning of probabilistic appearance manifolds for video-based recognition and tracking. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume 1, pp. 852–859, 2005.
179. Lee, L., Dalley, G., and Tieu, K. Learning pedestrian models for silhouette refinement. In Proc. IEEE Conference on Computer Vision, pp. 663–670, October 2003.
180. Lee, S. H. and Choi, S. Two-dimensional canonical correlation analysis. IEEE Signal Processing Letters, 14(10):735–738, October 2007.
181. Lenhart, A., Purcell, K., Smith, A., and Zickuhr, K. Social Media & Mobile Internet Use among Teens and Young Adults. Pew Internet & American Life Project Washington, DC, 2010.
182. Levey, A. and Lindenbaum, M. Sequential Karhunen-Loeve basis extraction and its application to images. IEEE Transactions on Image Processing, 9 (8):1371–1374, 2000.
183. Li, J., Zhang, L., Tao, D., Sun, H., and Zhao, Q. A prior neurophysiologic knowledge free tensor-based scheme for single trial EEG classification. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 17(2):107– 115, April 2009a.
184. Li, M. and Yuan, B. 2D-LDA: A statistical linear discriminant analysis for image matrix. Pattern Recognition Letters, 26(5):527–532, 2005.
185. Li, S. Z., Zhao, C., Ao, M., and Lei, Z. Learning to fuse 3D+2D based face recognition at both feature and decision levels. In Proc. IEEE International Workshop on Analysis and Modeling of Faces and Gestures, pp. 43–53, October 2005.
186. Li, X., Zeng, J., and Yan, H. PCA-HPR: A principle component analysis model for human promoter recognition. Bioinformation, 2(9):373–378, 2008.
187. Li, X., Pang, Y., and Yuan, Y. L1-norm-based 2DPCA. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 40(4):1170–1175, 2009b.
188. Librado, P. and Rozas, J. DNASP v5: a software for comprehensive analysis of DNA polymorphism data. Bioinformatics, 25(11):1451–1452, 2009.
189. Lindeberg, T. Scale-space theory: A basic tool for analyzing structures at different scales. Journal of Applied Statistics, 21(1-2):225–270, 1994.
190. Little, J. J. and Boyd, J. E. Recognizing people by their gait: The shape of motion. Videre, 1(2):1–32, 1998.
191. Liu, C. Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(5):725–737, May 2006.
192. Liu, J., Chen, S., Zhou, Z.H., and Tan, X. Generalized low-rank approximations of matrices revisited. IEEE Transactions on Neural Networks, 21(4): 621–632, 2010.
193. Liu, N., Zhang, B., Yan, J., Chen, Z., Liu, W., Bai, F., and Chien, L. Text representation: From vector to tensor. In Fifth IEEE International Conference on Data Mining, pp. 725–728. IEEE, 2005.
194. Liu, Q., Tang, X., Lu, H., and Ma, S. Face recognition using kernel scatter-difference-based discriminant analysis. IEEE Transactions on Neural Networks, 17(4):1081–1085, July 2006.
195. Liu, Y., Collins, R. T., and Tsin, Y. A computational model for periodic pattern perception based on frieze and wallpaper groups. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(3):354–371, March 2004.
196. Liu, Z. and Sarkar, S. Simplest representation yet for gait recognition: Averaged silhouette. In Proc. International Conference on Pattern Recognition, volume 4, pp. 211–214, August 2004.
197. Liu, Z. and Sarkar, S. Effect of silhouette quality on hard problems in gait recognition. IEEE Transactions on Systems, Man, and Cybernetics—Part B: Cybernetics, 35(2):170–178, 2005.
198. Loog, M., Duin, R. P. W., and Haeb-Umbach, R. Multiclass linear dimension reduction by weighted pairwise Fisher criteria. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(7):762–766, July 2001.
199. Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., Arnaldi, B., et al. A review of classification algorithms for EEG-based brain–computer interfaces. Journal of Neural Engineering, 4(2):R1–R13, 2007.
200. Lowe, D.G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91–110, 2004.
201. Lu, H. Multilinear Subspace Learning for Face and Gait Recognition. PhD thesis, University of Toronto, 2008. URL https://tspace.library. utoronto.ca/handle/1807/16750.
202. Lu, H., Kot, A. C., and Shi, Y. Q. Distance-reciprocal distortion measure for binary document images. IEEE Signal Processing Letters, 11(2):228–231, February 2004.
203. Lu, H., Plataniotis, K. N., and Venetsanopoulos, A. N. A layered deformable model for gait analysis. In Proc. IEEE International Conference on Automatic Face and Gesture Recognition, pp. 249–254, April 2006a.
204. Lu, H., Plataniotis, K. N., and Venetsanopoulos, A. N. Coarse-to-fine pedestrian localization and silhouette extraction for the gait challenge data sets. In Proc. IEEE Conference on Multimedia and Expo, pp. 1009–1012, July 2006c.
205. Lu, H., Plataniotis, K. N., and Venetsanopoulos, A. N. Multilinear principal component analysis of tensor objects for recognition. In Proc. International Conference on Pattern Recognition, volume 2, pp. 776 – 779, August 2006d.
206. Lu, H., Plataniotis, K. N., and Venetsanopoulos, A. N. MPCA: Multilinear principal component analysis of tensor objects. IEEE Transactions on Neural Networks, 19(1):18–39, January 2008b.
207. Lu, H., Plataniotis, K. N., and Venetsanopoulos, A. N. Uncorrelated multilinear discriminant analysis with regularization and aggregation for tensor object recognition. IEEE Transactions on Neural Networks, 20(1):103–123, January 2009c.
208. Lu, H., Plataniotis, K. N., and Venetsanopoulos, A. N. Uncorrelated multilinear principal component analysis for unsupervised multilinear subspace learning. IEEE Transactions on Neural Networks, 20(11):1820–1836, November 2009d.
209. Lu, H., Eng, H.-L., Guan, C., Plataniotis, K. N., and Venetsanopoulos, A. N. Regularized common spatial pattern with aggregation for EEG classification in small-sample setting. IEEE Transactions on Biomedical Engineering, 57 (12):2936–2946, December 2010a.
210. Lu, H., Eng, H.-L., Thida, M., and Plataniotis, K. N. Visualization and clustering of crowd video content in MPCA subspace. In Proc. 19st ACM Conference on Information and Knowledge Management, pp. 1777–1780, October 2010b.
211. Lu, H., Plataniotis, K. N., and Venetsanopoulos, A. N. A survey of multilinear subspace learning for tensor data. Pattern Recognition, 44(7):1540–1551, July 2011.
212. Lu, H., Pan, Y., Mandal, B., Eng, H, Guan, C., and Chan, D. Quantifying limb movements in epileptic seizures through color-based video analysis. IEEE Transactions on Biomedical Engineering, 60(2):461–469, February 2013.
213. Lu, J., Plataniotis, K. N., and Venetsanopoulos, A. N. Face recognition using LDA based algorithms. IEEE Transactions on Neural Networks, 14(1):195– 200, January 2003.
214. Lu, J., Plataniotis, K. N., and Venetsanopoulos, A. N. Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition. Pattern Recognition Letters, 26(2):181–191, 2005.
215. Lu, J., Plataniotis, K. N., Venetsanopoulos, A. N., and Li, S. Z. Ensemble-based discriminant learning with boosting for face recognition. IEEE Transactions on Neural Networks, 17(1):166–178, January 2006e.
216. Luo, D., Ding, C., and Huang, H. Symmetric two dimensional linear discriminant analysis (2DLDA). In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 2820–2827, 2009.
217. Ma, Y., Niyogi, P., Sapiro, G., and Vidal, R. Dimensionality reduction via subspace and submanifold learning [from the guest editors]. IEEE Signal Processing Magazine, 28(2):14–126, January 2011.
218. MacKay, D.J.C. Introduction to Gaussian processes. NATO ASI Series F Computer and Systems Sciences, 168:133–166, 1998.
219. Mahoney, M.W., Maggioni, M., and Drineas, P. Tensor-CUR decompositions for tensor-based data. SIAM Journal on Matrix Analysis and Applications, 30(3):957–987, 2008.
220. Mairal, J., Bach, F., Ponce, J., and Sapiro, G. Online learning for matrix factorization and sparse coding. The Journal of Machine Learning Research, 11:19–60, 2010.
221. Manning, C.D. and Schütze, H. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA, 1999.
222. Marden, J.I. Multivariate statistical analysis old school, 2011. URL http://istics.net/pdfs/multivariate.pdf.
223. Mažgut, J., Tiňo, P., Bodén, M., and Yan, H. Multilinear decomposition and topographic mapping of binary tensors. Proceedings of International Conference on Artificial Neural Networks, pp. 317–326, 2010.
224. Mažgut, J., Tiňo, P., Bodén, M., and Yan, H. Dimensionality reduction and topographic mapping of binary tensors. Pattern Analysis and Applications, pp. 1–19, February 2013.
225. McLachlan, G.J. Discriminant Analysis and Statistical Pattern Recognition. Wiley, New York, 1992.
226. McLachlan, G.J. and Krishnan, T. The EM Algorithm and Extensions, volume 382. Wiley-Interscience, New York, 2007.
227. Meng, J. and Zhang, W. Volume measure in 2DPCA-based face recognition. Pattern Recognition Letters, 28(10):1203–1208, 2007.
228. Meng, X.L. and Van Dyk, D. The EM algorithman old folk-song sung to a fast new tune. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 59(3):511–567, 2002.
229. Moon, H. and Phillips, P. J. Computational and performance aspects of PCA-based face recognition algorithms. Perception, 30:303–321, 2001.
230. Moon, T. K. and Stirling, W. C. Mathematical methods and Algorithms for Signal Processing. Prentice Hall, Englewood Cliffs, NJ, 2000.
231. Mørup, M., Hansen, L.K., and Arnfred, S.M. Algorithms for sparse nonnegative Tucker decompositions. Neural Computation, 20(8):2112–2131, 2008.
232. Muja, M. and Lowe, D.G. Fast approximate nearest neighbors with automatic algorithm configuration. In International Conference on Computer Vision Theory and Applications (VISSAPP09), pp. 331–340, 2009.
233. Müller, K.-R., Mika, S., Rätsch, G., Tsuda, K., and Schölkopf, B. An introduction to kernel-based learning algorithms. IEEE Transactions on Neural Networks, 12(2):181–201, March 2001.
234. Muti, D. and Bourennane, S. Survey on tensor signal algebraic filtering. Signal Processing, 87(2):237–249, February 2007.
235. Nie, F., Xiang, S., Song, Y., and Zhang, C. Extracting the optimal dimensionality for local tensor discriminant analysis. Pattern Recognition, 42(1): 105–114, 2009.
236. Nixon, M. S. and Carter, J. N. Advances in automatic gait recognition. In Proc. IEEE International Conference on Automatic Face and Gesture Recognition, pp. 139–144, May 2004.
237. Nixon, M. S. and Carter, J. N. Automatic recognition by gait. Proceedings of the IEEE, 94(11):2013–2024, November 2006.
238. Nolker, C. and Ritter, H. Visual recognition of continuous hand postures. IEEE Transactions on Neural Networks, 13(4):983–994, July 2002.
239. Oja, E. and Yuan, Z. The FastICA algorithm revisited: Convergence analysis. IEEE Transactions on Neural Networks, 17(6):1370–1381, November 2006.
240. Ojala, T., Pietikainen, M., and Maenpaa, T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7):971–987, 2002.
241. Oppenheim, A.V, Willsky, A.S, and Nawab, S.H. Signals and Systems, volume 2. Prentice-Hall, Englewood Cliffs, NJ, 1983.
242. Oweiss, K.G. Statistical Signal Processing for Neuroscience and Neurotechnology. Academic Press, Burlington, MA, 2010.
243. Paatero, P. A weighted non-negative least squares algorithm for three-way PARAFAC factor analysis. Chemometrics and Intelligent Laboratory Systems, 38(2):223–242, 1997.
244. Paatero, P. and Tapper, U. Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values. Environmetrics, 5(2):111–126, 1994.
245. Pan, S.J. and Yang, Q. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10):1345–1359, 2010.
246. Panagakis, Y., Kotropoulos, C., and Arce, G. R. Non-negative multilinear principal component analysis of auditory temporal modulations for music genre classification. IEEE Transactions on Audio, Speech, and Language Processing, 18(3):576–588, March 2010.
247. Pang, Y., Li, X., and Yuan, Y. Robust tensor analysis with L1-norm. IEEE Transactions on Circuits and Systems for Video Technology, 20(2):172–178, 2010.
248. Pantano, P., Mainero, C., Lenzi, D., Caramia, F., Iannetti, G.D., Piattella, M.C., Pestalozza, I., Di Legge, S., Bozzao, L., and Pozzilli, C. A longitudinal fMRI study on motor activity in patients with multiple sclerosis. Brain, 128 (9):2146–2153, 2005.
249. Papadimitriou, S., Sun, J., and Faloutsos, C. Streaming pattern discovery in multiple time-series. In Proc. 31st International Conference on Very Large Data Bases, pp. 697–708, 2005.
250. Pearson, K. On lines and planes of closest fit to systems of points in space. Philosophical Magazine, 2(6):559–572, 1901.
251. Phillips, P. J., Moon, H., Rizvi, S. A., and Rauss, P. The FERET evaluation method for face recognition algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(10):1090–1104, October 2000.
252. Phillips, P. J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., and Worek, W. Overview of the face recognition grand challenge. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume 1, pp. 947–954, June 2005.
253. Pitton, J.W., Wang, K., and Juang, B.H. Time-frequency analysis and auditory modeling for automatic recognition of speech. Proceedings of the IEEE, 84(9):1199–1215, 1996.
254. Plataniotis, K. N. and Venetsanopoulos, A. N. Color Image Processing and Applications. Springer Verlag, Berlin, 2000.
255. Porges, T. and Favier, G. Automatic target classification in SAR images using MPCA. In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1225–1228, 2011.
256. Porro-Muñoz, D., Duin, R.P.W., Talavera, I., and Orozco-Alzate, M. Classification of three-way data by the dissimilarity representation. Signal Processing, 91(11):2520–2529, 2011.
257. Qi, L., Sun, W., and Wang, Y. Numerical multilinear algebra and its applications. Frontiers of Mathematics in China, 2(4):501–526, 2007.
258. Qian, S. Introduction to Time-Frequency and Wavelet Transforms, volume 68. Prentice Hall PTR, Englewood Cliffs, NJ, 2002.
259. Rai, P. and Daumé III, H. Multi-label prediction via sparse infinite CCA. In Advances in Neural Information Processing Systems (NIPS), pp. 1518–1526, 2009.
260. Raina, R., Battle, A., Lee, H., Packer, B., and Ng, A.Y. Self-taught learning: Transfer learning from unlabeled data. In Proc. 24th International Conference on Machine Learning, pp. 759–766, 2007.
261. Raj, R. G. and Bovik, A. C. MICA: A multilinear ICA decomposition for natural scene modeling. IEEE Transactions on Image Processing, 17(3): 259–271, March 2009.
262. Rajih, M., Comon, P., and Harshman, R.A. Enhanced line search: A novel method to accelerate PARAFAC. SIAM Journal on Matrix Analysis and Applications, 30(3):1128–1147, 2008.
263. Ramoser, H., Muller-Gerking, J., and Pfurtscheller, G. Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Transactions on Rehabilitation Engineering, 8(4):441–446, 2000.
264. Rasmussen, C.E. and Williams, C.K.I. Gaussian Processes for Machine Learning, volume 1. MIT Press, Cambridge, MA, 2006.
265. Renard, N. and Bourennane, S. Dimensionality reduction based on tensor modeling for classification methods. IEEE Transactions on Geoscience and Remote Sensing, 47(4):1123–1131, April 2009.
266. Rissanen, J. A universal prior for integers and estimation by minimum description length. The Annals of Statistics, pp. 416–431, 1983.
267. Rosipal, R. and Krämer, N. Overview and recent advances in partial least squares. Subspace, Latent Structure and Feature Selection, Springer-Verlag, Berlin, pp. 34–51, 2006.
268. Ross, A. and Govindarajan, R. Feature level fusion of hand and face biometrics. In Proc. SPIE Conference on Biometric Technology for Human Identification II, pp. 196–204, March 2005.
269. Ross, A., Jain, A. K., and Qian, J. Z. Information fusion in biometrics. Pattern Recognition Letters, 24:2115–2125, 2003.
270. Ross, D.A., Lim, J., Lin, R.S., and Yang, M.H. Incremental learning for robust visual tracking. International Journal of Computer Vision, 77(1):125–141, 2008.
271. Rosten, E., Porter, R., and Drummond, T. Faster and better: A machine learning approach to corner detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(1):105–119, 2010.
272. Roweis, S. and Saul, L. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(22):2323–2326, December 2000.
273. Roweis, S. Matrix identities. Note available on the Internet at http://www.cs.toronto.edu/roweis/notes/matrixid.pdf, 1999.
274. Rozas, J., Sánchez-DelBarrio, J. C., Messeguer, X., and Rozas, R. DNASP, DNA polymorphism analyses by the coalescent and other methods. Bioinformatics, 19(18):2496–2497, 2003.
275. Ruiz-Hernandez, J. A., Crowley, J. L., and Lux, A. “How old are you?”: Age estimation with tensors of binary Gaussian receptive maps. In Proceedings of the British Machine Vision Conference, pp. 1–11, 2010a.
276. Ruiz-Hernandez, J.A., Crowley, J.L., and Lux, A. Tensor-jet: A tensorial representation of local binary Gaussian jet maps. In Proc. IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 41–47, 2010b.
277. Saeys, Y., Inza, I., and Larrañaga, P. A review of feature selection techniques in bioinformatics. Bioinformatics, 23(19):2507–2517, 2007.
278. Sahambi, H. S. and Khorasani, K. A neural-network appearance-based 3-D object recognition using independent component analysis. IEEE Transactions on Neural Networks, 14(1):138–149, January 2003.
279. Samaria, F. and Young, S. HMM based architecture for face identification. Image and Vision Computing, 12:537–583, 1994.
280. Sarkar, S., Phillips, P. J., Liu, Z., Robledo, I., Grother, P., and Bowyer, K. W. The human ID gait challenge problem: Data sets, performance, and analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(2): 162–177, February 2005.
281. Schapire, R. E. Using output codes to boost multiclass learning problems. In Proc. Fourteenth International Conference on Machine Learning, pp. 313– 321, 1997.
282. Schapire, R. E. The boosting approach to machine learning: An overview. In Denison, D. D., Hansen, M. H., Holmes, C., Mallick, B., and Yu, B. (Eds.), MSRI Workshop on Nonlinear Estimation and Classification. Springer, Berlin, 2003. URL http://stat.haifa.ac.il/~goldensh/DM/msri.pdf.
283. Schapire, R. E. and Singer, Y. Improved boosting algorithms using confidence-rated predictions. Machine Learning, 37(3):297–336, December 1999.
284. Schapire, R. E., Freund, Y., Bartlett, P., and Lee, W. S. Boosting the margin: A new explanation for the effectiveness of voting methods. In Proc. Fourteenth International Conference on Machine Learning, pp. 322–330, 1997.
285. Schein, A.I., Saul, L.K., and Ungar, L.H. A generalized linear model for principal component analysis of binary data. In Proc. Ninth International Workshop on Artificial Intelligence and Statistics, pp. 14–21, 2003.
286. Schölkopf, B., Smola, A., and Müller, K. R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10(5):1299–1319, 1998.
287. Schwarz, G. Estimating the dimension of a model. The Annals of Statistics, 6(2):461–464, 1978.
288. Shakhnarovich, G. and Moghaddam, B. Face recognition in subspaces. In Li, Stan Z. and Jain, Anil K. (Eds.), Handbook of Face Recognition, pp. 141–168. Springer-Verlag, Berlin, 2004.
289. Shashua, A. and Hazan, T. Non-negative tensor factorization with applications to statistics and computer vision. In Proc. International Conference on Machine Learning, pp. 792–799, 2005.
290. Shashua, A. and Levin, A. Linear image coding for regression and classification using the tensor-rank principle. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume I, pp. 42–49, 2001.
291. Shechtman, E., Caspi, Y., and Irani, M. Space-time super-resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(4):531–545, April 2005.
292. Sim, T., Baker, S., and Bsat, M. The CMU pose, illumination, and expression database. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(12):1615–1618, December 2003.
293. Sivic, J. and Zisserman, A. Video Google: A text retrieval approach to object matching in videos. In Proc. IEEE Conference on Computer Vision, pp. 1470–1477, 2003.
294. Skurichina, M. and Duin, R. P. W. Bagging, boosting and the random subspace method for linear classifiers. Pattern Analysis & Applications, 5(2): 121–135, 2002.
295. Sonnenburg, S., Braun, M. L., Ong, C. S., Bengio, S., Bottou, L., Holmes, G., Y. LeCun, K.-R. Müller, F. Pereira, Rasmussen, C. E., Rätsch, G., Schölkopf, B., Smola, A., Vincent, P., Weston, J., and Williamson, R. C. The need for open-source software in machine learning. Journal of Machine Learning Research, 8:2443–2466, October 2007.
296. Steinwart, I. and Christmann, A. Support Vector Machines. Springer, Berlin, 2008.
297. Sukittanon, S., Atlas, L.E., and Pitton, J.W. Modulation-scale analysis for content identification. IEEE Transactions on Signal Processing, 52(10): 3023–3035, 2004.
298. Sun, J., Tao, D., and Faloutsos, C. Beyond streams and graphs: Dynamic tensor analysis. In Proc. 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 374–383, August 2006.
299. Sun, J., Tao, D., Papadimitriou, S., Yu, P. S., and Faloutsos, C. Incremental tensor analysis: Theory and applications. ACM Transactions on Knowledge Discovery from Data, 2(3):11:1–11:37, October 2008a.
300. Sun, J., Xie, Y., Zhang, H., and Faloutsos, C. Less is more: Sparse graph mining with compact matrix decomposition. Statistical Analysis and Data Mining, 1(1):6–22, February 2008b.
301. Sun, M., Wang, S., Liu, X., Jia, C., and Zhou, C. Human action recognition using tensor principal component analysis. In Proc. 4th IEEE International Conference on Computer Science and Information Technology, pp. 487–491, 2011.
302. Sutton, R.S. and Barto, A.G. Reinforcement Learning: An Introduction, volume 1. Cambridge Univ Press, 1998.
303. Szeliski, R. Computer vision: Algorithms and applications. Springer, 2010.
304. Tan, X., Chen, S., Zhou, Z.-H., and Zhang, F. Face recognition from a single image per person: A survey. Pattern Recognition, 39(9):1725–1745, 2006.
305. Tao, D., Li, X., Wu, X., and Maybank, S. J. Elapsed time in human gait recognition: A new approach. In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, volume 2, pp. 177–180, April 2006.
306. Tao, D., Li, X., Wu, X., Hu, W., and Maybank, S. J. Supervised tensor learning. Knowledge and Information Systems, 13(1):1–42, January 2007a.
307. Tao, D., Li, X., Wu, X., and Maybank, S. J. General tensor discriminant analysis and gabor features for gait recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(10):1700–1715, October 2007b.
308. Tao, D., Li, X., Wu, X., and Maybank, S. J. Tensor rank one discriminant analysis: A convergent method for discriminative multilinear subspace selection. Neurocomputing, 71(10-12):1866–1882, June 2008a.
309. Tao, D., Song, M., Li, X., Shen, J., Sun, J., Wu, X., Faloutsos, C., and Maybank, S. J. Bayesian tensor approach for 3-D face modeling. IEEE Transactions on Circuits and Systems for Video Technology, 18(10):1397–1410, October 2008b.
310. Tenenbaum, J. B., de Silva, V., and Langford, J.C. A global geometric framework for nonlinear dimensionality reduction. Science, 290(22):2319–2323, December 2000.
311. Tibshirani, R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), pp. 267–288, 1996.
312. Tipping, M.E. and Bishop, C.M. Mixtures of probabilistic principal component analyzers. Neural Computation, 11(2):443–482, 1999a.
313. Tipping, M.E. and Bishop, C.M. Probabilistic principal component analysis. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 61(3):611–622, 1999b.
314. Tolliver, D. and Collins, R. T. Gait shape estimation for identification. In Proc. International Conference on Audio and Video-Based Biometric Person Authentication, pp. 734–742, June 2003.
315. Tong, S. and Chang, E. Support vector machine active learning for image retrieval. In Proceedings of the Ninth ACM International Conference on Multimedia, pp. 107–118, 2001.
316. Tong, S. and Koller, D. Support vector machine active learning with applications to text classification. The Journal of Machine Learning Research, 2: 45–66, 2002.
317. Torralba, A., Fergus, R., and Freeman, W.T. 80 million tiny images: A large data set for nonparametric object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(11):1958–1970, 2008.
318. Tsybakov, A. B. Optimal aggregation of classifiers in statistical learning.(English summary). Annals of Statistics, 32(1):135–166, 2004.
319. Tucker, L. R. Some mathematical notes on three-mode factor analysis. Psychometrika, 31:279–311, 1966.
320. Turk, M. and Pentland, A. Eigenfaces for recognition. Journal of Cognitive Neurosicence, 3(1):71–86, 1991.
321. van de Ven, V.G., Formisano, E., Prvulovic, D., Roeder, C.H., and Linden, D.E.J. Functional connectivity as revealed by spatial independent component analysis of fMRI measurements during rest. Human Brain Mapping, 22(3):165–178, 2004.
322. Vapnik, V and Sterin, A. On structural risk minimization or overall risk in a problem of pattern recognition. Automation and Remote Control, 10(3): 1495–1503, 1977.
323. Vapnik, V. N. The Nature of Statistical Learning Theory. Springer-Verlag, New York, 1995.
324. Vasilescu, M. A. O. Human motion signatures: analysis, synthesis, recognition. In Proc. International Conference on Pattern Recognition, volume 3, pp. 456–460, August 2002.
325. Vasilescu, M. A. O. and Terzopoulos, D. Multilinear image analysis for facial recognition. In Proc. International Conference on Pattern Recognition, volume 2, pp. 511–514, August 2002a.
326. Vasilescu, M. A. O. and Terzopoulos, D. Multilinear analysis of image ensembles: Tensorfaces. In Proc. Seventh European Conference on Computer Vision, pp. 447–460, May 2002b.
327. Vasilescu, M. A. O. and Terzopoulos, D. Multilinear subspace analysis of image ensembles. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume II, pp. 93–99, June 2003.
328. Vasilescu, M. A. O. and Terzopoulos, D. Multilinear independent components analysis. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume I, pp. 547–553, June 2005.
329. Vega, I. R. and Sarkar, S. Statistical motion model based on the change of feature relationships: Human gait-based recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(10):1323–1328, October 2003.
330. Vidal, R., Ma, Y., and Sastry, S. Generalized principal component analysis (gpca). IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(12):1945–1959, 2005.
331. Viola, P. and Jones, M. J. Robust real-time face detection. International Journal of Computer Vision, 57(2):137–154, May 2004.
332. Wagg, D. K. and Nixon, M. S. On automated model-based extraction and analysis of gait. In Proc. IEEE International Conference on Automatic Face and Gesture Recognition, pp. 11–16, May 2004.
333. Wagstaff, K. Machine learning that matters. In Proc. International Conference on Machine Learning, pp. 529–536, 2012.
334. Wang, H. Local two-dimensional canonical correlation analysis. IEEE Signal Processing Letters, 17(11):921–924, November 2010.
335. Wang, H. and Ahuja, N. A tensor approximation approach to dimensionality reduction. International Journal of Computer Vision, 76(3):217–229, March 2008.
336. Wang, J., Plataniotis, K. N., and Venetsanopoulos, A. N. Selecting discriminant eigenfaces for face recognition. Pattern Recognition Letters, 26(10): 1470–1482, 2005.
337. Wang, J., Plataniotis, K. N., Lu, J., and Venetsanopoulos, A. N. On solving the face recognition problem with one training sample per subject. Pattern Recognition, 39(9):1746–1762, 2006.
338. Wang, L., Tan, T., Ning, H., and Hu, W. Silhouette analysis-based gait recognition for human identification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(12):1505–1518, December 2003.
339. Wang, L., Ning, H., Tan, T., and Hu, W. Fusion of static and dynamic body biometrics for gait recognition. IEEE Transactions on Circuits and Systems for Video Technology, 14(2):149–158, February 2004.
340. Wang, Q., Chen, F., and Xu, W. Tracking by third-order tensor representation. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 41(2):385–396, 2011a.
341. Wang, S.J., Yang, J., Zhang, N., and Zhou, C.G. Tensor discriminant color space for face recognition. IEEE Transactions on Image Processing, 20(9): 2490–2501, 2011b.
342. Wang, S.J., Zhou, C.G., Zhang, N., Peng, X.J., Chen, Y.H., and Liu, X. Face recognition using second-order discriminant tensor subspace analysis. Neurocomputing, 74(12):2142–2156, 2011c.
343. Wang, S.J., Yang, J., Sun, M.F., Peng, X.J., Sun, M.M., and Zhou, C.G. Sparse tensor discriminant color space for face verification. IEEE Transactions on Neural Networks and Learning Systems, 23(6):876–888, 2012.
344. Wang, X., Ma, X., and Grimson, W.E.L. Unsupervised activity perception in crowded and complicated scenes using hierarchical bayesian models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(3):539–555, 2009.
345. Wang, Y. and Gong, S. Tensor discriminant analysis for view-based object recognition. In Proc. International Conference on Pattern Recognition, volume 3, pp. 33–36, August 2006.
346. Wang, Z., Chen, S., Liu, J., and Zhang, D. Pattern representation in feature extraction and classifier design: matrix versus vector. IEEE Transactions on Neural Networks, 19(5):758–769, 2008.
347. Washizawa, Y., Higashi, H., Rutkowski, T., Tanaka, T., and Cichocki, A. Tensor based simultaneous feature extraction and sample weighting for EEG classification. Neural Information Processing. Models and Applications, pp. 26–33, 2010.
348. Weenink, D. J. M. Canonical correlation analysis. Proceedings of the Institute of Phonetic Sciences of the University of Amsterdam, 25:81–99, 2003.
349. Welling, M. and Weber, M. Positive tensor factorization. Pattern Recognition Letters, 22(12):1255–1261, 2001.
350. Wen, J., Gao, X., Yuan, Y., Tao, D., and Li, J. Incremental tensor biased discriminant analysis: A new color-based visual tracking method. Neurocomputing, 73(4-6):827–839, January 2010.
351. Williams, C.K.I. Prediction with Gaussian processes: From linear regression to linear prediction and beyond. NATO ASI Series D Behavioural And Social Sciences, 89:599–621, 1998.
352. Wiskott, L., Fellous, J. M., Kruger, N., and von der Malsburg, C. Face recognition by elastic bunch graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):775–779, July 1997.
353. Wold, S., Sjöström, M., L., and Eriksson. PLS-regression: A basic tool of chemometrics. Chemometrics and Intelligent Laboratory Systems, 58(2): 109–130, 2001.
354. Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., and Ma, Y. Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(2):210–227, 2009.
355. Wu, S., Li, W., Wei, Z., and Yang, J. Local discriminative orthogonal rank-one tensor projection for image feature extraction. In First Asian Conference on Pattern Recognition (ACPR), pp. 367–371, 2011.
356. Xu, D., Yan, S., Tao, D., Zhang, L., Li, X., and Zhang, H.-J. Human gait recognition with matrix representation. IEEE Transactions on Circuits and Systems for Video Technology, 16(7):896–903, July 2006.
357. Xu, D., Lin, S., Yan, S., and Tang, X. Rank-one projections with adaptive margins for face recognition. IEEE Transactions on Systems, Man, and Cybernetics—Part B: Cybernetics, 37(5):1226–1236, October 2007.
358. Xu, D., Yan, S., Zhang, L., Lin, S., Zhang, H.-J., and Huang, T. S. Reconstruction and recognition of tensor-based objects with concurrent subspaces analysis. IEEE Transactions on Circuits and Systems for Video Technology, 18(1):36–47, January 2008.
359. Xu, R. and Wunsch II, D. C. Survey of clustering algorithms. IEEE Transactions on Neural Networks, 16(3):645–678, May 2005.
360. Yam, C. Y., Nixon, M. S., and Carter, J. N. Automated person recognition by walking and running via model-based approaches. Pattern Recognition, 37(5):1057–1072, May 2004.
361. Yan, J., Zheng, W., Zhou, X., and Zhao, Z. Sparse 2-D canonical correlation analysis via low rank matrix approximation for feature extraction. IEEE Signal Processing Letters, 19(1):51–54, January 2012.
362. Yan, S., Xu, D., Yang, Q., Zhang, L., Tang, X., and Zhang, H.-J. Discriminant analysis with tensor representation. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume I, pp. 526–532, June 2005.
363. Yan, S., Xu, D., Yang, Q., Zhang, L., Tang, X., and Zhang, H. Multilinear discriminant analysis for face recognition. IEEE Transactions on Image Processing, 16(1):212–220, January 2007a.
364. Yan, S., Xu, D., Zhang, B., Zhang, H. J., Yang, Q., and Lin, S. Graph embedding and extensions: A general framework for dimensionality reduction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(1): 40–51, January 2007b.
365. Yang, J., Zhang, D., Frangi, A. F., and Yang, J. Two-dimensional PCA: A new approach to appearance-based face representation and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(1):131–137, January 2004.
366. Yang, J., Zhang, D., Yong, X., and Yang, J.-Y. Two-dimensional discriminant transform for face recognition. Pattern Recognition, 38(7):1125–1129, 2005.
367. Ye, J. Generalized low rank approximations of matrices. Machine Learning, 61(1-3):167–191, 2005a.
368. Ye, J. Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. Journal of Machine Learning Research, 6:483–502, April 2005b.
369. Ye, J., Janardan, R., and Li, Q. GPCA: An efficient dimension reduction scheme for image compression and retrieval. In Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 354– 363, 2004a.
370. Ye, J., Janardan, R., and Li, Q. Two-dimensional linear discriminant analysis. In Advances in Neural Information Processing Systems (NIPS), pp. 1569– 1576, 2004b.
371. Ye, J., Janardan, R., Li, Q., and Park, H. Feature reduction via generalized uncorrelated linear discriminant analysis. IEEE Transactions on Knowledge and Data Engineering, 18(10):1312–1322, October 2006.
372. Zafeiriou, S. Algorithms for nonnegative tensor factorization. In Aja-Fernández, S., d. L. García, R., Tao, D., and Li, X. (Eds.), Tensors in Image Processing and Computer Vision, pp. 105–124. Springer, Berlin, 2009a.
373. Zafeiriou, S. Discriminant nonnegative tensor factorization algorithms. IEEE Transactions on Neural Networks, 20(2):217–235, 2009b.
374. Zafeiriou, S. and Petrou, M. Nonnegative tensor factorization as an alternative Csiszar–Tusnady procedure: Algorithms, convergence, probabilistic interpretations and novel probabilistic tensor latent variable analysis algorithms. Data Mining and Knowledge Discovery, 22(3):419–466, 2011.
375. Zangwill, W.I. Nonlinear Programming: A Unified Approach. Prentice-Hall Englewood Cliffs, NJ, 1969.
376. Zhang, D., Wang, Y., and Bhanu, B. Ethnicity classification based on gait using multi-view fusion. In Proc. IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 108–115, 2010.
377. Zhang, J., Li, S. Z., and Wang, J. Manifold learning and applications in recognition. In Tan, Y. P., Yap, K. H., and Wang, L. (Eds.), Intelligent Multimedia Processing with Soft Computing, pp. 281–300. Springer-Verlag, Berlin, 2004.
378. Zhang, L., Gao, Q., and Zhang, D. Directional independent component analysis with tensor representation. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–7, June 2008.
379. Zhang, L., Tao, D, and Huang, X. Tensor discriminative locality alignment for hyperspectral image spectral–spatial feature extraction. IEEE Transactions on Neural Networks, 51(1):242–256, 2013.
380. Zhang, T. and Golub, G.H. Rank-one approximation to high order tensors. SIAM Journal on Matrix Analysis and Applications, 23(2):534–550, 2001.
381. Zhang, Y., Zhou, G., Zhao, Q., Onishi, A., Jin, J., Wang, X., and Cichocki, A. Multiway canonical correlation analysis for frequency components recognition in SSVEP-based BCIs. In Proc. International Conference on Neural Information Processing (ICONIP), pp. 287–295, 2011.
382. Zhao, J., Yu, P.L.H., and Kwok, J.T. Bilinear probabilistic principal component analysis. IEEE Transactions on Neural Networks and Learning Systems, 23(3):492–503, 2012.
383. Zhao, Q., Caiafa, C. F., Mandic, D. P., Zhang, L., Ball, T., Schulze-Bonhage, A., and Cichocki, A. Multilinear subspace regression: An orthogonal tensor decomposition approach. In Advances in Neural Information Processing Systems (NIPS), pp. 1269–1277, 2011.
384. Zhou, X.S. and Huang, T.S. Comparing discriminating transformations and SVM for learning during multimedia retrieval. In Proceedings of the Ninth ACM International Conference on Multimedia, pp. 137–146, 2001a.
385. Zhou, X.S. and Huang, T.S. Small sample learning during multimedia retrieval using biasmap. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, volume 1, pp. I–11, 2001b.
386. Zhou, Z.-H. Ensemble Methods: Foundations and Algorithms. Chapman & Hall, Boca Raton, FL, 2012.
387. Zhou, Z.-H. and Geng, X. Projection functions for eye detection. Pattern Recognition, 37(5):1049–1056, 2004.
388. Zou, H. and Hastie, T. Regression shrinkage and selection via the elastic net, with applications to microarrays. Journal of the Royal Statistical Society: Series B. v67, pp. 301–320, 2003.
389. Zuo, W., Zhang, D., and Wang, K. An assembled matrix distance metric for 2DPCA-based image recognition. Pattern Recognition Letters, 27(3): 210–216, 2006.