A linear support higher-order tensor machine for classification

IEEE Transactions on Image Processing

Volumn 22, Issue 7, 2013, Pages 2911-2920

  Hao, Zhifeng ^a,b   He, Lifang ^b   Chen, Bingqian ^b   Yang, Xiaowei ^b,c  

^a GUANGDONG UNIVERSITY OF TECHNOLOGY   (China)

^b SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^c JILIN UNIVERSITY   (China)

Author keywords

Higher order tensor; support tensor machine (STM); support vector machine (SVM); tensor classification; tensor rank one decomposition

Indexed keywords

EFFECTIVE LEARNING; GAIT RECOGNITION; HIGHER-ORDER TENSOR; ITERATIVE TECHNIQUE; LEARNING MACHINES; NONCONVEX OPTIMIZATION PROBLEM; PERFORMANCE GAIN; SUPPORT TENSOR MACHINE (STM);

FACE RECOGNITION; SUPPORT VECTOR MACHINES;

TENSORS;

EID: 84878311477     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2013.2253485     Document Type: Article

References (61)

1. V. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 1995.
2. D. Gavrila, "The visual analysis of human movement: A survey," Comput. Vis. Image Understand., vol. 73, no. 1, pp. 82-92, 1999.
3. D. Ramanan and D. Forsyth, "Automatic annotation of everyday movements," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2003, pp. 1-8.
4. Z. Li and X. Tang, "Bayesian face recognition using support vector machine and face clustering," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun.-Jul. 2004, pp. 259-265.
5. J. Liu and M. Shah, "Learning human actions via information maximization," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
6. J. Li, N. Allinsion, D. Tao, and X. Li, "Multitraining support vector machine for image retrieval," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3597-3601, Nov. 2006. (Pubitemid 44615153)
7. F. Bovolo, L. Bruzzone, and L. Carlin, "A novel technique for subpixel image classification based on support vector machine," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2983-2999, Nov. 2010.
8. M. Turk and A. Pentland, "Face recognition using eigenfaces," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 1991, pp. 586-591.
9. M. Felsberg, "Low-level image processing with the structure multivec-tor," Ph.D. dissertation, Inst. Computer Science and Applied Mathematics, Christian-Albrechts-Univ. Kiel, Kiel, Germany, 2002.
10. K. Plataniotis and A. Venetsanopoulos, Color Image Processing and Applications, Berlin, Germany: Springer-Verlag, 2000.
11. R. Green and L. Guan, "Quantifying and recognizing human movement patterns from monocular video images-part II: Applications to biometrics," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 2, pp. 191-198, Feb. 2004.
12. R. Chellappa, A. Roy-Chowdhury, and S. Zhou, Recognition of Humans and their Activities Using Video. San Rafael, CA, USA: Morgan & Claypool, 2005.
13. P. Negi and D. Labate, "3-D discrete shearlet transform and video processing," IEEE Trans. Image Process., vol. 21, no. 6, pp. 2944-2954, Jun. 2012.
14. S. Sarkar, P. Phillips, Z. Liu, I. Vega, P. Grother, and K. Bowyer, "The humanID gait challenge problem: Data sets, performance, and analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 162-177, Feb. 2005. (Pubitemid 40377311)
15. H. Lu, K. Plataniotis, and A. Venetsanopoulos, "MPCA: Multilinear principal component analysis of tensor objects," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 18-39, Jan. 2008. (Pubitemid 351279223)
16. N. Renard and S. Bourennane, "Dimensionality reduction based on tensor modeling for classification methods," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 4, pp. 1123-1131, Apr. 2009.
17. M. Kim, J. Jeon, J. Kwak, M. Lee, and C. Ahn, "Moving object segmentation in video sequences by user interaction and automatic object tracking," Image Vis. Comput., vol. 19, no. 5, pp. 245-260, 2001. (Pubitemid 32160650)
18. H. Wang and N. Ahuja, "Compact representation of multidimensional data using tensor rank-one decomposition," in Proc. 17th Int. Conf. Pattern Recognit., vol. 1. 2004, pp. 44-47.
19. X. Geng, K. Smith-Miles, Z.-H. Zhou, and L. Wang, "Face image modeling by multilinear subspace analysis with missing values," IEEE Trans. Syst., Man, Cybern B, Cybern., vol. 41, no. 3, pp. 881-892, Jun. 2011.
20. J. Ye, R. Janardan, and Q. Li, "GPCA: An efficient dimension reduction scheme for image compression and retrieval," in Proc. 10th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2004, pp. 354-363. (Pubitemid 40114945)
21. H. Lu, K. Plataniotis, and A. Venetsanopoulos, "Uncorrelated multilinear discriminant analysis with regularization and aggregation for tensor object recognition," IEEE Trans. Neural Netw., vol. 20, no. 1, pp. 103-123, Jan. 2009.
22. S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, and H.-J. Zhang, "Multilinear discriminant analysis for face recognition," IEEE Trans. Image Process., vol. 16, no. 1, pp. 212-220, Jan. 2007. (Pubitemid 46437483)
23. X. Zhang, X. Lu, Q. Shi, X.-Q. Xu, H.-C. Leung, L. Harris, J. Iglehart, A. Miron, J. Liu, and W. Wong, "Recursive SVM feature selection and sample classification for mass-spectrometry and microarray data," BMC Bioinformat., vol. 7, p. 197, Apr. 2006.
24. T. Cooke, "Two variations on Fisher's linear discriminant for pattern recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 2, pp. 268-273, Feb. 2002. (Pubitemid 34198213)
25. P. Hall, J. Marron, and A. Neeman, "Geometric representation of high dimension, low sample size data," J. Royal Stat. Soc. Ser. B, vol. 67, no. 18, pp. 427-444, Jun. 2005. (Pubitemid 40855293)
26. D. Tao, X. Tang, X. Li, and X. Wu, "Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1088-1099, Jul. 2006.
27. A. Shashua and A. Levin, "Linear image coding for regression and classification using the tensor-rank principle," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1. Dec. 2001, pp. 42-49.
28. T. Hazan, S. Polak, and A. Shashua, "Sparse image coding using a 3D non-negative tensor factorization," in Proc. 10th IEEE Int. Conf. Comput. Vis., vol. 1. Oct. 2005, pp. 50-57. (Pubitemid 44054940)
29. T. Kolda and B. Bader, "Tensor decompositions and applications," SIAM Rev., vol. 51, no. 3, pp. 455-500, 2009.
30. M. Liu, N. Yu, and W. Li, "Camera model identification for JPEG images via tensor analysis," in Proc. 6th Int. Conf. Intell. Inf. Hiding Multimedia Signal Process., 2010, pp. 462-465.
31. S. Bourennane, C. Fossati, and A. Cailly, "Improvement of classification for hyperspectral images based on tensor modeling," IEEE Geosci. Remote Sens. Lett., vol. 7, no. 4, pp. 801-805, Oct. 2010.
32. S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, and H.-J. Zhang, "Discriminant analysis with tensor representation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 526-532.
33. Y. Fu and T. Huang, "Image classification using correlation tensor analysis," IEEE Trans. Image Process., vol. 17, no. 2, pp. 226-234, Feb. 2008. (Pubitemid 351279250)
34. H. Lu, K. Plataniotis, and A. Venetsanopoulos, "A survey of multilinear subspace learning for tensor data," Pattern Recogn., vol. 44, no. 7, pp. 1540-1551, 2011.
35. D. Tao, X. Li, W. Hu, S. Maybank, and X. Wu, "Supervised tensor learning," in Proc. 5th IEEE Int. Conf. Data Mining, Houston, TX, USA, Nov. 2005, pp. 450-457. (Pubitemid 47385725)
36. D. Cai, X. He, and J. Han, "Learning with tensor representation," Dept. Comput. Sci., Univ. Illinois at Urbana-Champaign, Urbana, IL, USA, Tech. Rep. UIUCDCS-R-2006-2716, Apr. 2006.
37. D. Tao, X. Li, X. Wu, W. Hu, and S. Maybank, "Supervised tensor learning," Knowl. Inf. Syst., vol. 13, no. 1, pp. 1-42, 2007.
38. Y. Liu, F. Wu, Y. Zhuang, and J. Xiao, "Active post-refined multimodal-ity video semantic concept detection with tensor representation, " in Proc. ACM Conf. Multimedia, 2008, pp. 91-100.
39. I. Kotsia and I. Patras, "Support tucker machines," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2001, pp. 633-640.
40. L. Wolf, H. Jhuang, and T. Hazan, "Modeling appearances with low-rank SVM," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-6.
41. H. Pirsiavash, D. Ramanan, and C. Fowlkes, "Bilinear classifiers for visual recognition," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2009, pp. 1482-1490.
42. C. Cortes and V. Vapnik, "Support vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
43. B. Schölkopf, A. Smola, R. Williamson, and P. Bartlett, "New support vector algorithms," Neural Comput., vol. 12, no. 5, pp. 1207-1245, 2000.
44. J. Suykens and J. Vandewalle, "Least squares support vector machine classifiers," Neural Process. Lett., vol. 9, no. 3, pp. 293-300, 1999.
45. P. Savicky and J. Vomlel, "Exploiting tensor rank-one decomposition in probabilistic inference," Kybernetika, vol. 43, no. 5, pp. 747-764, 2007.
46. H. Wang and N. Ahuja, "Rank-R approximation of tensors using image-as-matrix representation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 346-353.
47. L. Lathauwer, "Signal processing based on multilinear algebra," Ph.D. dissertation, Dept. Elektrotechniek, Katholieke Univ., Leuven, Belgium, Sep. 1997.
48. H. Lu, K. Plataniotis, and A. Venetsanopoulos, "A taxonomy of emerging multilinear discriminant analysis solutions for biometric signal recognition," in Biometrics: Theory, Methods, and Applications, N. V. Boul-gouris, K. Plataniotis, and E. Micheli-Tzanakou, Eds. New York, NY, USA: Wiley, 2009.
49. S. Goreinov, E. Tyrtyshnikov, and N. Zamarashkin. "A theory of pseudoskeleton approximations," Linear Algebra Appl., vol. 261, nos. 1-3, pp. 1-21, 1997. (Pubitemid 127380509)
50. T. Zhang and G. Golub, "Rank-one approximation to high order tensors," SIAM J. Matrix Anal. Appl., vol. 23, no. 2, pp. 534-550, 2001.
51. S. Keerthi, S. Shevade, C. Bhattacharyya, and K. Murthy, "Improvement to Platt's SMO algorithm for SVM classifier design," Neural Comput., vol. 13, no. 3, pp. 637-649, 2001. (Pubitemid 33595014)
52. U. Kreßel, "Pairwise classification and support vector machines," in Advances in Kernel Methods: Support Vector Learning. Cambridge MA, USA: MIT Press, 1999, pp. 255-268.
53. C.-T. Chu, S. Kim, Y.-A. Lin, Y. Yu, G. Bradski, A. Ng, and K. Oluko-tun, "Map-reduce for machine learning on multicore," in Advances in Neural Information Processing Systems. Cambridge MA, USA: MIT Press, 2006, pp. 281-288.
54. P. Kroonenberg and J. Leeuw, "Principal component analysis of three-mode data by means of alternating least squares algorithms," Psychome-trika, vol. 45, no. 1, pp. 69-97, Mar. 1980.
55. P. Clarkson and P. Moreno, "On the use of support vector machines for phonetic classification," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Mar. 1999, pp. 585-588.
56. S. Maji, A. Berg, and J. Malik, "Efficient classification for additive kernel SVMs," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 66-77, Jan. 2013.
57. J. Demšar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, pp. 1-30, Jan. 2006. (Pubitemid 43022939)
58. Y. Hochberg, "A sharper Bonferroni procedure for multiple tests of significance," Biometrika, vol. 75, no. 4, pp. 800-802, 1988.
59. M. Kilmer and C. Martin, "Factorization strategies for third-order tensors," Linear Algebra Appl., vol. 435, no. 3, pp. 641-658, Aug. 2011.
60. V. Silva and L.-H. Lim, "Tensor rank and the ill-posedness of the best low-rank approximation problem," SIAM J. Matrix Anal. Appl., vol. 30, no. 3, pp. 1084-1127, 2008.
61. C. Martin, "The rank of a 2×2×2 tensor," Linear and Multilinear Algebra, vol. 59, no. 8, pp. 943-950, 2011.