Group sparse Multiview patch alignment framework with view consistency for image classification

IEEE Transactions on Image Processing

Volumn 23, Issue 7, 2014, Pages 3126-3137

  Gui, Jie ^a,b   Tao, Dacheng ^c   Sun, Zhenan ^b   Luo, Yong ^d   You, Xinge ^e   Tang, Yuan Yan ^f  

^a INSTITUTE OF INTELLIGENT MACHINES   (China)

^b INSTITUTE OF AUTOMATION   (China)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^d Peking University   (China)

^e HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^f UNIVERSITY OF MACAU   (Macao)

Author keywords

[No Author keywords available]

Indexed keywords

ALIGNMENT; FEATURE EXTRACTION; LINEAR TRANSFORMATIONS; SEMANTICS;

COMPLEMENTARY PROPERTY; DIMENSIONALITY REDUCTION ALGORITHMS; MULTI-VIEW LEARNING; PROJECTION MATRIX; REAL-WORLD IMAGE DATA; RELEVANT FEATURES; SEMANTIC CONCEPT; VIEW CONSISTENCY;

IMAGE CLASSIFICATION;

EID: 84903120310     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2326001     Document Type: Article

References (85)

1. Z.-G. Fan and B.-L. Lu, "Fast recognition of multi-view faces with feature selection," in Proc. 10th IEEE ICCV, Oct. 2005, pp. 76-81. (Pubitemid 44054943)
2. C. M. Christoudias, R. Urtasun, and T. Darrell, "Unsupervised feature selection via distributed coding for multi-view object recognition," in Proc. CCVPR, Jun. 2008, pp. 1-8.
3. J. Tang, R. Hong, S. Yan, T.-S. Chua, G.-J. Qi, and R. Jain, "Image annotation by KNN-sparse graph-based label propagation over noisily tagged web images," ACM Trans. Intell. Syst. Technol., vol. 2, no. 2, p. 14, 2011.
4. J. Tang, Z.-J. Zha, D. Tao, and T.-S. Chua, "Semantic-gap-oriented active learning for multilabel image annotation," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2354-2360, Apr. 2012.
5. J. Tang, H. Li, G.-J. Qi, and T.-S. Chua, "Image annotation by graph-based inference with integrated multiple/single instance representations," IEEE Trans. Multimedia, vol. 12, no. 2, pp. 131-141, Feb. 2010.
6. J. Yang, J.-Y. Yang, D. Zhang, and J. Lu, "Feature fusion: Parallel strategy vs. serial strategy," Pattern Recognit., vol. 36, no. 6, pp. 1369-1381, 2003. (Pubitemid 36225872)
7. D. Wu, J. Cao, J. Wang, and W. Li, "Multi-feature fusion face recognition based on kernel discriminate local preserve projection algorithm under smart environment," J. Comput., vol. 7, no. 10, pp. 2479-2487, 2012.
8. U. G. Mangai, S. Samanta, S. Das, and P. R. Chowdhury, "A survey of decision fusion and feature fusion strategies for pattern classification," IETE Tech. Rev., vol. 27, no. 4, p. 293, 2010.
9. M. Temerinac-Ott, O. Ronneberger, P. Ochs, W. Driever, T. Brox, and H. Burkhardt, "Multiview deblurring for 3-D images from light-sheet-based fluorescence microscopy," IEEE Trans. Image Process., vol. 21, no. 4, pp. 1863-1873, Apr. 2012.
10. G. Cheung, V. Velisavljevic, and A. Ortega, "On dependent bit allocation for multiview image coding with depth-image-based rendering," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3179-3194, Nov. 2011.
11. A. Gelman, P. L. Dragotti, and V. Velisavljevic, "Multiview image coding using depth layers and an optimized bit allocation," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4092-4105, Sep. 2012.
12. C. Xu, D. Tao, and C. Xu, "Large-margin multi-view information bottleneck," IEEE Trans. Pattern Anal. Mach. Intell., to be published.
13. C. Xu, D. Tao, and C. Xu, "A survey on multi-view learning," ArXiv: 1304.5634, 2013.
14. T. Xia, D. Tao, T. Mei, and Y. Zhang, "Multiview spectral embedding," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 6, pp. 1438-1446, Dec. 2010.
15. J. Gui, Z. Sun, J. Cheng, S. Ji, and X. Wu, "How to estimate the regularization parameter for spectral regression discriminant analysis and its kernel version?" IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 2, pp. 211-223, Feb. 2014.
16. B. Xie, Y. Mu, D. Tao, and K. Huang, "m-SNE: Multiview stochastic neighbor embedding," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 4, pp. 1088-1096, Aug. 2011.
17. J. Gui, S.-L. Wang, and Y.-K. Lei, "Multi-step dimensionality reduction and semi-supervised graph-based tumor classification using gene expression data," Artif. Intell. Med., vol. 50, no. 3, pp. 181-191, 2010.
18. B. Long, S. Y. Philip, and Z. M. Zhang, "A general model for multiple view unsupervised learning," in Proc. SIAM Int. Conf. Data Mining, Apr. 2008, pp. 822-833.
19. J. Gui, W. Jia, L. Zhu, S.-L. Wang, and D.-S. Huang, "Locality preserving discriminant projections for face and palmprint recognition," Neurocomputing, vol. 73, no. 13, pp. 2696-2707, 2010.
20. B. Lin, X. He, C. Zhang, and M. Ji, "Parallel vector field embedding," J. Mach. Learn. Res., vol. 14, no. 1, pp. 2945-2977, 2013.
21. X. Mao, B. Lin, D. Cai, X. He, and J. Pei, "Parallel field alignment for cross media retrieval," in Proc. 21st ACM Int. Conf. Multimedia, Oct. 2013, pp. 897-906.
22. B. Lin, S. Yang, C. Zhang, J. Ye, and X. He, "Multi-task vector field learning," in Proc. Neural Inform. Process. Syst., Dec. 2012, pp. 296-304.
23. Z. Zhao and H. Liu, "Multi-source feature selection via geometry-dependent covariance analysis," J. Mach. Learn. Res., vol. 4, pp. 36-47, Sep. 2008.
24. V. Bolón-Canedo, N. Sánchez-Maroño, and A. Alonso-Betanzos, "A review of feature selection methods on synthetic data," Knowl. Inform. Syst., vol. 34, no. 3, pp. 483-519, 2013.
25. Q. Gu, Z. Li, and J. Han, "Joint feature selection and subspace learning," in Proc. Int. Joint Conf. Artif. Intell., Jul. 2011, pp. 1294-1299.
26. A. Zien and C. S. Ong, "Multiclass multiple kernel learning," in Proc. Int. Conf. Mach. Learn., Jun. 2007, pp. 1191-1198.
27. Y.-S. Chen and C.-H. Cheng, "Application of rough set classifiers for determining hemodialysis adequacy in ESRD patients," Knowl. Inform. Syst., vol. 34, no. 2, pp. 453-482, 2013.
28. T. T. Nguyen, K. Chang, and S. C. Hui, "Supervised term weighting centroid-based classifiers for text categorization," Knowl. Inform. Syst., vol. 35, no. 1, pp. 61-85, 2013.
29. D. Zhou and C. J. Burges, "Spectral clustering and transductive learning with multiple views," in Proc. Int. Conf. Mach. Learn., Jun. 2007, pp. 1159-1166.
30. S. Bickel and T. Scheffer, "Multi-view clustering," in Proc. 4th IEEE ICDM, vol. 36. Nov. 2004, pp. 19-26. (Pubitemid 40731009)
31. Y. Yan, L. Chen, and W.-C. Tjhi, "Semi-supervised fuzzy co-clustering algorithm for document categorization," Knowl. Inform. Syst., vol. 34, no. 1, pp. 55-74, 2013.
32. A. Tagarelli and G. Karypis, "A segment-based approach to clustering multi-topic documents," Knowl. Inform. Syst., vol. 34, no. 3, pp. 563-595, 2013.
33. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, 2000. (Pubitemid 32041578)
34. J. B. Tenenbaum, V. De Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, 2000. (Pubitemid 32041577)
35. P. N. Belhumeur, J. P. Hespanha, and D. Kriegman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997. (Pubitemid 127762263)
36. Z.-Y. Zhang, T. Li, and C. Ding, "Non-negative tri-factor tensor decomposition with applications," Knowl. Inform. Syst., vol. 34, no. 2, pp. 243-265, 2013.
37. Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N. Le Roux, and M. Ouimet, "Out-of-sample extensions for LLE, isomap, MDS, eigenmaps, and spectral clustering," in Proc. Neural Inform. Process. Syst., 2004, pp. 177-184.
38. T. Zhang, D. Tao, and J. Yang, "Discriminative locality alignment," in Proc. ECCV, 2008, pp. 725-738.
39. T. Zhang, D. Tao, X. Li, and J. Yang, "Patch alignment for dimensionality reduction," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1299-1313, Sep. 2009.
40. X. Tian, D. Tao, X.-S. Hua, and X. Wu, "Active reranking for web image search," IEEE Trans. Image Process., vol. 19, no. 3, pp. 805-820, Mar. 2010.
41. X. He and P. Niyogi, "Locality preserving projections," in Proc. Neural Inform. Process. Syst., 2004, pp. 153-160.
42. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, "Face recognition using laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005. (Pubitemid 40377326)
43. Q. Sun, Q. Chen, and D. Xia, "Face representation and recognition using partial least squares regression," J. Jiangnan Univ., vol. 7, no. 1, pp. 1-5, 2008.
44. F. Deleus and M. M. Van Hulle, "A connectivity-based method for defining regions-of-interest in fMRI data," IEEE Trans. Image Process., vol. 18, no. 8, pp. 1760-1771, Aug. 2009.
45. D. P. Foster, S. M. Kakade, and T. Zhang, "Multi-view dimensionality reduction via canonical correlation analysis," Dept. Statist., Univ. Pennsylvania, Philadelphia, PA, USA, Tech. Rep. TTI-TR-2008-4, 2008.
46. K. Chaudhuri, S. M. Kakade, K. Livescu, and K. Sridharan, "Multi-view clustering via canonical correlation analysis," in Proc. 26th Int. Conf. Mach. Learn., Jun. 2009, pp. 129-136.
47. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," J. Mach. Learn. Res., vol. 3, pp. 1157-1182, Jan. 2003.
48. J. Gui, Z. Sun, W. Jia, R. Hu, Y. Lei, and S. Ji, "Discriminant sparse neighborhood preserving embedding for face recognition," Pattern Recognit., vol. 45, no. 8, pp. 2884-2893, 2012.
49. D. Cai, X. He, and J. Han, "Spectral regression: A unified approach for sparse subspace learning," in Proc. IEEE 7th ICDM, Oct. 2007, pp. 73-82.
50. E. Kokiopoulou, D. Kressner, and P. Frossard, "Optimal image alignment with random projections of manifolds: Algorithm and geometric analysis," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1543-1557, Jun. 2011.
51. H. Zou, T. Hastie, and R. Tibshirani, "Sparse principal component analysis," J. Comput. Graph. Statist., vol. 15, no. 2, pp. 265-286, 2006. (Pubitemid 43935978)
52. B. Moghaddam, Y. Weiss, and S. Avidan, "Generalized spectral bounds for sparse LDA," in Proc. 23rd Int. Conf. Mach. Learn., Jun. 2006, pp. 641-648.
53. F. Nie, H. Huang, X. Cai, and C. Ding, "Efficient and robust feature selection via joint l2,1-norms minimization," in Proc. Neural Inform. Process. Syst., 2010, pp. 1813-1821.
54. C. Ding, D. Zhou, X. He, and H. Zha, "R1-PCA: Rotational invariant L1-norm principal component analysis for robust subspace factorization," in Proc. 23rd Int. Conf. Mach. Learn., Jun. 2006, pp. 281-288.
55. A. Argyriou, T. Evgeniou, and M. Pontil, "Convex multi-task feature learning," Mach. Learn., vol. 73, no. 3, pp. 243-272, 2008.
56. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. Conf. Comput. Learn. Theory, Jul. 1998, pp. 92-100.
57. K. Hiroyuki and Y. Morimoto, "Unsupervised word-sense disambiguation using bilingual comparable corpora," IEICE Trans. Inform. Syst., vol. 88, no. 2, pp. 289-301, 2005. (Pubitemid 41228095)
58. Z.-H. Zhou and M. Li, "Tri-training: Exploiting unlabeled data using three classifiers," IEEE Trans. Knowl. Data Eng., vol. 17, no. 11, pp. 1529-1541, Nov. 2005. (Pubitemid 41704840)
59. S. Dasgupta, M. L. Littman, and D. McAllester, "PAC generalization bounds for co-training," in Proc. Neural Inform. Process. Syst., Dec. 2002, pp. 375-382.
60. K. Nigam, A. K. McCallum, S. Thrun, and T. Mitchell, "Text classification from labeled and unlabeled documents using EM," Mach. Learn., vol. 39, nos. 2-3, pp. 103-134, 2000. (Pubitemid 30594822)
61. U. Brefeld and T. Scheffer, "Co-EM support vector learning," in Proc. 21st Int. Conf. Mach. Learn., Jul. 2004, pp. 16-23.
62. R. Hwa, M. Osborne, A. Sarkar, and M. Steedman, "Corrected co-training for statistical parsers," in Proc. ICML Workshop Continuum Labeled Unlabeled Data Mach. Learn. Data Mining, 2003, pp. 2-1.
63. D. Pierce and C. Cardie, "Limitations of co-training for natural language learning from large datasets," in Proc. Conf. Empirical Methods Natural Lang. Process., Jun. 2001, pp. 1-9.
64. K. Wang, R. He, W. Wang, L. Wang, and T. Tan, "Learning coupled feature spaces for cross-modal matching," in Proc. ICCV, Dec. 2013, pp. 2088-2095.
65. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal semi-supervised learning for image classification," in Proc. Conf. CVPR, Jun. 2010, pp. 902-909.
66. M. J. Huiskes, B. Thomee, and M. S. Lew, "New trends and ideas in visual concept detection: The mir flickr retrieval evaluation initiative," in Proc. Int. Conf. Multimedia Inform. Retr., Mar. 2010, pp. 527-536.
67. N. Srivastava and R. R. Salakhutdinov, "Multimodal learning with deep Boltzmann machines," in Proc. Neural Inform. Process. Syst., Dec. 2012, pp. 2231-2239.
68. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Ng, "Multimodal deep learning," in Proc. Int. Conf. Mach. Learn., 2011, pp. 689-696.
69. A. Rakotomamonjy, F. R. Bach, S. Canu, and Y. Grandvalet, "Simplemkl," J. Mach. Learn. Res., vol. 9, pp. 2491-2521, Nov. 2008.
70. M. Kloft, U. Brefeld, S. Sonnenburg, and A. Zien, "L p-norm multiple kernel learning," J. Mach. Learn. Res., vol. 12, pp. 953-997, Jan. 2011.
71. A. J. Smola, R. C. Williamson, and B. Schölkopf, "Generalization bounds for convex combinations of kernel functions," Dept. Eng., Australian Nat. Univ., Canberra, Australia, Tech. Rep. NC2-TR-1998- 022, 1998.
72. A. Argyriou, C. A. Micchelli, and M. Pontil, "Learning convex combinations of continuously parameterized basic kernels," in Proc. Conf. Learn. Theory, 2005, pp. 338-352.
73. B. McFee and G. Lanckriet, "Learning multi-modal similarity," J. Mach. Learn. Res., vol. 12, pp. 491-523, Feb. 2011.
74. G. R. Lanckriet, N. Cristianini, P. Bartlett, L. E. Ghaoui, and M. I. Jordan, "Learning the kernel matrix with semidefinite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, Dec. 2004.
75. M. Gönen and E. Alpayd?n, "Multiple kernel learning algorithms," J. Mach. Learn. Res., vol. 12, pp. 2211-2268, Feb. 2011.
76. Z. Y. Zhang and H. Y. Zha, "Principal manifolds and nonlinear dimension reduction via local tangent space alignment," SIAM J. Sci. Comput., vol. 26, no. 1, pp. 313-338, 2005.
77. M. Wang, X. S. Hua, X. Yuan, Y. Song, and L. R. Dai, "Optimizing multi-graph learning: Towards a unified video annotation scheme," in Proc. Int. Conf. Multimedia, Sep. 2007, pp. 862-871.
78. R. Bhatia, Matrix Analysis, vol. 169. Berlin, Germany: Springer-Verlag, 1997.
79. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. (2007). The PASCAL Visual Object Classes Challenge (VOC2007) Results [Online]. Available: http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index. html
80. M. J. Huiskes and M. S. Lew, "The MIR flickr retrieval evaluation," in Proc. 1st ACM Int. Conf. Multimedia Inform. Retr., Oct. 2008, pp. 39-43.
81. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid, "Tagprop: Discriminative metric learning in nearest neighbor models for image auto-annotation," in Proc. IEEE 12th ICCV, Sep./Oct. 2009, pp. 309-316.
82. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001. (Pubitemid 32680801)
83. J. Van De Weijer and C. Schmid, "Coloring local feature extraction," in Proc. ECCV, 2006, pp. 334-348. (Pubitemid 44029738)
84. T. Fawcett, "An introduction to ROC analysis," Pattern Recognit. Lett., vol. 27, no. 8, pp. 861-874, 2006.
85. M.-L. Zhang and Z.-H. Zhou, "ML-KNN: A lazy learning approach to multi-label learning," Pattern Recognit., vol. 40, no. 7, pp. 2038-2048, 2007. (Pubitemid 46497248)