Content-based visual landmark search via multimodal hypergraph learning

IEEE Transactions on Cybernetics

Volumn 45, Issue 12, 2015, Pages 2756-2769

  Zhu, Lei ^a   Shen, Jialie ^b   Jin, Hai ^a   Zheng, Ran ^a   Xie, Liang ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b SINGAPORE MANAGEMENT UNIVERSITY   (Singapore)

Author keywords

Content based visual landmark search; high order relations; multimodal hypergraph (MMHG); visual diversity

Indexed keywords

COMBINATION WEIGHTS; EXPERIMENT STUDY; HETEROGENEOUS SOURCES; LARGE SCALE TESTS; STATE-OF-THE-ART APPROACH; VISUAL APPEARANCE; VISUAL LANDMARKS; VISUAL MODALITIES;

EID: 84960130998     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2383389     Document Type: Article

References (53)

1. J. Shen, Z. Cheng, J. Shen, T. Mei, and X. Gao, "The evolution of research on multimedia travel guide search, and recommender systems. in Advances in Multimedia Modeling. Cham, Switzerland: Springer. 2014, pp. 227-238.
2. Q. Fang, J. Sang, and C. Xu, "GIANT: Geo-informative attributes for location recognition, and exploration. in Proc. ACM Int. Conf. Multimedia, Barcelona, Spain. 2013, pp. 13-22.
3. Z. Cheng, J. Ren, J. Shen, and H. Miao, "Building a large scale test collection for effective benchmarking of mobile landmark search. in Advances in Multimedia Modeling. Berlin, Germany: Springer. 2013, pp. 36-46.
4. E. Gavves, and C. G. Snoek, "Landmark image retrieval using visual synonyms. in Proc. ACM Int. Conf. Multimedia, Florence, Italy. 2010, pp. 1123-1126.
5. C. Deng, R. Ji, D. Tao, X. Gao, and X. Li, "Weakly supervised multigraph learning for robust image reranking. IEEE Trans. Multimedia, vol. 16, no. 3, pp. 785-795, Apr. 2014.
6. Y. Yang, et al., "Multi-feature fusion via hierarchical regression for multimedia analysis. IEEE Trans. Multimedia, vol. 15, no. 3, pp. 572-581, Apr. 2013.
7. X.-C. Xu, X.-S. Xu, Y. Wang, and X. Wang, "A heterogenous automatic feedback semi-supervised method for image reranking. in Proc. ACM. Int. Conf. Inf. Knowl. Manage., San Francisco, CA, USA. 2013, pp. 999-1008.
8. J. Shen, D. Tao, and X. Li, "Modality mixture projections for semantic video event detection. IEEE Trans. Circuits Syst. Video Technol, vol. 18, no. 11, pp. 1587-1596, Nov. 2008.
9. X. Wu, A. G. Hauptmann, and C. Ngo, "Measuring novelty, and redundancy with multiple modalities in cross-lingual broadcast news. Comput. Vis. Image Und, vol. 110, no. 3, pp. 418-431, 2008.
10. J. Shen, "Stochastic modeling western paintings for effective classification. Pattern Recognit, vol. 42, no. 2, pp. 293-301, 2009.
11. Z. Xu, I. W. Tsang, Y. Yang, Z. Ma, and A. G. Hauptmann, "Event detection using multi-level relevance labels, and multiple features. in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA. 2014, pp. 97-104.
12. Y. Ren, M. Yu, X.-J. Wang, L. Zhang, and W.-Y. Ma, "Diversifying landmark image search results by learning interested views from community photos. in Proc. Int. Conf. World Wide Web, Raleigh, NC, USA. 2010, pp. 1289-1292.
13. J. Ye, et al., "DLMSearch: Diversified landmark search by photo. in Proc. ACM Int. Conf. Multimedia, Nara, Japan. 2012, pp. 905-908.
14. R. Ji, et al., "Location discriminative vocabulary coding for mobile landmark search. Int. J. Comput. Vis, vol. 96, no. 3, pp. 290-314, 2012.
15. J. Sivic, and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos. in Proc. IEEE Int. Conf. Comput. Vis., Nice, France. 2003, pp. 1470-1477.
16. Q. Hao, et al., "3D visual phrases for landmark recognition. in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA. 2012, pp. 3594-3601.
17. X. Xiao, C. Xu, J. Wang, and M. Xu, "Enhanced 3-D modeling for landmark image classification. IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1246-1258, Aug. 2012.
18. R. Roberts, S. N. Sinha, R. Szeliski, and D. Steedly, "Structure from motion for scenes with large duplicate structures. in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA. 2011, pp. 3137-3144.
19. L. S. Kennedy, and M. Naaman, "Generating diverse, and representative image search results for landmarks. in Proc. ACM Int. Conf. World Wide Web. 2008, pp. 297-306.
20. T. Chen, and K. Yap, "Discriminative BoW framework for mobile landmark recognition. IEEE Trans. Cybern, vol. 44, no. 5, pp. 695-706, May 2014.
21. Y. Yang, Z. Ma, Y. Yang, F. Nie, and H. T. Shen, "Multi-Task spectral clustering by exploring inter-Task correlation. IEEE Trans. Cybern., to be published
22. P. Qian, F. Chung, S. Wang, and Z. Deng, "Fast graph-based relaxed clustering for large data sets using minimal enclosing ball. IEEE Trans. Syst., Man, Cybern. B, Cybern, vol. 42, no. 3, pp. 672-687, Jun. 2012.
23. X. Geng, D.-C. Zhan, and Z.-H. Zhou, "Supervised nonlinear dimensionality reduction for visualization, and classification. IEEE Trans. Syst., Man, Cybern. B, Cybern, vol. 35, no. 6, pp. 1098-1107, Dec. 2005.
24. Y. Zhang, K. Huang, X. Hou, and C. Liu, "Learning locality preserving graph from data. IEEE Trans. Cybern, vol. 44, no. 11, pp. 2088-2098, Nov. 2014.
25. J. Song, Y. Yang, Z. Huang, H. T. Shen, and J. Luo, "Effective multiple feature hashing for large-scale near-duplicate video retrieval. IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1997-2008, Dec. 2013.
26. Y. Yang, et al., "A multimedia retrieval framework based on semisupervised ranking, and relevance feedback. IEEE Trans. Pattern Anal. Mach. Intell, vol. 34, no. 4, pp. 723-742, Apr. 2012.
27. S. Jones, and L. Shao, "A multigraph representation for improved unsupervised/semi-supervised learning of human actions. in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2014, pp. 820-826.
28. L. Shao, D. Wu, and X. Li, "Learning deep, and wide: A spectral method for learning deep networks. IEEE Trans. Neural Netw. Learn, vol. 25, no. 12, pp. 2303-2308, Dec. 2014.
29. Y. Huang, Q. Liu, and D. N. Metaxas, "Video object segmentation by hypergraph cut. in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Miami, FL, USA. 2009, pp. 1738-1745.
30. L. Zhang, et al., "Feature correlation hypergraph: Exploiting high-order potentials for multimodal recognition. IEEE Trans. Cybern, vol. 44, no. 8, pp. 1408-1419, Aug. 2014.
31. Y. Huang, Q. Liu, S. Zhang, and D. Metaxas, "Image retrieval via probabilistic hypergraph ranking. in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, USA. 2010, pp. 3376-3383.
32. Y. Gao, M. Wang, D. Tao, R. Ji, and Q. Dai, "3-D object retrieval, and recognition with hypergraph analysis. IEEE Trans. Image Process, vol. 21, no. 9, pp. 4290-4303, Sep. 2012.
33. C. Snoek, M. Worring, and A. W. M. Smeulders, "Early versus late fusion in semantic video analysis. in Proc. ACM Int. Conf. Multimedia, Singapore. 2005, pp. 399-402.
34. Y. Wu, E. Y. Chang, K. C.-C. Chang, and J. R. Smith, "Optimal multimodal fusion for multimedia data analysis. in Proc. ACM Int. Conf. Multimedia, New York, NY, USA. 2004, pp. 572-579.
35. M. Varma, and D. Ray, "Learning the discriminative power-invariance trade-off. in Proc. IEEE Int. Conf. Comput. Vis., Rio de Janeiro, Brazil. 2007, pp. 1-8.
36. A. Vedaldi, V. Gulshan, M. Varma, and A. Zisserman, "Multiple kernels for object detection. in Proc. IEEE Int. Conf. Comput. Vis., Montreal, QC, Canada. 2009, pp. 606-613.
37. F. R. Bach, G. R. G. Lanckriet, and M. I. Jordan, "Multiple kernel learning, conic duality, and the SMO algorithm. in Proc. Int. Conf. Mach. Learn., Kyoto, Japan. 2004, p. 6.
38. Z. Ma, et al., "Complex event detection via multi-source video attributes. in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA. 2013, pp. 2627-2633.
39. S. Wang, et al., "Semi-supervised multiple feature analysis for action recognition. IEEE Trans. Multimedia, vol. 16, no. 2, pp. 289-298, Feb. 2014.
40. Z. Xu, Y. Yang, I. Tsang, N. Sebe, and A. G. Hauptmann, "Feature weighting via optimal thresholding for video analysis. in Proc. IEEE Int. Conf. Comput. Vis., Sydney, NSW, Australia. 2013, pp. 3440-3447.
41. F. Mindru, T. Tuytelaars, L. V. Gool, and T. Moons, "Moment invariants for recognition under changing viewpoint, and illumination. Comput. Vis. Image Und, vol. 94, nos. 1-3, pp. 3-27, 2004.
42. T. Ojala, M. Pietikäinen, and D. Harwood, "A comparative study of texture measures with classification based on featured distributions. Pattern Recognit, vol. 29, no. 1, pp. 51-59, 1996.
43. N. Dalal, and B. Triggs, "Histograms of oriented gradients for human detection. in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., San Diego, CA, USA. 2005, pp. 886-893.
44. S. Wei, D. Xu, X. Li, and Y. Zhao, "Joint optimization toward effective, and efficient image search. IEEE Trans. Cybern, vol. 43, no. 6, pp. 2216-2227, Dec. 2013.
45. D. G. Lowe, "Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis, vol. 60, no. 2, pp. 91-110, 2004.
46. A. Oliva, and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope. Int. J. Comput. Vis, vol. 42, no. 3, pp. 145-175, 2001.
47. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local, and global consistency. in Proc. Neural Inf. Process. Syst., Vancouver, BC, Canada. 2003, pp. 321-328.
48. X. Feng, H. Jin, R. Zheng, Z. Shao, and L. Zhu, "A segment-based sparse matrix-vector multiplication on CUDA. Concurr. Comput. Pract. Exp, vol. 26, no. 1, pp. 271-286, 2014.
49. J. He, M. Li, H. Zhang, H. Tong, and C. Zhang, "Generalized manifoldranking-based image retrieval. IEEE Trans. Image Process, vol. 15, no. 10, pp. 3170-3177, Oct. 2006.
50. J. Hays, and A. Efros, "IM2GPS: Estimating geographic information from a single image. in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA. 2008, pp. 1-8.
51. M. Wang, H. Li, D. Tao, K. Lu, and X. Wu, "Multimodal graph-based reranking for web image search. IEEE Trans. Image Process, vol. 21, no. 11, pp. 4649-4661, Nov. 2012.
52. J. Xu, V. Singh, Z. Guan, and B. Manjunath, "Unified hypergraph for image ranking in a multimodal context. in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Kyoto, Japan. 2012, pp. 2333-2336.
53. P. Duygulu, K. Barnard, J. de Freitas, and D. Forsyth, "Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. in Proc. Eur. Conf. Comput. Vis., Copenhagen, Denmark. 2002, pp. 97-112.