Landmark Summarization With Diverse Viewpoints

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 25, Issue 11, 2015, Pages 1857-1869

  Qian, Xueming ^a   Xue, Yao ^a   Yang, Xiyu ^a   Tang, Yuan Yan ^b   Hou, Xingsong ^a   Mei, Tao ^c  

^a XI'AN JIAOTONG UNIVERSITY   (China)

^b UNIVERSITY OF MACAU   (Macao)

^c MICROSOFT RESEARCH   (United States)

Author keywords

geometric consistency check; landmark retrieval; viewpoint modeling; Visual summarization

Indexed keywords

VIDEO SIGNAL PROCESSING;

CONSISTENCY CHECKS; DESCRIPTORS; LANDMARK RETRIEVAL; SPATIAL LAYOUT; VISUAL SUMMARIZATION;

NETWORKS (CIRCUITS);

EID: 84961574647     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2014.2369731     Document Type: Article

References (46)

1. A. Jaffe, M. Naaman, T. Tassa, and M. Davis, "Generating summaries and visualization for large collections of geo-referenced photographs," in Proc. 8th ACM Int. Workshop Multimedia Inf. Retr., 2006, pp. 89-98.
2. A. Shokoufandeh and S. Dickinson, "Graph-theoretical methods in computer vision," in Theoretical Aspects of Computer Science (Lecture Notes in Computer Science), vol. 2292. Berlin, Germany: Springer-Verlag, 2002, pp. 148-174. [Online]. Available: http://link.springer.com/chapter/10.1007/3-540-45878-6-5
3. A. Qamra and E. Y. Chang, "Scalable landmark recognition using EXTENT," Multimedia Tools Appl., vol. 38, no. 2, pp. 187-208, Jun. 2008.
4. B. Jiao, L. Yang, J. Xu, and F. Wu, "Visual summarization of web pages," in Proc. 33rd Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., 2010, pp. 499-506.
5. D. J. Crandall, L. Backstrom, D. Huttenlocher, and J. Kleinberg, "Mapping the world's photos," in Proc. 18th Int. Conf. World Wide Web, 2009, pp. 761-770.
6. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
7. E. Gavves, C. G. M. Snoek, and A. W. M. Smeulders, "Visual synonyms for landmark image retrieval," Comput. Vis. Image Understand., vol. 166, no. 2, pp. 238-249, Feb. 2012.
8. H. Xu, J. Wang, X.-S. Hua, and S. Li, "Interactive image search by 2D semantic map," in Proc. Conf. 19th World Wide Web, 2010, pp. 1321-1324.
9. H. C. Wu, R. W. P. Luk, K. F. Wong, and K. L. Kwok, "Interpreting TF-IDF term weights as making relevance decisions," ACM Trans. Inf. Syst., vol. 26, no. 3, Jun. 2008, Art. ID 13.
10. I. Simon, N. Snavely, and S. M. Seitz, "Scene summarization for online image collections," in Proc. ICCV, 2007, pp. 1-8.
11. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. 9th IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 1470-1477.
12. J. Li, X. Qian, Y. Tang, and L. Yang, "GPS estimation from users' photos," in Proc. 19th Int. Conf. MMM, 2013, pp. 118-129.
13. L. Cao et al., "Rank Compete: Simultaneous ranking and clustering of information networks," Neurocomputing, vol. 95, pp. 98-104, Oct. 2012.
14. L. S. Kennedy and M. Naaman, "Generating diverse and representative image search results for landmarks," in Proc. 17th Int. Conf. World Wide Web, 2008, pp. 297-306.
15. M. Stricker and M. Orengo, "Similarity of color images," in Proc. SPIE Storage Retr. Image Video Databases, 1995, pp. 381-392.
16. B. S. Manjunath and W. Y. Ma, "Texture features for browsing and retrieval of image data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 8, pp. 837-842, Aug. 1996.
17. M. Park, J. Luo, R. T. Collins, and Y. Liu, "Beyond GPS: Determining the camera viewing direction of a geotagged image," in Proc. Int. Conf. ACM Multimedia, 2010, pp. 631-634.
18. N. Snavely, S. M. Seitz, and R. Szeliski, "Photo tourism: Exploring photo collections in 3D," in Proc. ACM SIGGRAPH, 2006, pp. 835-846.
19. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
20. R. Kadobayashi and K. Tanaka, "3D viewpoint-based photo search and information browsing," in Proc. 28th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., 2005, pp. 621-622.
21. R. H. van Leuken, L. Garcia, X. Olivares, and R. van Zwol, "Visual diversification of image search results," in Proc. 18th Int. Conf. World Wide Web, 2009, pp. 341-350.
22. S. Palmer, E. Rosch, and P. Chase, "Canonical perspective and the perception of objects," in Proc. Attention Perform. IX, 1981, pp. 135-151.
23. S. Ahern, M. Naaman, R. Nair, and J. H.-I. Yang, "World explorer: Visualizing aggregate data from unstructured text in geo-referenced collections," in Proc. 7th ACM/IEEE Joint Conf. Digital Libraries, 2007, pp. 1-10.
24. S. Papadopoulos, C. Zigkolis, Y. Kompatsiaris, and A. Vakali, "Clusterbased landmark and event detection for tagged photo collections," IEEE Multimedia Mag., vol. 18, no. 1, pp. 52-63, Jan. 2011.
25. T. Berg and D. Forsyth, "Automatic ranking of iconic images," Dept. Elect. Eng. Comput. Sci., Univ. California, Berkeley, Berkeley, CA, USA, Tech. Rep. UCB/EECS-2007-13, Jan. 2007.
26. T. Quack, B. Leibe, and L. van. Gool, "World-scale mining of objects and events from community photo collections," in Proc. Int. ACM Conf. Content-Based Image Video Retr., 2008, pp. 47-56.
27. W.-C. Chen, A. Battestini, N. Gelfand, and V. Setlur, "Visual summaries of popular landmarks from community photo collections," in Proc. 43rd Asilomar Conf. Signals, Syst. Comput., Nov. 2009, pp. 1248-1255.
28. X. Li, C. Wu, C. Zach, S. Lazebnik, and J.-M. Frahm, "Modeling and recognition of landmark image collections using iconic scene graphs," in Proc. ECCV, 2008, pp. 427-440.
29. X.-Q. Cheng, P. Du, J. Guo, X. Zhu, and Y. Chen, "Ranking on data manifold with sink points," IEEE Trans. Knowl. Data Eng., vol. 25, no. 1, pp. 177-191, Jan. 2013.
30. Y. Jing and S. Baluja, "Visualrank: Applying pagerank to large-scale image search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1877-1890, Nov. 2008.
31. Y.-T. Zheng et al., "Tour the world: Building a web-scale landmark recognition engine," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1085-1092.
32. Y.-L. Zhao, Y.-T. Zheng, X. Zhou, and T.-S. Chua, "Generating representative views of landmarks via scenic theme detection," in Proc. 17th Int. Multimedia Modeling Conf., 2011, pp. 392-402.
33. Y. Ren, M. Yu, X.-J. Wang, L. Zhang, and W.-Y. Ma, "Diversifying landmark image search results by learning interested views from community photos," in Proc. 19th Int. Conf. World Wide Web, 2010, pp. 1289-1292.
34. Y. Li, D. Crandall, and D. Huttenlocher, "Landmark classification in large-scale image collections," in Proc. IEEE 12th ICCV, Sep. 2009, pp. 1957-1964.
35. Y. Avrithis, Y. Kalantidis, G. Tolias, and E. Spyrou, "Retrieving landmark and non-landmark images from community photo collections," in Proc. Int. Conf. Multimedia, 2010, pp. 153-162.
36. Y. Xue and X. Qian, "Visual summarization of landmarks via viewpoint modeling," in Proc. IEEE 19th Int. Conf. Image Process., Sep./Oct. 2012, pp. 2873-2876.
37. S. Jiang, X. Qian, Y. Xue, F. Li, and X. Hou, "Generating representative images for landmark by discovering high frequency shooting locations from community-contributed photos," in Proc. Int. Conf. Multimedia Expo Workshops, Jul. 2013, pp. 1-6.
38. T. Weyand and B. Leibe, "Discovering favorite views of popular places with iconoid shift," in Proc. IEEE ICCV, Nov. 2011, pp. 1132-1129.
39. B. Ionescu, M. Menéndez, H. Müller, and A. Popescu, "Retrieving diverse social images at mediaeval 2013: Objectives, dataset and evaluation," Working Notes MediaEval, Barcelona, Spain, Tech. Rep. DISI-13-038, Jan. 2013.
40. R. Ji, X. Xie, H. Yao, and W.-Y. Ma, "Mining city landmarks from blogs by graph modeling," in Proc. 17th Int. Conf. Multimedia, 2009, pp. 105-114.
41. Y. Pang, Q. Hao, Y. Yuan, T. Hu, R. Cai, and L. Zhang, "Summarizing tourist destinations by mining user-generated travelogues and photos," Comput. Vis. Image Understand., vol. 115, no. 3, pp. 352-363, Mar. 2011.
42. J. Li, X. Qian, Y. Y. Tang, L. Yang, and T. Mei, "GPS estimation for places of interest from social users' uploaded photos," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 2058-2071, Dec. 2013.
43. H. Jegou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Proc. 10th Eur. Conf. Comput. Vis., 2008, pp. 304-317.
44. W. Zhou, Y. Lu, H. Li, Y. Song, and Q. Tian, "Spatial coding for large scale partial-duplicate web image search," in Proc. Int. Conf. MM, 2010, pp. 511-520.
45. X. Yang and X. Qian, "Spatial verification for scalable mobile image retrieval," presented at the ACM Int. Conf. Inf. Knowl. Manage., Shanghai, China, Nov. 2014.
46. Y. Xue, X. Qian, and B. Zhang, "Mobile image retrieval using multiphotos as query," in Proc. Int. Conf. Multimedia Expo Workshops, Jul. 2013, pp. 1-4.