Robust and accurate mobile visual localization and its applications

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 9, Issue 1 SUPPL, 2013, Pages

  Liu, Heng ^a   Mei, Tao ^b   Li, Houqiang ^a   Luo, Jiebo ^c   Li, Shipeng ^b  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b MICROSOFT RESEARCH ASIA   (China)

^c UNIVERSITY OF ROCHESTER   (United States)

Author keywords

Geo tagging; Location based services; Mobile visual localization; Scene reconstruction

Indexed keywords

CONTEXT INFORMATION; DISCRIMINATIVE POWER; GEO-TAGGING; LARGE-SCALE DATASETS; LOCALIZATION METHOD; RETRIEVAL PERFORMANCE; SCENE RECONSTRUCTION; VISUAL LOCALIZATION;

DATA PROCESSING; GLOBAL POSITIONING SYSTEM; LOCATION BASED SERVICES; MAPS; QUERY PROCESSING; TELEPHONE SETS; TREES (MATHEMATICS);

IMAGE RETRIEVAL;

EID: 84886903458     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/2491735     Document Type: Conference Paper

References (38)

1. AVRITHIS, Y., KALANTIDIS, Y., TOLIAS, G., AND SPYROU, E. 2010. Retrieving landmark and non-landmark images from community photo collections. In Proceedings of the International Conference on Multimedia. ACM, 153-162.
2. BOURKE, S., MCCARTHY, K., AND SMYTH, B. 2011. The social camera: A case-study in contextual image recommendation. In Proceedings of the 16th International Conference on Intelligent User Interfaces. ACM, 13-22.
3. CHEN, D., BAATZ, G., KOSER, K., TSAI, S., VEDANTHAM, R., PYLVANAINEN, T., ROIMELA, K., CHEN, X., BACH, J., POLLEFEYS, M., GIROD, B., AND GRZESZCZUK, R. 2011. City-scale landmark identification on mobile devices. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 737-744.
4. CRANDALL, D., BACKSTROM, L., HUTTENLOCHER, D., AND KLEINBERG, J. 2009. Mapping the world's photos. In Proceedings of the 18th International Conference on World Wide Web. ACM, 761-770.
5. DOERSCH, C., SINGH, S., GUPTA, A., SIVIC, J., AND EFROS, A. A. 2012. What makes Paris look like Paris? ACM Trans. Graph. 31, 4, 101:1-101:9.
6. FREY, B. AND DUECK, D. 2007. Clustering by passing messages between data points. Science 315, 5814, 972-976. (Pubitemid 46281181)
7. GIROD, B., CHANDRASEKHAR, V., CHEN, D., CHEUNG, N., GRZESZCZUK, R., REZNIK, Y., TAKACS, G., TSAI, S., AND VEDANTHAM, R. 2011. Mobile visual search. IEEE Signal Proces. Mag. 28, 4, 61-76.
8. HARTLEY, R. I. AND ZISSERMAN, A. 2004. Multiple View Geometry in Computer Vision 2nd Ed. Cambridge University Press.
9. IRSCHARA, A., ZACH, C., FRAHM, J., AND BISCHOF, H. 2009. From structure-from-motion point clouds to fast location recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09). IEEE, 2599-2606.
10. JI, R., DUAN, L., CHEN, J., YAO, H., RUI, Y., CHANG, S., AND GAO, W. 2011. Towards low bit rate mobile visual search with multiple-channel coding. In Proceedings of the 19th ACM International Conference on Multimedia. ACM, 573-582.
11. JI, R., DUAN, L., CHEN, J., YAO, H., YUAN, J., RUI, Y., AND GAO, W. 2012. Location discriminative vocabulary coding for mobile landmark search. Int. J. Comput. Vision 96, 3, 290-314.
12. JOSEPHSON, K. AND BYROD, M. 2009. Pose estimation with radial distortion and unknown focal length. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09). IEEE, 2419-2426.
13. KNOPP, J., SIVIC, J., AND PAJDLA, T. 2010. Avoiding confusing features in place recognition. In Proceedings of the European Conference on Computer Vision (ECCV'10). 748-761.
14. KROEPFL, M.,WEXLER, Y., AND OFEK, E. 2010. Efficiently locating photographs in many panoramas. In Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 119-128.
15. LI, X.,WU, C., ZACH, C., LAZEBNIK, S., AND FRAHM, J. 2008. Modeling and recognition of landmark image collections using iconic scene graphs. In Proceedings of the European Conference on Computer Vision (ECCV'08). 427-440.
16. LI, Y., SNAVELY, N., AND HUTTENLOCHER, D. 2010. Location recognition using prioritized feature matching. In Proceedings of the European Conference on Computer Vision (ECCV'10). 791-804.
17. LIU, H.,MEI, T., LUO, J., LI, H., AND LI, S. 2012. Finding perfect rendezvous on the go: accurate mobile visual localization and its applications to routing. In Proceedings of the 20th ACM International Conference on Multimedia (MM'12). ACM, New York, NY, 9-18.
18. LOWE, D. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 2, 91-110.
19. LUO, J., JOSHI, D., YU, J., AND GALLAGHER, A. 2011. Geotagging in multimedia and computer visionla survey. Multimedia Tools Appl. 51, 1, 187-211.
20. LUO, Z., LI, H., TANG, J., HONG, R., AND CHUA, T. 2009. Viewfocus: Explore places of interests on Google maps using photos with view direction filtering. In Proceedings of the 17th ACM International Conference on Multimedia. ACM, 963-964.
21. NISTER, D. 2004. An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intel. 26, 6, 756-770.
22. NISTER, D. AND STEWENIUS, H. 2006. Scalable recognition with a vocabulary tree. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Vol. 2, IEEE, 2161-2168. (Pubitemid 44931581)
23. PARK, M., LUO, J., COLLINS, R., AND LIU, Y. 2010. Beyond GPS: Determining the camera viewing direction of a geotagged image. In Proceedings of the International Conference on Multimedia. ACM, 631-634.
24. PHILBIN, J., CHUM, O., ISARD, M., SIVIC, J., AND ZISSERMAN, A. 2007. Object retrieval with large vocabularies and fast spatial matching. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07). IEEE, 1-8.
25. PHILBIN, J., ISARD, M., SIVIC, J., AND ZISSERMAN, A. 2010. Descriptor learning for efficient retrieval. In Proceedings of the European Conference on Computer Vision (ECCV'10). Springer, 677-691.
26. SATTLER, T., LEIBE, B., AND KOBBELT, L. 2011. Fast image-based localization using direct 2d-to-3d matching. In Proceedings of the IEEE International Conference on Computer Vision (ICCV'11) IEEE, 667-674.
27. SCHINDLER, G., BROWN, M., AND SZELISKI, R. 2007. City-scale location recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07). IEEE, 1-7.
28. SCHROTH, G.,HUITL, R., CHEN, D., ABU-ALQUMSAN, M., AL-NUAIMI, A., AND STEINBACH, E. 2011. Mobile visual location recognition. IEEE Signal Process. Mag. 28, 4, 77-89.
29. SIVIC, J. AND ZISSERMAN, A. 2003. Video Google: A text retrieval approach to object matching in videos. In Proceedings of the 9th IEEE International Conference on Computer Vision. IEEE, 1470-1477.
30. SNAVELY, N., SEITZ, S., AND SZELISKI, R. 2006. Photo tourism: Exploring photo collections in 3d. ACM Trans. Graph. 25, 835-846. (Pubitemid 44481045)
31. TURCOT, P. AND LOWE, D. 2009. Better matching with fewer features: The selection of useful features in large database recognition problems. In Proceedings of the IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops). IEEE, 2109-2116.
32. WANG, X., YANG, M., COUR, T., ZHU, S., YU, K., AND HAN, T. X. 2011. Contextual weighting for vocabulary tree based image retrieval. In Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE, 209-216.
33. YU, F., JI, R., AND CHANG, S. 2011. Active query sensing for mobile location search. In Proceedings of the 19th ACM International Conference on Multimedia. ACM, 3-12.
34. ZAMIR, A. AND SHAH, M. 2010. Accurate image localization based on google maps street view. In Proceedings of the European Conference on Computer Vision (ECCV'10). 255-268.
35. ZHANG, S., YANG, M., COUR, T., YU, K., AND METAXAS, D. N. 2012. Query specific fusion for image retrieval. In Proceedings of the European Conference on Computer Vision (ECCV'12). Springer, 660-673.
36. ZHANG, W. AND KOSECKA, J. 2006. Image based localization in urban environments. In Proceedings of the 3rd International Symposium on 3D Data Processing, Visualization, and Transmission. IEEE, 33-40.
37. ZHOU, W., LU, Y., LI, H., SONG, Y., AND TIAN, Q. 2010. Spatial coding for large scale partial-duplicate web image search. In Proceedings of the International Conference on Multimedia. ACM, 511-520.
38. ZHUANG, J., MEI, T., HOI, S. C., XU, Y.-Q., AND LI, S. 2011. When recommendation meets mobile: Contextual and personalized recommendation on the go. In Proceedings of the 13th International Conference on Ubiquitous Computing (UbiComp'11). ACM, New York, NY, 153-162.