On-device mobile visual location recognition by integrating vision and inertial sensors

IEEE Transactions on Multimedia

Volumn 15, Issue 7, 2013, Pages 1688-1699

  Guan, Tao ^a   He, Yunfeng ^a   Gao, Juan ^a   Yang, Jianzhong ^a   Yu, Junqing ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Mobile visual location recognition; on device; vector quantization; vision and inertial sensors integration

Indexed keywords

COMPUTER VISION TECHNIQUES; IMAGE SIMILARITY; INERTIAL SENSOR; LOCATION RECOGNITION; MOBILE VISUAL LOCATION RECOGNITION; ON-DEVICE; RESIDUAL VECTOR QUANTIZATIONS; VECTOR OF LOCALLY AGGREGATED DESCRIPTORS;

INERTIAL NAVIGATION SYSTEMS; MOBILE DEVICES;

VECTOR QUANTIZATION;

EID: 84886468209     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2013.2265674     Document Type: Article

References (26)

1. G. Schroth, R. Huitl, D. Chen, M. Abu-Alqumsan, A. Al-Nuaimi, and E. Steinbach, "Mobile visual location recognition," IEEE Signal Process. Mag., vol. 28, no. 4, pp. 77-89, 2011.
2. G. Takacs, V. Chandrasekhar, N. Gelfand, Y. Xiong, W. C. Chen, T. Bismpigiannis, R. Grzeszczuk, K. Pulli, and B. Girod, "Outdoors augmented reality on mobile phone using loxel-based visual feature organization," in Proc. ACM Int. Conf.Multimedia Inf. Retrieval,Vancouver, BC, Canada, 2008, pp. 427-434.
3. G. Schroth, R. Huitl,M. Abu-Alqumsan, F. Schweiger, and E. Steinbach, "Exploiting prior knowledge in mobile visual location recognition," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, Kyoto, Japan, 2012, pp. 2357-2360.
4. D. Chen, G. Baatz, K. Koeser, S. Tsai, R. Vedantham, T. Pylvanainen, K. Roimela, X. Chen, J. Bach, M. Pollefeys, B. Girod, and R. Grzeszczuk, "City-scale landmark identification on mobile devices," in Proc. IEEE Int. Conf. Comput. Vision and Pattern Recognition (CVPR), Jun. 2011, pp. 737-744.
5. G. Baatz, K. Koeser, D. Chen, R. Grzeszczuk, andM. Pollefeys, "Handling urban location recognition as a 2D homothetic problem," in Proc. 11th Eur. Conf. Comput. Vision (ECCV '10), 2010.
6. D. Chen, S. Tsai, V. Chandrasekhar, G. Takacs, H. Chen, R. Vedantham, R. Grzeszczuk, and B. Girod, "Residual enhanced visual vectors for on-device image matching," in Proc. Asilomar Conf. Signals, Syst., and Comput., Nov. 2011.
7. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. Int. Conf. Comput. Vision, Oct. 2003, vol. 2, pp. 1470-1477.
8. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. 2006 IEEE Comput. Soc. Conf. Comput. Vision and Pattern Recognition (CVPR), 2006, pp. 2161-2168. (Pubitemid 44931581)
9. G. Schindler, M. Brown, and R. Szeliski, "City-scale location recognition," in Proc. IEEE Comput. Soc. Conf. Comput. Vision and Pattern Recognition (CVPR), 2007, pp. 1-7.
10. Y. Li, N. Snavely, and D. P. Huttenlocher, "Location recognition using prioritized feature matching," in Proc. 11th Eur. Conf. Comput. Vision (ECCV '10), 2010.
11. V. Chandrasekhar, G. Takacs, D. Chen, S. Tsai, Y. Reznik, R. Grzeszczuk, and B. Girod, "Compressed histogram of gradients: a low bitrate descriptor," Int. J. Comput. Vision, vol. 94, no. 5, pp. 384-399, 2011.
12. D. Chen, S. Tsai, and V. Chandrasekhar, "Tree histogram coding for mobile image matching," in Proc. DCC, 2009, pp. 143-152.
13. R. R. Ji, L. Y. Duan, J. Chen, H. X. Yao, J. S. Yuan, Y. Rui, and W. Gao, "Location discriminative vocabulary coding for mobile landmark search," Int. J. Comput. Vision, vol. 96, no. 3, pp. 290-314, 2012.
14. R. R. Ji et al., "When codeword frequency meets geographical location," in Proc. IEEE ICASSP, 2011, pp. 2400-2403.
15. T. Chen, K. H. Yap, and L. P. Chau, "Integrated content and context analysis for mobile landmark recognition," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 10, pp. 1476-1486, 2011.
16. Z. Li and K. H. Yap, "Content and context boosting for mobile landmark recognition," IEEE Signal Process. Lett., vol. 19, no. 8, pp. 459-462, Aug. 2012.
17. [Online]. Available: http://www.flickr.com/
18. [Online]. Available: http://earth.google.com/
19. H. Jegou, F. Perronnin, M. Douze, J. Sanchez, P. Perez, and C. Schmid, "Aggregating local image descriptors into compact codes," IEEE Trans. Pattern Anal.Mach. Intell., vol. 34, no. 9, pp. 1704-1716, Sep. 2012.
20. D. Kurz and S. Benhimane, "Inertial sensor-aligned visual feature descriptors," in Proc. IEEE Conf. Comput. Vision and Pattern Recognition, 2011.
21. H. Jegou, M. Douze, and C. Schmid, "Product quantization for nearest neighbor search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 117-128, Jan. 2011.
22. J. Brandt, "Transform coding for fast approximate nearest neighbor search in high dimensions," in Proc. Int. Conf. Comput. Vision and Pattern Recognition, 2010, pp. 1815-1822.
23. Y. Chen, T. Guan, and C. Wang, "Approximate nearest neighbor search by residual vector quantization," Sensors, vol. 10, no. 12, pp. 11259-11273, 2010.
24. M. Datar, N. Immorlica, P. Indyk, and V.Mirrokni, "Locality- sensitive hashing scheme based on p-Stable distributions," in Proc. 20th Annu. Symp. Computational Geometry, 2004, pp. 253-262.
25. H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, "Surf: Speeded up robust features," Comput. Vision Image Understand. (CVIU), vol. 110, no. 3, pp. 346-359, 2008.
26. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing," Adv. Neural Inf. Process. Syst., 2008.