CVM-Net: Cross-View Matching Network for Image-Based Ground-to-Aerial Geo-Localization

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 7258-7267

  Hu, Sixing ^a   Feng, Mengdan ^a   Nguyen, Rang M H ^a   Lee, Gim Hee ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DEEP LEARNING;

IMAGE DESCRIPTORS; LOCAL IMAGE FEATURES; LOSS FUNCTIONS; MATCHING NETWORKS; METRIC LEARNING; SOFT MARGINS; STATE-OF-THE-ART APPROACH; TRAINING PROCEDURES;

ANTENNAS;

EID: 85062819955     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00758     Document Type: Conference Paper

References (54)

1. Google street view image api. https://developers. google.com/maps/documentation/streetview/intro, 2017 (accessed September 4, 2017).
2. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. CoRR, abs/1603.04467, 2016.
3. R. Arandjelovic, P. Gronat, A. Torii, T. Pajdla, and J. Sivic. Netvlad: Cnn architecture for weakly supervised place recognition. In IEEE Conference on Computer Vision and Pattern Recognition, June 2016.
4. R. Arandjelovic, P. Gronat, A. Torii, T. Pajdla, and J. Sivic. Netvlad: Cnn architecture for weakly supervised place recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, PP(99), 2017.
5. M. Bansal, K. Daniilidis, and H. Sawhney. Ultra-wide baseline facade matching for geo-localization. In European Conference on Computer Vision, October 2012.
6. M. Bansal, H. S. Sawhney, H. Cheng, and K. Daniilidis. Geo-localization of street views with aerial image databases. In ACM International Conference on Multimedia, November 2011.
7. H. Bay, T. Tuytelaars, and L. Van Gool. Surf: Speeded up robust features. In European Conference on Computer Vision, May 2006.
8. Y. Cao, M. Long, and J. Wang. Correlation hashing network for efficient cross-modal retrieval. In British Machine Vision Conference, September 2017.
9. Y. Cao, M. Long, J.Wang, and S. Liu. Deep visual-semantic quantization for efficient image retrieval. In IEEE Conference on Computer Vision and Pattern Recognition, July 2017.
10. W. Chen, X. Chen, J. Zhang, and K. Huang. Beyond triplet loss: A deep quadruplet network for person re-identification. In IEEE Conference on Computer Vision and Pattern Recognition, July 2017.
11. D. Cheng, Y. Gong, S. Zhou, J. Wang, and N. Zheng. Person re-identification by multi-channel parts-based cnn with improved triplet loss function. In IEEE Conference on Computer Vision and Pattern Recognition, June 2016.
12. S. Chopra, R. Hadsell, and Y. LeCun. Learning a similarity metric discriminatively, with application to face verification. In IEEE Conference on Computer Vision and Pattern Recognition, June 2005.
13. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and F.-F. Li. Imagenet: A large-scale hierarchical image database. In IEEE Conference on Computer Vision and Pattern Recognition, June 2009.
14. S. Ding, L. Lin, G. Wang, and H. Chao. Deep feature learning with relative distance comparison for person reidentification. Pattern Recognition, 48(10), 2015.
15. X. Han, T. Leung, Y. Jia, R. Sukthankar, and A. C. Berg. Matchnet: Unifying feature and metric learning for patchbased matching. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
16. J. Hays and A. A. Efros. Im2gps: Estimating geographic information from a single image. In IEEE Conference on Computer Vision and Pattern Recognition, June 2008.
17. A. Hermans, L. Beyer, and B. Leibe. In defense of the triplet loss for person re-identification. CoRR, abs/1703.07737, 2017.
18. H. Jegou, M. Douze, C. Schmid, and P. Perez. Aggregating local descriptors into a compact image representation. In IEEE Conference on Computer Vision and Pattern Recognition, June 2010.
19. S. Khamis, C.-H. Kuo, V. K. Singh, V. D. Shet, and L. S. Davis. Joint learning for attribute-consistent person reidentification. In European Conference on Computer Vision Workshops, September 2014.
20. D. Kingma and J. Ba. Adam: A method for stochastic optimization. CoRR, abs/1412.6980, 2014.
21. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, December 2012.
22. T.-Y. Lin, S. Belongie, and J. Hays. Cross-view image geolocalization. In IEEE Conference on Computer Vision and Pattern Recognition, June 2013.
23. T.-Y. Lin, Y. Cui, S. Belongie, and J. Hays. Learning deep representations for ground-to-aerial geolocalization. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
24. J. Liu, Z.-J. Zha, Q. Tian, D. Liu, T. Yao, Q. Ling, and T. Mei. Multi-scale triplet cnn for person re-identification. In ACM International Conference on Multimedia, October 2016.
25. D. G. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 2004.
26. C. McManus, W. Churchill, W. Maddern, A. D. Stewart, and P. Newman. Shady dealings: Robust, long-term visual localisation using illumination invariance. In IEEE International Conference on Robotics and Automation, May 2014.
27. S. Middelberg, T. Sattler, O. Untzelmann, and L. Kobbelt. Scalable 6-dof localization on mobile devices. In European Conference on Computer Vision, September 2014.
28. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. CoRR, abs/1301.3781, 2013.
29. D. Nister and H. Stewenius. Scalable recognition with a vocabulary tree. In IEEE Conference on Computer Vision and Pattern Recognition, June 2006.
30. M. Noda, T. Takahashi, D. Deguchi, I. Ide, H. Murase, Y. Kojima, and T. Naito. Vehicle ego-localization by matching in-vehicle camera images to an aerial image. In Asian Conference on Computer Vision Workshops, November 2010.
31. H. Oh Song, Y. Xiang, S. Jegelka, and S. Savarese. Deep metric learning via lifted structured feature embedding. In IEEE Conference on Computer Vision and Pattern Recognition, June 2016.
32. S. Paisitkriangkrai, C. Shen, and A. van den Hengel. Learning to rank in person re-identification with metric ensembles. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
33. T. Sattler, M. Havlena, K. Schindler, and M. Pollefeys. Large-scale location recognition and the geometric burstiness problem. In Conference on Computer Vision and Pattern Recognition, June 2016.
34. F. Schroff, D. Kalenichenko, and J. Philbin. Facenet: A unified embedding for face recognition and clustering. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
35. T. Senlet and A. Elgammal. A framework for global vehicle localization using stereo images and satellite and road maps. In IEEE International Conference on Computer VisionWorkshops, November 2011.
36. T. Senlet and A. Elgammal. Satellite image based precise robot localization on sidewalks. In IEEE International Conference on Robotics and Automation, May 2012.
37. Q. Shan, C.Wu, B. Curless, Y. Furukawa, C. Hernandez, and S. M. Seitz. Accurate geo-registration by ground-to-aerial image matching. In International Conference on 3D Vision, December 2014.
38. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556, 2014.
39. J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In IEEE International Conference on Computer Vision, October 2003.
40. J. Sivic and A. Zisserman. Video google: Efficient visual search of videos. In Toward Category-Level Object Recognition. Springer, 2006.
41. E. Stumm, C. Mei, S. Lacroix, J. Nieto, M. Hutter, and R. Siegwart. Robust visual place recognition with graph kernels. In IEEE Conference on Computer Vision and Pattern Recognition, June 2016.
42. C. Su, S. Zhang, J. Xing, W. Gao, and Q. Tian. Deep attributes driven multi-camera person re-identification. In European Conference on Computer Vision, October 2016.
43. Y. Tian, C. Chen, and M. Shah. Cross-view image matching for geo-localization in urban environments. In IEEE Conference on Computer Vision and Pattern Recognition, July 2017.
44. A. Viswanathan, B. R. Pires, and D. Huber. Vision based robot localization by ground to satellite matching in gpsdenied situations. In IEEE/RSJ International Conference on Intelligent Robots and Systems, September 2014.
45. N. Vo, N. Jacobs, and J. Hays. Revisiting im2gps in the deep learning era. In IEEE International Conference on Computer Vision, October 2017.
46. N. N. Vo and J. Hays. Localizing and orienting street views using overhead imagery. In European Conference on Computer Vision, October 2016.
47. F. Wang, W. Zuo, L. Lin, D. Zhang, and L. Zhang. Joint learning of single-image and cross-image representations for person re-identification. In IEEE Conference on Computer Vision and Pattern Recognition, June 2016.
48. J. Wang, F. Zhou, S. Wen, X. Liu, and Y. Lin. Deep metric learning with angular loss. In IEEE International Conference on Computer Vision, October 2017.
49. S. Workman and N. Jacobs. On the location dependence of convolutional neural network features. In IEEE Conference on Computer Vision and Pattern Recognition Workshops, June 2015.
50. S. Workman, R. Souvenir, and N. Jacobs. Wide-area image geolocalization with aerial reference imagery. In IEEE International Conference on Computer Vision, December 2015.
51. S. Zagoruyko and N. Komodakis. Learning to compare image patches via convolutional neural networks. In IEEE Conference on Computer Vision and Pattern Recognition, June 2015.
52. A. R. Zamir and M. Shah. Image geo-localization based on multiple nearest neighbor feature matching using generalized graphs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(8), August 2014.
53. M. Zhai, Z. Bessinger, S. Workman, and N. Jacobs. Predicting ground-level scene layout from aerial imagery. In IEEE Conference on Computer Vision and Pattern Recognition, July 2017.
54. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva. Learning deep features for scene recognition using places database. In Advances in Neural Information Processing Systems, December 2014.