Learning local image descriptors with deep siamese and triplet convolutional networks by minimizing global loss functions

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 5385-5394

  Kumar, B G Vijay ^a   Carneiro, Gustavo ^a   Reid, Ian ^a  

^a UNIVERSITY OF ADELAIDE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER VISION; CONVOLUTION; IMAGE PROCESSING; LEARNING SYSTEMS; NEURAL NETWORKS; STOCHASTIC SYSTEMS;

BENCHMARK DATASETS; CLASSIFICATION ACCURACY; CLASSIFICATION ERRORS; CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORK; LOCAL IMAGE DESCRIPTORS; MISCLASSIFICATIONS; STOCHASTIC GRADIENT DESCENT;

PATTERN RECOGNITION;

EID: 84986272593     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.581     Document Type: Conference Paper

References (36)

1. Ubc patch dataset. http://www.cs. ubc. ca/mbrown/patchdata/patchdata.html. Accessed: 2015-10-27.
2. J. Bromley, J. W. Bentz, L. Bottou, I. Guyon, Y. LeCun, C. Moore, E. Säckinger, and R. Shah. Signature verification using a siamese time delay neural network. International Journal of Pattern Recognition and Artificial Intelligence, 7 (04): 669-688, 1993.
3. M. Brown, G. Hua, and S. Winder. Discriminative learning of local image descriptors. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 33 (1): 43-57, 2011.
4. G. Carneiro. The automatic design of feature spaces for local image descriptors using an ensemble of non-linear feature extractors. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 3509-3516. IEEE, 2010.
5. H.-T. Chen, H.-W. Chang, and T.-L. Liu. Local discriminant embedding and its variants. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 2, pages 846-853. IEEE, 2005.
6. S. Chopra, R. Hadsell, and Y. LeCun. Learning a similarity metric discriminatively, with application to face verification. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 1, pages 539-546. IEEE, 2005.
7. A. Coates, A. Y. Ng, and H. Lee. An analysis of singlelayer networks in unsupervised feature learning. In International conference on artificial intelligence and statistics, pages 215-223, 2011.
8. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 1, pages 886-893. IEEE, 2005.
9. J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon. Information-theoretic metric learning. In Proceedings of the 24th international conference on Machine learning, pages 209-216. ACM, 2007.
10. A. Dosovitskiy, J. T. Springenberg, M. Riedmiller, and T. Brox. Discriminative unsupervised feature learning with convolutional neural networks. In Advances in Neural Information Processing Systems, pages 766-774, 2014.
11. J. Goldberger, G. E. Hinton, S. T. Roweis, and R. Salakhutdinov. Neighbourhood components analysis. In Advances in neural information processing systems, pages 513-520, 2004.
12. X. Han, T. Leung, Y. Jia, R. Sukthankar, and A. C. Berg. Matchnet: Unifying feature and metric learning for patchbased matching. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
13. S. Hinterstoisser, C. Cagniart, S. Ilic, P. Sturm, N. Navab, P. Fua, and V. Lepetit. Gradient response maps for real-time detection of textureless objects. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 34 (5): 876-888, 2012.
14. E. Hoffer and N. Ailon. Deep metric learning using triplet network. ArXiv preprint arXiv: 1412. 6622, 2014.
15. S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015, pages 448-456, 2015.
16. P. Jain, B. Kulis, J. V. Davis, and I. S. Dhillon. Metric and kernel learning using a linear transformation. The Journal of Machine Learning Research, 13 (1): 519-547, 2012.
17. M. Koestinger, M. Hirzer, P. Wohlhart, P. M. Roth, and H. Bischof. Large scale metric learning from equivalence constraints. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2288-2295. IEEE, 2012.
18. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097-1105, 2012.
19. D. G. Lowe. Object recognition from local scale-invariant features. In Computer vision, 1999. The proceedings of the seventh IEEE international conference on, volume 2, pages 1150-1157. Ieee, 1999.
20. J. Masci, D. Migliore, M. M. Bronstein, and J. Schmidhuber. Descriptor learning for omnidirectional image matching. In Registration and Recognition in Images and Videos, pages 49-62. Springer, 2014.
21. J. Matas, O. Chum, M. Urban, and T. Pajdla. Robust widebaseline stereo from maximally stable extremal regions. Image and vision computing, 22 (10): 761-767, 2004.
22. N. Molton, A. J. Davison, and I. Reid. Locally planar patch features for real-time structure from motion. In BMVC, pages 1-10, 2004.
23. V. Nair and G. E. Hinton. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on Machine Learning (ICML), pages 807-814, 2010.
24. X. Niyogi. Locality preserving projections. In Neural information processing systems, volume 16, page 153. MIT, 2004.
25. C. Schmid and R. Mohr. Local grayvalue invariants for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19 (5): 530-534, 1997.
26. F. Schroff, D. Kalenichenko, and J. Philbin. Facenet: A unified embedding for face recognition and clustering. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7-12, 2015, pages 815-823, 2015.
27. E. Simo-Serra, E. Trulls, L. Ferraz, I. Kokkinos, P. Fua, and F. Moreno-Noguer. Discriminative learning of deep convolutional feature point descriptors. In The IEEE International Conference on Computer Vision (ICCV), December 2015.
28. K. Simonyan, A. Vedaldi, and A. Zisserman. Learning local feature descriptors using convex optimisation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014.
29. J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on, pages 1470-1477. IEEE, 2003.
30. N. Snavely, S. M. Seitz, and R. Szeliski. Modeling the world from internet photo collections. International Journal of Computer Vision, 80 (2): 189-210, 2008.
31. M. Sugiyama. Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis. The Journal of Machine Learning Research, 8: 1027-1061, 2007.
32. T. Trzcinski, M. Christoudias, P. Fua, and V. Lepetit. Boosting binary keypoint descriptors. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 2874-2881. IEEE, 2013.
33. J. Wang, Y. Song, T. Leung, C. Rosenberg, J. Wang, J. Philbin, B. Chen, and Y. Wu. Learning fine-grained image similarity with deep ranking. In 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, Columbus, OH, USA, June 23-28, 2014, pages 1386-1393, 2014.
34. K. Q. Weinberger, J. Blitzer, and L. K. Saul. Distance metric learning for large margin nearest neighbor classification. In Advances in neural information processing systems, pages 1473-1480, 2005.
35. P. Wohlhart and V. Lepetit. Learning descriptors for object recognition and 3d pose estimation. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
36. S. Zagoruyko and N. Komodakis. Learning to compare image patches via convolutional neural networks. In Conference on Computer Vision and Pattern Recognition (CVPR), 2015.