DeepHash for image instance retrieval: Getting regularization, depth and fine-tuning right

ICMR 2017 - Proceedings of the 2017 ACM International Conference on Multimedia Retrieval

Volumn , Issue , 2017, Pages 133-141

  Lin, Jie ^a   Morère, Olivier ^b   Veillard, Antoine ^b   Duan, Ling Yu ^c   Goh, Hanlin ^a   Chandrasekhar, Vijay ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b SORBONNE UNIVERSITÉ   (France)

^c PEKING UNIVERSITY   (China)

Author keywords

CNN; Fisher vectors; Hashing; Image instance retrieval; RBM; Regularization; Siamese network

Indexed keywords

NEURAL NETWORKS;

BENCHMARK DATASETS; CONVOLUTIONAL NEURAL NETWORK; FISHER VECTORS; HASHING; INSTANCE RETRIEVAL; REGULARIZATION; RETRIEVAL PERFORMANCE; STATE-OF-THE-ART METHODS;

DEEP NEURAL NETWORKS;

EID: 85021783306     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3078971.3078983     Document Type: Conference Paper

References (51)

1. DeepFace: Closing the Gap to Human-Level Performance in Face Verification. In Conference on Computer Vision and Pattern Recognition (CVPR).
2. MPEG CDVS (Compact Descriptors for Visual Search) Benchmark. Stanford Digital Repository. http://purl.stanford.edu/qy869qz5226.
3. Pulkit Agrawal, Ross Girshick, and Jitendra Malik. Analyzing the performance of multilayer neural networks for object recognition. In Proceedings of the European Conference on Computer Vision (ECCV), 2014.
4. A. Babenko and V. Lempitsky. Aggregating local deep features for image retrieval. In International Conference on Computer Vision (ICCV), 2015.
5. Artem Babenko, Anton Slesarev, Alexandr Chigorin, and Victor Lempitsky. Neural Codes for Image Retrieval. In Proceedings of European Conference on Computer Vision (ECCV), 2014.
6. Jane Bromley, Isabelle Guyon, Yann Lecun, Eduard Sckinger, and Roopak Shah. Signature Verification using a "Siamese" Time Delay Neural Network. In Advances in Neural Information Processing Systems (NIPS), 1994.
7. V. Chandrasekhar, D.M.Chen, S.S.Tsai, N.M.Cheung, H.Chen, G.Takacs, Y.Reznik, R.Vedantham, R.Grzeszczuk, J.Back, and B.Girod. Stanford Mobile Visual Search Data Set. In Proceedings of ACM Multimedia Systems Conference (MMSys), San Jose, California, February 2011.
8. V. Chandrasekhar, M. Makar, G. Takacs, D.M. Chen, S. S. Tsai, N. M. Cheung, R. Grzeszczuk, Y. Reznik, and B. Girod. Survey of SIFT Compression Schemes. In Proceedings of International Mobile Multimedia Workshop (IMMW), IEEE International Conference on Pattern Recognition (ICPR), Istanbul, Turkey, August 2010.
9. V. Chandrasekhar, G. Takacs, D. M. Chen, S. S. Tsai, R. Grzeszczuk, and B. Girod. CHoG: Compressed Histogram of Gradients - A Low Bit Rate Feature Descriptor. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2504-2511, Miami, Florida, June 2009.
10. D. M. Chen, S. S. Tsai, V. Chandrasekhar, G. Takacs, R. Vedantham, R. Grzeszczuk, and B. Girod. Residual Enhanced Visual Vector as a Compact Signature for Mobile Visual Search. In Signal Processing, Elsevier, In Press, June 2012.
11. David M. Chen. Memory-Efficient Image Databases for Mobile Visual Search. Ph.D. thesis, Department of Electrical Engineering, Stanford University, April 2014.
12. Sumit Chopra, Raia Hadsell, and Yann Lecun. Learning a similarity metric discriminatively, with application to face verification. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 539-546. IEEE Press, 2005.
13. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A largescale hierarchical image database. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
14. M. A. Fischler and R. C. Bolles. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Communications of ACM, 24(6):381-395, June 1981.
15. Hanlin Goh, Nicolas Thome, Matthieu Cord, and Joo-Hwee Lim. Unsupervised and supervised visual codes with restricted Boltzmann machines. In European Conference on Computer Vision (ECCV), 2012.
16. Yunchao Gong, Sanjiv Kumar, Henry Rowley, and Svetlana Lazebnik. Learning Binary Codes for High-Dimensional Data Using Bilinear Projections. In Proceedings of CVPR, pages 484-491, 2013.
17. Yunchao Gong and S. Lazebnik. Iterative Quantization: A Procrustean Approach to Learning Binary Codes. In Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR '11, pages 817-824, Washington, DC, USA, 2011.
18. Kristen Grauman and Rob Fergus. Learning Binary Hash Codes for Large-Scale Image Search. In Machine Learning for Computer Vision, volume 411, pages 49-87. 2013.
19. R. Hadsell, S. Chopra, and Y. LeCun. Dimensionality Reduction by Learning an Invariant Mapping. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, volume 2, pages 1735-1742, 2006.
20. Geoffrey Hinton. A Practical Guide to Training Restricted Boltzmann Machines. In Neural Networks: Tricks of the Trade, volume 7700 of LNCS, pages 599-619. Springer Berlin Heidelberg, 2012.
21. Geoffrey E Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800, 2002.
22. Geoffrey E. Hinton, Simon Osindero, and Yee-Whye Teh. A fast learning algorithm for deep belief networks. Neural Computation, 18(7):1527-1554, 2006.
23. H. Jégou, M. Douze, and C. Schmid. Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search. In Proceedings of European Conference on Computer Vision (ECCV), pages 304-317, Berlin, Heidelberg, October 2008.
24. H. Jégou, M. Douze, C. Schmid, and P. Perez. Aggregating Local Descriptors into a Compact Image Representation. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3304-3311, San Francisco, CA, USA, June 2010.
25. Hervé Jégou, Florent Perronnin, Matthijs Douze, Jorge Sánchez, Patrick Pérez, and Cordelia Schmid. Aggregating local image descriptors into compact codes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(9):1704-1716, September 2012.
26. Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.
27. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems (NIPS), 2012.
28. Brian Kulis and Kristen Grauman. Kernelized Locality-Sensitive Hashing for Scalable Image Search. In Proceedings of IEEE International Conference on Computer Vision (ICCV, 2009.
29. Honglak Lee, Chaitanya Ekanadham, and Andrew Ng. Sparse deep belief net model for visual area V2. In Advances in Neural Information Processing Systems (NIPS), pages 873-880, 2008.
30. Youngwoon Lee. Spherical Hashing. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2957-2964, Washington, DC, USA, 2012. IEEE Computer Society.
31. Xi Li, Guosheng Lin, Chunhua Shen, Anton van den Hengel, and Anthony R. Dick. Learning Hash Functions Using Column Generation. In Proceedings of ICML, volume 28, pages 142-150, 2013.
32. Jie Lin, Ling-Yu Duan, Tiejun Huang, and Wen Gao. Robust Fisher Codes for Large Scale Image Retrieval. In Proceedings of International Conference on Acoustics and Signal Processing (ICASSP), 2013.
33. K. Lin, J. Lu, C. Chen, and J. Zhou. Learning compact binary descriptors with unsupervised deep neural networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
34. Wei Liu, Jun Wang, Rongrong Ji, Yu-Gang Jiang, and Shih-Fu Chang. Supervised Hashing with Kernels. In Computer Vision and Pattern Recognition (CVPR), 2012.
35. D. Lowe. Distinctive Image Features from Scale-invariant Keypoints. International Journal of Computer Vision, 60(2):91-110, November 2004.
36. B. Thomee Mark J. Huiskes and Michael S. Lew. New Trends and Ideas in Visual Concept Detection: The MIR Flickr Retrieval Evaluation Initiative. In Proceedings of the 2010 ACM International Conference on Multimedia Information Retrieval, pages 527-536, New York, NY, USA, 2010.
37. Vinod Nair and Geoffrey Hinton. 3D Object Recognition with Deep Belief Nets. In Advances in Neural Information Processing Systems (NIPS), pages 1339-1347, 2009.
38. D. Nistér and H. Stewénius. Scalable Recognition with a Vocabulary Tree. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2161-2168, New York, USA, June 2006.
39. Mohammad Norouzi and David Fleet. Minimal Loss Hashing for Compact Binary Codes. In Proceedings of ICML, pages 353-360, 2011.
40. F. Perronnin, Y. Liu, J. Sanchez, and H. Poirier. Large-scale Image Retrieval with Compressed Fisher Vectors. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3384-3391, San Francisco, CA, USA, June 2010.
41. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Object Retrieval with Large Vocabularies and Fast Spatial Matching. In Proceedings of CVPR, pages 1-8, Minneapolis, Minnesota, June 2007.
42. Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey Hinton. Restricted Boltzmann Machines for Collaborative Filtering. In Proceedings of the 24th International Conference on Machine Learning, ICML '07, pages 791-798, New York, NY, USA, 2007. ACM.
43. Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556, 2014.
44. Yi Sun, Xiaogang Wang, and Xiaoou Tang. Deep learning face representation from predicting 10,000 classes. June 2014.
45. Giorgos Tolias, Ronan Sicre, and Hervé Jégou. Particular object retrieval with integral max-pooling of CNN activations. In International Conference on Learning Representations (ICLR), 2016.
46. A. Torralba, R. Fergus, and Y. Weiss. Small Codes and Large Image Databases for Recognition. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1-8, Anchorage, Alaska, June 2008.
47. Alexander Toshev and Christian Szegedy. Deeppose: Human pose estimation via deep neural networks. June 2014.
48. Jun Wang, Sanjiv Kumar, and Shih-Fu Chang. Semi-Supervised Hashing for Scalable Image Retrieval. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, USA, June 2010.
49. Jun Wang, Wei Liu, Andy X Sun, and Yu-Gang Jiang. Learning Hash Codes with Listwise Supervision. In Proceedings of IEEE International Conference on Computer Vision, ICCV 2013, Sydney, Australia, December 1-8, 2013, pages 3032-3039, 2013.
50. Y. Weiss, A. Torralba, and R. Fergus. Spectral Hashing. In Proceedings of Neural Information Processing Systems (NIPS), pages 1753-1760, Vancouver, BC, Canada, December 2008.
51. C. Yeo, P. Ahammad, and K. Ramchandran. Rate-efficient Visual Correspondences using Random Projections. In Proceedings of IEEE International Conference on Image Processing (ICIP), pages 217-220, San Diego, California, October 2008.