Deep visual-semantic quantization for efficient image retrieval

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 916-925

  Cao, Yue ^a   Long, Mingsheng ^a   Wang, Jianmin ^a   Liu, Shichen ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; CODES (SYMBOLS); COMPUTER VISION; DEEP LEARNING; IMAGE CODING; IMAGE COMPRESSION; NEAREST NEIGHBOR SEARCH; SEMANTICS; TABLE LOOKUP;

COMPACT ENCODING; COMPUTATION EFFICIENCY; QUANTIZATION APPROACH; QUANTIZATION MODELS; RETRIEVAL QUALITY; SEMANTIC INFORMATION; SIMILARITY RETRIEVAL; VISUAL SEMANTICS;

IMAGE RETRIEVAL;

EID: 85044463053     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.104     Document Type: Conference Paper

References (45)

1. M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, M. Devin, S. Ghemawat, G. Irving, M. Is-ard, M. Kudlur, J. Levenberg, R. Monga, S. Moore, D. G. Murray, B. Steiner, P. Tucker, V. Vasudevan, P. Warden, M. Wicke, Y. Yu, and X. Zheng. Tensor-flow: A system for large-scale machine learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), pages 265-283, GA, 2016. USENIX Association.
2. A. Babenko and V. Lempitsky. Additive quantization for extreme vector compression. In CVPR. IEEE, 2014.
3. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 35(8):1798-1828, Aug 2013.
4. J. Besag. On the statistical analysis of dirty pictures. Journal of the Royal Statistical Society, 48(3):259-320, 1986.
5. Y. Cao, M. Long, and J. Wang. Correlation hashing network for efficient cross-modal retrieval. CoRR, abs/1602.06697, 2016.
6. Y. Cao, M. Long, J. Wang, and S. Liu. Collective deep quantization for efficient cross-modal retrieval. In AAAI. AAAI, 2017.
7. Y. Cao, M. Long, J. Wang, Q. Yang, and P. S. Yu. Deep visual-semantic hashing for cross-modal retrieval. In SIGKDD, 2016.
8. Y. Cao, M. Long, J. Wang, H. Zhu, and Q. Wen. Deep quantization network for efficient image retrieval. In AAAI. AAAI, 2016.
9. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng. Nus-wide: A real-world web image database from national university of singapore. In ICMR. ACM, 2009.
10. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. In ICML, 2014.
11. C. Du and J. Wang. Inner product similarity search using compositional codes. CoRR, abs/1406.4966, 2014.
12. V. Erin Liong, J. Lu, G. Wang, P. Moulin, and J. Zhou. Deep hashing for compact binary codes learning. In CVPR, pages 2475-2483. IEEE, 2015.
13. D. J. Fleet, A. Punjani, and M. Norouzi. Fast search in hamming space with multi-index hashing. In CVPR. IEEE, 2012.
14. A. Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, M. A. Ranzato, and T. Mikolov. Devise: A deep visual-semantic embedding model. In C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger, editors, Advances in Neural Information Processing Systems 26, pages 2121-2129. Curran Associates, Inc., 2013.
15. T. Ge, K. He, Q. Ke, and J. Sun. Optimized product quantization. TPAMI, 2014.
16. A. Gionis, P. Indyk, R. Motwani, et al. Similarity search in high dimensions via hashing. In VLDB, volume 99, pages 518-529. ACM, 1999.
17. Y. Gong, S. Kumar, H. Rowley, S. Lazebnik, et al. Learning binary codes for high-dimensional data using bilinear projections. In CVPR, pages 484-491. IEEE, 2013.
18. Y. Gong and S. Lazebnik. Iterative quantization: A procrustean approach to learning binary codes. In CVPR, pages 817-824, 2011.
19. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. CVPR, 2016.
20. H. Jegou, M. Douze, and C. Schmid. Product quantization for nearest neighbor search. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 33(1):117-128, Jan 2011.
21. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Im-agenet classification with deep convolutional neural networks. In NIPS, 2012.
22. B. Kulis and T. Darrell. Learning to hash with binary reconstructive embeddings. In NIPS, pages 1042-1050, 2009.
23. H. Lai, Y. Pan, Y. Liu, and S. Yan. Simultaneous feature learning and hash coding with deep neural networks. In CVPR. IEEE, 2015.
24. M. S. Lew, N. Sebe, C. Djeraba, and R. Jain. Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl., 2(1):1-19, Feb. 2006.
25. H. Liu, R. Wang, S. Shan, and X. Chen. Deep supervised hashing for fast image retrieval. In CVPR, 2016.
26. W. Liu, J. Wang, R. Ji, Y.-G. Jiang, and S.-F. Chang. Supervised hashing with kernels. In CVPR. IEEE, 2012.
27. W. Liu, J. Wang, S. Kumar, and S.-F. Chang. Hashing with graphs. In ICML. ACM, 2011.
28. X. Liu, J. He, B. Lang, and S.-F. Chang. Hash bit selection: a unified solution for selection problems in hashing. In CVPR, pages 1570-1577. IEEE, 2013.
29. M. Long, Y. Cao, J. Wang, and P. S. Yu. Composite correlation quantization for efficient multimodal retrieval. In SIGIR, 2016.
30. T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. CoRR, abs/1301.3781, 2013.
31. M. Norouzi and D. M. Blei. Minimal loss hashing for compact binary codes. In ICML, pages 353-360. ACM, 2011.
32. M. Norouzi, D. M. Blei, and R. R. Salakhutdinov. Hamming distance metric learning. In NIPS, pages 1061-1069, 2012.
33. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV), 115(3):211-252, 2015.
34. R. Salakhutdinov and G. E. Hinton. Learning a nonlinear embedding by preserving class neighbourhood structure. In AISTATS, pages 412-419, 2007.
35. F. Shen, C. Shen, W. Liu, and H. Tao Shen. Supervised discrete hashing. In CVPR. IEEE, June 2015.
36. L. van der Maaten and G. Hinton. Visualizing high-dimensional data using t-sne. Journal of Machine Learning Research, 9: 2579-2605, Nov 2008.
37. J. Wang, S. Kumar, and S.-F. Chang. Semi-supervised hashing for large-scale search. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 34(12):2393-2406, 2012.
38. J. Wang, H. T. Shen, J. Song, and J. Ji. Hashing for similarity search: A survey. Arxiv, 2014.
39. X. Wang, T. Zhang, G.-J. Qi, J. Tang, and J. Wang. Supervised quantization for similarity search. In CVPR, 2016.
40. Y. Weiss, A. Torralba, and R. Fergus. Spectral hashing. In NIPS, 2009.
41. R. Xia, Y. Pan, H. Lai, C. Liu, and S. Yan. Supervised hashing for image retrieval via image representation learning. In AAAI, pages 2156-2162. AAAI, 2014.
42. F. X. Yu, S. Kumar, Y. Gong, and S.-F. Chang. Circulant binary embedding. In ICML, pages 353-360. ACM, 2014.
43. P. Zhang, W. Zhang, W.-J. Li, and M. Guo. Supervised hashing with latent factor models. In SIGIR, pages 173-182. ACM, 2014.
44. T. Zhang, C. Du, and J. Wang. Composite quantization for approximate nearest neighbor search. In ICML. ACM, 2014.
45. H. Zhu, M. Long, J. Wang, and Y. Cao. Deep hashing network for efficient similarity retrieval. In AAAI. AAAI, 2016.