Sequential discrete hashing for scalable cross-modality similarity retrieval

IEEE Transactions on Image Processing

Volumn 26, Issue 1, 2017, Pages 107-118

  Liu, Li ^a,b   Lin, Zijia ^c   Shao, Ling ^a,b   Shen, Fumin ^a   Ding, Guiguang ^c   Han, Jungong ^b  

^a SOUTHWEST UNIVERSITY   (China)

^b NORTHUMBRIA UNIVERSITY   (United Kingdom)

^c TSINGHUA UNIVERSITY   (China)

Author keywords

bitwise; Cross modality retrieval; discrete optimization; hashing; unified hash code

Indexed keywords

BINARY CODES; BINS; CODES (SYMBOLS); IMAGE RETRIEVAL; NEAREST NEIGHBOR SEARCH; OPTIMIZATION;

BITWISE; CROSS MODALITY; DISCRETE OPTIMIZATION; HASHING; UNIFIED HASH CODE;

HASH FUNCTIONS;

ARTICLE; INFORMATION RETRIEVAL; LEARNING;

EID: 85011954473     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2619262     Document Type: Article

References (56)

1. D. Wang, X. Gao, X. Wang, and L. He, "Semantic topic multimodal hashing for cross-media retrieval," in Proc. Int. Joint Conf. Artif. Intell., 2015, pp. 3890-3896.
2. J. Song, Y. Yang, Z. Huang, H. T. Shen, and J. Luo, "Effective multiple feature hashing for large-scale near-duplicate video retrieval," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1997-2008, Dec. 2013.
3. M. M. Bronstein, A. M. Bronstein, F. Michel, and N. Paragios, "Data fusion through cross-modality metric learning using similarity-sensitive hashing," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3594-3601.
4. S. Kumar and R. Udupa, "Learning hash functions for cross-view similarity search," in Proc. Int. Joint Conf. Artif. Intell., 2011, pp. 1360-1365.
5. L. Liu, M. Yu, and L. Shao, "Multiview alignment hashing for efficient image search," IEEE Trans. Image Process., vol. 24, no. 3, pp. 956-966, Mar. 2015.
6. Y. Zhen and D.-Y. Yeung, "A probabilistic model for multimodal hash function learning," in Proc. SIGKDD, 2012, pp. 940-948.
7. Y. Zhen and D.-Y. Yeung, "Co-regularized hashing for multimodal data," in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1385-1393.
8. X. Zhu, Z. Huang, H. T. Shen, and X. Zhao, "Linear cross-modal hashing for efficient multimedia search," in Proc. 21st Int. Conf. Multimedia, 2013, pp. 143-152.
9. J. Song, Y. Yang, Y. Yang, Z. Huang, and H. T. Shen, "Inter-media hashing for large-scale retrieval from heterogeneous data sources," in Proc. ACM Int. Conf. Manage. (SIGMOD), 2013, pp. 785-796.
10. X. Liu, C. Deng, B. Lang, D. Tao, and X. Li, "Query-adaptive reciprocal hash tables for nearest neighbor search," IEEE Trans. Image Process., vol. 25, no. 2, pp. 907-919, Feb. 2016.
11. X. Liu, L. Huang, C. Deng, J. Lu, and B. Lang, "Multi-view complementary hash tables for nearest neighbor search," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2015, pp. 1107-1115.
12. V. Gaede and O. Günther, "Multidimensional access methods," ACM Comput. Surv., vol. 30, no. 2, pp. 170-231, Jun. 1998.
13. D. Wang, X. Gao, and X. Wang, "Semi-supervised constraints preserving hashing," Neurocomputing, vol. 167, pp. 230-242, Nov. 2015.
14. L. Cao, Z. Li, Y. Mu, and S.-F. Chang, "Submodular video hashing: A unified framework towards video pooling and indexing," in Proc. 20th ACM Int. Conf. Multimedia, 2012, pp. 299-308.
15. X. Liu, X. Fan, C. Deng, Z. Li, H. Su, and D. Tao, "Multilinear hyperplane hashing," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2016, pp. 5119-5127.
16. X. Liu, B. Du, C. Deng, M. Liu, and B. Lang, "Structure sensitive hashing with adaptive product quantization," IEEE Trans. Cybern., vol. 46, no. 10, pp. 2252-2264, Oct. 2016.
17. Y. Liu, F. Wu, Y. Yang, Y. Zhuang, and A. G. Hauptmann, "Spline regression hashing for fast image search," IEEE Trans. Image Process., vol. 21, no. 10, pp. 4480-4491, Oct. 2012.
18. W. Liu, J. Wang, R. Ji, Y.-G. Jiang, and S.-F. Chang, "Supervised hashing with kernels," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2074-2081.
19. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing," in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 1753-1760.
20. A. Gionis, P. Indyk, and R. Motwani, "Similarity search in high dimensions via hashing," in Proc. VLDB, 1999, pp. 518-529.
21. J. Wang, S. Kumar, and S.-F. Chang, "Semi-supervised hashing for largescale search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 12, pp. 2393-2406, Dec. 2012.
22. B. Kulis and K. Grauman, "Kernelized locality-sensitive hashing for scalable image search," in Proc. IEEE 12th Int. Conf. Comput. Vis., Oct. 2009, pp. 2130-2137.
23. Y. Gong, S. Lazebnik, A. Gordo, and F. Perronnin, "Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2916-2929, Dec. 2013.
24. W. Liu, J. Wang, S. Kumar, and S.-F. Chang, "Hashing with graphs," in Proc. Int. Conf. Mach. Learn., 2011, pp. 1-8.
25. J.-P. Heo, Y. Lee, J. He, S.-F. Chang, and S.-E. Yoon, "Spherical hashing," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2957-2964.
26. F. Shen, C. Shen, W. Liu, and H. T. Shen, "Supervised discrete hashing," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 37-45.
27. F. Shen, W. Liu, S. Zhang, Y. Yang, and H. T. Shen, "Learning binary codes for maximum inner product search," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2015, pp. 4148-4156.
28. D. Zhang and W.-J. Li, "Large-scale supervised multimodal hashing with semantic correlation maximization," in Proc. Assoc. Adv. Artif. Intell. Conf., 2014, pp. 2177-2183.
29. Z. Lin, G. Ding, M. Hu, and J. Wang, "Semantics-preserving hashing for cross-view retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 3864-3872.
30. J. Zhou, G. Ding, Y. Guo, Q. Liu, and X. Dong, "Kernel-based supervised hashing for cross-view similarity search," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2014, pp. 1-6.
31. G. Ding, Y. Guo, and J. Zhou, "Collective matrix factorization hashing for multimodal data," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 2083-2090.
32. B. Wu, Q. Yang, W.-S. Zheng, Y. Wang, and J. Wang, "Quantized correlation hashing for fast cross-modal search," in Proc. 24th Int. Joint Conf. Artif. Intell., 2015, pp. 3946-3952.
33. A. Shrivastava and P. Li, "Asymmetric LSH (ALSH) for sublinear time maximum inner product search (MIPS)," in Proc. Adv. Neural Inf. Process. Syst., 2014, pp. 2321-2329.
34. G. Lin, C. Shen, Q. Shi, A. V. den Hengel, and D. Suter, "Fast supervised hashing with decision trees for high-dimensional data," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 1971-1978.
35. L. Liu, M. Yu, and L. Shao, "Projection bank: From high-dimensional data to medium-length binary codes," in Proc. Int. Conf. Comput. Vis., Dec. 2015, pp. 2821-2829.
36. Z. Cai, L. Liu, M. Yu, and L. Shao, "Latent structure preserving hashing," in Proc. BMVC, 2016, pp. 1-19.
37. L. Liu, M. Yu, and L. Shao, "Latent structure preserving hashing," Int. J. Comput. Vis., 2016, doi: 10.1007/s11263-016-0931-4.
38. J. Song, Y. Yang, X. Li, Z. Huang, and Y. Yang, "Robust hashing with local models for approximate similarity search," IEEE Trans. Cybern., vol. 44, no. 7, pp. 1225-1236, Jul. 2014.
39. Y. Gao, M. Shi, D. Tao, and C. Xu, "Database saliency for fast image retrieval," IEEE Trans. Multimedia, vol. 17, no. 3, pp. 359-369, Mar. 2015.
40. J. Yu, D. Tao, M. Wang, and Y. Rui, "Learning to rank using user clicks and visual features for image retrieval," IEEE Trans. Cybern., vol. 45, no. 4, pp. 767-779, Apr. 2015.
41. J. Zhou, G. Ding, and Y. Guo, "Latent semantic sparse hashing for crossmodal similarity search," in Proc. Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., 2014, pp. 415-424.
42. L. Liu, M. Yu, and L. Shao, "Unsupervised local feature hashing for image similarity search," IEEE Trans. Cybern., vol. 46, no. 11, pp. 2548-2558, Nov. 2016.
43. W. Liu, C. Mu, S. Kumar, and S.-F. Chang, "Discrete graph hashing," in Proc. Adv. Neural Inf. Process. Syst., 2014, pp. 3419-3427.
44. W.-C. Kang, W.-J. Li, and Z.-H. Zhou, "Column sampling based discrete supervised hashing," in Proc. 30th AAAI Conf. Artif. Intell., 2016, pp. 3432-3438.
45. J. Friedman, T. Hastie, and R. Tibshirani, "Additive logistic regression: A statistical view of boosting (with discussion and a rejoinder by the authors)," Ann. Statist., vol. 28, no. 2, pp. 337-407, 2000.
46. L. Liu and L. Shao, "Sequential compact code learning for unsupervised image hashing," IEEE Trans. Neural Netw. Learn. Syst., to be published, doi: 10.1109/TNNLS.2015.2495345.
47. J. Qin, L. Liu, Z. Zhang, Y. Wang, and L. Shao, "Compressive sequential learning for action similarity labeling," IEEE Trans. Image Process., vol. 25, no. 2, pp. 756-769, Feb. 2016.
48. X. Liu, J. He, C. Deng, and B. Lang, "Collaborative hashing," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 2147-2154.
49. J. Malick, J. Povh, F. Rendl, and A. Wiegele, "Regularization methods for semidefinite programming," SIAM J. Optim., vol. 20, no. 1, pp. 336-356, 2009.
50. L. Liu and L. Shao, "Discriminative partition sparsity analysis," in Proc. 22nd Int. Conf. Pattern Recognit. (ICPR), Aug. 2014, pp. 1597-1602.
51. G. McLachlan and D. Peel, Finite Mixture Models. New York, NJ, USA: Wiley, 2004.
52. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), Dec. 2001, pp. 511-518.
53. N. Rasiwasia et al., "A new approach to cross-modal multimedia retrieval," in Proc. Int. Conf. Multimedia, 2010, pp. 251-260.
54. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
55. M. J. Huiskes and M. S. Lew, "The MIR flickr retrieval evaluation," in Proc. ACM Int. Conf. Multimedia Inf. Retr., 2008, pp. 39-43.
56. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "Nus-wide: A real-world Web image database from National University of Singapore," in Proc. ACM Int. Conf. Image Video Retr., 2009.