Query-adaptive image search with hash codes

IEEE Transactions on Multimedia

Volumn 15, Issue 2, 2013, Pages 442-453

  Jiang, Yu Gang ^a   Wang, Jun ^b   Xue, Xiangyang ^a   Chang, Shih Fu ^c  

^a FUDAN UNIVERSITY   (China)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c Columbia University ^*  (United States)

Author keywords

Hash codes; Query adaptive image search; Scalability; Weighted Hamming distance

Indexed keywords

EUCLIDEAN; HAMMING SPACE; HASH CODES; HASHING METHOD; HIGH-DIMENSIONAL IMAGES; IMAGE DATASETS; IMAGE SEARCH; INTEGER VALUES; LEARNING PROCESS; OFF-LINE LEARNING; PRE-DEFINED SEMANTICS; QUADRATIC PROGRAMMING PROBLEMS; RAW IMAGES; SCALABLE IMAGE; SEARCH RESULTS; SEMANTIC CONCEPT; VISUAL SIMILARITY;

HASH FUNCTIONS; IMAGE CODING; SCALABILITY; SEMANTICS;

HAMMING DISTANCE;

EID: 84872738893     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2231061     Document Type: Article

References (44)

1. A. Torralba, R. Fergus, and W. Freeman, "80 million tiny images: A large data set for nonparametric object and scene recognition," IEEE Trans. Pattern Anal.Mach. Intell., vol. 30, no. 11, pp. 1958-1970, Nov. 2008.
2. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Computer Vision, 2003.
3. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
4. J. Wang, S. Kumar, and S.-F. Chang, "Semi-supervised hashing for scalable image retrieval," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
5. G. Hinton and R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006. (Pubitemid 44148451)
6. R. Salakhutdinov and G. Hinton, "Semantic hashing," in Proc. Workshop of ACM SIGIR Conf. Research and Development in Information Retrieval, 2007.
7. J. L. Bentley, "Multidimensional binary search trees used for associative searching," Commun. ACM, vol. 18, no. 9, pp. 509-517, 1975.
8. A. Torralba, R. Fergus, and Y. Weiss, "Small codes and large image databases for recognition," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
9. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing," in Adv. Neural Inf. Process. Syst., 2008.
10. J. Wang, S. Kumar, and S.-F. Chang, "Sequential projection learning for hashing with compact codes," in Proc. Int. Conf.Machine Learning, 2010.
11. A. W. Smeulders,M.Worring, S. Santini, A. Gupta, and R. Jain, "Content- based image retrieval at the end of the early years," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, Dec. 2000. (Pubitemid 32088465)
12. R. Datta, D. Joshi, J. Li, and J. Z.Wang, "Image retrieval: Ideas, influences, and trends of the new age," ACM Comput. Surveys, vol. 40, no. 2, 2008.
13. J. R. Smith and S.-F. Chang, "VisualSEEk: A fully automated contentbased image query system," in Proc. ACM Int. Conf.Multimedia, 1996.
14. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vision, vol. 42, pp. 145-175, 2001. (Pubitemid 32680801)
15. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
16. J. Zobel and A. Moffat, "Inverted files for text search engines," ACM Comput. Surveys, vol. 38, no. 2, 2006.
17. H. Jegou, M. Douze, and C. Schmid, "Packing bag-of-features," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
18. M. Muja and D. G. Lowe, "Fast approximate nearest neighbors with automatic algorithm configuration," in Proc. Int. Conf. Computer Vision Theory and Applications, 2009, pp. 331-340.
19. P. Indyk, J. E. Goodman and J. O'Rourke, Eds., "Nearest neighbors in high-dimensional spaces," in Handbook of Discrete and Computational Geometry. Boca Raton, FL: CRC, 2004, ch. 39.
20. C. Silpa-Anan and R. Hartley, "Optimised KD-trees for fast image descriptor matching," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
21. Y. Jia, J.Wang, G. Zeng, H. Zha, and X.-S. Hua, "Optimizing KD-trees for scalable visual descriptor indexing," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010, pp. 3392-3399.
22. P. Indyk and R. Motwani, "Approximate nearest neighbors: Towards removing the curse of dimensionality," in Proc. Symp. Theory of Computing, 1998.
23. B. Kulis and K. Grauman, "Kernelized locality-sensitive hashing for scalable image search," in Proc. IEEE Int. Conf. Computer Vision, 2009.
24. O. Chum,M. Perdoch, and J. Matas, "Geometric min-hashing: Finding a (thick) needle in a haystack," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
25. B. Kulis and T. Darrell, "Learning to hash with binary reconstructive embeddings," in Adv. Neural Inf. Process. Syst., 2009.
26. R.-S. Lin, D. A. Ross, and J. Yagnik, "Spec hashing: Similarity preserving algorithm for entropy-based coding," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
27. Y. Mu, J. Shen, and S. Yan, "Weakly-supervised hashing in kernel space," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
28. W. Liu, J. Wang, S. Kumar, and S.-F. Chang, "Hashing with graphs," in Proc. Int. Conf. Machine Learning, 2011.
29. M. M. Bronstein, A. M. Bronstein, F. Michel, and N. Paragios, "Data fusion through cross-modality metric learning using similarity-sensitive hashing," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
30. H. Xu, J. Wang, Z. Li, G. Zeng, S. Li, and N. Yu, "Complementary hashing for approximate nearest neighbor search," in Proc. IEEE Int. Conf. Computer Vision, 2011.
31. E. Horster and R. Lienhart, "Deep networks for image retrieval on large-scale databases," in Proc. ACM Int. Conf. Multimedia, 2008.
32. G. Shakhnarovich, P. Viola, and T. Darrell, "Fast pose estimation with parameter-sensitive hashing," in Proc. IEEE Int. Conf. Computer Vision, 2003.
33. H. Jegou, M. Douze, and C. Schmid, "Improving bag-of-features for large scale image search," Int. J. Comput. Vision, vol. 87, pp. 191-212, 2010.
34. X.-J. Wang, L. Zhang, F. Jing, and W.-Y. Ma, "Annosearch: Image auto-annotation by search," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
35. H. Jegou, L. Amsaleg, C. Schmid, and P. Gros, "Query adaptative locality sensitive hashing," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, 2008.
36. Y.-G. Jiang, J. Wang, and S.-F. Chang, "Lost in binarization: Queryadaptive ranking for similar image search with compact codes," in Proc. ACM Int. Conf. Multimedia Retrieval, 2011.
37. G. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Computat., vol. 14, no. 8, pp. 1771-1800, 2002.
38. J. Goldberger, S. Roweis, G. Hinton, and R. Salakhutdinov, "Neighbourhood components analysis," in Adv. Neural Inf. Process. Syst., 2004.
39. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Ann. Eugenics, vol. 7, pp. 179-188, 1936.
40. E. Xing, A. Ng, M. Jordan, and S. Russell, "Distance metric learning with application to clustering with side-information," Adv. Neural Inf. Process. Syst., pp. 521-528, 2003.
41. K.Weinberger and L. Saul, "Fast solvers and efficient implementations for distance metric learning," in Proc. Int. Conf. Machine Learning, 2008.
42. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng, "NUSWIDE: A real-world web image database from National University of Singapore," in Proc. ACM Int. Conf. Image and Video Retrieval, 2009.
43. Y. G. Jiang, C. W. Ngo, and J. Yang, "Towards optimal bag-of-features for object categorization and semantic video retrieval," in Proc. ACM Int. Conf. Image and Video Retrieval, 2007.
44. J. Yang and A. G. Hauptmann, "(Un)reliability of video concept detection," in Proc. ACM Int. Conf. Image and Video Retrieval, 2008.