Mining compact bag-of-patterns for low bit rate mobile visual search

IEEE Transactions on Image Processing

Volumn 23, Issue 7, 2014, Pages 3099-3113

  Ji, Rongrong ^a,b   Duan, Ling Yu ^a   Chen, Jie ^a   Huang, Tiejun ^a   Gao, Wen ^a  

^a PEKING UNIVERSITY   (China)

^b XIAMEN UNIVERSITY   (China)

Author keywords

bag of words; compact visual descriptor; low bit rate retrieval; Mobile visual search; sparse coding; structure from motion; visual pattern mining

Indexed keywords

CODES (SYMBOLS); GRAPHIC METHODS;

BAG OF WORDS; COMPACT VISUAL DESCRIPTOR; LOW BIT RATE; MOBILE VISUAL SEARCHES; SPARSE CODING; STRUCTURE FROM MOTION; VISUAL PATTERN;

BENCHMARKING;

EID: 84900994890     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2324291     Document Type: Article

References (59)

1. J. Sivic and A. Zisserman, "Video google: A text retrieval approach to object matching in videos," in Proc. 9th IEEE ICCV, Oct. 2003, pp. 1470-1477.
2. D. Nistér and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2006, pp. 2161-2168. (Pubitemid 44931581)
3. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabulary and fast spatial matching," in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-8.
4. G. Schindler, R. Szeliski, and M. Brown, "City-scale location recognition," in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-7.
5. G. Salton and C. Buckley, "Term-weighting approaches in text retrieval," Inform. Process. Manag., vol. 24, no. 5, pp. 513-523, 1988.
6. T. Hofmann, "Unsupervised learning by probabilistic latent semantic analysis," J. Mach. Learn., vol. 42, nos. 1-2, pp. 177-196, Jan./Feb. 2001. (Pubitemid 32872403)
7. D. Blei, A. Ng, and M. Jordan, "Latent dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, Jan. 2003.
8. Z. Wu, Q. Ke, M. Isard, and J. Sun, "Bundling features for large scale partial-duplicate web image search," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 25-32.
9. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 1794-1801.
10. J. Sivic and A. Zisserman, "Video data mining using configurations of viewpoint invariant regions," in Proc. IEEE Comput. Soc. Conf. CVPR, Jul. 2004, pp. I-488-I-495.
11. T. Quack, V. Ferrari, and L. V. Gool, "Video mining with frequent itemset configurations," in Proc. 5th Int. Conf. CIVR, Jul. 2006, pp. 360-369. (Pubitemid 44153576)
12. J. Yuan, Y. Wu, and M. Yang, "Discovery of collocation patterns: From visual words to visual phrases," in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-8.
13. T. Quack, V. Ferrari, B. Leibe, and L. V. Gool, "Efficient mining of frequent and distinctive feature configurations," in Proc. IEEE 11th ICCV, Oct. 2007, pp. 1-8.
14. Y. Huang, S. Shekhar, and H. Xiong, "Discovering collocation patterns from spatial data sets: A general approach," IEEE Trans. Knowl. Data Eng., vol. 16, no. 12, pp. 1472-1485, Dec. 2004. (Pubitemid 40010922)
15. R. Fergus, P. Perona, and A. Zisserman, "Object class recognition by unsupervised scale-invariant learning," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2003, pp. II-264-II-271.
16. R. Fergus, P. Perona, and A. Zisserman, "A sparse object categoty model for efficient learning and exhaustive recognition," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2005, pp. 380-387. (Pubitemid 41275967)
17. R. Ji et al., "Location discriminative vocabulary coding for mobile landmark search," Int. J. Comput. Vis., vol. 96, no. 3, pp. 290-314, Feb. 2011.
18. N. Snavely, S. M. Seitz, and R. Szeliski, "Photo tourism: Exploring photo collections in 3D," in Proc. ACM SIGGRAPH, 2006, pp. 835-846. (Pubitemid 44481045)
19. R. Agrawal, T. Imielinski, and A. N. Swami, "Mining association rules between sets of items in large database," ACM SIGMOD Rec., vol. 22, no. 2, pp. 207-216, Jun. 1993.
20. D. Chen, S. Tsai, V. Chandrasekhar, G. Takacs, J. Singh, and B. Girod, "Tree histogram coding for mobile image matching," in Proc. DCC, 2009, pp. 143-152.
21. V. Chandrasekhar, G. Takacs, D. Chen, S. Tsai, R. Grzeszczuk, and B. Girod, "CHoG: Compressed histogram of gradients a low bit-rate feature descriptor," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 2504-2511.
22. F.-F. Li and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2005, pp. 524-531.
23. A. Bosch, A. Zisserman, and X. Munoz, "Scene Classification using a hybrid generative/discriminative approach," J. IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 4, pp. 712-727, Apr. 2008. (Pubitemid 351559723)
24. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing," in Proc. NIPS, Dec. 2008.
25. J. Yang, Y.-G. Jiang, A. G. Hauptmann, and C.-W. Ngo, "Evaluating bag-of-visual-words representations in scene classification," in Proc. Int. Workshop MIR, 2007, pp. 197-206.
26. H. Jegou, M. Douze, C. Schmid, and P. Perez, "Aggregating local descriptors into a compact image representation," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 3304-3311.
27. A. Gionis, P. Indyk, and R. Motwani, "Similarity search in high dimensions via hashing," in Proc. 25th Int. Conf. VLDB, 1999, pp. 518-529.
28. B. Kulis and K. Grauman, "Kernelized locality-sensitive hashing for scalable image search," in Proc. 12th ICCV, Sep./Oct. 2009, pp. 2130-2137.
29. H. Jegou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Proc. 10th ECCV, Oct. 2008, pp. 304-317.
30. J. C. van Gemert, C. J. Veenman, A. W. M. Smeulders, and J.-M. Geusebroek, "Visual word ambiguity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1271-1283, Jul. 2009.
31. G. Csurka, C. Bray, C. Dance, and L. Fan, "Visual categorization with bags of keypoints," in Proc. Workshop Statist. Learn. Comput. Vis., ECCV, 2004.
32. D. Crandall, P. Felzenszwalb, and D. Hutternlocher, "Spatial priors for part-based recognition using statistical models," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2005, pp. 10-17.
33. F. Perronnin, C. Dance, G. Csurka, and M. Bressan, "Adapted vocabularies for generic visual categorization," in Proc. 9th ECCV, May 2006, pp. 464-475. (Pubitemid 44029651)
34. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid, "Local features and kernels for classification of texture and object categories: A comprehensive study," Int. J. Comput. Vis., vol. 73, no. 2, pp. 213-238, Jun. 2007. (Pubitemid 46181625)
35. J. Liu, Y. Yang, and M. Shah, "Learning semantic visual vocabularies using diffusion distance," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 461-468.
36. J. Winn, A. Criminisi, and T. Minka, "Object categorization by learned universal visual dictionary," in Proc. Int. IEEE ICCV, Oct. 2005, pp. 1800-1807. (Pubitemid 44042395)
37. D. G. Lowe, "Distinctive image features form scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
38. H. Bay, T. Tuytelaars, and L. Van Gool, "SURF: Speeded up robust features," in Proc. 9th ECCV, May 2006, pp. 404-417. (Pubitemid 44029795)
39. Y. Ke and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun./Jul. 2004, pp. II-506-II-513.
40. E. Eade and T. Drummond, "Unified loop closing and recovery for real time monocular SLAM," in Proc. BMVC, 2008.
41. A. Irschara, C. Zach, J.-M. Frahm, and H. Bischof, "From structure-from-motion point clouds to fast location recognition," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 2599-2606.
42. J. Hays and A. Efros, "IMG2GPS: Estimating geographic information from a single image," in Proc. IEEE Conf. CVPR, 2008, pp. 1-8.
43. E. Kalogerakis, O. Vesselova, J. Hays, A. A. Efros, and A. Hertzmann, "Image sequence geolocation with human travel priors," in Proc. IEEE 12th ICCV, Sep./Oct. 2009, pp. 253-260.
44. Y.-T. Zheng et al., "Tour the world: Building a web-scale landmark recognition engine," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 1085-1092.
45. R. Tibshirani, "Regression shrinkage and selection via the Lasso," J. Roy. Statist. Soc., Ser. B, 1997, pp. 267-288.
46. D. Donoho, "For most large underdetermined systems of equations, the minimal l1-norm near-solution approximates the sparsest near-solution," Commun. Pure Appl. Math., vol. 59, no. 7, pp. 907-934, Jul. 2006.
47. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
48. S. A. J. Winder and M. Brown, "Learning local image descriptors," in Proc. IEEE Comput. Soc. Conf. CVPR, Jun. 2007, pp. 1-8.
49. R. Ji, L.-Y. Duan, J. Chen, and W. Gao, "Towards compact topical descriptor," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 2925-2932.
50. J. X. Xiao, J. N. Chen, D. Y. Yeung, and L. Quan, "Structuring visual words in 3D for arbitrary-view object localization," in Proc. 10th ECCV, Oct. 2008, pp. 725-737.
51. R. Ji, X. Xie, H. Yao, and W.-Y. Ma, "Vocabulary tree incremental indexing for scalable scene recognition," in Proc. IEEE Int. Conf. Multimedia Expo, Jun./Apr. 2008, pp. 869-872.
52. J. Chen, L.-Y. Duan, R. Ji, and W. Gao, "Pruning tree-structured vector quantizer towards low bit rate mobile visual search," in Proc. IEEE ICASSP, Mar. 2012, pp. 965-968.
53. Y. Gao, M. Wang, Z.-J. Zha, Q. Tian, Q. Dai, and N. Zhang, "Less is more: Efficient 3-D object retrieval with query view selection," IEEE Trans. Multimedia, vol. 13, no. 5, pp. 1007-1018, Oct. 2011.
54. S. Zhang, Q. Tian, G. Hua, Q. Huang, and S. Li, "Descriptive visual words and visual phrases for image applications," in Proc. 17th ACM Int. Conf. Multimedia, 2009, pp. 75-84.
55. S. Zhang, Q. Huang, G. Hua, S. Jiang, W. Gao, and Q. Tian, "Building contextual visual vocabulary for large-scale image applications," in Proc. ACM Int. Conf. Multimedia, 2010, pp. 501-510.
56. X. Wang, M. Yang, T. Cour, S. Zhu, K. Yu, and T. X. Han, "Contextual weighting for vocabulary tree based image retrieval," in Proc. IEEE ICCV, Nov. 2011, pp. 209-216.
57. Y. Gao, M. Wang, D. Tao, R. Ji, and Q. Dai, "3-D object retrieval and recognition with hypergraph analysis," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4290-4303, Sep. 2012.
58. D. M. Chen et al., "City-scale landmark identification on mobile devices," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 737-744.
59. Y. Gao et al., "Camera constraint-free view-based 3-D object retrieval," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2269-2281, Apr. 2012.