Flexible image similarity computation using hyper-spatial matching

IEEE Transactions on Image Processing

Volumn 23, Issue 9, 2014, Pages 4112-4125

  Zhang, Yu ^a   Wu, Jianxin ^b   Cai, Jianfei ^a   Lin, Weiyao ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b NANJING UNIVERSITY   (China)

^c SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

fast SVM learning; mage similarity; spatial matching

Indexed keywords

IMAGE ANALYSIS;

FAST SVM LEARNING; IMAGE SIMILARITY; IMAGE SIMILARITY COMPUTATION; LEARNING STRATEGY; MAGE SIMILARITY; SPATIAL MATCHING; SPATIAL PYRAMID MATCHING; TRAINING AND TESTING;

IMAGE CLASSIFICATION;

EID: 84940330596     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2344296     Document Type: Article

References (46)

1. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. 2006, pp. 2169-2178.
2. T. Harada, Y. Ushiku, Y. Yamashita, and Y. Kuniyoshi, "Discriminative spatial pyramid," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1617-1624.
3. G. Sharma, F. Jurie, and C. Schmid, "Discriminative spatial saliency for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3434-3441.
4. Y. Jia, C. Huang, and T. Darrell, "Beyond spatial pyramids: Receptive field learning for pooled image features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3370-3377.
5. Y.-L. Boureau, F. Bach, Y. LeCun, and J. Ponce, "Learning mid-level features for recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2559-2566.
6. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1794-1801.
7. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3360-3367.
8. F. Perronnin, J. Sánchez, and T. Mensink, "Improving the Fisher kernel for large-scale image classification," in Proc. 11th Eur. Conf. Comput. Vis., Sep. 2010, pp. 143-156.
9. J. Wu and J. M. Rehg, "CENTRIST: A visual descriptor for scene categorization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1489-1501, Aug. 2011.
10. F. Perronnin and C. Dance, "Fisher kernels on visual vocabularies for image categorization," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
11. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification," J. Mach. Learn. Res., vol. 9, pp. 1871-1874, Aug. 2008.
12. J. Wu, "Efficient HIK SVM learning for image classification," IEEE Trans. Image Process., vol. 21, no. 10, pp. 4442-4453, Oct. 2012.
13. A. Vedaldi and A. Zisserman, "Efficient additive kernels via explicit feature maps," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 480-492, Mar. 2012.
14. J. Wu, "Power mean SVM for large scale visual classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2344-2351.
15. G. Sharma and F. Jurie, "Learning discriminative spatial representation for image classification," in Proc. Brit. Mach. Vis. Conf., 2011.
16. Y. Jiang, J. Yuan, and G. Yu, "Randomized spatial partition for scene recognition," in Proc. 12th Eur. Conf. Comput. Vis., Oct. 2012, pp. 730-743.
17. H. Bilen, V. Namboodiri, and L. Van Gool, "Object and action classification with latent variables," in Proc. Brit. Mach. Vis. Conf., Sep. 2011.
18. D. Xu, S. Yan, and J. Luo, "Face recognition using spatially constrained earth mover's distance," IEEE Trans. Image Process., vol. 17, no. 11, pp. 2256-2260, Nov. 2008.
19. J. Zou, Q. Ji, and G. Nagy, "A comparative study of local matching approach for face recognition," IEEE Trans. Image Process., vol. 16, no. 10, pp. 2617-2628, Oct. 2007.
20. S. Gao, I. W.-H. Tsang, and L.-T. Chia, "Laplacian sparse coding, hypergraph Laplacian sparse coding, and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 92-104, Jan. 2013.
21. A. Vedaldi and S. Soatto, "Relaxed matching kernels for robust image comparison," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 73-86.
22. E. S. Ng and N. G. Kingsbury, "Robust pairwise matching of interest points with complex wavelets," IEEE Trans. Image Process., vol. 21, no. 8, pp. 3429-3442, Aug. 2012.
23. A. Perina and N. Jojic, "Spring lattice counting grids: Scene recognition using deformable positional constraints," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 837-851.
24. O. Russakovsky, Y. Lin, K. Yu, and L. Fei-Fei, "Object-centric spatial pooling for image classification," in Proc. 12th Eur. Conf. Comput. Vis., Oct. 2012, pp. 1-15.
25. A. Perina and N. Jojic, "Image analysis by counting on a grid," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1985-1992.
26. X. Zhang, Z. Li, L. Zhang, W.-Y. Ma, and H.-Y. Shum, "Efficient indexing for large scale visual search," in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 1103-1110.
27. T. de Campos, G. Csurka, and F. Perronnin, "Images as sets of locally weighted features," Comput. Vis. Image Understand., vol. 116, no. 1, pp. 68-85, Jan. 2012.
28. S. Maji, A. C. Berg, and J. Malik, "Efficient classification for additive kernel SVMs," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 66-77, Jan. 2013.
29. F. Perronnin, Z. Akata, Z. Harchaoui, and C. Schmid, "Towards good practice in large-scale learning for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3482-3489.
30. G. Sharma and F. Jurie, "A novel approach for efficient SVM classification with histogram intersection kernel," in Proc. Brit. Mach. Vis. Conf., 2013.
31. F. Perronnin, J. Sánchez, and Y. Liu, "Large-scale image categorization with explicit data embedding," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2297-2304.
32. F. Perronnin and C. Dance, "Fisher kernels on visual vocabularies for image categorization," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
33. H. Jegou, F. Perronnin, M. Douze, J. Sanchez, P. Perez, and C. Schmid, "Aggregating local image descriptors into compact codes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1704-1716, Sep. 2012.
34. J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba, "SUN database: Large-scale scene recognition from abbey to zoo," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3485-3492.
35. D. Haussler, "Convolution kernels on discrete structures," Dept. Comput. Sci., Univ. California Santa Cruz, Santa Cruz, CA, USA, Tech. Rep. UCSC-CRL-99-10, 1999.
36. C. Wallraven and B. Caputo, "Recognition with local features: The kernel recipe," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 257-264.
37. S. Lyu, "Mercer kernels for object recognition with local features," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 223-229.
38. L. Bo and C. Sminchisescu, "Efficient match kernels between sets of features for visual recognition," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 135-143.
39. G.-X. Yuan, C.-H. Ho, and C.-J. Lin, "Recent advances of large-scale linear classification," Proc. IEEE, vol. 100, no. 9, pp. 2584-2603, Sep. 2012.
40. J. Sánchez, F. Perronnin, and T. de Campos, "Modeling the spatial layout of images beyond spatial pyramids," Pattern Recognit. Lett., vol. 33, no. 16, pp. 2216-2223, Dec. 2012.
41. M. C. Grant and S. Boyd. CVX: Matlab Software for Disciplined Convex Programming. [Online]. Available: http://cvxr.com/cvx, accessed Jul. 12, 2013.
42. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 27:1-27:27, 2011. [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm
43. A. Quattoni and A. Torralba, "Recognizing indoor scenes," in Proc. Comput. Vis. Pattern Recognit., 2009, pp. 413-420.
44. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. (2007). The PASCAL Visual Object Classes Challenge Results. [Online]. Available: http://www.pascalnetwork. org/challenges/VOC/voc2007/workshop/index. html
45. J. Krapac, J. Verbeek, and F. Jurie, "Modeling spatial layout with fisher vectors for image categorization," in Proc. Int. Conf. Comput. Vis. Pattern Recognit., 2012, pp. 1487-1494.
46. A. Vedaldi and B. Fulkerson. (2008). VLFeat: An Open and Portable Library of Computer Vision Algorithms. [Online]. Available: http://www.vlfeat.org/