Learning object-to-class kernels for scene classification

IEEE Transactions on Image Processing

Volumn 23, Issue 8, 2014, Pages 3241-3253

  Zhang, Lei ^a   Zhen, Xiantong ^b   Shao, Ling ^c  

^a HARBIN ENGINEERING UNIVERSITY   (China)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

^c UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

kernels; Object bank; object filters; object to class distances; scene classification

Indexed keywords

IMAGE PROCESSING; MATHEMATICAL MODELS;

IMAGE REPRESENTATIONS; KERNELS; OBJECT BANK; OBJECT DETECTORS; OBJECT-TO-CLASS DISTANCES; SCENE CLASSIFICATION; STATE-OF-THE-ART PERFORMANCE; VISUAL RECOGNITION;

BENCHMARKING;

EID: 84903266238     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2328894     Document Type: Article

References (50)

1. M. C. Potter, "Meaning in visual search Science, vol. 187, no. 4180, pp. 965-966, 1975
2. J. Yao, S. Fidler, and R. Urtasun, "Describing the scene as a whole: Joint object detection, scene classification and semantic segmentation in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2012, pp. 702-709
3. M. Szummer and R. W. Picard, "Indoor-outdoor image classification in Proc. IEEE Int. Workshop Content-Based Access Image Video Database, Jan. 1998, pp. 42-51
4. D. B. Walther, B. Chai, E. Caddigan, D. M. Beck, and L. Fei-Fei, "Simple line drawings suffice for functional MRI decoding of natural scene categories Proc. Nat. Acad. Sci., vol. 108, no. 23, pp. 9661-9666, 2011
5. Y-L. Boureau, F. Bach, Y. LeCun, and J. Ponce, "Learning mid-level features for recognition in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2010, pp. 2559-2566
6. L-J. Li, H. Su, E. P. Xing, and L. Fei-Fei, "Object bank: A high-level image representation for scene classification and semantic feature sparsification in Proc. Adv. Neural Inform. Process. Syst., vol. 24. 2010, pp. 1378-1386
7. K. Mikolajczyk and C. Schmid, "Scale & affine invariant interest point detectors Int. J. Comput. Vis., vol. 60, no. 1, pp. 63-86, 2004
8. K. Mikolajczyk et al., "A comparison of affine region Detectors Int. J. Comput. Vis., vol. 65, nos. 1-2, pp. 43-72, 2005
9. D. G. Lowe, "Distinctive image features from scale-invariant keypoints Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004
10. E. Tola, V. Lepetit, and P. Fua, "DAISY: An efficient dense descriptor applied to wide-baseline stereo IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 5, pp. 815-830, May 2010
11. J. C. van Gemert, C. J. Veenman, A. W. M. Smeulders, and J-M. Geusebroek, "Visual word ambiguity IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1271-1283, Jun. 2010
12. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 1794-1801
13. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 3360-3367
14. L. Liu, L. Wang, and X. Liu, "In Defense of soft-Assignment coding in Proc. IEEE Int. Conf. Comput. Vis., ICCV, Nov. 2011, pp. 2486-2493
15. K. Grauman and T. Darrell, "The pyramid match kernel: Discriminative classification with sets of image features in Proc. IEEE Int. Conf. Comput. Vis., ICCV, vol. 2. Oct. 2005, pp. 1458-1465. (Pubitemid 44042350
16. L. Bo and C. Sminchisescu, "Efficient match kernel between sets of features for visual recognition in Proc. Adv. Neural Inform. Process. Syst., 2009, pp. 135-143
17. L. Bo, X. Ren, and D. Fox, "Kernel descriptors for visual recognition in Proc. Adv. Neural Inform. Process. Syst., 2010, pp. 244-252
18. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, vol. 2. Jun. 2006, pp. 2169-2178. (Pubitemid 44931582
19. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001
20. A. Bosch, A. Zisserman, and X. Munoz, "Scene classification via pLSA in Proc. Eur. Conf. Comput. Vis., ECCV, 2006, pp. 517-530
21. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, vol. 2. Jun. 2005, pp. 524-531
22. A. Bosch, A. Zisserman, and X. Muoz, "Scene classification using a hybrid generative/discriminative approach IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 4, pp. 712-727, Apr. 2008
23. F. Zhu and L. Shao, "Weakly-supervised cross-domain Dictionary learning for visual recognition Int. J. Comput. Vis., vol. 109, no. 1-2, pp. 42-59, Aug. 2014
24. L. Shao, L. Liu, and X. Li, "Feature learning for image classification via multiobjective genetic programming IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 7, pp. 1359-1371, Jul. 2014
25. L. Zhang, S. Xie, and X. Zhen, "Towards optimal object bank for scene classification in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., ICASSP, May 2013, pp. 1967-1970
26. L. Zhang, S. Xie, L. Shao, and X. Zhen, "Discriminative high-level representations for scene classification in Proc. IEEE ICIP, Sep. 2013, pp. 4345-4348
27. M. R. Boutell, J. Luo, X. Shen, and C. M. Brown, "Learning multi-label scene classification Pattern Recognit., vol. 37, no. 9, pp. 1757-1771, 2004
28. Z-H. Zhou and M-L. Zhang, "Multi-instance multi-label learning with application to scene classification in Proc. Adv. Neural Inform. Process. Syst., 2006, pp. 1609-1616
29. R. Edwards and L. Collins, "Lexical frequency profiles and Zipf's law Lang. Learn., vol. 61, no. 1, pp. 1-30, 2011
30. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010
31. D. Hoiem, A. A. Efros, and M. Hebert, "Automatic photo pop-up ACM Trans. Graph., vol. 24, no. 3, pp. 577-584, 2005
32. B. C. Russell, A. Torralba, K. P. Murphy, and W. T. Freeman, "LabelMe: A database and web-based tool for image annotation Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 157-173, 2008
33. J. Deng, W. Dong, R. Socher, L-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 248-255
34. J. Vogel and B. Schiele, "Semantic modeling of natural scenes for content-based image retrieval Int. J. Comput. Vis., vol. 72, no. 2, pp. 133-157, 2007
35. O. Boiman, E. Shechtman, and M. Irani, "In Defense of nearest-neighbor based image classification in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2008, pp. 1-8
36. T. Tuytelaars, M. Fritz, K. Saenko, and T. Darrell, "The NBNN kernel in Proc. IEEE Int. Conf. Comput. Vis., ICCV, Nov. 2011, pp. 1824-1831
37. S. McCann and D. G. Lowe, "Local naive Bayes nearest neighbor for image classification in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2012, pp. 3650-3656
38. K. Yu, T. Zhang, and Y. Gong, "Nonlinear learning using local coordinate coding in Proc. Adv. Neural Inf. Process. Syst., Dec. 2009, pp. 2223-2231
39. S. Lyu, "Mercer kernels for object recognition with local features in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, vol. 2. Jun. 2005, pp. 223-229
40. L-J. Li and L. Fei-Fei, "What, where and who? Classifying events by scene and object recognition in Proc. IEEE Int. Conf. Comput. Vis., ICCV, Oct. 2007, pp. 1-8
41. A. Quattoni and A. Torralba, "Recognizing indoor scenes in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2009, pp. 413-420
42. L. Fei-Fei, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories Comput. Vis. Image Understand., vol. 106, no. 1, pp. 59-70, 2007
43. C-C. Chang and C-J. Lin, "LIBSVM: A library for support vector machines ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, p. 27, 2011
44. A. Shabou and H. LeBorgne, "Locality-constrained and spatially regularized coding for scene categorization in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2012, pp. 3618-3625
45. Z. Niu, G. Hua, X. Gao, and Q. Tian, "Context aware topic model for scene recognition in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2012, pp. 2743-2750
46. S. Gao, I. W. H. Tsang, and L. T. Chia, "Kernel sparse representation for image classification and face recognition in Proc. Eur. Conf. Comput. Vis., ECCV, 2010, pp. 1-14
47. M. Dixit, N. Rasiwasia, and N. Vasconcelos, "Adapted Gaussian models for image classification in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2011, pp. 937-943
48. S. Gao, I. W. Tsang, L-T. Chia, and P. Zhao, "Local features are not lonely - Laplacian sparse coding for image classification in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2010, pp. 3555-3561
49. P. Wang, J. Wang, G. Zeng, W. Xu, H. Zha, and S. Li, "Supervised kernel descriptors for visual recognition in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR, Jun. 2013, pp. 2858-2865
50. J. Wu and J. M. Rehg, "CENTRIST: A visual descriptor for scene categorization IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1489-1501, Aug. 2011