Images as sets of locally weighted features

Computer Vision and Image Understanding

Volumn 116, Issue 1, 2012, Pages 68-85

  De Campos, Teófilo ^a,b   Csurka, Gabriela ^a,b   Perronnin, Florent ^a,b  

^a UNIVERSITY OF SURREY   (United Kingdom)

^b XEROX RESEARCH CENTRE EUROPE   (France)

Author keywords

Bag of visual words; Image categorisation; Saliency estimation

Indexed keywords

BAG-OF-VISUAL-WORDS; COMPUTATIONAL COSTS; DATA SETS; ESTIMATION METHODS; FISHER KERNELS; GAZE TRACKING; GENERIC FRAMEWORKS; IMAGE CATEGORISATION; LOCAL FEATURE; MOUSE CLICKS; MULTIPLE SAMPLING; PERFORMANCE IMPROVEMENTS; SALIENCY MAP; VISUAL FEATURE; WEIGHT FACTOR; WEIGHTED FEATURES;

IMAGING SYSTEMS; PROFITABILITY;

ESTIMATION;

EID: 81355124124     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2011.07.011     Document Type: Article

References (65)

1. B. Alexe, T. Deselaers, V. Ferrari, What is an object? in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, San Francisco, CA, June 13-18, 2010.
2. Y.L. Boureau, J. Ponce, Y. LeCun, A theoretical analysis of feature pooling in visual recognition, in: Proc. of the 27th International Conference on Machine Learning (ICML), Haifa, Israel, 2010.
3. N.D. Bruce, and J.K. Tsotsos Saliency, attention, and visual search: an information theoretic approach Journal of Vision 9 3 2009 1 24 5
4. T. de Campos, Description and Evaluation of Novel Local Features with Usable Sub-Categorisation Performance, Tech. rep., PinView European Community Project FP7-216529, 2008. D6.1, < http://www.pinview.eu >.
5. T. de Campos, R. Feris, R. Cesar, Eigenfaces versus eigeneyes: first steps toward performance assessment of representations for face recognition, in: MICAI, LNCS, vol. 1793, pp. 197-206. Acapulco, Mexico, 2000.
6. E. Chang, S. Mallat, and C. Yap Wavelet foveation Journal of Applied and Computational Harmonic Analysis 9 2000 312 335
7. L.Q. Chen, X. Xie, X. Fan, W.Y. Ma, H.J. Zhang, and H.Q. Zhou A visual attention model for adapting images on small displays ACM Multimedia Systems Journal 9 4 2003
8. G. Csurka, C.R. Dance, L. Fan, J. Willamowski, C. Bray, Visual categorization with bags of keypoints, in: ECCV International Workshop on Statistical Learning in Computer Vision, 2004.
9. G. Csurka, F. Perronnin, A simple high performance approach to semantic segmentation, In: BMVC, 2008.
10. W. Einhäuser, M. Spain, and P. Perona Objects predict fixations better than early saliency Journal of Vision 8 14:18 2008 1 26 < http://journalofvision.org/8/14/18/
11. J. Elson, J.R. Douceur, J. Howell, J. Saul, A CAPTCHA that exploits interest-aligned manual image categorization, in: 14th ACM Conference on Computer and Communications Security (CCS), 2007.
12. M. Everingham, L.V. Gool, C.K.I. Williams, J. Winn, A. Zisserman, The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results, 2007, < http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html >.
13. M. Everingham, L.V. Gool, C.K.I. Williams, J. Winn, A. Zisserman, The PASCAL Visual Object Classes Challenge 2008 (VOC2008) Results, 2008, < http://www.pascal-network.org/challenges/VOC/voc2008/workshop/index.html >.
14. M. Everingham, L. Van Gool, C.K.I. Williams, J. Winn, A. Zisserman, The PASCAL Visual Object Classes Challenge 2010 (VOC2010) Results, 2010, < http://www.pascal-network.org/challenges/VOC/voc2010/workshop/index.html >.
15. M. Everingham, L. Van Gool, C.K.I. Williams, J. Winn, A. Zisserman, The PASCAL Visual Object Classes Challenge 2009 (VOC2009) Results, 2009, < http://www.pascal-network.org/challenges/VOC/voc2009/workshop/index.html >.
16. J.D.R. Farqhar, S. Szedmak, H. Meng, J. Shawe-Taylor, Improving "bag-of-keypoints" Image Categorisation: Generative Models and Pdf-Kernels, Tech. Rep., University of Southampton, 2005, LAVA Project, European Union.
17. T. Foulsham, and G. Underwood What can saliency models predict about eye movements? spatial and sequential aspects of fixations during encoding and recognition Journal of Vision 8 2 2008 1 17
18. S. Frintrop, E. Rome, and H. Christensen Computational visual attention systems and their cognitive foundation: A survey ACM Transactions on Applied Perception 2009
19. J.C. van Gemert, C.J. Veenman, A.W.M. Smeulders, and J.M. Geusebroek Visual word ambiguity IEEE Transactions on Pattern Analysis and Machine Intelligence 32 7 2010 1271 1283
20. P. Harding, N. Robertson, A comparison of feature detectors with passive and task-based visual saliency, in: Proc. Scandinavian Conference on Image Analysis, No. 5575 in LNCS, Springer, Oslo, 2009, pp. 714-725.
21. C. Harris, M. Stephens, A combined corner and edge detector, In: Proc. 4th Alvey Vision Conf., Manchester, 1988, pp. 147-151.
22. L. Itti, and C. Koch A saliency-based search mechanism for overt and covert shifts of visual attention Vision Research 40 2000 1489 1506 (Pubitemid 30216462)
23. A. Jaimes, J. Pelz, T. Grabowski, J. Babcock, S.F. Chang, Using human observers' eye movements in automatic image classifiers, in: Proc. SPIE Conference on Human Vision and Electronic Imaging VI. San Jose, CA, 2001.
24. H. Jégou, M. Douze, C. Schmid, On the burstiness of visual elements, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Miami Beach, FL, June 20-25, 2009.
25. T. Judd, K. Ehinger, F. Durand, A. Torralba, Learning to predict where humans look, in: Proc. 12th Int. Conf. on Computer Vision, Kyoto, Japan, September 29-October 2, 2009.
26. T. Kadir, and M. Brady Scale, saliency and image description IJCV 45 2 2001 83 105
27. M.S. Keil "I look in your eyes, honey": internal face features induce spatial frequency preference for human face processing PLoS Computational Biology 5 3 2009
28. W. Kienzle, F.A. Wichmann, B. Schölkopf, M.O. Franz, A nonparametric approach to bottom-up visual saliency, in: Proc. of the Neural Information Processing Systems (NIPS), 2007, pp. 689-698.
29. G. Kootstra, A. Nederveen, B. de Boer, Paying attention to symmetry, in: BMVC, 2008.
30. B. Krishnapuram, L. Carin, M. Figueiredo, and A. Hastemink Sparse multimodal logistic regression: fast algorithms and generalization bounds IEEE PAMI 27 6 2005
31. D.G. Lowe Distinctive image features from scale-invariant keypoints IJCV 60 2 2004
32. L. Marchesotti, C. Cifarelli, G. Csurka, A framework for visual saliency detection with applications to image thumbnailing, in: Proc. 12th Int. Conf. on Computer Vision, Kyoto, Japan, September 29-October 2, 2009.
33. K. Mikolajczyk, and C. Schmid Scale and affine invariant interest point detectors IJCV 60 1 2004
34. K. Mikolajczyk, and C. Schmid A performance evaluation of local descriptors IEEE PAMI 27 10 2005
35. F. Moosmann, D. Larlus, F. Jurie, Learning saliency maps for object categorization, in: ECCV International Workshop on The Representation and Use of Prior Knowledge in Vision, Springer, 2006.
36. M.E. Nilsback, A. Zisserman, Automated flower classification over a large number of classes, in: Proc. of the Indian Conference on Computer Vision, Graphics and Image Processing, 2008.
37. E. Nowak, F. Jurie, W. Triggs, Sampling strategies for bag-of-features image classification, in: ECCV, 2006.
38. O. Oyekoya, Eye Tracking: A Perceptual Interface for Content Based Image Retrieval, Ph.D. Thesis, DEEE, University College London, 2007.
39. D. Parikh, C. Lawrence Zitnick, T. Chen, Determining patch saliency using low-level context, in: ECCV, 2008.
40. F. Perronnin Universal and adapted vocabularies for generic visual categorization IEEE Transactions on Pattern Analysis and Machine Intelligence 30 7 2008 1243 1256
41. F. Perronnin, C. Dance, Fisher kernel on visual vocabularies for image categorization, in: CVPR, 2007.
42. F. Perronnin, J. Sánchez, T. Mensink, Improving the fisher kernel for large-scale image classification, in: Proc. 11th European Conf. on Computer Vision, vol. 4, Crete, Greece, September 5-11, 2010, pp. 143-156.
43. U. Rutishauser, D. Walther, C. Koch, P. Perona, Is bottom-up attention useful for object recognition? in: CVPR, 2004.
44. J. Sanchez, F. Perronnin, T. de Campos, Modeling the spatial layout of images beyond spatial pyramids, Pattern Recognition Letters, in preparation.
45. C. Saunders, A. Klami, Database of Eye-Movement Recordings, Tech. Rep., PinView European Community Project FP7-216529, 2008. D8.3, < http://www.pinview.eu >.
46. J. Sivic, A. Zisserman, Video Google: A text retrieval approach to object matching in videos, in: ICCV, 2003.
47. F.W.M. Stentiford Attention based similarity Pattern Recognition 40 3 2007 771 783
48. B. Suh, H. Ling, B. Bederson, D. Jacobs, Thumbnail cropping and its effectiveness, in: ACM User Interface Software and Technology, 2003.
49. V. Sundstedt, A. Chalmers, K. Cater, K. Debattista, Top-down visual attention for efficient rendering of task related scenes, in: In Vision, Modeling and Visualization, 2004, pp. 209-216.
50. M.A. Tahir et al, UvA & Surrey @ PASCAL 2008, Visual Recognition Challenge Workshop, In Conjunction with ECCV, 2008.
51. B.W. Tatler The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions Journal of Vision 7 14:4 2007 1 17
52. A. Torralba Modeling global scene factors in attention Journal of Optical Society of America A. Special Issue on Bayesian and Statistical Approaches to Vision 20 7 2003 1407 1418
53. A. Torralba, A. Oliva, M. Castelhano, and J. Henderson Contextual guidance of eye movements and attention in real-world scenes: the role of global features on object search Psychological Review 113 4 2006 766 786 (Pubitemid 44629917)
54. J.R.R. Uijlings, A.W.M. Smeulders, R.J.H. Scha, What is the spatial extent of an object? in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Miami Beach, FL, June 20-25, 2009.
55. A. Vedald, V. Gulshan, M. Varma, A. Zisserman, Multiple kernels for object detection, in: Proc. 12th Int. Conf. on Computer Vision, Kyoto, Japan, September 29-October 2, 2009.
56. M. Vidal-Naquet, S. Ullman, Object recognition with informative features and linear classification, in: ICCV, 2003.
57. V. Viitaniemi, and J. Laaksonen Use of image regions in context-adaptive image classification International Conference on Semantic and Digital Media Technologies (SAMT 2006) LNCS 2006 Springer Athens, Greece 169 183
58. V. Viitaniemi, J. Laaksonen, Spatial extensions to bag of visual words, in: ACM International Conference on Image and Video Retrieval (CIVR). Santorini, Greece, 2009.
59. D. Walther, and C. Koch Modeling attention to salient proto-objects Neural Networks 19 2006 1395 1407 (Pubitemid 44708603)
60. G. Wang, D. Forsyth, Joint learning of visual attributes, object classes and visual saliency, in: Proc. 12th Int. Conf. on Computer Vision, Kyoto, Japan, September 29-October 2, 2009.
61. W. Wang, Y. Wang, Q. Huang, W. Gao, Measuring visual saliency by site entropy rate, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, San Francisco, CA, June 13-18, 2010.
62. Z. Wang, B. Li, A two-stage approach to saliency detection in images, in: ICASSP, 2008.
63. J. Winn, A. Criminisi, T. Minka, Object categorization by learned universal visual dictionary, in: Proc. 10th Int. Conf. on Computer Vision, Beijing, China, October 15-21, 2005.
64. J. Zhang, M. Marszałek, S. Lazebnik, and C. Schmid Local features and kernels for classification of texture and object categories: a comprehensive study IJCV 73 2 2007
65. X. Zhou, K. Yu, T. Zhang, T.S. Huang, Image classification using super-vector coding of local image descriptors, in: Proc. 11th European Conf. on Computer Vision, Crete, Greece, September 5-11, 2010.