A performance evaluation of gradient field HOG descriptor for sketch based image retrieval

Computer Vision and Image Understanding

Volumn 117, Issue 7, 2013, Pages 790-806

  Hu, Rui ^a   Collornosse, John ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Bag of visual words; Image descriptors; Matching; Sketch based image retrieval

Indexed keywords

GRAPHIC METHODS; SEARCH ENGINES; SEMANTICS;

AFFINE DEFORMATION; BAG-OF-VISUAL-WORDS; IMAGE DESCRIPTORS; IMAGE RETRIEVAL SYSTEMS; MATCHING; RETRIEVAL FRAMEWORKS; SEMANTIC SIMILARITY; SKETCH-BASED IMAGE RETRIEVALS;

IMAGE RETRIEVAL;

EID: 84885381467     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2013.02.005     Document Type: Article

References (69)

1. A.D. Bimbo, P. Pala, Visual image retrieval by elastic matching of user sketches, in: IEEE PAMI, 1997. PP. 121-132. (Pubitemid 127828328)
2. M. Eitz, K. Hildebrand, T. Boubekeur, M. Alexa, A descriptor for large scale image retrieval based on sketched feature lines, in: SBIM, 2009, pp. 29-38.
3. MA. Tahir, F. Yan, M. Barnard, M. Awais, K. Mikolajczyk, J. Kittler, The university of surrey visual concept detection system at imageclef 2010: working notes, in: ICPR, 2010.
4. J. Sivic, A. Zisserman, Video Google: a text retrieval approach to object matching in videos, in: ICCV, vol. 2, 2003, pp. 1470-1477.
5. O. Chum, J. Philbin, J. Sivic, M. Isarci, A. Zisserman, Total recall: automatic query expansion with a generative feature model for object retrieval, in: ICCV, 2007.
6. R. Flu, M. Barnard, J.P. Collomosse, Gradient field descriptor for sketch based retrieval and localization, in: ICIP, 2010, pp. 1025-1028.
7. T. Kato, T. Kurita, N. Otsu, K. Hirata, A sketch retrieval method for full color image database query by visual example, in: ICPR, 1992, pp. 530-533.
8. J.-L Shih, L-I-l. Chen, A new system for trademark segmentation and retrieval, Image Vision Computing (2001) 1011-1018. (Pubitemid 33019032)
9. W.FI. Leung, T. Chen, Trademark retrieval using contour-skeleton stroke classification, in: ICME, 2002, pp. 517-520.
10. Mj. Fonseca, A. Ferreira, J.A. Jorge, Content-based retrieval of technical drawings, in: IJCAT, 2005, pp. 86-100. (Pubitemid 40422137)
11. S. Liang, Z. Sun, Sketch retrieval and relevance feedback with biased SVM classification, Pattern Recognition Letters (2008) 1733-1741.
12. M.J. Fonseca, D. Goncalves, sketch-a-doc: using sketches to find documents, in: Proceedings of the 16th International Conference on flistrihuted Multimedia Systems (DMS), 2010, pp. 327-330.
13. P. Fränti, A. Mednonogov, V. Kyrki, H. Kälviäinen, Content-based matching of line-drawing images using the Hough transform, International Journal on Document Analysis and Recognition (2000) 24-25.
14. P. Sousa, M.J. Fonseca, Sketch-based retrieval of drawings using spatial proximity, Journal of Visual Languages and Computing (JVLC) (2010) 69-80.
15. C. Wang, J. Zhang, B. Yang, L. Zhang, Sketch2Cartoon: composing cartoon images by sketching, ACM Multimedia (2011) 789-790.
16. S. Liang, Z. Sun, B. Li, Sketch retrieval based on spatial relations, in: CGIV, 2005, pp. 24-29.
17. W.Fi. Leung, T. Chen, Retrieval of sketches based on spatial relation between strokes, in: ICIP, 2002, pp. 908-911.
18. M.J. Fonseca, A. Ferreira,J.A. Jorge, Sketch-based retrieval of complex drawings using hierarchical topology and geometry, Computer-Aided Design (2009) 1067-1081.
19. G. Qiu, Indexing chromatic and achromatic patterns for content-based colour image retrieval, Pattern Recognition (2002) 1675-1686. (Pubitemid 34557571)
20. J. Ashley, M. Flickner, J.L. Flafner, D. Lee, W. Niblack, D. Petkovic, The query by image content (QBIC) system, in: SIGMOD Conference, 1995, p. 475.
21. J. Smith, S.-F. Chang, Visualseek: a fully automated content-based image query system, in: ACM Multimedia, 1996, pp. 87-98.
22. CE. Jacobs, A. Finkelstein, DH. Salesin, Fast multi-resolution image querying, in: Proc. ACM SIGGRAPH, 1995, PP. 277-286.
23. M.N. Do, M. Vetterli, Wavelet-based texture retrieval using generalized gaussian density and kullback-leibler distance, IEEE Transactions on Image Processing (2002) 146-158. (Pubitemid 34278451)
24. MR. Pi, C.S. Tong, S.K. Choy, H. Zhang, A fast and effective model for wavelet subband histograms and its application in texture image retrieval, 2006.
25. S.-K. Choy, C.-S. Tong, Statistical wavelet subbanci characterization based on generalized gamma density and its application in texture retrieval, IEEE Transactions on Image Processing 19 (2) (2010) 281-289.
26. E. Sciascio, M. Mongiello, M. Mongiello, Content-based image retrieval over the web using query by sketch and relevance feedback, in: Intl. Conf. on Visual Information Systems, 1999, pp. 123-130.
27. S. Matusiak, M. Daoudi, T. Blu, O. Avaro, Sketch-based images database retrieval, in: International Workshop on Advances in Multimedia Information Systems, 1998, pp. 185-191. (Pubitemid 128144212)
28. F. Mokhtarian, AK. Mackworth, A theory of multiscale, curvature-based shape representation for planar curves, in: PAMI, 1992, pp. 789-805.
29. A. del Bimbo, P. Pala, Visual image retrieval by elastic matching of user sketches, in: PAMI, 1997, pp. 121-132.
30. I-I.R.S. Ip, A.K.Y.Wong, W.Y.F. Cheng, J. Feng, Affine-invariant sketch-based retrieval of images, in: International Conference on Computer Graphics, 2001, pp. 55-61. (Pubitemid 32797563)
31. A.K.Jain, A. Vailaya, Image retrieval using color and shape, Pattern Recognition (1996) 1233-1244. (Pubitemid 126405513)
32. Y. Chans, Z. Lei, D. Lopresti, S.Y. Kung, A feature-based approach for image retrieval by sketch, in: SPIE Storage and Retrieval for Image and Video Databases, 1997.
33. R. Rajendran, S. Chang, Image retrieval with sketches and compositions, in: ICME, 2000, PP. 717-720. (Pubitemid 33059044)
34. A. Chalechale, G. Naghcly, A. Mertins, Sketch-based image matching using angular partitioning, IEEE Transactions on Systems, Man, and Cybernetics (2005) 28-41. (Pubitemid 40085384)
35. L. Tao, L. Yuan, J. Sun, Skyfincler: attribute-based sky image search, ACM Transactions on Graphics (2009).
36. E. Shechtman, M. Irani, Matching local self-similarities across images and videos, in: CVPR, 2007
37. C. Wang, Y. Cao, L. Zhang, Mindfinder: a sketch based image search engine based on edge index, Proceedings of Computer Vision and Pattern Recognition (2011).
38. M. Eitz, K. Hildebrand, T. Boubekeur, M. Alexa, Sketch-based image retrieval: benchmark and bag-of-features descriptors, in: TVCG, vol. 99, 2010.
39. T. Chen, M.-M. Cheng, P. Tan, S. Ariel, S.-M. I-lu, Sketch2Photo: internet image montage, ACM Transactions on Graphics 28 (5) (2009) 1-10.
40. C. Wang, Z. Li, L. Zhang, Mindfinder: image search by interactive sketching and tagging, in: WWW, 2010, pp. 1309-1312.
41. Y. Cao, R. Wang, C. Wang, Z. Li, L Zhang, L. Zhang, Mindfinder: interactive sketch-based image search on millions of images, in: ACM Multimedia, 2010, pp. 1605-1608.
42. B. Sigurbjornsson, R. van Zwol, Flickr tag recommendation based on collective knowledge, in: WWW, 2008, pp. 327-336.
43. C. Wartena, R. Brussee, M. Wibbels, Using tag co-occurrence for recommendation, in: 19th International Conference on Intelligent Systems Design and Applications, 2009, pp. 273-278.
44. P. Schmitz, Inducing ontology from flickr tags, in: Proceedings of the Collaborative Web Tagging Workshop, 2006
45. H.J. Escalante, M. Montes, L.E. Sucar, Improving automatic image annotation based on word co-occurrence, 2008, pp. 57-70.
46. A. Isaac, L. van der Meij, S. Schlobach, S. Wang, An empirical study of instance- based ontology matching, in: ISWC/ASWC, 2007, pp. 253-266.
47. R. Agrawal, T. Imielinski, A. Swami, Mining association rules between sets of items in large databases, 1993, pp. 207-216.
48. M. Lipczak, Tag recommendation for folksonomies oriented towards individual users, in: ECML/PKDD Discovery Challenge Workshop, 2008
49. R. Flu, S. James, J.P. Collomosse, Annotated free-hand sketches for video retrieval using object semantics and motion, in: MMM, 2012, pp. 473-484.
50. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: CVPR, 2005, pp. 886-893. (Pubitemid 43897286)
51. P. Perez, M. Gangnet, A. Blake, Poisson image editing, in: ACM Trans. Graph. 22 (3), 2003, pp. 313-318.
52. S. Toldeo, D. Chen, V. Rotkin, TAUCS: a library of sparse linear solvers. .
53. A. Bosch, A. Zisserman, X. Munoz, Representing shape with a spatial pyramid kernel, in: CIVR, 2007, pp. 401-408. (Pubitemid 350229652)
54. J. Yang, Y.-G. Jiang, A.G. Hauptmann, C.-W. Ngo, Evaluating bag-of-visual- words representations in scene classification, in: MIR, 2007, pp. 197-206.
55. B. Geng, L. Yang, C. Xu, A study of language model for image retrieval, in: Proceedings of the 2009 IEEE International Conference on Data Mining Workshops, 2009, pp. 158-163.
56. K. Mikolajczyk, C. Schmid, Scale & affine invariant interest point detectors, in: IJCV, 2004, pp. 63-86.
57. K. Mikolajczyk, C. Schmid, A performance evaluation of local descriptors, in: PAMI 27(10), 2005. pp. 1615-1630. (Pubitemid 41555406)
58. K. Mikolajczyk, I-I. Uemura, Action recognition with appearance-motion features and fast search trees, Computer Vision and Image Understanding 115 (3) (2011) 426-438.
59. R. Ren, J.P. Collomosse, J.M. Jose, A BoVW based query generative model, in: MMM,2011,pp. 118-128.
60. The Lemur project. (accessed March 2011).
61. J. Callan, Z. Lu, W. Croft, Searching distributed collections with inference networks, in: Proc. ACM SIGIR, 1995, pp. 21-29.
62. D. Lowe, Distinctive image features from scale-invariant keypoints, in: IJCV 60, 2004, 91-110.
63. C. Fellbaum, WordNet: An Electronic Lexical Database, MIT Press, Cambridge, MA, 1998.
64. S. Belongie, J. Malik, J. Puzicha, Shape matching and object recognition using shape contexts, in: PAMI, 2002, pp. 509-522. (Pubitemid 34448769)
65. K.E.A. van de Sande, T. Gevers, C.G.M. Snoek, Evaluating color descriptors for object and scene recognition, in: PAMI, 2010, pp. 1582-1596.
66. K. Chatfield, J. Philbin, A. Zisserman, Efficient retrieval of deformable shape classes using local self-similarities, in: ICCV Workshops, 2009, pp. 264-271.
67. V. Gulshan, Visual geometry group: self-simi4larity descriptor. (accessed June 2011).
68. SJ. Elwang, K. Grauman, Accounting for the relative importance of objects in image retrieval, in: BMVC, 2010, pp. 58.1 -58.12.
69. X. Bai, Y.-Z. Song, A. Baliki, P. Hall, Structure is a visual class invariant, in: Proc. SSPR and SPR (Lec. Notes in Comp. Sci), 2008.