A comparison of methods for sketch-based 3D shape retrieval

Computer Vision and Image Understanding

Volumn 119, Issue , 2014, Pages 57-80

  Li, Bo ^a,b   Lu, Yijuan ^a   Godil, Afzal ^b   Schreck, Tobias ^c   Bustos, Benjamin ^d   Ferreira, Alfredo ^e   Furuya, Takahiko ^f   Fonseca, Manuel J ^e   Johan, Henry ^g   Matsuda, Takahiro ^f   Ohbuchi, Ryutarou ^f   Pascoal, Pedro B ^e   Saavedra, Jose M ^d,h  

^a Texas State University   (United States)

^b NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

^c UNIVERSITY OF KONSTANZ   (Germany)

^d UNIVERSITY OF CHILE   (Chile)

^e INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^f UNIVERSITY OF YAMANASHI   (Japan)

^g Visual Computing   (Singapore)

^h ORAND SA ^*  (Chile)

Author keywords

Benchmark; Evaluation; Large scale; SHREC contest; Sketch based 3D model retrieval

Indexed keywords

COMPARISON OF METHODS; COMPREHENSIVE COMPARISONS; EVALUATION; LARGE-SCALE; SHREC CONTEST; SKETCH-BASED 3D MODELING; STATE-OF-THE-ART APPROACH; STATE-OF-THE-ART METHODS;

BENCHMARKING; INFORMATION RETRIEVAL;

THREE DIMENSIONAL;

EID: 84891588482     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2013.11.008     Document Type: Article

References (81)

1. < http://www.itl.nist.gov/iad/vug/sharp/contest/2012/SBR/ >, 2013.
2. < http://www.itl.nist.gov/iad/vug/sharp/contest/2013/SBR/ >, 2013.
3. A.-P. Ta, C. Wolf, G. Lavoué, and A. Baskurt 3D object detection and viewpoint selection in sketch images using local patch-based Zernike moments S.D. Kollias, Y.S. Avrithis, CBMI 2009 IEEE Computer Society 189 194
4. B. Li, T. Schreck, A. Godil, M. Alexa, T. Boubekeur, B. Bustos, J. Chen, M. Eitz, T. Furuya, K. Hildebrand, S. Huang, H. Johan, A. Kuijper, R. Ohbuchi, R. Richter, J.M. Saavedra, M. Scherer, T. Yanagimachi, G.-J. Yoon, S.M. Yoon, SHREC'12 track: Sketch-based 3D shape retrieval, in: Eurographics Workshop on 3D Object Retrieval (3DOR), 2012, 2012, pp. 109-118.
5. M. Eitz, R. Richter, T. Boubekeur, K. Hildebrand, and M. Alexa Sketch-based shape retrieval ACM Trans. Graph. 31 2012 31:1 31:10
6. P. Shilane, P. Min, M.M. Kazhdan, and T.A. Funkhouser The Princeton shape benchmark Shape Modeling International 2004 IEEE Computer Society 167 178
7. B. Li, Y. Lu, A. Godil, T. Schreck, M. Aono, H. Johan, J.M. Saavedra, S. Tashiro, SHREC'13 track: large scale sketch-based 3D shape retrieval, in: Eurographics Workshop on 3D Object Retrieval (3DOR), 2013, 2013, pp. 89-96.
8. T. Funkhouser, P. Min, M. Kazhdan, J. Chen, A. Halderman, D. Dobkin, and D. Jacobs A search engine for 3D models ACM Trans. Graph. 22 2003 83 105 (Pubitemid 44769059)
9. M.M. Kazhdan, T.A. Funkhouser, S. Rusinkiewicz, Rotation invariant spherical harmonic representation of 3D shape descriptors, in: L. Kobbelt, P. Schröder, H. Hoppe (Eds.), Symposium on Geometry Processing, ACM International Conference Proceeding Series, vol. 43, Eurographics Association, 2003, pp. 156-164.
10. S.M. Yoon, M. Scherer, T. Schreck, and A. Kuijper Sketch-based 3D model retrieval using diffusion tensor fields of suggestive contours A.D. Bimbo, S.-F. Chang, A.W.M. Smeulders, ACM Multimedia 2010 ACM 193 200
11. J.M. Saavedra, B. Bustos, M. Scherer, and T. Schreck STELA: sketch-based 3D model retrieval using a structure-based local approach F.G.B.D. Natale, A.D. Bimbo, A. Hanjalic, B.S. Manjunath, S. Satoh, ICMR 2011 ACM 26:1 26:8
12. D. Doug, F. Adam, R. Szymon, and S. Anthony Suggestive contours for conveying shape ACM Trans. Graph. 22 2003 848 855
13. M. Aono, H. Iwabuchi, 3D shape retrieval from a 2D image as query, in: Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC) 2012, 2012, pp. 1-10.
14. M. Eitz, K. Hildebrand, T. Boubekeur, and M. Alexa Sketch-based 3D shape retrieval SIGGRAPH Talks 2010 ACM 1
15. M. Eitz, K. Hildebrand, T. Boubekeur, and M. Alexa An evaluation of descriptors for large-scale image retrieval from sketched feature lines Comput. Graph. 34 2010 482 498
16. M. Eitz, K. Hildebrand, T. Boubekeur, and M. Alexa Sketch-based image retrieval: benchmark and bag-of-features descriptors IEEE Trans. Visual. Comput. Graph. 17 2011 1624 1636
17. M. Eitz, J. Hays, and M. Alexa How do humans sketch objects? ACM Trans. Graph. 31 2012 44:1 44:10
18. T. Shao, W. Xu, K. Yin, J. Wang, K. Zhou, and B. Guo Discriminative sketch-based 3D model retrieval via robust shape matching Comput. Graph. Forum 30 2011 2011 2020
19. B. Li, and H. Johan Sketch-based 3D model retrieval by incorporating 2D-3D alignment Multimedia Tools Appl. 65 2013 363 385
20. B. Li, and H. Johan View context: a 3D model feature for retrieval S. Boll, MMM 2010 LNCS vol. 5916 2010 Springer Heidelberg 185 195
21. S. Belongie, J. Malik, and J. Puzicha Shape matching and object recognition using shape contexts IEEE Trans. Pattern Anal. Mach. Intell. 24 2002 509 522 (Pubitemid 34448769)
22. B. Li, Y. Lu, and R. Fares Semantic sketch-based 3D model retrieval ICME 2013 IEEE 1 4
23. T. Xue, J. Liu, and X. Tang Example-based 3D object reconstruction from line drawings CVPR 2012 IEEE 302 309
24. T. Xue, J. Liu, X. Tang, Object cut: complex 3D object reconstruction through line drawing separation, in: The Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, 2010, pp. 1149-1156.
25. J. Liu, Y. Chen, and X. Tang Decomposition of complex line drawings with hidden lines for 3D planar-faced manifold object reconstruction IEEE Trans. Pattern Anal. Mach. Intell. 33 2011 3 15
26. X. Xie, K. Xu, N.J. Mitra, D. Cohen-Or, and B. Chen Sketch-to-design: context-based part assembly Comput. Graph. Forum 32 2013 233 245
27. K. Xu, K. Chen, H. Fu, W.-L. Sun, and S.-M. Hu Sketch2scene: sketch-based co-retrieval and co-placement of 3D models ACM Trans. Graph. 32 2013 123:1 123:15
28. S. Kanai Content-based 3D mesh model retrieval from hand-written sketch Int. J. Interact. Des. Manuf. 2 2008 87 98 (Pubitemid 351663216)
29. A. Tatsuma, and M. Aono Multi-Fourier spectra descriptor and augmentation with spectral clustering for 3D shape retrieval Vis. Comput. 25 2009 785 804
30. S.M. Yoon, A. Kuijper, View-based 3D model retrieval using compressive sensing based classification, in: The 7th International Symposium on Image and Signal Processing and Analysis, ISPA 2011, IEEE, 2011, pp. 437-442.
31. J.M. Saavedra, B. Bustos, T. Schreck, S.M. Yoon, M. Scherer, Sketch-based 3D model retrieval using keyshapes for global and local representation, in: Eurographics Workshop on 3D Object Retrieval (3DOR), 2012, 2012, pp. 47-50.
32. T. Judd, F. Durand, and E.H. Adelson Apparent ridges for line drawing ACM Trans. Graph. 26 2007 19
33. Y. Ohtake, A.G. Belyaev, and H.-P. Seidel Ridge-valley lines on meshes via implicit surface fitting ACM Trans. Graph. 23 2004 609 612
34. X. Xie, Y. He, F. Tian, H.S. Seah, X. Gu, and H. Qin An effective illustrative visualization framework based on photic extremum lines (PELs) IEEE Trans. Vis. Comput. Graph. 13 2007 1328 1335 (Pubitemid 350089831)
35. L. Zhang, Y. He, and H.S. Seah Real-time computation of photic extremum lines (PELs) The Visual Comput. 26 2010 399 407
36. M. Kolomenkin, I. Shimshoni, and A. Tal Demarcating curves for shape illustration ACM Trans. Graph. 27 2008 157
37. Y. Miao, and J. Feng Perceptual-saliency extremum lines for 3D shape illustration The Visual Comput. 26 2010 433 443
38. L. Zhang, Y. He, J. Xia, X. Xie, and W. Chen Real-time shape illustration using Laplacian lines IEEE Trans. Vis. Comput. Graph. 17 2011 993 1006
39. L. Zhang, J. Xia, X. Ying, Y. He, W. Mueller-Wittig, and H.S. Seah Efficient and robust 3D line drawings using difference-of-gaussian Graph. Models 74 2012 87 98
40. M. Kolomenkin, I. Shimshoni, and A. Tal Multi-scale curve detection on surfaces CVPR 2013 IEEE 1 8
41. D. DeCarlo Depicting 3D shape using lines Proc. SPIE 8291 2012 829116-829116-16.
42. D. Zhang, G. Lu, A comparative study of Fourier descriptors for shape representation and retrieval, in: Proceedings of the Fifth Asian Conference on Computer Vision (ACCV02), 2002, pp. 646-651.
43. A. Sajjanhar, G. Lu, D. Zhang, Image retrieval using modified generic fourier descriptors, in: B. Gupta (Ed.), Computers and their Applications, ISCA, 2004, pp. 32-35.
44. D. Zhang, and G. Lu Shape-based image retrieval using generic Fourier descriptor Signal Process. Image Commun. 2002 825 848 (Pubitemid 35282149)
45. A. Khotanzad, and Y. Hong Invariant image recognition by Zernike moments IEEE Trans. Pattern Anal. Mach. Intell. 12 1990 489 497 (Pubitemid 20702892)
46. M. Novotni, and R. Klein 3D Zernike descriptors for content based shape retrieval Proceedings of the 8th ACM Symposium on Solid Modeling and Applications 2003 ACM Press 216 225
47. J. Revaud, G. Lavoué, and A. Baskurt Improving Zernike moments comparison for optimal similarity and rotation angle retrieval IEEE Trans. Pattern Anal. Mach. Intell. 31 2009 627 636
48. T. Ojala, M. Pietikäinen, and D. Harwood A comparative study of texture measures with classification based on featured distributions Pattern Recog. 29 1996 51 59
49. M. Eitz, K. Hildebrand, T. Boubekeur, M. Alexa, A descriptor for large scale image retrieval based on sketched feature lines, in: C. Grimm, J.J. L Jr., (Eds.), SBM, Eurographics Association, 2009, pp. 29-36.
50. D.G. Lowe Distinctive image features from scale-invariant keypoints Int. J. Comput. Vision 60 2004 91 110
51. H. Jegou, M. Douze, C. Schmid, P. Pérez, Aggregating local descriptors into a compact image representation, in: The Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, 2010, pp. 3304-3311.
52. T. Furuya, and R. Ohbuchi Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features S. Marchand-Maillet, Y. Kompatsiaris, CIVR 2009 ACM 17:1 8
53. R. Ohbuchi, and T. Furuya Scale-weighted dense bag of visual features for 3D model retrieval from a partial view 3D model S. Marchand-Maillet, Y. Kompatsiaris, IEEE ICCV 2009 Workshop on Search in 3D and Video (S3DV) 2009 ACM 63 70
54. N. Dalal, and B. Triggs Histograms of oriented gradients for human detection 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005) 2005 IEEE Computer Society 886 893 (Pubitemid 43897286)
55. E. Candès, D. Donoho, Curvelets: A surprisingly effective nonadaptive representation of objects with edges, in: L.L. S et al. (Ed.), Curves and Surfaces, Vanderbilt University Press, Nashville, TN, 1999, pp. 1-16.
56. J.G. Snodgrass, and M. Vanderwart A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity J. Experimen. Pyschol.: Human Learn. Mem. 6 1980 174 215
57. F.-X. Alario, and L. Ferrand A set of 400 pictures standardized for French: Norms for name agreement, image agreement, familiarity, visual complexity, image variability, and age of acquisition Behav. Res. Meth. Instrum., Comput. 31 1999 531 552
58. P. Bonin, R. Peereman, N. Malardier, A. Mot, and M. Chalard A new set of 299 pictures for psycholinguistic studies: French norms for name agreement, image agreement, conceptual familiarity, visual complexity, image variability, age of acquisition, and naming latencies Behav. Res. Meth. Instrum., Comput. 35 2003 158 167 (Pubitemid 37545058)
59. M. Sanfeliu, and A. Fernandez A set of 254 Snodgrass-vanderwart pictures standardized for spanish: norms for name agreement, image agreement, familiarity, and visual complexity Behav. Res. Meth. Instrum., Comput. 28 1996 537 555 (Pubitemid 126416717)
60. S. Pompia, M. Miranda, and O. Bueno A set of 400 pictures standardised for portuguese: norms for name agreement, familiarity and visual complexity for children and adults Arquivos de Neuro-Psiquiatria 59 2001 330 337 (Pubitemid 33606730)
61. F. Cole, A. Golovinskiy, A. Limpaecher, H.S. Barros, A. Finkelstein, T.A. Funkhouser, and S. Rusinkiewicz Where do people draw lines? ACM Trans. Graph. 27 2008 1 11
62. J.M. Saavedra, and B. Bustos An improved histogram of edge local orientations for sketch-based image retrieval M. Goesele, S. Roth, A. Kuijper, B. Schiele, K. Schindler, DAGM-Symposium Lecture Notes in Computer Science vol. 6376 2010 Springer 432 441
63. R.C. Veltkamp, F.B. ter Haar, SHREC 2007 3D Retrieval Contest, Technical Report UU-CS-2007-015, Department of Information and Computing Sciences, Utrecht University, 2007.
64. B. Li, and H. Johan 3D model retrieval using hybrid features and class information Multimedia Tools Appl. 62 2013 821 846
65. T. Furuya, R. Ohbuchi, Ranking on cross-domain manifold for sketch-based 3D model retrieval, in: Cyberworlds 2013, 2013, pp. 1-8.
66. D. Zhou, O. Bousquet, T.N. Lal, J. Weston, and B. Schölkopf Learning with local and global consistency Advances in Neural Information Processing Systems vol. 16 2004 MIT Press 321 328
67. P. Geurts, D. Ernst, and L. Wehenkel Extremely randomized trees Mach. Learn. 63 2006 3 42
68. B. Li, Y. Lu, H. Johan, Sketch-based 3D model retrieval by viewpoint entropy-based adaptive view clustering, in: U. Castellani, T. Schreck, S. Biasotti, I. Pratikakis, A. Godil, R.C. Veltkamp (Eds.), 3DOR, Eurographics Association, 2013, pp. 49-56.
69. M. Fonseca, A. Ferreira, J. Jorge, Sketch-based retrieval of vector drawings, in: Sketch-based Interfaces and Modeling, 2011, 2011, pp. 181-201.
70. P.M.A. Sousa, and M.J. Fonseca Sketch-based retrieval of drawings using spatial proximity J. Vis. Lang. Comput. 21 2010 69 80
71. Y.-T. Shen, D.-Y. Chen, X.-P. Tian, M. Ouhyoung, 3D model search engine based on Lightfield descriptors, in: Eurographics, 2003, 2003, pp. 1-7.
72. J.L. Bentley, and T. Ottmann Algorithms for reporting and counting geometric intersections IEEE Trans. Comput. 28 1979 643 647 (Pubitemid 10420519)
73. M.M. Syslo An efficient cycle vector space algorithm for listing all cycles of a planar graph SIAM J. Comput. 10 1981 797 808
74. J.D. Horton A polynomial-time algorithm to find the shortest cycle basis of a graph SIAM J. Comput. 16 1987 358 366 (Pubitemid 17571391)
75. M.J. Egenhofer, and K.K. Al-Taha Reasoning about gradual changes of topological relationships A.U. Frank, I. Campari, U. Formentini, Spatio-Temporal Reasoning Lecture Notes in Computer Science vol. 639 1992 Springer 196 219
76. M.J. Fonseca, C. Pimentel, J.A. Jorge, CALI: An online scribble recognizer for calligraphic interfaces, in: Proceedings of the 2002 AAAI Spring Symposium Sketch Understanding, 2002, pp. 51-58.
77. D. Zhang, G. Luo, An integrated approach to shape based image retrieval, in: Proceedings of the 5th Asian Conference on Computer Vision (ACCV 2002), 2002, 2002, pp. 652-657.
78. M. Muja, D.G. Lowe, Fast approximate nearest neighbors with automatic algorithm configuration, in: Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), 2009, 2009, pp. 331-340.
79. Y.J. Lee, C.L. Zitnick, and M.F. Cohen Shadowdraw: real-time user guidance for freehand drawing ACM Trans. Graph. 30 2011 27:1 27:10
80. H. Samet Foundations of Multidimensional and Metric Data Structures 2005 Morgan Kaufman Publishers Inc. San Francisco, CA, USA
81. P. Zezula, G. Amato, V. Dohnal, and M. Batko Similarity search: the metric space approach Advances in Database Systems vol. 32 2006 Springer