Learning high-level feature by deep belief networks for 3-D model retrieval and recognition

IEEE Transactions on Multimedia

Volumn 16, Issue 8, 2014, Pages 2154-2167

  Bu, Shuhui ^a   Liu, Zhenbao ^a   Han, Junwei ^a   Wu, Jun ^a   Ji, Rongrong ^b  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b XIAMEN UNIVERSITY   (China)

Author keywords

3 D model recognition; 3 D model retrieval; Bag of words; Deep belief networks; Deep learning

Indexed keywords

FEATURE EXTRACTION;

3-D MODELING; BAG OF WORDS; DEEP BELIEF NETWORKS; DEEP LEARNING; GEOMETRIC RELATIONSHIPS; HIGH-LEVEL FEATURES; SHAPE CLASSIFICATION; STATE-OF-THE-ART METHODS;

INFORMATION RETRIEVAL;

EID: 84912070759     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2351788     Document Type: Review

References (57)

1. J. W. Tangelder and R. C. Veltkamp, "A survey of content based 3D shape retrieval methods," Multimedia Tools Appl., vol. 39, no. 3, pp. 441-471, 2008.
2. A. D. Bimbo and P. Pala, "Content-based retrieval of 3dmodels," ACM Trans. Multimedia Comput., Commun., Appl., vol. 2, no. 1, pp. 20-43, 2006.
3. Z. Liu, S. Bu,K. Zhou, S. Gao, J. Han, and J.Wu, "Asurvey on partial retrieval of 3D shapes," J. Comput. Sci. Technol., vol. 28, no. 5, pp. 836-851, 2013.
4. M. Ovsjanikov, A. M. Bronstein, M. M. Bronstein, and L. J. Guibas, "Shape Google: A computer vision approach to isometry invariant shape retrieval," in Proc. 2009 IEEE 12th Int. Conf. Comput. Vis. Workshops, 2009, pp. 320-327.
5. A. M. Bronstein, M. M. Bronstein, L. J. Guibas, and M. Ovsjanikov, "Shape Google: Geometric words and expressions for invariant shape retrieval," ACM Trans. Graph., vol. 30, no. 1, pp. 1-22, 2011.
6. J. Sun, M. Ovsjanikov, and L. Guibas, "A concise and provably informative multi-scale signature based on heat diffusion," Comput. Graph. Forum, vol. 28, no. 5, pp. 1383-1392, 2009.
7. M. M. Bronstein and I. Kokkinos, "Scale-invariant heat kernel signatures for non-rigid shape recognition," in Proc. 2010 IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), 2010, pp. 1704-1711.
8. G. Lavoué, "Combination of bag-of-words descriptors for robust partial shape retrieval," Vis. Comput., vol. 28, no. 9, pp. 931-942, 2012.
9. R. Toldo, U. Castellani, and A. Fusiello, "Visual vocabulary signature for 3D object retrieval and partial matching," in Proc. 2nd Eurograph. Conf. 3D Object Retrieval, 2009, pp. 21-28.
10. U. Castellani, M. Cristani, S. Fantoni, and V. Murino, "Sparse points matching by combining 3D mesh saliency with statistical descriptors," Comput. Graph. Forum, vol. 27, no. 2, pp. 643-652, 2008.
11. S. Bu, P. Han, Z. Liu, K. Li, and J. Han, "Shift-invariant ring feature for 3D shape," Vis. Comput., vol. 30, no. 6, pp. 867-876, 2014.
12. R. Litman and A. M. Bronstein, "Learning spectral descriptors for deformable shape correspondence," IEEE Trans. Pattern Anal.Mach. Intell., vol. 36, no. 1, pp. 171-180, Jan. 2014.
13. V. Barra and S. Biasotti, "Learning kernels on extended Reeb graphs for 3D shape classification and retrieval," in Proc. Eurograph. Workshop 3D Object Retrieval, 2013, pp. 25-32.
14. H. Laga, M. Mortara, and M. Spagnuolo, "Geometry and context for semantic correspondences and functionality recognition in man-made 3D shapes," ACM Trans. Graph., vol. 32, no. 5, p. 150, 2013.
15. B. Leng and Z. Xiong, "Modelseek: An effective 3D model retrieval system," Multimedia Tools Appl., vol. 51, no. 3, pp. 935-962, 2011.
16. H. Laga, "Semantics-driven approach for automatic selection of best views of 3D shapes," in Proc. 3rd Eurograph. Conf. 3D Object Retrieval, 2010, pp. 15-22.
17. H. Tabia, D. Picard, H. Laga, and P.-H. Gosselin, "Compact vectors of locally aggregated tensors for 3d shape retrieval," in Proc. Eurograph. Workshop 3D Object Retrieval, 2013, pp. 17-24.
18. Y. Gao, M. Wang, R. Ji, X. Wu, and Q. Dai, "3D object retrieval with Hausdorff distance learning," IEEE Trans. Ind. Electron., vol. 61, no. 4, pp. 2088-2098, Apr. 2014.
19. Y. Bengio, "Learning deep architectures for AI," Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
20. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng, "Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations," in Proc. 26th Annu. Int. ACM Conf.Mach. Learn., 2009, pp. 609-616.
21. D. Ciresan, U. Meier, and J. Schmidhuber, "Multi-column deep neural networks for image classification," in Proc. 2012 IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), 2012, pp. 3642-3649.
22. R. Osada, T. Funkhouser, B. Chazelle, and D. Dobkin, "Matching 3D models with shape distributions," in Proc. SMI 2001 Int. Conf. Shape Model. Appl., 2001, pp. 154-166.
23. M. Kazhdan, T. Funkhouser, and S. Rusinkiewicz, "Rotation invariant spherical harmonic representation of 3D shape descriptors," in Proc. 2003 Eurograph./ACM SIGGRAPH Symp. Geometry, 2003, pp. 156-164, Eurographics Association.
24. V. Jain and H. Zhang, "A spectral approach to shape-based retrieval of articulated 3D models," Comput.-Aided Des., vol. 39, no. 5, pp. 398-407, 2007.
25. D. Smeets, T. Fabry, J. Hermans, D. Vandermeulen, and P. Suetens, "Isometric deformationmodelling for object recognition," in Computer Analysis of Images and Patterns. New York, NY, USA: Springer, 2009, pp. 757-765.
26. N. D. Cornea, M. F. Demirci, D. Silver, S. Dickinson, and P. Kantor, "3d object retrieval using many-to-many matching of curve skeletons," in Proc. 2005 Int. Conf. Shape Model. Appl., 2005, pp. 366-371.
27. A. Mademlis, P. Daras, A. Axenopoulos, D. Tzovaras, and M. G. Strintzis, "Combining topological and geometrical features for global and partial 3D shape retrieval," IEEE Trans. Multimedia, vol. 10, no. 5, pp. 819-831, Aug. 2008.
28. J. Tierny, J.-P. Vandeborre, and M. Daoudi, "Partial 3d shape retrieval by reeb pattern unfolding," Comput. Graph. Forum, vol. 28, no. 1, pp. 41-55, 2009.
29. V. Barra and S. Biasotti, "3D shape retrieval using kernels on extended Reeb graphs," Pattern Recog., vol. 46, no. 11, pp. 2985-2999, Nov. 2013.
30. P. Papadakis, I. Pratikakis, T. Theoharis, and S. Perantonis, "Panorama: A 3d shape descriptor based on panoramic views for unsupervised 3d object retrieval," Int. J. Comput. Vis., vol. 89, no. 2, pp. 177-192, 2010.
31. D.-Y. Chen, X.-P. Tian, Y.-T. Shen, and M. Ouhyoung, "On visual similarity based 3d model retrieval," Comput. Graph. Forum, vol. 22, no. 3, pp. 223-232, 2003.
32. Y. Gao, J. Tang, R. Hong, S. Yan, Q. Dai, N. Zhang, and T.-S. Chua, "Camera constraint-free view-based 3D object retrieval," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2269-2281, Apr. 2012.
33. Y. Gao, M. Wang, D. Tao, R. Ji, and Q. Dai, "3D object retrieval and recognition with hypergraph analysis," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4290-4303, Feb. 2012.
34. Y. Gao, M. Wang, Z. Zha, Q. Tian, Q. Dai, and N. Zhang, "Less is more: Efficient 3D object retrieval with query view selection," IEEE Trans. Multimedia, vol. 13, no. 5, pp. 1007-1018, Oct. 2011.
35. A. E. Johnson and M. Hebert, "Using spin images for efficient object recognition in cluttered 3D scenes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 5, pp. 433-449, May 1999.
36. Y. Liu, H. Zha, and H. Qin, "The generalized shape distributions for shape matching and analysis," in Proc. IEEE Int. Conf. Shape Model. Appl., 2006, pp. 16-16.
37. I. Sipiran, B. Bustos, and T. Schreck, "Data-aware 3D partitioning for generic shape retrieval," Comput. Graph., vol. 37, no. 5, pp. 460-470, 2013.
38. J. Knopp, M. Prasad, G.Willems, R. Timofte, and L. Van Gool, "Hough transform and 3D surf for robust three dimensional classification," in Proc. Comput. Vis.-ECCV 2010, 2010, pp. 589-602.
39. H.-Y. Wu, H. Zha, T. Luo, X.-L. Wang, and S. Ma, "Global and local isometry-invariant descriptor for 3d shape comparison and partial matching," in Proc. 2010 IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), 2010, pp. 438-445.
40. A. Dubrovina and R. Kimmel, "Matching shapes by eigendecomposition of the Laplace-Beltrami operator," in Proc. Symp. 3D Data Proc., 2010, vol. 2, no. 3.
41. G. Lavoue, "Bag of words and local spectral descriptor for 3d partial shape retrieval," in Proc. Eurograph. Workshop 3D Object Retrieval, 2011, pp. 41-48.
42. K. Sfikas, T. Theoharis, and I. Pratikakis, "Non-rigid 3d object retrieval using topological information guided by conformal factors," Vis. Comput., vol. 28, no. 9, pp. 943-955, 2012.
43. A. Kovnatsky, M. M. Bronstein, A. M. Bronstein, D. Raviv, and R. Kimmel, "Affine-invariant photometric heat kernel signatures," in Proc. Eurograph. Conf. 3D Object Retrieval, 2012, pp. 39-46.
44. M. Hilaga, Y. Shinagawa, T. Kohmura, and T. L. Kunii, "Topology matching for fully automatic similarity estimation of 3d shapes," in Proc. 28th Annu. Conf. Comput. Graph. Interactive Tech., 2001, pp. 203-212.
45. R. Cordeiro de Amorim and B. Mirkin, "Minkowski metric, feature weighting and anomalous cluster initializing in k-means clustering," Pattern Recog., vol. 45, no. 3, pp. 1061-1075, 2012.
46. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
47. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
48. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Comput., vol. 14, no. 8, pp. 1771-1800, 2002.
49. H. Larochelle and Y. Bengio, "Classification using discriminative restricted boltzmann machines," in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 536-543.
50. D. Giorgi, S. Biasotti, and L. Paraboschi, CNR - IMATI, Genoa, Italy, "Watertight models track," Tech. Rep. 9, 2007.
51. P. Shilane, P. Min, M. Kazhdan, and T. Funkhouser, "The Princeton shape benchmark," in Proc. Shape Model. Appl., 2004, pp. 167-178, IEEE.
52. Z. Lian, A. Godil, B. Bustos, M. Daoudi, J. Hermans, S. Kawamura, Y. Kurita, G. Lavoué, H. Van Nguyen, and R. Ohbuchi, "SHREC'11 track: Shape retrieval on non-rigid 3D watertight meshes," 3DOR, vol. 11, pp. 79-88, 2011.
53. Z. Lian, A. Godil, X. Sun, and H. Zhang, "Non-rigid 3D shape retrieval using multidimensional scaling and bag-of-features," in Proc. 17th IEEE Int. Conf. Image Process. (ICIP), 2010, pp. 3181-3184.
54. M. Reuter, F.-E. Wolter, and N. Peinecke, "Laplace-spectra as fingerprints for shape matching," in Proc. 2005 ACM Symp. Solid Physical Model., 2005, pp. 101-106.
55. C.Maes, T. Fabry, J. Keustermans, D. Smeets, P. Suetens, and D. Vandermeulen, "Feature detection on 3D face surfaces for pose normalisation and recognition," in Proc. 2010 4th IEEE Int. Conf. Biometrics: Theory Appl. Syst. (BTAS), 2010, pp. 1-6.
56. K. Siddiqi, J. Zhang, D. Macrini, A. Shokoufandeh, S. Bouix, and S. Dickinson, "Retrieving articulated 3D models using medial surfaces," Mach. Vis. Appl., vol. 19, no. 4, pp. 261-275, 2008.
57. A. M. Bronstein, M. M. Bronstein, and R. Kimmel, Numerical Geometry of Non-Rigid Shapes. New York, NY, USA: Springer, 2008.