Multi-View 3D Object Retrieval With Deep Embedding Network

IEEE Transactions on Image Processing

Volumn 25, Issue 12, 2016, Pages 5526-5537

  Guo, Haiyun ^a   Wang, Jinqiao ^a   Gao, Yue ^b   Li, Jianqiang ^c   Lu, Hanqing ^a  

^a INSTITUTE OF AUTOMATION   (China)

^b TSINGHUA UNIVERSITY   (China)

^c BEIJING UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Convolutional neural network; multi view 3D object retrieval; triplet loss

Indexed keywords

CONVOLUTION; NEURAL NETWORKS; SEMANTICS;

3D OBJECT REPRESENTATION; 3D OBJECT RETRIEVAL; CONVOLUTIONAL NEURAL NETWORK; HIGH-DIMENSIONAL IMAGES; INTRA-CLASS VARIATION; LOCAL CHARACTERISTICS; SEMANTIC INFORMATION; STATE-OF-THE-ART APPROACH;

OBJECT RECOGNITION;

EID: 84995477031     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2609814     Document Type: Article

References (46)

1. H.-S. Wong, B. Ma, Z. Yu, P. F. Yeung, and H. H. Ip, "3-D head model retrieval using a single face view query," IEEE Trans. Multimedia, vol. 9, no. 5, pp. 1026-1036, Aug. 2007.
2. Y. Li, H. Su, C. R. Qi, N. Fish, D. Cohen-Or, and L. J. Guibas, "Joint embeddings of shapes and images via cnn image purification," ACM Trans. Graph., vol. 34, no. 6, p. 234, Nov. 2015.
3. J.-S. Yeh, D.-Y. Chen, B.-Y. Chen, and M. Ouhyoung, "A Webbased Three-Dimensional protein retrieval system by matching visual similarity," Bioinformatics, vol. 21, no. 13, pp. 3056-3057, Apr. 2005.
4. J. W. Tangelder and R. C. Veltkamp, "A survey of content based 3D shape retrieval methods," Multimedia Tools Appl., vol. 39, no. 3, pp. 441-471, Sep. 2008.
5. Y. Liu, X.-L. Wang, H.-Y. Wang, H. Zha, and H. Qin, "Learning robust similarity measures for 3D partial shape retrieval," Int. J. Comput. Vis., vol. 89, no. 2, pp. 408-431, Sep. 2010.
6. Y. Gao, Q. Dai, and N.-Y. Zhang, "3D model comparison using spatial structure circular descriptor," Pattern Recognit., vol. 43, no. 3, pp. 1142-1151, Mar. 2010.
7. P. Daras and A. Axenopoulos, "A 3D shape retrieval framework supporting multimodal queries," Int. J. Comput. Vis., vol. 89, nos. 2-3, pp. 229-247, 2010.
8. Z. Zhu, X. Wang, S. Bai, C. Yao, and X. Bai, "Deep learning representation using autoencoder for 3D shape retrieval," in Proc. SPAC, Oct. 2014, pp. 279-284.
9. Y. Gao and Q. Dai, "View-based 3-d object retrieval: Challenges and approaches," IEEE Multimedia Magazine, vol. 21, no. 3, pp. 52-57, Mar. 2014.
10. T. F. Ansary, M. Daoudi, and J.-P. Vandeborre, "A Bayesian 3-D search engine using adaptive views clustering," IEEE Trans. Multimedia, vol. 9, no. 1, pp. 78-88, Jan. 2007.
11. Y. Gao et al., "Camera constraint-free view-based 3-D object retrieval," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2269-2281, Apr. 2012.
12. D.-Y. Chen, X.-P. Tian, Y.-T. Shen, and M. Ouhyoung, "On visual similarity based 3D model retrieval," Comput. Graph. Forum, vol. 22, no. 3, pp. 223-232, Sep. 2003.
13. P. Papadakis, I. Pratikakis, T. Theoharis, and S. Perantonis, "PANORAMA: A 3D shape descriptor based on panoramic views for unsupervised 3D object retrieval," Int. J. Comput. Vis., vol. 89, nos. 2-3, pp. 177-192, Sep. 2010.
14. W.-Y. Kim and Y.-S. Kim, "A region-based shape descriptor using Zernike moments," Signal Process., Image Commun., vol. 16, pp. 95-102, Sep. 2000.
15. D. Zhang and G. Lu, "Generic fourier descriptor for shape-based image retrieval," in Proc. ICME, vol. 1. Aug. 2002, pp. 425-428.
16. D. G. Lowe, "Object recognition from local scale-invariant features," in Proc. ICCV, vol. 2. Sep. 1999, pp. 1150-1157.
17. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. CVPR, Jun. 2005, pp. 886-893.
18. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. CVPR, 2014, pp. 580-587.
19. A. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson, "Cnn features off-the-shelf: An astounding baseline for recognition," in Proc. CVPRW, 2014, pp. 806-813.
20. F. Schroff, D. Kalenichenko, and J. Philbin, "Facenet: A unified embedding for face recognition and clustering," in Proc. CVPR, 2015, pp. 815-823.
21. Y. Gao et al., "3D object retrieval with multimodal views," in Proc. Eurograph. Workshop 3D Object Retr., 2015, pp. 129-136.
22. (2016). Embedding. [Online]. Available: https://en.wikipedia.org/wiki/Embedding
23. K. Q. Weinberger and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification," J. Mach. Learn. Res., vol. 10, pp. 207-244, Feb. 2009.
24. J. Wang et al., "Learning fine-grained image similarity with deep ranking," in Proc. CVPR, 2014, pp. 1386-1393.
25. X. Wang and A. Gupta, "Unsupervised learning of visual representations using videos," in Proc. ICCV, 2015, pp. 2794-2802.
26. O. M. Parkhi, A. Vedaldi, and A. Zisserman, "Deep face recognition," in Proc. BMVC, 2015, p. 6.
27. J. Y.-H. Ng, F. Yang, and L. Davis, "Exploiting local features from deep networks for image retrieval," in Proc. CVPRW, 2015, pp. 53-61.
28. J.-L. Shih, C.-H. Lee, and J. T. Wang, "A new 3D model retrieval approach based on the elevation descriptor," Pattern Recognit., vol. 40, no. 1, pp. 283-295, 2007.
29. R. Ohbuchi, K. Osada, T. Furuya, and T. Banno, "Salient local visual features for shape-based 3D model retrieval," in Proc. SMI, Jan. 2008, pp. 93-102.
30. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. CVPR, vol. 2. Jun. 2005, pp. 524-531.
31. Z. Lian, A. Godil, and X. Sun, "Visual similarity based 3D shape retrieval using bag-of-features," in Proc. SMI, Jun. 2010, pp. 25-36.
32. P. Papadakis, I. Pratikakis, T. Theoharis, G. Passalis, and S. Perantonis, "3d object retrieval using an efficient and compact hybrid shape descriptor," in Proc. Eurograph. Workshop 3D Object Retr., 2008, pp. 9-16.
33. K. Simonyan and A. Zisserman. (Sep. 2014). "Very deep convolutional networks for large-scale image recognition." [Online]. Available: http://arxiv.org/abs/1409.1556
34. Y. Wang, J. Liu, J. Wang, Y. Li, and H. Lu, "Color names learning using convolutional neural networks," in Proc. ICIP, Sep. 2015, pp. 217-221.
35. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. NIPS, 2012, pp. 1097-1105.
36. R. Hadsell, S. Chopra, and Y. Le Cun, "Dimensionality reduction by learning an invariant mapping," in Proc. CVPR, Jun. 2006, pp. 1735-1742.
37. Y. Sun, Y. Chen, X. Wang, and X. Tang, "Deep learning face representation by joint identification-verification," in Proc. NIPS, 2014, pp. 1988-1996.
38. Y. Le Cun et al., "Backpropagation applied to handwritten zip code recognition," Neural Comput., vol. 1, no. 4, pp. 541-551, 1989.
39. S. Ding, L. Lin, G. Wang, and H. Chao, "Deep feature learning with relative distance comparison for person re-identification," Pattern Recognit., vol. 48, no. 10, pp. 2993-3003, Oct. 2015.
40. Y. Jia et al. (Jun. 2014). "Caffe: Convolutional architecture for fast feature embedding." [Online]. Available: https://arxiv.org/abs/1408.5093
41. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "Imagenet: A large-scale hierarchical image database," in Proc. CVPR, Jun. 2009, pp. 248-255.
42. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks," in Proc. ECCV, 2014, pp. 818-833.
43. M. J. Atallah, "A linear time algorithm for the hausdorff distance between convex polygons," Inf. Process. Lett., vol. 17, no. 4, pp. 207-209, Nov. 1983.
44. T. D. Russ, M. W. Koch, and C. Q. Little, "A 2d range hausdorff approach for 3d face recognition," in Proc. CVPRW, Sep. 2005, p. 169.
45. K. Lai, L. Bo, X. Ren, and D. Fox, "A large-scale hierarchical multiview rgb-d object dataset," in Proc. ICRA, May 2011, pp. 1817-1824.
46. S. Gupta, R. Girshick, and P. Arbeláez, and J. Malik, "Learning rich features from rgb-d images for object detection and segmentation," in Proc. ECCV, 2014, pp. 345-360.