CROSSLINK: Joint understanding of image and 3D model collections through shape and camera pose variations

ACM Transactions on Graphics

Volumn 34, Issue 6, 2015, Pages

  Hueting, Moos ^a   Ovsjanikov, Maks ^b   Mitra, Niloy J ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b ÉCOLE POLYTECHNIQUE   (France)

Author keywords

Image search; Model collections; Pose estimation; Shape analysis; Shape variations

Indexed keywords

IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE RETRIEVAL;

ANALYSIS AND EXPLORATIONS; DATA REPRESENTATIONS; DIFFERENT DOMAINS; IMAGE COLLECTIONS; IMAGE SEARCH; POSE ESTIMATION; SHAPE ANALYSIS; SHAPE VARIATIONS;

SEARCH ENGINES;

EID: 84995916494     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2816795.2818097     Document Type: Conference Paper

References (53)

1. AUBRY, M., MATURANA, D., EFROS, A. A., RUSSELL, B., AND SIVIC, J. 2014. Seeing 3D chairs: exemplar part-based 2d-3d alignment using a large dataset of CAD models. In IEEE CVPR.
2. AUBRY, M., RUSSELL, B. C., AND SIVIC, J. 2014. Painting-to-3D model alignment via discriminative visual elements. ACM TOG 33, 2, 14:1-14:14.
3. AVERKIOU, M., KIM, V., ZHENG, Y., AND MITRA, N. J. 2014. Shapesynth: Parameterizing model collections for coupled shape exploration and synthesis. CGF Eurographics.
4. AVERKIOU, M., KIM, V. G., AND MITRA, N. J. 2015. Autocorrelation descriptor for efficient co-alignment of 3d shape collections. CGF.
5. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3d faces. In Proc. SIGGRAPH, 187-194.
6. BOUREAU, Y.-L., PONCE, J., AND LECUN, Y. 2010. A theoretical analysis of feature pooling in visual recognition. In Proc. ICML, 111-118.
7. CHEN, D.-Y., TIAN, X.-P., SHEN, Y.-T., AND OUHYOUNG, M. 2003. On visual similarity based 3d model retrieval. In Computer graphics forum, vol. 22, Wiley Online Library, 223-232.
8. CORSINI, M., DELLEPIANE, M., PONCHIO, F., AND SCOPIGNO, R. 2009. Image-to-geometry registration: a mutual information method exploiting illumination-related geometric properties. In CGF, vol. 28, 1755-1764.
9. CORTES, C., AND VAPNIK, V. 1995. Support-vector networks. Machine learning 20, 3, 273-297.
10. DALAL, N., AND TRIGGS, B. 2005. Histograms of oriented gradients for human detection. In IEEE CVPR, vol. 1, IEEE, 886-893.
11. DAMBREVILLE, S., SANDHU, R., YEZZI, A., AND TANNEN-BAUM, A. 2008. Robust 3d pose estimation and efficient 2d region-based segmentation from a 3d shape prior. In ECCV. 169-182.
12. DATTA, R., JOSHI, D., LI, J., AND WANG, J. Z. 2008. Image retrieval: Ideas, influences, and trends of the new age. ACM Comput. Surv. 40, 2, 5:1-5:60.
13. DENG, J., DONG, W., SOCHER, R., LI, L.-J., LI, K., AND FEI-FEI, L. 2009. Imagenet: A large-scale hierarchical image database. In IEEE CVPR, IEEE, 248-255.
14. EITZ, M., RICHTER, R., BOUBEKEUR, T., HILDEBRAND, K., AND ALEXA, M. 2012. Sketch-based shape retrieval. ACM SIGGRAPH 31, 4, 31:1-31:10.
15. EVGENIOU, T., AND PONTIL, M. 2004. Regularized multi-task learning. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, ACM, 109-117.
16. FELZENSZWALB, P., MCALLESTER, D., AND RAMANAN, D. 2008. A discriminatively trained, multiscale, deformable part model. In IEEE CVPR, IEEE, 1-8.
17. GONG, B., SHI, Y., SHA, F., AND GRAUMAN, K. 2012. Geodesic flow kernel for unsupervised domain adaptation. In IEEE CVPR, IEEE, 2066-2073.
18. HUANG, Q.-X., SU, H., AND GUIBAS, L. 2013. Fine-grained semi-supervised labeling of large shape collections. ACM SIGGRAPH Asia 32, 6, 190:1-190:10.
19. HUANG, S.-S., SHAMIR, A., SHEN, C.-H., ZHANG, H., SHEFFER, A., HU, S.-M., AND COHEN-OR, D. 2013. Qualitative organization of collections of shapes via quartet analysis. ACM SIGGRAPH 32, 4 (July), 71:1-71:10.
20. HUANG, Q., WANG, F., AND GUIBAS, L. 2014. Functional map networks for analyzing and exploring large shape collections. ACM SIGGRAPH 33, 4, 36:1-36:11.
21. JARRETT, K., KAVUKCUOGLU, K., RANZATO, M., AND LECUN, Y. 2009. What is the best multi-stage architecture for object recognition? In IEEE ICCV, 2146-2153.
22. JIA, Y., SHELHAMER, E., DONAHUE, J., KARAYEV, S., LONG, J., GIRSHICK, R., GUADARRAMA, S., AND DARRELL, T. 2014. Caffe: Convolutional architecture for fast feature embedding. In Proc. ACM ICM, ACM, 675-678.
23. KIM, V. G., LI, W., MITRA, N. J., CHAUDHURI, S., DIVERDI, S., AND FUNKHOUSER, T. 2013. Learning part-based templates from large collections of 3d shapes. ACM SIGGRAPH 32, 4.
24. KLEIMAN, Y., FISH, N., LANIR, J., AND COHEN-OR, D. 2013. Dynamic maps for exploring and browsing shapes. In Proc. SGP, 187-196.
25. KRIZHEVSKY, A., SUTSKEVER, I., AND HINTON, G. E. 2012. Imagenet classification with deep convolutional neural networks. In NIPS, 1097-1105.
26. LEARNED-MILLER, E. G. 2006. Data driven image models through continuous joint alignment. Pattern Analysis and Machine Intelligence, IEEE Transactions on 28, 2, 236-250.
27. LI, Y., ZHENG, Q., SHARF, A., COHEN-OR, D., CHEN, B., AND MITRA, N. J. 2011. 2d-3d fusion for layer decomposition of urban facades. In IEEE ICCV.
28. LI, B., ET AL. 2015. A comparison of 3d shape retrieval methods based on a large-scale benchmark supporting multimodal queries. Computer Vision and Image Understanding 131, 0, 1-27.
29. MASCI, J., BRONSTEIN, M. M., BRONSTEIN, A. M., AND SCHMIDHUBER, J. 2014. Multimodal similarity-preserving hashing. IEEE PAMI 36, 4, 824-830.
30. MIN, P., KAZHDAN, M., AND FUNKHOUSER, T. 2004. A comparison of text and shape matching for retrieval of online 3d models. In Research and Advanced Technology for Digital Libraries. Springer, 209-220.
31. MITRA, N. J., WAND, M., ZHANG, H., COHEN-OR, D., AND BOKELOH, M. 2013. Structure-aware shape processing. In EUROGRAPHICS State-of-the-art Report.
32. OVSJANIKOV, M., LI, W., GUIBAS, L., AND MITRA, N. J. 2011. Exploration of continuous variability in collections of 3d shapes. ACM SIGGRAPH 30, 4, 33:1-33:10.
33. PEREIRA, COSTA, J., COVIELLO, E., DOYLE, G., RASIWASIA, N., LANCKRIET, G., LEVY, R., AND VASCONCELOS, N. 2014. On the role of correlation and abstraction in cross-modal multimedia retrieval. IEEE PAMI 36, 3, 521-535.
34. PLATT, J. C. 1999. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In Advances in large margin classifiers, Citeseer.
35. PRISACARIU, V. A., AND REID, I. D. 2012. Pwp3d: Real-time segmentation and tracking of 3d objects. IJCV 98, 3, 335-354.
36. RAFIEE, G., DLAY, S., AND WOO, W. 2010. A review of content-based image retrieval. In Communication Systems Networks and Digital Signal Processing (CSNDSP), 2010 7th International Symposium on, 775-779.
37. RUSSAKOVSKY, O., DENG, J., SU, H., KRAUSE, J., SATHEESH, S., MA, S., HUANG, Z., KARPATHY, A., KHOSLA, A., BERNSTEIN, M., BERG, A. C., AND FEI-FEI, L., 2014. ImageNet Large Scale Visual Recognition Challenge.
38. RUSSELL, B. C., SIVIC, J., PONCE, J., AND DESSALES, H. 2011. Automatic alignment of paintings and photographs depicting a 3d scene. In 3dRR ICCV Workshop, 545-552.
39. SAUNDERS, C., GAMMERMAN, A., AND VOVK, V. 1998. Ridge regression learning algorithm in dual variables. In Proc. ICML, Morgan Kaufmann, 515-521.
40. SHILANE, P., MIN, P., KAZHDAN, M., AND FUNKHOUSER, T. 2004. The princeton shape benchmark. In Shape modeling applications, 2004. Proceedings, IEEE, 167-178.
41. SHRIVASTAVA, A., MALISIEWICZ, T., GUPTA, A., AND EFROS, A. A. 2011. Data-driven visual similarity for cross-domain image matching. ACM SIGGRAPH Asia 30, 6.
42. SU, H., HUANG, Q., MITRA, N. J., LI, Y., AND GUIBAS, L. 2014. Estimating image depth using shape collections. ACM SIGGRAPH.
43. VAN GEMERT, J. C., GEUSEBROEK, J.-M., VEENMAN, C. J., AND SMEULDERS, A. W. 2008. Kernel codebooks for scene categorization. In ECCV. Springer, 696-709.
44. VICENTE, S., CARREIRA, J., AGAPITO, L., AND BATISTA, J. 2014. Reconstructing pascal voc. In IEEE CVPR.
45. WANG, Y., GONG, M., WANG, T., COHEN-OR, D., ZHANG, H., AND CHEN, B. 2013. Projective analysis for 3d shape segmentation. ACM SIGGRAPH Asia 32, 6, 192:1-192:12.
46. WESTON, J., BENGIO, S., AND USUNIER, N. 2011. Wsabie: Scaling up to large vocabulary image annotation. In Proc. IJCAI.
47. XU, K., LI, H., ZHANG, H., COHEN-OR, D., XIONG, Y., AND CHENG, Z.-Q. 2010. Style-content separation by anisotropic part scales. In ACM SIGGRAPH Asia, 184:1-184:10.
48. XU, K., ZHENG, H., ZHANG, H., COHEN-OR, D., LIU, L., AND XIONG, Y. 2011. Photo-inspired model-driven 3d object modeling. ACM SIGGRAPH 30, 4, 80:1-80:10.
49. XU, K., MA, R., ZHANG, H., ZHU, C., SHAMIR, A., COHENOR, D., AND HUANG, H. 2014. Organizing heterogeneous scene collection through contextual focal points. ACM SIGGRAPH 33, 4.
50. YUMER, M. E., AND KARA, L. B. 2014. Co-constrained handles for deformation in shape collections. ACM SIGGRAPH Asia.
51. YUMER, M. E., CHAUDHURI, S., HODGINS, J. K., AND KARA, L. B. 2015. Semantic shape editing using deformation handles. ACM SIGGRAPH 34.
52. ZHANG, L., AND RUI, Y. 2013. Image searchfrom thousands to billions in 20 years. ACM TOMCCAP 9, 1s, 36.
53. ZHU, J.-Y., LEE, Y. J., AND EFROS, A. A. 2014. Averageexplorer: Interactive exploration and alignment of visual data collections. ACM SIGGRAPH 33, 4, 160:1-160:11.