Toward automatic 3D generic object modeling from one single image

Proceedings - 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2011

Volumn , Issue , 2011, Pages 9-16

  Sun, Min ^a   Kumar, Shyam Sunder ^a   Bradski, Gary ^b   Savarese, Silvio ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

^b Willow Garage Inc   (United States)

Author keywords

3D modeling; 3D reconstruction; Shape completion; Texture completion

Indexed keywords

3-D MODELING; 3-D SHAPE; 3D MODELS; 3D RECONSTRUCTION; HUMAN INTERVENTION; IN-BUILDINGS; NOVEL METHODS; OBJECT CATEGORIES; OBJECT MODELING; SECOND LIFE; SHAPE COMPLETION; SINGLE IMAGES; VIRTUAL ENVIRONMENTS;

CONTENT BASED RETRIEVAL; IMAGING SYSTEMS; MAMMALS; TEXTURES; THREE DIMENSIONAL COMPUTER GRAPHICS; VIRTUAL REALITY; VISUALIZATION;

THREE DIMENSIONAL;

EID: 80051969487     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/3DIMPVT.2011.11     Document Type: Conference Paper

References (49)

1. M. Sun, G. Bradski, B.-X. Xu, and S. Savarese, "Depth-encoded hough voting for joint object detection and shape recovery," in ECCV, 2010.
2. N. Snavely, S. M. Seitz, and R. Szeliski, "Photo tourism: Exploring photo collections in 3d," in SIGGRAPH, 2006.
3. Z. Zhang, "Iterative point matching for registration of free-form curves and surfaces," IJCV, vol. 13, pp. 119-152, 1994.
4. M. K. J. Michael W. Tao and S. Paris, "Error-tolerant image compositing," in ECCV, 2010.
5. P. E. Debevec, C. J. Taylor, and J. Malik, "Modeling and rendering architecture from photographs: a hybrid geometry-and image-based approach," in SIGGRAPH, 1996.
6. M. Pollefeys, L. Van Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, and R. Koch, "Visual modeling with a hand-held camera," IJCV, vol. 59, no. 3, pp. 207-232, 2004.
7. S. Agarwal, N. Snavely, I. Simon, S. M. Seitz, and R. Szeliski, "Building rome in a day," in ICCV, 2009.
8. A. R. Dick, P. H. S. Torr, and R. Cipolla, "Modelling and interpretation of architecture from several images," IJCV, vol. 60, no. 2, pp. 111-134, 2004.
9. S. Teller, M. Antone, Z. Bodnar, M. Bosse, S. Coorg, M. Jethwa, and N. Master, "Calibrated, registered images of an extended urban area," IJCV, vol. 53, no. 1, pp. 93-107, 2003.
10. J.-Y. Bouguet and P. Perona, "Visual navigation using a single camera," in ICCV, 1995.
11. S. Savarese, M. Andreetto, H. Rushmeier, F. Bernardin, and P. Perona, "3d reconstruction by shadow carving: Theory and practical evaluation," IJCV, vol. 71, no. 3, pp. 305-336, 2006. (Pubitemid 44610050)
12. S. Rusinkiewicz, O. Hall-Holt, and M. Levoy, "Real-time 3d model acquisition," ACM Trans. Graph., vol. 21, no. 3, pp. 438-446, 2002.
13. M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk, "The digital michelangelo project: 3d scanning of large statues," in SIGGRAPH, 2000.
14. K. N. Kutulakos and S. M. Seitz, "A theory of shape by space carving," IJCV, vol. 38, no. 3, pp. 199-218, 2000.
15. P. R. S. Mendonça, K.-Y. K. Wong, and R. Cipolla, "Camera pose estimation and reconstruction from image profiles under circular motion," in ECCV, 2000.
16. S. M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski, "A comparison and evaluation of multi-view stereo reconstruction algorithms," in CVPR, 2006.
17. L. McMillan and G. Bishop, "Plenoptic modeling: an image-based rendering system," in SIGGRAPH, 1995.
18. M. Levoy and P. Hanrahan, "Light field rendering," in SIGGRAPH, 1996.
19. D. G. Aliaga, T. Funkhouser, D. Yanovsky, and I. Carlbom, "Sea of images: A dense sampling approach for rendering large indoor environments," IEEE Comput. Graph. Appl., vol. 23, no. 6, pp. 22-30, 2003.
20. C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation, " in SIGGRAPH. ACM, 2004.
21. Y. Horry, K.-I. Anjyo, and K. Arai, "Tour into the picture: using a spidery mesh interface to make animation from a single image," in SIGGRAPH. ACM, 1997.
22. D. Liebowitz, A. Criminisi, and A. Zisserman, "Creating architectural models from images," in EuroGraphics, 1999.
23. J. Kopf, B. Neubert, B. Chen, M. Cohen, D. Cohen-Or, O. Deussen, M. Uyttendaele, and D. Lischinski, "Deep photo: Model-based photograph enhancement and viewing," in SIGGRAPH Asia. ACM, 2008.
24. A. Saxena, M. Sun, and A. Y. Ng, "Make3d: Learning 3d scene structure from a single still image," TPAMI, vol. 31, no. 5, pp. 824-840, 2009.
25. D. Hoiem, A. A. Efros, and M. Hebert, "Automatic photo pop-up," in SIGGRAPH. ACM, 2005.
26. H. Wang, S. Gould, and D. Koller, "Discriminative learning with latent variables for cluttered indoor scene understanding," in ECCV, 2010.
27. M. Prasad and A. Fitzgibbon, "Single view reconstruction of curved surfaces," in CVPR, 2006.
28. C. Colombo, A. Del Bimbo, and F. Pernici, "Metric 3d reconstruction and texture acquisition of surfaces of revolution from a single uncalibrated view," TPAMI, vol. 27, no. 1, pp. 99-114, 2005. (Pubitemid 40195901)
29. X. Chen, S. B. Kang, Y.-Q. Xu, J. Dorsey, and H.-Y. Shum, "Sketching reality: Realistic interpretation of architectural designs," ACM Trans. Graph., vol. 27, no. 2, pp. 1-15, 2008.
30. O. A. Karpenko and J. F. Hughes, "Smoothsketch: 3d free-form shapes from complex sketches," ACM Transactions on Graphics, vol. 25/3, pp. 589-598, 2006. (Pubitemid 44488155)
31. N. Jiang, P. Tan, and L.-F. Cheong, "Symmetric architecture modeling with a single image," in SIGGRAPH Asia, 2009.
32. A. Thomas, V. Ferrari, B. Leibe, T. Tuytelaars, and L. J. V. Gool, "Depth-from-recognition: Inferring meta-data by cognitive feedback," in 3DRR workshop in ICCV, 2007.
33. "The princeton shape benchmark," in SMI '04: Proceedings of the Shape Modeling International 2004. Washington, DC, USA: IEEE Computer Society, 2004, pp. 167-178.
34. N. J. Mitra, L. Guibas, and M. Pauly, "Partial and approximate symmetry detection for 3d geometry," ACM Trans. Graph., vol. 25, no. 3, pp. 560-568, 2006. (Pubitemid 44481015)
35. D. H. Ballard, "Generalizing the hough transform to detect arbitrary shapes," Pattern Recognition, vol. 13, no. 2, pp. 111-122, 1981.
36. B. Leibe, A. Leonardis, and B. Schiele, "Combined object categorization and segmentation with an implicit shape model," in ECCV workshop on statistical learning in computer vision, 2004, pp. 17-32.
37. A. Sharf, M. Alexa, and D. Cohen-Or, "Context-based surface completion," in SIGGRAPH. ACM, 2004.
38. M. Pauly, N. J. Mitra, J. Giesen, M. Gross, and L. J. Guibas, "Example-based 3d scan completion," in SGP, 2005.
39. V. Kraevoy and A. Sheffer, "Template-based mesh completion," in SGP, 2005.
40. R. Gal, A. Shamir, T. Hassner, M. Pauly, and D. Cohen-Or, "Surface reconstruction using local shape priors," in SGP, 2007.
41. C. Rother, V. Kolmogorov, and A. Blake, ""grabcut": interactive foreground extraction using iterated graph cuts," ACM Trans. Graph., vol. 23, no. 3, pp. 309-314, 2004.
42. P. P. Antonio Criminisi and K. Toyama, "Object removal by exemplar-based inpainting," in CVPR, 2003.
43. A. Shamir and S. Avidan, "Seam carving for media retargeting," Commun. ACM, vol. 52, no. 1, pp. 77-85, 2009.
44. J. Hays and A. A. Efros, "Scene completion using millions of photographs," in SIGGRAPH. ACM, 2007.
45. A. A. Efros and T. K. Leung, "Texture synthesis by non-parametric sampling," in ICCV, 1999.
46. P. Pérez, M. Gangnet, and A. Blake, "Poisson image editing," ACM Trans. Graph., vol. 22, no. 3, pp. 313-318, 2003.
47. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The PASCAL voc challenge 2007."
48. V. Ferrari, L. Fevrier, F. Jurie, and C. Schmid, "Groups of adjacent contour segments for object detection," TPAMI, vol. 30, no. 1, pp. 36-51, 2008. (Pubitemid 350168354)
49. S. Savarese and L. Fei-Fei, "3D generic object categorization, localization and pose estimation," in ICCV, 2007.