Image-based street-side city modeling

ACM Transactions on Graphics

Volumn 28, Issue 5, 2009, Pages

  Xiao, Jianxiong ^a   Fang, Tian ^a   Zhao, Peng ^a   Lhuillier, Maxime ^b   Quan, Long ^a  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^b UNIVERSITÉ CLERMONT AUVERGNE   (France)

Author keywords

3D reconstruction; Building modeling; City modeling; Fa ade modeling; Image based modeling; Street view; Street side

Indexed keywords

3D DATA; 3D RECONSTRUCTION; AUTOMATIC SYSTEMS; CITY MODELING; GROUND LEVEL; IMAGE-BASED; IMAGE-BASED MODELING; LINE STRUCTURES; MULTI-VIEWS; OBJECT CLASS; PARTITION SCHEMES; PHOTO-REALISTIC; PIXEL LEVEL; SEMANTIC SEGMENTATION; STRUCTURE ANALYSIS;

BUILDINGS; IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; INTERACTIVE COMPUTER GRAPHICS; ROADS AND STREETS;

THREE DIMENSIONAL;

EID: 77749268047     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1661412.1618460     Document Type: Conference Paper

References (33)

1. BARINOVA, O., KONUSHIN, V., YAKUBENKO, A., LIM, H., AND KONUSHIN, A. 2008. Fast automatic single-view 3-d reconstruction of urban scenes. In Proceedings of the European Conference on Computer Vision, 100-113.
2. BOYKOV, Y., VEKSLER, O., AND ZABIH, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 11, 1222-1239.
3. CANNY, J. F. 1986. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8, 679-714.
4. CORNELIS, N., LEIBE, B., CORNELIS, K., AND GOOL, L. V. 2008. 3D urban scene modeling integrating recognition and reconstruction. International Journal of Computer Vision 78, 2, 121-141.
5. COUGHLAN, J., AND YUILLE, A. 1999. Manhattan world: compass direction from a single image by bayesian inference. In Proceeding of IEEE International Conference in Computer Vision, vol. 2, 941-947.
6. CURLESS, B., AND LEVOY, M. 1996. A volumetric method for building complex models from range images. In Proceedings of SIGGRAPH 96, ACM Press / ACM SIGGRAPH, H. Rushmeier, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 303-312.
7. DE BERG, M., CHEONG, O., VAN KREVELD, M., AND OVERMARS, M. 2008. Computational Geometry: Algorithms and Applications, 3rd ed. Springer, Berlin.
8. DEBEVEC, P. E., TAYLOR, C. J., AND MALIK, J. 1996. Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In Proceedings of SIGGRAPH 96, ACM Press / ACM SIGGRAPH, H. Rushmeier, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 11-20.
9. DICK, A., TORR, P., AND CIPOLLA, R. 2004. Modelling and interpretation of architecture from several images. International Journal of Computer Vision 60, 2, 111-134.
10. FELZENSZWALB, P., AND HUTTENLOCHER, D. 2004. Efficient graph-based image segmentation. International Journal of Computer Vision 59, 2, 167-181.
11. FRUEH, C., AND ZAKHOR, A. 2003. Automated reconstruction of building facades for virtual walk-thrus. In SIGGRAPH '03: ACM SIGGRAPH 2003 Sketches & Applications, ACM, New York, NY, USA, 1-1.
12. FRÜH, C., AND ZAKHOR, A. 2003. Constructing 3d city models by merging ground-based and airborne views. In Proceedings of IEEE Conference Computer Vision and Pattern Recognition, 562-569.
13. GEMAN, S., AND GEMAN, D. 1984. Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6, 6, 721-741.
14. HARTLEY, R. I., AND ZISSERMAN, A. 2004. Multiple View Geometry in Computer Vision, 2nd ed. Cambridge University Press.
15. HOIEM, D., EFROS, A. A., AND HEBERT, M. 2005. Automatic photo pop-up. ACM Transactions on Graphics 24, 3 (Aug.), 577-584.
16. LHUILLIER, M., AND QUAN, L. 2005. A quasi-dense approach to surface reconstruction from uncalibrated images. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 418-433.
17. MÜLLER, P., ZENG, G., WONKA, P., AND GOOL, L. V. 2007. Image-based procedural modeling of façades. ACM Transactions on Graphics (Aug.), 85:1-85:10.
18. OH, B. M., CHEN, M., DORSEY, J., AND DURAND, F. 2001. Image-based modeling and photo editing. In Proceedings of SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 433-442.
19. OLIVA, A., AND TORRALBA, A. 2006. Building the gist of a scene: the role of global image features in recognition. Progress in Brain Research 155, Part 2, 23-36.
20. PEARL, J. 1982. Reverend bayes on inference engines: a distributed hierarchical approach. In Proceedings of AAAI National Conference on AI, 133-136.
21. PÉREZ, P., GANGNET, M., AND BLAKE, A. 2003. Poisson image editing. ACM Transactions on Graphics 22, 3 (Aug.), 313-318.
22. POLLEFEYS, M., NISTÉR, D., FRAHM, J., AKBARZADEH, A., MORDOHAI, P., CLIPP, B., ENGELS, C., GALLUP, D., KIM, S., MERRELL, P., SALMI, C., SINHA, S., TALTON, B.,WANG, L., YANG, Q., STEWNIUS, H., YANG, R., WELCH, G., AND TOWLES, H. 2008. Detailed real-time urban 3D reconstruction from video. International Journal of Computer Vision 78, 2, 143-167.
23. SAXENA, A., SUN, M., AND NG, A. Y. 2009. Make3d: learning 3d scene structure from a single still image. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 5, 824-840.
24. SCHINDLER, G., KRISHNAMURTHY, P., AND DELLAERT, F. 2006. Line-based structure from motion for urban environments. In 3D Data Processing, Visualization, and Transmission, Third International Symposium on, 846-853.
25. SHOTTON, J., WINN, J., ROTHER, C., AND CRIMINISI, A. 2009. TextonBoost for image understanding: multi-class object recognition and segmentation by jointly modeling texture, layout, and context. International Journal of Computer Vision 81, 1, 2-23.
26. SINHA, S. N., STEEDLY, D., SZELISKI, R., AGRAWALA, M., AND POLLEFEYS, M. 2008. Interactive 3D architectural modeling from unordered photo collections. ACM Transactions on Graphics 27, 5 (Dec.), 159:1-159:10.
27. STAMOS, I., AND ALLEN, P. K. 2002. Geometry and texture recovery of scenes of large scale. Computer Vision and Image Understanding 88, 2, 94-118.
28. TORRALBA, A., MURPHY, K., AND FREEMAN, W. 2007. Sharing visual features for multiclass and multiview object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 5, 854-869.
29. VAN DEN HENGEL, A., DICK, A., THORMÄHLEN, T., WARD, B., AND TORR, P. H. S. 2007. VideoTrace: rapid interactive scene modelling from video. ACM Transactions on Graphics 26, 3 (Aug.), 86:1-86:5.
30. WERNER, T., AND ZISSERMAN, A. 2002. Model selection for automated architectural reconstruction from multiple views. In Proceedings of the British Machine Vision Conference, 53-62.
31. WINN, J., CRIMINISI, A., AND MINKA, T. 2005. Object categorization by learned universal visual dictionary. In Proceedings of IEEE International Conference in Computer Vision, vol. 2, 1800-1807.
32. XIAO, J., FANG, T., TAN, P., ZHAO, P., OFEK, E., AND QUAN, L. 2008. Image-based façade modeling. ACM Transactions on Graphics 27, 5 (Dec.), 161:1-161:10.
33. ZEBEDIN, L., KLAUS, A., GRUBER-G EYMAYER, B., AND KARNER, K. 2006. Towards 3D map generation from digital aerial images. ISPRS Journal of Photogrammetry and Remote Sensing 60, 6 (Sep.), 413-427.