Activity-centric scene synthesis for functional 3D scene modeling

ACM Transactions on Graphics

Volumn 34, Issue 6, 2015, Pages

  Fisher, Matthew ^a   Savva, Manolis ^a   Li, Yangyan ^a   Hanrahan, Pat ^a   Nießner, Matthias ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Activities; Scene synthesis; Scene understanding

Indexed keywords

COMPUTER GRAPHICS;

ACTIVITIES; NOCV1; OBJECT ARRANGEMENTS; PERCEPTUAL EVALUATION; REAL WORLD ENVIRONMENTS; ROBUST OBJECT DETECTION; SCENE REPRESENTATION; SCENE UNDERSTANDING; SYNTHESIS TECHNIQUES;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84995809854     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2816795.2818057     Document Type: Conference Paper

References (32)

1. CHEN, K., LAI, Y.-K., WU, Y.-X., MARTIN, R., AND HU, S.-M. 2014. Automatic semantic modeling of indoor scenes from low-quality rgb-d data using contextual information. ACM Transactions on Graphics (TOG) 33, 6, 208.
2. DROST, B., AND ILIC, S. 2012. 3d object detection and localization using multimodal point pair features. In Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), IEEE, 9-16.
3. FISHER, M., SAVVA, M., AND HANRAHAN, P. 2011. Characterizing structural relationships in scenes using graph kernels. In ACM Transactions on Graphics (TOG), vol. 30, ACM, 34.
4. FISHER, M., RITCHIE, D., SAVVA, M., FUNKHOUSER, T., AND HANRAHAN, P. 2012. Example-based synthesis of 3D object arrangements. ACM Transactions on Graphics (TOG) 31, 6, 135.
5. GALLEGUILLOS, C., AND BELONGIE, S. 2010. Context based object categorization: A critical survey. Computer Vision and Image Understanding 114, 6, 712-722.
6. GIBSON, J. 1977. The concept of affordances. Perceiving, acting, and knowing.
7. GRABNER, H., GALL, J., AND VAN GOOL, L. 2011. What makes a chair a chair? In CVPR.
8. JIANG, Y., AND SAXENA, A. 2013. Hallucinating humans for learning robotic placement of objects. In Experimental Robotics, Springer, 921-937.
9. JIANG, Y., LIM, M., AND SAXENA, A. 2012. Learning object arrangements in 3d scenes using human context. arXiv preprint arXiv:1206.6462.
10. JOHNSON, A. E., AND HEBERT, M. 1999. Using spin images for efficient object recognition in cluttered 3d scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 5, 433-449.
11. KIM, Y. M., MITRA, N. J., YAN, D.-M., AND GUIBAS, L. 2012. Acquiring 3d indoor environments with variability and repetition. ACM Transactions on Graphics (TOG) 31, 6, 138.
12. KIM, V. G., CHAUDHURI, S., GUIBAS, L., AND FUNKHOUSER, T. 2014. Shape2pose: Human-centric shape analysis. ACM Transactions on Graphics (TOG) 33, 4, 120.
13. KOPPULA, H., GUPTA, R., AND SAXENA, A. 2013. Learning human activities and object affordances from RGB-D videos. IJRR.
14. LI, Y., DAI, A., GUIBAS, L., AND NIESSNER, M. 2015. Database-assisted object retrieval for real-time 3d reconstruction. Computer Graphics Forum 34, 2.
15. LIU, T., CHAUDHURI, S., KIM, V. G., HUANG, Q.-X., MITRA, N. J., AND FUNKHOUSER, T. 2014. Creating Consistent Scene Graphs Using a Probabilistic Grammar. ACM Transactions on Graphics (TOG) 33, 6.
16. LOWE, D. G. 2004. Distinctive image features from scale-invariant keypoints. International journal of computer vision 60, 2, 91-110.
17. MARGARITIS, D. 2003. Learning Bayesian network model structure from data. PhD thesis, University of Pittsburgh.
18. MATTAUSCH, O., PANOZZO, D., MURA, C., SORKINE-HORNUNG, O., AND PAJAROLA, R. 2014. Object detection and classification from large-scale cluttered indoor scans. Computer Graphics Forum 33, 2, 11-21.
19. NAN, L., XIE, K., AND SHARF, A. 2012. A search-classify approach for cluttered indoor scene understanding. ACM Transactions on Graphics (TOG) 31, 6, 137.
20. NIESSNER, M., ZOLLHÖFER, M., IZADI, S., AND STAMMINGER, M. 2013. Real-time 3d reconstruction at scale using voxel hashing. ACM Transactions on Graphics (TOG) 32, 6, 169.
21. SATKIN, S., AND HEBERT, M. 2013. 3dnn: Viewpoint invariant 3d geometry matching for scene understanding. In Computer Vision (ICCV), 2013 IEEE International Conference on, IEEE, 1873-1880.
22. SAVVA, M., CHANG, A. X., HANRAHAN, P., FISHER, M., AND NIESSNER, M. 2014. Scenegrok: Inferring action maps in 3D environments. ACM Transactions on Graphics (TOG) 33, 6.
23. SHAO, T., XU, W., ZHOU, K., WANG, J., LI, D., AND GUO, B. 2012. An interactive approach to semantic modeling of indoor scenes with an rgbd camera. ACM Transactions on Graphics (TOG) 31, 6, 136.
24. SHAO, T., MONSZPART, A., ZHENG, Y., KOO, B., XU, W., ZHOU, K., AND MITRA, N. J. 2014. Imagining the unseen: Stability-based cuboid arrangements for scene understanding. ACM Transactions on Graphics (TOG) 33, 6, 209.
25. SHOTTON, J., SHARP, T., KIPMAN, A., FITZGIBBON, A., FINOCCHIO, M., BLAKE, A., COOK, M., AND MOORE, R. 2013. Real-time human pose recognition in parts from single depth images. Communications of the ACM 56, 1, 116-124.
26. TVERSKY, B., AND HARD, B. M. 2009. Embodied and disembodied cognition: Spatial perspective-taking. Cognition 110, 1, 124-129.
27. WEI, P., ZHAO, Y., ZHENG, N., AND ZHU, S.-C. 2013. Modeling 4D human-object interactions for event and object recognition. In ICCV.
28. WEI, P., ZHENG, N., ZHAO, Y., AND ZHU, S.-C. 2013. Concurrent action detection with structural prediction. In ICCV.
29. XU, K., ZHANG, H., COHEN-OR, D., AND CHEN, B. 2012. Fit and diverse: set evolution for inspiring 3d shape galleries. ACM Transactions on Graphics (TOG) 31, 4, 57.
30. XU, K., CHEN, K., FU, H., SUN, W.-L., AND HU, S.-M. 2013. Sketch2scene: Sketch-based co-retrieval and co-placement of 3d models. ACM Transactions on Graphics (TOG) 32, 4, 123.
31. XU, K., MA, R., ZHANG, H., ZHU, C., SHAMIR, A., COHEN-OR, D., AND HUANG, H. 2014. Organizing heterogeneous scene collections through contextual focal points. ACM Transactions on Graphics (TOG) 33, 4, 35.
32. YEH, Y.-T., YANG, L., WATSON, M., GOODMAN, N. D., AND HANRAHAN, P. 2012. Synthesizing open worlds with constraints using locally annealed reversible jump mcmc. ACM Transactions on Graphics (TOG) 31, 4, 56.