SceneGrok: Inferring action maps in 3D environments

ACM Transactions on Graphics

Volumn 33, Issue 6, 2014, Pages

  Savva, Manolis ^a   Chang, Angel X ^a   Hanrahan, Pat ^a   Fisher, Matthew ^a   Nießner, Matthias ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

3D scenes; Object semantics; Scene understanding

Indexed keywords

FORECASTING; SEMANTICS;

3-D ENVIRONMENTS; 3D RECONSTRUCTION; 3D REPRESENTATIONS; 3D SCENES; FUNCTIONAL SIMILARITY; PUBLICLY ACCESSIBLE; REAL WORLD ENVIRONMENTS; SCENE UNDERSTANDING;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84914703232     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2661229.2661230     Document Type: Conference Paper

References (39)

1. ARTHUR, D., AND VASSILVITSKII, S. 2007. k-means++: The advantages of careful seeding. In ACM-SIAM symposium on Discrete algorithms.
2. BOHG, J., MORALES, A., ASFOUR, T., AND KRAGIC, D. 2013. Data-driven grasp synthesis - a survey.
3. BREIMAN, L. 2001. Random forests. Machine learning.
4. COATES, A., AND NG, A. Y. 2012. Learning feature representations with k-means. In Neural Networks: Tricks of the Trade.
5. COATES, A., NG, A. Y., AND LEE, H. 2011. An analysis of singlelayer networks in unsupervised feature learning. In ICAIS.
6. DELAITRE, V., FOUHEY, D. F., LAPTEV, I., SIVIC, J., GUPTA, A., AND EFROS, A. A. 2012. Scene semantics from long-term observation of people. In ECCV.
7. FELZENSZWALB, P. F., AND HUTTENLOCHER, D. P. 2004. Efficient graph-based image segmentation. IJCV.
8. FISHER, M., SAVVA, M., AND HANRAHAN, P. 2011. Characterizing structural relationships in scenes using graph kernels. In ACM TOG.
9. FISHER, M., RITCHIE, D., SAVVA, M., FUNKHOUSER, T., AND HANRAHAN, P. 2012. Example-based synthesis of 3D object arrangements. In ACM TOG.
10. FOUHEY, D. F., DELAITRE, V., GUPTA, A., EFROS, A. A., LAPTEV, I., AND SIVIC, J. 2012. People watching: Human actions as a cue for single view geometry. In ECCV.
11. FRITZ, G., PALETTA, L., BREITHAUPT, R., ROME, E., AND DORFFNER, G. 2006. Learning predictive features in affordance based robotic perception systems. In IROS.
12. GIBSON, J. 1977. The concept of affordances. Perceiving, acting, and knowing.
13. GOLDFEDER, C., AND ALLEN, P. K. 2011. Data-driven grasping. Autonomous Robots.
14. GRABNER, H., GALL, J., AND VAN GOOL, L. 2011. What makes a chair a chair? In CVPR.
15. GUPTA, A., SATKIN, S., EFROS, A. A., AND HEBERT, M. 2011. From 3D scene geometry to human workspace. In CVPR.
16. HALL, M., FRANK, E., HOLMES, G., PFAHRINGER, B., REUTEMANN, P., AND WITTEN, I. H. 2009. The WEKA data mining software: an update. ACM SIGKDD explorations newsletter.
17. HERMANS, T., REHG, J. M., AND BOBICK, A. 2011. Affordance prediction via learned object attributes. In ICRA Workshop on Semantic Perception, Mapping, and Exploration.
18. HYVÄRINEN, A., AND OJA, E. 2000. Independent component analysis: algorithms and applications. Neural networks.
19. JIANG, Y., AND SAXENA, A. 2013. Infinite latent conditional random fields for modeling environments through humans. In RSS.
20. JIANG, Y., LIM, M., AND SAXENA, A. 2012. Learning object arrangements in 3d scenes using human context. arXiv preprint arXiv:1206.6462.
21. JIANG, Y., KOPPULA, H., AND SAXENA, A. 2013. Hallucinated humans as the hidden context for labeling 3D scenes. In CVPR.
22. KARPATHY, A., MILLER, S., AND FEI-FEI, L. 2013. Object discovery in 3D scenes via shape analysis. In ICRA.
23. KIM, V. G., CHAUDHURI, S., GUIBAS, L., AND FUNKHOUSER, T. 2014. Shape2Pose: Human-centric shape analysis. ACM TOG.
24. KOPPULA, H. S., AND SAXENA, A. 2013. Anticipating human activities using object affordances for reactive robotic response. RSS.
25. KOPPULA, H., GUPTA, R., AND SAXENA, A. 2013. Learning human activities and object affordances from RGB-D videos. IJRR.
26. MITRA, N., WAND, M., ZHANG, H. R., COHEN-O R, D., KIM, V., AND HUANG, Q.-X. 2013. Structure-aware shape processing. In SIGGRAPH Asia 2013 Courses.
27. MITRA, N. J., PAULY, M., WAND, M., AND CEYLAN, D. 2013. Symmetry in 3d geometry: Extraction and applications. In Computer Graphics Forum.
28. MONTESANO, L., LOPES, M., BERNARDINO, A., AND SANTOSVICTOR, J. 2008. Learning object affordances: From sensory-motor coordination to imitation. IEEE Transactions on Robotics.
29. NAN, L., XIE, K., AND SHARF, A. 2012. A search-classify approach for cluttered indoor scene understanding. ACM TOG.
30. NIESSNER, M., ZOLLHÖFER, M., IZADI, S., AND STAMMINGER, M. 2013. Real-time 3D reconstruction at scale using voxel hashing. ACM TOG.
31. PANDEY, A. K., AND ALAMI, R. 2012. Taskability graph: Towards analyzing effort based agent-agent affordances. In ROMAN, 2012 IEEE.
32. SHOTTON, J., SHARP, T., KIPMAN, A., FITZGIBBON, A., FINOCCHIO, M., BLAKE, A., COOK, M., AND MOORE, R. 2013. Real-time human pose recognition in parts from single depth images. CACM.
33. STARK, M., LIES, P., ZILLICH, M., WYATT, J., AND SCHIELE, B. 2008. Functional object class detection based on learned affordance cues. In Computer Vision Systems.
34. SUN, J., MOORE, J. L., BOBICK, A., AND REHG, J. M. 2010. Learning visual object categories for robot affordance prediction. IJRR.
35. WEI, P., ZHAO, Y., ZHENG, N., AND ZHU, S.-C. 2013. Modeling 4D human-object interactions for event and object recognition. In ICCV.
36. WEI, P., ZHENG, N., ZHAO, Y., AND ZHU, S.-C. 2013. Concurrent action detection with structural prediction. In ICCV.
37. XU, K., CHEN, K., FU, H., SUN, W.-L., AND HU, S.-M. 2013. Sketch2Scene: Sketch-based co-retrieval and co-placement of 3D models. ACM TOG.
38. XU, K., MA, R., ZHANG, H., ZHU, C., SHAMIR, A., COHENOR, D., AND HUANG, H. 2014. Organizing heterogeneous scene collection through contextual focal points. ACM TOG.
39. ZHENG, B., ZHAO, Y., YU, J. C., IKEUCHI, K., AND ZHU, S.-C. 2014. Detecting potential falling objects by inferring human action and natural disturbance. In ICRA.