PiGraphs: Learning interaction snapshots from observations

ACM Transactions on Graphics

Volumn 35, Issue 4, 2016, Pages

  Savva, Manolis ^a   Chang, Angel X ^a   Hanrahan, Pat ^a   Fisher, Matthew ^a   Nießner, Matthias ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

3D content generation; Human pose modeling; Object semantics; Person object interactions

Indexed keywords

BEHAVIORAL RESEARCH; GEOMETRY; HIGH LEVEL LANGUAGES; INTERACTIVE COMPUTER GRAPHICS; PROBABILITY DISTRIBUTIONS; SEMANTICS;

3D CONTENT; HIGH LEVEL SPECIFICATION; HUMAN POSE; HUMAN-OBJECT INTERACTION; JOINT PROBABILITY DISTRIBUTIONS; LEARNING INTERACTIONS; OBJECT INTERACTIONS; PROBABILISTIC MODELING;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84979986281     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2897824.2925867     Document Type: Conference Paper

References (44)

1. BAI, Y., SIU, K., AND LIU, C. K. 2012. Synthesis of concurrent object manipulation tasks. ACM Trans. Graph. 31, 6, 156.
2. BOHG, J., MORALES, A., ASFOUR, T., AND KRAGIC, D. 2013. Data-driven grasp synthesis-a survey.
3. CHANG, A. X., SAVVA, M., AND MANNING, C. D. 2014. Learning spatial knowledge for text to 3D scene generation. In Empirical Methods in Natural Language Processing (EMNLP).
4. COYNE, B., AND SPROAT, R. 2001. WordsEye: an automatic textto-scene conversion system. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques.
5. DE LA TORRE, F., HODGINS, J., MONTANO, J., VALCARCEL, S., AND MACEY, J. 2009. Guide to the Carnegie Mellon university multimodal activity (CMU-MMAC) database. Robotics Institute, Carnegie Mellon University.
6. DELAITRE, V., FOUHEY, D. F., LAPTEV, I., SIVIC, J., GUPTA, A., AND EFROS, A. A. 2012. Scene semantics from long-term observation of people. In ECCV.
7. FELZENSZWALB, P. F., AND HUTTENLOCHER, D. P. 2004. Efficient graph-based image segmentation. IJCV.
8. FISHER, M., RITCHIE, D., SAVVA, M., FUNKHOUSER, T., AND HANRAHAN, P. 2012. Example-based synthesis of 3D object arrangements. In ACM TOG.
9. FISHER, M., SAVVA, M., LI, Y., HANRAHAN, P., AND NIESSNER, M. 2015. Activity-centric scene synthesis for functional 3D scene modeling. ACM Transactions on Graphics(TOG) 34, 6, 179.
10. FOUHEY, D. F., DELAITRE, V., GUPTA, A., EFROS, A. A., LAPTEV, I., AND SIVIC, J. 2012. People watching: Human actions as a cue for single view geometry. In ECCV.
11. GIBSON, J. 1977. The concept of affordances. Perceiving, acting, and knowing.
12. GRABNER, H., GALL, J., AND VAN GOOL, L. 2011. What makes a chair a chair? In CVPR.
13. GROCHOW, K., MARTIN, S. L., HERTZMANN, A., AND POPOVIĆ, Z. 2004. Style-based inverse kinematics. In ACM Transactions on Graphics (TOG), vol. 23, ACM, 522-531.
14. GUO, S., SOUTHERN, R., CHANG, J., GREER, D., AND ZHANG, J. J. 2014. Adaptive motion synthesis for virtual characters: a survey. The Visual Computer, 1-16.
15. GUPTA, A., SATKIN, S., EFROS, A. A., AND HEBERT, M. 2011. From 3D scene geometry to human workspace. In CVPR.
16. HU, R., ZHU, C., VAN KAICK, O., LIU, L., SHAMIR, A., AND ZHANG, H. 2015. Interaction context (icon): Towards a geometric functionality descriptor. ACM Trans. Graph. 34, 4 (July), 83:1-83:12.
17. HUANG, H., KALOGERAKIS, E., AND MARLIN, B. 2015. Analysis and synthesis of 3D shape families via deep-learned generative models of surfaces. Computer Graphics Forum 34, 5.
18. JIANG, Y., AND SAXENA, A. 2013. Infinite latent conditional random fields for modeling environments through humans. In RSS.
19. JIANG, Y., LIM, M., AND SAXENA, A. 2012. Learning object arrangements in 3D scenes using human context. arXiv preprint arXiv:1206.6462.
20. JIANG, Y., KOPPULA, H., AND SAXENA, A. 2013. Hallucinated humans as the hidden context for labeling 3D scenes. In CVPR.
21. KALLMANN, M., AND THALMANN, D. 1999. Modeling objects for interaction tasks. Springer.
22. KALOGERAKIS, E., CHAUDHURI, S., KOLLER, D., AND KOLTUN, V. 2012. A probabilistic model of component-based shape synthesis. ACM Transactions on Graphics 31, 4.
23. KANG, C., AND LEE, S.-H. 2014. Environment-adaptive contact poses for virtual characters. In Computer Graphics Forum, vol. 33, Wiley Online Library, 1-10.
24. KIM, V. G., CHAUDHURI, S., GUIBAS, L., AND FUNKHOUSER, T. 2014. Shape2Pose: Human-centric shape analysis. ACM TOG.
25. KOPPULA, H. S., AND SAXENA, A. 2013. Anticipating human activities using object affordances for reactive robotic response. RSS.
26. KOPPULA, H., GUPTA, R., AND SAXENA, A. 2013. Learning human activities and object affordances from RGB-D videos. IJRR.
27. LEE, K. H., CHOI, M. G., AND LEE, J. 2006. Motion patches: building blocks for virtual environments annotated with motiondata. In ACM ransactions on Graphics (TOG), vol. 25, ACM, 898-906.
28. MANNING, C. D., SURDEANU, M., BAUER, J., FINKEL, J., BETHARD, S. J., AND MCCLOSKY, D. 2014. The Stanford CoreNLP natural language processing toolkit. In Association for Computational Linguistics (ACL): System Demonstrations.
29. MARDIA, K. V., AND JUPP, P. E. 2009. Directional statistics, vol. 494. John Wiley & Sons.
30. MIN, J., AND CHAI, J. 2012. Motion graphs++: a compact generative model for semantic motion analysis and synthesis. ACM Transactions on Graphics (TOG) 31, 6, 153.
31. NIESSNER, M., ZOLLHÖFER, M., IZADI, S., AND STAMMINGER, M. 2013. Real-time 3D reconstruction at scale using voxel hashing. ACM TOG.
32. OFLI, F., CHAUDHRY, R., KURILLO, G., VIDAL, R., AND BAJCSY, R. 2013. Berkeley MHAD: A comprehensive multimodal human action database. In Applications of Computer Vision (WACV), 2013 IEEE Workshop on, IEEE, 53-60.
33. SAVVA, M., CHANG, A. X., HANRAHAN, P., FISHER, M., AND NIESSNER, M. 2014. SceneGrok: Inferring action maps in 3D environments. ACM TOG.
34. SHAPIRO, A. 2011. Building a character animation system. In Motion in Games. Springer, 98-109.
35. SHOTTON, J., SHARP, T., KIPMAN, A., FITZGIBBON, A., FINOCCHIO, M., BLAKE, A., COOK, M., AND MOORE, R. 2013. Real-time human pose recognition in parts from single depth images. CACM.
36. SRA, S. 2012. A short note on parameter approximation for von Mises-Fisher distributions: and a fast implementation of Is(x). Computational Statistics 27, 1, 177-190.
37. STARK, M., LIES, P., ZILLICH, M., WYATT, J., AND SCHIELE, B. 2008. Functional object class detection based on learned affordance cues. In Computer Vision Systems.
38. TENORTH, M., BANDOUCH, J., AND BEETZ, M. 2009. The TUM kitchen data set of everyday manipulation activities for motion tracking and action recognition. In Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on, IEEE, 1089-1096.
39. WEI, P., ZHAO, Y., ZHENG, N., AND ZHU, S.-C. 2013. Modeling 4D human-object interactions for event and object recognition. In ICCV.
40. WEI, P., ZHENG, N., ZHAO, Y., AND ZHU, S.-C. 2013. Concurrent action detection with structural prediction. In ICCV.
41. XU, K., MA, R., ZHANG, H., ZHU, C., SHAMIR, A., COHENOR, D., AND HUANG, H. 2014. Organizing heterogeneous scene collection through contextual focal points. ACM TOG.
42. YU, L.-F., YEUNG, S. K., TANG, C.-K., TERZOPOULOS, D., CHAN, T. F., AND OSHER, S. 2011. Make it home: automatic optimization of furniture arrangement. ACM Transactions on Graphics 30, 4, 86.
43. YUMER, M. E., CHAUDHURI, S., HODGINS, J. K., AND KARA, L. B. 2015. Semantic shape editing using deformation handles. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2015) 34.
44. ZHENG, B., ZHAO, Y., YU, J. C., IKEUCHI, K., AND ZHU, S.-C. 2014. Detecting potential falling objects by inferring human action and natural disturbance. In ICRA.