Human-virtual human interaction by upper body gesture understanding

Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

Volumn , Issue , 2013, Pages 133-142

  Xiao, Yang ^a   Yuan, Junsong ^b   Thalmann, Daniel ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Gesture understanding; Interaction; The Immersion CyberGlove II; The Microsoft Kinect; Virtual human

Indexed keywords

CYBERGLOVE; GESTURE UNDERSTANDING; INTERACTION; MICROSOFT KINECT; VIRTUAL HUMANS;

GESTURE RECOGNITION; VIRTUAL REALITY;

FACE RECOGNITION;

EID: 84887152964     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2503713.2503727     Document Type: Conference Paper

References (25)

1. ADAMO-VILLANI, N., HEISLER, J., and ARNS, L. 2007. Two gesture recognition systems for immersive math education of the deaf. In Proceedings of the First International Conference on Immersive Telecommunications, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 9.
2. BELONGIES, S., MALIK, J., and PUZICHA, J. 2002. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 4, 509-522.
3. BERMAN, S., and STERN, H. 2012. Sensors for gesture recognition systems. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 42, 3, 277-290.
4. BEYGELZIMER, A., KAKADE, S., and LANGFORD, J. 2006. Cover trees for nearest neighbor. In In Proceedings of the Twenty Third International Conference on Machine Learning (ICML 2006), 97-104.
5. CHOPRA, S., HADSELL, R., and LECUN, Y. 2005. Learning a similarity metric discriminatively, with application to face verification. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2005), Vol. 1, 539-546.
6. COVER, T., and HART, P. 1967. Nearest neighbor pattern classification. IEEE Transtractions in Information Theory 13, 1, 21-27.
7. FISHER, R. A. 1936. The use of multiple measures in taxonomic problems. Annals of Eugenics 7, 179-188.
8. GOBRON, S., AHN, J., GARCIA, D., SILVESTRE, Q., THALMANN, D., and BOULIC, R. 2012. An event-based architecture to manage virtual human non-verbal communication in 3d chatting environment. In Articulated Motion and Deformable Objects. Springer, 58-68.
9. GRATCH, J., WANG, N., OKHMATOVSKAIA, A., LAMOTHE, F., MORALES, M., WERF, R. J. V. D., and MORENCY, L. P. 2007. Can virtual humans be more engaging than real ones? In Human-Computer Interaction, HCI Intelligent Multimodal Interaction Environments, LNCS, Vol. 4552, 286-297.
10. IMMERSION. 2010. Cyberglove II specfications. Available at http://www.cyberglovesystems.com/products/cyberglove-ii/specifications.
11. JOLLIFFE, I. T. 1986. Principal Component Analysis. Springer Verlag.
12. KRÄMER, N. C., TIETZ, B., AND BENTE, G. 2003. Effects of embodied interface agents and their gestural activity. In Intelligent Virtual Agents, Springer, 292-300.
13. LU, G., SHARK, L.-K., HALL, G., and ZESHAN, U. 2012. Immersive manipulation of virtual objects through glove-based hand gesture interaction. Virtual Reality 16, 3, 243-252.
14. MÜLLER, M., AND RÖDER, T. 2006. Motion templates for automatic classification and retrieval of motion capture data. In Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, Eurographics Association, 137-146.
15. PIPLICA, A., DELEON, C., and MAGERKO, B. 2012. Full-body gesture interaction with improvisational narrative agents. In Intelligent Virtual Agents, Springer, 514-516.
16. RAUTARAY, S. S., and AGRAWAL, A. 2011. Interaction with virtual game through hand gesture recognition. In Multimedia, Signal Processing and Communication Technologies (IMPACT), 2011 International Conference on, IEEE, 244-247.
17. RIZZO, A. A., LANGE, B., BUCKWALTER, J., FORBELL, E., KIM, J., SAGAE, K., WILLIAMS, J., and ROTHBAUM., B. O., D-IFEDE, J., REGER, G., ET AL 2011. An intelligent virtual human system for providing healthcare information and support. Tech. rep., DTIC Document.
18. SHOTTON, J., FITZGIBBON, A., COOK, M., SHARP, T., FINOC-CHIO, M., MOORE, R., KIPMAN, A., and BLAKE, A. 2011. Real-time human pose recognition in parts from single depth images. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011), 1297-1304.
19. STEDMON, A. W., PATEL, H., SHARPLES, S. C., and WILSON, J. R. 2011. Developing speech input for virtual reality applications: A reality based interaction approach. International journal of human-computer studies 69, 1, 3-8.
20. SWARTOUT, W., TRAUM, D., ARTSTEIN, R., NOREN, D., DE-BEVEC, P., BRONNENKANT, K., WILLIAMS, J., LEUSKI, A., NARAYANAN, S., PIEPOL, D., ET AL 2010. Ada and grace: Toward realistic and engaging virtual museum guides. In Intelligent Virtual Agents, Springer, 286-300.
21. TELEB, H., and CHANG, G. 2012. Data glove integration with 3d virtual environments. In Systems and Informatics (ICSAI), 2012 International Conference on, IEEE, 107-112.
22. WANG, C., MA, Q., ZHU, D., CHEN, H., and YANG, Z. 2012. A methodology of real-time 3d virtual human motion control based on depth-sensing camera for agricultural machinery training. Mathematical and Computer Modelling.
23. WANG, J., LIU, Z., WU, Y., and YUAN, J. 2012. Mining actionlet ensemble for action recognition with depth cameras. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012), 1290-1297.
24. WEINBERGER, K. Q., and SAUL, L. K. 2009. Distance metric learning for large margin nearest neighbor classification. The Journal of Machine Learning Research 10, 207-244.
25. ZHAO, W., XIE, X., and YANG, X. 2012. Control virtual human with speech recognition and gesture recognition technology. In Advances in Electrical Engineering and Automation. Springer, 441-446.