State of the Art in Hand and Finger Modeling and Animation

Computer Graphics Forum

Volumn 34, Issue 2, 2015, Pages 735-760

  Wheatland, Nkenge ^a   Wang, Yingying ^b   Song, Huaguang ^b   Neff, Michael ^b   Zordan, Victor ^a   Jörg, Sophie ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c CLEMSON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIOINFORMATICS; COMPUTER GRAPHICS;

BIOLOGICAL STRUCTURES; COMPLEX BIOLOGICAL SYSTEMS; EMERGING TRENDS; FINGER MOTION; MODELING AND ANIMATION; MOTION CAPTURING; STATE OF THE ART; VIRTUAL CHARACTER;

ANIMATION;

EID: 84932140707     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/cgf.12595     Document Type: Conference Paper

References (207)

1. 3Gear Systems: Motion capture system website, http://threegearsystems.blogspot.com/, http://www.threegear.com/, August 2014. 9
2. Aleotti J., Caselli S.,: Grasp programming by demonstration in virtual reality with automatic environment reconstruction. Virtual Reality 16, 2 (2012), 87-104. 15
3. Arnaldi B., Dumont G., Hègron G., Magnenat-Thalmann N., Thalmann D.,: Animation control with dynamics. In State-of-the-art in Computer Animation, Magnenat-Thalmann N., Thalmann D., (Eds.). Springer-Verlag, 1989, pp. 113-123. 11, 12, 13
4. Albrecht I., Haber J., Seidel H.-P.,: Construction and animation of anatomically based human hand models. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2003), pp. 98-109. 3, 12
5. Andrews S., Jarvis M., Kry P.G.,: Data-driven fingertip appearance for interactive hand simulation. In Proceedings of Motion on Games (2013), MIG '13, ACM, pp. 155:177-155:186. 13
6. Andrews S., Kry P.G.,: Policies for goal directed multi-finger manipulation. In The 9th Workshop on Virtual Reality Interaction and Physical Simulation (VRIPHYS) (2012), pp. 137-145. 12
7. Andrews S., Kry P.G.,: Goal directed multi-finger manipulation: Control policies and analysis. Computers & Graphics 37, 7 (2013), 830-839. 4, 12
8. Aydin Y., Nakajima M.,: Database guided computer animation of human grasping using forward and inverse kinematics. Computers & Graphics 23, 1 (1999), 145-154. 15
9. Adamo-Villani N.,: 3D rendering of American sign language finger-spelling: A comparative study of two animation techniques. 5th International Conference on Computer Instructional Technologies (2008), 808-812. 5, 18
10. Adamo-Villani N., Beni G.,: Automated finger spelling by highly realistic 3D animation. British Journal of Educational Technology 35, 3 (2004), 345-362. 17
11. Bergmann K., Kopp S.,: Increasing the expressiveness of virtual agents: Autonomous generation of speech and gesture for spatial description tasks. In Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 1 (2009), AAMAS '09, pp. 361-368. 17
12. Bergmann K., Kahl S., Kopp S.,: Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints. In Proceedings of the 13th International Conference on Intelligent Virtual Agents (2013), Springer, pp. 203-216. 17
13. Bai Y., Liu C.K.,: Dexterous manipulation using both palm and fingers. In IEEE International Conference on Robotics and Automation (2014). 1, 15
14. Blausen Medical Communications: Hand and wrist bones, http://commons.wikimedia.org/wiki/file:blausen-0440-handbones.png, September 2014. Edits made for this publication. 2
15. Burtnyk N., Wein M.,: Computer-generated key frame animation. Society of Motion Picture and Television Engineers 80, 3 (1971), 149-153. 5
16. Burtnyk N., Wein M.,: Interactive skeleton techniques for enhancing motion dynamics in key frame animation. Communications of the ACM 19, 10 (Oct. 1976), 564-569. 5
17. Bruderlin A., Williams L.,: Motion signal processing. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques (1995), SIGGRAPH '95, ACM, pp. 97-104. 9
18. Braido P., Zhang X.,: Quantitative analysis of finger motion coordination in hand manipulative and gestic acts. Human Movement Science 22, 6 (2004), 661-678. 4, 11
19. Chi D., Costa M., Zhao L., Badler N.,: The emote model for effort and shape. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (2000), SIGGRAPH '00, ACM, pp. 173-182. 16
20. Ciocarlie M., Goldfeder C., Allen P.,: Dimensionality reduction for hand-independent dexterous robotic grasping. In IEEE/RSJ International Conference on Intelligent Robots and Systems (2007), pp. 3270-3275. 4
21. Chou T., Gadd A., Knott D.,: Hand-eye: A vision based approach to data glove calibration. Proceedings of Human Interface Technologies (2000). 7, 8
22. Cutkosky M.R., Howe R.D.,: Human grasp choice and robotic grasp analysis. In Dextrous Robot Hands, Venkataraman S.T., Iberall T., (Eds.). Springer-Verlag New York, Inc., 1990, ch. 1, pp. 5-31. 14
23. Chai J., Hodgins J.K.,: Performance animation from low-dimensional control signals. ACM Transactions on Graphics 24, 3 (July 2005), 686-696. 6
24. Chao A.,: Uni-dimensional evaluation of Wristsystem and CyberGlove. Master's thesis, Department of Industrial and Manufacturing Engineering, Wichita State University, Los Alamitos, CA, 2001. 7
25. Cerveri P., Lopomo N., Pedotti A., Ferrigno G.,: Derivation of centers and axes of rotation for wrist and fingers in a hand kinematic model: Methods and reliability results. Annals of Biomedical Engineering 33, 3 (2005), 402-412. 4
26. Chiu C.-C., Marsella S.,: How to train your avatar: A data driven approach to gesture generation. In Proceedings of the 10th International Conference on Intelligent Virtual Agents (2011), IVA'11, Springer-Verlag, pp. 127-140. 16, 17
27. Chiu C.-C., Marsella S.,: A style controller for generating virtual human behaviors. In The 10th International Conference on Autonomous Agents and Multiagent Systems-Volume 3 (2011), International Foundation for Autonomous Agents and Multiagent Systems, pp. 1023-1030. 16
28. Chiu C.-C., Marsella S.,: Gesture generation with low-dimensional embeddings. In Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems (2014), AAMAS '14, pp. 781-788. 16, 17
29. Control VR,: Motion capture system website, http://controlvr.com/, January 2015. 8
30. Chang L.Y., Pollard N.S.,: Constrained least-squares optimization for robust estimation of center of rotation. Journal of Biomechanics 40, 6 (2007), 1392-1400. 4
31. Chang L.Y., Pollard N.S.,: Robust estimation of dominant axis of rotation. Journal of Biomechanics 40, 12 (2007), 2707-2715. 4
32. Chang L., Pollard N.,: Method for determining kinematic parameters of the in vivo thumb carpometacarpal joint. IEEE Transactions on Biomedical Engineering 55, 7 (July 2008), 1897-1906. 4
33. Chang L.Y., Pollard N., Mitchell T., Xing E.P.,: Feature selection for grasp recognition from optical markers. In IEEE/RSJ International Conference on Intelligent Robots and Systems (2007), pp. 2944-2950. 5, 6
34. Cassell J., Vilhjálmsson H. H., Bickmore T.,: Beat: The behavior expression animation toolkit. In ACM SIGGRAPH 2001 (2001), pp. 477-486. 11, 17
35. Cutkosky M., Wright P.,: Modeling manufacturing grips and correlations with the design of robotic hands. In IEEE International Conference on Robotics and Automation. Proceedings (Apr 1986), vol. 3, pp. 1533-1539. 14
36. CyberGlove Systems: Motion capture system website, http://www.cyberglovesystems.com/products/cybergloveii/overview, August 2014. 7
37. DGTech Engineering Solutions: DG5 VHand description website, http://www.dgtech.it/vhand/eng/index.html, August 2014. 7
38. Delp S.L., Loan J.,: A graphics-based software system to develop and analyze models of musculoskeletal structures. Computers in Biology and Medicine 25, 1 (1995), 21-34. 12
39. de La Gorce M., Paragios N., Fleet D.,: Model-based hand tracking with texture, shading and self-occlusions. In IEEE Conference on Computer Vision and Pattern Recognition (June 2008), pp. 1-8. 9
40. Damasio F.W., Musse S.R.,: Animating virtual humans using hand postures. In SIBGRAPI (2002), IEEE Computer Society, p. 437. 10, 11
41. Dhawale P., Masoodian M., Rogers B.,: Bare-hand 3D gesture input to interactive systems. In Proceedings of the 7th ACM SIGCHI New Zealand Chapter's International Conference on Computer-human Interaction: Design Centered HCI (2006), CHINZ '06, ACM, pp. 25-32. 9
42. Dorner B.,: Chasing the Colour Glove [microform]: Visual Hand Tracking. Canadian theses. Thesis (M.Sc.)-Simon Fraser University, 1994. 8
43. de Ruiter J.,: The production of gesture and speech. In Language and Gesture: Window into Thought and Action, McNeill D., (Ed.). Cambridge University Press, Cambridge, England; New York, NY, 2000, pp. 284-311. 16
44. Dipietro L., Sabatini A., Dario P.,: A survey of glove-based systems and their applications. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 38, 4 (July 2008), 461-482. 7, 8, 10
45. Efron D.,: Gesture and environment. King's Crown Press, 1941. 15
46. ElKoura G., Singh K.,: Handrix: Animating the human hand. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2003), pp. 110-119. 4, 11, 18
47. Feiner S.K., Beshers C.,: Visualizing n-dimensional virtual worlds with n-vision. Computer Graphics 24, 2 (Feb. 1990), 37-38. 15
48. Fernández-Baena A., Montaño R., Antonijoan M., Roversi A., Miralles D., Alías F.,: Gesture synthesis adapted to speech emphasis. Speech Communication 57 (2014), 331-350. 16, 17
49. Flash T., Hogans N.,: The coordination of arm movements: An experimentally confirmed mathematical model. Journal of neuroscience 5, 7 (1985), 1688-1703. 16
50. Fifth Dimension Technologies: 5DT Data Glove product description website, http://www.5dt.com/products/pdataglovemri.html, August 2014. 7
51. Fitts P.M.,: The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47, 6 (1954), 381-391. 16
52. Fisher S.S., McGreevy M., Humphries J., Robinett W.,: Virtual environment display system. In Proceedings of the 1986 Workshop on Interactive 3D Graphics (1987), I3D' 86, ACM, pp. 77-87. 7
53. Fischer M., van der Smagt P., Hirzinger G.,: Learning techniques in a dataglove based telemanipulation system for the dlr hand. In IEEE International Conference on Robotics and Automation (1998), vol. 2, IEEE, pp. 1603-1608. 7, 8
54. Gao W., Chen Y., Fang G., Yang C., Jiang D., Ge C., Wang C.,: HandTalker II: A Chinese sign language recognition and synthesis system. In ICARCV'04 (2004), pp. 759-764. 17
55. Griffin W., Findley R., Turner M., Cutkosky M.,: Calibration and mapping of a human hand for dexterous telemanipulation. In ASME IMECE 2000 Symposium on Hoptic Interfaces for Virtual Environments and Teleoperator Systems (2000), pp. 1-8. 7, 8
56. Gibet S., Kamp J.-F., Poirier F.,: Gesture analysis: Invariant laws in movement. In Gesture-Based Communication in Human-Computer Interaction, Camurri A., Volpe G., (Eds.), vol. 2915 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2004, pp. 1-9. 16
57. Gray H., Lewis W.H.,: Anatomy of the human body, 20 ed. Philadelphia, Lea & Febiger, 1918. 3
58. Gao W., Ma J., Shan S., Chen X., Zeng W., Zhang H., Yan J., Wang J.,: Handtalker: A multimodal dialog system using sign language and 3-d virtual human. In Advances in Multimodal Interfaces-ICMI 2000, Tan T., Shi Y., Gao W., (Eds.), vol. 1948 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2000, pp. 564-571. 17
59. Gourret J.-P., Thalmann N.M., Thalmann D.,: Simulation of object and human skin formations in a grasping task. Computer Graphics 23, 3 (July 1989), 21-30. 13
60. Huang Z., Boulic R., Magnenat Thalmann N., Thalmann D.,: Multi-sensor approach for grasping and 3D interaction. In Proceedings Computer Graphics International '95, Academic Press (1995), pp. 235-254. 11, 15
61. Hülsken F., Eckes C., Kuck R., Unterberg J., Jörg S.,: Modeling and animating virtual humans. International Journal of Virtual Reality (IJVR) 6, 4 (December 2007), 11-20. 7
62. Hu H., Gao X., Li J., Wang J., Liu H.,: Calibrating human hand for teleoperating the hit/dlr hand. In IEEE International Conference on Robotics and Automation (2004), vol. 5, IEEE, pp. 4571-4576. 7, 8
63. Heloir A., Kipp M.,: Real-time animation of interactive agents: Specification and realization. Applied Artificial Intelligence 24, 6 (July 2010), 510-529. 17
64. Huenerfauth M., Lu P.,: Accurate and accessible motion-capture glove calibration for sign language data collection. ACM Transactions on Accessible Computing 3, 1 (Sept. 2010), 2:1-2:32. 7
65. Huenerfauth M., Lu P.,: Modeling and synthesizing spatially inflected verbs for American sign language animations. In Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (2010), ASSETS '10, ACM, pp. 99-106. 11, 18
66. Hartmann B., Mancini M., Pelachaud C.,: Formational parameters and adaptive prototype instantiation for MPEG-4 compliant gesture synthesis. In Proceedings of the Computer Animation (2002), CA '02, IEEE Computer Society, pp. 111-119. 16
67. Hartmann B., Mancini M., Pelachaud C.,: Implementing expressive gesture synthesis for embodied conversational agents. In Proceedings of the 6th International Conference on Gesture in Human-Computer Interaction and Simulation (2006), GW0'5, Springer-Verlag, pp. 188-199. 16
68. Hoyet L., Ryall K., McDonnell R., O'Sullivan C.,: Sleight of hand: perception of finger motion from reduced marker sets. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (2012), I3D '12, pp. 79-86. 4, 6
69. Hoyet L., Ryall K., McDonnell R., O'Sullivan C.,: Sleight of hand: Perception of finger motion from reduced marker sets. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (2012), I3D '12, ACM, pp. 79-86. 5
70. Huang H., Zhao L., Yin K., Qi Y., Yu Y., Tong X.,: Controllable hand deformation from sparse examples with rich details. In Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2011), SCA '11, ACM, pp. 73-82. 14
71. Ip H. H. S., Chan S. C. S., Lam M. S. W.,: Hand gesture animation from static postures using an anatomy-based model. In Proceedings of the International Conference on Computer Graphics (2000), CGI '00, IEEE Computer Society, pp. 29-. 3, 5, 12
72. Isrozaidi N., Ismail N., Oshita M.,: Data glove-based interface for real-time character motion control. In ACM SIGGRAPH ASIA 2010 Posters (2010), SA '10, ACM, pp. 5:1-5:1. 11
73. Jacobs J.P.,: Refinements to the ergonomic model for keyboard fingering of parncutt, sloboda, clarke, raekallio, and desain. Music Perception: An Interdisciplinary Journal 18, 4 (2001), pp. 505-511. 18
74. Jörg S., Hodgins J., O'Sullivan C.,: The perception of finger motions. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization (2010), APGV '10, ACM, pp. 129-133. 1, 5
75. Jörg S., Hodgins J., Safonova A.,: Data-driven finger motion synthesis for gesturing characters. ACM Transactions on Graphics 31, 6 (Nov. 2012), 189:1-189:7. 1, 9, 15
76. Jain S., Liu C.K.,: Controlling physics-based characters using soft contacts. ACM Transactions on Graphics 30 (Dec. 2011), 163:1-163:10. 13
77. Jin S., Li Y., Chen W.,: A novel dataglove calibration method. In 5th International Conference on Computer Science and Education (2010), IEEE, pp. 1825-1829. 7, 8
78. Jöng S., O'Sullivan C.,: Exploring the dimensionality of finger motion. In Proceedings of the 9th Eurographics Ireland Workshop (EGIE 2009) (December 2009), pp. 1-11. 5
79. Kochanek D. H. U., Bartels R.H.,: Interpolating splines for keyframe animation. In Graphics Interface '84 (May 1984), pp. 41-42. 5
80. Kochanek D. H. U., Bartels R.H.,: Interpolating splines with local tension, continuity, and bias control. Computer Graphics 18, 3 (Jan. 1984), 33-41. 5
81. Kim J., Cordier F., Magnenat-Thalmann N.,: Neural network-based violinist's hand animation. In Computer Graphics International (2000), pp. 37-41. 18
82. Kirchhof C., de Ruiter J.,: On the audiovisual integration of speech and gesture. Presented at the 5th Conference of the International Society for Gesture Studies (ISGS) (2012). 17
83. Kendon A.,: Gesticulation and speech: Two aspects of the process of utterance. The Relationship of Verbal and Nonverbal Communication 25 (1980), 207-227. 15
84. Kendon A.,: Gesture-Visible Action as Utterance. Cambridge University Press, Cambridge, UK, 2004. 1, 15
85. Kessler G.D., Hodges L.F., Walker N.,: Evaluation of the CyberGlove as a whole-hand input device. ACM Transactions on Computer-Human Interaction 2, 4 (1995), 263-283. 7
86. Kipp M.,: Gesture Generation by Imitation-From Human Behavior to Computer Character Animation. PhD thesis, Saarland University, Boca Raton, Florida, December 2004. 17
87. Kry P.G., James D.L., Pai D.K.,: Eigenskin: Real time large deformation character skinning in hardware. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2002), SCA '02, ACM, pp. 153-159. 14
88. Kopp S., Krenn B., Marsella S., Marshall A.N., Pelachaud C., Pirker H., Thõrisson K. R., Vilhjálmsson H.,: Towards a common framework for multimodal generation: The behavior markup language. In Proceedings of the 6th International Conference on Intelligent Virtual Agents (2006), IVA'06, Springer, pp. 205-217. 17
89. Kramer J., Leifer L.,: The talking glove. ACM SIGCAPH Computers and the Physically Handicapped, 39 (April 1988), 12-16. 17
90. Kramer J., Lindener P., George W.,: Communication system for deaf, deaf-blind, or non-vocal individuals using instrumented glove, Sept. 10 1991. US Patent 5,047,952. 17
91. Kurihara T., Miyata N.,: Modeling deformable human hands from medical images. In Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2004), SCA '04, Eurographics Association, pp. 355-363. 13
92. Kugimoto N., Miyazono R., Omori K., Fujimura T., Furuya S., Katayose H., Miwa H., Nagata N.,: CG animation for piano performance. In SIGGRAPH '09: Posters (2009), SIGGRAPH '09, ACM, pp. 3:1-3:1. 18
93. Kipp M., Neff M., Kipp K.H., Albrecht I.,: Towards natural gesture synthesis: Evaluating gesture units in a data-driven approach to gesture synthesis. In Proceedings of the 7th International Conference on Intelligent Virtual Agents (2007), pp. 15-28. 17
94. Kry P.G., Pai D.K.,: Interaction capture and synthesis. ACM Transactions on Graphics 25, 3 (2006), 872-880. 11, 13, 14, 15
95. Kopp S., Tepper P., Cassell J.,: Towards integrated microplanning of language and iconic gesture for multimodal output. In Proceedings of the 6th International Conference on Multimodal Interfaces (2004), ICMI '04, ACM, pp. 97-104. 16
96. KITA S., VAN GIJN I., VAN DER HULST H.,: Movement phase in signs and co-speech gestures, and their transcriptions by human coders. In Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction (1998), Springer-Verlag, pp. 23-35. 15, 16
97. Kopp S., Wachsmuth I.,: Model-based animation of co-verbal gesture. In Proceedings of Computer Animation (June 2002), IEEE, pp. 252-257. 16
98. Kopp S., Wachsmuth I.,: Synthesizing multimodal utterances for conversational agents: Research articles. Computer Animation and Virtual Worlds 15, 1 (Mar. 2004), 39-52. 17
99. Kitagawa M., Windsor B.,: MoCap for Artists: Workflow and Techniques for Motion Capture. Focal Press, 2008. 6
100. Kang C., Wheatland N., Neff M., Zordan V.,: Automatic hand-over animation for free-hand motions from low resolution input. In Motion in Games, vol. 7660 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2012, pp. 244-253. 6, 10
101. Kaufman A., Yagel R.,: Tools for interaction in three dimensions. In Proceedings of the Third International Conference on Human-computer Interaction, Vol.1 on Work with Computers: Organizational, Management, Stress and Health Aspects (1989), Elsevier Science Inc., pp. 468-475. 15
102. Kahlesz F., Zachmann G., Klein R.,: Visual-fidelity dataglove calibration. In Computer Graphics International (2004), pp. 403-410. 7, 8
103. Li Q., Chen Y., Zhang Y., Liu Y., Zhao D.,: Grasp gesture recognition based on rough sets theory in ar system. International Journal of Digital Content Technology and its Applications 5, 1 (2011), 226-234. 15
104. Leap Motion: Motion capture system website, http://www.leapmotion.com/, August 2014. 9
105. Li Y., Fu J.L., Pollard N.S.,: Data-driven grasp synthesis using shape matching and task-based pruning. IEEE Transactions on Visualization and Computer Graphics 13, 4 (2007), 732-747. 15
106. Lu P., Huenerfauth M.,: Accessible motion-capture glove calibration protocol for recording sign language data from deaf subjects. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (2009), ACM, pp. 83-90. 7
107. Lu P., Huenerfauth M.,: Collecting a motion-capture corpus of American sign language for data-driven generation research. In Proceedings of the NAACL HLT 2010 Workshop on Speech and Language Processing for Assistive Technologies (2010), SLPAT '10, Association for Computational Linguistics, pp. 89-97. 17, 18
108. Lu P., Huenerfauth M.,: Synthesizing American sign language spatially inflected verbs from motion-capture data. Second International Workshop on Sign Language Translation and Avatar Technology (SLTAT), in conjunction with ASSETS (2011). 17, 18
109. Liu C.K.,: Synthesis of interactive hand manipulation. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2008), pp. 163-171. 4, 13
110. Liu C.K.,: Dextrous manipulation from a grasping pose. ACM Transactions on Graphics 28, 3 (2009), 3:1-3:6. 11, 13
111. Levine S., Krähenbühl P., Thrun S., Koltun V.,: Gesture controllers. ACM Transactions on Graphics 29, 4 (2010), 1-11. 10, 17
112. Lee J., Marsella S.,: Nonverbal behavior generator for embodied conversational agents. In Proceedings of the 6th International Conference on Intelligent Virtual Agents (2006), IVA'06, Springer-Verlag, pp. 243-255. 17
113. Lhommet M., Marsella S.C.,: Gesture with meaning. In Proceedings of the 13th International Conference on Intelligent Virtual Agents (2013), Springer, pp. 303-312. 17
114. Liang R.-H., Ouhyoung M.,: A sign language recognition system using hidden markov model and context sensitive search. In Proceedings of the ACM International Symposium on Virtual Reality and Softwre Technology (1996), pp. 59-66. 10
115. Lockwood N., Singh K.,: Finger walking: Motion editing with contact-based hand performance. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2012), SCA '12, Eurographics Association, pp. 43-52. 11
116. Lee S.-H., Sifakis E., Terzopoulos D.,: Comprehensive biomechanical modeling and simulation of the upper body. ACM Transactions on Graphics 28, 4 (Sept. 2009), 99:1-99:17. 12
117. Levine S., Theobalt C., Koltun V.,: Real-time prosody-driven synthesis of body language. ACM Transactions on Graphics 28, 5 (Dec. 2009), 172:1-172:10. 10, 17
118. Lin J., Wu Y., Huang T.S.,: Modeling the constraints of human hand motion. In Proceedings of the Workshop on Human Motion (HUMO '00) (2000), HUMO '00, IEEE Computer Society, pp. 121-126. 4, 11
119. Menon A.S., Barnes B., Mills R., Bruyns C.D., Twombly A., Twombly E., Smith J., Montgomery K., Boyle R.,: Using registration, calibration, and robotics to build a more accurate virtual reality simulation for astronaut training and telemedicine. In Proceedings of the 11th International Conference in Central Europe on Computer Graphics, Visualization, and Computer (WSCGo03) (2003). 7, 8
120. McNeill D.,: Hand and Mind: what gestures reveal about thought. The University of Chicago Press, 1992. 15
121. McNeill D.,: Gesture and thought. University of Chicago Press, 2005. 16
122. Measurand: www.shapehand.com, August 2014. 7
123. Menache A.,: Understanding Motion Capture for Computer Animation and Video Games. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1999. 5, 7
124. Mehdi S., Khan Y.,: Sign language recognition using sensor gloves. In Proceedings of the 9th International Conference on Neural Information Processing (Nov 2002), vol. 5, pp. 2204-2206. 10
125. Miller A.T., Knoop S., Christensen H.I., Allen P.K.,: Automatic grasp planning using shape primitives. In In Proceedings of the 2003 IEEE International Conference on Robotics and Automation (2003), pp. 1824-1829. 14
126. Miyata N., Kouch M., Mochimaru M., Kurihara T.,: Finger joint kinematics from MR images. In IEEE/RSJ International Conference on Intelligent Robots and Systems (Aug 2005), pp. 2750-2755. 4
127. Moccozet L., Magnenat-Thalmann N.,: Dirichlet free-form deformations and their application to hand simulation. In Computer Animation '97 (Jun 1997), pp. 93-102. 13
128. Mancini M., Niewiadomski R., Bevacqua E., Pelachaud C.,: Greta: A saiba compliant eca system. In Troisième Workshop sur les Agents Conversationnels Animés (Paris, France, November 2008), WACA '08. 17
129. Murakami K., Taguchi H.,: Gesture recognition using recurrent neural networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (1991), CHI '91, ACM, pp. 237-242. 10
130. McDonald J., Toro J., Alkoby K., Berthiaume A., Carter R., Chomwong P., Christopher J., Davidson M.J., Furst J., Konie B., Lancaster G., Roychoudhuri L., Sedgwick E., Tomuro N., Wolfe R.,: An improved articulated model of the human hand. The Visual Computer 17, 3 (2001), 158-166. 3
131. Magnenat-Thalmann N., Laperrire R., Thalmann D.,: Joint-dependent local deformations for hand animation and object grasping. In In Proceedings on Graphics Interface (1988), pp. 26-33. 13, 14
132. Magnenat-Thalmann N., Thalmann D.,: The direction of synthetic actors in the film rendez-vous a montreal. IEEE Computer Graphics and Applications 7, 12 (Dec. 1987), 9-19. 13
133. Maikowska A., Zordan V.B., Faloutsos P.,: Automatic splicing for hand and body animations. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2006), pp. 309-316. 9, 10
134. Napier J.,: Hands. New York: Pantheon Books, Princeton, NJ, 1980. 2
135. Neuron P.,: Motion capture system website, http://perceptionmocap.com/, Janurary 2015. 8
136. Neff M., Fiume E.,: Modeling tension and relaxation for computer animation. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2002), SCA '02, ACM, pp. 81-88. 16
137. Neff M., Fiume E.,: AER: Aesthetic exploration and refinement for expressive character animation. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2005), SCA '05, ACM, pp. 161-170. 16
138. Nimble VR,: Motion capture system website, http://nimblevr.com//, January 2015. 9
139. Neff M., Kipp M., Albrecht I., Seidel H.-P.,: Gesture modeling and animation based on a probabilistic recreation of speaker style. ACM Transactions on Graphics 27, 1 (2008), 1-24. 2, 5, 11, 16, 17
140. Neff M., Seidel H.-P.,: Modeling relaxed hand shape for character animation. In Articulated Motion and Deformable Objects, vol. 4069 of Lecture Notes in Computer Science. Springer, 2006, pp. 262-270. 12
141. Neff M., Toothman N., Bowmani R., Tree J. E. F., Walker M.A.,: Don't scratch! Self-adaptors reflect emotional stability. In Proceedings of the 10th International Conference on Intelligent Virtual Agents (2011), Springer, pp. 398-411. 2
142. Neff M., Wang Y., Abbott R., Walker M.,: Evaluating the effect of gesture and language on personality perception in conversational agents. In Proceedings of the 10th International Conference on Intelligent Virtual Agents (2010), Springer, pp. 222-235. 2
143. OptiTrack: Motion capture system website, https://www.naturalpoint.com/optitrack/, July 2014. 6
144. PhaseSpace: Motion capture system website, http://www.phasespace.com/, August 2014. 6
145. Plancak M., Luzanin O.,: Hand gesture recognition using low-budget data glove and cluster-trained probabilistic neural network. Assembly Automation 34, 1 (2014), 94-105. 11
146. Palastanga N., Soames R.,: Anatomy and Human Movement-Structure and Function, 6 ed. Butterworth Heinemann Elsevier, 2012. 2, 3
147. Parncutt R., Sloboda J.A., Clarke E.F., Raekallio M., Desain P.,: An ergonomic model of keyboard fingering for melodic fragments. Music Perception: An Interdisciplinary Journal 14, 4 (1997), 341-382. 18
148. Pollard N.S., Zordan V.B.,: Physically based grasping control from example. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2005), pp. 311-318. 4, 11, 12, 15
149. Qualisys: Motion capture system website, http://www.qualisys.com/, August 2014. 6
150. Quam D.L., Williams G.B., Agnew J.R., Browne P.C.,: An experimental determination of human hand accuracy with a dataglove. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (1989), vol. 33, SAGE Publications, pp. 315-319. 7
151. Reeves W.T.,: Inbetweening for computer animation utilizing moving point constraints. Computer Graphics 15, 3 (Aug. 1981), 263-269. 5
152. Rijpkema H., Girard M.,: Computer animation of knowledge-based human grasping. In Proceedings of the 18th Annual Conference on Computer graphics and Interactive Techniques (1991), SIGGRAPH '91, ACM, pp. 339-348. 4, 11, 14
153. Rhee T., Neumann U., Lewis J.P.,: Human hand modeling from surface anatomy. In Proceedings of the 2006 Symposium on Interactive 3D Graphics and Games (2006), I3D '06, ACM, pp. 27-34. 13
154. SAIBA: Working group website, 2012. http://www.mindmakers.org/projects/saiba/wiki. 15
155. Sayegh S.I.,: Fingering for string instruments with the optimum path paradigm. Computer Music Journal 13, 3 (1989), pp. 76-84. 18
156. Stewart A.J., Cremer J.F.,: Beyond keyframing: An algorithmic approach to animation. In Proceedings of the Conference on Graphics Interface '92 (1992), Morgan Kaufmann Publishers Inc., pp. 273-281. 11
157. Siméon T., Cortes J., Sahbani A., Laumond J.P.,: A manipulation planner for pick and place operations under continuous grasps and placements. In In Proceedings of the IEEE International Conference on Robotics and Automation (2002), pp. 2022-2027. 11
158. Stone M., DeCarlo D., Oh I., Rodriguez C., Stere A., Lees A., Bregler C.,: Speaking with hands: Creating animated conversational characters from recordings of human performance. ACM Transactions on Graphics 23, 3 (2004), 506-513. 10, 16, 17
159. Shotton J., Fitzgibbon A., Cook M., Sharp T., Finocchio M., Moore R., Kipman A., Blake A.,: Realtime human pose recognition in parts from single depth images. In Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (2011), CVPR '11, IEEE, pp. 1297-1304. 9
160. Santello M., Flanders M., Soechting J.F.,: Postural hand synergies for tool use. The Journal of Neuroscience 18, 23 (1998), 10105-10115. 4, 5, 11
161. Shankar V., Ghosh D.,: Dynamic hand gesture synthesis and animation using image morphing technique. IET Conference Proceedings (January 2006), 543-548 (5). 5
162. Stillfried G., Hillenbrand U., Settles M., van der Smagt P.,: MRI-based skeletal hand movement model. In The Human Hand as an Inspiration for Robot Hand Development, Balasubramanian R., Santos V.J., (Eds.), vol. 95 of Springer Tracts in Advanced Robotics. Springer International Publishing, 2014, pp. 49-75. 4
163. Sueda S., Kaufman A., Pai D.K.,: Musculotendon simulation for hand animation. ACM Transactions on Graphics 27, 3 (Aug. 2008), 3:1-3:8. 3, 11, 12
164. Schlattmann M., Kahlesz F., Sarlette R., Klein R.,: Markerless 4 gestures 6 DOF real-time visual tracking of the human hand with automatic initialization. Computer Graphics Forum 26, 3 (Sept. 2007), 467-476. 9
165. Sudderth E.B., M M. I., Freeman W.T., Willsky A.S.,: Distributed occlusion reasoning for tracking with nonparametric belief propagation. In In Neural Information Processing Systems (2004), MIT Press, pp. 1369-1376. 9
166. Steffen J., Maycock J., Ritter H.,: Robust dataglove mapping for recording human hand postures. Intelligent Robotics and Applications (2011), 34-45. 7, 8
167. Sridhar S., Oulasvirta A., Theobalt C.,: Interactive markerless articulated hand motion tracking using RGB and depth data. In IEEE International Conference on Computer Vision (2013), IEEE, pp. 2456-2463. 9
168. Sueda S., Pai D.,: Hand simulation models in computer graphics. Journal of the Society of Biomechanisms 38, 1 (2014). 11
169. Somia N., Rash G., Wachowiak M., Gupta A.,: The initiation and sequence of digital joint motion: A three-dimensional motion analysis. The Journal of Hand Surgery: Journal of the British Society for Surgery of the Hand 23, 6 (Dec. 1998), 792-795. 4, 11
170. Sanso R.M., Thalmann D.,: A hand control and automatic grasping system for synthetic actors. In Computer Graphics Forum (1994), vol. 13, pp. 167-77. 4, 14
171. Synertial: Motion capture system website, http://www.synertial.com/products/glove-7-sensor/, January 2015. 8
172. Sturman D.J., Zeltzer D.,: A survey of glove-based input. IEEE Computer Graphics and Applications 14, 1 (1994), 30-39. 7, 15
173. Sturman D.J., Zeltzer D., Pieper S.,: Hands-on interaction with virtual environments. In Proceedings of the 2nd Annual ACM SIGGRAPH Symposium on User Interface Software and Technology (1989), UIST '89, ACM, pp. 19-24. 7, 15
174. Theobalt C., Albrecht I., Haber J., Magnor M., Seidel H.-P.,: Pitching a baseball: Tracking high-speed motion with multi-exposure images. ACM Transactions on Graphics 23, 3 (August 2004), 540-547. 8
175. Teran J., Blemker S., Hing V. N. T., Fedkiw R.,: Finite volume methods for the simulation of skeletal muscle. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2003), SCA '03, Eurographics Association, pp. 68-74. 11, 12
176. Tomovic R., Bekey G.A., Karplus W.J.,: A strategy for grasp synthesis with multifingered robot hands. In IEEE International Conference on Robotics and Automation (Mar 1987), vol. 4, pp. 83-89. 14
177. Tang Y.-M., Hui K.-C.,: Simulating tendon motion with axial mass-spring system. Computers & Graphics 33, 2 (2009), 162-172. 12
178. Taylor G.W., Hinton G.E.,: Factored conditional restricted boltzmann machines for modeling motion style. In Proceedings of the 26th Annual International Conference on Machine Learning (2009), ACM, pp. 1025-1032. 16
179. Taylor G.W., Hinton G.E., Roweis S.T.,: Modeling human motion using binary latent variables. In Advances in neural information processing systems (2006), pp. 1345-1352. 16
180. Thiebaux M., Marsella S., Marshall A.N., Kallmann M.,: Smartbody: Behavior realization for embodied conversational agents. In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems-Volume 1 (Richland, SC, 2008), AAMAS '08, pp. 151-158. 17
181. Tsang W., Singh K., Fiume E.,: Helping hand: An anatomically accurate inverse dynamics solution for unconstrained hand motion. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2005), pp. 319-328. 3, 4, 12
182. Tompson J., Stein M., LeCun Y., Perlin K.,: Real-time continuous pose recovery of human hands using convolutional networks. ACM Transaction on Graphics 33, 5 (2014), 169:1-169:10. 9
183. Uno Y., Kawato M., Suzuki R.,: Formation and control of optimal trajectory in human multijoint arm movement-minimum torque-change model. Biological Cybernetics 61, 2 (1989), 89-101. 16
184. Vilhiálmsson H., Cantelmo N., Cassell J. E., Chafai N., Kipp M., Kopp S., Mancini M., Marsella S., Marshall A.N., Pelachaud C., Ruttkay Z., Thõrisson K. R., Welbergen H., Werf R.J.,: The behavior markup language: Recent developments and challenges. In Proceedings of the 7th International Conference on Intelligent Virtual Agents (2007), IVA '07, Springer-Verlag, pp. 99-111. 17
185. Vicon: Motion capture system website, http://www.vicon.com, July 2014. 6
186. Viviani P., Terzuolo C.,: Trajectory determines movement dynamics. Neuroscience 7, 2 (1982), 431-437. 16
187. van Welbergen H., Reidsma D., Ruttkay Z.M., Zwiers J.,: Elckerlyc-A BML Realizer for continuous, multimodal interaction with a virtual human. Journal on Multimodal User Interfaces 3, 4 (August 2010), 271-284. 16, 17
188. Wallbott H.G.,: Bodily expression of emotion. European Journal of Social Psychology 28, 6 (1998), 879-896. 2
189. Williams G., Bregler C., Hackney P., Rosenthal S., MCDOWALL I., Smolskiy K.,: Body Signature Recognition. Tech. Rep. TR-2008-915, New York University, 2008. 2
190. Wang J.M., Fleet D.J., Hertzmann A.,: Gaussian process dynamical models for human motion. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 2 (2008), 283-298. 16
191. Weimer D., Ganapathy S.K.,: A synthetic visual environment with hand gesturing and voice input. SIGCHI Bulletin 20, SI (Mar. 1989), 235-240. 7
192. Wise S., Gardner W., Sabelman E., Valainis E., Wong Y., Glass K., Drace J., Rosen J.M.,: Evaluation of a fiber optic glove for semi-automated goniometric measurements. Journal of Rehabilitation Research and Development 27, 4 (1990), 411-424. 7
193. Wheatland N., Jörg S., Zordan V.,: Automatic hand-over animation using principle component analysis. In Proceedings of Motion on Games (2013), MIG '13, ACM, pp. 175:197-175:202. 5, 6, 10, 18
194. Wang Y., Neff M.,: Data-driven glove calibration for hand motion capture. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2013), SCA '13, ACM, pp. 15-24. 7, 8
195. Wang Y., Neff M.,: The influence of prosody on the requirements for gesture-text alignment. In Proceedings of the 13th International Conference on Intelligent Virtual Agents (2013), Springer, pp. 180-188. 17
196. Wang R.Y., Popovic J.,: Real-time hand-tracking with a color glove. ACM Transactions on Graphics 28, 3 (2009), 1-8. 8, 10, 11, 12
197. Wang R.Y., Paris S., Popovic J.,: 6D hands: markerless hand-tracking for computer aided design. In ACM Symposium on User Interface Software and Technology (2011), pp. 549-558. 8
198. Weissmann J., Salomon R.,: Gesture recognition for virtual reality applications using data gloves and neural networks. In International Joint Conference on Neural Networks (1999), vol. 3, pp. 2043-2046 vol. 3. 10
199. Yazadi F.,: Cyberglove systems: CyberGlove II wireless data glove user guide. CyberGlove Systems LLC, 2009. 7
200. Yamane K., Kuffner J.J., Hodgins J.K.,: Synthesizing animations of human manipulation tasks. ACM Transactions on Graphics 23, 3 (Aug. 2004), 532-539. 11
201. Ye Y., Liu C.K.,: Synthesis of detailed hand manipulations using contact sampling. ACM Transactions on Graphics 31, 4 (2012). 11, 15
202. Yang X.S., Zhang J.J.,: Modelling and animating hand wrinkles. In Proceedings of the 5th International Conference on Computational Science-Volume Part II (2005), ICCS'05, Springer-Verlag, pp. 199-206. 13
203. Zancolli E.,: Structural and dynamic bases of hand surgery, 2 ed. Lippincott, Philadelphia, Pennsylvania, 1979. 4
204. Zhao W., Chai J., Xu Y.-Q.,: Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2012). 4, 9, 11
205. Zimmerman T.,: Optical flex sensor, Sept. 17 1985. US Patent 4,542,291. 7
206. Zhu Y., Ramakrishnan A.S., Hamann B., Neff M.,: A system for automatic animation of piano performances. Computer Animation and Virtual Worlds 24, 5 (2013), 445-457. 1, 11, 18
207. Zhao W., Zhang J., Min J., Chai J.,: Robust realtime physics-based motion control for human grasping. ACM Transactions on Graphics 32, 6 (Nov. 2013), 207:1-207:12. 4