Markerless motion capture and measurement of hand kinematics: Validation and application to home-based upper limb rehabilitation

IEEE Transactions on Biomedical Engineering

Volumn 60, Issue 8, 2013, Pages 2184-2192

  Metcalf, Cheryl D ^a   Robinson, Rebecca ^a,b   Malpass, Adam J ^a,c   Bogle, Tristan P ^a,d   Dell, Thomas A ^a,e   Harris, Chris ^b   Demain, Sara H ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b Roke Manor Research Limited   (United Kingdom)

^c DIALOG SEMICONDUCTOR   (Germany)

^d WheelRight   (United Kingdom)

^e McLaren Automotive Ltd   (United Kingdom)

Author keywords

Hand kinematics; markerless; Microsoft Kinect; telerehabilitation

Indexed keywords

CLASSIFICATION ALGORITHM; HAND KINEMATICS; MARKER-LESS MEASUREMENTS; MARKERLESS; MARKERLESS MOTION CAPTURE; MICROSOFT KINECT; TELEREHABILITATION; UPPER-LIMB REHABILITATION;

GESTURE RECOGNITION; MEASUREMENTS;

KINEMATICS;

ANATOMIC LANDMARK; ARTICLE; CLASSIFICATION ALGORITHM; COMPARATIVE STUDY; COMPUTER SYSTEM; FINGER JOINT; GESTURE; HAND GRIP; HAND MOVEMENT; HOME REHABILITATION; HUMAN; KINEMATICS; MEASUREMENT ACCURACY; MOTION; MOTION CAPTURE SYSTEM; RECOGNITION; THUMB; VALIDATION PROCESS;

ACCELEROMETRY; ACTIGRAPHY; ALGORITHMS; COMPUTER SIMULATION; HAND; HOME CARE SERVICES; HUMANS; MODELS, BIOLOGICAL; MONITORING, AMBULATORY; MOVEMENT; MOVEMENT DISORDERS; THERAPY, COMPUTER-ASSISTED;

EID: 84880871525     PISSN: 00189294     EISSN: 15582531     Source Type: Journal    
DOI: 10.1109/TBME.2013.2250286     Document Type: Article

References (45)

1. United States of America Government, "Patient protection and affordable care act," Office for the Legislative Council, May 1, 2010.
2. United Kingdom of Great BritainGovernment, "The power of information: Putting all of us in control of the health and care information we need," Dept. of Health, Gateway Ref: 17668, May 21, 2012.
3. European Commission, "TeleHealth," Straeqo Cornsortium, Dec. 11, 2007.
4. F. L. Buczek, E. W. Sinsel, D. S. Gloekler, B. M. Wimer, C. M. Warren, and J. Z. Wu, "Kinematic performance of a six degree-of-freedom hand model (6DHand) for use in occupational biomechanics," J. Biomech., vol. 44, no. 9, pp. 1805-1809, Jun. 2011.
5. J. Condell and G. Moore, "HandPuppet3D: Motion capture and analysis for character animation," Artif. Intel. Rev., vol. 31, no. 1-4, pp. 45-59, 2009.
6. M. I. Jackson, M. J. Hiley, andM. R. Yeadon, "A comparison of Coulomb and pseudo-Coulomb friction implementations: Application to the table contact phase of gymnastics vaulting," J. Biomech., vol. 44, no. 15, pp. 2706-2711, Oct. 2011.
7. H. G. Kortier, H. M. Schepers, V. I. Sluiter, and P. H. Veltink, "Ambulatory assessment of hand kinematics: Using an instrumented glove," presented at the XII Int. Symp. 3D Anal. Human Movement, Bologna, Italy, Jul. 18-29, 2012.
8. D. Kim, O. Hilliges, S. Izadi, A. D. Butler, J. Chen, I. Oikonomidis, and P. Oliver, "Digits: Freehand 3D interactions anywhere using a wrist-worn gloveless sensor," presented at the 25th Annu. ACMSymp. User Interface Software Tech., Cambridge, MA, USA, 2012.
9. C. D.Metcalf, S. V. Notley, P. H. Chappell, J. H. Burridge, and V. T. Yule, "Validation and application of a computational model for wrist and hand movements using surface markers," IEEE Trans. Biomed. Eng., vol. 55, no. 3, pp. 1199-1210, Mar. 2008. (Pubitemid 351301223)
10. C. D. Metcalf and S. V.Notley, "Modified kinematic technique formeasuring pathological hyperextension and hypermobility of the interphalangeal joints," IEEE Trans. Biomed. Eng., vol. 58, no. 5, pp. 1224-1231, May 2011.
11. Wii-Habilitation (Oct. 2012). "For those involved in the use of the Nintendo Wii as part of therapy or rehabilitation," [Online]. Available: http://wiihabilitation.co.uk/main.shtml
12. S. Demain, C. D. Metcalf, G. V. Merrett, D. Zheng, and S. Cunningham, "A narrative review on haptic devices: Relating the physiology and psychophysical properties of the hand to devices for rehabilitation in central nervous system disorders," Dis. Rehab.: Assist. Tech., in press. DOI: 10.3109/17483107.2012.697532.
13. M. Windolf, N. Gotzen, and M. Morlock, "Systematic accuracy and precision analysis of video motion capturing systems - Exemplified on the Vicon 460 system," J. Biomech., vol. 41, no. 12, pp. 2776-2780, 2008.
14. Y. Ehara (2012). "Comparison meeting of motion analysis systems," Clin. Gait Anal. Forum Japan [Online]. Available: http://www.ne.jp/asahi/gait/analysis/comparison2002/index-eng.html
15. I. Carpinella, J. Jonsdottir, and M. Ferrarin. (2011). "Multi-finger coordination in healthy subjects and stroke patients: A mathematical modelling approach," J. Neuroeng. Rehab. vol. 8, no. 19 [Online]. Available: http://www.jneuroengrehab.com/content/pdf/1743-0003-8-19.pdf
16. R. DeGeorges, J. Parasie, D. Mitton, N. Imbert, J. N. Goubier, and F. Lavaste, "Three-dimensional rotations of human three-joint fingers: An optoelectronic measurement. Preliminary results," Surg. Radiol. Anat., vol. 27, pp. 43-50, 2005. (Pubitemid 40378814)
17. S. Corazza, L. Mundermann, A. M. Chaudhari, T. Demattio, C. Cobelli, and T. P. Andriacchi, "A markerless motion capture system to study musculoskeletal biomechanics: Visual hull and simulated annealing approach," Ann. Biomed. Eng., vol. 34, no. 6, pp. 1019-1029, Jun. 2006. (Pubitemid 43954334)
18. H. Rijpkema and M. Girard, "Computer animation of knowledge-based human grasping," presented at the 18th Ann. Conf. Comput. Graphics Interact. Tech., Groningen, The Netherlands, 1991.
19. A. Erol, G. Bebis,M. Nicolescu, R. D. Boyle, and X. Twombly, "A review on vision-based full DOF hand motion estimation," presented at the IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Reno, NV, USA, Jun. 2005.
20. J. M. Rehg and T. Kanade, "DigitEyes: Vision-based hand tracking for human-computer interaction," in Proc. IEEEWorkshop Motion Non-Rigid Articulated Obj., Nov. 1994, pp. 16-22.
21. A. Aristidou and J. Lasenby, "Motion capture with constrained inverse kinematics for real-time hand tracking," presented at the Proc. 4th Int. Symp. Commun., Control, Signal Process., Limmasol, Cyprus, 2010.
22. A. El-Sawah, N. D. Georganas, and E. M. Petriu, "Finger inverse kinematics using error model analysis for gesture enabled navigation in virtual environments," in Proc. IEEE Int. Workshop Haptic Audio Vis. Envir. Appl., Ottawa, ON, Canada, 2006, pp. 34-39. (Pubitemid 351688628)
23. B. Stenger, P. Mendonca, and R. Cipolla, "Model-based 3D tracking of an articulated hand," presented at the IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Cambridge, UK, 2001.
24. J. Lee and T. L. Kunii, "Model-based analysis of hand posture," IEEE Comput. Graph. Appl., vol. 15, no. 5, pp. 77-86, Sep. 1995.
25. T. Gumpp, P. Azad, K.Welke, E. Oztop, R. Dillmann, and G. Cheng, "Unconstrained real-timemarkerless hand tracking for humanoid interaction," in Proc. 6th IEEE-RAS Int. Conf. Humanoid Robots, Saitama, Japan, Dec. 2006, pp. 88-93.
26. A. M. Biancardi, A. C. Jirapatnakul, and A. P. Reeves, "A comparison of ground truth estimation methods," Int. J. Comput. Assist. Radiol. Surg., vol. 5, no. 3, pp. 295-305, May 2010.
27. C. Sollerman, "The use of eight main hand-grips in activities of daily living," Ph.D. dissertation, Univ. Goteborg, Goteborg, Sweden, 1980.
28. S. Malik, "Real-time hand tracking and finger tracking for interaction," M.Sc. thesis, Dept. Comput. Sci., Univ. Toronto, Toronto, ON, Canada, 2003.
29. K. Byron, L. Pham, and J. Situka, "Markerless motion tracking," M.Sc. thesis, Iowa State Univ., Ames, IA, USA, 2009.
30. J. L. Crowley, F. Berard, and J. Coutaz, "Finger tracking as an input device for augmented reality," presented at the Int.Workshop Face Gesture Recognit., Zurich, Switzerland, 1995.
31. Z. Luo, C. K. Lim, I.-M. Chen, and S. H. Yeo, "A virtual reality system for arm and hand rehabilitation," Front. Mech. Eng., vol. 6, no. 1, pp. 23-32, 2011.
32. D. Gianstanti, "Validation of a tele-home-care for hand-telerehabilitation," Proc. IEEE Eng. Med. Biol. Soc., Aug. 2007, pp. 3830-3832.
33. M. Huber, B. Rabin, C. Docan, G. C. Burdea, M. Abdelbaky, and M. R. Gomolb, "Feasibility of modified remotely monitored in-home gaming technology for improving hand function in adolescents with cerebral palsy," IEEE Trans. Inf. Technol. Biomed., vol. 14, no. 2, pp. 526-534, Mar. 2010.
34. L. Ballan and G. M. Cortelazzo, "Marker-less motion capture of skinned models in a four camera set-up using optical flow and silhouettes," presented at the 4th Int. Symp. 3D Data Process., Vis. Transmiss., Atlanta, GA, USA, 2008.
35. S. Nussbaumer, M. Leunig, J. F. Glatthorn, S. Stauffacher, H. Gerber, and N. A. Maffiuletti, "Validity and test-retest reliability of manual goniometers for measuring passive hip range of motion in femoroacetabular impingement patients," BMC Musc. Disord., vol. 11, p. 194, 2010.
36. T. I. Carter, B. Pansy, A. L. Wolff, H. J. Hillstrom, S. I. Backus, M. Lenhoff, and S. W. Wolfe, "Accuracy and reliability of three different techniques for manual goniometry for wrist motion: A cadaveric study," J. Hand. Surg., vol. 34, no. 8, pp. 1422-1428, 2009.
37. B. Ellis and A. Bruton, "A study to compare the reliability of composite finger flexion with goniometry for measurement of range of motion in the hand," Clin. Rehab., vol. 16, no. 5, pp. 562-570, 2002.
38. F. Cordella, F. Di Corato, L. Zollo, B. Siciliano, and P. van der Smagt, "Patient performance evaluation using Kinect and Monte Carlo-based finger tracking," presented at the 4th IEEE RAS/EMBS Int. Conf. Biomed. Rob. Biomechatronics, Rome, Italy, Jun. 2012.
39. T. Dutta, "Evaluation of the KinectTM sensor for 3-D kinematic measurement in the workplace," App. Ergo., vol. 43, pp. 645-649, 2012.
40. M. Alnowami, B. Alnwaimi, F. Tahavori, M. Copland, and K. Wells, "A quantitative assessment of using the Kinect for Xbox360TM for respiratory surface motion tracking," in Proc. SPIE, 2012, vol. 8316, pp. 8316T- 1-8316T-10.
41. J. A. K. S. Segen, "Gesture VR: Vision based 3D hand interface for spatial interaction," Proc. ACM Multimedia, 1998, pp. 455-464.
42. S. S. Rautaray and A. Agrawal, "Design of gesture recognition system for dynamic user interface," presented at the IEEE Int. Conf. Tech. Enhanced Educ., Allahabad, India, Jan. 2012.
43. B. You, P. Siy, and W. A. T. S. Anderst, "In vivo measurement of 3-D skeletal kinematics from sequences of biplane radiographs: Application to knee kinematics," IEEE Trans. Med. Imag., vol. 20, no. 6, pp. 514-525, Jun. 2001. (Pubitemid 32657855)
44. D. Massimini and J. A. L. G. Warner, "Non-invasive determination of coupled motion of the scapula and humerus: An in-vitro validation," J. Biomech., vol. 44, pp. 408-412, 2011.
45. Y. A. N. M. Jang-Hee, "Automated markerless analysis of human gait motion for recognition and classification," ETRI J., vol. 33, pp. 259-266, 2011.