Markerless motion capture can provide reliable 3D gait kinematics in the sagittal and frontal plane

Medical Engineering and Physics

Volumn 36, Issue 9, 2014, Pages 1168-1175

  Sandau, Martin ^a,b   Koblauch, Henrik ^a   Moeslund, Thomas B ^c   Aanæs, Henrik ^d   Alkjær, Tine ^a   Simonsen, Erik B ^a  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

^b Danish Institute of Fire and Security Technology   (Denmark)

^c AALBORG UNIVERSITY   (Denmark)

^d TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

3D reconstruction; Articulated model; Biomechanics; Dense point cloud; Gait analysis; Iterative closest point; Markerless; Motion capture; Photogrammetry; Stereo vision; Tracking

Indexed keywords

BIOMECHANICS; DEGREES OF FREEDOM (MECHANICS); GAIT ANALYSIS; PHOTOGRAMMETRY; STEREO IMAGE PROCESSING; STEREO VISION; SURFACE DISCHARGES;

3D RECONSTRUCTION; ARTICULATED MODELS; ITERATIVE CLOSEST POINTS; MARKERLESS; MOTION CAPTURE; POINT CLOUD;

REPAIR;

ACCURACY; ANKLE; ARTICLE; CAMERA; GAIT; HIP; HUMAN; JOINT MOBILITY; KINEMATICS; KNEE; KNEE FUNCTION; MARKERLESS MOTION CAPTURE; MOTION; PRIORITY JOURNAL; RANGE OF MOTION; RELIABILITY; SKILL; STANDING; STEREOVISION CAMERA; THREE DIMENSIONAL IMAGING; BIOLOGICAL MODEL; BIOMECHANICS; JOINT CHARACTERISTICS AND FUNCTIONS; LEG; MALE; PHYSIOLOGY; PROCEDURES; ROTATION; VIDEORECORDING; WALKING;

ANKLE JOINT; BIOMECHANICAL PHENOMENA; GAIT; HIP JOINT; HUMANS; IMAGING, THREE-DIMENSIONAL; KNEE JOINT; LEG; MALE; MODELS, BIOLOGICAL; RANGE OF MOTION, ARTICULAR; ROTATION; VIDEO RECORDING; WALKING;

EID: 84906053642     PISSN: 13504533     EISSN: 18734030     Source Type: Journal    
DOI: 10.1016/j.medengphy.2014.07.007     Document Type: Article

References (47)

1. Piazza S.J., Cavanagh P.R. Measurement of the screw-home motion of the knee is sensitive to errors in axis alignment. J Biomech 2000, 33:1029-1034.
2. Akbarshahi M., Schache A.G., Fernandez J.W., Baker R., Banks S., Pandy M.G. Non-invasive assessment of soft-tissue artifact and its effect on knee joint kinematics during functional activity. J Biomech 2010, 43:1292-1301.
3. Li K., Zheng L., Tashman S., Zhang X. The inaccuracy of surface-measured model-derived tibiofemoral kinematics. J Biomech 2012, 45:2719-2723.
4. Tsai T-Y., Lu T-W., Kuo M-Y., Lin C-C. Effects of soft tissue artifacts on the calculated kinematics and kinetics of the knee during stair-ascent. J Biomech 2011, 44:1182-1188.
5. Weinland D., Ronfard R., Boyer E. A survey of vision-based methods for action representation, segmentation and recognition. Comput Vision Image Understanding 2011, 115:224-241.
6. Yang S.X.M., Christiansen M.S., Larsen P.K., Alkjær T., Moeslund T.B., Simonsen E.B., Lynnerup N. Markerless motion capture systems for tracking of persons in forensic biomechanics: an overview. Comput Methods Biomech Biomed Eng: Imaging Visual 2013, 2:46-65.
7. Holte M.B., Tran C., Trivedi M.M., Moeslund T.B. Human pose estimation and activity recognition from multi-view videos: comparative explorations of recent developments. IEEE J Sel Top Signal Process 2012, 6:538-552.
8. Moeslund T.B., Hilton A., Krüger V., Sigal L. Visual analysis of humans: looking at people 2011, Springer, London.
9. Poppe R. Vision-based human motion analysis: an overview. Comput Vision Image Understanding 2007, 108:4-18.
10. Xiaofei J., Honghai L. Advances in view-invariant human motion analysis: a review. IEEE Trans Syst Man Cybern C Appl Rev 2010, 40:13-24.
11. Straka M., Hauswiesner S., Rüther M., Bischof H. Simultaneous shape and pose adaption of articulated models using linear optimization. Lect Notes Comput Sci 2012, 7572:724-737. (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics).
12. Kakadiaris I., Metaxas D. Model-based estimation of 3D human motion. IEEE Trans Pattern Anal Mach Intell 2000, 22:1453-1459.
13. Kakadiaris I.A., Metaxas D. 3D human body model acquisition from multiple views. Proceedings of the fifth international conference on computer vision 1995, 618-623.
14. Gall J., Potthoff J., Schnörr C., Rosenhahn B., Seidel H.-P. Interacting and annealing particle filters: mathematics and a recipe for applications. J Math Imaging Vis 2007, 28:1-18.
15. Ariyanto G., Nixon M.S. Marionette mass-spring model for 3D gait biometrics. 5th IAPR International Conference on Biometrics (ICB) 2012, 354-359.
16. Gall J., Rosenhahn B., Brox T., Seidel H.-P. Optimization and filtering for human motion capture. Int J Comput Vision 2010, 87:75-92.
17. Gall J., Stoll C., de Aguiar E., Theobalt C., Rosenhahn B. Seidel HP. Motion capture using joint skeleton tracking and surface estimation. IEEE conference on computer vision & pattern recognition (CVPR) 2009, 1746-1753.
18. Liu Y., Stoll C., Gall J., Seidel H.-P., Theobalt C. Markerless motion capture of interacting characters using multi-view image segmentation. IEEE conference on computer vision & pattern recognition (CVPR) 2011, 1249-1256.
19. Chen J., Wu X., Wang M., Deng F. Human body shape and motion tracking by hierarchical weighted ICP 2011, 408-417. Springer, Berlin/Heidelberg. G. Bebis, R. Boyle, B. Parvin, D. Koracin, S. Wang, K. Kyungnam (Eds.).
20. Wu D., Liu Y., Ihrke I., Dai Q., Theobalt C. Performance capture of high-speed motion using staggered multi-view recording. Comput Graphics Forum 2012, 31:2019-2028.
21. Shotton J., Fitzgibbon A., Cook M., Sharp T., Finocchio M., Moore R., Kipman A., Blake A. Real-time human pose recognition in parts from single depth images. 2011 IEEE conference on computer vision and pattern recognition (CVPR) 2011, 1297-1304.
22. Taylor J., Sharp T., Fitzgibbon A., Shotton J. The Vitruvian manifold: inferring dense correspondences for one-shot human pose estimation. Proceedings of the IEEE computer society conference on computer vision and pattern recognition 2012, 10:3-10.
23. Lligadas X., Susín A., Fernández-Baena A. Biomechanical validation of upper-body and lower-body joint movements of kinect motion capture data for rehabilitation treatments. Proceedings of the fourth international conference on intelligent networking and collaborative systems, INCoS 2012 2012, 656-661.
24. Yang S.X.M., Christiansen M.S., Larsen P.K., Alkjær T., Moeslund T.B., Simonsen E.B., Lynnerup N. Markerless motion capture systems for tracking of persons in forensic biomechanics: an overview. Comput Methods Biomech Biomed Eng: Imaging Visual 2014, 2:46-65.
25. Corazza S., Mündermann L., Chaudhari A.M., Demattio T., Cobelli C., Andriacchi T.P. A markerless motion capture system to study musculoskeletal biomechanics: visual hull and simulated annealing approach. Ann Biomed Eng 2006, 34:1019-1029.
26. Corazza S., Gambaretto E., Mündermann L., Andriacchi T.P. Automatic generation of a subject-specific model for accurate markerless motion capture and biomechanical applications. IEEE Trans Biomed Eng 2010, 57:806-812.
27. Corazza S., Mündermann L., Gambaretto E., Ferrigno G., Andriacchi T.P. Markerless motion capture through visual hull, articulated ICP and subject specific model generation. Int J Comput Vision 2010, 87:156-169.
28. Mündermann L., Corazza S., Andriacchi T. The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications. J Neuroeng Rehabil 2006, 3:6.
29. Mündermann L., Corazza S., Andriacchi T.P. Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models. 2007 IEEE conference on computer vision and pattern recognition 2007, 1-8:2550-2555.
30. Mündermann L., Corazza S., Chaudhari A.M., Andriacchi T.P., Sundaresan A., Chellappa R. Measuring human movement for biomechanical applications using markerless motion capture. Three-dimensional image capture and applications VII 2006, 6056. 60560R-60560R-10.
31. Seitz S.M., Curless B., Diebel J., Scharstein D., Szeliski R. A comparison and evaluation of multi-view stereo reconstruction algorithms. Proceedings of the IEEE computer society conference on computer vision and pattern recognition 2006, 1:519-526.
32. Furukawa Y., Ponce J. Dense 3D motion capture for human faces. IEEE conference on computer vision and pattern recognition (CVPR) 2009, 1674-1681.
33. Kun L., Qionghai D., Wenli X. Markerless shape and motion capture from multiview video sequences. IEEE Trans Circuits Syst Video Technol 2011, 21:320-334.
34. Benoit D.L., Ramsey D.K., Lamontagne M., Xu L., Wretenberg P., Renström P. Effect of skin movement artifact on knee kinematics during gait and cutting motions measured in vivo. Gait Posture 2006, 24:152-164.
35. Lucchetti L., Cappozzo A., Cappello A., Croce U.D. Assessment of non-optimal, least squares, and artefact-compensated joint kinematics estimators. J Biomech 1998, 31:31.
36. Furukawa Y., Ponce J. Accurate dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 2010, 32:1362-1376.
37. Kazhdan M., Bolitho M., Hoppe H. Poisson surface reconstruction. ACM international conference proceeding series 2006, 256:61-70.
38. Besl P.J., McKay N.D. A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell 1992, 14:239-256.
39. Vaughan C.L., Davis B.L., O'Connor J.C. Dynamics of human gait 1992, Human Kinetics Publishers, Champaign, IL.
40. Davis R.B., Ounpuu S., Tyburski D., Gage J.R. A gait analysis data collection and reduction technique. Hum Mov Sci 1991, 10:575-588.
41. Reinschmidt C., vandenBogert A.J., Lundberg A., Nigg B.M., Murphy N., Stacoff A., Stano A. Tibiofemoral and tibiocalcaneal motion during walking: external vs. skeletal markers. Gait Posture 1997, 6:98-109.
42. Cappozzo A., Catani F., Leardini A., Benedetti M.G., Croce U.Della Position and orientation in space of bones during movement: experimental artefacts. Clin Biomech 1995, 11:90-100.
43. Stagni R., Fantozzi S., Cappello A., Leardini A. Quantification of soft tissue artefact in motion analysis by combining 3D fluoroscopy and stereophotogrammetry: a study on two subjects. Clin Biomech 2005, 20:320-329.
44. Lamoreux L.W. Errors in thigh axial rotation measurements using skin mounted markers. J Biomech 1992, 25:769.
45. Peters A., Galna B., Sangeux M., Morris M., Baker R. Quantification of soft tissue artifact in lower limb human motion analysis: a systematic review. Gait Posture 2010, 31:1-8.
46. McGinley J.L., Baker R., Wolfe R., Morris M.E. The reliability of three-dimensional kinematic gait measurements: a systematic review. Gait Posture 2009, 29:360-369.
47. Wren T.A.L., Do K.P., Hara R., Rethlefsen S.A. Use of a patella marker to improve tracking of dynamic hip rotation range of motion. Gait Posture 2008, 27:530-534.