A novel sensing and data fusion system for 3-D arm motion tracking in telerehabilitation

IEEE Transactions on Instrumentation and Measurement

Volumn 57, Issue 5, 2008, Pages 1029-1040

  Tao, Yaqin ^a   Hu, Huosheng ^a  

^a UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

3 D arm motion tracking; Biomedical measurements; Particle filter (PF); Sensor fusion; Telerehabilitation; Upper limb pose estimation

Indexed keywords

ALGORITHMS; BIOMEDICAL ENGINEERING; COMPUTER SIMULATION; MOTION CONTROL; MOTION ESTIMATION; STATE SPACE METHODS;

PARTICLE FILTER; TELEREHABILITATION;

DATA FUSION;

EID: 42549133925     PISSN: 00189456     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIM.2007.913828     Document Type: Article

References (38)

1. L. Wang, W. Hu, and T. Tan, "Recent developments in human motion analysis," J. Pattern Recognit., vol. 36, no. 3, pp. 585-601, Mar. 2003.
2. T. Moeslund and E. Granum, "A survey of computer vision-based human motion capture," J. Comput. Vis. Image Underst., vol. 81, no. 3, pp. 231-268, Mar. 2001.
3. D. M. Gavrila, "The visual analysis of human movement: A survey," J. Comput. Vis. Image Underst., vol. 73, no. 1, pp. 82-98, Jan. 1999.
4. J. K. Aggarwal and Q. Cai, "Human motion analysis: A review," J. Comput. Vis. Image Underst., vol. 73, no. 3, pp. 428-440, Mar. 1999.
5. C. Sminchisescu, "Estimation algorithms for ambiguous visual models 3D human modelling and motion reconstruction in monocular video sequences," Ph.D. dissertation, Inst. Nat. Politechnique de Grenoble (INRIA), Grenoble, France, Jul. 2002.
6. C. Sminchisescu and B. Triggs, "Covariance scaled sampling for monocular 3D body tracking," in Proc. Int. Cont. Comput. Vis. Pattern Recog., Dec. 9-14, 2001, pp. 447-454.
7. H. Sidenbladh, M. Black, and D. Fleet, "Stochastic tracking of 3D human figures using 2D image motion," in Proc. Eur. Conf. Comput. Vis., D. Vernon, Ed. Dublin, Ireland: Springer-Verlag, Jun. 2000, vol. 1843, pp. 702-718.
8. P. Prez, J. Vermaak, and A. Blake, "Data fusion for visual tracking with particles," Proc. IEEE, vol. 92, no. 3, pp. 495-513, Mar. 2004.
9. S. C. Thomopoulos and L. Nillson, "3-D motion tracking using stereo camera and range radar," in Proc. SPIE - Sensing Reconstruction Three-Dimensional Objects Scenes, B. Girod, Ed., Jan. 1990, vol. 1260, pp. 21-35.
10. D. Strelow and S. Singh, "Motion estimation from image and inertial measurements," Int. J. Robot. Res., vol. 23, no. 12, pp. 1157-1195, Dec. 1, 2004.
11. E. Foxlin, Y. Altshuler, L. Naimark, and M. Harrington, "FlightTracker: A novel optical/inertial tracker for cockpit enhanced vision," in Proc. IEEE/ACM ISMAR, Washington, DC, Nov. 2-5, 2004, pp. 212-221.
12. L. Chai, W. A. Hoff, and T. Vincent, "Three-dimensional motion and structure estimation using inertial sensors and computer vision for augmented reality," Presence: Teleoperators Virtual Environ., vol. 11, no. 5, pp. 474-492, Oct. 2002.
13. P. Lang, M. Ribo, and A. Pinz, "A new combination of vision-based and inertial tracking for fully mobile, wearable and real-time operation," in Proc. 26th Workshop GM/AAPR, Graz, Austria, Sep. 2002, vol. 160, pp. 141-148.
14. S. You and U. Neumann, "Fusion of vision and gyro tracking for robust augmented reality registration," in Proc. IEEE Virtual Reality, Yokohama, Japan, Mar. 2001, pp. 71-78.
15. Y. Tao, H. Hu, and H. Zhou, "Integration of vision and inertial sensors for home-based rehabilitation," in Proc. IEEE 2nd Workshop InerVis ICRA, Apr. 18, 2005.
16. H. Zhou and H. Hu, "Inertial motion tracking of human arm movements in stroke rehabilitation," in Proc. IEEE Int. Conf. Mechatronics Autom. Niagara Falls, ON, Canada, Jul. 29-Aug. 1, 2005, pp. 1306-1311.
17. M. Isard and A. Blake, "CONDENSATION - Conditional density propagation for visual tracking," Int. J. Comput. Vis., vol. 29, no. 1, pp. 5-28, Aug. 1998.
18. M. Isard and A. Blake, "ICONDENSATION: Unifying low-level and high-level tracking in a stochastic framework," in Proc. Eur. Conf. Comput. Vis., 1998, pp. 893-908.
19. T. B. Moeslund and E. Granum, "Bootstrapping sequential Monte Carlo tracking," in Proc. Scandinavian Conf. Image Anal., Goteborg, Sweden, Jun. 2003, pp. 1030-1037.
20. T. B. Moeslund and E. Granum, "Sequential Monte Carlo tracking of body parameters in a sub-space," in Proc. Int. Workshop Anal. Model. Faces Gestures, Nice, France, Oct. 2003, pp. 84-91.
21. S. Zhou, V. Krueger, and R. Chellappa, "Face recognition from video: A CONDENSATION approach," in Proc. Int. Conf. Autom. Face Gesture Recog., Washington, DC, May 20-21, 2002, pp. 212-217.
22. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174-188, Feb. 2002.
23. R. Douc, O. Cappé, and E. Moulines, "Comparison of resampling schemes for particle filtering," in Proc. 4th Int. Symp. Image Signal Process. Anal., 2005, pp. 64-69.
24. J. Deutscher, A. Blake, and I. Reid, "Articulated body motion capture by annealed particle filtering," in Proc. Int. Conf. Comput. Vis. Pattern Recog., Hilton Head Island, SC, Jun. 13-15, 2000, pp. 126-133.
25. A. Doucet, S. Godsill, and C. Andrieu, "On sequential Monte Carlo sampling methods for Bayesian filtering," Dept. Eng., Cambridge Univ., Cambridge, U.K., Tech. Rep. CUED/F-INFENG/TR. 310, 1998.
26. F. Gustafsson, F. Gunnarsson, N. Bergman, U. Forssell, J. Jansson, R. Karlsson, and P. J. Nordlund, "Particle filters for positioning, navigation and tracking," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 425-437, Feb. 2002.
27. N. Gordon, D. Salmond, and A. Smith, "Novel approach to nonlinear/ non-Gaussian Bayesian state estimation," Proc. Inst. Electr. Eng. F vol. 140, no. 2, pp. 107-113, Apr. 1993.
28. L. Goncalves, E. Di Bernardo, E. Ursella, and P. Perona, "Monocular tracking of the human arm in 3D," in Proc. ICCV, 1995, pp. 764-770.
29. T. B. Moeslund and E. Granum, "3D human pose estimation using 2D-data and an alternative phase space representation," in Proc. Workshop Human Model., Anal. Synthesis CVPR, 2000, pp. 26-33.
30. G. R. Bradski, "Computer vision face tracking for use in a perceptual user interface," Intel Technol. J., vol. 2, 1998.
31. GENTLE/S: Robotic assistance in neuro and motor rehabilitation, Mar. 2006. [Online]. Available: http://www.gentle.rdg.ac.uk/
32. Rehabworks, Jan. 2007. [Online]. Available: http://rehabworks.ksc.nasa. gov/education/protocols/basicshoulder.php
33. P. D. Moral and L. Miclo, "Branching and interacting particle systems approximations of Feynman-Kac formulae with applications to non-linear filtering," in Séminaire de Probabilités XXXIV, vol. 1729, J. Azéma, M. Emery, M. Ledoux, and M. Yor, Eds. Berlin, Germany: Springer-Verlag, 2000, pp. 1-145.
34. P. D. Moral and P. M. Ledoux, "On the convergence and the applications of empirical processes for interacting particle systems and nonlinear filtering," J. Theor. Probab., vol. 13, no. 1, pp. 225-257, 2000.
35. D. Crisan and A. Doucet, "A survey of convergence results on particle filtering methods for practitioners," IEEE Trans. Signal Process. vol. 50, no. 3, pp. 736-746, Mar. 2002.
36. Y. Tao and H. Hu, "3D arm motion tracking for home-based rehabilitation," in Proc. 3rd CWUAAT, Cambridge, U.K., Apr. 10-12, 2006.
37. Sequential Monte Carlo Method's Homepage, Jul. 2007. [Online]. Available: http://www-sigproc.eng.cam.ac.uk/smc/
38. XSENS. [Online]. Available: http://www.xsens.com/