Fusion of 2d and 3d sensor data for articulated body tracking

Robotics and Autonomous Systems

Volumn 57, Issue 3, 2009, Pages 321-329

  Knoop, Steffen ^a   Vacek, Stefan ^a   Dillmann, Rüdiger ^a  

^a UNIVERSITY OF KARLSRUHE   (Germany)

Author keywords

3D body model; Human motion capture; Human robot interaction; Sensor fusion; Time of flight

Indexed keywords

CAMERAS; INDUCTIVELY COUPLED PLASMA; MAN MACHINE SYSTEMS; MECHANICS; NEGATIVE IONS; ROBOTICS; ROBOTS; SENSOR DATA FUSION; SENSORS;

3D BODY MODEL; HUMAN MOTION CAPTURE; HUMAN ROBOT INTERACTION; SENSOR FUSION; TIME-OF-FLIGHT;

THREE DIMENSIONAL;

EID: 59249105687     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2008.10.017     Document Type: Article

References (27)

1. M. Ehrenmann, R. Zöllner, O. Rogalla, S. Vacek, R. Dillmann, Observation in programming by demonstration: Training and execution environment, in: Proceedings of Third IEEE International Conference on Humanoid Robots, October 2003, Karlsruhe, Karlsruhe and Munich, Germany, 2003. [Online]. Available: http://www.iaim.ira.uka.de/index.php/site/files/liste_veroeffentlichungen/1095668130/humanoids2003llncsFinal.pdf
2. S. Calinon, A. Billard, Recognition and reproduction of gestures using a probabilistic framework combining pca, ica and hmm, in: Proceedings of the International Conference on Machine Learning (ICML), Bonn, Germany, 2005
3. Fritsch J., Kleinehagenbrock M., Lang S., Plötz T., Fink G.A., and Sagerer G. Multi-modal anchoring for human-robot-interaction. Robotics and Autonomous Systems 43 2-3 (2003) 133-147 Special issue on Anchoring Symbols to Sensor Data in Single and Multiple Robot Systems
4. J. Deutscher, A. Blake, I. Reid, Articulated body motion capture by annealed particle filtering, in: Computer Vision and Pattern Recognition (CVPR), Hilton Head, USA, 2000, pp. 2126-2133
5. Aggarwal J.K., and Cai Q. Human motion analysis: A review. Computer Vision and Image Understanding: CVIU 73 3 (1999) 428-440. http://www.citeseer.ist.psu.edu/aggarwal99human.html
6. Gavrila D.M. The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73 1 (1999) 82-98
7. Moeslund T.B., and Granum E. A survey of computer vision-based human motion capture. Computer Vision and Image Understanding 81 3 (2001) 231-268
8. Wang L., Hu W., and Tan T. Recent developments in human motion analysis. Pattern Recognition 36 3 (2003) 585-601. http://www.nlpr-web.ia.ac.cn/english/irds/papers/wangliang/PR%20.pdf
9. J. Fritsch, S. Lang, M. Kleinehagenbrock, G.A. Fink, G. Sagerer, Improving adaptive skin color segmentation by incorporating results from face detection, in: Proc. IEEE Int. Workshop on Robot and Human Interactive Communication (ROMAN), IEEE, Berlin, Germany, 2002, pp. 337-343
10. Bobick A.F., and Davis J.W. The recognition of human movement using temporal templates. IEEE Transactions on Pattern Analysis and Machine Intelligence 3 (2001) 257-267. http://www.citeseer.ist.psu.edu/bobick01recognition.html
11. D. Ramanan, D.A. Forsyth, Finding and tracking people from the bottom up, in: Computer Vision and Pattern Recognition, vol. 2, 18-20 June, 2003, pp. II-467-II-474
12. H. Sidenbladh, Probabilistic tracking and reconstruction of 3d human motion in monocular video sequences, Ph.D. Thesis, KTH, Stockholm, Sweden (2001)
13. G.K.M. Cheung, S. Baker, T. Kanade, Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture, in: Computer Vision and Pattern Recognition, 2003
14. P. Azad, A. Ude, R. Dillmann, G. Cheng, A full body human motion capture system using particle filtering and on-the-fly edge detection, in: Proceedings of the IEEE-RAS/RSJ International Conference on Humanoid Robots, IEEE Institute of Electrical and Electronics Engineers, Santa Monica, USA, 2004
15. D. Demirdjian, T. Darrell, 3-D articulated pose tracking to untethered deictic references, in: Multimodel Interfaces, 2002, pp. 267-272
16. D. Demirdjian, Enforcing constraints for human body tracking, in: 2003 Conference on Computer Vision and Pattern Recognition Workshop Vol. 9, Madison, Wisconsin, USA, 2003, pp. 102-109
17. Humanoid Animation Working Group, Information technology-Computer graphics and image processing-Humanoid animation (H-Anim), Annex B, Specification, ISO/IEC FCD 19774 - Humanoid Animation (2003). http://www.h-anim.org/
18. S. Knoop, S. Vacek, R. Dillmann, Modeling Joint Constraints for an Articulated 3D Human Body Model with Artificial Correspondences in ICP, in: Proceedings of the International Conference on Humanoid Robots (Humanoids 2005), IEEE-RAS, Tsukuba, Japan, 2005
19. S. Knoop, S. Vacek, R. Dillmann, Sensor fusion for 3d human body tracking with an articulated 3d body model, in: Proceedings of the 2006 IEEE International Conference on Robotics and Automation (ICRA), Orlando, Florida, 2006
20. S. Knoop, S. Vacek, K. Steinbach, R. Dillmann, Sensor fusion for model based 3d tracking, in: Proceedings of the IEEE International Conference on Multi Sensor Fusion and Integration (MFI), 2006
21. Besl P.J., and McKay N.D. A method for registration of 3-d shapes. IEEE Transactions on pattern analysis and machine intelligence 14 2 (1992) 239-256
22. Horn B.K.P. Closed-form solution of absolute orientation using unit quaternions. Optical Society of America Journal A 4 (1987) 629-642
23. P. Viola, M. Jones, Rapid object detection using a boosted cascade of simple features, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2001. http://citeseer.ist.psu.edu/viola01rapid.html
24. J. Yang, W. Lu, A. Waibel, Skin-color modeling and adaptation, in: Proceedings of ACCV, Hong Kong, vol. 2, 1998, pp. 687-694
25. Bradski G.R. Computer video face tracking for use in a perceptual user interface. Intel Technology Journal 2 (1998)
26. C. Tomasi, T. Kanade, Shape and motion from image streams: A factorization method, Technical Report CMU-CS-91-132, CMU (1991)
27. C. Harris, M. Stephens, A combined corner and edge detector, in: Proc. 4th Alvey Vision Conf., 1988, pp. 189-192