Robot-manipulator teleoperation by markerless vision-based hand-arm tracking

International Journal of Optomechatronics

Volumn 1, Issue 3, 2007, Pages 331-357

  Kofman, Jonathan ^a,b   Verma, Siddharth ^b,c  

^a UNIVERSITY OF WATERLOO   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

^c Hispano Suiza Canada   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85009597081     PISSN: 15599612     EISSN: 15599620     Source Type: Journal    
DOI: 10.1080/15599610701580467     Document Type: Article

References (42)

1. Al-Mouhamed, Mayez A., Onur Toker, and Abdulkhalik Al-Harthy. 2005. A 3-D vision-based man-machine interface for hand-controlled telerobot. IEEE Transactions on Industrial Electronics 52(1):306-319.
2. Bachmann, Eric R., Robert B. McGhee, Xiaoping Yun, and Michael J. Zyda. 2001. Inertial and magnetic posture tracking for inserting humans into networked virtual environments. ACM Symposium on Virtual Reality Software and Technology (VRST), Banff, Canada, 9-16.
3. Borghese, N. Alberto and Paolo Rigiroli. 2002. Tracking densely moving markers. IEEE First International Symposium on 3D Data Processing and Transmission, Padova Giugno, 682-685.
4. Boult, Terry E., R. Micheals, A. Erkan, P. Lewis, C. Powers, C. Qian, and W. Yin. 1998. Frame-rate multi-body tracking for surveillance. Proceedings of DARPA IUW, 305-308.
5. Bullock, Dave J. and John S. Zelek. 2004. Real-time tracking for visual interface applications in cluttered and occluding situations. Image and Vision Computing 22:1083-1091.
6. Bullock, Dave and John Zelek. 2005. Towards real-time 3-D monocular visual tracking of human limbs in unconstrained environments. Real-Time Imaging 11:323-353.
7. Cai, Q. and J. K. Aggarwal. 1999. Tracking human motion in structured environments using a distributed-camera System. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(11):1241-1247.
8. Chang, S., J. Kim, I. Kim, J. H. Borm, and C. Lee. 1999. KIST teleoperation system for humanoid robot. Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems, 1198-1203.
9. Chang, Jae Sik, Eun Yi Kim, Kee Chul Jung, and Hang Joon Kim. 2005. Real time hand tracking based on active contour model. International Conference on Computational Sciences and its Application, 999-1006.
10. Chaudhari, Ajit M., R. W. Bragg, E. J. Alexander, and Thomas P. Andriacchi. 2001. A videobased markerless motion tracking system for biomechanical analysis in an arbitrary environment. BED-50 Bioengineering Conference, 777-778.
11. Cipolla, Roberto and Nicholas J. Hollinghurst. 1996. Human-robot interface by pointing with uncalibrated stereo vision. Image and Vision Computing 14:171-178.
12. Coquin, Didier, E. Benoit, H. Sawada, and Bogdan Ionescu. 2005. Fusion of hand and arm gestures. In Optomechatronic Machine Vision, ed. by K. Sumi, Proceedings International Society for Optical Engineering (SPIE) 6051, 60510E, 1-11.
13. Cui, J., Sabri Tosunoglu, R. Roberts, C. Moore, and Daniel W. Repperger. 2003. A review of teleoperation system control. Proceedings Florida Conference on Recent Advances in Robotics, FCRAR, Boca Raton, FA.
14. Fong, Terrence, Francois Conti, Sebastien Grange, and Charles Baur. 2000. Novel interfaces for remote driving: gesture, haptic and PDA. SPIE Telemanipulator & Telepresence Technologies Vol VII 4195:300-311.
15. Goncalves, Luis, Enrico Di Bernardo, Enrico Ursella, and Pietro Perona. 1995. Monocular tracking of the human arm in 3D. Proceedings of IEEE International Conference on Computer Vision, ICCV 95, 764-770.
16. Harada, Tatsuya, Tomomasa Sato, and Taketoshi Mori. 2000. Human motion tracking system based on skeleton and surface integration model using pressure sensors distribution bed. Workshop on Human Motion (HUMO’00), 99-106.
17. Hu, Chao, Max Qinghu Meng, Peter Xiaoping Liu, and Xiang Wang. 2003. Visual gesture recognition for human-machine interface of robot teleoperation. IEEE/RSJ International Conference on Intelligent Robots and Systems, USA, 1560-1565.
18. Hu, Haiying, Jiawei Li, Zongwu Xie, Bin Wang, Hong Liu, and Gerd Hirzinger. 2005. A robot arm/hand teleoperation system with telepresence and shared control. Proceedings IEEE/ASME International Conference on Advanced Intelligent Mechatronics, 1312-1317.
19. Hugli, H., G. Maitre, F. Tieche, and C. Facchinetti. 1992. Vision-based behaviours for robot navigation. Proceedings of the Fourth Annual SGAICO Meeting, Neuchatel, Switzerland.
20. Ionescu, Bogdan, Didier Coquin, Patrick Lambert, and Vasile Buzuloiu. 2005. Dynamic hand gesture recognition using the skeleton of the hand. Journal on Applied Signal Processing 13:2101-2109.
21. Kakadiaris, Ioannis A. and Dimitri Metaxas. 1995. 3D human body model acquisition from multiple views. Proceedings of IEEE Fifth International Conference on Computer Vision, 618-623.
22. Kakadiaris, Ioannis A. and Dimitri Metaxas. 2000. Model-based estimation of 3D human motion. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12): 1453-1459.
23. Kakadiaris, Ioannis A., Dimitri Metaxas, and Ruzena Bajcsy. 1994a. Active part-decomposition, shape and motion estimation of articulated objects: a physics-based approach. Proceeding of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 980-984.
24. Kakadiaris, Ioannis A., Dimitri Metaxas, and Ruzena Bajcsy. 1994b. Active motion-based segmentation of human body outlines. Proceedings of Workshop on Motion of NonRigid and Articulated Objects, 50-56.
25. Koara, Kengo, Atsushi Nishikawa, and Fumio Miyazaki. 2000. Hierarchical part decomposition method of articulated body contour, and its application to human body motion measurement. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2000), 2055-2060.
26. Koara, Kengo, Atsushi Nishikawa, and Fumio Miyazaki. 2001. Contour based hierarchical part decomposition method for human body motion analysis from video sequence. In Human Friendly Mechatronics. Ed. by E. Arai, T. Arai, and M. Takano, Elsevier Science.
27. Kofman, Jonathan, Xianghai Wu, Timothy Luu, and Siddharth Verma. 2005. Teleoperation of a robot manipulator using a vision-based human-robot interface. IEEE Transactions on Industrial Electronics 52(5):1206-1219.
28. Kurpjuhn, Tobias Peter, Kevin Nickels, Alexa Hauck, and Seth Hutchinson. 1999. Development of a visual space-mouse. Proc. Int. Conf. Robotics and Automation (ICRA) 3230-3235.
29. Lathuiliere, Fabienne and Jean-Yves Herve. 2000. Visual hand posture tracking in a gripper guiding application. Proc. Int. Conf. Robotics and Automation (ICRA) 1688-1694.
30. MacCormick, John and Michael Isard. 2000. Partitioned sampling, articulated objects, and interface-quality hand tracking. Proceeding of European Conference on Computer Vision 2:3-19.
31. Moy, Milyn C. 1999. Gesture-based interaction with a pet robot. Proceedings of 6th National Conference on Artificial Intelligence and 11th Conference on Innovative Applications of Artificial Intelligence, USA, 628-633.
32. Perie, D., A. J. Tate, P. L. Cheng, and G. A. Dumas. 2002. Evaluation and calibration of an electromagnetic tracking device for biomechanical analysis of lifting tasks. Journal of Biomechanics 35(2):293-297.
33. Peters, Christopher and Carol O’Sullivan. 2002. Vision-based reaching for autonomous virtual humans. Proceedings of AISB02 symposium: Animating Expressive Characters for Social Interactions, 69-72.
34. Postigo, Jose F., Vicente A. Mut, Ricardo O. Carelli, Luis A. Baigorria, and Benjamin R. Kuchen. 2000. Hand controller for bilateral teleoperation of robots. Robotica 18:677-686.
35. Rosales, Romer and Stan Sclaroff. 1999. 3D trajectory recovery for tracking multiple objects and trajectory guided recognition of actions. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2:117-123.
36. Rosales, Romer and Stan Sclaroff. 2000. Inferring body pose without tracking body parts. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2:721-727.
37. Tezuka, Tetsuo, Atsushi Goto, Ken-ichiro Kashiwa, Hidekazu Yoshikawa, and Ryutaro Kawano, 1994. A study on space interface for teleoperation system. IEEE International Workshop on Robot and Human Communication 62-67.
38. Tieche, Francois, Narinder Singh Ghai, and Heinz Hugli. 1996. Self-positioning and localisation of a mobile robot using vision-based behaviours. Proceedings of Mechatronics, Europe-Asia Congress on Mechatronics, Besancon, France.
39. Triesch, Jochen and Christoph von der Malsburg. 2002. A system for person-independent hand posture recognition against complex backgrounds. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(12):1449-1453.
40. Ueda, Etsuko, Yoshio Matsumoto, Masakazu Imai, and Tsukasa Ogasawara. 2001. Hand pose estimation for vision based human interface. 10th IEEE International Workshop on Robot and Human Communication (ROMAN 2001) 473-478.
41. Verma, Siddharth. 2004. Vision-based markerless 3D human-arm tracking. M.A.Sc. Thesis, Department of Mechanical Engineering, University of Ottawa, Ottawa, Canada.
42. Verplaetse, C. 1996. Inertial proprioceptive devices: self-motion-sensing toys and tools. IBM Systems Journal 35(3):639-650.