A collaborative telerobotics network framework with hand gesture interface and conflict prevention

International Journal of Production Research

Volumn 51, Issue 15, 2013, Pages 4443-4463

  Zhong, Hao ^a   Wachs, Juan P ^a   Nof, Shimon Y ^a  

^a SCHOOL OF INDUSTRIAL ENGINEERING   (United States)

Author keywords

collaborative intelligence; collaborative telerobotics; computer vision; conflict and error prevention; gesture recognition

Indexed keywords

COLLABORATION PROTOCOLS; COLLABORATIVE CONTROL; COLLABORATIVE INTELLIGENCE; COMPUTER VISION ALGORITHMS; ERROR PREVENTION; HAND-GESTURE RECOGNITION; NUCLEAR DECOMMISSIONING; TELE-ROBOTICS;

COMPUTER VISION; GESTURE RECOGNITION; INDUSTRIAL ROBOTS; WEARABLE COMPUTERS;

ROBOTICS;

EID: 84882456785     PISSN: 00207543     EISSN: 1366588X     Source Type: Journal    
DOI: 10.1080/00207543.2012.756591     Document Type: Article

References (48)

1. Andriluka, M., Roth, S., and, Schiele, B. 2009. Pictorial Structures Revisited: People Detection and Articulated Pose Estimation. 2009 IEEE Conference on Computer Vision and Pattern Recognition,: 1014-1021.
2. Bakari, M. J., Zied, K. M., and, Seward. 2007. D. W. Development of a Multi-Arm Mobile Robot for Nuclear Decommissioning Tasks. International Journal of Advanced Robotic Systems, 4 (4): 387-406.
3. Basanez, L., and, Suarez, R. 2009. " Teleoperation ". In Springer Handbook of Automation, Edited by: Nof, S. Y. 449-468. New York, NY: Springer.
4. Belongie, S., Malik, J., and, Puzicha, J. 2002. Shape Matching and Object Recognition Using Shape Contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24 (24): 509-522.
5. Bilmes, J. A. 1998. "A Gentle Tutorial of the Em Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models," Technical Report TR-97-021, International Computer Science Institute and Computer Science Division, University of California at Berkeley.
6. Bocaniala, C. D., and, Sa da Costa, J. 2006. " Causal Models for Distributed Fault Diagnosis of Complex Systems ". In Computational Intelligence in Fault Diagnosis, Edited by: Palade, V., Bocaniala, C. D. and Jain, L. 335-356. New York, NY: Springer.
7. Chen, Q., Georganas, N. D., and, Petriu, E. M. 2008. Hand Gesture Recognition Using Haar-like Features and a Stochastic Content-Free Gramma. IEEE Transactions on Instrumentation and Measurement, 57 (8): 1562-1571.
8. Chen, X. W., and, Nof, S. Y. 2007. Error Detection and Prediction Algorithms: Application in Robotics. Journal of Intelligent & Robotic Systems, 48: 225-252.
9. Chen, X. W., and, Nof, S. Y. 2010. A Decentralized Conflict and Error Detection and Prediction Model. International Journal of Production Research, 48 (16): 4829-4843.
10. Chong, N. Y., Kawabata, S., Ohba, K. 2002. Multioperator Teleoperation of Multirobot Systems with Time Delay: Part I-Aids for Collision-Free Control. Presence: Teleoperators and Virtual Environments, 11 (3): 277-291.
11. Chong, N. Y., Kotoku, T., Ohba, K. 2000. Development of a Multi-Telerobot System for Remote Collaboration. IEEE International Conference on Intelligent Robots and Systems, 2: 1002-1007.
12. Dalal, N., and, Triggs, B. 2005. Histogram of Oriented Gradients for Human Detection. Proceedings of IEEE International Conference on Computer Vision Pattern Recognition, I: 886-893.
13. Dalton, B. 2001. " Techniques for web telerobotics." Thesis (Doctor of Philosophy), University of Western Australia.
14. Domingues, C., S. Otmane, F. Davene. et al. 2009. "A Distributed Architecture for Collaborative Teleoperation using Virtual Reality and Web Platforms." 6th Annual IEEE Consumer Communications & Networking Conference.
15. Felzenszwalb, P. F., Girshick, R. B., McAllester, D. 2010. Object Detection with Discriminatively Trained Part Based Models. IEEE Pattern Analysis and Machine Intelligence, 32 (9): 1627-1645.
16. Felzenszwalb, P. F., and, Huttenlocher, D. P. 2005. Pictorial Structures for Object Recognition. International Journal of Computer Vision, 61 (1): 55-79.
17. Ferrell, W. R., and, Sheridan, T. B. 1967. Supervisory Control of Remote Manipulation. IEEE Spectrum, 4 (10): 81-88.
18. Garcia, P. 2011. " Telemedicine for the Battlefield: Present and Future Technologies ". In Surgical Robotics: Systems Applications and Visions, Edited by: Rosen, J. 33-68. New York: Springer.
19. Goldberg, K., Chen, B., Solomon, R. 2000. Collaborative Teleoperation via the Internet. International Conference on Robotics and Automation, 2: 2019-2024.
20. Goldberg, K., Song, D., and, Levandowski, A. 2003. Collaborative Teleoperation Using Networked Spatial Dynamic Voting. Proceedings of IEEE Special Issue on Networked Robots, 91 (3): 430-439.
21. Hassanpour, R., Wong, S., and, Shahbahrami, A. 2008. Vision-Based Hand Gesture Recognition for Human Computer Interaction: a Review. MCCSIS Proceedings of Interfaces and Human Computer Interaction,: 125-131.
22. Hokayem, P. F., and, Spong, M. W. 2006. Bilateral Teleoperation: an Historical Survey. Automatica, 42 (12): 2035-2057.
23. Huang, J., Arkin, R. C., and, Kwon, D. 2003. Mobile Robots at Your Fingertips: Bezier Curve on-Line Trajectory Generator for Supervisory Control. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems
24. Kim, K., Chalidabhongse, T. H., Harwood, D. 2005. Real-Time Foreground-Background Segmentation Using Codebook Model. Real-Time Imaging, 11 (3): 172-185.
25. King, J., Pretty, R., and, Brothers, B. 2003. The Tele-Robotic Management System: Coordinating Multiple Human Operators with Multiple Robots. Proceedings of SPIE International Society of Optics and Photonics, 5083: 462-471.
26. Ko, H. S., and, Nof, S. Y. 2012. Design and Application of Task Administration Protocols for Collaborative Production and Service Systems. International Journal of Production Economics, 135: 177-189.
27. Lee, D. J., and, Spong, M. W. 2005. Bilateral Teleoperation of Multiple Cooperative Robots over Delayed Communication Networks: Theory. Proceedings of IEEE International Conference on Robotics and Automation,: 360-365.
28. Lionnie, R., Timotius, I. K., and, Setyawan, I. 2011. An Analysis of Edge Detection as Feature Extractor in a Hand Gesture Recognition System Based on Nearest Neighbor. International Conference of Electrical Engineering and Informatics
29. McMillan, G. R. 1998. The Technology and Applications of Gesture-Based Control. Alternative Control Technologies: Human Factors Issues, 4: 1-11.
30. Miller, G. A. 2001. The Magical Number Seven, plus or minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review, 63 (2): 81-97.
31. Nof, S. Y. 2003. Design of Effective E-Work: Review of Models, Tools, and Emerging Challenges. Production Planning and Control, 14 (8): 681-703.
32. Nof, S. Y. 2006. Collaborative E-Work and E-Manufacturing: Challenges for Production and Logistics Managers. Journal of Intelligent Manufacturing, 17: 689-701.
33. Nof, S. Y. 2007. Collaborative Control Theory for E-Work, E-Production, and E-Service. Annual Reviews in Control, 31: 281-292.
34. Nudehi, S. S., Mukherjee, R., and, Ghodoussi, M. 2005. A Shared-Control Approach to Haptic Interface Design for Minimally Invasive Telesurgical Training. IEEE Transactions on Control Systems Technology, 13 (4): 588-592.
35. Sabatini, A. M., Genovese, V., and, Maini, E. S. 2002. Toward Low-Cost Vision-Based 2D Localization Systems for Applications in Rehabilitation Robotics. Proceedings of IEEE International Conference on Intelligent Robots and Systems,: 1355-1360.
36. Sheridan, T. B. 1989. Telerobotics. Automatica, 25 (4): 487-507.
37. Song, D., and, Goldberg, K. Y. 2007. Approximated Algorithms for a Collaborative Controlled Robotic Camera. IEEE Transactions on Robotics, 23 (5): 1061-1070.
38. Song, D., Goldberg, K., and, Chong, N. Y. 2008. " Networked Telerobots ". In Springer Handbook of Robotics, Edited by: Siciliano, B. and Khatib, O. 759-771. Berlin: Springer.
39. Passenberg, C., Peer, A., and, Buss, M. 2010. Model-Mediated Teleoperation for Multi-Operator Multi-Robot Systems. IEEE International Conference on Intelligent Robots and Systems,: 4263-4268.
40. Pavlovic, V. I., Sharma, R., and, Huang, T. S. 1997. Visual Interpretation of Hand Gestures for Human-Computer Interface: a Review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19 (7): 677-695.
41. Pettersson, O. 2005. Execution Monitoring in Robotics: a Survey. Robotics and Autonomous Systems, 53: 73-88.
42. Porikli, F. 2005. Integral Histogram: a Fast Way to Extract Histograms in Cartesian Spaces. Proceedings IEEE Conference on Computer Vision Pattern Recognition, 2005: 829-836.
43. Porta, M. 2002. Vision-Based User Interfaces: Methods and Applications. International Journal of Human-Computer Studies, 57: 27-73.
44. Wachs, J. P., Kölsch, M., Stern, H. 2011. Vision-Based Hand Gesture Applications. Communications of the ACM, 54 (2): 60-71.
45. Wachs, J. P., Stern, H., and, Edan, Y. 2005. Cluster Labeling and Parameter Estimation for the Automated Setup of a Hand-Gesture Recognition System. IEEE Transactions on Systems, Man, and Cybernetics Part a: Systems and Humans, 35 (6): 932-944.
46. Wachs, J., Stern, H., Edan, Y. 2008. Real-Time Hand Gesture Interface for Browsing Medical Image. International Journal of Intelligent Computing in Medical Sciences and Image Processing, 1 (3): 175-185.
47. Wang, X., Moallem, M., and, Patel, R. V. 2003. An Internet-Based Distributed Multiple-Telerobot System. IEEE Transactions on Systems, Man, and Cybernetics Part a: Systems and Humans, 33 (5): 627-633.
48. Zhong, H. 2012, "HUB-based Telerobotics." Thesis (Master of Science), Purdue University.