A review and framework of laser-based collaboration support

Annual Reviews in Control

Volumn 39, Issue , 2015, Pages 30-45

  Bechar, A ^a   Nof, S Y ^b   Wachs, J P ^b  

^a VOLCANI CENTER   (Israel)

^b SCHOOL OF INDUSTRIAL ENGINEERING   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LASER SAFETY; QUALITY ASSURANCE;

COLLABORATION SUPPORT; DYNAMIC ENVIRONMENTS; INTERACTING AGENTS; LASER TECHNOLOGIES; LASER-BASED TECHNOLOGIES; RESEARCH ACTIVITIES; RESEARCH GAPS; SUPPORTING TECHNOLOGY;

LASER APPLICATIONS;

EID: 84929047417     PISSN: 13675788     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.arcontrol.2015.03.003     Document Type: Conference Paper

References (108)

1. R.T. Azuma A survey of augmented reality Presence: Teleoperators and Virtual Environments 6 1997 355 385
2. Bechar, A., Wachs, J. P., & Nof, S. Y. (2012). Developing a human-robot collaborative system for precision agricultural tasks. Presented at the proceedings of the 11th ICPA, international conference on precision agriculture, Indianapolis, IN, 2012.
3. A. Bechar, J. Meyer, and Y. Edan An objective function to evaluate performance of human-robot collaboration in target recognition tasks IEEE Transactions on Systems Man and Cybernetics Part C - Applications and Reviews 39 2009 611 620
4. A. Bechar, S.Y. Nof, and J.P. Wachs Precision collaboration and advanced integration using laser systems and techniques S.Y. Nof, Laser and photonic systems 2014 CRC Press 165 200
5. N. Bellotto, and H. Hu Multisensor-based human detection and tracking for mobile service robots IEEE Transactions on Systems Man and Cybernetics Part B - Cybernetics 39 February 2009 167 181
6. J.L. Boulnois Photophysical processes in recent medical laser developments: A review Lasers in Medical Sciences 1 1986 47 66
7. Breazeal, C., Hoffman, G., & Lockerd, A. (2004). Teaching and working with robots as a collaboration. In Proceedings of the third international joint conference on autonomous agents and multiagent systems, 2004 (pp. 1030-1037).
8. T. Brogardh Present and future robot control development - An industrial perspective Annual Reviews in Control 31 2007 69 79
9. T. Brogardh Robot control overview: An industrial perspective Modeling Identification and Control 30 2009 167 180
10. Cassinelli, A., Perrin, S., & Ishikawa, M. (2005). Smart laser-scanner for 3D human-machine interface. In Proceedings of the international conference on human factors in computing systems, Portland, OR, 2005 (pp. 1138-1130).
11. A. Chavez, and H. Karstoft Improvement of kinect (TM) sensor capabilities by fusion with laser sensing data using octree Sensors 12 April 2012 3868 3878
12. X.W. Chen, S.J. Landry, and S.Y. Nof A framework of enroute air traffic conflict detection and resolution through complex network analysis Computers in Industry 62 October-December 2011 787 794
13. K.B. Cho, and B.H. Lee Intelligent lead: A novel HRI sensor for guide robots Sensors 12 June 2012 8301 8318
14. Chuen Leong, N., Teck Chew, N., Thi Anh Ngoc, N., Yang, G., & Chen, W. (2010). Intuitive robot tool path teaching using laser and camera in augmented reality environment. Presented at the proceedings of the 11th international conference on control, automation, robotics and vision, 2010.
15. R. Cipolla, and N.J. Hollinghurst Human-robot interface by pointing with uncalibrated stereo vision Image and Vision Computing 14 1996 171 178
16. D.L. Craig, and C. Zimring Support for collaborative design reasoning in shared virtual spaces Automation in Construction 11 February 2002 249 259
17. Cruz-Ramirez, S. R., Ishizuka, Y., Mae, Y., Takubo, T., & Arai, T. (2008). Dismantling interior facilities in buildings by human robot collaboration. In Proceedings of the 2008 IEEE international conference on robotics and automation, Pasadena, CA, 2008 (Vols. 1-9, pp. 2583-2590).
18. G.L. Du, P. Zhang, J.H. Mai, and Z.L. Li Markerless kinect-based hand tracking for robot teleoperation International Journal of Advanced Robotic Systems 9 July 2012 10
19. A.A.M. Faudzi, K. Suzumori, and S. Wakimoto Development of an intelligent chair tool system applying new intelligent pneumatic actuators Advanced Robotics 24 2010 1503 1528
20. Fruchter, R., Biswas, P., & Yin, Z. (2005). DiVAS-a cross-media system for ubiquitous gesture-discourse-sketch knowledge capture and reuse. USA patent, 2005.
21. Ghys, C., Paragios, N., & Bascle, B. (2006). Graph-based multi-resolution temporal-based face reconstruction. In Proceedings of the advances in visual computing, Pt 1, Lake Tahoe, NV, 2006 (pp. 803-812).
22. Giesler, B., Steinhaus, P., Walther, M., & Dillmann, R. (2004). Sharing skills: Using augmented reality for human-robot collaboration. In Proceedings of the SPIE, 2004 (pp. 446-453).
23. D.F. Glas, T. Miyashita, H. Ishiguro, and N. Hagita Laser-based tracking of human position and orientation using parametric shape modeling Advanced Robotics 23 2009 405 428
24. N. Glossop, C. Wedlake, J. Moore, T. Peters, and Z.H. Wang Laser projection augmented reality system for computer assisted surgery Proceedings of the Medical Image Computing and Computer-Assisted Intervention - Miccai 2003 Pt 2 2003 239 246
25. E.J. Gonzalez-Galvan, S.R. Cruz-Ramirez, M.J. Seelinger, and J.J. Cervantes-Sanchez An efficient multi-camera, multi-target scheme for the three-dimensional control of robots using uncalibrated vision Robotics and Computer-Integrated Manufacturing 19 October 2003 387 400
26. Guarnieri, M., Kurazume, R., Masuda, H., Inoh, T., Takita, K., Debenest, P., et al. (2009). HELIOS system: A team of tracked robots for special urban search and rescue operations. In Proceedings of the 2009 IEEE-RSJ international conference on intelligent robots and systems, 2009 (pp. 2795-2800).
27. Harb, M., Abielmona, R., & Petriu, E. (2009). Speed control of a mobile robot using neural networks and fuzzy logic. In Proceedings of the 2009 international joint conference on neural networks, New York, NY, 2009 (Vols. 1-6, pp. 1346-1352).
28. Ishii, H., & Kobayashi, M. (1992). Clearboard: A seamless medium for shared drawing and conversation with eye contact. In Proceedings of the conference on human factors in computing systems, 1992 (pp. 525-532).
29. Ishii, K., Zhao, S., Inami, M., Igarashi, T., & Imai, M. (2009). Designing laser gesture interface for robot control. In Proceedings of the 12th IFIP international conference on human-computer interaction, Uppsala, Sweden, 2009 (pp. 479-492).
30. Jackson, B., & Keefe, D. F. (2011). Sketching over props: Understanding and interpreting 3d sketch input relative to rapid prototype props. In Proceedings of the IUI 2011 sketch recognition workshop, 2011.
31. Jacob, M. G., Li, Y. T., & Wachs, J. P. (2011). A gesture driven robotic scrub nurse. In Proceedings of the IEEE international conference on systems, man and cybernetics, 2011 (pp. 2039-2044).
32. Jacob, M., Cange, C., Packer, R., & Wachs, J. (2012). Intention, context and gesture recognition for sterile MRI navigation in the operating room. In Proceedings of the progress in pattern recognition, image analysis, computer vision, and applications, 2012 (pp. 220-227).
33. M. Jacob, J. Wachs, and R. Packer Hand-gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images Journal of the American Medical Informatics Association 2012
34. R. Jarvis Terrain-aware path guided mobile robot teleoperation in virtual and real space Proceedings of the Third International Conference on Advances in Computer-Human Interactions: ACHI 2010 2010 56 65
35. W. Jeong, and S.Y. Nof A collaborative sensor network middleware for automated production systems Computers and Industrial Engineering 57 August 2009 106 113
36. Jiang, R., & Chen, Y. (2008). MultiRobot precise localization based on multisensor fusion. In Proceedings of the 2008 IEEE conference on robotics, automation, and mechatronics, Chengdu, China, 2008 (pp. 967-972).
37. T. Kanda, D.F. Glas, M. Shiomi, and N. Hagita Abstracting people's trajectories for social robots to proactively approach customers IEEE Transactions on Robotics 25 December 2009 1382 1396
38. Kemp, C. C., Anderson, C. D., Nguyen, A. J., & Xu, Z. (2008). A point and click interface for the real world: Laser designation of objects for mobile manipulation. Presented at the proceedings of the 3rd ACM/IEEE international conference on human-robot interaction, 2008.
39. H. Kim, G.A. Lee, U. Yang, T. Kwak, and K.H. Kim Dual autostereoscopic display platform for multi-user collaboration with natural interaction Etri Journal 34 June 2012 466 469
40. Ko, H. S., Wachs, J. P., & Nof, S. Y. (2011). Web-based facility monitoring system using wireless sensor network. Presented at the proceedings of the industrial engineering research conference, Reno, NV, 2011.
41. Kurata, T., Sakata, N., Kourogi, M., Kuzuoka, H., & Billinghurst, M. (2004). Remote collaboration using a shoulder-worn active camera/laser. In Proceedings of the 8th international symposium on wearable computers, Arlington, VA, 2004 (pp. 62-69).
42. Lee, J. C., Hudson, S. E., & Tse, E. (2008). Foldable interactive displays. In Proceedings of the 21st annual ACM symposium on user interface software and technology, 2008 (pp. 287-290).
43. Leykin, A., & Tuceryan, M. (2004). Automatic determination of text readability over textured backgrounds for augmented reality systems. In Proceedings of the third IEEE and ACM international symposium on mixed and augmented reality, 2004 (pp. 224-230).
44. Li, G., Du, J., Zhu, C., & Sheng, W. (2011). A cost-effective and open mobile sensor platform for networked surveillance. In Proceedings of the conference on signal and data processing of small targets, San Diego, CA, 2011.
45. H.C. Li, H.M. Gao, and L. Wu Teleteaching approach for sensor-based arc welding telerobotic system Industrial Robot - An International Journal 34 2007 423 429
46. L. Li The challenges ahead for laser macro, micro and nano manufacturing J. Lawerence, J. Pou, D.K.Y. Low, E. Toyserkani, Advances in laser materials processing: Technology, research and applications 2010 Woodhead Publishing Limited Cambridge 20 39
47. S.C. Liu, L. Gao, Z.W. Yin, Y.C. Shi, L. Zhang, and X.F. Chen Simple hybrid wire-wireless fiber laser sensor by direct photonic generation of beat signal Applied Optics 50 April 2011 1792 1797
48. Livatino, S., Muscato, G., De Tommaso, D., & Macaluso, M. (2010). Augmented reality stereoscopic visualization for intuitive robot Teleguide. In Proceedings of the IEEE international symposium on industrial electronics (ISIE 2010), Bari, Italy, 2010 (pp. 2828-2833).
49. M. Luber, G.D. Tipaldi, and K.O. Arras Place-dependent people tracking International Journal of Robotics Research 30 March 2011 280 293
50. Maimone, A., & Fuchs, H. (2012). Reducing interference between multiple structured light depth sensors using motion. In Proceedings of the IEEE virtual reality, 2012 (pp. 51-54).
51. Mann, S. (2000). Telepointer: Hands-free completely self contained wearable visual augmented reality without headwear and without any infrastructural reliance. In Proceedings of the 4th international symposium on wearable computers, Atlanta, GA, 2000 (pp. 177-178).
52. S. Marcos, J. Gomez-Garcia-Bermejo, and E. Zalama A realistic, virtual head for human-computer interaction Interacting with Computers 22 May 2010 176 192
53. Marins, J. L., Xiaoping, Y., Bachmann, E. R., McGhee, R. B., & Zyda, M. J. (2001). An extended Kalman filter for quaternion-based orientation estimation using MARG sensors. In Proceedings of the IEEE intelligent robots and systems, 2001 (Vol. 4, pp. 2003-2011).
54. Martinez-Otzeta, J. M., Ibarguren, A., Ansuategi, A., Tubio, C., & Aristondo, J. (2010). People following behaviour in an industrial environment using laser and stereo camera. In Proceedings of the 23rd international conference on industrial, engineering and other applications of applied intelligent systems, Cordoba, Spain, 2010 (pp. 508-517).
55. F. Mazzetto, and A. Calcante Highly automated vine cutting transplanter based on DGNSS-RTK technology integrated with hydraulic devices Computers and Electronics in Agriculture 79 October 2011 20 29
56. Mehdi, S. A., & Berns, K. (2010). Ordering of robotic navigational tasks in home environment. In Proceedings of the 13th federation-of-international-robot-soccer-association robot world congress, Bangalore, India, 2010 (pp. 242-249).
57. A. Miller, B. White, E. Charbonneau, Z. Kanzler, and J.J. LaViola Interactive 3D model acquisition and tracking of building block structures IEEE Transactions on Visualization and Computer Graphics 18 April 2012 651 659
58. K. Morioka, Y. Oinaga, and Y. Nakamura Control of human-following robot based on cooperative positioning with an intelligent space Electronics and Communications in Japan 95 January 2012 20 30
59. T.D. Myers, and J.D. McDaniel The pulsed Nd:YAG dental laser: Review of clinical applications Journal of the California Dental Association 19 1991 25 30
60. V. Naren, and V. Shaleen Towards development of a non-touch man-machine interface for intelligent presenter-audience collaborative environment ASME Conference Proceedings 2006 2006 841 849
61. Nikulin, V., Khandekar, R., Sofka, J., & Mecherle, G. S. (2006). Performance of a laser communication system with acousto-optic tracking: An experimental study. In Proceedings of SPIE, the international society for optical engineering, 2006 (pp. 61050C.1-61050C.10).
62. S.Y. Nof Design of effective e-Work: Review of models, tools, and emerging challenges Production Planning and Control 14 December 2003 681 703
63. S.Y. Nof Collaborative control theory for e-Work, e-Production, and e-Service Annual Reviews in Control 31 2007 281 292
64. S.Y. Nof, G.J. Cheng, A.M. Weiner, X.W. Chen, A. Bechar, and M.G. Jones Laser and photonic systems integration: Emerging innovations and framework for research and education Human Factors and Ergonomics in Manufacturing & Service Industries 23 2013 483 516
65. S.Y. Nof Cultural factors: Their impact in collaboration support systems and on decision quality R.W. Proctor, S.Y. Nof, Y. Yih, Cultural factors in systems design, decision making and action 2011 CRC Press
66. S.Y. Nof, A.M. Weiner, and G.J. Cheng Laser and photonic systems: Design and integration 2014 CRC Press
67. Oh, J. Y., & Stuerzlinger, W. (2002). Laser pointers as collaborative pointing devices. In Proceedings of the graphics interface 2002 conference, Calgary, Canada, 2002 (pp. 141-149).
68. Park, Y. S. (2000). Structured beam projection for semi-automatic teleoperation. In Proceedings of the conference on optomechatronic systems, Boston, MA, 2000 (pp. 192-201).
69. Perrin, S., Cassinelli, A., & Ishikawa, M. (2004). Gesture recognition using laser-based tracking system. In Proceedings of the 6th IEEE international conference on automatic face and gesture recognition, Seoul, South Korea, 2004 (pp. 541-546).
70. A. Rama, F. Tarres, and J. Rurainsky 2D-3D pose invariant face recognition system for multimedia applications M. Grgic, K. Delac, M. Ghanbari, Recent advances in multimedia signal processing and communications Vol. 231 2009 Springer Berlin 121 144
71. A.C. Ramirez-Hernandez, J.A. Rivera-Bautista, A. Marin-Hernandez, and V.A. Garcia-Vega Detection and interpretation of human walking gestures for human-robot interaction 2009 IEEE New York
72. Rogers, J., Paluri, M., Cunningham, A., Christensen, H. I., Michael, N., Kumar, V., et al. (2011). Distributed autonomous mapping of indoor environments. Presented at the proceedings of the conference on micro- and nanotechnology sensors, systems, and applications III, Orlando, FL, 2011.
73. Rongxin, J., Xiang, T., Li, X., & Yaowu, C. (2008). A robot collision avoidance scheme based on the moving obstacle motion prediction. In Proceedings of the international colloquium on computing, communication, control, and management, 2008 (pp. 341-345).
74. Rosheim, M. E., & Sauter, G. F. (2002). New high-angulation omni-directional sensor mount. In Proceedings of the free-space laser communication and laser imaging II, Seattle, WA, 2002 (pp. 163-174).
75. Sakurai, F., & Mita, A. (2011). Biofied room integrated with sensor agent robots to interact with residents and acquire environmental information. In Proceedings of the conference on sensors and smart structures technologies for civil, mechanical, and aerospace systems 2011, San Diego, CA, 2011.
76. J. Salvi, J. Pagès, and J. Batlle Pattern codification strategies in structured light systems Pattern Recognition 37 2004 827 849
77. Sareika, M., & Schmalstieg, D. (2007). Urban sketcher: Mixed reality on site for urban planning and architecture. In Proceedings of the 2007 6th IEEE and ACM international symposium on mixed and augmented reality, ISMAR, 2007 (pp. 27-30).
78. E. Sato, T. Yamaguchi, and F. Harashima Natural interface using pointing behavior for human-robot gestural interaction IEEE Transactions on Industrial Electronics 54 April 2007 1105 1112
79. F.M. Schaf, D. Muller, F.W. Bruns, C.E. Pereira, and H.H. Erbe Collaborative learning and engineering workspaces Annual Reviews in Control 33 December 2009 246 252
80. H. Seok, S.Y. Nof, and F.G. Filip Sustainability decision support system based on collaborative control theory Annual Reviews in Control 36 April 2012 85 100
81. X.M. Shan, S.K. Kuo, J.H. Zhang, and C.H. Menq Ultra precision motion control of a multiple degrees of freedom magnetic suspension stage IEEE-ASME Transactions on Mechatronics 7 March 2002 67 78
82. K. Sickel, S. Baloch, R. Melkisetoglu, V. Bubnik, S. Azernikov, and T. Fang Toward automation in hearing aid design Computer-Aided Design 43 December 2011 1793 1802
83. Silberman, N., & Fergus, R. (2011). Indoor scene segmentation using a structured light sensor. In: Proceedings of the IEEE international conference on computer vision, 2011 (pp. 601-608).
84. J. Sofka, V.V. Nikulin, V.A. Skormin, D.H. Hughes, and D.J. Legare Laser communication between mobile platforms IEEE Transactions on Aerospace and Electronic Systems 45 January 2009 336 346
85. Suzuki, T., Ohya, A., & Yuta, S. (2005). Operation direction to a mobile robot by projection lights. In Proceedings of the 2005 IEEE workshop on advanced robotics and its social impacts, 2005 (pp. 160-165).
86. Svenstrup, M., Tranberg, S., Andersen, H. J., & Bak, T. (2009). Pose estimation and adaptive robot behaviour for human-robot interaction. In Proceedings of ICRA: 2009 IEEE international conference on robotics and automation, New York, NY, 2009 (Vols. 1-7, pp. 3222-3227).
87. M. Tavakoli, G. Cabrita, R. Faria, L. Marques, and A.T. de Almeida Cooperative multi-agent mapping of three-dimensional structures for pipeline inspection applications International Journal of Robotics Research 31 October 2012 1489 1503
88. Tkach, I., Edan, Y., & Nof, S. Y. (2012). Security of supply chains by automatic multi-agents collaboration. In Proceedings of the INCOM, Bucharest, Romania, 2012.
89. F. Tsalakanidou, S. Malassiotis, and M.G. Strintzis Face localization and authentication using color and depth images IEEE Transactions on Image Processing 14 2005 152 168
90. K.-S. Tseng, and A.C.-W. Tang Self-localization and stream field based partially observable moving object tracking Eurasip Journal on Advances in Signal Processing 200 2009 12
91. J.D. Velasquez, and S.Y. Nof Best-matching protocols for assembly in e-work networks International Journal of Production Economics 122 November 2009 508 516
92. Vogt, F., Wong, J., Po, B. A., Argue, R., Fels, S. S., & Booth, K. S. (2004). Exploring collaboration with group pointer interaction. In Proceedings of the computer graphics international, 2004 (pp. 636-639).
93. J. Wachs, H. Stern, Y. Edan, M. Gillam, C. Feied, and M. Smith Gestix: A doctor-computer sterile gesture interface for dynamic environments Advances in Soft Computing 39 2007 30 39
94. J.P. Wachs, H.I. Stern, Y. Edan, M. Gillam, J. Handler, and C. Feied A gesture-based tool for sterile browsing of radiology images Journal of the American Medical Informatics Association 15 2008 321 323
95. B.C. Wang, Z.J. Li, W.J. Ye, and Q. Xie Development of human-machine interface for teleoperation of a mobile manipulator International Journal of Control Automation and Systems 10 December 2012 1225 1231
96. Wenjian, Y., Fuchun, S., Huaping, L., & Yu, S. (2009). A collaborative navigation system for autonomous vehicle in flat terrain. In Proceedings of the IEEE international conference on control and automation, Christchurch, New Zealand, 2009 (pp. 1615-1620).
97. H.A. Wigdor, J.T. Walsh, J.D.B. Featherstone, S.R. Visuri, D. Fried, and J.L. Waldvogel Lasers in dentistry Lasers in Surgery and Medicine 16 1995 103 133
98. WOS. Web of science (online).
99. S.-W. Yang, C.-C. Wang, and C. Thorpe The annotated laser data set for navigation in urban areas International Journal of Robotics Research 30 August 2011 1095 1099
100. Yeong Nam, C., Young-Ho, K., Jin, C., Kyusung, C., & Hyun, S. Y. (2009). An adaptive sensor fusion based objects tracking and human action recognition for interactive virtual environments. Presented at the proceedings of the 8th international conference on virtual reality continuum and its applications in industry, Yokohama, Japan, 2009.
101. Ying, W., Sun, F., Liu, H., & Song, Y. (2009). A collaborative navigation system for autonomous vehicle in flat terrain. In Proceedings of the IEEE international conference on control and automation, Christchurch, New Zealand, 2009 (pp. 1615-1620).
102. A.C. Yoo, G.R. Gilbert, and T.J. Broderick Military robotic combat casualty extraction and care 2010 Springer New York
103. Young Sang, C., Cressel, D. A., Jonathan, D. G., & Charles, C. K. (2008). Laser pointers and a touch screen: Intuitive interfaces for autonomous mobile manipulation for the motor impaired. Presented at the proceedings of the 10th international ACM SIGACCESS conference on computers and accessibility, Halifax, Canada, 2008.
104. Zhong, H., & Nof, S. Y. (2013). Collaborative design for assembly: The HUB-CI model. In ICPR-22, Iguassu Falls, Brazil, 2013.
105. Zhong, H., Wachs, J. P., & Nof, S. Y. (2013). HUB-CI model for collaborative telerobotics in manufacturing. In 11th IFAC workshop on intelligent manufacturing systems, IMS 2013, Sao Paulo, 2013 (pp. 63-68).
106. H. Zhong, J.P. Wachs, and S.Y. Nof A collaborative telerobotics network framework with hand gesture interface and conflict prevention International Journal of Production Research 51 2013 4443 4463
107. Y. Zhuang, M.W. Gu, W. Wang, and H.Y. Yu Multi-robot cooperative localization based on autonomous motion state estimation and laser data interaction Science China-Information Sciences 53 November 2010 2240 2250
108. Z. Zivkovic, O. Booij, B. Krose, E.A. Topp, and H.I. Christensen From sensors to human spatial concepts: An annotated data set IEEE Transactions on Robotics 24 April 2008 501 505