Dynamic kinesthetic boundary for haptic teleoperation of VTOL aerial robots in complex environments

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Volumn 46, Issue 5, 2016, Pages 694-705

  Hou, Xiaolei ^a   Mahony, Robert ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Dynamic kinesthetic boundary (DKB); haptic teleoperation; kinesthetic feedback; obstacle avoidance; vertical taking off and landing (VTOL) aerial robots

Indexed keywords

AIR NAVIGATION; AIRCRAFT LANDING; ANTENNAS; COLLISION AVOIDANCE; FREE FLIGHT; REMOTE CONTROL; ROBOTS; VEHICLES;

AERIAL ROBOTS; CLUTTERED ENVIRONMENTS; COMPLEX ENVIRONMENTS; ENVIRONMENT CONSTRAINTS; HAPTIC TELEOPERATION; KINESTHETIC FEEDBACK; NATURAL REPRESENTATION; STATE-OF-THE-ART APPROACH;

VTOL/STOL AIRCRAFT;

EID: 84969287462     PISSN: 21682216     EISSN: 21682232     Source Type: Journal    
DOI: 10.1109/TSMC.2015.2478756     Document Type: Article

References (45)

1. K. Hashtrudi-Zaad and S. Salcudean, "Transparency in time-delayed systems and the effect of local force feedback for transparent teleoperation, " IEEE Trans. Robot. Autom., vol. 18, no. 1, pp. 108-114, Feb. 2002
2. B. Hannaford, "A design framework for teleoperators with kinesthetic feedback, " IEEE Trans. Robot. Autom., vol. 5, no. 4, pp. 426-434, Aug. 1989
3. S. Hong, B. Kim, S. Kim, and J. Lee, "Artificial force reflection control for teleoperated mobile robots, " Mechatronics, vol. 8, no. 6, pp. 707-717, 1998
4. S. Hong, J. Lee, and S. Kim, "Generating artificial force for feedback control of teleoperated mobile robots, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), vol. 3. Kyongju, Korea, 1999, pp. 1721-1726
5. D. A. Lawrence, "Stability and transparency in bilateral teleoperation, " IEEE Trans. Robot. Autom., vol. 9, no. 5, pp. 624-637, Oct. 1993
6. K. Hashtrudi-Zaad and S. Salcudean, "Analysis of control architectures for teleoperation systems with impedance/admittance master and slave manipulators, " Int. J. Robot. Res., vol. 20, no. 6, pp. 419-445, 2001
7. N. Diolaiti and C. Melchiorri, "Teleoperation of a mobile robot through haptic feedback, " in Proc. IEEE Int. Workshop Haptic Virtual Environ. Appl. (HAVE), Ottawa, ON, Canada, 2002, pp. 67-72
8. S. Lee, G. Sukhatme, G. Kim, and C. Park, "Haptic control of a mobile robot: A user study, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), vol. 3. Lausanne, Switzerland, 2002, pp. 2867-2874
9. V. Mut, J. Postigo, E. Slawinski, and B. Kuchen, "Bilateral teleoperation of mobile robots, " Robotica, vol. 20, no. 2, pp. 213-221, 2002
10. D. Lee, O. Martinez-Palafox, and M. Spong, "Bilateral teleoperation of a wheeled mobile robot over delayed communication network, " in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Orlando, FL, USA, May 2006, pp. 3298-3303
11. T. Lam, H. Boschloo, M. Mulder, and M. Van Paassen, "Artificial force field for haptic feedback in UAV teleoperation, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 39, no. 6, pp. 1316-1330, Nov. 2009
12. R. Mahony, F. Schill, P. Corke, and Y. Oh, "A new framework for force feedback teleoperation of robotic vehicles based on optical flow, " in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Kobe, Japan, May 2009, pp. 1079-1085
13. R. Philbrick and M. Colton, "Effects of haptic and 3D audio feedback on operator performance and workload for quadrotor UAVs in indoor environments, " J. Robot. Mechatron., vol. 26, no. 5, pp. 580-591, 2014
14. Z. Zuo and D. Lee, "Haptic tele-driving of a wheeled mobile robot over the Internet: A PSPM approach, " in Proc. IEEE Int. Conf. Decis. Control (CDC), Atlanta, GA, USA, Dec. 2010, pp. 3614-3619
15. A. Mersha, S. Stramigioli, and R. Carloni, "Bilateral teleoperation of underactuated unmanned aerial vehicles: The virtual slave concept, " in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Saint Paul, MN, USA, May 2012, pp. 4614-4620
16. H. Boschloo, T. Lam, M. Mulder, and M. Van Paassen, "Collision avoidance for a remotely-operated helicopter using haptic feedback, " in Proc. IEEE Int. Conf. Syst. Man Cybern., vol. 1. Hague, The Netherlands, 2004, pp. 229-235
17. S. Omari, M. Hua, G. Ducard, and T. Hamel, "Bilateral haptic teleoperation of VTOL UAVs, " in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Karlsruhe, Germany, May 2013, pp. 2393-2399
18. F. Schill, X. Hou, and R. Mahony, "Admittance mode framework for haptic teleoperation of hovering vehicles with unlimited workspace, " in Proc. Aust. Conf. Robot. Autom. (ACRA), Brisbane, QLD, Australia, Dec. 2010, pp. 1-9
19. X. Hou, R. Mahony, and F. Schill, "Representation of vehicle dynamics in haptic teleoperation of aerial robots, " in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Karlsruhe, Germany, May 2013, pp. 1485-1491
20. X. Hou and R. Mahony, "Dynamic kinesthetic boundary for haptic teleoperation of aerial robotic vehicles, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Tokyo, Japan, Nov. 2013, pp. 4549-4950
21. A. Brandt and M. Colton, "Haptic collision avoidance for a remotely operated quadrotor UAV in indoor environments, " in Proc. IEEE Int. Conf. Syst. Man Cybern., Istanbul, Turkey, Oct. 2010, pp. 2724-2731
22. D. Mellinger, N. Michael, and V. Kumar, "Trajectory generation and control for precise aggressive maneuvers with quadrotors, " Int. J. Robot. Res., vol. 31, no. 5, pp. 664-674, 2012
23. P. Pounds, R. Mahony, and P. Corke, "Modelling and control of a large quadrotor robot, " Cont. Eng. Pract., vol. 18, no. 7, pp. 691-699, 2010
24. A. Ruesch, A. Mersha, S. Stramigioli, and R. Carloni, "Kinetic scrollingbased position mapping for haptic teleoperation of unmanned aerial vehicles, " in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Saint Paul, MN, USA, May 2012, pp. 3116-3121
25. A. Mersha, S. Stramigioli, and R. Carloni, "Switching-based mapping and control for haptic teleoperation of aerial robots, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Vilamoura, Portugal, Oct. 2012, pp. 2629-2634
26. A. Mersha et al., "Intercontinental haptic teleoperation of a flying vehicle: A step towards real-Time applications, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Tokyo, Japan, Nov. 2013, pp. 4951-4957
27. I. Farkhatdinov, J. Ryu, and J. Poduraev, "A user study of command strategies for mobile robot teleoperation, " Intell. Serv. Robot., vol. 2, no. 2, pp. 95-104, 2009
28. T. Lam, M. Mulder, and M. Van Paassen, "Haptic interface in UAV teleoperation using force-stiffness feedback, " in Proc. IEEE Int. Conf. Syst. Man Cybern. (SMC), San Antonio, TX, USA, Oct. 2009, pp. 835-840
29. J. Lim, J. Ko, and J. Lee, "Internet-based teleoperation of a mobile robot with force-reflection, " in Proc. IEEE Conf. Control Appl., vol. 1. Istanbul, Turkey, Jun. 2003, pp. 680-685
30. T. Lam, M. Mulder, and M. Van Paassen, "Haptic feedback for UAV tele-operation-Force offset and spring load modification, " in Proc. IEEE Int. Conf. Syst. Man Cybern., Oct. 2006, pp. 1618-1623
31. T. Lam, M. Mulder, and M. Van Paassen, "Collision avoidance in UAV tele-operation with time delay, " in Proc. IEEE Int. Conf. Syst. Man Cybern. (SMC), Montreal, QC, Canada, Oct. 2007, pp. 997-1002
32. B. Krogh, "A generalized potential field approach to obstacle avoidance control, " in Proc. Conf. Robot. Res., Next Five Years Beyond, Bethlehem, Jerusalem, 1984, pp. 1-5
33. F. Schill, R. Mahony, P. Corke, and L. Cole, "Virtual force feedback teleoperation of the InsectBot using optical flow, " in Proc. Australasian Conf. Robot. Autom. (ACRA), Canberra, ACT, Australia, Dec. 2008, pp. 1-9
34. S. Alaimo, L. Pollini, and H. Buelthoff, "Admittance-based bilateral teleoperation with time delay for an unmanned aerial vehicle involved in an obstacle avoidance task, " in Proc. AIAA Model. Simulat. Technol. Conf., Aug. 2011, pp. 1-19
35. K. Kim, W. Chung, and I. Suh, "Accurate force reflection for kinematically dissimilar bilateral teleoperation systems using instantaneous restriction space, " in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Orlando, FL, USA, May 2006, pp. 3257-3262
36. B. Horan and S. Nahavandi, "Intuitive haptic control surface for mobile robot motion control, " in Proc. IEEE Int. Workshop Safety Security Rescue Robot., Sendai, Japan, Oct. 2008, pp. 121-127
37. X. Hou and R. Mahony, "An intuitive multimodal haptic interface for teleoperation of aerial robots, " in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Hong Kong, May 2014, pp. 838-845
38. J. Abbott, G. Hager, and A. Okamura, "Steady-hand teleoperation with virtual fixtures, " in Proc. 12th IEEE Int. Workshop Robot Human Interact. Commun. (ROMAN), Millbrae, CA, USA, Nov. 2003, pp. 145-151
39. J. Park and O. Khatib, "A haptic teleoperation approach based on contact force control, " Int. J. Robot. Res., vol. 25, nos. 5-6, pp. 575-591, 2006
40. Hokuyo. [Online]. Available: https: //www.hokuyo-Aut.jp/, accessed Sep. 30, 2015
41. Irrlicht. [Online]. Available: http: //irrlicht.sourceforge.net/, accessed Sep. 30, 2015
42. ROS. [Online]. Available: http: //www.ros.org, accessed Sep. 30, 2015
43. S. Hart and L. Staveland, "Development of NASA-TLX (task load index): Results of empirical and theoretical research, " in Human Mental Workload (Advances in Psychology), vol. 52, P. Hancock and N. Meshkati, Eds. Amsterdam, The Netherlands: North-Holland, 1988, pp. 139-183
44. N. Hogan, "Impedance control: An approach to manipulation, " in Proc. Amer. Control Conf., San Diego, CA, USA, Jun. 1984, pp. 304-313
45. C. Zilles and J. Salisbury, "A constraint-based god-object method for haptic display, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), vol. 3. Pittsburgh, PA, USA, Aug. 1995, pp. 146-151