Semiautonomous haptic teleoperation control architecture of multiple unmanned aerial vehicles

IEEE/ASME Transactions on Mechatronics

Volumn 18, Issue 4, 2013, Pages 1334-1345

  Lee, Dongjun ^a   Franchi, Antonio ^b   Son, Hyoung Il ^c   Ha, Changsu ^a   Bulthoff, Heinrich H ^b,d   Giordano, Paolo Robuffo ^e  

^a Seoul National University   (South Korea)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^c Samsung Heavy Industries   (South Korea)

^d Korea University   (South Korea)

^e CAMPUS DE BEAULIEU   (France)

Author keywords

Haptic feedback; multiagent control; passivity; teleoperation; unmanned aerial vehicles (UAVs)

Indexed keywords

ARTIFICIAL POTENTIALS; ASYMPTOTIC PERFORMANCE; CONNECTIVITY PRESERVATION; CONTROL ARCHITECTURE; HAPTIC FEEDBACKS; MULTIAGENT CONTROL; PASSIVITY; UNMANNED AERIAL VEHICLE (UAVS);

MULTI AGENT SYSTEMS; REMOTE CONTROL;

UNMANNED AERIAL VEHICLES (UAV);

EID: 84880570638     PISSN: 10834435     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMECH.2013.2263963     Document Type: Article

References (44)

1. K. P. Valavanis, Advances in Unmanned Aerial Vehicles: State of the Art and the Road to Autonomy. NewYork, NY, USA: Springer-Verlag, 2007, vol. 33.
2. G. Vachtsevanos and K. Valavanis, IEEE Robot. Autom. Mag. (Special Issue on Unmanned Aerial Vehicles), vol. 13, Sep. 2006.
3. T. J. Koo and S. Sastry, "Output tracking control design of a helicopter model based on approximate linearization," in Proc. IEEE Conf. Decision Control, Dec. 1998, vol. 4, pp. 3635-3640.
4. R. Mahony and T. Hamel, "Robust trajectory tracking for a scale model autonomous helicopter," Int. J. Robust Nonlinear Control, vol. 14, pp. 1035- 1059, 2004.
5. A. P. Aguiar and J. P. Hespanha, "Trajectory-tracking and path-following of underactuated autonomous vehicles with parametric modeling uncertainty," IEEE Trans. Autom. Control, vol. 52, no. 8, pp. 1362-1379, Aug. 2007. (Pubitemid 47316686)
6. M-D. Hua, T. Hamel, P. Morin, and C. Samson, "A control approach for thrust-propelled underactuated vehicles and its application to VTOL drones," IEEE Trans. Autom. Control, vol. 54, no. 8, pp. 1837-1853, Aug. 2009.
7. D. J. Lee, C. Ha, and Z. Zuo, "Backstepping control of quadrotor-type UAVs: Trajectory tracking and teleoperation over the internet," in Proc. Int. Conf. Autonom. Syst., Jun. 2013, pp. 217-225.
8. J. M. Pflimlin, P. Soueres, and T. Hamel, "Position control of a ducted fan VTOL UAV in crosswind," Int. J. Control, vol. 80, no. 5, pp. 666-683, 2007. (Pubitemid 46537765)
9. M. Oishi and C. J. Tomlin, "Switched nonlinear control of a VSTOL aircraft," in Proc. IEEE Conf. Decision Control, 1999, vol. 3, pp. 2685- 2690. (Pubitemid 30575361)
10. D. J. Lee and K. Huang, "Passive-set-position-modulation framework for interactive robotic systems," IEEE Trans. Robot., vol. 26, no. 2, pp. 354- 369, Apr. 2010.
11. T. M. Lam, M. Mulder, and M. M. van Paassen, "Haptic feedback in uninhabited aerial vehicle teleoperation with time delay," AIAA J. Guid., Control Dyn., vol. 31, no. 6, pp. 1728-1739, 2008.
12. S. Stramigioli, R. Mahony, and P. Corke, "A novel approach to haptic tele-operation of aerial robot vehicles," in Proc. IEEE Int. Conf. Robot. Autom., May 2010, pp. 5302-5308.
13. C. Masone, A. Franchi, H. H. Bülthoff, and P. Robuffo Giordano, "Interactive planning of persistent trajectories for human-assisted navigation of mobile robots," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Oct. 2012, pp. 2641-2648.
14. D. J. Lee and M. W. Spong, "Bilateral teleoperation of multiple cooperative robots over delayed communication networks: Theory," in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2005, pp. 362-367.
15. E. J. Rodriguez-Seda, J. J. Troy, C. A. Erignac, P. Murray, D. M. Stipanovic, and M. W. Spong, "Bilateral teleoperation of multiple mobile agents: Coordinated motion and collision avoidance," IEEE Trans. Control Syst. Technol., vol. 18, no. 4, pp. 984-992, Jul. 2010.
16. D. J. Lee and P. Y. Li, "Passive decomposition ofmechanical systems with coordination requirement," IEEE Trans. Autom. Control, vol. 58, no. 1, pp. 230-235, Jan. 2013.
17. D. J. Lee and P. Y. Li, "Passive decomposition approach to formation and maneuver control of multiple rigid bodies," J. Dyn. Syst. Meas. Control, vol. 129, pp. 662-677, Sep. 2007. (Pubitemid 47558930)
18. D. J. Lee and D. Xu, "Feedback r-passivity of Lagrangian systems for mobile robot teleoperation," in Proc. IEEE Int. Conf. Robot. Autom., May 2011, pp. 2118-2123.
19. D. J. Lee, "Passive decomposition and control of nonholonomic mechanical systems," IEEE Trans. Robot., vol. 26, no. 6, pp. 978-992, Dec. 2010.
20. D. J. Lee, "Semi-autonomous teleoperation of multiple wheeled mobile robots over the internet," in Proc. ASME Dynam. Syst. Contr. Conf., 2008, pp. 147-154.
21. D. J. Lee, A. Franchi, P. R. Giordano, H-I. Son, and H. H. Bülthoff, "Haptic teleoperation of multiple unmanned aerial vehicles over the internet," in Proc. IEEE Int. Conf. Robot. Autom., May 2011, pp. 1341-1347.
22. A. Franchi, P. R. Giordano, C. Secchi, H. I. Son, and H. H. Bülthoff, "A passivity-based decentralized approach for the bilateral teleoperation of a group of UAVs with switching topology," in Proc. IEEE Int. Conf. Robot. Autom., May 2011, pp. 898-905..
23. A. Franchi, C. Secchi, H. I. Son, H. H. Bülthoff, and P. R. Giordano, "Bilateral teleoperation of groups of mobile robots with time-varying topology," IEEE Trans. Robot., vol. 28, no. 5, pp. 1019-1033, Oct. 2012.
24. C. Secchi, A. Franchi, H. H. Bülthoff, and P. R. Giordano, "Bilateral teleoperation of a group of UAVs with communication delays and switching topology," in Proc. IEEE Int. Conf. Robot. Autom., St. Paul, MN, USA, May 2012, pp. 4307-4314.
25. A. Franchi, C. Masone, V. Grabe, M. Ryll, H. H. Bülthoff, and P. R. Giordano, "Modeling and control of UAV bearing-formations with bilateral high-level steering," Int. J. Robot. Res., vol. 31, no. 12, pp. 1504- 1525, 2012.
26. P. R. Giordano, A. Franchi, C. Secchi, and H. H. Bülthoff, "A Passivitybased decentralized strategy for generalized connectivity maintenance," Int. J. Robot. Res., vol. 32, no. 3, pp. 299-323, 2013.
27. H. I. Son, A. Franchi, L. L. Chuang, J. Kim, H. H. Bülthoff, and P. R. Giordano, "Human-centered design and evaluation of haptic cueing for teleoperation of multiple mobile robots," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 43, no. 2, pp. 597-609, Apr. 2013.
28. K. Huang and D. J. Lee, "Implementation and experiments of passive setposition modulation framework for interactive robotic systems," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Oct. 2009, pp. 5615-5620.
29. A. Franchi, C. Secchi, M. Ryll, H. H. Bülthoff, and P. R. Giordano, "Shared control: Balancing autonomy and human assistance with a group of quadrotor uavs," IEEE Robot. Autom. Mag., vol. 19, no. 3, pp. 57-68, Sep. 2012.
30. K. Tanaka,H.Ohtake, M. Tanaka, and H. O.Wang,"Wireless vision-based stabilization of indoor microhelicopter," IEEE/ASME Trans. Mechatronics, vol. 17, no. 3, pp. 519-524, Jun. 2012.
31. M. W. Spong, S. Hutchinson, and M. Vidyasaga, Robot Modeling and Control. Hoboken, NJ, USA: Wiley, 2006.
32. J. Aspnes, T. Eren, D. K. Goldenberg, A. S. Morse, W. Whiteley, B. D. O. Anderson, and P. N. Belhumeur, "A theory of network localization," IEEE Trans. Mobile Comput., vol. 5, no. 12, pp. 1663-1678, Dec. 2006.
33. D. Zelazo, A. Franchi, F. Allgöwer, H. H. Bülthoff, and P. R. Giordano, "Rigidity maintenance control for multi-robot systems," presented at the Robot. Sci. Syst. Conf., Sydney, Australia, Jul. 2012.
34. D. V. Dimarogonas and K. J. Kyriakopoulos, "Connectedness preserving distributed swam aggregation for multiple kinematic robots," IEEE Trans. Robot., vol. 24, no. 5, pp. 1213-1223, Oct. 2008.
35. P. Ogren, E. Fiorelli, and N. E. Leonard, "Cooperative control of mobile sensor networks: Adaptive gradient climbing in a distributed environment," IEEE Trans. Autom. Control, vol. 49, no. 8, pp. 1292-1302, Aug. 2004.
36. Y. Cao andW. Ren, "Distributed coordinated tracking via a variable structure approach-Part ii: Swarm tracking," in Proc. Amer. Control Conf., 2010, pp. 4750-4755.
37. A. Sarlette, R. Sepulchre, and N. E. Leonard, "Cooperative attitude synchronization in satellite swarms: A consensus approach," in Proc. 17th IFAC Symp. Autom. Control Aerosp., 2007, pp. 223-228.
38. O. M. Palafox and M. W. Spong, "Bilateral teleoperation of a formation of nonholonomic mobile robots under constant time delay," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Oct. 2009, pp. 2821-2826.
39. S. F. F. Gibson and B. Mirtich, "A survey of deformable modeling in computer graphics," Mitsubishi Electric Information Technology Center America, Cambridge, MA, USA, Tech. Rep. TR-97-19, 1997.
40. C. W. Reynolds, "Flocks, herds, and schools: A distributed behavioral model," Comput. Graph., vol. 21, no. 4, pp. 25-34, 1987.
41. H. I. Son, L. L. Chuang, J. Kim, and H. H. Bülthoff, "Haptic feedback can improve human perceptual awareness in multi-robots teleoperation," in Proc. Int. Conf. Control Autom. Syst., 2011, pp. 1323-1328.
42. R. Mahony, T. Hamel, and J.-M. Pflimlin, "Complementary filter design on the special orthogonal group SO(3)," in Proc. IEEE Conf. Decision Control, Dec. 2005, pp. 1477-1484. (Pubitemid 46297176)
43. M. Egerstedt, S. Martini, M. Cao, K. Camlibel, and A. Bicchi, "Interacting with networks," IEEE Control Syst. Mag., vol. 32, no. 4, pp. 66-73, Aug. 2012.
44. D. J. Lee, "Distributed backstepping control of multiple thrust-propelled vehicles on balanced graph," Automatica, vol. 48, no. 11, pp. 2971-2977, 2012.