Vision-controlled micro flying robots: From system design to autonomous navigation and mapping in GPS-denied environments

IEEE Robotics and Automation Magazine

Volumn 21, Issue 3, 2014, Pages 26-40

  Scaramuzza, Davide ^a   Achtelik, Michael C ^b   Doitsidis, Lefteris ^c   Friedrich, Fraundorfer ^d   Kosmatopoulos, Elias ^e   Martinelli, Agostino ^f   Achtelik, Markus W ^g   Chli, Margarita ^h   Chatzichristofis, Savvas ^e   Kneip, Laurent ⁱ   Gurdan, Daniel ^b   Heng, Lionel ^g   Lee, Gim Hee ^g   Lynen, Simon ^g   Pollefeys, Marc ^g   Renzaglia, Alessandro ^g   Siegwart, Roland ^g   Stumpf, Jan Carsten ^j   Tanskanen, Petri ^b   Troiani, Chiara ^g   Weiss, Stephan ^f   Meier, Lorenz ^k   more..

^a UNIVERSITY OF ZURICH   (Switzerland)

^b Ascending Technologies GmbH   (Germany)

^c TECHNOLOGICAL EDUCATIONAL INSTITUTE OF CRETE   (Greece)

^d TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^e DEMOCRITUS UNIVERSITY OF THRACE   (Greece)

^f INRIA RHÔNE ALPES   (France)

^g ETH ZURICH   (Switzerland)

^h UNIVERSITY OF EDINBURGH   (United Kingdom)

ⁱ AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^j UNIVERSITY OF MINNESOTA   (United States)

^k CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

more..

Author keywords

[No Author keywords available]

Indexed keywords

AIR NAVIGATION; AIRCRAFT CONTROL; MACHINE DESIGN; MAPPING; MONITORING; NAVIGATION; NAVIGATION SYSTEMS; REMOTE CONTROL; ROBOTS; UNITS OF MEASUREMENT;

AUTONOMOUS NAVIGATION; AUTONOMOUS OPERATIONS; ENVIRONMENT MONITORING; INERTIAL MEASUREMENT UNIT; SECURITY SURVEILLANCE; TECHNICAL CHALLENGES; THREEDIMENSIONAL (3-D); VISION BASED NAVIGATION;

GLOBAL POSITIONING SYSTEM;

EID: 85027921262     PISSN: 10709932     EISSN: None     Source Type: Journal    
DOI: 10.1109/MRA.2014.2322295     Document Type: Article

References (60)

1. M. Achtelik, A. Bachrach, R. He, S. Prentice, and N. Roy, "Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments," in Proc. SPIE Conf. Unmanned Systems Technology, 2009, pp. 1-8.
2. N. Michael, J. Fink, and V. Kumar, "Cooperative manipulation and transportation with aerial robots," Auton. Robot., vol. 30, no. 1, pp. 73-86, 2010.
3. N. Michael, D. Mellinger, Q. Lindsey, and V. Kumar, "The GRASP multiple micro UAV testbed," IEEE Robot. Automat. Mag., vol. 17, no. 3, pp. 56-65, 2010.
4. S. Lupashin, A. Schöllig, M. Sherback, and R. D'Andrea, "A simple learning strategy for high-speed quadrocopter multi-flips," in Proc. IEEE Int. Conf. Robotics Automation, May 2010, pp. 1642-1648.
5. D. Mellinger and V. Kumar, "Minimum snap trajectory generation and control for quadrotors," in Proc. IEEE Int. Conf. Robotics Automation, 2011, pp. 2520-2525.
6. S. Bouabdallah, P. Murrieri, and R. Siegwart, "Design and control of an indoor micro quadrotor," in Proc. IEEE Int. Conf. Robotics Automation, 2004, pp. 4393-4398.
7. R. Mahony, V. Kumar, and P. Corke, "Multirotor aerial vehicles-modeling, estimation, and control of quadrotor," IEEE Robot. Automat. Mag., vol. 19, no. 3, pp. 20-32, 2012.
8. N. Michael, D. Scaramuzza, and V. Kumar, "Special issue on micro-UAV perception and control," Auton. Robot., vol. 23, nos. 1-2, pp. 1-3, 2012.
9. M. Cutler, N. Ure, B. Michini, and J. P. How. (Aug. 2011). Comparison of fixed and variable pitch actuators for agile quadrotors. presented at AIAA Guidance, Navigation, Control Conf., Portland, OR. [Online]. Available: http://acl.mit.edu/papers/GNC11Cutleruber.pdf
10. M. C. Achtelik, J. Stumpf, D. Gurdan, and K.-M. Doth, "Design of a flexible high performance quadcopter platform breaking the MAV endurance record with laser power beaming," in Proc. IEEE Int. Conf. Intelligent Robots Systems, 2011, pp. 5166-5172.
11. S. Thrun, M. Montemerlo, H. Dahlkamp, D. Stavens, A. Aron, J. Diebel, P. Fong, J. Gale, M. Halpenny, G. Hoffmann, K. Lau, C. Oakley, M. Palatucci, V. Pratt, P. Stang, S. Strohband, C. Dupont, L.-E. Jendrossek, C. Koelen, C. Markey, C. Rummel, J. van Niekerk, E. Jensen, P. Alessandrini, G. Bradski, B. Davies, S. Ettinger, A. Kaehler, A. Nefian, and P. Mahoney, "Stanley, the robot that won the DARPA grand challenge," J. Field Robot., vol. 23, no. 9, pp. 661-692, 2006.
12. A. Bachrach, R. He, and N. Roy, "Autonomous flight in unstructured and unknown indoor environments," in Proc. European Conf. Micro Air Vehicles, 2009, pp. 1-8.
13. A. Chambers, S. Achar, S. Nuske, J. Rehder, B. Kitt, L. Chamberlain, J. Haines, S. Scherer, and S. Singh, "Perception for a river mapping robot," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots Systems, 2011, pp. 227-234.
14. S. Grzonka, G. Grisetti, and W. Burgard, "A fully autonomous indoor quadrotor," IEEE Trans. Robot., vol. 28, no. 1, pp. 90-100, 2012.
15. S. Shen, N. Michael, and V. Kumar, "Autonomous multi-floor indoor navigation with a computationally constrained MAV," in Proc. IEEE Int. Conf. Robotics Automation, 2011, pp. 20-25.
16. S. Shen, N. Michael, and V. Kumar, "Autonomous indoor 3D exploration with a micro-aerial vehicle," in Proc. IEEE Int. Conf. Robotics Automation, 2012, pp. 20-25.
17. D. Floreano, J. Zufferey, M. Srinivasan, and C. Ellington, Flying Insects and Robots. Berlin Heidelberg, Germany: Springer-Verlag, 2010.
18. S. Hrabar, G. S. Sukhatme, P. Corke, K. Usher, and J. Roberts, "Combined optic-flow and stereo-based navigation of urban canyons for a UAV," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots Systems, 2005, pp. 3309-3316.
19. J. Zufferey and D. Floreano, "Fly-inspired visual steering of an ultralight indoor aircraft," IEEE Trans. Robot., vol. 22, no. 1, pp. 137-146, 2006.
20. S. Ahrens, D. Levine, G. Andrews, and J. How, "Vision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments," in Proc. Int. Conf. Robotics Automation, 2009, pp. 2643-2648.
21. M. Bloesch, S. Weiss, D. Scaramuzza, and R. Siegwart, "Vision based MAV navigation in unknown and unstructured environments," in Proc. IEEE Int. Conf. Robotics Automation, 2010, pp. 21-28.
22. S. Weiss, D. Scaramuzza, and R. Siegwart, "Monocular-SLAM-based navigation for autonomous micro helicopters in GPS-denied environments," J. Field Robot., vol. 28, no. 6, pp. 854-874, 2011.
23. D. Eberli, D. Scaramuzza, S. Weiss, and R. Siegwart, "Vision based position control for MAVs using one single circular landmark," J. Intell. Robot. Syst., vol. 61, nos. 1-4, pp. 495-512, 2011.
24. S. Weiss, M. Achtelik, S. Lynen, M. Chli, and R. Siegwart, "Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments," in Proc. IEEE Int. Conf. Robotics Automation, 2012, pp. 957-964.
25. A. Ganguli, J. Cortés, and F. Bullo, "Maximizing visibility in nonconvex polygons: Nonsmooth analysis and gradient algorithm design," in Proc. American Control Conf., 2005, vol. 2, pp. 792-797.
26. A. Ganguli, J. Cortés, and F. Bullo, "Visibility-based multi-agent deployment in orthogonal environments," in Proc. American Control Conf., 2007, pp. 3426-3431.
27. P. Agarwal and M. Sharir, "Efficient algorithms for geometric optimization," ACM Comput. Surv., vol. 30, no. 4, pp. 412-458, 1998.
28. T. Shermer, "Recent results in art galleries," Proc. IEEE, vol. 80, no. 9, pp. 1384-1399, 1992.
29. A. Howard, M. Matari?, and G. Sukhatme, "Distributed coverage control on surfaces in 3D space," in Proc. IEEE Int. Conf. Robotics Intelligent System, Lausanne, Switzerland, 2002, pp. 2849-2854.
30. M. Schwager, B. Julian, and D. Rus, "Optimal coverage for multiple hovering robots with downward facing camera," in Proc. IEEE Int. Conf. Robotics Automation, Kobe, Japan, 2009, pp. 3515-3522.
31. J. Cortés, S. Martínez, T. Karata?, and F. Bullo, "Coverage control for mobile sensing networks," IEEE Trans. Robot. Automat., vol. 20, no. 2, pp. 243-255, 2004.
32. M. Schwager, J. McLurkin, and D. Rus, "Distributed coverage control with sensory feedback for networked robots," in Proc. Robotics: Science Systems, Philadelphia, PA, 2006.
33. A. Breitenmoser, M. Schwager, J. Metzger, R. Siegwart, and D. Rus, "Voronoi coverage of non-convex environments with a group of networked robots," in Proc. IEEE Int. Conf. Robotics Automation, Anchorage, AK, 2010, pp. 4982-4989.
34. L. Pimenta, V. Kumar, R. Mesquita, and G. Pereira, "Sensing and coverage for a network of heterogeneous robots," in Proc. IEEE 47th Conf. Decision Control, Cancun, Mexico, 2008, pp. 3947-3952.
35. A. Howard, M. Matari?, and G. Sukhatme, "Mobile sensor network deployment using potential fields: A distributed, scalable solution to the area coverage problem," in Proc. 6th Int. Conf. Distributed Autonomous Robotic System, 2002, pp. 299-308.
36. A. Breitenmoser, J. Metzger, R. Siegwart, and D. Rus, "Distributed coverage control on surfaces in 3D space," in Proc. IEEE Int. Conf. Robotics Intelligent System, 2010, pp. 1-8.
37. M. Achtelik, K.-M. Doth, D. Gurdan, and J. Stumpf, "Multi-rotor-mavs-A trade off between efficiency, dynamics and redundancy," in Proc. Guidance, Navigation, Control, Aug. 2012, pp. 1-8.
38. D. Scaramuzza and F. Fraundorfer, "Visual odometry: Part I-The first 30 years and fundamentals," IEEE Robot. Automat. Mag., vol. 18, no. 4, pp. 80-92, 2011.
39. F. Fraundorfer and D. Scaramuzza, "Visual odometry: Part II-Matching, robustness, and applications," IEEE Robot. Automat. Mag., vol. 19, no. 2, pp. 78-90, 2012.
40. G. Klein and D. Murray, "Parallel tracking and mapping for small AR workspaces," in Proc. Int. Symp. Mixed Augmented Reality, 2007, pp. 1-10.
41. C. Forster, M. Pizzoli, and D. Scaramuzza, "SVO: Fast semi-direct monocular visual odometry," in Proc. IEEE Int. Conf. Robotics Automation, 2014, pp. 1-8.
42. S. Weiss and R. Siegwart, "Real-time metric state estimation for modular visioninertial systems," in Proc. IEEE Int. Conf. Robotics Automation, 2011, pp. 4531-4537.
43. S. Weiss, M. W. Achtelik, M. Chli, and R. Siegwart, "Versatile distributed pose estimation and sensor self-calibration for an autonomous MAV," in Proc. IEEE Int. Conf. Robotics Automation, 2012, pp. 31-38.
44. A. Martinelli, "Vision and IMU data fusion: Closed-form solutions for attitude, speed, absolute scale, and bias determination," IEEE Trans. Robot., vol. 28, no. 1, pp. 44-60, 2012.
45. J. Kelly and G. S. Sukhatme, "Visual-inertial sensor fusion: Localization, mapping and sensor-to-sensor self-calibration," Int. J. Robot. Res., vol. 30, no. 1, pp. 56-79, 2011.
46. C. Forster, S. Lynen, L. Kneip, and D. Scaramuzza, "Collaborative monocular SLAM with multiple micro aerial vehicles," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots a Systems, 2013, pp. 3962-3970.
47. D. Nistér and H. Stewénius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Computer Vision Pattern Recognition, New York, 2006, pp. 2161-2168.
48. F. Fraundorfer, C. Engels, and D. Nister, "Topological mapping, localization and navigation using image collections," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots Systems, 2007, pp. 3872-3877.
49. H. Bay, T. Tuytelaars, and L. V. Gool, "SURF: Speeded up robust features," in Proc. European Conf. Computer Vision, 2006, pp. 404-417.
50. L. Kneip, D. Scaramuzza, and R. Siegwart, "A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation," in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2011, pp. 2969-2976.
51. R. Kuemmerle, G. Grisetti, H. Strasdat, K. Konolige, and W. Burgard, "G2o: A general framework for graph optimization," in Proc. IEEE Int. Conf. Robotics Automation, 2011, pp. 3607-3613.
52. L. Heng, G. Lee, F. Fraundorfer, and M. Pollefeys, "Real-time photorealistic 3D mapping for micro aerial vehicles," in Proc. IEEE Int. Conf. Robotics Intelligent System, 2011, pp. 4012-4019.
53. E. Kosmatopoulos and A. Kouvelas, "Large-scale nonlinear control system fine-tuning through learning," IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 1009-1023, 2009.
54. J. Spall, Introduction to Stochastic Search and Optimization. New York: Wiley, 2003.
55. J. L. Ny and G. Pappas, "Sensor-based robot deployment algorithms," in Proc. 49th IEEE Conf. Decision Control, Atlanta, GA, 2010, pp. 5486-5492.
56. A. Renzaglia, L. Doitsidis, A. Martinelli, and E. Kosmatopoulos, "Multirobot three-dimensional coverage of unknown areas," Int. J. Robot. Res., vol. 31, no. 6, pp. 738-752, 2012.
57. L. Doitsidis, S. Weiss, A. Renzaglia, M. W. Achtelik, E. Kosmatopoulos, R. Siegwart, and D. Scaramuzza, "Optimal surveillance coverage for teams of micro aerial vehicles in GPS-denied environments using onboard vision," Auton. Robot., vol. 33, nos. 1-2, pp. 173-188, 2012.
58. M. Achtelik, S. Lynen, S. Weiss, L. Kneip, M. Chli, and R. Siegwart, "Visualinertial SLAM for a small helicopter in large outdoor environments," in Video Proc. IEEE/RSJ Int. Conf. Intelligent Robots Systems, 2012, pp. 2651-2652.
59. S. Weiss, M. W. Achtelik, S. Lynen, M. Chli, and R. Siegwart, "Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments," in Proc. IEEE Int. Conf. Robotics Automation, 2012, pp. 957-964.
60. M. Pollefeys, D. Nister, J. M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S. J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewénius, R. Yang, G. Welch, and H. Towles. (2008, July). Detailed real-time urban 3D reconstruction from video. Int. J. Comput. Vision. [Online]. 78(2-3), pp. 143-167. Available: http://dx.doi.org/10.1007/s11263-007-0086-4