Autonomous vision-based micro air vehicle for indoor and outdoor Navigation

Journal of Field Robotics

Volumn 31, Issue 4, 2014, Pages 537-570

  Schmid, Korbinian ^a   Lutz, Philipp ^a   Tomic̈, Teodor ^a   Mair, Elmar ^a   Hirschmüller, Heiko ^a  

^a GERMAN AEROSPACE CENTER DLR   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

INDUSTRIAL APPLICATIONS; MICRO AIR VEHICLE (MAV); SENSOR DATA FUSION; STEREO IMAGE PROCESSING; UNITS OF MEASUREMENT;

AUTONOMOUS NAVIGATION; DENSE STEREO MATCHING; HARDWARE AND SOFTWARE; INERTIAL MEASUREMENT UNIT; OUTDOOR ENVIRONMENT; SEMI-GLOBAL MATCHING; UNKNOWN ENVIRONMENTS; WIRELESS CONNECTION;

NAVIGATION;

EID: 84902271793     PISSN: 15564959     EISSN: 15564967     Source Type: Journal    
DOI: 10.1002/rob.21506     Document Type: Article

References (66)

1. Achtelik, M., Achtelik, M., Weiss, S., &, Siegwart, R., (2011). Onboard IMU and monocular vision based control for MAVS in unknown in- and outdoor environments. In Proceedings of the IEEE International Conference on Robotics and Automation (pp. 3056-3063), Shanghai, China.
2. Arun, K. S., Hunag, T. S., &, Blostein, S. D., (1987). Least-squares fitting of two 3-D point sets. IEEE Transactions on Pattern Analysis and Machine Intelligence, 9 (5), 698-700.
3. Bachrach, A., De Winter, A., He, R., Hemnann, G., Prentice, S., &, Roy, N., (2010). RANGE robust autonomous navigation in GPS-denied environments. In Proceedings of the IEEE International Conference on Robotics and Automation (pp. 1096-1097), Anchorage, AK.
4. Banz, C., Blume, H., &, Pirsch, P., (2011). Real-time semi-global matching disparity estimation on the GPU. In Workshop on GPU in Computer Vision Applications at the International Conference on Computer Vision (ICCV) (pp. 514-521).
5. Banz, C., Hesselbarth, S., Flatt, H., Blume, H., &, Pirsch, P., (2010). Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation. In IEEE Conference on Embedded Computer Systems: Architectures, Modeling and Simulation. SAMOS X.
6. Bleyer, M., Rhemann, C., &, Rother, C., (2011). PatchMatch stereo-stereo matching with slanted support windows. In British Machine Vision Conference.
7. Craig, J., (2006). Introduction to robotics: Mechanics and control, 3rd ed. New York: Addison-Wesley.
8. Davison, A. J., (2003). Real-time simultaneous localisation and mapping with a single camera. In International Conference on Computer Vision.
9. De Boor, C., (2001). A practical guide to splines, Vol. 27. Berlin: Springer-Verlag.
10. Ernst, I., &, Hirschmüller, H., (2008). Mutual information based semi-global stereo matching on the GPU. In International Symposium on Visual Computing (ISVC08) (vol. LNCS 5358, Part 1, pp. 228-239), Las Vegas, NV.
11. Fraundorfer, F., Heng, L., Honegger, D., Lee, G., Meier, L., Tanskanen, P., &, Pollefeys, M., (2012). Vision-based autonomous mapping and exploration using a quadrotor MAV. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Algarve, Portugal.
12. Gehrig, S., Eberli, F., &, Meyer, T., (2009). A real-time low-power stereo vision engine using semi-global matching. In International Conference on Computer Vision Systems (ICVS) (vol. LNCS 5815, pp. 134-143), Liege, Belgium.
13. Goldberg, S. B., &, Matthies, L., (2011). Stereo and IMU assisted visual odometry on an OMAP3530 for small robots. In IEEE Computer Vision and Pattern Recognition Workshops (pp. 169-176).
14. Haralick, R., Joo, H., Lee, C.-N., Zhuang, X., Vaidya, V. G., &, Kim, M. B., (1989). Pose estimation from corresponding point data. IEEE Transactions on Systems, Man, and Cybernetics, 19 (6): 1426-1446.
15. Harris, C., &, Stephens, M., (1988). A combined corner and edge detector. In Proceedings of the 4th Alvey Vision Conference (pp. 147-151).
16. Hartley, R., &, Zisserman, A., (2003). Multiple view geometry in computer vision. Cambridge University Press.
17. Heng, L., Meier, L., Tanskanen, P., Fraundorfer, F., &, Pollefeys, M., (2011). Autonomous obstacle avoidance and maneuvering on a vision-guided MAV using on-board processing. In Proceedings of the IEEE International Conference on Robotics and Automation (pp. 2472-2477), Shanghai, China. IEEE.
18. Hirschmüller, H., (2003). Stereo vision based mapping and immediate virtual walkthroughs. Ph.D. thesis, School of Computing, De Montfort University, Leicester, UK.
19. Hirschmüller, H., (2008). Stereo processing by semi-global matching and mutual information. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30 (2), 328-341.
20. Hirschmüller, H., Innocent, P. R., &, Garibaldi, J. M., (2002a). Fast, unconstrained camera motion estimation from stereo without tracking and robust statistics. In Proceedings of the 7th International Conference on Control, Automation, Robotics and Vision (pp. 1099-1104), Singapore.
21. Hirschmüller, H., Innocent, P. R., &, Garibaldi, J. M., (2002b). Real-time correlation-based stereo vision with reduced border errors. International Journal of Computer Vision 47 (1/2/3), 229-246.
22. Hirschmüller, H., &, Scharstein, D., (2009). Evaluation of stereo matching costs on images with radiometric differences. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31 (9), 1582-1599.
23. Hoffmann, G. M., Wasl, S. L., &, Tomlin, C. J., (2008). Quadrotor helicopter trajectory tracking control. In Proceedings of the AIAA Guidance, Navigation and Control Conference.
24. Hol, J., Schön, T., &, Gustafsson, F., (2010). Modeling and calibration of inertial and vision sensors. The International Journal of Robotics Research, 29 (2-3), 231.
25. Honegger, D., Greisen, P., Meier, L., Tanskanen, P., &, Pollefeys, M., (2012). Real-time velocity estimation based on optical flow and disparity matching. In IEEE International Conference on Intelligent Robots and Systems (IROS).
26. Hornung, A., Wurm, K. M., Bennewitz, M., Stachniss, C., &, Burgard, W., (2013). Octomap: An efficient probabilistic 3d mapping framework based on octrees. Autonomous robots (pp. 1-18).
27. Huang, A. S., Bachrach, A., Henry, P., Krainin, M., Fox, D., &, Roy, N., (2011). Visual odometry and mapping for autonomous flight using an RGB-D camera. In International Symposium on Robotics Research (ISRR) (pp. 1-16), Shanghai, China.
28. Jeong, S.-H., &, Jung, S., (2012). Experimental studies of a disturbance observer for attitude control of a quad-rotor system. In ICCAS '12 (pp. 579-583).
29. Kelly, J., &, Sukhatme, G., (2009). Visual-inertial simultaneous localization, mapping and sensor-to-sensor self-calibration. In Computational Intelligence in Robotics and Automation (CIRA), 2009 IEEE International Symposium (pp. 360-368). IEEE.
30. Kondak, K., Bernard, M., Meyer, N., &, Hommel, G., (2007). Autonomously flying vtol-robots: Modeling and control. In ICRA (pp. 736-741).
31. Larsen, T. D., Andersen, N. A., Ravn, O., &, Poulsen, N. K., (1998). Incorporation of time delayed measurements in a discrete-time Kalman filter. In Decision and Control, 1998. Proceedings of the 37th IEEE Conference (Vol. 4, pp. 3972-3977). IEEE.
32. Lobo, J., &, Dias, J., (2007). Relative pose calibration between visual and inertial sensors. The International Journal of Robotics Research, 26 (6), 561.
33. Lowe, D. G., (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60 (2), 91-110.
34. Mair, E., (2012). Efficient and robust pose estimation based on inertial and visual sensing. Ph.D. thesis, Technische Universität München.
35. Mair, E., Fleps, M., Ruepp, O., Suppa, M., &, Burschka, D., (2011a). Optimization based IMU camera calibration. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, San Francisco. IEEE.
36. Mair, E., Fleps, M., Suppa, M., &, Burschka, D., (2011b). Spatio-temporal initialization for IMU to camera registration. In Robotics and Biomimetics (ROBIO), 2011. IEEE International Conference. IEEE.
37. Mair, E., Hager, G., Burschka, D., Suppa, M., &, Hirzinger, G., (2010). Adaptive and generic corner detection based on the accelerated segment test. Computer Vision (ECCV), 2010. European Conference (pp. 183-196).
38. Matthies, L., &, Shafer, S. A., (1987). Error modeling in stereo navigation. IEEE Journal on Robotics and Automation, 3 (3), 239-248.
39. Maybeck, P. S., (1979). Stochastic models, estimation, and control, volume 1 of Mathematics in Science and Engineering. Academic.
40. Mirzaei, F., &, Roumeliotis, S., (2007a). A Kalman filter-based algorithm for IMU-camera calibration. In Intelligent Robots and Systems, 2007. IROS 2007. IEEE/RSJ International Conference (pp. 2427-2434). IEEE.
41. Mirzaei, F., &, Roumeliotis, S., (2007b). IMU-camera calibration: Bundle adjustment implementation. Technical report, Department of Computer Science, University of Minnesota.
42. Nakao, M., Ohnishi, K., &, Miyachi, K., (1987). A robust decentralized joint control based on interference estimation. In Proceedings of the IEEE International Conference on Robotics and Automation (vol. 4, pp. 326-331).
43. Newcombe, R. A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohli, P., Shotton, J., Hodges, S., &, Fitzgibbon, A., (2011a). KinectFusion: Real-Time Dense Surface Mapping and Tracking. In ISMAR.
44. Newcombe, R. A., Lovegrove, S., &, Davison, A. J., (2011b). DTAM: Dense tracking and mapping in real-time. In International Conference on Computer Vision.
45. Nocedal, J., &, Wright, S., (2000). Numerical optimization. Springer.
46. OSADL (2012). Open source automation development lab eg-realtime linux road map. Retrieved June 12, 2013, from https://www.osadl.org/Realtime-Linux. projects-realtime-linux.0.html.
47. Prautzsch, H., Boehm, W., &, Paluszny, M., (2002). BÉZier and B-Spline Techniques. Berlin: Springer-Verlag.
48. Roumeliotis, S. I., Johnson, A. E., &, Montgomery, J. F., (2002). Augmenting inertial navigation with image-based motion estimation. In Proceedings of the IEEE International Conference on Robotics and Automation (pp. 4326-4333), Washington, D.C.
49. Scharstein, D., &, Szeliski, R., (2002). A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision, 47 (1/2/3), 7-42.
50. Schmid, K., Tomic, T., Ruess, F., Hirschmüller, H., &, Suppa, M., (2013). Stereo vision based indoor/outdoor navigation for flying robots. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan.
51. Schmid, K., (2013). DLR XRotor Webpage, http://mobilerobots.dlr.de/ systems/multicopters.
52. Schmid, K., &, Hirschmüller, H., (2013). Stereo vision and IMU based real-time ego-motion and depth image computation on a handheld device. In Proceedings of the IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.
53. Schmid, K., Ruess, F., Suppa, M., &, Burschka, D., (2012). State estimation for highly dynamic flying systems using key frame odometry with varying time delays. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 2997-3004), Vilamoura, Algarve, Portugal.
54. Shen, S., Michael, N., &, Kumar, V., (2011). Autonomous multi-floor indoor navigation with a computationally constrained MAV. In Proceedings of the IEEE International Conference on Robotics and Automation, March (pp. 20-25), Shanghai, China. GRASP Laboratory, University of Pennsylvania, Philadelphia, IEEE.
55. Shen, S., Michael, N., &, Kumar, V., (2012). Stochastic differential equation-based exploration algorithm for autonomous indoor 3D exploration with a micro-aerial vehicle. The International Journal of Robotics Research, 31 (12), 1431-1444.
56. Steingrube, P., Gehrig, S., &, Franke, U., (2009). Performance evaluation of stereo algorithms for automotive applications. In International Conference on Computer Vision Systems (ICVS) (vol. LNCS 5815), Liege, Belgium.
57. Stelzer, A., Hirschmüller, H., &, Görner, M., (2012). Stereo-vision-based navigation of a six-legged walking robot in unknown rough terrain. International Journal of Robotics Research: Special Issue on Robot Vision, 31 (4), 381-402.
58. Strobl, K., Sepp, W., Fuchs, S., Paredes, C., &, Arbter, K., (2005). DLR CalLab and DLR CalDe, http://www.robotic.dlr.de/callab/.
59. Sturm, J., Burgard, W., &, Cremers, D., (2012). Evaluating egomotion and structure-from-motion approaches using the TIM RGB-D benchmark. In Proceedings of the Workshop on Color-Depth Camera Fusion in Robotics at the International Conference on Robotic Systems (IROS).
60. Tomic, T., Schmid, K., Lutz, P., Domel, A., Kassecker, M., Mair, E., Grixa, I., Ruess, F., Suppa, M., &, Burschka, D., (2012). Toward a fully autonomous UAV: Research platform for indoor and outdoor urban search and rescue. IEEE Robotics Automation Magazine, 19 (3), 46-56.
61. Tsai, R., &, Lenz, R., (1989). A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Transactions on Robotics and Automation, 5 (3), 345-358.
62. Weiss, S., Achtelik, M., Chli, M., &, Siegwart, R., (2012). Versatile distributed pose estimation and sensor self-calibration for an autonomous mav. In Proceedings of the IEEE International Conference on Robotics and Automation, St. Paul, MN.
63. Wendel, J., (2007). Integrierte navigationssysteme. Sensordatenfusion, GPS und inertiale navigation. Oldenbourg.
64. Yoon, K.-J., &, Kweon, I.-S., (2006). Adaptive support-weight approach for correspondence search. IEEE Transactions on Pattern Matching and Machine Intelligence, 28 (4), 650-656.
65. Youcef-Toumi, K., &, Ito, O., (1988). A time delay controller for systems with unknown dynamics. In Proceedings of the American Control Conference (pp. 904-913), Atlanta.
66. Zabih, R., &, Woodfill, J., (1994). Non-parametric local transforms for computing visual correspondence. In Proceedings of the European Conference of Computer Vision (pp. 151-158), Stockholm, Sweden.