Autonomous navigation in three-dimensional urban environments using wide-field integration of optic flow

Journal of Guidance, Control, and Dynamics

Volumn 33, Issue 1, 2010, Pages 147-159

  Hyslop, Andrew M ^a,b   Humbert, J Sean ^a,b  

^a UNIVERSITY OF MARYLAND   (United States)

^b 3182 Martin Hall ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADDITIVE NOISE; ASYMPTOTIC ANALYSIS; NEURONS; PERTURBATION TECHNIQUES; URBAN PLANNING;

ALGEBRAIC MODELING; AUTONOMOUS NAVIGATION; ENVIRONMENT UNCERTAINTY; LOCAL OBSTACLE AVOIDANCES; OPTIMAL WEIGHTING; STABILITY AUGMENTATIONS; URBAN ENVIRONMENTS; WEIGHTED SUMMATIONS;

OPTICAL FLOWS;

EID: 73949086495     PISSN: 07315090     EISSN: 15333884     Source Type: Journal    
DOI: 10.2514/1.43778     Document Type: Conference Paper

References (53)

1. Amidi, O., Mesaki, Y., and Kanade, T., "A Visual Odometer for Autonomous Helicopter Flight," Robotics and Autonomous Systems, Vol.28, Aug. 1999, p. 185. doi:10.1016/S0921-8890(99)00016-0 (Pubitemid 30500441)
2. Gurfil, P., and Rotstein, H., "Partial Aircraft State Estimation from Visual Motion using the Subspace Constraints Approach," Journal of Guidance, Control, and Dynamics, Vol.24, No.5, 2001, pp. 1016-1028. doi:10.2514/2.4811 (Pubitemid 32936211)
3. Hrabar, S., and Sukhatme, G. S., "Omnidirectional Vision for an Autonomous Helicopter," IEEE International Conference on Robotics and Automation '03, IEEE Publications, Piscataway, NJ, Nov. 2003, pp. 558-563.
4. Garratt, M., and Chahl, J., "Visual Control of an Autonomous Helicopter," 41st Aerospace Sciences Meeting and Exhibit, AIAA Paper 2003-460, 2003.
5. Garcia-Pardo, P. J., Sukhatme, G. S., and Montgomery, J. F., "Towards Vision-Based Safe Landing for an Autonomous Helicopter," Robotics and Autonomous Systems, Vol.38, No.1, 2002, pp. 19-29. doi:10.1016/S0921-8890(01)00166-X (Pubitemid 34110166)
6. Li, J., and Chellappa, R., "A Factorization Method for Structure from Planar Motion," Proceedings of the IEEE Workshop on Motion and Video Computing, Vol.2, IEEE Publications, Piscataway, NJ, Jan. 2005, pp. 154-159. doi:10.1109/ACVMOT.2005.4
7. Kendoula, F., Fantoni, I., and Nonamib, K., "Optic Flow-Based Vision System for Autonomous 3D Localization and Control of Small Aerial Vehicles," Robotics and Autonomous Systems, 2009 (in press).
8. Frye, M. A., and Dickinson, M. H., "Fly Flight: A Model for the Neural Control of Complex Behavior," Neuron, Vol.32, No.3, 2001, pp. 385-388. doi:10.1016/S0896-6273(01)00490-1
9. Egelhaaf, M., Kern, R., Krapp, H., Kretzberg, J., Kurtz, R., and Warzecha, A., "Neural Encoding of Behaviourally Relevant VisualMotion Information in the Fly," Trends in Neurosciences, Vol.25, No.2, 2002, pp. 96-102. doi:10.1016/S0166-2236(02)02063-5 (Pubitemid 34113957)
10. Borst, A., and Haag, J., "Neural Networks in the Cockpit of the Fly," Journal of Comparative Physiology A: Sensory, Neural, and Behavioral Physiology, Vol.188, No.6, 2002, pp. 419-437. doi:10.1007/s00359-002-0316-8
11. Gibson, J. J., The Perception of the Visual World, Houghton-Mifflin, Boston, 1950.
12. David, C. T, "Compensation for Height in the Control of Groundspeed by Drosophila in a New, Barber's Pole Wind Tunnel," Journal of Comparative Physiology, Vol.147, No.4, 1982, pp. 485-493. doi:10.1007/BF00612014
13. Srinivasan, M. V., Zhang, S. W., Lehrer, M., and Collett, T. S., "Honeybee Navigation En Route to the Goal: Visual Flight Control and Odometry," Journal of Experimental Biology, Vol.199, No.1, 1996, pp. 237-244. (Pubitemid 126603957)
14. Tammero, L. F., and Dickinson, M. H., "The Influence of Visual Landscape on the Free Flight Behavior of the Fruit Fly Drosophila Melanogaster," Journal of Experimental Biology, Vol.205, Feb. 2002, pp. 327-343.
15. Hrabar, S., Sukhatme, G. S., Corke, P., Usher, K., and Roberts, J., "Combined Optic-Flow and Stereo-Based Navigation of Urban Canyons for a UAV," Proceedings of the IEEE International Conference on Intelligent Robots and Systems, IEEE Publications, Piscataway, NJ, Dec. 2005, pp. 3309-3316. doi:10.1109/IROS.2005.1544998
16. Griffiths, S., Saunders, J., Curtis, A., Barber, B., McLain, T., and Beard, R., "Maximizing Miniature Aerial Vehicles: Obstacle and Terrain Avoidance for MAVs," IEEE Robotics and Automation Magazine, Vol.13, No.3, 2006, pp. 34-43. doi:10.1109/MRA.2006.1678137
17. Muratet, L., Doncieux, S., and Meyer, J.-A., "A Biomimetic Reactive Navigation System Using the Optical Flow for a Rotary-Wing UAV in Urban Environment," Proceedings of the 35th International Symposium of Robotics [CD-ROM], International Symposium of Robotics, Paris, 2004.
18. Beyeler, A., Zufferey, J.-C., and Floreano, D., "3D Vision-Based Navigation for Indoor Microflyers," Proceedings of the 2007 IEEE International Conference on Robotics and Automation, IEEE Publications, Piscataway, NJ, May 2007, pp. 1336-1341. doi:10.1109/ROBOT.2007.363170
19. Griffiths, S., Saunders, J., Curtis, A., McLain, T., and Beard, R., "Obstacle and Terrain Avoidance for Miniature Aerial Vehicles," Advances in Unmanned Aerial Vehicles, Vol.33, Springer, Dordrecht, The Netherlands, 2007.
20. Chahl, J. S., and Srinivasan, M. V., "A Complete Panoramic Vision System, Incorporating Imaging, Ranging, and Three Dimensional Navigation," Proceedings of the IEEE Workshop on Omnidirectional Vision, IEEE Publications, Piscataway, NJ, Aug. 2002, pp. 104-111. doi:10.1109/OMNVIS.2000.853815
21. Franceschini, N., Ruffier, F., and Serres, J., "A Bio-Inspired Flying Robot Sheds Light on Insect Piloting Abilities," Current Biology, Vol.17, No.4, 2007, pp. 329-335. doi:10.1016/j.cub.2006.12.032 (Pubitemid 46241879)
22. Beyeler, A., Zufferey, J.-C., and Floreano, D., "Optic-Flow to Steer and Avoid Collisions in 3D," Flying Insects and Robotics, Springer-Verlag, Berlin, 2009.
23. Miao, A. X., Zacharias, G. L., and Warren, R., "Passive Navigation from Image Sequences: A Practitioner's Approach," AIAA Flight Simulation Technologies Conference, AIAA Paper 1996-3556, 1996.
24. Kehoe, J. J., Watkins, A. S., Causey, R. S., and Lind, R., "State Estimation using Optical Flow from Parallax-Weighted Feature Tracking," AIAA Guidance, Navigation, and Control Conference and Exhibit, AIAA Paper 2006-6721, 2006.
25. Bruss, A. R., and Horn, K. P., "Passive Navigation," Computer Vision, Graphics, and Image Processing, Vol.21, No.1, 1983, pp. 3-20. doi:10.1016/S0734-189X(83)80026-7
26. Franz, M. O., Chahl, J. S., and Krapp, H. G., "Insect-Inspired Estimation of Egomotion," Neural Computation, Vol.16, No.11, 2004, pp. 2245-2260. doi:10.1162/0899766041941899
27. Toupet, O., Paduano, J. D., Panish, R., Sedwick, R., and Frazzoli, E., "Augmenting State Estimates with Multiple Camera Visual Measurements," AIAA Infotech at Aerospace Conference and Exhibit, AIAA Paper 2007-2983, 2007.
28. Franz, M. O., and Krapp, H. G., "Wide-Field, Motion-Sensitive Neurons and Matched Filters for Optic Flow Fields," Biological Cybernetics, Vol.83, No.3, 2000, pp. 185-197. doi:10.1007/s004220000163
29. Grunwald, A. J., "Stability and Control of a Remotely Controlled Indoors Micro Hovering Vehicle," AIAA Guidance, Navigation, and Control Conference and Exhibit, AIAA Paper 2005-6283, 2005.
30. Webb, T. P., Prazenica, R. J., Kurdila, A. J., and Lind, R., "Vision-Based State Estimation for Autonomous Micro Air Vehicles," Journal of Guidance, Control, and Dynamics, Vol.30, No.3, 2007, pp. 816-826. doi:10.2514/1.22398 (Pubitemid 46848340)
31. Call, B., Beard, R., and Taylor, C., "Obstacle Avoidance for Unmanned Vehicles Using Image Feature Tracking," AIAA Guidance, Navigation, and Control Conference, AIAA Paper 2006-6541, 2006.
32. Hausen, K., "Motion Sensitive Interneurons in the Optomotor System of the Fly, Part 1: The Horizontal Cells - Structure and Signals," Biological Cybernetics, Vol.45, No.2, 1982, pp. 143-156. doi:10.1007/BF00335241 (Pubitemid 13197420)
33. Hausen, K., "Motion Sensitive Interneurons in the Optomotor System of the Fly, Part 2: The Horizontal Cells - Receptive Field Organization and Response Characteristics," Biological Cybernetics, Vol.46, No.1, 1982, pp. 67-79. doi:10.1007/BF00335352 (Pubitemid 13191392)
34. Hengstenberg, R., Hausen, K., and Hengstenberg, B., "The Number and Structure of Giant Vertical Cells (VS) in the Lobula Plate of the Blowfly Calliphora Erythrocephala," Journal of Comparative Physiology, Vol.149, No.2, 1982, pp. 163-177. doi:10.1007/BF00619211
35. Humbert, J. S., and Hyslop, A. M., "Bio-Inspired Visuomotor Convergence," IEEE Transactions on Robotics and Automation, 2009 (in press).
36. Srinivasan, M. V., Zhang, S., and Chahl, J. S., "Landing Strategies in Honeybees, and Possible Applications to Autonomous Airborne Vehicles," The Biological Bulletin, Vol.200, April 2001, pp. 216-221. doi:10.2307/1543319 (Pubitemid 32391900)
37. Humbert, J. S., Murray, R. M., and Dickinson, M. H., "Sensorimotor Convergence in Visual Navigation and Flight Control Systems," Proceedings of the 16th IFAC World Congress [CD-ROM], Elsevier, New York,June 2005.
38. Humbert, J. S., Murray, R. M., and Dickinson, M. H., "Pitch-Altitude Control and Terrain Following Based on Bio-Inspired Visuomotor Convergence," AIAA Guidance, Navigation, and Control Conference, AIAA Paper 2005-6280, 2005.
39. Humbert, J. S., Murray, R. M., and Dickinson, M. H., "A ControlOriented Analysis of Bio-Inspired Visuomotor Convergence," Proceedings of the 44th IEEE Conference on Decision and Control, IEEE Publications, Piscataway, NJ, Jan. 2006, pp. 245-250.
40. Xu, P., Humbert, J. S., and Abshire, P., "Implementation and Demonstration of Wide-Field Integration in Analog VLSI," IEEE Transactions on Control Systems Technology, 2009 (submitted for publication).
41. Koenderink, J. J., and van Doom, A. J., "Facts on Optic Flow," Biological Cybernetics, Vol.56, No.4, 1987, pp. 247-254. doi:10.1007/BF00365219
42. Egelhaaf, M., and Borst, A., "Motion Computation and Visual Orientation in Flies," Comparative Biochemistry Physiology, Vol.104, No.4, 1993, pp. 659-673. doi:10.1016/0300-9629(93)90144-S (Pubitemid 23094350)
43. Krapp, H. G., Hengstenberg, B., and Hengstenberg, R., "Dendritic Structure and Receptive-Field Organization of Optic Flow Processing Interneurons in the Fly," Journal of Neurophysiology, Vol.79, No.4, 1998, pp. 1902-1917. (Pubitemid 28183327)
44. Conroy, J. K., Humbert, J. S., and Pines, D., "System Identification of a Rotary-Wing Micro Air Vehicle," Journal of the American Helicopter Society, 2009 (accepted for publication).
45. Kwakernaak, H., and Sivan, R., Linear Optimal Control Systems, 1st ed., Wiley-Interscience, New York, 1972.
46. Zufferey, J. C., and Floreano, D., "Fly-Inspired Visual Steering of an Ultralight Indoor Aircraft," IEEE Transactions on Robotics and Automation, Vol.22, No.1, 2006, pp. 137-146. doi:10.1109/TRO.2005.858857 (Pubitemid 43245262)
47. Shi, R. Z., and Horiuchi, T. K., "A Neuromorphic VLSI Model of Bat Interaural Level Difference Processing for Azimuthal Echolocation," IEEE Transactions on Circuits and Systems 1: Regular Papers, Vol.54, No.1, 2007, pp. 74-88. doi:10.1109/TCSI.2006.887981
48. Chao, H., Cao, Y., and Chen, Y., "Autopilots for Small Fixed-Wing Unmanned Air Vehicles: A Survey," Proceedings of the IEEE International Conference on Mechatronics and Automation, IEEE Publications, Piscataway, NJ, Sept. 2007, pp. 3144-3149. doi:10.1109/ICMA.2007.4304064 (Pubitemid 350245150)
49. Conroy, J. K., Gremillion, G., Ranganathan, B., and Humbert, J. S., "Implementation of Wide-Field Integration Methods for Autonomous Micro Helicopter Navigation," Autonomous Robots, 2009 (accepted for publication).
50. Hrabar, S., and Sukhatme, G. S., "A Comparison of Two Camera Configurations for Optic-Flow Based Navigation of a UAV Through Urban Canyons," Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Vol.3, IEEE Publications, Piscataway, NJ, Feb. 2004, pp. 2673-2680. doi:10.1109/IROS.2004.1389812 (Pubitemid 40275999)
51. Humbert, J. S., Hyslop, A., and Chinn, M., "Experimental Validation of Wide-Field Integration Methods for Autonomous Navigation," Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE Publications, Piscataway, NJ, Dec. 2007, pp. 2144-2149. doi:10.1109/IROS.2007. 4399488
52. Hyslop, A. M., and Humbert, J. S., "Wide-Field Integration Methods for Autonomous Navigation of 3-D Environments," AIAA Guidance, Navigation, and Control Conference, AIAA Paper 2008-7252, 2008.
53. DeSouza, G. N., and Kak, A. C., "Vision for Mobile Robot Navigation: A Survey," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.24, No.2, 2002, pp. 237-266. doi:10.1109/34.982903