Fly-inspired visual steering of an ultralight indoor aircraft

IEEE Transactions on Robotics

Volumn 22, Issue 1, 2006, Pages 137-146

  Zufferey, Jean Christophe ^a   Floreano, Dario ^a  

^a EPFL   (Switzerland)

Author keywords

Collision avoidance; Indoor flying robot; Optic flow (OF); Steering control

Indexed keywords

ALGORITHMS; COLLISION AVOIDANCE; COMPUTER VISION; MATHEMATICAL MODELS; MICROSENSORS; MOTION CONTROL; SIGNAL PROCESSING; STEERING;

INDOOR FLYING ROBOT; OPTIC FLOW; STEERING CONTROL; ULTRALIGHT INDOOR AIRCRAFT;

ROBOTICS;

EID: 32644445914     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2005.858857     Document Type: Article

References (58)

1. J. Zufferey and D. Floreano, "Toward 30-gram autonomous indoor aircraft: Vision-based obstacle avoidance and altitude control," in Proc. IEEE Int. Conf. Robot. Autom., Barcelona, Spain, 2005, pp. 2605-2610.
2. M. Land, "Visual acuity in insects," Annu. Rev. Entomol., vol. 42, pp. 147-177, 1997.
3. J. Gibson, The Perception of the Visual World. Boston, MA: Houghton Mifflin, 1950.
4. M. Egelhaaf and R. Kern, "Vision in flying insects," Current Opinion Neurobiol., vol. 12, no. 6, pp. 699-706, 2002.
5. J. Koenderink and A. van Doorn, "Facts on optic flow," Biol. Cybern., vol. 56, pp. 247-254, 1987.
6. H. Wagner, "Flight performance and visual control of flight of the free-flying housefly (musca domestica l.). I. Organization of the flight motor," Philos. Trans. Roy. Soc. B, vol. 312, pp. 527-551, 1986.
7. L. Tammero and M. Dickinson, "The influence of visual landscape on the free flight behavior of the fruit fly drosophila melanogaster," J. Exp. Biol., vol. 205, pp. 327-343, 2002.
8. M. Dickinson, "Haltere-mediated equilibrium reflexes of the fruit fly, drosophila melanogaster," Philos. Trans.: Biol. Sci., vol. 354, no. 1385, pp. 903-916, 1999.
9. G. Nalbach and R. Hengstenberg, "The halteres of the blowfly calliphora - Three-dimensional organization of compensatory reactions to real and simulated rotations," J. Comparative Physiol. A, vol. 175, pp. 695-708, 1994.
10. N. Franceschini, J. Pichon, and C. Blanes, "From insect vision to robot vision," Philos. Trans. Roy. Soc. B, vol. 337, pp. 283-294, 1992.
11. M. Srinivasan, J. Chahl, M. Nagle, and S. Zhang, "Embodying natural vision into machines," in From Living Eyes to Seeing Machines, M. Srinivasan and S. Venkatesh, Eds. Oxford, U.K.: Oxford Univ. Press, 1997, pp. 249-265.
12. A. Duchon, W. H. Warren, and L. Kaelbling, "Ecological robotics," Adapt. Behav., vol. 6, pp. 473-507, 1998.
13. M. Lewis, "Visual navigation in a robot using zig-zag behavior," in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1998, vol. 10.
14. D. Coombs, M. Herman, T. Hong, and M. Nashman, "Real-time obstacle avoidance using central flow divergence and peripheral flow," in Proc. 5th Int. Conf. Comput. Vis., 1995, pp. 276-283.
15. J. Santos-Victor, G. Sandini, F. Curotto, and S. Garibaldi, "Divergent stereo for robot navigation: A step forward to a robotic bee," Int. J. Comput. Vis., vol. 14, pp. 159-177, 1995.
16. K. Weber, S. Venkatesh, and M. Srinivasan, "Insect inspired behaviors for the autonomous control of mobile robots," in From Living Eyes to Seeing Machines, M. V. Srinivasan and S. Venkatesh, Eds. Oxford, U.K.: Oxford Univ. Press, 1997, pp. 226-248.
17. M. Srinivasan, J. Chahl, K. Weber, S. Venkatesh, and H. Zhang, "Robot navigation inspired by principles of insect vision," in Field and Service Robotics, A. Zelinsky, Ed. New York: Springer-Verlag, 1998, pp. 12-16.
18. J. Zufferey, "Bioinspired vision-based flying robots," Ph.D. dissertation, Swiss Federal Inst. Technol. Lausanne (EPFL), Lausanne, Switzerland, 2005.
19. I. Kroo and P. Kunz, "Mesoscale flight and miniature rotorcraft development," in Fixed and Flapping Wing Aerodynamics for Micro Air Vehicle Applications. ser. Progress in Astronautics and Aeronautics, T. J. Mueller, Ed: AIAA, 2001, vol. 195, pp. 503-517.
20. T. Pornsin-Sirirak, Y.-C. Tai, and C.-M. Ho. Microbat: A palm-sized electrically powered ornithopter. presented at Proc. NASA/JPL Workshop Biomorphic Robot. [Online]. Available: http://touch.cal-tech.edu/ publications/2001/jpl/jpl2001.pdf
21. K. Jones, C. Bradshaw, J. Papadopoulos, and M. Platzer, "Improved performance and control of flapping-wing propelled micro air vehicles," in Proc. 42nd Aerosp. Sci. Meeting Exhibit., Reno, NV, 2004, Paper 2004-0399.
22. R. Fearing, K. Chiang, M. Dickinson, D. Pick, M. Sitti, and J. Yan, "Wing transmission for a micromechanical flying insect," in Proc. IEEE Int. Conf. Robot. Autom., 2000, pp. 1509-1516.
23. S. Avadhanula, R. Wood, E. Steltz, J. Yan, and R. Fearing, "Lift force improvements for the micromechanical flying insect," in Proc. IEEE Int. Conf. Intell. Robots Syst., 2003, pp. 1350-1356.
24. W. Wu, L. Schenato, R. Wood, and R. Fearing, "Biomimetic sensor suite for flight control of a micromechanical flight insect: Design and experimental results," in Proc. IEEE Int. Conf. Robot. Autom., Taipei, Taiwan, R.O.C., 2003, pp. 1146-1151.
25. L. Schenato, W. Wu, and S. Sastry, "Attitude control for a micromechanical flying insect via sensor output feedback," IEEE Trans. Robot. Autom., vol. 20, no. 1, pp. 93-106, Feb. 2004.
26. J. Nicoud and J. Zufferey, "Toward indoor flying robots," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2002, pp. 787-792.
27. F. Mura and N. Franceschini, "Visual control of altitude and speed in a flying agent," in From Animals to Animats III. Cambridge, MA: MIT Press, 1994, pp. 91-99.
28. F. Ruffier and N. Franceschini, "Visually guided micro-aerial vehicle: Automatic take off, terrain following, landing and wind reaction," in Proc. IEEE Int. Conf. Robot. Autom., T. J. Tarn, T. Fukuda, and K. Valavanis, Eds., New Orleans, LA, Apr. 2004, pp. 2339-2346.
29. J. Chahl, M. Srinivasan, and H. Zhang, "Landing strategies in honeybees and applications to uninhabited airborne vehicles," Int. J. Robot. Res., vol. 23, no. 2, pp. 101-1102, 2004.
30. T. Neumann and H. Bülthoff, "Behavior-oriented vision for biomimetic flight control," in Proc. EPSRC/BBSRC Int. Workshop Biol. Inspired Robot., 2002, pp. 196-203.
31. L. Muratet, S. Doncieux, Y. Brière, and J.-A. Meyer, "A contribution to vision-based autonomous helicopter flight in urban environments," Robot. Auton. Syst., to be published.
32. M. Reiser and M. Dickinson, "A test bed for insect-inspired robotic control," Philos. Trans.: Math., Phys., Eng. Sci., vol. 361, pp. 2267-2285, 2003.
33. G. Barrows and C. Neely, "Mixed-mode VLSI optic flow sensors for in-flight control of a micro air vehicle," Critical Technol. Future Comput., SPIE, vol. 4109, pp. 52-63, 2000.
34. G. Barrows, C. Neely, and K. Miller, "Optic flow sensors for MAV navigation," in Fixed and Flapping Wing Aerodynamics for Micro Air Vehicle Applications. ser. Progress in Astronautics and Aeronautics, T. J. Mueller, Ed: AIAA, 2001, vol. 195, pp. 557-574.
35. W. Green, P. Oh, K. Sevcik, and G. Barrows, "Autonomous landing for indoor flying robots using optic flow," in Proc. ASME Int. Mech. Eng. Congr. Expo., vol. 2, 2003, pp. 1347-1352.
36. P. Oh, W. Green, and G. Barrows, "Closed quarter aerial robot prototype to fly in and around buildings," in Proc. Int. Conf. Comput., Commun., Control Technol., vol. 5, 2003, pp. 302-307.
37. W. Green, P. Oh, and G. Barrows, "Flying insect inspired vision for autonomous aerial robot maneuvers in near-earth environments," in Proc. IEEE Int. Conf. Robot. Autom., vol. 3, 2004, pp. 2347-2352.
38. R. Nelson and Y. Aloimonos, "Finding motion parameters from spherical flow fields (or the advantages of having eyes in the back of your head)," Biol. Cybern., vol. 58, pp. 261-273, 1988.
39. H. Krapp, "Neuronal matched filters for optic flow processing in flying insects," in Neuronal Processing of Optic Flow, M. Lappe, Ed. San Diego, CA: Accademic, 2000, pp. 93-120.
40. J. Zufferey, A. Beyeler, and D. Floreano, "Vision-based navigation from wheels to wings," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., vol. 3, 2003, pp. 2968-2973.
41. M. Srinivasan, "An image-interpolation technique for the computation of optic flow and egomotion," Biol. Cybern., vol. 71, pp. 401-416, 1994.
42. B. Horn, Robot Vision. Cambridge, MA: MIT Press, 1986.
43. N. Ancona and T. Poggio, "Optical flow from 1D correlation: Application to a simple time-to-crash detector," in Proc. 4th Int. Conf. Comput. Vis., 1993, pp. 209-214.
44. T. Poggio, A. Verri, and V. Torre, "Green theorems and qualitative properties of the optical flow," Mass. Inst. Technol., Cambridge, MA, Tech. Rep. A.I. Memo 1289, 1991.
45. D. Lee, "A theory of visual control of braking based on information about time-to-collision," Perception, vol. 5, pp. 437-459, 1976.
46. T. Camus, "Calculating time-to-contact using real-time quantized optical flow," Nat. Inst. Standards Technol., Tech. Rep. 5609, 1995.
47. M. Srinivasan, S. Zhang, M. Lehrer, and T. Collett, "Honeybee navigation en route to the goal: Visual flight control and odometry," J. Exp. Biol., vol. 199, pp. 237-244, 1996.
48. A. Borst, "How do flies land? From behavior to neuronal circuits," BioSci., vol. 40, no. 4, pp. 292-299, 1990.
49. R. Brooks, Cambrian Intelligence. Cambridge, MA: The MIT Press, 1999.
50. R. Hengstenberg, "Gaze control in the blowfly calliphora: A multisensory two-stage integration process," Neurosci., vol. 3, pp. 19-29, 1991.
51. W. Reichardt, "Movement perception in insects," in Processing of Optical Data by Organizms and by Machines, W. Reichardt, Ed. New York: Academic, 1969, pp. 465-493.
52. M. Srinivasan, M. Poteser, and K. Kral, "Motion detection in insect orientation and navigation," Vis. Res., vol. 39, no. 16, pp. 2749-2766, 1999.
53. L. Tammero and M. Dickinson, "Collision-avoidance and landing responses are mediated by separate pathways in the fruit fly," J. Exp. Biol., vol. 205, pp. 2785-2798, 2002.
54. M. Srinivasan, S. Zhang, J. Chahl, E. Barth, and S. Venkatesh, "How honeybees make grazing landings on flat surfaces," Biol. Cybern., vol. 83, pp. 171-183, 2000.
55. N. Franceschini, "From fly vision to robot vision: Reconstruction as a mode of discovery," in Sensors and Sensing in Biology and Engineering, F. G. Barth, J. A. Humphrey, and T. W. Secomb, Eds. New York: Springer, 2003, pp. 223-235.
56. A. Sherman and M. Dickinson, "Summation of visual and mechanosensory feedback in drosophila flight control," J. Exp. Biol., vol. 207, pp. 133-142, 2004.
57. J. Kramer, R. Sarpeshkar, and C. Koch, "An analog VLSI velocity sensor," in Proc. IEEE Int. Symp. Circuits Syst., 1995, pp. 413-416.
58. A. Beyeler, C. Mattiusi, J. Zufferey, and D. Floreano, "Vision-based altitude and pitch estimation for ultralight indoor aircraft," in Proc. IEEE Int. Conf. Robot. Autom., to be published.