Visual guidance based on optic flow: A biorobotic approach

Journal of Physiology Paris

Volumn 98, Issue 1-3 SPEC. ISS., 2004, Pages 281-292

  Franceschini, Nicolas ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

Author keywords

Biomimetics; Bionics; Biorobotics; Flies; Vision; Visuo motor control

Indexed keywords

BIOMIMETICS; COMPUTER SIMULATION; ETHOLOGY; FLOW RATE; MODEL; NEUROBIOLOGY; NEUROPHYSIOLOGY; NONHUMAN; OPTICAL BIOSENSOR; OPTICAL DENSITY; RETINA IMAGE; REVIEW; ROBOTICS; SENSORIMOTOR FUNCTION; VISION; VISUAL ACUITY; VISUAL SYSTEM;

EID: 5144230290     PISSN: 09284257     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jphysparis.2004.06.002     Document Type: Article

References (113)

1. Aloimonos Y. Active Perception. 1993;Lawrence Erlbaum, Hillsdale, USA
2. Arkin R. Behavior-based Robotics. 1998;MIT Press, Cambridge, USA
3. Ayers J., Davis J.L., Rudolph A. Neurotechnology for Biomimetic Robots. 2002;MIT Press, Cambridge, USA
4. R. Bajcsy, Active perception versus passive perception, in: Proc. 3rd IEEE Workshop on Computer Vision: Representation and control, Bellaire, MI, USA, 1985, pp. 55-59
5. Ballard D. Animate vision. Artificial Intelligence. 48:1991;57-86
6. Barlow H.B., Frisby J.P., Horridge A., Jeeves M. Natural and Artificial Low-level Seeing Systems. 1993;Clarendon Press, Oxford
7. C. Blanes, Appareil visuel élémentaire pour la navigation à vue d'un robot mobile autonome, DEA thesis (Neurosciences), Aix-Marseille Univ., 1986
8. C. Blanes, Guidage visuel d'un robot mobile autonome d'inpiration bionique, Dr thesis, National Polytechnic Institute, Grenoble, 1991
9. Braitenberg V. Vehicles. 1984;MIT Press, Cambridge, USA
10. Brooks R.A. Cambrian Intelligence. 1999;MIT Press, Cambridge, USA
11. Buchner E. Behavioral analysis of spatial vision in insects. Ali M. Photoreception and Vision in Invertebrates. 1984;561-621 Plenum, New York
12. Burrows M. The Neurobiology of an Insect Brain. 1996;Oxford University Press, Oxford
13. Chang C., Gaudiano P. Biomimetic robotics. Robotics and Autonomous Systems (Special Issue). 30:2000
14. D. Cliff, P. Husbands, J.A. Meyer, S.W. Wilson, From animals to animats III, in: Proc. Intern. Conf. on Simulation of Adaptive Behavior, MIT Press, Cambridge, 1994
15. Collett T., Land M. Visual control of flight behaviour in the hoverfly Syritta Pipiens L. J. Comp. Physiol. A. 99:1975;1-66
16. Collett T., Nalbach H.O., Wagner H. Visual stabilisation in arthropods. Miles F.A., Wallman J. Visual Motion and its Role in the Stabilization of Gaze. 1993;239-263 Elsevier, Amsterdam
17. Collett T.S. Peering: a locust behaviour pattern for obtaining motion parallax information. J. Exp. Biol. 76:1978;237-241
18. D. Coombs, K. Roberts, Bee-Bot: Using the peripheral optic flow to avoid obstacles, in: Intelligent Robots and Computer Vision XI, SPIE vol. 1835, Bellingham, USA, 1992, pp. 714-725
19. Dickinson M., Tammero L., Tarsino M. Sensory fusion in free-flight search behavior of fruit flies. Ayers J., Davis J., Rudolph A. Neurotechnology for Biomimetic Robots. 2002;573-592 MIT Press, Cambridge, USA
20. Douglas R., Mahowald M., Mead C. Neuromorphic Engineering. Annu. Rev. Neurosci. 18:1995;255-281
21. Douglass J.K., Strausfeld N.J. Anatomical organization of retinotopic motion-sensitive pathways in the optic lobes of flies. Microsc. Res. Technol. 62:2003;132-150
22. A.P. Duchon, W.H. Warren, Robot navigation from a Gibsonian viewpoint, in: IEEE Intern. Conf. on Syst., Man and Cybernetics, San Antonio, IEEE Press, Los Alamitos, USA, 1994, pp. 2272-2277
23. Franceschini N. Sampling of the visual environment by the compound eye of the fly: fundamentals and applications. Snyder A., Menzel R. Photoreceptor Optics. 1975;98-125 Springer, Berlin. (Chapter 17)
24. Franceschini N. Chromatic organisation and sexual dimorphism of the fly retinal mosaic. Borsellino A., Cervetto L. Photoreceptors. 1984;319-350 Plenum, New York
25. Franceschini N. Early processing of color and motion in a mosaic visual system. Neurosci. Res. (Suppl. 2):1985;17-49
26. Franceschini N. Engineering applications of small brains. Future Electron Devices Journal. (Suppl. 7):1996;38-52
27. Franceschini N. Sequence-discriminating neural network in the eye of the fly. Eeckman F.H.K. Analysis and Modeling of Neural Systems. 1992;142-150 Kluwer-Academic, Norwell, USA
28. Franceschini N. Combined optical, neuroanatomical, electrophysiological and behavioural studies on signal processing in the fly compound eye. Taddei-Ferretti C. Biocybernetics of vision: Integrative Mechanisms and Cognitive Processes. 1998;341-361 World Scientific, London
29. Franceschini N., Chagneux R. Repetitive scanning in the fly compound eye. Elsner N., Wässle H. Göttingen Neurobiology Rep. 1997;279 Georg Thieme, Stuttgart
30. N. Franceschini, C. Blanes, L. Oufar, Passive noncontact velocity sensor, Dossier Technique ANVAR/DVAR No. 51,549, Paris, 1986 (in French)
31. Franceschini N., Pichon J.M., Blanes C. From insect vision to robot vision. Philos. Trans. Roy. Soc. Lond. B. 337:1992;283-294
32. Franceschini N., Pichon J.M., Blanes C. Bionics of visuomotor control. Gomi T. Evolutionary Robotics: from Intelligent Robots to Artificial life. 1997;49-67 AAAI Books, Ottawa, Canada
33. Franceschini N., Riehle A., Le Nestour A. Directionally Selective Motion Detection by Insect Neurons. Stavenga D.G., Hardie R.C. Facets of Vision. 1989;360-390 Springer, Berlin. (Chapter 17)
34. Gibson J.J. Perception of the Visual World. 1950;Houghton, Mifflin, Boston
35. Gibson J.J., Olum P., Rosenblatt F. Parallax and perspective during aircraft landings. Am. J. Psychol. 68:1955;372-385
36. Gibson J.J. Visually controlled locomotion and visual orientation in animals. Brit. J. Psychol. 49:1958;182-194
37. Götz K.G. Flight control in Drosophila by visual perception of motion. Kybernetik. 4:1969;199-208
38. Goulet M., Campan R. The visual perception of the relative distance in the wood cricket Nemobius sylvestris. Physiol. Entomol. 6:1981;357-387
39. Grind van de Grind W. Smart mechanisms for the evaluation and control of self-motion. Warren R., Wertheim A.H. Perception and Control of Self-motion. 1990;357-398 Lawrence Erlbaum, London
40. Hardie R.C. Functional organization of the fly retina. Ottosson D. Progress in Sensory Physiology 5. 1985;Springer, Berlin
41. Harrison R., Koch C. A silicon implementation of the fly's optomotor control system. Neural Computation. 12:2000;2291-2304
42. Hausen K., Egelhaaf M. Neural mechanisms of visual course control in insects. Stavenga D.G., Hardie R.C. Facets of Vision. 1989;391-424 Springer, Berlin. (Chapter 18)
43. Heisenberg M., Wolf R. Vision in Drosophila. 1984;Springer, Berlin
44. Horridge G.A. The evolution of visual processing and the construction of seeing systems. Proc. Roy. Soc. Lond. B. 230:1987;279-292
45. Hoyle G. Identified Neurons and Behavior of Arthropods. 1977;Plenum, New York
46. Huber S.A., Franz M.O., Bülthoff H.H. On robots and flies: modeling the visual orientation behavior of flies. Robot. Autonom. Syst. 29:1999;227
47. Ichikawa M., Yamada H., Takeuchi J. Flying robot with biologically inspired vision. J. Robot. Mechatron. 6:2001;621-624
48. Iida F. Biologically inspired visual odometer for navigation of a flying robot. Robot. Autonom. Syst. 44:2003;201-208
49. F. Iida, D. Lambrinos, Navigation in an autonomous flying robot by using a biologically inspired visual odometer, in: G.T. McKee, P.S. Schenker (Eds.), Sensor Fusion and Decentralized Control in Robotic Systems III, SPIE vol. 4196, Bellingham, USA, 2000
50. Indiveri G., Kramer J., Koch C. System implementation of analog VLSI velocity sensors. IEEE Micro. 16:1996;40-49
51. Kennedy J.S. The migration of the desert locust. Philos. Trans. Roy. Soc. B. 235:1951;163-290
52. Kirchner W.H., Srinivasan M.V. Freely flying honeybees use image motion to estimate distance. Naturwissenschaften. 76:1989;281-282
53. Koenderink J.J. Optic flow. Vis. Res. 26:1986;161-180
54. Krapp H., Hengstenberg B., Hengstenberg R. Dendritic structure and receptive-field organisation of optic flow processing interneurons in the fly. J. Neurophysiol. 79:1998;1902-1917
55. Land M. Variations in the structure and design of compound eyes. Stavenga D.G., Hardie R.C. Facets of Vision. 1989;90-111 Springer, Berlin. (Chapter 5)
56. Lee D.N. The optic flow field: the foundation of vision. Philos. Trans. Roy. Soc. Lond. Ser. B. 290:1980;169-179
57. Lee D.N. Visual information during locomotion. Macleod R.B., Pick H.L. Perception: Essays in Honour of James Gibson. 1974;250-267 Cornell University Press, Ithaca/London
58. Lehrer M., Srinivasan M.V., Zhang S.W., Horridge G.A. Motion cues provide the bee's visual world with a third dimension. Nature (London). 332:1988;356-357
59. Lewis M.A., Nelson M.A. Look before you leap: peering behavior for depth perception. Pfeifer R., Blumberg B., Meyer J.A., Wilson S. From Animals to Animats 5. 1998;98-103 MIT Press, Cambridge, USA
60. Lewis M.A., Arbib M. Biomorphic robots. Autonomous Robots (Special Issue). 77:1999
61. Maes P. Designing Autonomous Agents: Theory and Practice from Biology to Engineering and Back. 1991;MIT Press, Cambridge, USA
62. Martin N., Franceschini N. Obstacle avoidance and speed control in a mobile vehicle equipped with a compound eye. Masaki I. Intelligent Vehicles. 1994;381-386 MIT Press, Cambridge, USA
63. M.J. Mataric, Navigating with a rat brain: a neurobiologically inspired model for robot spatial representation, in: J.A. Meyer, S. Wilson (Eds.), From Animal to Animats, MIT Press, Cambridge, USA (1990)
64. Mead C.A. Analog VLSI and Neural Systems. 1989;Addison-Wesley, Reading, MA
65. Miles F.A., Wallman J. Visual Motion and its Role in the Stabilization of Gaze. 1993;Elsevier, Amsterdam
66. Möller R., Lambrinos D., Pfeifer R., Labhart T., Wehner R. Modeling ant navigation with an autonomous agent. Pfeifer R., Blumberg B., Meyer J.A., Wilson S. From Animals to Animats 5. 1998;185-194 MIT Press, Cambridge, USA
67. Mura F., Franceschini N. Visual control of altitude and speed in a flying agent. Cliff D., Husbands P., Meyer J.A., Wilson S.W. From Animals to Animats. 1994;91-99 MIT Press, Cambridge
68. Mura F., Franceschini N. Obstacle avoidance in a terrestrial mobile robot provided with a scanning retina. Aoki M., Masaki I. Intelligent Vehicles II. 1996;47-52
69. F. Mura, N. Franceschini, Biologically inspired 'retinal scanning' enhances motion perception of a mobile robot, in: A. Bourjault, S. Hata (Eds.), Proc. 1st Europe-Asia Congress on Mechatronics, vol. 3, ENSM, Besançon, 1996, pp. 934-940
70. F. Mura, I. Shimoyama, Visual guidance of a small mobile robot using active, biologically-inspired eye movements, in: Proc. IEEE Intern. Conf. Rob. Autom. 3, 1998, pp. 1859-1864
71. Nachtigall W. Bionik. second ed.:2002;Springer, Berlin
72. Nakayama K., Loomis J.M. Optical velocity patterns, velocity sensitive neurons and space perception: a hypothesis. Perception. 3:1974;63-80
73. T. Netter, N. Franceschini, Neuromorphic optical flow sensing for nap-of-the-earth flight, in: Mobile Robots XIV, SPIE vol. 3838, Bellingham, USA, 1999, pp. 208-216
74. T. Netter, N. Franceschini, A robotic aircraft that follows terrain using a neuromorphic eye, in: Intelligent Robots and Systems, Proc. IROS-2002, EPFL, Lausanne, 2002, pp. 129-134
75. T.R. Neumann, H.H. Bülthoff, Insect inspired visual control of translatory flight, in: Proc. European Conf. on Artificial Life, ECAL 2001, Springer, Berlin, 2001, pp. 627-636
76. Neumann T.R., Huber S., Bülthoff H.H. Artificial systems as models in biological cybernetics. Behav. Brain Sci. 2001;1071-1072
77. O'Shea M., Rowell H. CHF, complex neural integration and identified interneurons in the locust brain. Hoyle G. Identified Neurons and Behaviour of Arthropods. 1977;307-328 Plenum, New York
78. R. Pfeiffer, D. Lambrinos, Cheap vision - exploiting ecological niche and morphology, in: V. Hlavac, K.G. Jeffery, J. Wiedemann (Eds.), SOFCEM 2000, 27th Conf., Current Trends in Theory and Practice of Informatics, Milovy, Czech Republic, November 2000, pp. 202-226
79. Pfeiffer R., Scheier C. Understanding Intelligence. 2001;MIT Press, Cambridge
80. J.M. Pichon, C. Blanes, N. Franceschini, Visual guidance of a mobile robot equipped with a network of self-motion sensors, in: W.J. Wolfe, W.H. Chun (Eds.), Mobile Robots IV, Proc. SPIE vol. 1195, Bellingham, USA, 1989, pp. 44-53
81. Reichardt W. Movement perception in insects. Processing of Optical Data by Organisms and by Machines. 1969;465-493 Academic Press, New York
82. Reichardt W. Evaluation of optical motion information by movement detectors. J. Comp. Physiol. A. 161:1987;533-547
83. Riehle A., Franceschini N. Motion detection in flies: parametric control over ON-OFF pathways. Exp. Br. Res. 54:1984;390-394
84. F. Ruffier, N. Franceschini, OCTAVE: a bioinspired visuo-motor control system for the guidance of Micro-Air-Vehicles, in: A. Gabriel-Vasquez, D. Abbott, R. Carmona (Eds.), Bioengineered and Bioinspired systems, SPIE vol. 5119, 2003, pp. 1-12
85. F. Ruffier, S. Viollet, N. Franceschini, Visual control of two aerial mini-robots by insect based autopilots, Advanced Robotics, 2004, in press
86. F. Ruffier, N. Franceschini, Visually guided micro-aerial robot: take off, terrain following, landing and wind reaction, in: Proc. IEEE Intern. Cong. Robotics and Automation (ICRA 2004), New Orleans, USA, 2004
87. F. Ruffier, S. Viollet, S. Amic, N. Franceschini, Bio-inspired optical flow circuits for the visual guidance of micro-air vehicles, in: Proc. IEEE Int. Symp. on Circuits and Systems, ISCAS 03, Bangkok, Thailand, 2003
88. G. Sandini, J. Santos-Victor, F. Curotto, S. Garibaldi, Robotic bees, in: Proc. IEEE Conf. on Intelligent Robots and Systems (IROS93), New York, 1993
89. R. Sarpeshkar, J. Kramer, C. Koch, Pulse domain neuromorphic circuit for computing motion, United States Patent No. 5,781,648 (1998)
90. Schilstra C., van Hateren J.H. Blowfly flight and optic flow. 1. Thorax kinematics and flight dynamics. J. Exp. Biol. 202:1999;1481-1490
91. Srinivasan M.V. How insects infer range from motion. Miles F.A., Wallman J. Visual Motion and its Role in the Stabilisation of Gaze. 1993;139-156 Elsevier
92. Srinivasan M., Venkatesh S. From Living Eyes to Seeing Machines. 1997;Oxford University Press, Oxford
93. Srinivasan M.V., Lehrer M., Kirchner W., Zhang S.W. Range perception through apparent image speed in freely flying honeybees. Vis. Neurosci. 6:1991;519-535
94. Stavenga D.G., Hardie R.C. Facets of Vision. 1989;Springer, Berlin
95. Srausfeld N.J. Atlas of an Insect Brain. 1976;Springer, Berlin
96. Strausfeld N.J. Beneath the compound eye: neuroanatomical analysis and physiological correlates in the study of insect vision. Stavenga D.G., Hardie R.C. Facets of Vision. 1989;317-359 Springer, Berlin. (Chapter 16)
97. Tammero L.F., Dickinson M. The influence of visual landscape on the free flight behavior of the fruitfly Drosophila Melanogaster. J. Exp. Biol. 205:2002;327-343
98. Ullman S. Artificial intelligence and the brain; computational studies of the visual system. Annu. Rev. Neurosci. 9:1986;1-26
99. Vaney D.I., He S., Taylor W.R., Levick W.R. Direction selective ganglion cells in the retina. Zanker J.M., Zeil J. Motion Vision: Computational, Neural and Ecological Constraints. 2001;13-65 Springer, Berlin
100. S. Viollet, N. Franceschini, Biologically-inspired visual scanning sensor for stabilization and tracking, in: Proc. IEEE Intern. Conf. Intelligent Robots and Systems (IROS'99) Kyon-gyu, Korea, 1999, pp. 204-209
101. S. Viollet, N. Franceschini, Visual servo-system based on a biologically-inspired scanning sensor, in: Sensor Fusion and Decentralized Control II, SPIE vol. 3839, Bellingham, USA, 1999, pp. 144-155
102. Viollet S., Franceschini N. Superaccurate visual control of an aerial minirobot. Rückert U., Sitte J., Witkowski U. Autonomous Minirobots for Research and Edutainment. 2001;215-224 Heinz Nixdorf Institut, Paderborn, Germany
103. Vittoz E. Analog VLSI signal processing: why where and how? J. VLSI Signal Proc. 8:1994;27-44
104. Wagner H. Flow-field variables trigger landing in flies. Nature. 297:1982;147-148
105. Wagner H. Flight performance and visual control of flight of the free-flying housefly Musca domestica, I/II/III. Philos. Trans. Roy. Soc. B. 312:1986;527-600
106. Warren W.H., Kay B.A., Zosh D., Duchon P., Sahuc S. Optic flow is used to control human walking. Nature Neurosci. 4:2001;213-216
107. Webb B. Can robots make good models of biological behavior? Behav. Brain Sci. 24:2001;6
108. Webb B. Robots in invertebrate neuroscience. Nature. 417:2002;359-363
109. Webb B., Consi T. Biorobotics. 2001;MIT Press, Cambridge, USA
110. R. Wehner, Spatial Vision in Arthropods, in: H.J. Autrum (Ed.), Handbook of Sensory Physiology, vol. VII/6C, Springer, Berlin, 1981, pp. 288-616
111. Wehrhahn C. Sex-specific differences in the chasing behaviour of free-flying houseflies. Biol. Cyb. 32:1979;239-241
112. Whiteside T.C., Samuel D.G. Blur zone. Nature. 225:1970;94-95
113. Zaretsky M., Rowell F.C.H. Saccadic suppression by corollary discharge in the locust. Nature. 280:1979;583-585