Collision detection in complex dynamic scenes using an LGMD-based visual neural network with feature enhancement

IEEE Transactions on Neural Networks

Volumn 17, Issue 3, 2006, Pages 705-716

  Yue, Shigang ^a   Rind, F Claire ^a  

^a NEWCASTLE UNIVERSITY   (United Kingdom)

Author keywords

Collision detection; Complex environment; Dynamic visual scene; Mobile robot; Visual neural network

Indexed keywords

COLLISION AVOIDANCE; FEATURE EXTRACTION; MOBILE ROBOTS; MOTION ESTIMATION; REAL TIME SYSTEMS; ROBOTICS; VISUALIZATION;

COLLISION DETECTION; DYNAMIC VISUAL SCENE; LOBULA GIANT MOVEMENT DETECTOR; VISUAL NEURAL NETWORK;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 33646517023     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2006.873286     Document Type: Article

References (39)

1. M. D. Adams, Sensor Modeling, Design and Data Processing for Autonomous Navigation. River Edge, NJ: World Scientific, 1998.
2. G. Benet, F. Blanes, J. E. Simo, and P. Perez, "Using infrared sensors for distance measurement in mobile robots," Robot. Autonom. Syst., vol. 40, pp. 255-266, 2002.
3. M. Blanchard, P. F. M. J. Verschure, and F. C. Rind, "Using a mobile robot to study locust collision avoidance responses," Int. J. Neural Syst., vol. 9, pp. 405-410, 1999.
4. M. Blanchard, F. C. Rind, and P. F. M. J. Verschure, "Collision avoidance using a model of the locust LGMD neuron," Robot. Autonom. Syst., vol. 30, pp. 17-38, 2000.
5. A. Borst and J. Haag, "Neural networks in the cockpit of the fly," J. Comput. Phys., vol. 188, pp. 419-437, 2002.
6. H. Buxton, "Learning and understanding dynamic scene activities: A review," Image Vis. Comput., vol. 21, pp. 125-136, 2003.
7. E. R. Davies, Machine Vision: Theory, Algorithms, Practicalities. San Diego, CA: Academic Press, 1997.
8. G. N. DeSouza and A. C. Kak, "Vision for mobile robot navigation: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 2, pp. 237-267, Feb. 2002.
9. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
10. H. R. Everett, Sensors for Mobile Robots: Theory and Application. Wellesley, MA: AK Peters, 1995.
11. M. Fiala and A. Basu, "Robot navigation using panoramic tracking," Pattern Recognit., vol. 37, pp. 2195-2215, 2004.
12. N. Franceschini, "Visual guidance based on optic flow: A biorobotic approach," J. Phys.-Paris, vol. 98, pp. 281-292, 2004.
13. F. Gabbiani, H. G. Krapp, C. Koch, and G. Laurent, "Multiplicative computation in a visual neuron sensitive to looming," Nature, vol. 420, no. 21, pp. 320-324, 2002.
14. F. Gabbiani, H. G. Krapp, N. Hatsopoulos, C.-H. Mo, C. Koch, and G. Laurent, "Multiplication and stimulus invariance in a looming-sensitive neuron," J. Phys.-Paris, vol. 98, pp. 19-34, 2004.
15. R. R. Harrison and C. Koch, "A silicon implementation of the fly's optomotor control system," Neural Comput., vol. 12, pp. 2291-2304, 2000.
16. S. A. Hubber, M. O. Franz, and H. H. Buelthoff, "On robots and flies: modeling the visual orientatin behavior of flies," Robot. Autonom. Syst., vol. 29, pp. 227-242, 1999.
17. S. J. Judge and F. C. Rind, "The locust DCMD, a movement detecting neurone tightly tuned to collision trajectories," J. Experimental Biol., vol. 200, pp. 2209-2216, 1997.
18. Khepera User Manual, Switzerland, Mar. 2002.
19. F. Iida, "Biologically inspired visual odometer for navigation of a flying robot," Robot. Autonom. Syst., vol. 44/3-4, pp. 201-208, 2003.
20. G. Indiveri and R. Douglas, "Neuromorphic vision sensors," Science, vol. 288, pp. 1189-1190, 2000.
21. R. Manduchi, A. Castano, A. Talukder, and L. Matthies, "Obstacle detection and terrain classification for autonomous off-road navigation," Autonomous Robots, vol. 18, pp. 81-102, 2005.
22. C. F. Olson, L. H. Matthies, M. Schoppers, and M. W. Maimone, "Rover naviation using stereo ego-motion," Robot. Autonom. Syst., vol. 43, pp. 215-229, 2003.
23. M. O'Shea, C. H. F. Rowell, and J. L. D. Williams, "The anatomy of a locust visual interneurone: The descending contralateral movement detector," J. Experimental Biol., vol. 60, pp. 1-12, 1974.
24. F. C. Rind, "A directionally selective motion-detecting neurone in the brain of the locust: Physiological and morphological characterization," J. Experimental Biol., vol. 149, pp. 1-19, 1990.
25. F. C. Rind, "Identification of directionally selective motion-detecting neurones in the locust lobula and their synaptic connections with an identified descending neurone," J. Experimental Biol., vol. 149, pp. 21-43, 1990.
26. F. C. Rind and P. J. Simmons, "Orthopteran DCMD neuron: A reevaluation of responses to moving objects. I. Selective responses to approaching objects," J. Neurophys., vol. 68, pp. 1654-1666, 1992.
27. F. C. Rind and D. I. Bramwell, "Neural network based on the input organization of an identified neuron signaling impending collision," J. Neurophys., vol. 75, pp. 967-985, 1996.
28. F. C. Rind and P. J. Simmons, "Seeing what is coming: Building collision sensitive neurons," Trends in Neurosci., vol. 22, pp. 215-220, 1999.
29. F. C. Rind, R. D. Santer, J. M. Blanchard, and P. F. M. J. Verschure, "Locust's looming detectors for robot sensors," in Sensors and Sensing in Biology and Engineering, F. G. Barth, J. A. C. Humphrey, and T. W. Secomb, Eds. Wien, Austria: Spinger-Verlag, 2003.
30. C. H. F. Rowell, M. O'Shea, and J. L. D. Williams, "The neuronal basis of a sensory analyzer, the acridid movement detector system," J. Experimental Biol., vol. 68, pp. 157-185, 1977.
31. A. Rosenfeld, "From image analysis to computer vision: An annotated bibliography, 1955-1979," Comput. Vis. Image Understanding, vol. 84, pp. 298-324, 2001.
32. R. D. Santer, R. Stafford, and F. C. Rind, "Retinally-generated saccadic suppression of a locust looming detector neuron: Investigations using a robot locust," J. R. Soc. Lond. Interface, vol. 1, pp. 61-77, 2004.
33. R. D. Santer, P. J. Simmons, and F. C. Rind, "Gliding behavior elicited by lateral looming stimuli in flying locusts," J. Comput. Phys. A, vol. 191, pp. 61-73, 2005.
34. G. R. Schlotterer, "Response of the locust descending contralateral movement detector neuron to rapidly approaching and withdrawing visual stimuli," Canadian J. Zoology, vol. 55, pp. 1372-1376, 1977.
35. "LOCUST: Life-Like Object Detection for Collision-Avoidance Using Spatio-Temporal Image Processing,", Tech. Rep. D11: Biological Model Report, Project IST-2001-38 097, February 2004.
36. S. F. Stasheff and R. H. Masland, "Functional inhibition in direction-selective retinal ganglion cells: Spatiotemporal extent and intralaminar interactions," J. Neurophys., vol. 88, pp. 1026-1039, 2002.
37. B. Webb and R. Reeve, "Reafferent or redundant: Integration of phohotaxis and optomotor behavior in crickets and robots," Adaptive Behav., vol. 11, no. 3, pp. 137-158, 2003.
38. G. Wichert, "Can robots learn to see," Control Eng. Practice, vol. 7, pp. 783-795, 1999.
39. S. Yue and F. C. Rind, "A Collision detection system for a mobile robot inspired by locust visual system," in Proc. IEEE Int. Conf. Robotics and Automation, Barcelona, Spain, Apr. 18-22, 2005, pp. 2843-3848.