Robust models for optic flow coding in natural scenes inspired by insect biology

PLoS Computational Biology

Volumn 5, Issue 11, 2009, Pages

  Brinkworth, Russell S A ^a   O'Carroll, David C ^a  

^a UNIVERSITY OF ADELAIDE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

MOTION ANALYSIS; OPTICAL FLOWS;

BIOINSPIRED MODELS; BIOLOGICAL ORGANISMS; MOTION DETECTION; MOTION INFORMATION; NATURAL SCENES; NONLINEAR PROCESSING; OPTIC FLOW; ROBUST MODELING; SELF MOTION; VISUAL WORLD;

ANTENNAS;

ACCELERATION; ALGORITHM; ANALOG COMPUTER; ARTICLE; BIOLOGY; BRAIN; DIGITAL COMPUTER; DYNAMICS; FLY; MOVEMENT PERCEPTION; NERVE CELL; OPTICS; PHOTOTRANSDUCTION; REDUNDANCY ANALYSIS; ROBOTICS; SENSOR; VELOCITY; VISION; VISUAL SYSTEM; ANIMAL; BIOLOGICAL MODEL; BIOMIMETICS; COMPUTER SIMULATION; DROSOPHILA MELANOGASTER; METHODOLOGY; NERVE CELL NETWORK; PHYSIOLOGY; VISUAL CORTEX;

HEXAPODA;

ANIMALS; BIOMIMETICS; COMPUTER SIMULATION; DROSOPHILA MELANOGASTER; MODELS, NEUROLOGICAL; MOTION PERCEPTION; NERVE NET; VISUAL CORTEX; VISUAL PATHWAYS;

EID: 73449123033     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1000555     Document Type: Article

References (103)

1. Strausfeld N (1976) Some Quantitative Aspects of the Fly's Brain. Atlas of an Insect. Berlin: Springer-Verlag. pp 49-56.
2. Land MF, Collett TS (1974) Chasing behaviour of houseflies. J Comp Physiol A 156: 525-538.
3. Land MF, Eckert HM (1985) Maps of the acute zones of fly eyes. J Comp Physiol A 156: 525-538.
4. Srinivasan MV, Zhang SW, Lehrer M, Collett TS (1996) Honeybee navigation en route to the goal: Visual flight control and odometry. J Exp Biol 199: 237-244.
5. Olberg RM, Worthington AH, R VK (2000) Prey pursuit and interception in dragonflies. J Comp Physiol A 186: 155-162.
6. Srinivasan MV, Zhang SW, Altwein M, Tautz J (2000) Honeybee navigation: Nature and calibration of the "odometer". Science 287: 851-853.
7. Egelhaaf M, Borst A (1993) A look into the cockpit of the fly - visual orientation, algorithms, and identified neurons. J Neurosci 13: 4563-4574.
8. Collett TS, Land MF (1975) Visual control of flight behaviour in the hoverfly, Syritta pipiens L. J Comp Physiol A 99: 1-66.
9. Kern R, van Hateren JH, Michaelis C, Lindemann JP, Egelhaaf M (2005) Function of a fly motion-sensitive neuron matches eye movements during free flight. PLoS Biol 3: e171.
10. O'Carroll DC, Laughlin SB, Bidwell NJ, Harris RA (1997) Spatio-temporal properties of motion detectors matched to low image velocities in hovering insects. Vision Res 37: 3427-3439.
11. Barron JL, Fleet DJ, Beauchemin SS (1994) Performance of optical-flow techniques. IJCV 12: 43-77.
12. Horn BKP, Schunck BG (1981) Determining optical-flow. Artif Intell 17: 185-203.
13. Nagel HH (1987) On the estimation of optical-flow - Relations between different approaches and some new results. Artif Intell 33: 299-324.
14. Potters M, Bialek W (1994) Statistical-mechanics and visual signal-processing. Journal de Physique 4: 1755-1775.
15. Anandan P (1989) A computational framework and an algorithm for the measurement of visual-motion. IJCV 2: 283-310.
16. Singh A (1992) Incremental estimation of image flow using a Kalman filter. JVCIR 3: 39-57.
17. Dellaert F, Fox D, Burgard W, Thrun S (1999) Monte Carlo localization for mobile robots. ICRA '99: IEEE International Conference on Robotics and Automation, Vols 1-4, Proceedings. pp 1322-1328.
18. Botelho S, Correa UB, Lautenschlager WI (2006) Vision-Based Motion Detection Using C-NLPCA Approach. In: de Paulo Canuto AM, de Souto MCP, eds. Brazil: Ribeirão Preto. pp 37-42.
19. Fleet DJ, Jepson AD (1990) Computation of component image velocity from local phase information. IJCV 5: 77-104.
20. Fleet DJ, Jepson AD (1993) Stability of phase information. TPAMI 15: 1253-1268.
21. Heeger DJ (1987) Optical-flow using spatiotemporal filters. IJCV 1: 279-302.
22. Heeger DJ (1987) Model for the extraction of image flow. JOSA 4: 1455-1471.
23. Adelson EH, Bergen JR (1985) Spatiotemporal energy models for the perception of motion. JOSA 2: 284-299.
24. Hassenstein B, Reichardt W (1956) Systemtheoretische analyse der Zeit-, Reihenfolgen-, und Vorseichenauswertung bei der Berwegungsperzeption des Rüsselkäfers Chlorophanus. Zeitschrift für Naturforschung 11b: 513-524.
25. Wolf-Oberhollenzer F, Kirschfeld K (1994) Motion sensitivity in the nucleus of the basal optic root of the pigeon. J Neurophysiol 71: 1559-1573.
26. Vansanten JPH, Sperling G (1984) Temporal covariance model of human motion perception. Journal of the Optical Society of America a-Optics Image Science and Vision 1: 451-473.
27. Clifford CWG, Ibbotson MR (2003) Fundamental mechanisms of visual motion detection: models, cells and functions. Progress in Neurobiology 68: 409-437.
28. Reichardt W (1961) Autocorrelation, a Principle for the Evaluation of Sensory Information by the Central Nervous System. In: Rosenblith WA, ed. Principles of Sensory Communications. New York: John Wiley. pp 303-317.
29. Egelhaaf M, Borst A, Reichardt W (1989) Computational structure of a biological motion-detection system as revealed by local detector analysis in the fly's nervous-system. JOSA 6: 1070-1087.
30. Kennedy HL (2007) Gradient Operators for the Determination of Optical Flow. Glenelg, Australia. pp 346-351.
31. Borst A (2007) Correlation versus gradient type motion detectors: the pros and cons. Philos Trans R Soc Lond B: Biol Sci 362: 369-374.
32. Haag J, Denk W, Borst A (2004) Fly motion vision is based on Reichardt detectors regardless of the signal-to-noise ratio. Proc Natl Acad Sci USA 101: 16333-16338.
33. Dror RO, O'Carroll DC, Laughlin SB (2001) Accuracy of velocity estimation by Reichardt correlators. Journal of the Optical Society of America A: Optics, Image Science & Vision 18: 241-252.
34. Shoemaker PA, O'Carroll DC, Straw AD (2005) Velocity constancy and models for wide-field motion detection in insects. Biol Cybern 93: 275-287.
35. Tolhurst DJ, Tadmor Y, Chao T (1992) Amplitude spectra of natural images. OPO 12: 229-232.
36. Straw AD, Rainsford T, O'Carroll DC (2008) Contrast sensitivity of insect motion detectors to natural images. Journal of Vision 8: 1-9.
37. Lindemann JP, Kern R, van Hateren JH, Ritter H, Egelhaaf M (2005) On the Computations Analyzing Natural Optic Flow: Quantitative Model Analysis of the Blowfly Motion Vision Pathway. J Neurosci 25: 6435-6448.
38. Debevec PE, Malik J (1997) Recovering High Dynamic Range Radiance Maps from Photographs. Los AngelesCA, USA. pp 369-378.
39. Smakman JG, Stavenga DG (1986) Spectral sensitivity of blowfly photoreceptors: dependence on waveguide effects and pigment concentration. Vision Research 26: 1019-1025.
40. Srinivasan MV, Guy RG (1990) Spectral properties of movement perception in the dronefly Eristalis. J Comp Physiol A 166: 287-295.
41. Tadmor Y, Tolhurst DJ (2000) Calculating the contrasts that retinal ganglion cells and LGN neurones encounter in natural scenes. Vision Res 40: 3145-3157.
42. Straw AD, Warrant EJ, O'Carroll DC (2006) A 'bright zone' in male hoverfly (Eristalis tenax) eyes and associated faster motion detection and increased contrast sensitivity. J Exp Biol 209: 4339-4354.
43. Krapp HG, Hengstenberg R (1996) Estimation of self-motion by optic flow processing in single visual interneurons. Nature 384: 463-466.
44. Stavenga DG (2003) Angular and spectral sensitivity of fly photoreceptors. I. Integrated facet lens and rhabdomere optics. J Comp Physiol A 189: 1-17.
45. Egelhaaf M, Kern R (2002) Vision in flying insects. Curr Opin Neurobiol 12: 699-706.
46. van Hateren JH (1990) Directional tuning curves elementary movement detectors and the estimation of the direction of visual movement. Vision Res 30: 603-614.
47. Harris RA, O'Carroll DC (2002) Afterimages in fly motion vision. Vision Res 42: 1701-1714.
48. Harris RA, O'Carroll DC, Laughlin SB (1999) Adaptation and the temporal filter of fly motion detectors. Vision Res 39: 2603-2613.
49. Mah EL, Brinkworth RSA, O'Carroll DC (2008) Implementation of an elaborated neuromorphic model of a biological photoreceptor. Biol Cybern 98: 357-369.
50. van Hateren JH, Snippe HP (2001) Information Theoretical Evaluation of Parametric Models of Gain Control in Blowfly Photoreceptor Cells. Vision Res 41: 1851-1865.
51. van Hateren JH, Snippe HP (2006) Phototransduction in primate cones and blowfly photoreceptors: different mechanisms, different algorithms, similar response. J Comp Physiol A 192: 187-197.
52. Brinkworth RSA, Mah EL, Gray JP, O'Carroll DC (2008) Photoreceptor Processing Improves Salience Facilitating Small Target Detection In Cluttered Scenes. Journal of Vision 8: 1-17.
53. Laughlin SB, Hardie RC (1978) Common strategies for light adaptation in the peripheral visual systems of fly and dragonfly. J Comp Physiol 128: 319-340.
54. van Hateren JH (1992) A theory of maximizing sensory information. Biol Cybern 68: 68-70.
55. Juusola M, Uusitalo RO, Weckstrom M (1995) Transfer of Graded Potentials at the Photoreceptor Interneuron Synapse. J Gen Physiol 105: 117-148.
56. Laughlin SB, Osorio D (1989) Mechanisms for neural signal enhncement in the blowfly compound eye. J Exp Biol 144: 113-146.
57. Kirschfeld K (1971) [Uptake and processing of optic data in the complex eye of insects]. Naturwissenschaften 58: 201-209.
58. James AC (1992) Nonlinear operator network models of processing in the fly lamina. In: Pinter RB, Nabet B, eds. Nonlinear vision: Determination of neural receptive fields, function, and networks. London: CRC Press. pp 39-73.
59. Dubs A (1982) The spatial intergration of signals in the retina and lamina of the fly compound eye under different conditions of luminance. J Comp Physiol A 146: 321-343.
60. Douglass JK, Strausfeld NJ (1995) Visual motion detection circuits in flies: peripheral motion computation by identified small-field retinotopic neurons. J Neurosci 15: 5596-5611.
61. Rister J, Pauls D, Schnell B, Ting CY, Lee CH, et al. (2007) Dissection of the peripheral motion channel in the visual system of Drosophila melanogaster. Neuron 56: 155-170.
62. Coombe PE, Srinivasan MV, Guy RG (1989) Are the large monopolar cells of the insect lamina on the optomotor pathway. J Comp Physiol A 166: 23-35.
63. Strausfeld NJ, Lee JK (1991) Neuronal basis for parallel visual processing in the fly. Visual Neurosci 7: 13-33.
64. Egelhaaf M, Borst A (1989) Transient and steady-state response properties of movement detectors. JOSA 6: 116-127.
65. Rivera-Alvidrez Z, Higgins CM (2005) Contrast saturation in a neuronallybased model of elementary motion detection Elsevier Science Bv. pp 173-179.
66. Osorio D (1987) The temporal properties of nonlinear, transient cells in the locust medulla. J Comp Physiol A 161: 431-440.
67. Osorio D (1991) Mechanisms of early visual processing in the medulla of the locust optic lobe - how self-inhibition, spatial-pooling, and signal rectification contribute to the properties of transient cells. Visual Neurosci 7: 345-355.
68. Honegger HW (1980) Receptive-fields of sustained medulla neurons in crickets. J Comp Physiol 136: 191-201.
69. Warzecha AK, Egelhaaf M (1996) Intrinsic properties of biological motion detectors prevent the optomotor control system from getting unstable. Philos Trans R Soc Lond, Ser B: Biol Sci 351: 1579-1591.
70. Maddess T, Laughlin SB (1985) Adaptation of the motion- sensitive neuron H1 is generated locally and governed by contrast frequency. Proc R Soc Lond, Ser B: Biol Sci 225: 251-275.
71. Harris RA, O'Carroll DC, Laughlin SB (2000) Contrast gain reduction in fly motion adaptation. Neuron 28: 595-606.
72. O'Carroll DC, Shoemaker PA, Brinkworth RSA (2007) Bioinspired optical rotation sensor. In: Al-Sarawi SF, ed. Smart Structures, Devices, and Systems III. Adelaide, Australia. pp 641416.
73. Borst A, Egelhaaf M, Haag J (1995) Mechanisms of dendritic integration underlying gain control in fly motion-sensitive neurons. J Comput Neurosci 2: 5-18.
74. Srinivasan MV, Dvorak DR (1979) The waterfall illusion in an insect visual system. Vision Res 19: 1435-1437.
75. Land MF (1997) Visual acuity in insects. Annu Rev Entomol 42: 147-177.
76. Laughlin SB, Horridge GA (1971) Angular sensitivity of the retinula cells of dark-adapted worker bee. J Comp Physiol A 74: 329-335.
77. Williams DS (1983) changes of photoreceptor performance associated with the daily turnover of photoreceptor membrane in locusts. J Comp Physiol 150: 509-519.
78. van Hateren JH, Srinivasan MV, Wait PB (1990) Pattern recognition in bees: orientation discrimination. J Comp Physiol A 167: 649-654.
79. Snyder AW (1977) Acuity of compound eyes: Physical limitations and design. J Comp Physiol A 116: 161-182.
80. Snyder AW, Stavenga DG, Laughlin SB (1977) Spatial Information Capacity of Compound Eyes. J Comp Physiol A 116: 183-207.
81. Merigan WH, Katz LM, Maunsell JHR (1991) The effects of parvocellular lateral geniculate lesions on the acuity and contrast sensitivity of macaque monkeys. J Neurosci 11: 994-1001.
82. Borst A, Egelhaaf M (1989) Principles of visual-motion detection. Trends Neurosci 12: 297-306.
83. Schilstra C, Van Hateren JH (1999) Blowfly flight and optic flow I. Thorax kinematics and flight dynamics. J Exp Biol 202: 1481-1490.
84. O'Carroll DC, Bidwell NJ, Laughlin SB, Warrant EJ (1996) Insect motion detectors matched to visual ecology. Nature 382: 63-66.
85. Harrison RR, Koch C (2000) Robust analog VSLI Reichardt motion sensor. Analog integrated circuits and signal processing 24: 213-239.
86. Rajesh S, Straw A, O'Carroll DC, Abbott D (2005) Effect of spatial sampling on pattern noise in insect-based motion detection. In: Al-Sarawi SF, ed. Proceedings SPIE. Australia. pp 811-825.
87. Reichardt W, Egelhaaf M (1988) Properties of individual-movement detectors as derived from behavioral-experiments on the visual-system of the fly. Biol Cybern 58: 287-294.
88. Reichardt W, Guo AK (1986) Elementary pattern discrimination (behavioural experiments with the fly Musca domestica). Biol Cybern 53: 284-306.
89. Nordström K, Barnett PD, Moyer de Miguel I, Brinkworth RSA, O'Carroll DC (2008) Sexual dimorphism in the hoverfly motion vision pathway. Curr Biol 18: 661-667.
90. Huston SJ, Krapp HG (2008) Visuomotor Transformation in the Fly Gaze Stabilization System. PLoS Biol 6: 1468-1478.
91. Rajesh S, Rainsford TJ, Brinkworth RSA, Abbott D, O'Carroll DC (2007) Implementation of saturation for modeling pattern noise using naturalistic stimuli. Proceedings SPIE. Adelaide, Australia. pp 641424.
92. Ibbotson MR (2001) Evidence for velocity-tuned motion-sensitive descending neurons in the honeybee. Proc R Soc Lond, Ser B: Biol Sci 268: 2195-2201.
93. Dror RO, O'Carroll DC, Laughlin SB (2000) The role of natural image statistics in biological motion estimation. Springer Lecture Notes in Computer Science 181: 492-501.
94. Egelhaaf M, Borst A (1992) Are there separate on and off channels in fly motion vision. Visual Neurosci 8: 151-164.
95. Riehle A, Franceschini N (1984) Motion detection in flies - parametric control over on-off pathways. Exp Brain Res 54: 390-394.
96. Wiederman S, Brinkworth RSA, O'Carroll DC (2009) Performance of a Bio-Inspired Model for the Robust Detection of Moving Targets in High Dynamic Range Natural Scenes. JCTN, in press: acceptance date 8-1-09.
97. Wiederman SD, Shoemaker PA, O'Carroll DC (2008) A model for the detection of moving targets in visual clutter inspired by insect physiology. PLoS ONE 3: e2784.
98. Franceschini N, Pichon JM, Blanes C, Brady JM (1992) From Insect Vision to Robot Vision. Philos Trans R Soc Lond, Ser B: Biol Sci 337: 283-294.
99. Bayerl P, Neumann H (2007) A Fast Biologically Inspired Algorithm for Recurrent Motion Estimation. TPAMI 29: 246-260.
100. NVIDIA (2008) What is CUDA .
101. Brinkworth R, Shoemaker P, O'Carroll D (2009) Characterization of a Neuromorphic Motion Detection Chip Based On Insect Visual System. In: Palaniswami MS, ed. ISSNIP. Melbourne, Australia.
102. O'Carroll DC, Brinkworth RSA (2008) Biomimetic & Bio-Inspired Motion Detectors Based on Insect Vision. In: Viollett S, Ruffier F, eds. Nics, France. pp 1-2.
103. Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. Proceedings 7th Joint Conference on Artificial Intelligence. Vancouver, Canada. pp 674-679.