A biologically inspired modular VLSI system for visual measurement of self-motion

IEEE Sensors Journal

Volumn 2, Issue 6, 2002, Pages 508-528

  Higgins, Charles M ^a   Shams, Shaikh Arif ^a,b  

^a University of Arizona   (United States)

^b INTEL CORPORATION   (United States)

Author keywords

Address event representation; Analog VLSI; Asynchronous digital communication; Biomimetic; Self motion; Spatial integration; Visual motion

Indexed keywords

BIOMIMETIC MATERIALS; COMPUTATIONAL METHODS; MOTION ESTIMATION; PARALLEL PROCESSING SYSTEMS; PATTERN RECOGNITION; VISUAL COMMUNICATION;

ADDRESS EVENT REPRESENTATION; ANALOG VLSI; ASYNCHRONOUS DIGITAL COMMUNICATION; BIOMIMETICS; SPATIAL INTEGRATION; VISUAL MOTION;

VLSI CIRCUITS;

EID: 12944261384     PISSN: 1530437X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSEN.2002.807304     Document Type: Article

References (61)

1. S. Ullman, "Analysis of visual motion by biological and computer systems," Computer, vol. 14, pp. 57-69, 1981.
2. M. R. Ibbotson, "Identification of mechanisms underlying motion detection in mammals," in Motion Vision: Computational, Neural, and Ecological Constraints, J. M. Zanker and J. Zeil, Eds. New York: Springer, 2001, pp. 57-65.
3. B. Hassenstein and W. Reichardt, "Systemtheorische analyze der Zeit-, Reihenfolgen- unVorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus," Zeits. Naturforschung, vol. 11b, pp. 513-524, 1956.
4. E. Adelson and J. Bergen, "Spatiotemporal energy models for the perception of motion," J. Opt. Soc. Amer. A, vol. 2, no. 2, pp. 284-299, 1985.
5. K. Hausen, "The lobula-complex of the fly: Structure, function, and significance in visual behavior," in Photoreception and Vision in Invertebrates, M. Ali, Ed. New York: Plenum, 1984, pp. 523-599.
6. H. Krapp and R. Hengstenberg, "Estimation of self-motion by optic flow processing in single visual interneurons," Nature, vol. 384, pp. 463-466, 1996.
7. H. Saito, M. Yukie, K. Tanaka, K. Hikosaka, Y. Fukada, and E. Iwai, "Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey," J. Neurosci., vol. 6, pp. 145-157, 1986.
8. C. Duffy and R. Wurtz, "Response of monkey MST neurons to optic flow stimuli with shifted centers of motion," J. Neurosci., vol. 15, no. 7, pp. 5192-5208, 1995.
9. R. Jain, "Direct computation of the focus of expansion," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, pp. 58-64, 1983.
10. B. Horn and E. Weldon, "Direct methods for recovering motion," Int. J. Comput. Vis., vol. 2, pp. 51-76, 1988.
11. W. Burger and B. Bhanu, "Estimating 3-D egomotion from perspective image sequences," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 1040-1058, Nov. 1990.
12. A. Verri, M. Straforini, and V. Torre, "Computational aspects of motion perception in natural and artificial vision systems," Phil. Trans. R. Soc. Lond. B, vol. 337, pp. 429-443, 1992.
13. M. J. Barth and S. Tsuji, "Egomotion determination through an intelligent gaze control strategy," IEEE Trans. Syst., Man, Cybern., vol. 23, pp. 1424-1432, Sept./Oct. 1993.
14. J. S. Chahl and M. V. Srinivasan, "Visual computation of egomotion using an image interpolation technique," Biol. Cybern., vol. 74, pp. 405-411, 1996.
15. C. Fermüller and Y. Aloimonos, "On the geometry of visual correspondence," Int. J. Comput. Vis., vol. 21, no. 3, pp. 233-247, 1997.
16. J. J. Gibson, The Perception of the Visual World. Boston, MA: Houghton Mifflin, 1950.
17. D. Bradley, M. Maxwell, R. Andersen, M. Banks, and K. Shenoy, "Mechanisms of heading perception in primate visual cortex," Science, vol. 273, September 1996.
18. J. Perrone, "Model for the computation of self-motion in biological systems," J. Opt. Soc. Amer. A, vol. 9, pp. 177-194, 1992.
19. J. Perrone and L. Stone, "A model of self-motion estimation within primate extrastriate visual cortex," Vis. Res., vol. 34, no. 21, pp. 2917-2938, 1994.
20. _, "Emulating the visual receptive-field properties of MST neurons with a template model of heading estimation," J. Neurosci., vol. 18, no. 15, pp. 5958-5975, 1998.
21. K. Tanaka, Y. Fukada, and H. Saito, "Underlying mechanisms of the response specificity of expansion/contraction and rotation cells in the dorsal part of the medial superior temporal area of the macaque monkey," J. Neurophys., vol. 62, no. 3, pp. 642-656, 1989.
22. M. Franz and H. Krapp, "Wide-Field, Motion-Sensitive Neurons and Optimal Matched Filters for Optic Flow," MPIK, 61, 1998.
23. _, "Wide-field, motion-sensitive neurons and matched filters for optic flow fields," Biol. Cybern., 2000.
24. H.-J. Dahmen, M. Franz, and H. Krapp, "Extracting egomotion from optic flow: Limits of accuracy and neural matched filters," in Motion Vision: Computational, Neural, and Ecological Constraints, J. M. Zanker and J. Zeil, Eds. New York: Springer, 2001, pp. 143-168.
25. J. K. Douglass and N. J. Strausfeld, "Optic flow representation in the optic lobes of Diptera: Modeling the role of T5 directional tuning properties," J. Comp. Physiol. A., vol. 186, pp. 783-797, 2000.
26. _, "Optic flow representation in the optic lobes of Diptera: Modeling innervation matrices onto collators and their evolutionary implications," J. Comp. Physiol. A., vol. 186, pp. 799-811, 2000.
27. J. Tanner and C. Mead, "An integrated analog optical motion sensor," in VLSI Signal Processing, II, N. York, Ed. New York: IEEE Press, 1986, pp. 59-76.
28. T. Horiuchi, J. Lazzaro, A. Moore, and C. Koch, "A delay-line based motion detection chip," in Advances in Neural Information Processing Systems, R. Lippman, J. Moody, and D. Touretzky, Eds. San Mateo, CA: Morgan Kaufmann, 1991, pp. 406-412.
29. T. Delbrück, "Silicon retina with correlation-based, velocity-tuned pixels," IEEE Trans. Neural Networks, vol. 4, pp. 529-541, May 1993.
30. A. Moini, A. Bouzerdoum, A. Yakovleff, and K. Eshraghian, "A two dimensional motion detector based on the insect vision," in Proc. Advanced Focal Plane Arrays and Electronic Cameras, Berlin, Germany, Oct. 10-11, 1996, pp. 146-157.
31. X. Arreguit, F. van Schaik, F. Bauduin, M. Bidiville, and E. Raeber, "A CMOS motion detector system for pointing devices," IEEE J. Solid State Circuits, vol. 31, pp. 1916-1921, Dec. 1996.
32. R. Etienne-Cummings, J. Van der Spiegel, and P. Mueller, "A focal plane visual motion measurement sensor," IEEE Trans. Circuit Syst. I, vol. 44, pp. 55-66, Jan. 1997.
33. C. M. Higgins, R. A. Deutschmann, and C. Koch, "Pulse-based 2D motion sensors," IEEE Trans. Circuits Syst. II, vol. 46, pp. 677-687, June 1999.
34. R. Harrison and C. Koch, "An analog VLSI model of the fly elementary motion detector," in Advances in Neural Information Processing Systems, M. I. Jordan, M. J. Kearns, and S. A. Solla, Eds. Cambridge, MA: MIT Press, 1998, vol. 10, pp. 880-886.
35. R. A. Deutschmann and C. Koch, "Compact real-time 2-D gradient based analog VLSI motion sensor," Proc. Int. Conf. Advanced Focal Plane Arrays and Electronic Cameras, pp. 98-108, 1998.
36. A. Stocker and R. Douglas, "Computation of smooth optical flow in a feedback connected analog network," in Advances in Neural Information Processing Systems, M. S. Kearns, S. A. Solla, and D. A. Cohn, Eds. Cambridge, MA: MIT Press, 1999, vol. 11.
37. R. Sarpeshkar, J. Kramer, G. Indiveri, and C. Koch, "Analog VLSI architectures for motion processing: From fundamental limits to system applications," Proc. IEEE, vol. 84, pp. 969-987, 1996.
38. G. Indiveri, J. Kramer, and C. Koch, "Parallel analog VLSI architectures for computation of heading direction and time-to-contact," in Advances in Neural Information Processing Systems, D. Touretzky, M. Mozer, and M. Hasselmo, Eds. Cambridge, MA: MIT Press, 1996, vol. 8, pp. 720-726.
39. I. McQuirk, "An Analog VLSI Chip for Estimating the Focus of Expansion," Mass. Inst. Technol., Cambridge, Artif. Intell. Lab., 1577, 1996.
40. C. M. Higgins and C. Koch, "An integrated vision sensor for the computation of optical flow singular points," in Advances in Neural Information Processing Systems, M. S. Kearns, S. A. Solla, and D. A. Cohn, Eds. Cambridge, MA: MIT Press, 1999, vol. 11.
41. R. A. Deutschmann and O. G. Wenisch, "Compressive computation in analog VLSI motion sensors," in Proc. Deutsche Arbeitsgemeinschaft für Mustererkennung, 1998, pp. 564-571.
42. C. M. Higgins and C. Koch, "A modular multi-chip neuromorphic architecture for real-time visual motion processing," Analog Integr. Circuits Signal Process., vol. 24, no. 3, Sept. 2000.
43. M. Mahowald, "VLSI analogs of neuronal visual processing: A synthesis of form and function," Ph.D. dissertation, California Inst. Technol., Dept. Comput. Neural Syst., Pasadena, 1992.
44. K. Boahen, "Retinomorphic vision systems," in Proc. Int. Conf. Microelectronics for Neural Networks and Fuzzy Systems, 1996, pp. 2-14.
45. _, "A throughput-on-demand 2-D address-event transmitter for neuromorphic chips," in Proc. 20th Conf. Advanced Research in VLSI, Atlanta, GA, 1999.
46. _, "Retinomorphic chips that see quadruple images," in Proc. 7th Int. Conf. Microelectronics for Neural, Fuzzy and Bio-Inspired Systems, Apr. 1999.
47. G. Indiveri, A. M. Whatley, and J. Kramer, "A reconfigurable neuromorphic VLSI multi-chip system applied to visual motion computation," in Proc. 7th Int. Conf. Microelectronics for Neural, Fuzzy and Bio-Inspired Systems, Apr. pp. 37-44, 1999.
48. S. R. Deiss, R. J. Douglas, and A. M. Whatley, "A pulse-coded communications infrastructure for neuromorphic systems," in Pulsed Neural Networks, W. Maass and C. M. Bishop, Eds. Cambridge, MA: MIT Press, 1998, ch. 6, pp. 157-178.
49. J. Kramer, R. Sarpeshkar, and C. Koch, "Pulse-based analog VLSI velocity sensors," IEEE Trans. Circuits Syst. II, vol. 44, pp. 86-101, Jan. 1997.
50. S. Shams, "A multichip neuromorphic motion processor for extracting egomotion information," M.S. thesis, Univ. Arizona, Dept. Elect. Comput. Eng., Tucson, 2000.
51. J. G. Elias, "Artificial dendritic trees," Neural Computat., vol. 5, pp. 648-663, 1993.
52. A. Mortara, E. Vittoz, and P. Venier, "A communications scheme for analog VLSI perceptive systems," IEEE J. Solid State Circuits, vol. 30, pp. 660-669, June 1995.
53. Z. Kalayjian, J. Waskiewicz, D. Yochelson, and A. Andreou, "Asynchronous sampling of 2D arrays using winner-takes-all arbitration," in Proc. IEEE Int. Symp. Circuits and Systems, Atlanta, GA, pp. 393-396, 1996.
54. T. S. Lande, Ed., Neuromorphic Systems Engineering: Neural Networks in Silicon. Boston, MA: Kluwer, 1998.
55. T. Delbrück and C. Mead, "Analog VLSI phototransduction by continuous-time, adaptive, logarithmic photoreceptor circuits," in Vision Chips: Implementing Vision Algorithms with Analog VLSI Circuits, C. Koch and H. Li, Eds: IEEE Computer Soc. Press, 1995, pp. 139-161.
56. C. Mead, Analog VLSI and Neural Systems. Reading, MA: Addison-Wesley, 1989.
57. P. Häfliger, "Asynchronous event redirecting in bio-inspired communication," Proc. 8th IEEE Int. Conf. Electronics, Circuits, and Systems, 2001.
58. A. Warzecha, M. Egelhaaf, and A. Borst, "Neural circuit tuning fly visual interneurons to motion of small objects. I. Dissection of the circuit by pharmacological and photoinactivation techniques," J. Neurophysiol., vol. 69, no. 2, pp. 329-339, 1993.
59. W. Gronenberg and N. J. Strausfeld, "Descending pathways connecting the male-specific visual system of flies to the neck and flight motor," J. Comparative Physiol. A, vol. 169, pp. 413-426, 1991.
60. O. Landolt, Place Coding in Analog VLSI - A Neuromorphic Approach to Computation. Boston, MA: Kluwer, 1998.
61. N. J. Strausfeld, private communication, 2002.