Analog VLSI implementation of spatio-temporal frequency tuned visual motion algorithms

IEEE Transactions on Circuits and Systems I: Regular Papers

Volumn 52, Issue 3, 2005, Pages 489-502

  Higgins, Charles M ^a,b   Pant, Vivek ^a   Deutschmann, Rainer ^c  

^a University of Arizona   (United States)

^b UNIVERSITY OF ARIZONA   (United States)

^c MCKINSEY AND COMPANY   (United States)

Author keywords

Analog very large scale integration (VLSI); Biomimetic; Spatio temporal frequency; Vision chip

Indexed keywords

ALGORITHMS; COMPUTER VISION; ELECTRIC FREQUENCY MEASUREMENT; MOSFET DEVICES; MOTION ESTIMATION; SENSORS;

SPATIO TEMPORAL FREQUENCY; VISION CHIP;

VLSI CIRCUITS;

EID: 16344391425     PISSN: 10577122     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSI.2004.841601     Document Type: Article

References (50)

1. W. Reichardt, "Autocorrelation, a principle for the evaluation of sensory information by the central nervous system," in Sensory Communication, W. A. Rosenblith, Ed. New York: MIT Press, 1961, pp. 303-317.
2. P. H. Schiller, B. L. Finlay, and S. F. Volman, "Qualitative studies of single-cell properties in monkey striate cortex. I. Spatiotemporal organization of receptive fields," J. Neurophysiol., vol. 39, no. 6, pp. 1288-1319, 1976.
3. J. P. H. Van Santen and G. Sperling, "Elaborated Reichardt detectors," J. Opt. Soc. Amer. A, vol. 2, pp. 300-320, 1985.
4. E. H. Adelson and J. R. Bergen, "Spatiotemporal energy models for the perception of motion," J. Opt. Soc. Amer. A, vol. 2, no. 2, pp. 284-299, 1985.
5. E. C. Hildreth and C. Koch, "The analysis of visual-motion-from computational theory to neuronal mechanisms," Ann. Rev. Neurosci. vol. 10, pp. 477-533, 1987.
6. N. M. Grzywacz and A. L. Yuille, "A model for the estimate of local image velocity by cells in the visual cortex," Proc. Royal Soc. London B: Biol. Sci., vol. 239, pp. 129-161, 1990.
7. N. J. Strausfeld, Atlas of an Insect Brain. New York: Springer, 1976.
8. C. M. Higgins, J. K. Douglass, and N. J. Strausfeld, "The computational basis of an identified neuronal circuit for elementary motion detection in dipterous insects," Vis. Neurosci., vol. 21, no. 4, pp. 567-586, 2004.
9. C. M. Higgins, "Non-directional motion may underlie insect behavioral use of image speed," Biol. Cybern., vol. 91, no. 5, pp. 326-332, 2004.
10. J. Tanner and C. Mead, "An integrated analog optical motion sensor," in VLSI Signal Processing II, S.-Y. Kung, R. Owen, and G. Nash, Eds. New York: IEEE Press, 1986, pp. 59-76.
11. J. Hutchinson, C. Koch, J. Luo, and C. Mead, "Computing motion using analog and binary resistive networks," IEEE Comput., vol. 21, no. 3, pp. 52-63, Mar. 1988.
12. A. G. Andreou and K. Strohbehn, "Analog VLSI implementation of the Hassenstein - Reichardt-Poggio model for vision computation," in Proc. IEEE Int. Conf. Systems, Man, Cybernetics, Los Angeles, CA, Nov. 1990, pp. 708-710.
13. A. Moore and C. Koch, "A multiplication based analog motion detection chip," Proc. SPIE Vis. Inform. Process., vol. 1473, pp. 66-75, 1991.
14. T. Horiuchi, J. Lazzaro, A. Moore, and C. Koch, "A delay-line based motion detection chip," in Advances in Neural Information Processing Systems, R. P. Lippman, J. E. Moody, and D. S. Touretzky, Eds. San Mateo, CA: Morgan Kaufmann, 1991, pp. 406-412.
15. A. G. Andreou, K. Strohbehn, and R. E. Jenkins, "Silicon retina for motion computation," in Proc. Int. Symp. Circuits Systems (ISCAS'91) vol. , Singapore, Jun. 1991, pp. 1373-1376.
16. R. G. Benson and T. Delbrück, "Direction selective silicon retina that uses null inhibition," in Advances in Neural Information Processing Systems 4, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1991, pp. 756-763.
17. R. Sarpeshkar, W. Bair, and C. Koch, "An analog VLSI chip for local velocity estimation based on Reichardt's motion algorithm," in Advances in Neural Information Processing Systems 5, S. J. Hanson, J. Cowan, and L. Giles, Eds. San Mateo, CA: Morgan Kaufmann, 1993, pp. 781-788.
18. T. Delbrück, "Silicon retina with correlation-based, velocity-tuned pixels," IEEE Trans. Neural Netw., vol. 4, no. 5, pp. 529-541, May 1993.
19. A. Bilgin, H. Abut, and M. W. Marcellin, "A novel vector quantizer based architecture for block-matching motion estimation," in Proc. 29th Asilomar Conf. Signals Computers, vol. 2, Pacific Grove, CA, Oct. 1995.
20. R. C. Meitzler, K. Strohbehn, and A. G. Andreou, "A silicon retina for 2-D position and motion computation," in Proc. Int. Symp. Circuits Systems (ISCAS'95), vol. 3, Apr./May 1995, pp. 2096-2099.
21. J. Kramer, "Compact integrated motion sensor with three-pixel interaction," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, no. 4, pp. 455-460, Apr. 1996.
22. X. Arreguit, F. A. van Schaik, E Bauduin, M. Bidiville, and E. Raeber, "A CMOS motion detector system for pointing devices," IEEE J. Solid-State Circuits, vol. 31, no. 12, pp. 1916-1921, Dec. 1996.
23. R. Sarpeshkar, J. Kramer, G. Indiveri, and C. Koch, "Analog VLSI architectures for motion processing: From fundamental limits to system applications," Proc. IEEE, vol. 84, no. 7, pp. 969-987, 1996.
24. A. Moini, A. Bouzerdoum, K. Eshraghian, A. Yakovleff, X. T. Nguyen, A. Blanksby, R. Beare, D. Abbott, and R. E. Bogner, "An insect vision-based motion detection chip," IEEE J. Solid-State Circuits vol. 32, no. 2, pp. 279-283, Feb. 1997.
25. R. Etienne-Cummings, J. Van der Spiegel, and P. Mueller, "A focal plane visual motion measurement sensor," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 44, no. 1, pp. 55-66, Jan. 1997.
26. R. A. Deutschmann and C. Koch, "Compact real-time 2-D gradient based analog VLSI motion sensor," in Proc. Int. Conf. . Advanced Focal Plane Arrays and Electronic Cameras, Zurich, Switzerland, 1998.
27. R. A. Deutschmann and C. Koch, "An analog VLSI velocity sensor using the gradient method," in Proc. IEEE Int. Symp. Circuits Systems (ISCAS'98), vol. 6, Monterey, CA, 1998, pp. 649-665.
28. A. Stocker and R. Douglas, "Computation of smooth optical flow in a feedback connected analog network," in Advances in Neural Information Processing Systems, M. S. Kearns, S. A. Solla, and D. A. Cohn, Eds. Cambridge, MA: MIT Press, 1999, vol. 11.
29. C. M. Higgins, R. A. Deutschmann, and C. Koch, "Pulse-based 2-D motion sensors," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 46, no. 6, pp. 677-687, Jun. 1999.
30. A. Torralba and J. Herault, "An efficient neuromorphic analog network for motion estimation," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 46, no. 2, pp. 269-280, Feb. 1999.
31. R. Etienne-Cummings, J. Van der Spiegel, and P. Mueller, "Hardware implementation of a visual-motion pixel using oriented spatiotemporal neural filters," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl. vol. 46, no. 9, pp. 1121-1136, Sep. 1999.
32. R. R. Harrison and C. Koch, "A robust analog VLSI Reichardt motion sensor," Analog Integr. Circuits Signal Process., vol. 24, pp. 213-229, 2000.
33. C. M. Higgins and S. K. Korrapati, "An analog VLSI motion energy sensor based on the Adelson-Bergen algorithm," in Proc. Int. Symp. Biologically-Inspired Systems, Wollongong, NSW, Australia, Dec. 2000.
34. S. C. Liu, "A neuromorphic aVLSI model of global motion processing in the fly," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 47, no. 12, pp. 1458-1467, Dec. 2000.
35. A. A. Stocker, "Analog VLSI focal-plane array with dynamic connections for the estimation of piecewise-smooth optical flow," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 51, no. 5, pp. 963-973, May 2004.
36. H. B. Barlow and W. R. Levick, "The mechanism of directionally selective units in rabbit's retina," J. Physiol. (London), vol. 178, pp. 477-504, 1965.
37. B. Hassenstein and W. Reichardt, "Systemtheorische analyze der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus," Zs. Nat., vol. 11b, pp. 513-524, 1956.
38. R. C. Miall, "The flicker fusion frequencies of six laboratory insects, and the response of the compound eye to mains fluorescent 'ripple'," Physiol. Entomol., no. 3, pp. 99-106, 1978.
39. E. Özalevli and C. M. Higgins, "Reconfigurable biologically-inspired visual motion systems using modular neuromorphic VLSI chips," IEEE Transact. Circuits Syst. I, Reg. Papers, vol. 52, no. 1, pp. 79-92, Jan. 2O05.
40. C. W. G. Clifford and M. R. Ibbotson, "Fundamental mechanisms of visual motion detection: Models, cells and functions," Progr. Neurobiol. vol. 68, pp. 409-437, 2003.
41. D. J. Heeger, E. P. Simoncelli, and J. A. Movshon, "Computational models of cortical visual processing," Proc. Nat. Acad. Sci., vol. 93, pp. 623-627, 1996.
42. R. A. Harris, D. C. O'Carroll, and S. B. Laughlin, "Adaptation and the temporal delay filter of fly motion detectors," Vis. Res., vol. 39, pp. 2603-2613, 1999.
43. C. A. Mead and T. Delbrück, "Scanners for visualizing activity of analog VLSI circuitry," Analog Integr. Circuits Signal Process., vol. 1, pp. 93-106, 1991.
44. T. Delbrück and C. Mead, "Analog VLSI phototransduction by continuous-time, adaptive, logarithmic photoreceptor circuits," Prog. Computation Neural Syst., California Institute of Technology, Pasadena, Tech. Rep. 30, 1993.
45. S. C. Liu, "Silicon retina with adaptive filtering properties," Analog Integr. Circuits Signal Process., vol. 18, no. 2/3, pp. 243-254, 1999.
46. R. Schaumann and M. E. Van Valkenburg, Design of Analog Filters. Oxford, U.K.: Oxford Univ. Press, 2001.
47. A. G. Andreou and K. A. Boahen, "Translinear circuits in subthreshold MOS," Analog Integr. Circuits Signal Process., vol. 9, pp. 141-166, 1996.
48. R. Sarpeshkar, R. F. Lyon, and C. A. Mead, "A low-power wide-dynamic-range analog VLSI cochlea," Analog Integr. Circuits Signal Process., vol. 16, no. 3, pp. 245-274, 1998.
49. V. Pant and C. M. Higgins, "A biomimetic VLSI architecture for small target tracking," in Proc. IEEE Int. Symp. Circuits Systems, Vancouver, BC, Canada, 2004.
50. M. Egelhaaf and A. Borst, "Transient and steady-state response properties of movement detectors," J. Opt. Soc. Amer. A, vol. 6, pp. 116-127, 1989.