Analog VLSI focal-plane array with dynamic connections for the estimation of piecewise-smooth optical flow

IEEE Transactions on Circuits and Systems I: Regular Papers

Volumn 51, Issue 5, 2004, Pages 963-973

  Stocker, Alan A ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

Cellular neural networks; Dynamic connectivity; Gradient descent; Line process; Motion discontinuities; Motion segmentation; Neuromorphic; Optimization; Recurrent feedback

Indexed keywords

CELLULAR NEURAL NETWORKS; COMPUTATIONAL COMPLEXITY; GRADIENT METHODS; IMAGE SEGMENTATION; ITERATIVE METHODS; LINEAR INTEGRATED CIRCUITS; MOTION COMPENSATION; OPTICAL FLOWS; OPTICAL SENSORS; OPTIMIZATION;

DYNAMIC CONNECTIVITY; FOCAL PLANE ARRAY; GRADIENT DESCENT; LINE PROCESS; MOTION DISCONTINUITIES; MOTION SEGMENTATION; NEUROMORPHIC; OPTICAL FLOW ESTIMATION; RECURRENT FEEDBACK;

VLSI CIRCUITS;

EID: 2542620002     PISSN: 10577122     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSI.2004.827619     Document Type: Article

References (39)

1. J. J. Gibson, The Perception of the Visual World. Boston, MA: Houghton-Mifflin, 1950.
2. C. Mead, "Neuromorphic electronic systems," Proc. IEEE, vol. 78, pp. 1629-1636, Oct. 1990.
3. J. Kramer, R. Sarpeshkar, and C. Koch, "Pulse-based analog VLSI velocity sensors," IEEE Trans. Circuits Syst. II, vol. 44, pp. 86-101, Feb. 1997.
4. R. Etienne-Cummings, J. Van der Spiegel, and P. Mueller, "A focal plane visual motion measurement sensor," IEEE Trans. Circuits Syst. I, vol. 44, pp. 55-66, Jan. 1997.
5. H.-C. Jiang and C.-Y. Wu, "A 2-D velocity- and direction-selective sensor with BJT-based silicon retina and temporal zero-crossing detector," IEEE J. Solid-State Circuits, vol. 34, pp. 241-247, Feb. 1999.
6. S. Mehta and R. Etienne-Cummings, "Normal optical-flow chip," in Proc. Int. Symp. Circuits and Systems, vol. 4, Bangkok, Thailand, May 2003, pp. 784-787.
7. R. Deutschmann and C. Koch, "Compact real-time 2D gradient-based analog VLSI motion sensor," in Proc. Int. Conf. Adv. Focal Plane Arrays and Electronic Cameras, vol. 3410, 1998, pp. 98-108.
8. C. Higgins, R. Deutschmann, and C. Koch, "Pulse-based 2D motion sensors," IEEE Trans. Circuits Syst. II, vol. 46, pp. 677-687, June 1999.
9. R. Harrison and C. Koch, "A robust analog VLSI motion sensor based on the visual system of the fly," Autonom. Robot., vol. 7, pp. 211-224, 1999.
10. T. Delbruck, "Silicon retina with correlation-based velocity-tuned pixels," IEEE Trans. Neural Networks, vol. 4, pp. 529-541, May 1993.
11. C. Higgins and K. Coch, "A modular multi-chip neuromorphic architecture for real-time visual motion processing," Anal. Integr. Circuits Signal Processing, vol. 24, pp. 195-211, 2000.
12. L. Huang and Y. Aloimonos, "Relative depth from motion using normal flow: An active and purposive solution," in Proc. IEEE Workshop Visual Motion, Oct. 1991, pp. 196-203.
13. A. Stocker and R. Douglas, "Computation of smooth optical flow in a feedback connected analog network," in Advances in Neural Information Processing Systems, M. Kearns, S. Solla, and D. Cohn, Eds. Cambridge, MA: MIT Press, 1999, vol. 11, pp. 706-712.
14. A. Stocker, "Constraint Optimization Networks for Visual Motion Perception - Analysis and Synthesis," Ph.D. thesis, Dep. Phys., Swiss Federal Inst., Technol., Zürich, Switzerland, Sept. 2001.
15. ____, (2004, Jan.) Optical-flow estimation as distributed optimization problem - An a VLSI Implementation. Computer Science Dep., New York University, New York, Tech. Rep. TR2004-850. [Online]. Available: http://www.cs.nyu.edu
16. B. Shi, T. Roska, and L. Chua, "Estimating optical flow with cellular neural networks," Int. J. Circuit Theory Applicat., vol. 26, pp. 343-364, 1998.
17. L. Chua and L. Yang, "Cellular neural networks: Theory," IEEE Trans. Circuits Syst., vol. 35, pp. 531-548, Oct. 1988.
18. J. Heinzle and A. Stocker, "Classifying patterns of visual motion - A neuromorphic approach," in Advances in Neural Information Processing Systems, S. T. S. Becker and K. Obermayer, Eds. Cambridge, MA: MIT Press, 2003, vol. 15, pp. 1123-1130.
19. J. Tanner and C. Mead, "An integrated analog optical motion sensor," in VLSI Signal Processing, S.-Y. Kung, R. Owen, and G. Nash, Eds. New York: IEEE Press, 1986, vol. 2, p. 59 ff.
20. M.-H. Lei and T.-D. Chiueh, "An analog motion field detection chip for image segmentation," IEEE Trans. Circuits Syst. Video Technol., vol. 12, pp. 299-308, May 2002.
21. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell., vol. 6, pp. 721-741, Nov. 1984.
22. A. Blake and A. Zisserman, Visual Reconstruction, P. H. Winston and M. Brady, Eds. Cambridge, MA: MIT Press, 1987.
23. C. Stiller and J. Konrad, "Estimating motion in image sequences," IEEE Trans. Signal Processing, vol. 16, pp. 71-91, July 1999.
24. D. Murray and B. Buxton, "Scene segmentation from visual motion using global optimization," IEEE Trans. Pattern Anal. Machine Intell., vol. 9, pp. 220-228, Mar. 1987.
25. M. Chang, A. Tekalp, and M. Sezan, "Simultaneous motion estimation and segmentation," IEEE Trans. Image Processing, vol. 9, pp. 1326-1333, Sept. 1997.
26. C. Koch, J. Marroquin, and A. Yuille, "Analog neuronal networks in early vision," in Proc. Nat. Acad. Sci. USA, vol. 83, 1986, pp. 4263-4267.
27. J. Hutchinson, C. Koch, J. Luo, and C. Mead, "Computing motion using analog and binary resistive networks," Computer, vol. 21, pp. 52-64, 1988.
28. J. Harris, C. Koch, E. Staats, and J. Luo, "Analog hardware for detecting discontinuities in early vision," Intl. J. Comput. Vis., vol. 4, pp. 211-223, 1990.
29. J. Harris, C. Koch, and J. Luo, "A two-dimensional analog VLSI circuit for detecting discontinuities in early vision," Science, vol. 248, pp. 1209-1211, 1990.
30. J. Kramer, R. Sarpeshkar, and C. Koch, "Analog VLSI motion-discontinuity detectors for image segmentation," in Proc. IEEE Int. Symp. Circuits Systems, vol. 2, 1996, pp. 620-623.
31. A. Stocker, "An improved 2-D optical-flow sensor for motion segmentation," in Proc. IEEE Int. Symp. Circuits Systems, vol. 2, 2002, pp. 332-335.
32. J. Hopfield, "Neurons with graded response have collective computational properties like those of two-state neurons," Proc. Nat. Acad. Sci. USA., vol. 81, pp. 3088-3092, 1984.
33. J. Hopfield and D. Tank, "Neural computation of decisions in optimization problems," Biol. Cybern., no. 52, pp. 141-152, 1985.
34. T. Delbruck and C. Mead, "Analog VLSI phototransduction by continuous-time, adaptive, logarithmic photoreceptor circuits," Caltech Computation and Neural Systems Program, Pasadena, CA, Tech. Rep. 30, 1994.
35. J. Limb and J. Murphy, "Estimating the velocity of moving images in television signals," Comput. Graph. Image Processing, vol. 4, pp. 311-327, 1975.
36. B. Horn and B. Schunck, "Determining optical flow," Artif. Intell., vol. 17, pp. 185-203, 1981.
37. Y. Weiss, E. Simoncelli, and E. Adelson, "Motion illusions as optimal percept," Nature Neurosci., vol. 5, no. 6, pp. 598-604, 2002.
38. T. Delbruck, "Bump Circuits," Caltech, Pasadena, CA, Tech. Rep. CNS Memo 26, May 1993.
39. S. Manabe, Y. Mastunaga, A. Furukawa, K. Yano, Y. Endo, R. Miyagawa, Y. Iida, Y. Egawa, H. Shibata, H. Nozaki, N. Sakuma, and N. Harada, "A 2-million-pixel CCD image sensor overlaid with an amorphous silicon photoconversion layer," IEEE Trans. Electron Devices, vol. 38, pp. 1765-1771, Aug. 1991.