A foveated silicon retina for two-dimensional tracking

IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing

Volumn 47, Issue 6, 2000, Pages 504-517

  Etienne Cummings, Ralph ^a   Van Spiegel, Jan Der ^b   Mueller, Paul ^c   Zhang, Mao Zhu ^a  

^a Johns Hopkins University   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c Corticon Inc ^*  (United States)

Author keywords

Centroid localization chip; Foveated silicon retina; Motion chip; Target tracking chip; Vision chip

Indexed keywords

CMOS INTEGRATED CIRCUITS; COLOR IMAGE PROCESSING; COMPUTER VISION; EDGE DETECTION; FREQUENCIES; SEMICONDUCTING SILICON; TWO DIMENSIONAL;

CENTROID LOCALIZATION CHIP; FOVEATED SILICON RETINA; MOTION CHIP; TARGET TRACKING CHIP; VISION CHIP;

IMAGING SYSTEMS;

EID: 0033692190     PISSN: 10577130     EISSN: None     Source Type: Journal    
DOI: 10.1109/82.847066     Document Type: Article

References (45)

1. D. Coombs, M. Herman, T.-H. Hong, and M. Nashman, "Real-time obstacle avoidance using central flow divergence, and peripheral flow," IEEE Trans. Robot. Automat., vol. 14, pp. 49-59, Feb. 1998.
2. P. Nesi, F. Innocent!, and P. Pezzati, "RETIMAC: REeal-TIme Motion Analysis Chip," IEEE Trans. Circuits Syst. II, vol. 45, pp. 361-375, Mar. 1998.
3. F. Mura and I. Shimoyama, "Visual guidance of a small mobile robot using active, biologically-inspired, eye movements," in Proc. IEEE Int. Conf. Robotics and Automation, Leuven, Belgium, May 16-20, 1998.
4. D. Irwin, "Integrating information across saccadic eye movements," Current Direct. Psycholog. Sei., vol. 5, no. 3, pp. 94-100, 1996.
5. J. Tsotsos, D. Fleet, and A. Jepson, "Toward a theory of motion understanding in man and machine," in Motion Understanding: Robot and Human Vision, Martin and Agarwal, Eds. Norwell, MA: Kluwer, 1998.
6. M. Eckert and G. Buchsbaum, "Effect of tracking strategies on the velocity structure of two-dimensional image sequences,"/ Opt. Soc. Am., vol. A10, no. 7, pp. 1582-1585, 1993.
7. C. Koch and H. Li, Eds., Vision Chips: Implementing Vision Algorithms with Analog VLSI Circuits. Piscataway, NJ: IEEE Computer Press, 1995.
8. R. Etienne-Cummings and J. Van der Spiegel, "Neuromorphic vision sensors," Sensors and Actuators: A, vol. SNA056, pp. 19-29, 1996.
9. C. Mead, "Neuromorphic electronic systems," Proc. IEEE, vol. 78, pp. 1629-36, 1990.
10. R. Etienne-Cummings, J. Van der Spiegel, and P. Mueller, "Neuromorphic and digital hybrid systems," in Neuromorphic Systems: Engineering Silicon from Neurobiology, L. Smith and A. Hamilton, Eds, Singapore: World Scientific, 1997.
11. T. Horiuchi, "Analog VLSI-based, neuromorphic sensorimotor systems: Modeling the primate oculomotor system," Ph.D. dissertation, California Institute of Technology, Pasadena, CA, 1997.
12. N. Ferrier, "The Harvard binocular head," Harvard University, Cambridge, MA, Tech. Rep. 91-9, 1991.
13. N. Papanikolopoulos and P. Khosla, "Adaptive robotic visual tracking: Theory and experiments," IEEE Trans. Automat. Contr., vol. 38, pp. 42945, 1993.
14. D. Coombs and C. Brown, "Real-time binocular smooth pursuit," Int. J. Comput. Vis., vol. 7, no. 1, pp. 147-164, 1993.
15. M. Kulaczewski and H. Siegel, "SIMD and mixed-mode implementations of a visual tracking algorithm," in Proc. Int. Parallel Processing Symp., Orlando, FL, 1998.
16. D. Murray, K. Bradshaw, P. Mclauchlan, I. Reid, and P. Sharkey, "Driving saccade to pursuit using image motion," Int. J. Comput. Vis., vol. 16, no. 3, pp. 205-228, Nov. 1995.
17. A. Colla, L. Trogu, and R. Zunino, "Digital neuroimplementations of visual motion-tracking systems," in Proc. 5th IEEE Workshop Neural Networks for Signal Processing, Cambridge, MA, 1995, pp. 571-580.
18. S. DeWeerth, "A VLSI-based system for tracking visual stimuli," in Proc. IEEE Int.I Conf. Robotics and Automation, Apr. 9-11, 1991.
19. T. Horiuchi, T. Morris, C. Koch, and S. P. DeWeerth, "Analog VLSI circuits for attention-based visual tracking," Adv. Neural Inform. Processing Syst., vol. 9, 1996.
20. C. Bandera, "Foveal machine vision systems," Ph.D. dissertation, SUNY Buffalo, New York, NY, 1990.
21. S. Xia, R. Sridar, P. Scott, and C. Bandera, "An all CMOS Foveal image sensor chip," in Proc. llth IEEE Int. ASIC Conf., Rochester, NY, Sept. 1999.
22. G. Krieder, "A treatise on log-polar imaging using a custom computational sensor," Ph.D. dissertation, Dept. Elect. Eng., Univ. of Pennsylvania, Philadelphia, PA, 1993.
23. F. Ferrari, J. Nielsen, P. Questa, and G. Sandini, "Space variant sensing for personal communication and remote monitoring," in Proc. EU-HCM Smart Workshop, Apr. 1995.
24. R. Wodnicki, G. Roberts, and M. Levine, "A foveated image sensor in standard CMOS technology," in Proc. Custom Integrated Circuits Conf., 1995, pp. 357-360.
25. B. Horn, Robot Vision. Cambridge, MA: MIT Press, 1986.
26. W. Reichardt, "Autocorrelation: A principle for the evaluation sensory information by the central nervous system," in Sensory Communication. New York, NY: Wiley, 1961.
27. C. Koch, "Implementing early vision algorithms in analog hardware: An overview," SPIE Vol. 1473 Vis. Inform. Processing: From Neurons to Chips, pp. 2-15, 1991.
28. R. Etienne-Cummings, S. Fernando, J. Van der Spiegel, and P. Mueller, "Real time 2-D analog motion detector VLSI circuit," in Proc. Int. Joint Conf. Neural Networks, vol. IV, 1992, pp. 42631.
29. T. Horiuchi, W. Bair, B. Bishofberger, A. Moore, C. Koch, and J. Lazzaro, "Computing motion using analog VLSI vision chips: An experimental comparison among different approaches," Int. J. Comput. Vis., vol. 8, pp. 203-16, 1992.
30. R. Etienne-Cummings, J. Van der Spiegel, and P. Mueller, "A focal plane visual motion measurement sensor," IEEE Trans. Circuits Syst. I, vol. 44, pp. 55-66, Jan. 1997.
31. H. Jiang and C. Wu, "A 2D velocity and direction-selective sensor with BJT-based silicon retina and temporal zero-crossing detector," IEEE J. Solid-State Circuits, vol. 34, pp. 241-247, 1999.
32. R. Sarpeshkar, J. Kramer, G. Indiveri, and C. Koch, "Analog VLSI architectures for motion processing: From fundamentals to system applications," Proc. IEEE, vol. 84, pp. 969-987, July 1996.
33. R. Etienne-Cummings, V Gruev, and M. Abdel-Ghani, "VLSI implementation of motion centroid localization for autonomous navigation," in Advances in Neural Information Processing Systems 11. Cambridge, MA: MIT Press, 1999, pp. 685-691.
34. C. Higgins, R. Deutschmann, and C. Koch, "Pulsed-based 2-D motion sensors," IEEE Trans. Circuits Syst. II, vol. 46, pp. 677-687, June 1999.
35. D. Marr, Vision. San Francisco, CA: Freeman, 1982.
36. S. DeWeerth, "Analog VLSI circuits for stimulus localization and centroid computation,"/J. J. Comput. Vis., vol. 8, no. 2, pp. 191-202, 1992.
37. P. Mansfield, "Machine vision tackles star tracking,"Laser Focus World, vol. 30, no. 26, pp. S21-S24, 1996.
38. D. Sparks, C. Lee, and W. Rohrer, "Population coding of the direction, amplitude and velocity of saccadic eye movements by neurons in the superior colliculus," in Proc. Cold Spring Harbor Quantitative Biology Symp., vol. LV 1990.
39. D. Robinson, "Basic mechanisms of ocular motility and their clinical implications," Oculomotor Contr. Signals, pp. 337-374, 1975.
40. C. Mead, "Sensitive electronic photoreceptor," in Proc. 1985 Chapel Hill VLSI Conf. , 1985, pp. 46371.
41. S. Mendis, S. Kemeny, and E. Possum, "CMOS active pixel image sensor," IEEE Trans. Electron Devices, vol. 41, pp. 452153, Mar. 1994.
42. S. Decker, D. McGrath, K. Brehmer, and C. Sodini, "A 256x256 CMOS imaging array with wide-dynamic range pixels and column-parallel digital output,"/J. J. Solid-State Circuits, vol. 33, no. 12, 2081-2091, Dec. 1998.
43. R. Normann and F. Werblin, "Control of retinal sensitivity," J. Gen. Physiol., vol. 63, pp. 37-61, 1974.
44. A. Andreou, K. Boahen, P. Pouliquen, and A. Pavasovic, "Current mode sub-threshold MOS circuits for analog VLSI neural systems," IEEE Trans. Neural Networks, vol. 2, pp. 205-213, March 1991.
45. H. Barlow, The Senses: Physiology of the Retina. Cambridge, MA: Cambridge Univ. Press, 1982.