Neuromorphic vision sensors

Sensors and Actuators, A: Physical

Volumn 56, Issue 1-2, 1996, Pages 19-29

  Etienne Cummings, R ^a   Van Der Spiegel, J ^b  

^a Southern Illinois University Carbondale   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Neuromorphic sensors; Vision sensors

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER VISION; DATA PROCESSING; IMAGE PROCESSING; MEDICAL IMAGING; PHOTODETECTORS;

ADAPTIVE PHOTORECEPTORS; NEUROMORPHIC VISION SENSORS; STEADY STATE PHOTOTRANSDUCTION;

IMAGE SENSORS;

EID: 0030206052     PISSN: 09244247     EISSN: None     Source Type: Journal    
DOI: 10.1016/0924-4247(96)01277-0     Document Type: Article

References (65)

1. A.J.P. Theuwissen, Solid-State Imaging with Charge-Coupled Devices, Kluwer, Dordrecht, 1995.
2. W. Kosonocky et al., 360 × 360-element very-high frame-rate burst-image sensor, Tech. Digest, IEEE ISSCC, 39 (1996) 182-183.
3. R.H. Dyck and G.P. Weckler, Integrated arrays of silicon photodetectors for image sensing, IEEE Trans. Electron Devices, ED-15 (1968) 196-201.
4. E. Fossum, Active pixel image sensors - are CCDs dinosaurs?, SPIE Proc., Vol. 1900, 1993, pp. 2-14.
5. B. Auckland and A. Dickinson, Camera on a chip, Tech. Digest, IEEE ISSCC, 39 (1996) 22-25.
6. J. Van der Spiegel, Computational sensors - the basis for truly intelligent machines, in H. Yamasaki (ed.), Intelligent Sensors, Elsevier, Amsterdam, 1996, pp.19-38.
7. D. Hubel and T. Wiesel, Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, J. Physiol. 160 (1962) 106-154.
8. M. Gupta and G. Knopf, Neuro-vision systems: a tutorial, in M. Gupta and G. Knopf (eds.), Neuro-Vision Systems - Principles and Applications, A Selected Reprint Volume, IEEE Press, NY, 1994, pp. 1-34.
9. G.A. Horridge, The compound eye of insects, Sci. Amer., 237 (1977) 108-122.
10. W. Reichardt, Movement perception in insects, in W. Reichardt (ed.), Processing of Optical Data by Organisms and by Machine, Academic Press, New York, 1969.
11. D. Abbott, A. Moini, A. Yakovleff, X.T. Nguyen, A. Blanksby, G. Kim, A. Bouzerdoum and R.E. Bogner, A new VLSI smart sensor for collision avoidance inspired by insect vision, SPIE Proc., Vol. 2344, Intelligent Vehicle Highway Systems, 1994, pp. 105-115.
12. A. Yakovleff, A. Moini, A. Bouzerdoum, X.T. Nguyen, R.E. Bogner and K. Eshraghian, A micro-sensor based on insect vision, Workshop on Computer Architecture for Machine Perception (CAMP), New Orleans, LA, USA, Dec. 1993, pp. 137-146.
13. R. Williams, A novel technique for providing a highly effective arrangement of multi-aperture vision system eyelets for a particular task, Ph.D. Thesis, University of Memphis, 1993.
14. R. Wodnicki, G.W. Roberts and M.D. Levine, A foveated image sensor in standard CMOS technology, Proc. IEEE Custom Integrated Circuits Conf., Santa Clara, CA, USA, 1995, pp. 357-360.
15. F. Ferrari, J. Nielsen, P. Questa and G. Sandini, Space variant imaging, Sensor Review, 15 (1995) 17-20.
16. J. Van der Spiegel et al., A foveated retina-like sensor based on CCD technology, in C. Mead and M. Ismail (eds.), Analog VLSI Implementation of Neural Systems, Kluwer, Boston, MA, 1989, Ch. 8, pp. 189-210.
17. C. Bandera, Foveal machine vision systems, Ph.D. Thesis, SUNY Buffalo, NY, 1990.
18. M. Tistarelli and G. Sandini, Direct estimate of time-to-impact from optical flow, IEEE Workshop on Visual Motion, Princeton, NJ, Oct. 1991, pp. 226-233.
19. R. Jain, S. Bartlett and N. O'Brien, Motion stereo using ego-motion complex logarithmic mapping, IEEE Trans. Pattern Anal. Machine Intelligence, PAMI-9 (1987) 356-369.
20. G. Kreider, A treatise on log-polar imaging using a custom computational sensor, Ph.D. Thesis, Dept. of Electrical Engineering, University of Pennsylvania, Philadelphia, PA, 1993.
21. H. Barlow, The Senses: Physiology of the Retina, Cambridge University Press, Cambridge, UK, 1982.
22. C.A. Mead, Sensitive Electronic Photoreceptor, Proc. 1985 Chapel Hill Conf. VLSI, Computer Science Press, MD, 1985, pp. 463-471.
23. T. Delbruck and C. Mead, Analog VLSI phototransduction by continuous adaptive, logarithmic photoreceptor circuits, in C. Koch and H. Li (eds.), Vision Chips: Implementing Vision Algorithms with Analog VLSI Circuits, IEEE Computer Society Press, NY, 1995, pp. 139-161.
24. R. Normann and F. Werblin, Control of retinal sensitivity, J. Gen. Phys., 65 (1974) 37-61.
25. M. Gottardi, A CMOS/CCD image sensor for 2D real-time motion estimation, Sensors and Actuators A, 46-47 (1995) 251-256.
26. V. Bruce and P. Green, Visual Perception, 2nd edn., LEA, London, 1990.
27. E. Vittoz, Future of analog in the VLSI environment, Proc. IEEE Int. Symp. Circuits Systems, New Orleans, LA, USA, 1990, Vol. 22, pp. 1372-1375.
28. E. Vittoz and J. Fellrath, CMOS analog integrated circuits based on weak inversion operation, IEEE J. Solid-State Circuits, SC-12 (1977) 224-231.
29. M. Sivilotti, M. Mahowald and C. Mead, Real-time visual computation using analog CMOS processing arrays, in Anderson and Rosenfeld (eds.), Neurocomputing: Foundations of Research, MIT Press, Cambridge, MA, 1990, pp. 701-711.
30. A. Andreou, K. Boahen, P. Pouliquen, A. Pavasovic, R. Jenkins and K. Strohbehn, Current-mode subthreshold MOS circuit for analog neural systems, IEEE Trans. Neural Networks, 2 (1991) 205-213.
31. C. Mead, Adaptive retina, in C. Mead and M. Ismail (eds.), Analog VLSI Implementation of Neural Systems, Kluwer, Norwell, MA, 1989, pp. 239-246.
32. R. Etienne-Cummings, S. Fernando, J. Van der Spiegel and P. Mueller, Real time 2-D analog motion detector VLSI circuit, Proc. Int. Joint Conf. Neural Networks (IJCNN '92), Baltimore, MD, USA, 1992, pp. 426-431.
33. T. Delbruck and C. Mead, Time-derivative adaptive silicon photoreceptor array, SPIE Proc., Vol. 1541, Infrared Sensors: Detectors, Electronics and Signal Processing, 1989, pp. 92-99.
34. J. Mann, Implementing early visual processing in analog VLSI: light adaptation, SPIE Proc., Vol. 1473, Visual Information Processing: From Neurons to Chips, 1991, pp. 128-135.
35. D. Marr, Vision, Freeman, New York, 1982.
36. K. Nakayama, Biological image motion processing: a review, Vision Res., 25 (1985) 625-660.
37. H. Wilson and J. Bergen, A four mechanism model for spatial vision, Vision Res., 19 (1979) 19-32.
38. J. Wyatt et al., Analog VLSI systems for image acquisition and fast early vision processing, Int. J. Computer Vision, 8 (1992) 217-230.
39. B. Fossum, Architectures for focal plane image processing, Optical Eng., 28 (1989) 866-871.
40. T. Poggio, H. Voorhees and A. Yuille, A regularized solution to edge detection, MITAI Laboratory Memo, May 1985.
41. J. Harris, C. Koch, E. Staats and J. Luo, Analog hardware for detecting discontinuities in early vision, Int. J. Computer Vision, 4 (1990) 211-223.
42. C. Mead and M. Mahowald, A silicon model or early visual processing, Neural Network, 1 (1988) 91-97.
43. R. Etienne-Cummings, S. Fernando, N. Takahashi, V. Shtonov, J. Van der Spiegel and P. Mueller, A new temporal domain optical flow measurement technique for focal plane VLSI implementation, in M. Bayoumi, L. Davis and K. Valavanis (eds.), Proc. Computer Architecture for Machine Perception (CAMP '93), New Orleans, LA, USA, Dec. 1993, pp. 241-251.
44. J. Harris, C. Koch, J. Luo and J. Wyatt, Resistive fuses: analog hardware for detecting discontinuities in early vision, in C. Mead and M. Ismail (eds.), Analog VLSI Implementation of Neural Systems, Kluwer, Norwell, MA, 1989, pp. 27-56.
45. S. Liu and J. Harris, The negative fuse network, SPIE Proc., Vol. 1473, Visual Information Processing: From Neurons to Chips, 1991, pp. 185-193.
46. K. Boahen and A. Andreou, A contrast sensitive silicon retina with reciprocal synapses, in J. Moody, J. Hanson and R. Lippmann (eds.), Advances in Neural Information Processing Systems, Vol. 4, Morgan Kaufmann, San Mateo, CA, 1992, pp. 764-772.
47. W. Bair and C. Koch, An analog VLSI chip for finding edges from zero-crossings, in R. Lippmann, J. Moody and D. Touretzky (eds.), Natural Information Processing Systems, Vol. 3, Morgan Kaufmann, Palo Alto, CA, 1991, pp. 399-405.
48. A. Moore and C. Koch, A multiplication based analog motion detection chip, SPIE Proc., Vol. 1473, Visual Information Processing: From Neurons to Chips, Orlando, FL, USA, 1991, pp.66-75.
49. J. Tanner and C. Mead, An integrated optical motion sensor, in S.-Y. Kung, R. Owen and J. Nash (eds.), VLSI Signal Processing II, IEEE Press, NY, 1986, pp. 59-76.
50. T. Horiuchi, W. Bair, B. Bishofberger, A. Moore, C. Koch and J. Lazzaro, Computing motion using analog VLSI vision chips: an experimental comparison among different approaches, Int. J. Computer Vision, 8 (Sept.) (1992) 203-216.
51. R. Benson and T. Delbruck, Direction selective silicon retina that uses null inhibition, in J. Moody, S. Hanson and R. Lippmann (eds.), Advances in Neural Information Processing Systems, Vol. 4, Morgan Kaufmann, San Mateo, CA, 1992, pp. 756-763.
52. T. Delbruck, Silicon retina with correlation-based velocity-tuned pixels, IEEE Trans. Neural Networks, 4 (1993) 529-541.
53. A. Andreou and K. Strohbehn, Analog VLSI implementation of Hassenstein-Reichardt-Poggio models for vision computation, Proc. 1990 IEEE Symp. Systems, Man and Cybernetics, Los Angeles, CA, USA, 1990.
54. J. Kramer, R. Sarpeshkar and C. Koch, An analog VLSI velocity sensor, Proc. IEEE Int. Symp. Circuits and Systems (ISCAS '95), Seattle, WA, USA, 1995, pp. 413-416.
55. R. Sarpeshkar, W. Bair and C. Koch, An analog VLSI chip for local velocity estimation based on Reichardt's motion algorithm, in S. Hanson, J. Cowan and L. Giles (eds.), Advances in Neural Information Processing Systems, Vol. 5, Morgan Kaufmann, San Mateo, CA, 1993.
56. A. Moini, A. Bouzerdoum, K. Eshraghian, A. Yakovleff and X.T. Nguyen, The architecture of an insect vision based VLSI motion detection Chip, Austr. Microelectronics Conf., 1995, pp. 68-73.
57. H. Barlow and W. Levick, The mechanism for directional selective units in rabbit's retina, J. Physiol., 178 (1965) 477-504.
58. N. Matsumoto et al., Forebrain-mediated control of visually guided precatching in toads: investigation of striato-pretectal connections wiht intracellular recordings, Behavioral Processes, 25 (Nov.) (1991) 27-40.
59. W. Camp and J. Van der Spiegel, A silicon VLSI optical sensor for pattern recognition, Sensors and Actuators A, 43 (1994) 188-195.
60. J. Daugman, Complete discrete 1-D Gabor transforms by neural networks for image analysis and compression, IEEE Trans. Acoustic Speech Signal Processing, 36 (1988) 1169-1179.
61. G. Standley, An object position and orientation IC with embedded imager, IEEE J. Solid-State Circuits, 26 (1991) 387-393.
62. M. Nishimura and J. Van der Spiegel, A compact line and edge orientation detection sensor, Sensors and Actuators A, 40 (1994) 217-225.
63. C. Mead, Neuromorphic electronic systems, Proc. IEEE, 78 (1990) 1629-1636.
64. C. Koch and H. Li (eds.), Vision Chips: Implementing Vision Algorithms with Analog VLSI Circuits, A Selected Reprint Volume, IEEE Computer Society Press, NY, 1995.
65. M. Gupta and G. Knopf (eds.), Neuro-Vision Systems - Principles and Applications, A Selected Reprint Volume, IEEE Press, NY, 1994.