Pulse-modulation imaging - Review and performance analysis

IEEE Transactions on Biomedical Circuits and Systems

Volumn 5, Issue 1, 2011, Pages 64-82

  Chen, Denis Guangyin ^a   Matolin, Daniel ^b   Bermak, Amine ^a   Posch, Christoph ^b  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^b AIT AUSTRIAN INSTITUTE OF TECHNOLOGY   (Austria)

Author keywords

Energy harvesting; image processing; PFM; pulse modulation image sensor; pulsewidth modulation (PWM); retinal prosthesis; sensor network; time domain image sensor; video compression; wide dynamic range imaging

Indexed keywords

PFM; PULSE-MODULATION IMAGE SENSOR; RETINAL PROSTHESIS; TIME DOMAIN; VIDEO COMPRESSION; WIDE-DYNAMIC-RANGE IMAGING;

ANALOG TO DIGITAL CONVERSION; CMOS INTEGRATED CIRCUITS; COMPUTER VISION; COUNTING CIRCUITS; HARVESTING; IMAGE COMPRESSION; IMAGE QUALITY; IMAGE SENSORS; IMAGING SYSTEMS; MATHEMATICAL MODELS; MODULATION; NETWORK ARCHITECTURE; OPHTHALMOLOGY; PIXELS; PROSTHETICS; PULSE WIDTH MODULATION; SENSOR NETWORKS; SIGNAL TO NOISE RATIO; TIME DOMAIN ANALYSIS;

ENERGY HARVESTING;

EID: 79251604440     PISSN: 19324545     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBCAS.2010.2075929     Document Type: Article

References (89)

1. Smart Cameras, A. N. Belbachir, Ed.. New York: Springer, Nov. 2009.
2. A. El Gamal and H. Eltoukhy, "Cmos image sensors," IEEE Circuits Devices Mag., vol. 21, no. 3, pp. 6-20, May/Jun. 2005.
3. P. Denyer, D. Renshaw, G. Wang, L. M. , and S. Anderson, "On-chip cmos sensors for vlsi imaging systems," in Proc. Very Large Scale Integrated Systems Conf., 1991, pp. 157-166.
4. P. Noble, "Self-scanned image detector arrays," IEEE Trans. Electron Devices, vol. 15, no. 4, pp. 202-209, Apr. 1968.
5. E. Fossum, "Active pixel sensors: Are ccd's dinosaurs?," in Proc. SPIE Charged-Coupled Devices and Solid State Optical Sensors III, 1993, vol. 1900, pp. 30-39.
6. R. Guidash, T.-H. Lee, P. Lee, D. Sackett, C. Drowley, M. Swenson, L. Arbaugh, R. Hollstein, F. Shapiro, and S. Domer, "A 0.6 μW cmos pinned photodiode color imager technology," in Proc. Int. Electron Devices Meeting Tech. Dig., Dec. 1997, pp. 927-929.
7. J.-E. Eklund, C. Svensson, and A. Astrom, "Vlsi implementation of a focal plane image processor-a realization of the near-sensor image processing concept," IEEE Trans. Very Large Scale Integr. (VLSI) Syst., vol. 4, no. 3, pp. 322-335, Sep. 1996.
8. M. Jaffe, J. Ellis-Monaghan, and J. Adkisson, Proc. Circuits at the Nanoscale: Communications, Imaging, and Sensing, K. Iniewski, Ed. Boca Raton, FL: CRC, 2008.
9. A. El Gamal, "Trends in cmos image sensor technology and design," in Proc. Int. Electron Devices Meeting Dig., 2002, pp. 805-808.
10. A. Theuwissen, "Cmos image sensors: State-of-the-art and future perspectives," in Proc. 37th Eur. Solid State Device Research Conf., Sep. 2007, pp. 21-27.
11. S.-G. Wuu, H.-C. Chien, D.-N. Yaung, C.-H. Tseng, C. Wang, C.-K. Chang, and Y.-K. Hsaio, "A high performance active pixel sensor with 0.18 um cmos color imager technology," in Proc. Int. Electron Devices Meeting Tech. Dig., 2001, pp. 24.3.1-24.3.4.
12. D. Yang, A. El Gamal, B. Fowler, and H. Tian, "A 640512 cmos image sensor with ultra wide dynamic range floating-point pixel-level adc," in Proc. IEEE Int. Solid-State Circuits Conf., Dig. Tech. Papers, 1999, pp. 308-309.
13. E. Culurciello, R. Etienne-Cummings, and K. Boahen, "A biomorphic digital image sensor," IEEE J. Solid-State Circuits, vol. 38, no. 2, pp. 281-294, Feb. 2003.
14. A. Bermak and A. Kitchen, "A novel adaptive logarithmic digital pixel sensor," IEEE Photon. Technol. Lett., vol. 18, no. 20, pp. 2147-2149, Oct. 2006.
15. C. Shoushun and A. Bermak, "Arbitrated time-to-first spike cmos image sensor with on-chip histogram equalization," IEEE Trans. Very Large Scale Integr. (VLSI) Syst., vol. 15, no. 3, pp. 346-357, Mar. 2007.
16. S. Chen, A. Bermak, and F. Boussaid, "A compact reconfigurable counter memory for spiking pixels," IEEE Electron Device Lett., vol. 27, no. 4, pp. 255-257, Apr. 2006.
17. K. Boahen, "A burst-mode word-serial address-event link-i: Transmitter design," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 7, pp. 1269-1280, Jul. 2004.
18. J. Lazzaro, J.Wawrzynek, M. Mahowald, M. Sivilotti, and D. Gillespie, "Silicon auditory processors as computer peripherals," IEEE Trans. Neural Netw., vol. 4, no. 3, pp. 523-528, May 1993.
19. G. Dimitrakopoulos, N. Chrysos, and K. Galanopoulos, "Fast arbiters for on-chip network switches," in Proc. IEEE Int. Conf. Computer Design, Oct. 2008, pp. 664-670.
20. B. Schell and Y. Tsividis, "A clockless adc/dsp/dac system with activity- dependent power dissipation and no aliasing," in Proc. IEEE Int. Solid-State Circuits Conf., Dig. Tech. Papers, Feb. 2008, pp. 550-635.
21. V. Ravinuthula, V. Garg, J. G. Harris, and J. Fortes, "Time-mode circuits for analog computation," Int. J. Circuit Theory Appl., vol. 37, no. 5, pp. 631-659, 2009.
22. H. Yang and R. Sarpeshkar, "A bio-inspired ultra-energy-efficient analog-to-digital converter for biomedical applications," IEEE Trans. Circuits Syst. I, Reg. Papers, , vol. 53, no. 11, pp. 2349-2356, Nov. 2006.
23. D. Wei, V. Garg, and J. Harris, "An asynchronous delta-sigma converter implementation," in Proc. IEEE Int. Symp. Circuits and Systems, 2006, p. 4.
24. X. Guo, X. Qi, and J. Harris, "A time-to-first-spike cmos image sensor," IEEE Sensors J., vol. 7, no. 8, pp. 1165-1175, Aug. 2007.
25. S. Vargas-Sierra, E. Roca, and G. Linan-Cembrano, "Aps design alternatives in 0.18 μmcmos image sensor technology," in Proc. Eur. Conf. Circuit Theory and Design, Aug. 23-27, 2009, pp. 1-4.
26. S. Hamami, L. Fleshel, and O. Yadid-Pecht, "Cmos aps imager employing 3.3 v 12 bit 6.3 ms/s pipelined adc," in Proc. Int. Symp. Circuits and Systems, May 23-26, 2004, vol. 4, pp. IV-960-IV-963.
27. E.-S. Eid, "Study of limitations on pixel size of very high resolution image sensors," in Proc. 18th National Radio Science Conf., 2001, vol. 1, pp. 15-28.
28. A. Theuwissen, "Cmos image sensors: State-of-the-art and future perspectives," in Proc. 33rd Eur. Solid State Circuits Conf., Sep. 11-13, 2007, pp. 21-27.
29. A. El Gamal and H. Eltoukhy, "Cmos image sensors," IEEE Circuits Devices Mag., vol. 21, no. 3, pp. 6-20, May/Jun. 2005.
30. V. Brajovic and T. Kanade, "A vlsi sorting image sensor: Global massively parallel intensity-to-time processing for low-latency adaptive vision," IEEE Trans. Robot. Autom., , vol. 15, no. 1, pp. 67-75, Feb. 1999.
31. M. Nagata, J. Funakoshi, and A. Iwata, "A pwm signal processing core circuit based on a switched current integration technique," IEEE J. Solid-State Circuits, vol. 33, no. 1, pp. 53-60, Jan. 1998.
32. K. Frohmader, "A novel mos compatible light intensity-to-frequency converter suited for monolithic integration," IEEE J. Solid-State Circuits, vol. SSC-17, no. 3, pp. 588-591, Jun. 1982.
33. K. Tanaka, F. Ando, K. Taketoshi, I. Ohishi, and G. Asari, "Novel digital photosensor cell in GaAs IC using conversion of light intensity to pulse frequency," Jpn. J. Appl. Phys., vol. 32, no. 11A, pp. 5002-5007, Oct. 1993.
34. W. Yang, "A wide-dynamic-range, low-power photosensor array," in Proc. IEEE Int. Solid-State Circuits Conf., Dig. Tech. Papers, Feb. 1994, pp. 230-231.
35. J. Döge, G. Schönfelder, G. T. Streil, and A. König, "An hdr cmos image sensor with spiking pixels, pixel-level adc, and linear characteristics," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 49, no. 2, pp. 155-158, Feb. 2002.
36. F. Andoh, H. Shimamoto, and Y. Fujita, "A digital pixel image sensor for real-time readout," IEEE Trans. Electron Devices, vol. 47, no. 11, pp. 2123-2127, Nov. 2000.
37. X. Wang, W. Wong, and R. Hornsey, "A high dynamic range cmos image sensor with inpixel light-to-frequency conversion," IEEE Trans. Electron Devices, , vol. 53, no. 12, pp. 2988-2992, Dec. 2006.
38. C. Shoushun, F. Boussaid, and A. Bermak, "Robust intermediate read-out for deep submicron technology cmos image sensors," IEEE Sensors J., vol. 8, no. 3, pp. 286-294, Mar. 2008.
39. L. G. McIlrath, "A low-power low-noise ultrawide-dynamic-range cmos imager with pixel-parallel a/d conversion," IEEE J. Solid-State Circuits, vol. 36, no. 5, pp. 846-853, May 2001.
40. Z. Kalayjian, J. Waskiewicz, D. Yochelson, and A. Andreou, "Asynchronous sampling of 2 d arrays using winner-takes-all arbitration," in Proc. IEEE Int. Symp. Circuits and Systems, 'Connecting the World', May 1996, vol. 3, pp. 393-396.
41. M. Azadmehr, J. Abrahamsen, and P. Hafliger, "A foveated aer imager chip [address event representation]," in Proc. IEEE Int. Symp. Circuits and Systems, 2005, vol. 3, pp. 2751-2754.
42. K. Kagawa, K. Isakari, T. Furumiya, A. Uehara, T. Tokuda, J. Ohm, and M. Nunoshita, "Pixel design of pulsed cmos image sensor for retinal prosthesis with digital photosensitivity control," IEEE Electron. Lett., vol. 39, no. 5, pp. 419-421, Mar. 2003.
43. D. C. Ng, T. Furumiya, K. Yasuoka, A. Uehara, K. Kagawa, T. Tokuda, M. Nunoshita, and J. Ohta, "Pulse frequency modulation based cmos image sensor for subretinal stimulation," IEEE Trans. Circuits Syst. II, Expr. Briefs, , vol. 53, no. 6, pp. 487-491, Jun. 2006.
44. J. Ohta, K. Kagawa, T. Tokuda, and M. Nunoshita, "Retinal prosthesis device based on pulse-frequency-modulation vision chip," in , Proc. IEEE Int. Symp. Circuits and Systems, May 2005, pp. 2923-2925.
45. A. E. Gamal, D. X. D. Yang, and B. A. Fowler, "Pixel-level processing: Why, what, and how?," in Proc. SPIE Image Sensor Design and Characterization, 1999, vol. 3650, pp. 2-13.
46. A. Kitchen, A. Bermak, and A. Bouzerdoum, "Pwm digital pixel sensor based on asynchronous self-resetting scheme," IEEE Electron Device Lett., vol. 25, no. 7, pp. 471-473, Jul. 2004.
47. A. Kitchen, A. Bermak, and A. Bouzerdoum, "A digital pixel sensor array with programmable dynamic range," IEEE Trans. Electron Devices, vol. 52, no. 12, pp. 2591-2601, Dec. 2005.
48. C. Xu, C. Shen, A. Bermak, and M. Chan, "A new digital-pixel architecture for cmos image sensor with pixel-level adc and pulse width modulation using a 0.18 μW CMOS technology," in Proc. IEEE Conf. Electron Devices and Solid-State Circuits, Dec. 2003, pp. 265-268.
49. A. Bermak, "An 8/4-bit reconfigurable digital pixel array with on-chip non-uniform quantizer," in Proc. IEEE Custom Integrated Circuits Conf., Sep. 2005, pp. 223-226.
50. A. Bermak and Y.-F.Yung, "A dps array with programmable resolution and reconfigurable conversion time," IEEE Trans. Very Large Scale Integr. (VLSI) Syst., vol. 14, no. 1, pp. 15-22, Jan. 2006.
51. C. Xu, W. Zhang, W. Ki, and M. Chan, "A 1.0-v vdd cmos active-pixel sensor with complementary pixel architecture and pulsewidth modulation fabricated with a 0.25- μW cmos process," IEEE J. Solid-State Circuits, vol. 37, no. 12, pp. 1853-1859, Dec. 2002.
52. K. Kagawa, K. Yasuoka, D. Ng, T. Furumiya, T. Tokuda, J. Ohta, and M. Nunoshita, "Pulse-domain digital image processing for vision chips employing low-voltage operation in deep-submicrometer technologies," IEEE J. Sel. Topics Quantum Electron., vol. 10, no. 4, pp. 816-828, Jul./Aug. 2004.
53. S. Kleinfelder, S. Lim, X. Liu, and A. E. Gamal, "A 10000 frames/s cmos digital pixel sensor," IEEE J .Solid-State Circuits, vol. 36, no. 12, pp. 2049-2059, Dec. 2001.
54. Q. Luo and J. Harris, "A time-based cmos image sensor," in Proc. Int. Symp. Circuits and Systems, May 2004, vol. 4, p. IV-840-3.
55. J. Crooks, S. Bohndiek, C. Arvanitis, R. Speller, H. XingLiang, E. Villani, M. Towrie, and R. Turchetta, "A CMOS image sensor with in-pixel adc, timestamp, and sparse readout," IEEE Sensors J., vol. 9, no. 1, pp. 20-28, Jan. 2009.
56. D. Matolin, R. Wohlgenannt, M. Litzenberger, and C. Posch, "A loadbalancing readout method for large event-based pwm imaging arrays," in Proc. IEEE Int. Symp. Circuits Systems, Paris, France, May 2010, pp. 361-364.
57. X. Qi, X. Guo, and J. Harris, "A time-to-first spike cmos imager," in Proc. Int. Symp. Circuits Systems, May 2004, vol. 4, p. IV-824-7.
58. C. Shoushun and A. Bermak, "A second generation time-to-first-spike pixel with asynchronous self power-off," in Proc. IEEE Int. Symp. Circuits Systems, 2006, pp. 2289-2292.
59. C. Posch, D. Matolin, and R.Wohlgenannt, "A QVGA 143 db dynamic range asynchronous address-event pwm dynamic image sensor with lossless pixel-level video compression," in Proc. IEEE Int. Solid-State Circuits Conf., Dig. Tech. Papers, Feb. 2010, pp. 400-403.
60. P. Lichtsteiner, C. Posch, and T. Delbruck, "A 128 128 120 db 15 μW latency asynchronous temporal contrast vision sensor," IEEE J. Solid- State Circuits, vol. 43, no. 2, pp. 566-576, Feb. 2008.
61. D. Matolin, C. Posch, and R. Wohlgenannt, "True correlated double sampling and comparator design for time-based image sensors," in Proc. IEEE Int. Symp. Circuits Systems, May 2009, pp. 1269-1272.
62. A. Spivak, A. Belenky, A. Fish, and O. Yadid-Pecht, "Wide- dynamicrange cmos image sensors: Comparative performance analysis," IEEE Trans. Electron Devices, , vol. 56, no. 11, pp. 2446-2461, Nov. 2009.
63. J. Margarit, J. Sabadell, L. Teres, and F. Serra-Graells, "A novel dps integrator for fast cmos imagers," in Proc. IEEE Int. Symp. Circuits Systems, May 2008, pp. 1632-1635.
64. X. Wu and A. Bermak, "A low power digital pixel sensor with a dynamically biased adc," in Proc. Int. SoC Design Conf., Nov. 2008, vol. 01, pp. I-105-I-108.
65. K. T. Ng, C. Shoushun, F. Boussaid, and A. Bermak, "Compact graycode counter/memory circuits for spiking pixels," in Proc. 4th IEEE Int. Symp. Electronic Design, Test and Applications, Jan. 2008, pp. 506-511.
66. J. Olsson and P. Hafliger, "Mismatch reduction with relative reset in integrate- and-fire photo-pixel array," in Proc. IEEE Biomedical Circuits and Systems Conf., Nov. 20-22, 2008, pp. 277-280.
67. A. Belbachir,M. Hofstatter,M. Litzenberger, and P. Schon, "Improved dynamic shape representation using a biologically-inspired vision sensor with a synchronous arbitration," in Proc. IEEE Biomedical Circuits Systems Conf., Nov. 2008, pp. 161-164.
68. V. Brajovic, "Lossless non-arbitrated address-event coding," in Proc. Int. Symp. Circuits and Systems, May 2003, vol. 5, pp. V-825-V-828.
69. M. Tiziani, N. Massari, S. Jawed, and M. Gottardi, "A self-adapting high dynamic-range visual representation algorithm for aer imagers," in Proc. IEEE Int. Symp. Circuits and Systems, May 2008, pp. 1388-1391.
70. A. Astrom, R. Forchheimer, and J.-E. Eklund, "Global feature extraction operations for near-sensor image processing," IEEE Trans. Image Process., vol. 5, no. 1, pp. 102-110, Jan. 1996.
71. T. Komuro, S. Kagami, and M. Ishikawa, "A dynamically reconfigurable simd processor for a vision chip," IEEE J. Solid-State Circuits, vol. 39, no. 1, pp. 265-268, Jan. 2004.
72. A. Lopich and P. Dudek, "Aspa: Focal plane digital processor array with asynchronous processing capabilities," in Proc. IEEE Int. Symp. Circuits and Systems, May 2008, pp. 1592-1595.
73. M. Zhang and A. Bermak, "Compressive acquisition cmos image sensor: From the algorithm to hardware implementation," IEEE Trans. Very Large Scale Integr. (VLSI) Syst., vol. 18, no. 3, pp. 490-500, Mar. 2010.
74. M. Zhang and A. Bermak, "Architecture of a digital pixel sensor array using 1-bit hilbert predictive coding," in Proc. IEEE Int. Symp. Circuits and Systems, May 2009, pp. 1501-1504.
75. C. Shoushun, A. Bermak, W. Yan, and D. Martinez, "Adaptive- quantization digital image sensor for low-power image compression," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 54, no. 1, pp. 13-25, Jan. 2007.
76. D. Climie, S. Chen, A. Bermak, and D. Martinez, "Frame based adaptation for cmos imager," in Proc. 5th Int. Conf. Information, Communications and Signal Processing, 2005, pp. 301-304.
77. M. Susli, F. Boussaid, C. Shoushun, and A. Bermak, "Efficient eventdrivern frame capture for cmos imagers," in Proc. 9th Int. Symp. Signal Processing and its Applications, Feb. 2007, pp. 1-4.
78. H. Hu, A. Bermak, and D. Martinez, "A new video compression scheme combining conditional replenishment and address event representation," in Proc. IEEE Workshop Signal Processing Systems, Oct. 2007, pp. 573-578.
79. A. Linares-Barranco, G. Jimenez-Moreno, B. Linares-Barranco, and A. Civit-Balcells, "On algorithmic rate-coded aer generation," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 771-788, May 2006.
80. J. Ohta, T. Tokuda, K. Kagawa, T. Furumiya, A. Uehara, Y. Terasawa, M. Ozawa, T. Fujikado, and Y. Tano, "Silicon lsi-based smart stimulators for retinal prosthesis," IEEE Eng. Med. Biol. Mag., vol. 25, no. 5, pp. 47-59, Sep./Oct. 2006.
81. E. Culurciello and A. G. Andreou, "Cmos image sensors for sensor networks," Analog Integr. Circuits Signal Process., vol. 49, no. 1, pp. 39-51, 2006.
82. T. Teixeira, E. Culurciello, and A. Andreou, "An address-event image sensor network," in Proc. IEEE Int. Symp. Circuits and Systems, 2006, pp. 4467-4470.
83. E. Culurciello, J. H. Park, and A. Savvides, "Address-event video streaming over wireless sensor networks," in Proc. IEEE Int. Symp. Circuits and Systems, May 2007, pp. 849-852.
84. C. Shi, M. K. Law, and A. Bermak, "A novel asynchronous pixel for an energy harvesting cmos image sensor," IEEE Trans. Very Large Scale Integr. (VLSI) Syst., 2009, to be published.
85. M. Zhang, A. Bermak, X. Li, and Z.Wang, "A low power cmos image sensor design for wireless endoscopy capsule," in Proc. IEEE Biomedical Circuits and Systems Conf., Nov. 2008, pp. 397-400.
86. T. Tokuda, K. Hiyama, S. Sawamura, K. Sasagawa, Y. Terasawa, K. Nishida, Y. Kitaguchi, T. Fujikado, Y. Tano, and J. Ohta, "Cmos-based multichip networked flexible retinal stimulator designed for imagebased retinal prosthesis," IEEE Trans. Electron Devices, vol. 56, no. 11, pp. 2577-2585, Nov. 2009.
87. X. Zhao, A. Bermak, and F. Boussaid, "A cmos digital pixel sensor with photo-patterned micropolarizer array for real-time focal-plane polarization imaging," in Proc. IEEE Biomedical Circuits and Systems Conf., Nov. 2008, pp. 145-148.
88. W. Xiajun, X. Zhao, A. Bermak, and F. Boussaid, "An aer based cmos polarization image sensor with photo-aligned micropolarizer array," in Proc. 1st Asia Quality Electronic Design Symp., Jul. 2009, pp. 126-130.
89. M. Rahimi, H. Shah, G. Sukhatme, J. Heideman, and D. Estrin, "Studying the feasibility of energy harvesting in a mobile sensor network," in Proc. IEEE Int. Conf. Robotics and Automation, Sep. 2003, vol. 1, pp. 19-24.