A 10 000 fps CMOS sensor with massively parallel image processing

IEEE Journal of Solid-State Circuits

Volumn 43, Issue 3, 2008, Pages 706-717

  Dubois, Jérôme ^a,b   Ginhac, Dominique ^a,b   Paindavoine, Michel ^a,b   Heyrman, Barthélémy ^b  

^a IEEE

^b UNIVERSITÉ DE BOURGOGNE   (France)

Author keywords

Analog arithmetic unit; CMOS image sensor; High speed image processing; Parallel architecture

Indexed keywords

CMOS INTEGRATED CIRCUITS; FREQUENCY MULTIPLYING CIRCUITS; IMAGE SENSORS; PIXELS;

ANALOG ARITHMETIC UNIT; CMOS IMAGE SENSORS; PARALLEL ARCHITECTURE; STORAGE CAPACITORS;

IMAGE PROCESSING;

EID: 40149094658     PISSN: 00189200     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSSC.2007.916618     Document Type: Article

References (39)

1. E. Possum, "Active pixel sensors: Are CCDs dinosaurs?," Int. Soc. Opt. Eng. (SPIE), vol. 1900, pp. 2-14, 1993.
2. E. Possum, "CMOS image sensor : Electronic camera on a chip," IEEE Trans. Election Devices, vol. 44, no. 10, pp. 1689-1698, Oct. 1997.
3. P. Seitz, "Solid-state image sensing," Handbook of Computer Vision and Applications, vol. 1, pp. 165-222, 2000.
4. D. Litwiller, "CCD versus CMOS: Facts and fiction," Photonics Spectra, pp. 154-158, Jan. 2001.
5. M. Loinaz, K. Singh, A. Blanksby, D. Inglis, K. Azadet, and B. Ackland, "A 200 mv 3.3 V CMOS color camera IC producing 352 × 288 24-b video at 30 frames/s," IEEE J. Solid-State Circuits, vol. 33, no. 12, pp. 2092-2103, Dec. 1998.
6. S. Smith, J. Hurwitz, M. Torrie, D. Baxter, A. Holmes, M. Panaghiston, R. Henderson, A. Murrayn, S. Anderson, and P. Denyer, "A single-chip 306 × 244-pixel CMOS NTSC video camera," in IEEE ISSCC Dig. Tech. Papers, San Francisco, CA, 1998, pp. 170-171.
7. A. El Gamal, D. Yang, and B. Fowler, "Pixel level processing - why, what and how?," in Proc. SPIEElectronic Imaging '99 Conf., Jan. 1999, vol. 3650, pp. 2-13.
8. O. Yadid-Pecht and A. Belenky, "In-pixel autoexposure CMOS APS," IEEE J. Solid-State Circuits, vol. 38, no. 8, pp. 1425-1428, Aug. 2003.
9. P. Acosta-Serafini, M. Ichiro, and C. Sodini, "A 1/3 VGA linear wide dynamic range CMOS image sensor implementing a predictive multiple sampling algorithm with overlapping integration intervals," IEEE J. Solid-State Circuits, vol. 39, no. 9, pp. 1487-1496, Sep. 2004.
10. L. Kozlowski, G. Rossi, L. Blanquart, R. Marchesini, Y. Huang, G. Chow, J. Richardson, and D. Standley, "Pixel noise suppression via SoC management of target reset in a 1920 × 1080 CMOS image sensor," IEEE J. Solid-State Circuits, vol. 40, no. 12, pp. 2766-2776, Dec. 2005.
11. M. Sakakibara, S. Kawahito, D. Handoko, N. Nakamura, M. Higashi, K. Mabuchi, and H. Sumi, "A high-sensitivity CMOS image sensor with gain-adaptative column amplifiers," IEEE J. Solid-State Circuits, vol. 40, no. 5, pp. 1147-1156, May 2005.
12. A. Krymsky and T. Niarong, "A 9-V/Lux 5000-frames/s 512 × 512 CMOS sensor," IEEE Trans. Electron Devices, vol. 50, no. 1, pp. 136-143, Jan. 2003.
13. G. Cembrano, A. Rodriguez-Vazquez, R. Galan, F. Jimenez-Garrido, S. Espejo, and R. Dominguez-Castro, "A 1000 FPS at 128 × 128 vision processor with 8-bit digitized I/O," IEEE J. Solid-State Circuits, vol. 39, no. 7, pp. 1044-1055, Jul. 2004.
14. L. Lindgren, J. Melander, R. Johansson, and B. Mller, "A multiresolution 100-GOPS 4-Gpixels/s programmable smart vision sensor for multi-sense imaging," IEEE J. Solid-State Circuits, vol. 40, no. 6, pp. 1350-1359, Jun. 2005.
15. Y. Sugiyama, M. Takumi, H. Toyoda, N. Mukozaka, A. Ihori, T. Kurashina, Y. Nakamura, T. Tonbe, and S. Mizuno, "A high-speed CMOS image with profile data acquiring function," IEEE J. Solid-State Circuits, vol. 40, pp. 2816-2823, 2005.
16. D. Handoko, K. S, Y. Takokoro, M. Kumahara, and A. Matsuzawa, "A CMOS image sensor for local-plane motion vector estimation," in Symp. VLSI Circuits Dig. Papers, Jun. 2000, vol. 3650, pp. 28-29.
17. S. Lim and A. El Gamal, "Integrating image capture and processing - beyond single chip digital camera," in Proc. SPIE Electronic Imaging 2001 Conf., San Jose, CA, Jan. 2001, vol. 4306.
18. X. Liu and A. El Gamal, "Photocurrent estimation from multiple non-destructive samples in a CMOS image sensor," in Proc. SPIE Electronic Imaging 2001 Conf., San Jose, CA, Jan. 2001, vol. 4306.
19. D. Yang, A. El Gamal, B. Fowler, and H. Tian, "A 640 × 512 CMOS image sensor with ultra wide dynamix range floating-point pixel-level ADC," IEEE J. Solid-State Circuits, vol. 34, no. 12, pp. 1821-1834, Dec. 1999.
20. O. Yadid-Pecht and E. Possum, "CMOS APS with autoscaling and customized wide dynamic range," in IEEE Workshop on Charge-Coupled Devices and Advanced Image Sensors, Jun. 1999, vol. 3650, pp. 48-51.
21. D. Stoppa, A. Somoni, L. Gonzo, M. Gottardi, and G.-F. Dalla Betta, "Novel CMOS image sensor with, a 132-db dynamic range," IEEE J. Solid-State Circuits, vol. 37, no. 12, pp. 1846-1852, Dec. 2002.
22. X. Liu and A. El Gamal, "Simultaneous image formation and motion blur restoration via multiple capture," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, 2001, vol. 3, pp. 1841-1844.
23. C.-Y. Wu and C.-T. Chiang, "A low-photocurrent CMOS retinal focal-plane sensor with, a pseudo-bjt smoothing network and an adaptative current Schmitt trigger for scanner applications," IEEE Sensors J., vol. 4, no. 4, pp. 510-518, Aug. 2004.
24. D. Yang, B. Fowler, and A. El Gamal, "A Nyquist-rate pixel-level ADC for CMOS image sensors," IEEE J. Solid-State Circuits, vol. 34, no. 3, pp. 348-356, Mar. 1999.
25. S. Kleinfelder, S. Lim, X. Liu, and A. El Gamal, "A 10 000 frames/s CMOS digital pixel sensor," IEEE J. Solid-State Circuits, vol. 36, no. 12, pp. 2049-2059, Dec. 2001.
26. A. Harton, M. Ahmed, A. Beuhler, F. Castro, L. Dawson, B. Herold, G. Kujawa, K. Lee, R. Mareachen, and T. Scaminaci, "High dynamic range CMOS image sensor with pixel level ADC and in situ image enhancement," in Sensors and Camera Systems for Scientific and Industrial Applications VI. Proc. SPIE, Mar. 2005, vol. 5677, pp. 67-77.
27. Y. Chi, U. Mallik, E. Choi, M. Clapp, G. Gauwenberghs, and R. Etienne-Cummings, "Cmos pixel-level ADC with change detection," in Proc. Int. Symp. Circuits and Systems (ISCAS), May 2006, pp. 1647-1650.
28. O. Yadid-Pecht, B. Pain, C. Staller, C. Clark, and E. Possum, "CMOS active pixel sensor star tracker with regional electronic shutter," IEEE J. Solid-State Circuits, vol. 32, no. 2, pp. 285-288, Feb. 1997.
29. M. Barbara, P. Burgi, A. Mortara, P. Nussbaum, and F. Heitge, "A 100 × 100 pixel silicon retina for gradient extraction with steering filter capabilities and temporal output coding," IEEE J. Solid-State Circuits, vol. 37, no. 2, pp. 160-172, Feb. 2002.
30. C. Ryan, "Applications of a four-quadrant multiplier," IEEE J. Solid-State Circuits, vol. 5, no. 1, pp. 45-48, Feb. 1970.
31. S. Liu and Y. Hwang, "CMOS squarer and four-quadrant multiplier," IEEE Trans. Circuits Syst. I, Fundam. Theory Applicat., vol. 42, no. 2, pp. 119-122, Feb. 1995.
32. C. Wu, Y. Shih, J. Lan, C. Hsieh, C. Huang, and J. Lu, "Design, optimization, and performance analysis of new photodiode structures for CMOS active-pixel-sensor (APS) imager applications," IEEE Sensors J., vol. 4, no. 1, pp. 135-144, Feb. 2004.
33. I. Shcherback, A. Belenky, and O. Yadid-Pecht, "Empirical dark current modeling for complementary metal oxide semiconductor active pixel sensor," Opt. Eng., vol. 41, no. 6, pp. 1216-1219, Jun. 2002.
34. I. Shcherback and O. Yadid-Pecht, "Photoresponse analysis and pixel shape optimization for CMOS active pixel sensors," IEEE Trans. Electron Devices, vol. 50, no. 1, pp. 12-18, Jan. 2003.
35. J. Lee and R. Hornsey, "CMOS photodiodes with, substrate openings for higher conversion gain in active pixel sensor," in IEEE Workshop on CCDs and Advanced Image Sensors, Crystal Bay, NV, Jun. 2001.
36. G. Chapinal, S. Bota, M. Moreno, J. Palatin, and A. Herms, "A 128 × 128 CMOS image sensor with analog memory for synchronous image capture," IEEE Sensors J., vol. 2, no. 2, pp. 120-127, Apr. 2002.
37. F. Yang and M. Paindavoine, "Implementation of an RBF neural network on embedded systems: Real-time face tracking and identity verification," IEEE Trans. Neural Networks, vol. 14, no. 5, pp. 1162-1175, Sep. 2003.
38. N. Farrugia, F. Mamalet, S. Roux, F. Yang, and M. Paindavoine, "A parallel face detection system implemented on FPGA," in In IEEE Int. Symp. Circuits and Systems (ISCAS 2007), New Orleans, May 2007, pp. 3704-3707.
39. C. Garcia and M. Delakis, "Convolutional face finder: A neural architecture for fast and robust face detection," IEEE Trans. Pattern Anal. Machine Intell., vol. 26, no. 11, pp. 1408-1423, Nov. 2004.