Algorithm and architecture of disparity estimation with mini-census adaptive support weight

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 20, Issue 6, 2010, Pages 792-805

  Chang, Nelson Yen Chung ^a   Tsai, Tsung Hsien ^b   Hsu, Bo Hsiung ^c   Chen, Yi Chun ^c   Chang, Tian Sheuan ^c  

^a INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE   (Taiwan)

^b MEDIATEK INC   (Taiwan)

^c NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

Application specific integrated circuits (ASIC); Computer vision; Digital circuits; Digital integrated circuits; Very large scale integration (VLSI)

Indexed keywords

ADAPTIVE SUPPORT; APPLICATION-SPECIFIC INTEGRATED CIRCUITS (ASIC); AUTONOMOUS VEHICLES; BANDWIDTH REQUIREMENT; COMPLEMENTARY METAL-OXIDE-SEMICONDUCTOR TECHNOLOGIES; DISPARITY ESTIMATIONS; FRAME RATE; GATE-COUNT; HIGH-PERFORMANCE HARDWARE; INTERMEDIATE FORMATS; MANHATTAN COLORS; MEMORY SIZE; MULTIVIEW VIDEO CODING; PARTIAL COLUMNS; PROPOSED ARCHITECTURES; REAL TIME STEREO; VERY LARGE SCALE INTEGRATION ARCHITECTURES; VERY LARGE-SCALE INTEGRATION; VLSI ARCHITECTURES; YUV COLOR;

APPROXIMATION ALGORITHMS; AUTOMOBILE ELECTRONIC EQUIPMENT; COMPUTER HARDWARE; COMPUTER VISION; DIGITAL INTEGRATED CIRCUITS; ELECTRIC POWER SUPPLIES TO APPARATUS; ESTIMATION; IMAGE CODING; INTEGRATED CIRCUITS; MICROELECTRONICS; MOBILE TELECOMMUNICATION SYSTEMS; MOS DEVICES; SEMICONDUCTOR DEVICE MANUFACTURE; SURVEYS; SYNTHESIS (CHEMICAL); THREE DIMENSIONAL COMPUTER GRAPHICS; VIDEO CONFERENCING; VISUAL COMMUNICATION; VLSI CIRCUITS;

STEREO VISION;

EID: 77953098421     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2010.2045814     Document Type: Article

References (49)

1. M. Brown, D. Burschka, and G. Hager, "Advances in computational stereo," IEEE Trans. Pattern Anal. Mach. Intell., vol.25, no.8, pp. 993-1008, Aug. 2003.
2. D. Scharstein and R. Szeliski, "A Taxonomy and evaluation of dense two-frame stereo correspondence algorithms," Int. J. Comput. Vision, vol.47, nos. 1-3, pp. 7-42, Apr. 2002.
3. K.-J. Yoon and I.-S. Kweon, "Adaptive support-weight approach for correspondence search," IEEE Trans. Pattern Anal. Mach. Intell., vol.28, no.4, pp. 650-656, Apr. 2006.
4. M. Gerrits and P. Bekaert, "Local stereo matching with segmentation-based outlier rejection," in Proc. 3rd Canadian Conf. Comput. Robot Vision, Jun. 2006, p. 66.
5. F. Tombari, S. Mattoccia, and L. Di Stefano, "Segmentation-based adaptive support for accurate stereo correspondence," in Lecture Notes in Computer Science, vol.4872, Berlin, Germany: Springer, Dec. 2007, pp. 427-438.
6. T. Kanade, M. Okutomi, and T. Nakahara, "A multiple-baseline stereo method," in Proc. Defense Advanced Research Projects Agency (DARPA) Image Understanding Workshop, 1992, pp. 409-426.
7. S. Kimura, T. Kanade, H. Kano, A. Yoshida, E. Kawamura, and K. Oda, "CMU video-rate stereo machine," in Proc. Mobile Mapping Symp., 1995, pp. 9-12.
8. K. Konolige, "Small vision systems: Hardware and implementation," in Proc. 8th Int. Symp. Robotics Res., Oct. 1997, pp. 203-212.
9. J. Woodfill and B. Von Herzen, "Real-time stereo vision on the PARTS reconfigurable computer," in Proc. IEEE Workshop FPGAs Custom Comput. Mach., 1997, pp. 240-250.
10. P. Corke and P. Dunn, "Real-time stereopsis using FPGAs," in Proc. IEEE Region Ten Annu. Conf. (TENCON): Speech Image Tech. Comput. Telecommun., Apr. 1997, pp. 235-238.
11. S. Kimura, T. Shinbo, H. Yamaguchi, E. Kawamura, and K. Nakano, "A convolver-based real-time stereo machine (SAZAN)," in Proc. Conf. Comput. Vision Pattern Recognit., vol.1. 1999, pp. 457-463.
12. M. Hariyama, N. Yokoyama, M. Kameyama, and Y. Kobayashi, "FPGA implementation of a stereo matching processor based on window-parallel-and- pixel-parallel architecture," in Proc. 48th Midwest Symp. Circuit Syst., vol.2. Aug. 2005, pp. 1219-1222. (Pubitemid 46290353)
13. M. Gong and Y.-H. Yang, "Near real-time reliable stereo matching using programmable graphics hardware," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., vol.1. Jun. 2005, pp. 924-931.
14. M. Hariyama, H. Sasaki, and M. Kameyama, "Architecture of a stereo matching VLSI processor based on hierarchically parallel memory access," Inst. Electron., Informat. Commun. Eng.(IEICE) Trans. Info. Syst., vol.E88-D, no.7, pp. 1486-1491, 2005.
15. D. Masrani and W. MacLean, "A real-time large disparity range stereo-system using FPGAs," in Proc. IEEE Conf. Comput. Vision Syst., Jan. 2006, p. 13. (Pubitemid 44499935)
16. N. Chang, T.-M. Lin, T.-H. Tsai, Y.-C. Tseng, "Real-time DSP implementation on local stereo matching," in Proc. IEEE Conf. Multimedia Expo, Jul. 2007, pp. 2090-2093.
17. J. Banks and P. Corke, "Quantitative evaluation of matching methods and validity measures for stereo vision," Int. J. Robot. Res., vol.20, no.7, pp. 512-532, Jul. 2001.
18. H. Hirschmuller and D. Scharstein, "Evaluation of cost functions for stereo matching," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
19. R. Zabih and J. Woodfill, "Non-parametric local transforms for computing visual correspondence," in Proc. 3rd Eur. Conf. Comput. Vision, 1994, pp. 150-158.
20. H. Hirschmuller, "Accurate and efficient stereo processing by semi-global matching and mutual information," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., vol.2. Jun. 2005, pp. 807-814.
21. M. Bleyer, S. Chambon, U. Poppe, and M. Gelautz, "Evaluation of different methods for using color information in global stereo matching approaches," in Proc. Congr. Int. Soc. Photogrammetry Remote Sensing, Jul. 2008, pp. 63-68.
22. N. Chang, Y.-C. Tseng, and T.-S. Chang, "Analysis of color space and similarity measure impact on stereo block matching," in Proc. IEEE Asia Pacific Conf. Circuits Syst., Dec. 2008, pp. 926-929.
23. M. Okutomi and T. Kanade, "A locally adaptive window for signal matching," Int. J. Comput. Vision, vol.7, pp. 143-162, Jan. 1992.
24. T. Kanade and M. Okutomi, "A stereo matching algorithm with an adaptive window: Theory and experiment," IEEE Trans. Pattern Anal. Mach. Intell., vol.16, no.9, pp. 920-930, Sep. 1994.
25. M. Hariyama, T. Takeuchi, and M. Kameyama, "Reliable stereo matching for highly-safe intelligent vehicles and its VLSI implementation," in Proc. IEEE Intell. Vehicles Symp., Oct. 2000, pp. 128-133.
26. R. Arnold, "Automated stereo perception," Artif. Intell. Laboratory, Stanford Univ., Stanford, CA, Tech. Rep. AIM-351, 1983.
27. A. F. Bobick and S. S. Intille, "Large occlusion stereo," Int. J. Comput. Vision, vol.33, no.3, pp. 181-200, Sep. 1999.
28. S.-B. Kang, R. Szeliski, and J. Chai, "Handling occlusions in dense multi-view Stereo," in Proc. IEEE Conf. Comput. Vision Pattern Recog-nit., vol.1. 2001, pp. 103-110.
29. O. Veksler, "Stereo matching by compact windows via minimum ratio cycle," in Proc. IEEE Int. Conf. Comput. Vision, vol.1. Jul. 2001, pp. 540-547.
30. F. Tombari, S. Mattoccia, L. Di Stefano, and E. Addimanda, "Classification and evaluation of cost aggregation methods for stereo correspondence," in Proc. IEEE Int. Conf. Comput. Vision Pattern Recognit., Jun. 2008, pp. 1-8.
31. Digiclops Product Datasheets, Point Grey Research Inc., Richmond, BC, Canada, 1997 [Online]. Available: http://www.ptgrey. com/products/digiclops/ Digiclops.pdf
32. Triclops SDK, Point Grey Research Inc., Richmond, BC, Canada, 2001 [Online]. Available: http://www.ptgrey.com/products/triclopsSDK/index.asp
33. H. Hirschmuller, "Improvements in real-time correlation-based stereo vision," in Proc. IEEE Workshop Stereo Multi-Baseline Vision, Dec. 2001, pp. 141-148.
34. H. Hirschmuller, P. R. Innocent, and J. Garibaldi, "Real-time correlation-based stereo vision with reduced border errors," Int. J. Comput. Vision, vol.47, nos. 1-3, pp. 229-246, Nov. 2004.
35. S. Forstmann, Y. Kanou, O. Jun, S. Thuering, and A. Schmitt, "Realtime stereo by using dynamic programming," in Proc. Comput. Vision Pattern Recognit. Workshop Real-Time 3-D Sensor Their Use, Jun. 2004, p. 29.
36. G. Minglun and Y. Yee-Hong, "Near real-time reliable stereo matching using programmable graphics hardware," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., vol.1. Jun. 2005, pp. 924-931.
37. L. Jiangbo, G. Lafruit, and F. Catthoor, "Fast variable center-biased windowing for high-speed stereo on programmable graphics hardware," in Proc. IEEE Int. Conf. Image Process., vol.6. Oct. 2007, pp. 568-571.
38. L. Jiangbo, S. Rogmans, G. Lafruit, and F. Catthoor, "Real-time stereo correspondence using a truncated separable Laplacian kernel approximation on graphics hardware," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2007, pp. 1946-1949.
39. L. Wang, M. Liao, M. Gong, R. Yang, and D. Nister, "High-quality realtime stereo using adaptive cost aggregation and dynamic programming," in Proc. 3rd Int. Symp. 3-D Data Process., Vis., Transmission, Jun. 2006, pp. 798-805.
40. O. Faugeras, B. Hotz, H. Matthieu, T. Vieville, Z. Zhang, P. Fua, E. Theron, L. Moll, G. Berry, J. Vuillemin, P. Bertin, and C. Proy, "Real time correlation-based stereo: Algorithm, implementations and applications," Institut National de Recherche en Informatique et Automatique (INRIA), Tech. Rep. 2013, 1993.
41. H. K. Nishihara, "Real-time stereo and motion-based figure-ground discrimination and tracking using LOG sign-Correlation," in Proc. 27th Asilomar Conf. Signals, Syst., Comput., 1993, pp. 95-100.
42. S. Park, H. Jeong, "Real-time stereo vision FPGA chip with low-error rate," in Proc. Int. Conf. Multimedia Ubiquitous Eng., Apr. 2007, pp. 751-756.
43. Q. Yang, L. Wang, R. Yang, S. Wang, M. Liao, and D. Nister, "Realtime global stereo matching using hierarchical belief propagation," in Proc. Brit. Mach. Vision Conf., 2006, pp. 989-998.
44. S. Park, C. Chen, and H. Jeong, "VLSI architecture for MRF-based stereo matching," Lecture Notes in Computer Science, vol.4599, Berlin, Germany: Springer, Aug. 2007, pp. 55-64.
45. T.-H. Tsai, N. Chang, and T.-S. Chang, "Data reuse analysis of local stereo matching," in Proc. Int. Symp. Circuits Syst., May 2008, pp. 812-815.
46. F. Tombari, S. Mattoccia, L. Di Stefano, and E. Addimanda, "Near realtime stereo based on effective cost aggregation," in Proc. Int. Conf. Comput. Vision Pattern Recognit., 2008, pp. 1-4.
47. M. Gong and R. Yang, "Image-gradient-guided real-time stereo on graphics hardware," in Proc. 5th Int. Conf. 3-D Digital Imaging Modeling, 2005, pp. 548-555.
48. Z. Wang and Z. Zheng, "A region-based stereo matching algorithm using cooperative optimization," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2008, pp. 1-8.
49. S. Wattson. (2005 June 22). "NVIDIAs GeForce 7800 GTX graphics processor," in The Tech Report (Online). Available: http://techreport.com/ articles.x/8466/5