A fast stereo matching algorithm suitable for embedded real-time systems

Computer Vision and Image Understanding

Volumn 114, Issue 11, 2010, Pages 1180-1202

  Humenberger, Martin ^a   Zinner, Christian ^a   Weber, Michael ^a   Kubinger, Wilfried ^a   Vincze, Markus ^b  

^a AIT AUSTRIAN INSTITUTE OF TECHNOLOGY   (Austria)

^b VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Census; DSP; Embedded computer vision; GPU; Real time stereo; Stereo matching

Indexed keywords

CENSUS; DSP; EMBEDDED COMPUTER VISION; GPU; REAL TIME STEREO; STEREO MATCHING;

ALGORITHMS; COMPUTER VISION; DIGITAL SIGNAL PROCESSORS; EMBEDDED SOFTWARE; EMBEDDED SYSTEMS; OPTIMIZATION; QUALITY CONTROL; SIGNAL FILTERING AND PREDICTION; STEREO VISION; SURVEYS;

REAL TIME SYSTEMS;

EID: 77957375415     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2010.03.012     Document Type: Conference Paper

References (69)

1. M. Sonka, V. Hlavac, and R. Boyle Image Processing, Analysis, and Machine Vision second ed. 1998 Thomson-Engineering
2. H. Hirschmueller, Improvements in Real-Time Correlation-Based Stereo Vision, IEEE Workshop on Stereo and Multi-Baseline Vision, 2001.
3. J.Y. Bouguet, Camera Calibration Toolbox for Matlab, , 2008.
4. G. Bradski, A. Kaehler, Learning OpenCV, Computer Vision with the OpenCV Library, O'Reilly, 2008.
5. Z. Zhang, Flexible Camera Calibration by Viewing a Plane from Unknown Orientations, ICCV, 1999, pp. 666-673.
6. OpenCV, .
7. A. Fusiello, E. Trucco, and A. Verri A compact algorithm for rectification of Stereo Pairs Machine Vision and Applications 12 2000 16 22
8. W. van der Mark, F.C.A. Groen, J.C. van den Heuvel, Stereo based navigation in unstructured environments, in: IEEE Instrumentation and Measurement Technology Conference, 2001, pp. 2038-2043.
9. D. Murray, and J.J. Little Using real-time stereo vision for mobile robot navigation Autonomous Robots 8 2000 161 171
10. R. Cucchiara, E. Perini, G. Pistoni, Efficient stereo vision for obstacle detection and AGV navigation, in: IEEE Conference on Image Analysis and Processing, 2007, pp. 291-296.
11. K. Konolige, m. Agrawal, R.C. Bolles, C. Cowan, M. Fischler, and B. Gerkey Outdoor Mapping and Navigation Using Stereo Vision Experimental Robotics vol. 39 2008 Springer Tracts in Advanced Robotics
12. D. Murray, and C. Jennings Stereo vision based mapping and navigation for mobile robots IEEE Conference on Robotics and Automation 2 1997 1694 1699
13. D. Burschka, and G. Hager Scene classification from dense disparity maps in indoor environments IEEE Conference on Pattern Recognition 3 2002 708 712
14. R. Zabih, J. Woodfill, Non-parametric local transforms for computing visual correspondence, in: European Conference on Computer Vision, 1994, pp. 151-158.
15. H. Hirschmueller, P.R. Innocent, and J. Garibaldi Real-time correlation-based stereo vision with reduced border errors International Journal of Computer Vision 47 2002 229 246
16. O. Veksler Fast variable window for stereo correspondence using integral images IEEE Computer on Vision and Pattern Recognition 1 2003 551 561
17. S. Birchfield, and C. Tomasi Depth discontinuities by pixel-to-pixel stereo International Journal of Computer Vision 35 3 1996 269 293
18. S. Forstmann, Y. Kanou, J. Ohya, S. Thuering, A. Schmitt, Real-time stereo by using dynamic programming, in: IEEE Conference on Computer Vision and Pattern Recognition Workshop, vol. 3, 2004, pp. 29-36.
19. R.C. Gonzalez, J.A. Cancelas, J.C. Alvarez, J.A. Fernandez, J.M. Enguita, Fast stereo vision algorithm for robotic applications, in: IEEE Conference on Emerging Technologies and Factory Automation, vol. 1, 1999, pp. 97-104.
20. Y. Ohta, and T. Kanade Stereo by intra- and inter-scanline search using dynamic programming IEEE Transactions on Pattern Analysis and Machine Intelligence 7 1985 139 154
21. Y. Boykov, O. Veksler, and R. Zabih Fast approximate energy minimization via graph cuts IEEE Transactions on Pattern Analysis and Machine Intelligence 23 2001 1222 1239
22. R. Zabih, Individuating Unknown Objects by Combining Motion and Stereo, Dissertation, Department of Computer Science, Stanford University, 1994.
23. V. Kolmogorov, R. Zabih, Computing visual correspondence with occlusions using graph cuts, in: IEEE Conference on Computer Vision, 2001, pp. 508-515.
24. J. Sun, N.N. Zheng, and H.Y. Shum Stereo matching using belief propagation IEEE Transactions on Pattern Analysis and Machine Intelligence 25 2003 787 800
25. Q. Yang, L. Wang, R. Yang, S. Wang, M. Liao, D. Nister, Real-time global stereo matching using hierarchical belief propagation, in: The British Machine Vision Conference, 2006, pp. 989-998.
26. M.Z. Brown, D. Burschka, and G.D. Hager Advances in computational stereo IEEE Transactions on Pattern Analysis and Machine Intelligence 25 2003 993 1008
27. D. Scharstein, and R. Szeliski A taxonomy and evaluation of dense two-frame stereo correspondence International Journal of Computer Vision 47 2002 7 42
28. D. Scharstein, R. Szeleski, High-accuracy stereo depth maps using structured light, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, 2003, pp. 195-202.
29. D. Scharstein, C. Pal, Learning conditional random fields for stereo, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2007.
30. H. Hirschmueller, D. Scharstein, Evaluation of cost functions for stereo matching, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2007.
31. T. Kanade, A. Yoshida, K. Oda, H. Kano, M. Tanaka, A stereo machine for video-rate dense depth mapping and its new applications, in: IEEE Conference on Computer Vision and Pattern Recognition, 1996, pp. 196-202.
32. J. Woodfill, B. Von Herzen, Real-time stereo vision on the parts reconfigurable computer, in: IEEE Symposium on FPGAs for Custom Computing Machines, 1997, pp. 242-250.
33. O. Faugeras, B. Hotz, H. Matthieu, T. Vieville, Z. Zhang, P. Fua, E. Theron, L. Moll, G. Berry, J. Vuillemin, P. Bertin, C. Proy, Real-Time Correlation-Based Stereo: Algorithm, Implementations and Applications, INRIA Technical Report 2013, 1993.
34. Y. Miyajima, T. Maruyama, A Real-Time Stereo Vision System with FPGA, LNCS, Field-Programmable Logic and Applications, vol. 2778, 2003, pp. 448-457.
35. J.I. Woodfill, G. Gordon, R. Buck, Tyzx deepsea high speed stereo vision system, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2004, pp. 41-45.
36. J.I. Woodfill, B.v. Herzen, R. Zabih, Frame-rate Robust Stereo on a PCI Board, 1998.
37. Tyzx, Inc., Product Datasheet, , 2009.
38. Point Grey Research Inc., Triclops, Technical Manual, , 2000.
39. Stereo-on-a-Chip Stereo Head User Manual 1.3, , 2007.
40. S. Kimura, T. Shinbo, H. Yamagucchi, E. Kawamura, and K. Nakano A convolver-based real-time stereo machine (SAZAN) IEEE Conference on Computer Vision and Pattern Recognition 1 1999 457 463
41. N. Chang, T.-M. Lin, T.-H. Tsai, Y.-C. Tseng, T.-S. Chang, Real-time DSP implementation on local stereo matching, in: IEEE Conference on Multimedia and Expo, 2007, pp. 2090-2093.
42. I. Ernst, H. Hirschmueller, Mutual information based semi-global stereo matching on the GPU, in: International Symposium on Visual Computing, 2008, pp. 228-239.
43. R. Yang, M. Pollefeys, S. Li, Improved real-time stereo on commodity graphics hardware, in: IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2004, pp. 36-42.
44. B. Khaleghi, S. Ahuja, Q. Wu, An improved real-time miniaturized embedded stereo vision system (MESVS-II), in: IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2008, pp. 1-8.
45. H. Mathieu, A Multi-DSP 96002 Board, INRIA Technical Report 153, 1993.
46. L. Wang, M. Liao, M. Gong, R. Yang, D. Nistr, High-quality real-time stereo using adaptive cost aggregation and dynamic programming, in: International Symposium on 3D Data Processing, Visualization and Transmission, 2006, pp. 798-805.
47. M. Houston, High Level Languages for GPUs Overview, ACM SIGGRAPH 2007 Courses, 2007.
48. NVIDIA, GeForce GTX 280, , 2008.
49. NVIDIA, GeForce 9800 GT, NVIDIA Corporation, , 2008.
50. PCISIG, PCI Express, Specification, , 2009.
51. Advanced Micro Devices, Inc. (AMD), Software Optimization Guide for AMD64 Processors, Rev. 3.06, 2005.
52. M. Gong, R. Yang, L. Wang, and M. Gong A performance study on different cost aggregation approaches used in real-time stereo matching International Journal of Computer Vision 45/2 2007 283 296
53. Intel Corporation, Intel Core2 Duo Processors and Intel Core2 Extreme Processors for Platforms Based on Mobile Intel 965 Express Chipset Family, Document Number:316745-005, 2008.
54. A. Kuznetsov, BitMagic Library: Document about SSE2 Optimization, , 2008.
55. C. Zinner, M. Humenberger, K. Ambrosch, and W. Kubinger An optimized software-based implementation of a census-based stereo matching algorithm Lecture Notes in Computer Science, Advances in Visual Computing 5358 2008 216 227
56. C. Zinner, W. Kubinger, ROS-DMA: a DMA double buffering method for embedded image processing with resource optimized slicing, in: Proceedings of the 12th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS'06), 2006, pp. 361-372.
57. Texas Instruments, TMS320C6474 Multicore Digital Signal Processor, Lit. Number: SPRS552, 2008.
58. C. Zinner, W. Kubinger, R. Isaacs, Pfelib: a performance primitives library for embedded vision, EURASIP Journal on Embedded Systems 2007 (2007) 14p. doi: 10.1155/2007/49051.
59. Texas Instruments, TMS320C6414T, TMS320C6415T, TMS320C6416T Fixed-Point Digital Signal Processors, Lit. Number: SPRS226K, 2003.
60. Q. Yang, R. Yang, J. Davis, D. Nister, Spatial-depth super resolution for range images, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007.
61. Middlebury Computer Vision, Stereo Evaluation, .
62. Q. Yang, C. Engels, A. Akbarzadeh, Near real-time stereo for weakly-textured scenes, in: British Machine Vision Conference, 2008.
63. F. Tombari, S. Mattoccia, L. Di Stefano, E. Addimanda, Near real-time stereo based on effective cost aggregation, in: International Conference on Pattern Recognition, 2008.
64. M. Gong, and Y.-H. Yang Near real-time reliable stereo matching using programmable graphics hardware IEEE Conference on Computer Vision and Pattern Recognition 1 2005 924 931
65. O. Veksler Stereo correspondence by dynamic programming on a tree IEEE Conference on Computer Vision and Pattern Recognition 2 2005 384 390
66. H. Kopetz Real-Time Systems, Design Principles for Distributed Embedded Applications 1997 Springer
67. K. Zhang, J. Lu, G. Lafruit, R. Lauwereins, L.V. Gool, Real-time accurate stereo with bitwise fast voting on CUDA, in: IEEE International Conference on Computer Vision, 5th Workshop on Embedded Computer Vision, 2009, pp. 794-800.
68. J. Salmen, M. Schlipsing, J. Edelbrunner, S. Hegemann, and S. Lueke Real-time stereo vision: making more out of dynamic programming LNCS: Computer Analysis of Images and Patterns 5702/299 2009 1096 1103
69. S. Kosov, T. Thormaehlen, H. Seidel, Accurate real-time disparity estimation with variational methods, in: 5th International Symposium on Advances in Visual Computing, Lecture Notes In Computer Science, vol. 5875, Springer-Verlag, 2009, pp. 796-807.