Coarse-to-fine stereo vision with accurate 3D boundaries

Image and Vision Computing

Volumn 28, Issue 3, 2010, Pages 352-366

  Sizintsev, Mikhail ^a   Wildes, Richard P ^a  

^a YORK UNIVERSITY   (Canada)

Author keywords

Coarse to fine; Computer vision; Occlusions; Real time algorithms; Stereo

Indexed keywords

COMPUTATIONAL EFFICIENCY; COMPUTER VISION; THREE DIMENSIONAL;

3D SURFACE; BINOCULAR DISPARITY; BLOCK MATCHING; COARSE-TO-FINE; EMPIRICAL RESULTS; LOW COMPLEXITY; REAL TIME ALGORITHMS;

STEREO VISION;

EID: 70449719199     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2009.06.008     Document Type: Article

References (58)

1. A. Agarwal, A. Blake, The Panum Proxy algorithm for dense stereo matching over a volume of interest, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2006, pp. 2339-2346.
2. Scharstein D., and Szeliski R. Taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47 (2002) 7-42
3. Brown M.Z., Burschka D., and Hager G.D. Advances in computational stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 8 (2003) 993-1008
4. P.F. Felzenszwalb, D.P. Huttenlocher, Efficient belief propagation for early vision, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2004, pp. 261-268.
5. R. Yang, M. Pollefeys, Multi-resolution real-time stereo on commodity graphics hardware, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2003, pp. 211-217.
6. N. Cornelis, L. van Gool, Real-time connectivity constrained depth map combination using programmable graphics hardware, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 1099-1104.
7. G. van der Wal, M. Hansen, M. Piacentino, The Acadia vision processor, in: Proceedings of the International Workshop on Computer Architecture for Machine Perception, Padua, Italy, 2000, pp. 31-40.
8. Egnal G., and Wildes R.P. Detecting binocular half-occlusions: empirical comparisons of five approaches. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 8 (2002) 1127-1133
9. A. Fusiello, V. Roberto, Efficient stereo with multiple windowing, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1997, pp. 885-863.
10. Hirschmuller H., Innocent P.R., and Garibaldi J. Real-time correlation-based stereo vision with reduced border errors. International Journal of Computer Vision 47 (2002) 229-246
11. O. Veksler, Fast variable window for stereo correspondence using integral images, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2003, pp. 556-561.
12. Yoon K.-J., and Kweon I.S. Adaptive support-weight approach for correspondence search. IEEE Transactions on Pattern Analysis and Machine Intelligence 28 4 (2006) 650-656
13. V. Kolmogorov, R. Zabih, Computing visual correspondence with occlusions using graph cuts, in: Proceedings of the IEEE International Conference on Computer Vision, 2001, pp. 508-515.
14. A.S. Ogale, Y. Aloimonos, Stereo correspondence with slanted surfaces: critical implications of horizontal slant, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2004, pp. 568-573.
15. J. Sun, Y. Li, S.B. Kang, H.-Y. Shum, Symmetric stereo matching for occlusion handling, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 399-406.
16. Y. Deng, Q. Yang, X. Lin, X. Tang, A symmetric patch-based correspondence model for occlusion handling, in: Proceedings of the IEEE International Conference on Computer Vision, vol. 2, 2005, pp. 1316-1322.
17. Burt P.J., and Adelson E.H. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications 31 4 (1983) 532-540
18. Jahne B. Digital Image Processing: Concepts, Algorithms and Scientific Applications (1993), Springer, Berlin
19. Lindeberg T. Scale-Space Theory in Computer Vision (1994), Kluwer Academic Publishers, Boston
20. Kanade T., and Okutomi M. A stereo matching algorithm with an adaptive window. IEEE Transactions on Pattern Analysis and Machine Intelligence 16 (1994) 920-932
21. M. Sizintsev, R.P. Wildes, Coarse-to-fine stereo vision with accurate 3D boundaries, Tech. Rep. CS-2006-07, York University, Toronto, Canada, 2006.
22. Okutomi M., Katayama Y., and Oka S. A simple stereo algorithm to recover precise object boundaries and smooth surfaces. International Journal of Computer Vision 47 (2002) 261-273
23. M. Sizintsev, R.P. Wildes, Efficient stereo with accurate 3-D boundaries, in: Proceedings of the British Machine Vision Conference, 2006, pp. 237-246.
24. Meerbergen G.V., Vergauwen M., Pollefeys M., and van Gool L. A hierarchical symmetric stereo algorithm using dynamic programming. International Journal of Computer Vision 47 (2002) 275-282
25. Sun C. Fast stereo matching using rectangular subregioning and 3D maximum-surface techniques. International Journal of Computer Vision 47 (2002) 99-117
26. S. Forstmann, Y. Kanou, J. Ohya, S. Thuering, A. Schmitt, Real-time stereo by using dynamic programming, in: Proceedings of the IEEE Computer Vision and Pattern Recognition Workshop, vol. 3, 2004, pp. 29-35.
27. Anandan P. A computational framework and an algorithm for the measurement of visual motion. International Journal of Computer Vision 2 (1989) 283-301
28. C. Leung, B. Appleton, C. Sun, Fast stereo matching by iterated dynamic programming and quadtree subregioning, in: Proceedings of the British Machine Vision Conference, 2004, pp. 97-106.
29. Cochran S.D., and Medioni G.G. 3-D surface description from binocular stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 14 10 (1992) 981-994
30. R. Sara, R. Bajcsy, On occluding contour artifacts in stereo vision, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1997, pp. 852-857.
31. Birchfield S., and Tomasi C. A pixel dissimilarity measure that is insensitive to image sampling. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 4 (1998) 401-406
32. Szeliski R., and Scharstein D. Sampling the disparity space image. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 3 (2004) 419-425
33. Szeliski R., and Golland P. Stereo matching with transparency and matting. International Journal of Computer Vision 32 (1999) 45-61
34. W. Xiong, J. Jia, Stereo matching on objects with fractional boundary, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2007.
35. M. Drumheller, T. Poggio, On parallel stereo, in: Proceedings of the IEEE Conference on Robotics and Automation, 1986, pp. 1439-1448.
36. Y. Boykov, O. Veksler, R. Zabih, Disparity component matching for visual correspondence, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1997, pp. 470-475.
37. J. Kostkova, R. Sara, Stratified dense matching for stereopsis in complex scenes, in: Proceedings of the British Machine Vision Conference, 2003, pp. 339-348.
38. Middlebury College Stereo Vision Page, 2008. Available from: .
39. Brown University Image Sequences, 2006. Available from: .
40. S.B. Goldberg, M.W. Maimone, L. Matthies, Stereo vision and rover navigation software for planetary exploration, in: Proceedings of the IEEE Aerospace Conference, vol. 5, 2002, pp. 2025-2036.
41. M. Sizintsev, Hierarchical stereo with thin structures and transparency, in: Proceedings of the Canadian Conference on Computer and Robot Vision, 2008, pp. 97-104.
42. H. Hirschmuller, Stereo vision in structured environments by consistent semi-global matching, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 2006, pp. 2386-2393.
43. Shimizu M., and Okutomi M. Precise subpixel estimation on area-based matching. Systems and Computers in Japan 33 7 (2002) 1409-1418
44. R. Szeliski, R. Zabih, D. Scharstein, O. Veskler, V. Kolmogorov, A. Agarwala, M. Tappen, C. Rother, Comparative study of energy minimization methods for Markov random fields, in: Proceedings of the European Conference on Computer Vision, vol. 2, 2006, pp. 16-29.
45. V. Kolmogorov, C. Rother, Comparison of energy minimization algorithm for highly connected graphs, in: Proceedings of the European Conference on Computer Vision, vol. 2, 2006, pp. 1-15.
46. Kolmogorov V. Convergent tree-reweighted message passing for energy minimization. IEEE Transactions on Pattern Analysis and Machine Intelligence 28 (2006) 1568-1583
47. M.F. Tappen, W.T. Freeman, Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters, in: Proceedings of the IEEE International Conference on Computer Vision, 2003, pp. 900-907.
48. Sun J., Zheng N.-N., and Shum H.-Y. Stereo matching using belief propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 7 (2003) 787-800
49. Boykov Y., Veksler O., and Zabih R. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 11 (2001) 1222-1239
50. Boykov Y., and Kolmogorov V. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 9 (2004) 1124-1137
51. S. Roy, I.J. Cox, A maximum-flow formulation of the N-camera stereo correspondence problem, in: Proceedings of the IEEE International Conference on Computer Vision, 1998, pp. 492-502.
52. J. Cech, R. Sara, Efficient sampling of disparity space for fast and accurate matching, in: Proceedings of the BenCOS Workshop CVPR, 2007. Available from: .
53. Lhuillier M., and Quan L. Match propagation for image-based modeling and rendering. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 8 (2002) 1140-1146
54. R. Sara, Finding the largest unambiguous components of stereo matching, in: Proceedings of the European Conference on Computer Vision, vol. 3, 2002, pp. 900-914.
55. C. Harris, M. Stephens, A combined corner and edge detector, in: Proceedings of the Alvey Vision Conference, 1988, pp. 147-152.
56. Q. Yang, L. Wang, R. Yang, S. Wang, M. Liao, D. Nister, Real-time global stereo matching using hierarchical belief propagation, in: Proceedings of the British Machine Vision Conference, 2006, pp. 989-998.
57. Darabiha A., MacLean W.J., and Rose J. Reconfigurable hardware implementation of a phase-correlation stereo algorithm. Machine Vision and Applications Journal 17 (2006) 116-132
58. L. Wang, M. Liao, M. Gong, R. Yang, D. Nister, High-quality real-time stereo using adaptive cost aggregation and dynamic programming, in: Proceedings of the International Symposium on 3D Data Processing, Visualization and Transmission, 2006, pp. 798-805.