Cost aggregation and occlusion handling with WLS in stereo matching

IEEE Transactions on Image Processing

Volumn 17, Issue 8, 2008, Pages 1431-1442

  Min, Dongbo ^a   Sohn, Kwanghoon ^a  

^a Yonsei University   (South Korea)

Author keywords

Cost aggregation; Multiscale approach; Occlusion handling; Stereo vision; Weighted least square

Indexed keywords

COSTS; CURVE FITTING; DIFFERENCE EQUATIONS; EQUIPMENT TESTING; GLOBAL OPTIMIZATION; OPTIMIZATION; STEREO VISION;

ACCELERATION TECHNIQUES; ADAPTIVE INTERPOLATIONS; AGGREGATION METHODS; ART METHODS; ASYMMETRIC INFORMATIONS; COLOR SEGMENTATIONS; COMPUTATIONAL LOADS; COMPUTATIONALLY EFFICIENT; CONVERGENCE RATES; DIFFERENCE IMAGES; ENERGY FUNCTIONS; GLOBAL OPTIMIZATION TECHNIQUES; ITERATIVE EQUATIONS; MINIMIZATION PROBLEMS; MULTISCALE APPROACH; NOVEL METHODS; OBSERVED DATUMS; OCCLUSION HANDLING; OCCLUSION PROBLEMS; OPTIMAL COSTS; STEREO MATCHING; TEST BEDS; WEIGHTED LEAST SQUARE;

COST BENEFIT ANALYSIS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; PHOTOGRAPHY; REGRESSION ANALYSIS; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; LEAST-SQUARES ANALYSIS; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAMMETRY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 48349094922     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.925372     Document Type: Article

References (38)

1. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," Int. J. Comput. Vis. vol. 47, no. 1-3, pp. 7-42, Apr. 2002.
2. T. Kanade and M. Okutomi, "A stereo matching algorithm with an adaptive window: Theory and experiment," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 9, pp. 920-932, Sep. 1994.
3. Y. Boykov, O. Veksler, and R. Zabih, "A variable window approach to early vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 12, pp. 1283-1294, Dec. 1998.
4. O. Veksler, "Stereo correspondence with compact windows via minimum ratio cycle," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 12, pp. 1654-1660, Dec. 2002.
5. O. Veksler, "Fast variable windowfor stereo correspondence using integral images," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003, vol. 1, pp. 556-561.
6. Y. Zhang and C. Kambhamettu, "Stereo matching with segmentation-based cooperation," in Proc. Eur. Conf. Computer Vision, 2002, pp. 556-571.
7. H. Tao and H. S. Sawhney, "Global matching criterion and color segmentation based stereo," in Proc. IEEE Workshop on the Application of Computer Vision, 2000, pp. 246-253.
8. H. Lim and H. Park, "A dense disparity estimation method using color segmentation and energy minimization," in Proc. IEEE Int. Conf. Image Processing, 2006, pp. 1033-1036.
9. M. Gong and R. Yang, "Image-gradient-guided real-time stereo on graphics hardware," in Proc. IEEE 3DIM, 2005, pp. 548-555.
10. L. Tang, C. Wu, and Z. Chen, "Image dense matching based on region growth with adaptive window," Pattern Recognit. Lett., vol. 23, pp. 1169-1178, 2002.
11. S. Yoon, D. Min, and K. Sohn, "Fast dense stereo matching using adaptive window in hierarchical framework," in Proc. Int. Symp. Visual Computing, 2006, pp. 316-325.
12. A. Fusiello, V. Roberto, and E. Trucco, "Efficient stereo with multiple windowing," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997, pp. 858-863.
13. M. Okutomi, Y. Katayama, and S. Oka, "A simple stereo algorithm to recover precise object boundaries and smooth surfaces," Int. J. Comput. Vis., vol. 47, no. 1-3, pp. 261-273, 2002.
14. K. Yoon and I. Kweon, "Adaptive support-weight approach for correspondence search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 650-656, Apr. 2006.
15. L. Wang, M. Liao, M. Gong, R. Yang, and D. Nister, "High-quality real-time stereo using adaptive cost aggregation and dynamic programming," in Proc. IEEE 3DPVT, 2006, pp. 798-805.
16. A. Bobick and S. Intille, "Large occlusion stereo," Int. J. Comput. Vis., vol. 33, no. 3, pp. 1-20, Sep. 1999.
17. V. Kolmogorov and R. Zabih, "Computing visual correspondence with occlusions using graph cuts," in Proc. IEEE Int. Conf. Computer Vision, 2001, pp. 508-515.
18. J. Sun, Y. Li, S. Kang, and H. Shum, "Symmetric stereo matching for occlusion handling," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005, pp. 399-406.
19. L. Alvarez, R. Deriche, J. Sanchez, and J. Weickert, "Dense disparity map estimation respecting image discontinuities: A PDE and scalespace based approach," J. Vis. Commun. Image Represent., vol. 13, pp. 3-21, 2002.
20. H. Kim, Y. Choe, and K. Sohn, "Disparity estimation using region-dividing technique with energy-based regularization," Opt. Eng., vol. 43, no. 8, pp. 1882-1890, Aug. 2004.
21. D. Scharstein and R. Sezliski, "Stereo matching with nonlinear diffusion," Int. J. Comput. Vis., vol. 28, no. 2, pp. 155-174, June 1998.
22. M. Heath, Scientific Computing: An Introductory Survey. New York: McGraw Hill, 2002.
23. A.Willsky, "Multiresolution markov models for signal and image processing," Proc. IEEE, vol. 90, no. 8, pp. 1396-1458, Aug. 2002.
24. G. Meerbergen, M. Vergauwen, M. Pollefeys, and L. Van, "Gool A hierarchical symmetric stereo algorithm using dynamic programming," Int. J. Comput. Vis., vol. 47, no. 1-3, pp. 275-285, 2002.
25. R. Yang and M. Pollefeys, "Multiresolution real-time stereo on commodity graphics hardware," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003, pp. 1211-1217.
26. S. Geman and D. E. McClure, "Bayesian image analysis: An application to single photon emission tomography," Proc. Statist. Comput. Sect., pp. 12-18, 1985.
27. A. Klaus, M. Sormann, and K. Karner, "Segment-based stereo matching using belief propagation and a self-adapting dissimilarity measure," in Proc. IEEE Int. Conf. Pattern Recognit., 2006, pp. 15-18.
28. Q. Yang, L. Wang, R. Yang, H. Stewenius, and D. Nister, "Stereo matching with color-weighted correlation, hierarchical belief propagation and occlusion handling," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006, pp. 2347-2354.
29. M. Bleyer and M. Gelautz, "A layered stereo algorithm using image segmentation and global visibility constraints," in Proc. IEEE Int. Conf. Image Processing, 2004, pp. 2997-3000.
30. H. Hirschmueller, "Stereo vision in structured environments by consistent semi-global matching," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006, pp. 2386-2393.
31. K. Yoon and I. Kweon, "Stereo matching with the distinctive similarity measure," presented at the IEEE Int. Conf. Computer Vision, 2007.
32. L. Zitnick and S. B. Kang, "Stereo for image-based rendering using image oversegmentation," Int. J. Comput. Vis., vol. 75, no. 1, pp. 49-65, 2007.
33. C. Lei, J. Selzer, and Y.Yang, "Region-tree based stereo using dynamic programming optimization," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006, pp. 2378-2385.
34. S. Larsen, P. Mordohai, M. Pollefeys, and H. Fuchs, "Temporally consistent reconstruction from multiple video streams using enhanced belief propagation," presented at the IEEE Int. Conf. Computer Vision, 2007.
35. Y. Deng and X. Lin, "A fast line segment based dense stereo algorithm using tree dynamic programming," in Proc. Eur. Conf. Computer Vision 2006, pp. 201-212.
36. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient belief propagation for early vision," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004, pp. 261-268.
37. S. B. Kang, R. Szeliski, and C. Jinxjang, "Handling occlusions in dense multi-view stereo," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001, pp. 103-110.
38. [Online]. Available: Http://vision.middlebury.edu/stereo