Real-time disparity estimation using foreground segmentation for stereo sequences

Optical Engineering

Volumn 45, Issue 3, 2006, Pages

  Kim, Hansung ^a,b   Min, Dong Bo ^a   Choi, Shinwoo ^a   Sohn, Kwanghoon ^a  

^a Yonsei University   (South Korea)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

Adaptive window; Foreground segmentation; Real time disparity estimation; Stereo matching

Indexed keywords

ALGORITHMS; IMAGE PROCESSING; IMAGE SEGMENTATION; MOTION COMPENSATION; PATTERN MATCHING; REAL TIME SYSTEMS; VIDEO CAMERAS;

ADAPTIVE WINDOW; FOREGROUND SEGMENTATION; REAL-TIME DISPARITY ESTIMATION; STEREO MATCHING;

STEREO VISION;

EID: 33748614303     PISSN: 00913286     EISSN: 15602303     Source Type: Journal    
DOI: 10.1117/1.2183667     Document Type: Article

References (47)

1. J. Ohm, K. Gueneberg, E. Hendriks, E. Izquierdo, D. Kalivas, M. Karl, D. Papadimatos, and A. Redert, "A realtime hardware system for stereoscopic videoconferencing with viewpoint adaptation," in Proc. IWSNCH3DI '97, pp. 147-150 (1997).
2. E. Izquierdo, "Stereo matching for enhanced telepresence in 3D videocommunications," IEEE Trans. Circuits Syst. Video Technol. 7, 629-643 (1997).
3. O. Schreer and P. Sheppard, "VIRTUE - the step towards immersive tele-presence in virtual video conference systems," in Proc. eWorks 2000 (2000).
4. S. Gibbs, C. Arapis, C. Breiteneder, V. Lalioti, S. Mostafawy, and J. Speier, "Virtual studios: an overview," IEEE Multimedia 5, 18-35 (1998).
5. C. Fehn, E. Cooke, O. Schreer, and P. Kauff, "3D analysis and imagebased rendering for immersive TV applications," Signal Process. Image Commun. 17(9), 705-715 (2002)
6. F. Betting, J. Feldmar, N. Ayache, and F. Devernay, "A new framework for fusing stereo images with volumetric medical images" in Proc. CVRMed '95, N. Ayache (Ed.), pp. 30-39, Springer (1995).
7. N. Navab, B. Bascle, M. Appel, and E. Cubillo, "Scene augmentation via the fusion of industrial drawings and uncalibrated images with a view to markerless calibration," in Proc.2nd IEEE and ACM Int. Workshop on Augmented Reality, pp. 125-133 (1999).
8. S. Feiner, B. MacIntyre, and D. Seligmann, "Knowledge-based augmented reality," Commun. ACM 36(7), 53-62 (1993).
9. G. J. Iddan and G. Yahav, "3D imaging in the studio and elsewhere," in Three-Dimensional Image Capture and Applications IV, Proc. SPIE 4298, 48-55 (1994).
10. M. W. Scott, "Range imaging laser radar," U.S. Patent No. 4,935,616 (1990).
11. T. Kanade, A. Yoshida, K. Oda, H. Kano, and M. Tanaka, "A stereo machine for video-rate dense depth mapping and its new applications," in Proc. CVPR'96, pp. 196-202, IEEE (1996).
12. W. Förstner, "Image matching," in R. M. Haralick and L. G. Shapiro Eds., Computer and Robot Vision, Vol. II, Addison-Wesley (1993).
13. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," Int. J. Comput. Vis. 47, 7-42 (2002).
14. M. Brown, D. B0urschka, and G. D. Hager, "Advances in computational stereo," IEEE Trans. Pattern Anal. Mach. Intell. 25(8), 993-1008 (2003).
15. R. E. H. Franich, "Disparity estimation in stereoscopic digital images," PhD Thesis, Technische Universiteit Delft (1996).
16. S. S. Kumar and B. N. Chatterji, "Stereo matching algorithms based on fuzzy approach," Int. J. Pattern Recognit. Artif. Intell. 16(7), 883-899 (2002).
17. W. E. L. Grimson, "Computational experiments with a feature based stereo algorithm," IEEE Trans. Pattern Anal. Mach. Intell. 7(1), 17-34 (1985).
18. J. Y. Goulermas and P. Liatsis, "Hybrid symbiotic genetic optimisation for robust edge-based stereo correspondence," Pattern Recogn. 34, 2477-2496 (2001).
19. L. Robert and R. Deriche, "Dense depth map reconstruction: a minimization and regularization approach which preserves discontinuities," Lect. Notes Comput. Sci. 1064, 439-451 (1996).
20. L. Alvarez, R. Deriche, J. Sanchez, and J. Weickert, "Dense disparity map estimation respecting image discontinuities: a PDE and scale-space based approach," J. Visual Commun. Image Represent 13, 3-21 (2002).
21. Y. Ohta and T. Kanade, "Stereo by intra- and intra-scanline search using dynamic programming," IEEE Trans. Pattern Anal. Mach. Intell. 7, 139-154 (1985).
22. M. Mozerov, V. Kober, and T. Choi, "Improved motion stereo matching based on a modified dynamic programming," Opt. Eng. 40(10), 2234-2239 (2001).
23. T. Kanade, A. Yoshida, K. Oda, H. Kano, and M. Tanaka, "A stereo machine for video-rate dense depth mapping and its new applications," in Proc. CVPR'96, pp. 196-202 (1996).
24. S. Kimura, T. Shinbo, H. Yamaguchi, E. Kawamura, and K. Naka, "A convolver-based real-time stereo machine (SAZAN)," in Proc. CVPR'99, Vol. 1, pp. 457-463 (1999).
25. A. Darabiha, J. Rose, and W. J. MacLean, "Video-rate stereo depth measurement on programmable hardware," in Proc. CVPR'03, pp. 203-210 (2003).
26. S. Taraglio and A. Zanela, "Improving a real-time neural-based stereo vision system," Real-Time Imag. 7, 59-76 (2001).
27. O. Schreer, N. Brandenburg, and P. Kauff, "Real-time disparity analysis for applications in immersive teleconference scenarios - a comparatively study," in Proc. ICIAP, pp. 346-351, IEEE Computer Soc.(2001).
28. K. Mühlmann, D. Maier, J. Hesser, and R. Männer, "Calculating dense disparity maps from color stereo images, an efficient implementation," Int. J. Comput. Vis. 47, 79-88 (2002).
29. L. D. Stefano and S. Mattoccia, "Real-time stereo within the VIDET Project," Real-Time Imag. 8, 439-453 (2002).
30. J. Schmidt, H. Niemann, and S. Vogt, "Dense disparity maps in real-time with an application to augmented reality," in Proc. WACV, pp. 225-230, IEEE (2002).
31. H. Kim, Y. Choe, and K. Sohn, "Disparity estimation using region-dividing technique with energy-based regularization," Opt. Eng. 43(8), 1882-1890 (2004).
32. http://www.ptgrey.com/.
33. J. Fan, G. Fujita, M. Furuie, T Onoye, I. Shirakawa, and L. Wu, "Automatic moving object extraction toward compact video representation," Opt. Eng. 39, 438-452 (2000).
34. S. Chien, Y. Huang, and L. Chen, "Predictive watershed: a fast watershed algorithm for video segmentation," IEEE Trans. Circuits Syst. Video Technol. 13(5), 453-461 (2003).
35. A. Neri, S. Colonnese, G. Russo, and P. Talone, "Automatic moving object and background separation," Signal Process. 66, 219-232 (1998).
36. S. Chien, S. Ma, and L. Chen, "Efficient moving object segmentation algorithm using background registration technique," IEEE Trans. Circuits Syst. Video Technol. 12(7), 577-586 (2002).
37. K. Bhat, M. Saptharishi, and P. Khosla, "Motion detection and segmentation using image mosaics," in Proc.ICME 2000, Vol. 3, pp. 1577-1580, IEEE (2000).
38. P. Kumar, K. Sengupta, and S. Ranganath, "Real time detection and recognition of human profiles using inexpensive desktop cameras," in Proc. ICPR'00, pp. 1096-1099, IEEE Computer Soc., (2000).
39. R. C. Gonzalez and R. E. Wood, Digital Image Processing, Addison-Wesley (1993).
40. A. L. Yuille and T. Poggio, "A generalized ordering constraint for stereo correspondence," A.I. Memo 777, AI Lab, MIT (1984).
41. E. Izquierdo, "Stereo image analysis for multi-viewpoint telepresence applications," Signal Process. Image Commun. 11(3), 231-254 (1998).
42. J. Weickert, "A review of nonlinear diffusion filtering," Lect. Notes Comput. Sci. 1252, 3-28 (1997).
43. http://www.middlebury.edu/stereo.
44. H. Hirschmüller, "Improvements in real-time correlation-based stereo vision," in Proc. CVPR stereo Workshop, pp. 141-148 (2001).
45. C. Sun, "Fast stereo matching using rectangular subregioning and 3D maximum-surface techniques," Int. J. Comput. Vis. 42(1), 7-42 (2002).
46. S. Forstmann, J. Ohya, Y. Kanou, A. Schmitt, and S. Thuering, "Real-time stereo by using dynamic programming," in Proc. CVPR Workshop, p. 29, IEEE (2004).
47. L. Zitnick and T. Kanade, "A cooperative algorithm for stereo matching and occlusion detection," IEEE Trans. Pattern Anal. Mach. Intell. 22(7), 675-684 (2000).