Depth video enhancement based on weighted mode filtering

IEEE Transactions on Image Processing

Volumn 21, Issue 3, 2012, Pages 1176-1190

  Min, Dongbo ^a   Lu, Jiangbo ^a   Do, Minh N ^b  

^a ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Depth enhancement; depth sensor; multiscale color measure (MCM); temporal consistency; weighted mode filtering (WMF)

Indexed keywords

DEPTH ENHANCEMENT; DEPTH SENSORS; MODE FILTERING; MULTISCALES; TEMPORAL CONSISTENCY;

COLOR; FILTRATION;

GRAPHIC METHODS;

EID: 84863142594     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2011.2163164     Document Type: Article

References (32)

1. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," Int. J. Comput. Vis., vol. 47, no. 1-3, pp. 7-42, Apr.-Jun. 2002. (Pubitemid 34428419)
2. [Online]. Available: http://vision.middlebury.edu/stereo
3. K. Yoon and I. Kweon, "Adaptive support-weight approach for correspondence search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 650-656, Apr. 2006. (Pubitemid 43264662)
4. D. Min and K. Sohn, "Cost aggregation and occlusion handling with WLS in stereo matching," IEEE Trans. Image Process., vol. 17, no. 8, pp. 1431-1442, Aug. 2008.
5. R. Larsen, E. Barth, and A. Kolb, "Special issue on time-of-flight camera based computer vision," Comput. Vis. Image Understand., vol. 114, no. 12, p. 1317, Dec. 2010.
6. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Proc. IEEE ICCV, 1998, pp. 839-846.
7. J. Diebel and S. Thrun, "An application of Markov random fields to range sensing," in Proc. NIPS, 2005, pp. 291-298.
8. J. Lu, D. Min, R. S. Pahwa, and M. N. Do, "A revisit to MRF-based depth map super-resoultion and enhancement," in Proc. IEEE ICASSP, 2011, pp. 985-988.
9. J. Park, H. Kim, Y.-W. Tai, M. S. Brown, and I. Kweon, "High quality depth map upsampling for 3D-TOF cameras," in Proc. IEEE Int. Conf. Comput. Vis., 2011.
10. J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling," in Proc. ACM SIGGRAPH, 2007, p. 96.
11. Q. Yang, R. Yang, J. Davis, and D. Nister, "Spatial-depth super resolution for range images," Proc. IEEE Comput. Vis. Pattern Recognit., pp. 1-8, 2007.
12. Q. Yang, K.-H. Tan, B. Culbertson, and J. Apostolopoulos, "Fusion of active and passive sensors for Fast 3-D capture," in Proc. IEEE Int. Workshop MMSP, 2010, pp. 69-74.
13. B. Huhle, T. Schairer, P. Jenke, and W. Straer, "Fusion of range and color images for denoising and resolution enhancement with a nonlocal filter," Comput. Vis. Image Understand., vol. 114, no. 12, pp. 1336-1345, Dec. 2010.
14. M. F. Tappen and W. T. Freeman, "Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters," in Proc. IEEE ICCV, 2003, pp. 900-906.
15. J. Zhu, L.Wang, R. Yang, and J. Davis, "Fusion of time-of-flight depth and stereo for high accuracy depth maps," Proc. IEEE Comput. Vis. Pattern Recognit., pp. 1-8, 2008.
16. J. Zhu, L.Wang, J. Gao, and R. Yang, "Spatial-temporal fusion for high accuracy depth maps using dynamic MRFs," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 5, pp. 899-909, May 2010.
17. J. Weijer and R. Boomgaard, "Local mode filtering," in Proc. IEEE Comput. Vis. Pattern Recognit., 2001, pp. II-428-II-433. (Pubitemid 34096744)
18. S. Paris, P. Kornprobst, J. Tumblin, and F. Durand, "Bilateral filtering: Theory and applications," Foundations Trends Comput. Graph. Vis., vol. 4, no. 1, pp. 1-73, 2008.
19. S. Gokturk, H. Yalcin, and C. Bamji, "A time-of-flight depth sensor-System description, issues and solutions," in Proc. IEEE CVPRW, 2004, p. 35.
20. D. Barash, "A fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 6, pp. 844-847, Jun. 2006.
21. M. Elad, "On the origin of the bilateral filter and ways to improve it," IEEE Trans. Image Process., vol. 11, no. 10, pp. 1141-1151, Oct. 2002. (Pubitemid 35359385)
22. J. Lu, G. Lafruit, and F. Catthoor, "Anisotropic local high-confidence voting for accurate stereo correspondence," in Proc. SPIE-IST Electron. Imag., Jan. 2008, vol. 6812, p. 68 120J.
23. A. Buades, B. Coll, and J.-M. Morel, "Nonlocal image and movie denoising," Int. J. Comput. Vis., vol. 76, no. 2, pp. 123-139, Feb. 2008.
24. M. N. Do, Q. H. Nguyen, H. T. Nguyen, D. Kubacki, and S. J. Patel, "Immersive visual communication," IEEE Signal Process. Mag., vol. 28, no. 1, pp. 58-66, Jan. 2011.
25. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Int. Joint Conf. Artif. Intell., 1981, pp. 674-679. (Pubitemid 14478744)
26. C. Tomasi and T. Kanade, Detection and tracking of point features Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-CS-91-132, Apr. 1991.
27. [Online]. Available: http://vision.middlebury.edu/flow
28. C. Richardt, D. Orr, I. Davies, A. Criminisi, and N. A. Dodgson, "Real-time spatiotemporal stereo matching using the dual-cross-bilateral grid," in Proc. ECCV, 2010, pp. 510-523.
29. [Online]. Available: http://www.cl.cam.ac.uk/research/rainbow/projects/ dcbgrid/datasets/
30. [Online]. Available: http://diml.yonsei.ac.kr/~forevertin/
31. [Online]. Available: http://www.mesa-imaging.ch/
32. [Online]. Available: http://www.ptgrey.com/