Local density encoding for robust stereo matching

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 24, Issue 12, 2014, Pages 2049-2062

  Nguyen, Vinh Dinh ^a   Nguyen, Duc Dung ^a   Lee, Sang Jun ^a   Jeon, Jae Wook ^a  

^a Sungkyunkwan University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

ENCODING (SYMBOLS); RADIOMETRY;

COLOR CONSISTENCY; GLOBAL MODELS; ILLUMINATION CHANGES; LOCAL PATTERNS; RADIOMETRIC VARIATIONS; REALISTIC CONDITIONS; STEREO CORRESPONDENCES; STEREO MATCHING;

STEREO IMAGE PROCESSING;

EID: 84916934215     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2014.2334053     Document Type: Article

References (53)

1. M. Harville, "Stereo person tracking with adaptive plan-view templates of height and occupancy statistics," Image Vis. Comput., vol. 22, no. 2, pp. 127-142, 2004.
2. D. Pfeiffer and U. Franke, "Modeling dynamic 3D environments by means of the stixel world," IEEE Intell. Transp. Syst. Mag., vol. 3, no. 3, pp. 24-36, Dec. 2011.
3. L. Zhang, B. Curless, and S. M. Seitz, "Spacetime stereo: Shape recovery for dynamic scenes," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2003, pp. 367-374.
4. F. Tombari, S. Mattoccia, L. D. Stefano, and F. Tonelli, "Detecting motion by means of 2D and 3D information," in Proc. Workshop Multi-Dimensional Multi-View Image Process. (ACCV), 2007, pp. 170-176.
5. Z. Sun, B. George, and M. Ronald, "On-road vehicle detection: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 694-771, May 2006.
6. S. Meister, B. Jähne, and D. Kondermann, "Outdoor stereo camera system for the generation of real-world benchmark data sets," Opt. Eng., vol. 51, no. 2, pp. 021107-1-021107, 2012.
7. R. Klette et al., "Performance of correspondence algorithms in visionbased driver assistance using an online image sequence database," IEEE Trans. Veh. Technol., vol. 60, no. 5, pp. 2012-2026, Jun. 2011.
8. H. Hirschmuller and D. Scharstein, "Evaluation of stereo matching costs on images with radiometric differences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 9, pp. 1582-1599, Sep. 2009.
9. (2010). Middlebury Vision Evaluation [Online]. Available: http://vision.middlebury.edu/stereo/
10. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient belief propagation for early vision," Int. J. Comput. Vis., vol. 70, no. 1, pp. 972-986, 2006.
11. O. Veksler, "Fast variable window for stereo correspondence using integral images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2003, pp. 556-561.
12. C. Rhemann, A. Hosni, M. Bleyer, C. Rother, and M. Gelautz, "Fast cost-volume filtering for visual correspondence and beyond," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2011, pp. 3017-3024.
13. Q. Yang, "A non-local cost aggregation method for stereo matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1402-1409.
14. Z. Liu and R. Klette, "Dynamic programming stereo on real-world sequences," in Proc. 15th Int. Conf. Adv. Neuro Inform. Process. (ICONIP), vol. 5506. 2008, pp. 527-534.
15. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001.
16. A. S. Ogale and Y. Aloimonos, "Robust contrast invariant stereo correspondence," in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2005, pp. 819-824.
17. L. Wang, R. Yang, and J. E. Davis, "BRDF invariant stereo using light transport constancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 9, pp. 1616-1626, Sep. 2007.
18. L. Nalpantidis and A. Gasteratos, "Stereo vision for robotic applications in the presence of non-ideal lighting conditions," Image Vis. Comput., vol. 28, no. 6, pp. 940-951, 2010.
19. Y. S. Heo, K. M. Lee, and S. U. Lee, "Robust stereo matching using adaptive normalized cross-correlation," IEEE Trans. Pattern Anal. Mach. Intell, vol. 33, no. 4, pp. 807-822, Apr. 2011.
20. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
21. Z. Guo, D. Zhang, and D. Zhang, "A completed modeling of local binary pattern operator for texture classification," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1657-1663, Jun. 2010.
22. X. Tan and B. Triggs, "Enhanced local texture feature sets for face recognition under difficult lighting conditions," in Analysis and Modeling of Faces and Gestures, vol. 4778. Berlin, Germany: Springer-Verlag, 2007, pp. 168-182.
23. B. Zhang, Y. Gao, S. Zhao, and J. Liu, "Local derivative pattern versus local binary pattern: Face recognition with high-order local pattern descriptor," IEEE Trans. Image Process., vol. 19, no. 2, pp. 533-544, Feb. 2010.
24. M. Subrahmanyam, R. P. Maheshwari, and R. Balasubramanian, "Local tetra patterns: A new feature descriptor for content-based image retrieval," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2874-2886, May 2012.
25. V. D. Nguyen, D. D. Nguyen, T. T. Nguyen, V. Q. Dinh, and J. W. Jeon, "Support local pattern and its application to disparity improvement and texture classification," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 2, pp. 263-276, Feb. 2014.
26. S. T. Barnard and M. A. Fischler, "Computational stereo," ACM Comput. Surv., vol. 14, no. 4, pp. 553-572, 1982.
27. U. R. Dhond and J. K. Aggarwal, "Structure from stereo-A review," IEEE Trans. Syst., Man, Cybern., vol. 19, no. 6, pp. 1489-1510, Nov./Dec. 1989.
28. L. G. Brown, "A survey of image registration techniques," Comput. Surv., vol. 24, no. 4, pp. 325-376, 1992.
29. A. Koschan, "What is new in computational stereo since 1989: A survey on current stereo papers," Dept. Biol., Tech. Univ. Berlin, Berlin, Germany, Tech. Rep. 93-22 1993.
30. G. N. Desouza and A. C. Kak, "Vision for mobile robot navigation: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 2, pp. 237-267, Feb. 2002.
31. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense twoframe stereo correspondence algorithms," Int. J. Comput. Vis., vol. 47, nos. 1-3, pp. 7-42, 2002.
32. H. Sunyoto, W. van der Mark, and D. M. Gavrila, "A comparative study of fast dense stereo vision algorithms," in Proc. IEEE Intell. Veh. Symp., Jun. 2004, pp. 319-324.
33. S. Morales, T. Vaudrey, and R. Klette, "Robustness evaluation of stereo algorithms on long stereo sequences," in Proc. IEEE Intell. Veh. Symp., Jun. 2009, pp. 347-352.
34. M. Gong, R. Yang, L. Wang, and M. Gong, "A performance study on different cost aggregation approaches used in real-time stereo matching," Int. J. Comput. Vis., vol. 75, no. 2, pp. 283-296, 2007.
35. L. Nalpantidis, G. C. Sirakoulis, and A. Gasteratos, "Review of stereo vision algorithms: From software to hardware," Int. J. Optomechatronics, vol. 2, no. 4, pp. 435-562, 2008.
36. B. Tippetts, D. J. Lee, K. Lillywhite, and J. Archibald, "Review of stereo vision algorithms and their suitability for resource-limited systems," J. Real-Time Image Process., pp. 1-21, Jan. 2013.
37. R. Zahabih and J. Wook, "Non-parametric local transforms for computing visual correspondence," in Proc. Int. Eur. Conf. Comput. Vis., 1994, pp. 151-1581.
38. H. Hirschmuller, "Stereo processing by semiglobal matching and mutual information," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 328-341, Feb. 2008.
39. W. Xiatao and W. Xingbo, "FPGA based parallel architectures for normalized cross-correlation," in Proc. 1st Int. Conf. Inform. Sci. Eng., Dec. 2009, pp. 225-229.
40. K. Ambrosch, M. Humenberger, W. Kubinger, and A. Steininger, "Hardware implementation of an SAD based stereo vision algorithm," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-6.
41. S. Jin et al., "FPGA design and implementation of a real-time stereo vision system," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 1, pp. 15-26, Jan. 2010.
42. H. Jeon and S. Park, "Generalized trellis stereo matching with systolic array," in Proc. 2nd Int. Symp. Parallel Distrib. Process. Appl., 2005, pp. 263-267.
43. Q. Yang, L. Wang, and N. Ahuja, "A constant-space belief propagation algorithm for stereo matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1458-1465.
44. J. M. Perez, P. Sanchez, and M. Martinez, "High memory throughput FPGA architecture for high-definition belief-propagation stereo matching," in Proc. Int. Conf. Signal, Circuits Syst., Nov. 2009, pp. 1-6.
45. S. K. Gehrig, F. Eberli, and T. Meyer, "A real-time low-power stereo vision engine using semi-global matching," in Proc. Int. Conf. Comput. Vis. Syst., 2009, pp. 134-143.
46. F. M. Khellah, "Texture classification using dominant neighborhood structure," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3270-3279, Nov. 2011.
47. Y. Li and S. Osher, "A new median formula with applications to PDE based denoising," Commun. Math. Sci., vol. 7, no. 3, pp. 741-753, 2009.
48. A. Geiger, P. Lenz, and R. Urtasun, "Are we ready for autonomous driving? The KITTI vision benchmark suite," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3354-3361.
49. S. Hermann and T. Vaudrey, "The gradient-A powerful and robust cost function for stereo matching," in Proc. 25th Int. Conf. Image Vis. Comput. New Zealand (IVCNZ), Nov. 2010, pp. 1-8.
50. R. Szeliski et al., "A comparative study of energy minimization methods for Markov random fields with smoothness-based priors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 1068-1080, Jun. 2008.
51. R. Haeusler and R. Klette, "Analysis of KITTI data for stereo analysis with stereo confidence measures," in Proc. Eur. Conf. Comput. Vis. (ECCV) Workshops Demonstrations, vol. 7584. 2012, pp. 158-167.
52. Y. K. Baik, J. H. Jo, and K. M. Lee, "Fast census transform-based stereo algorithm using SSE2," in Proc. 12th Korea Jpn. Joint Workshop Frontiers Comput. Vis. (FCV), 2006, pp. 305-309.
53. V. D. Nguyen, T. T. Nguyen, D. D. Nguyen, S. J. Lee, and J. W. Jeon, "A fast evolutionary algorithm for real-time vehicle detection," IEEE Trans. Veh. Technol., vol. 62, no. 6, pp. 2453-2468, Nov. 2013.