Learning sparse representations of depth

IEEE Journal on Selected Topics in Signal Processing

Volumn 5, Issue 5, 2011, Pages 941-952

  Tošić, Ivana ^a   Olshausen, Bruno A ^a   Culpepper, Benjamin J ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Depth denoising; depth from stereo; dictionary learning; sparse approximations

Indexed keywords

DE-NOISING; DEPTH CAMERA; DEPTH ESTIMATION; DEPTH FROM STEREO; DEPTH MAP; DEPTH STRUCTURE; DICTIONARY LEARNING; DISPARITY MAP; GENERAL METHOD; GRAPH CUT; GRAPHICAL MODEL; HIGHER ORDER; ITERATIVE OPTIMIZATION; LASER RANGE SCANNERS; MARKOV RANDOM FIELD MODELS; NONSTATIONARY; SECOND LAYER; SECOND ORDERS; SPARSE APPROXIMATIONS; SPARSE CODING; SPARSE PRIOR; SPARSE REPRESENTATION; STATIONARY NOISE; STEREO MATCHING ALGORITHM; STRUCTURED LIGHT; TIME-OF-FLIGHT CAMERAS; TWO LAYERS;

ALGORITHMS; CAMERAS; GRAPHIC METHODS; INFERENCE ENGINES; NOISE POLLUTION CONTROL; OPTIMIZATION; SCANNING;

GRAPH THEORY;

EID: 80051761060     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2011.2158063     Document Type: Article

References (43)

1. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)
2. O.Woodford, P. Torr, I. Reid, and A. Fitzgibbon, "Global stereo reconstruction under second-order smoothness priors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 12, pp. 2115-2128, Dec. 2009.
3. E. Martinian, A. Behrens, J. Xin, and A. Vetro, "View synthesis for multiview video compression," in Proc. Picture Coding Symp., 2006.
4. A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, "Multiview imaging and 3DTV," IEEE Signal Process. Mag., vol. 24, no. 6, pp. 10-21, Nov. 2007. (Pubitemid 350201595)
5. S. G. Chang, B. Yu, and M. Vetterli, "Adaptive wavelet thresholding for image denoising and compression," IEEE Trans. Image Process., vol. 9, no. 9, pp. 1532-1546, Sep. 2000.
6. B. A. Olshausen and D. Field, "Sparse coding with an overcomplete basis set: A strategy employed by V1?," Vis. Res., vol. 37, no. 23, pp. 3311-3325, 1997. (Pubitemid 27493805)
7. K. Engan, B. D. Rao, and K. Kreutz-Delgado, "Frame design using FOCUSS with method of optimal directions (MOD)," in Proc. Norwegian Signal Process. Symp., 1999.
8. M. S. Lewicki and T. J. Sejnowski, "Learning overcomplete representations," Neural Comput., vol. 12, no. 2, pp. 337-365, 2000.
9. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
10. J. Mairal, G. Sapiro, and M. Elad, "Learning multiscale sparse representations for image and video restoration," Multiscale Modeling Simulat., vol. 7, no. 1, pp. 214-241, 2008.
11. M. Yaghoobi, T. Blumensath, and M. E. Davies, "Dictionary learning for sparse approximations with the majorization method," IEEE Trans. Signal Process., vol. 57, no. 6, pp. 2178-2191, Jun. 2009.
12. M. D. Plumbley, T. Blumensath, L. Daudet, R. Gribonval, and M. E. Davies, "Sparse representations in audio and music: From coding to source separation," Proc. IEEE, vol. 99, no. 1, pp. 1-11, Jan. 2009.
13. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006. (Pubitemid 44811686)
14. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," Int. J. Comput. Vis., vol. 47, no. (1/2/3), pp. 7-42, 2002. (Pubitemid 34428419)
15. K. Kreutz-Delgado, J. Murray, B. Rao, K. Engan, T.-W. Lee, and T. J. Sejnowski, "Dictionary learning algorithms for sparse representation," Neural Comput., vol. 15, no. 2, pp. 349-396, 2003. (Pubitemid 37049825)
16. S. Z. Li, Markov Random Field Modeling in Image Analysis. New York: Springer-Verlag, 2001.
17. J. Sun, N.-N. Zheng, and H.-Y. Shum, "Stereo matching using belief propagation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 7, pp. 787-800, Jul. 2003.
18. V. Lempitsky, C. Rother, S. Roth, and A. Blake, "Fusion moves for Markov random field optimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 8, pp. 1392-1405, Aug. 2010.
19. V. Kolmogorov and R. Zabih, "What energy functions can be minimized via graph cuts?," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 2, pp. 65-81, Feb. 2004.
20. M. S. Lewicki and B. A. Olshausen, "Probabilistic framework for the adaptation and comparison of image codes," J. Opt. Soc. Amer., vol. 16, no. 7, pp. 1587-1601, 1999. (Pubitemid 129308656)
21. Z. Ni, D. Tian, S. Bhagavathy, J. Llach, and B. S. Manjunath, "Improving the quality of depth image based rendering for 3D video systems," in Proc. IEEE Int. Conf. Image Process., 2009, pp. 513-516.
22. Z. Yang and D. Purves, "A statistical explanation of visual space," Nature Neurosci., vol. 6, pp. 632-640, 2003. (Pubitemid 36648805)
23. L. I. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Physica D, vol. 60, no. 1-4, pp. 259-268, 1992.
24. A. Chambolle, "An algorithm for total variation minimization and applications," J. Math. Imag. Vis., vol. 20, no. 1-2, pp. 89-97, 2004.
25. A. Buades, B. Coll, and J. M. Morel, "A review of image denoising algorithms, with a new one," Multiscale Modeling Simulat., vol. 4, no. 2, pp. 490-530, 2005. (Pubitemid 43890582)
26. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, "Image denoising using scale mixtures of Gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
27. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image denoising by sparse 3-D transform-domain collaborative filtering," IEEE Trans. Image Process., vol. 16, no. 8, pp. 2080-2095, Aug. 2007. (Pubitemid 47225460)
28. Y. Boykov and V. Kolmogorov, "An experimental comparison of mincut/max-flow algorithms for energy minimization in vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1124-1137, Sep. 2004.
29. M. Mahmoudi and G. Sapiro, "Sparse representations for three-dimensional range data restoration," IMA Preprint, Univ. of Minnesota, 2009.
30. M. Maitre and M. N. Do, "Depth and depth-color coding using shapeadaptive wavelets," J. Vis. Commun. Image Represent., vol. 21, no. 5-6, pp. 513-522, 2010.
31. R. Willett and R. Nowak, "Platelets: A multiscale approach for recovering edges and surfaces in photon-limited medical imaging," IEEE Trans. Med. Imag., vol. 22, no. 3, pp. 332-350, Mar. 2003.
32. Y. Morvan, P. H. N. de With, and D. Farin, "Platelet-based coding of depth maps for the transmission of multiview images," in Stereoscopic Displays and Virtual Reality Systems XIII. Bellingham, WA: SPIE, 2006, vol. 6055, p. 60550K, no. 1.
33. T. Edeler, K. Ohliger, S. Hussmann, and A. Mertins, "Super resolution of time-of-flight depth images under consideration of spatially varying noise variance," in Proc. IEEE Int. Conf. Image Process., 2009, pp. 1185-1188.
34. J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling," in Proc. ACM SIGGRAPH, 2007, vol. 26, no. 3.
35. B. Huhle, T. Schairer, P. Jenke, and W. Strasser, "Robust non-local denoising of colored depth data," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn., 2008, pp. 1-7.
36. O. Schall, A. Belyaev, and H.-P. Seidel, "Adaptive feature-preserving non-local denoising of static and time-varying range data," Comput.-Aided Design, vol. 40, no. 6, pp. 701-707, 2008.
37. D. Marr and T. Poggio, "Cooperative computation of stereo disparity," Science, vol. 194, no. 4262, pp. 283-287, 1976.
38. V. Kolmogorov and R. Zabih, "Computing visual correspondence with occlusions using graph cuts," in Proc. Int. Conf. Comput. Vis., 2001.
39. J. Sun, Y. Li, S. B. Kang, and H.-Y. Shum, "Symmetric stereo matching for occlusion handling," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn., 2005, pp. 399-406.
40. Q. Yang, L. Wang, R. Yang, H. Stewńius, and D. Nistŕ, "Stereo matching with color-weighted correlation, hierarchical belief propagation and occlusion handling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 3, pp. 492-504, Mar. 2009.
41. Y. Taguchi, B. Wilburn, and L. Zitnick, "Stereo reconstruction with mixed pixels using adaptive over-segmentation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn., 2008, pp. 1-8.
42. H. Ishikawa, "Higher-order clique reduction in binary graph cut," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn., 2009, vol. 0, pp. 2993-3000.
43. C. Rother, V. Kolmogorov, V. Lempitsky, and M. Szummer, "Optimizing binary MRFs via extended roof duality," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn., 2007, pp. 1-8.