A generalized random walk with restart and its application in depth up-sampling and interactive segmentation

IEEE Transactions on Image Processing

Volumn 22, Issue 7, 2013, Pages 2574-2588

  Ham, Bumsub ^a   Min, Dongbo ^b   Sohn, Kwanghoon ^a  

^a Yonsei University   (South Korea)

^b ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

Author keywords

Anisotropic diffusion; depth up sampling; diffusion reaction equation; interactive segmentation; random walk with restart (RWR); thermal diffusivity

Indexed keywords

ANISOTROPIC DIFFUSION; DIFFUSION-REACTION EQUATION; INTERACTIVE SEGMENTATION; RANDOM WALK WITH RESTART; UP SAMPLING;

DIFFUSION; OPTICAL ANISOTROPY; THERMAL DIFFUSIVITY;

SIGNAL SAMPLING;

EID: 84877882977     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2013.2253479     Document Type: Article

References (52)

1. P. Perona and J. Malik, "Scale-space and edge detection using anisotropic diffusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 7, pp. 629-639, Jul. 1990. (Pubitemid 20726016)
2. D. Tschumperle and R. Ceriche, "Vector-valued image regularization with PDEs: A common framework for different applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 4, pp. 506-517, Apr. 2005. (Pubitemid 40556107)
3. T. F. Chan, S. Osher, and J. Shen, "The digital TV filter and nonlinear denoising," IEEE Trans. Image Process., vol. 10, no. 2, pp. 231-241, Feb. 2001. (Pubitemid 33777271)
4. A. Chambolle, "An algorithm for total variation minimization and applications," J. Mach. Imag. Vis., vol. 20, nos. 1-2, pp. 89-97, Jan. 2004.
5. D. Mumford and J. Shah, "Optimal approximations by piecewise smooth functions and associated variational probelems," Commun. Pure Appl. Math., vol. 42, no. 5, pp. 577-685, Jul. 1989.
6. T. Pock, D. Cremers, H. Cischof, and A. Chambolle, "An algorithm for minimizing the Mumford-Shah functional," in Proc. IEEE 12th Conf. Comput. Vis., Oct. 2009, pp. 1133-1140.
7. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Proc. 6th Int. Conf. Comput. Vis., Jan. 1998, pp. 839-846.
8. S. Paris, P. Kornprobst, J. Tumblin, and F. Durand, "A gentle introduction to bilateral filtering and its applications," in Proc. ACM SIGGRAPH Classes, 2008, pp. 1-50.
9. P. G. Doyle and J. L. Snell, Random Walks and Electric Networks. Washington, DC, USA: Mathematical Association of America, 1984.
10. L. Grady, "Random walks for image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 11, pp. 1768-1783, Sep. 2006. (Pubitemid 46405425)
11. J. Y. Pan, H. J. Yanh, C. Faloutsos, and P. Duygulu, "Automatic multimedia cross-modal correlation discovery," in Proc. 10th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, Aug. 2004, pp. 653-658. (Pubitemid 40114986)
12. G. Steidl, J. Weickert, T. Brox, P. Mrazek, and M. Welk, "On the equivalence of soft Wavelet Shrinkage, total variation diffusion, total variation regularization, and SIDEs," SIAM J. Numer. Anal., vol. 42, no. 2, pp. 686-713, Sep. 2005. (Pubitemid 40645211)
13. Y. L. You, W. Xu, and M. Kaveh, "Behavior analysis of anisotropic diffusion in image processing," IEEE Trans. Image Process., vol. 5, no. 11, pp. 1539-1553, Nov. 1996. (Pubitemid 126777688)
14. M. J. Black, G. Sapiro, D. H. Marimont, and D. Heeger, "Robust anisotropic diffusion," IEEE Trans. Image Process., vol. 7, no. 3, pp. 421-432, Mar. 1998. (Pubitemid 128745360)
15. D. Barash, "A fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 6, pp. 844-847, Jun. 2002. (Pubitemid 34669596)
16. M. Elad, "On the origin of the bilateral filter and ways to improve it," IEEE Trans. Image Process., vol. 11, no. 10, pp. 1141-1151, Oct. 2002. (Pubitemid 35359385)
17. R. Shen, I. Cheng, J. Shi, and A. Basu, "Generalized random walks for fusion of multi-exposure images," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3634-3646, Apr. 2011.
18. Y. Boykov and G. Funka-Lea, "Graph cuts and efficient N-D image segmentation," Int. J. Comput. Vis., vol. 70, no. 2, pp. 109-131, Nov. 2006. (Pubitemid 44127252)
19. L. Grady, "Multilabel random walker image segmentation using prior models," in Proc. IEEE Conf. Comput. Vis. Pattern Recogn., Jun. 2005, pp. 763-770.
20. T. Kim, K. Lee, and S. Lee, "Generative image segmentation using random walks with restart," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 264-275.
21. C. Oh, B. Ham, and K. Sohn, "Probabilistic correspondence matching using random walk with restart," in Proc. Brit. Mach. Vis. Conf., 2012, pp. 37-57.
22. T. H. Haveliwala, "Topic-sensitive pageRank: A context-sensitive ranking algorithm for web search," IEEE Trans. Knowl. Data Eng., vol. 15, no. 4, pp. 784-796, Sep. 2003.
23. A. Elmoataz, O. Lezoray, and S. Bougleux, "Nonlocal discrete regularization on weighted graphs: A framework for image and manifold processing," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1047-1060, Jul. 2008.
24. G. Gilboa and S. Osher, "Nonlocal linear image regularization and segmentation," Multiscale Model. Simul., vol. 6, no. 2, pp. 595-630, Jul. 2007.
25. M. Subry, S. Paris, S. W. Hasinoff, J. Kautz, and F. Durand, "Fast and robust pyramid-based image processing," in Proc. MIT-CSAIL-TR-2001-049, Nov. 2011, pp. 1-3.
26. A. Buades, B. Coll, and J.-M. Morel, "Nonlocal image and movie denoising," Int. J. Comput. Vis., vol. 76, no. 2, pp. 123-139, Feb. 2008.
27. M. Protter, M. Elad, H. Takeda, and P. Milanfar, "Generalizing the nonlocal-means to super-resolution reconstruction," IEEE Trans. Image Process., vol. 18, no. 1, pp. 36-51, Jan. 2009.
28. L. Pizarro, P. Mrazek, S. Didas, S. Grewenig, and J. Weickert, "Generalised nonlocal image smoothing," Int. J. Comput. Vis., vol. 90, no. 1, pp. 62-87, Apr. 2010.
29. M. Werlberger, T. Pock, and H. Bischof, "Motion estimation with nonlocal total variation regularization," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Feb. 2010, pp. 2464-2471.
30. M. Jung, X. Bresson, T. F. Chan, and L. A. Vese, "Nonlocal Mumford-Shah regularizers for color image restoration," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1583-1598, Jun. 2011.
31. G. Plonka and J. Ma, "Nonlinear regularized reaction-diffusion filters for denoising of images with textures," IEEE Trans. Image Process., vol. 17, no. 8, pp. 1283-1294, Aug. 2008.
32. L. Grady, T. Schiwietz, S. Aharon, and R. Westermann, "Random walks for interactive alpha-matting," in Proc. Int. Conf. Visualizat. Imag. Image Process., 2005, pp. 423-429.
33. C. Wang, F. Jing, L. Zhang, and H.-J. Zhang, "Image annotation refinement using random walk with restarts," in Proc. 14th Annu. ACM Int. Conf. Multimedia, 2006, pp. 647-650. (Pubitemid 47113598)
34. J. Lee, M. Cho, and K. Lee, "Hyper-graph matching via reweighted random walks," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1633-1640.
35. E. Kreyszig, Advanced Engineering Mathematics, 9th ed. New York, NY, USA: Wiley, 2006, pp. 552-560.
36. B. Ham, D. Min, and K. Sohn, "Robust scale-space filter using secondorder partial differential equations," IEEE Trans. Image Process., vol. 21, no. 9, pp. 3937-3951, Sep. 2012.
37. H. Tong, C. Faloutsos, and J.-Y. Pan, "Fast random walk with restart and its application," in Proc. Int. Conf. Data Mining, 2006, pp. 613-622.
38. A. Singer, Y. Shkolnisky, and B. Nadler, "Diffusion interpretation of nonlocal neighborhood filters for signal denoising," SIAM J. Imag. Sci., vol. 2, no. 1, pp. 118-139, Jan. 2009.
39. [Online]. Available: http://www.mesa-imaging.ch
40. B. Huhle, T. Schairer, P. Jenke, and W. Staber, "Fusion of range and color images for denoising and resolution enhancement with a non-local filter," Comput. Vis. Image Understand., vol. 114, no. 12, pp. 1136-1345, Dec. 2010.
41. J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling," ACM Trans. Graph., vol. 26, no. 3, pp. 96-100, Aug. 2007.
42. Q. Yang, R. Yang, J. Davis, and D. Nister, "Spatial-depth super resolution for range images," in Proc. IEEE Conf. Comput. Vis. Pattern Recogn., Jun. 2007, pp. 1-8.
43. D. Min, J. Lu, and M. N. Do, "Depth video enhancement based on weighted mode filtering," IEEE Trans. Image Process., vol. 21, no. 3, pp. 1176-1190, Mar. 2012.
44. D. Scharstein and R. Szeliski. (2002, Apr.-Jun.). A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms [Online]. Available: http://vision.middlebury.edu/stereo/
45. [Online]. Available: http://www.ptgrey.com
46. [Online]. Available: http://kinectdata.com
47. [Online]. Available: http://kinectforwindows.org
48. J. Zhang, J. Zheng, and J. Cai, "A Diffusion Approach to Seeded Image Segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recogn., Jan. 2010, pp. 2125-2132.
49. A. K. Sinop and L. Grady, "A seeded image segmentation framework unifying graph cuts and random walker which yields a new algorithm," in Proc. Int. Conf. Comput. Vis., Feb. 2007, pp. 1-8.
50. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proc. Int. Conf. Comput. Vis., Jul. 2001, pp. 416-423. (Pubitemid 32795086)
51. X. An and F. Pellacini, "AppProp: All-pairs appearance-space edit propagation," ACM Trans. Graph., vol. 27, no. 3, pp. 401-409, 2008.
52. S. Paris and F. Durand, "A fast approximation of the bilateral filter using a signal processing approach," Int. J. Comput. Vis., vol. 81, no. 1, pp. 24-52, Jan. 2009.