Variational method for super-resolution optical flow

Signal Processing

Volumn 91, Issue 7, 2011, Pages 1535-1567

  Mochizuki, Yoshihiko ^a   Kameda, Yusuke ^a   Imiya, Atsushi ^a   Sakai, Tomoya ^a,b   Imaizumi, Takashi ^a  

^a CHIBA UNIVERSITY   (Japan)

^b NAGASAKI UNIVERSITY   (Japan)

Author keywords

Gauss pyramid; Numerical analysis; Optical flow; Pyramid transform; Small motion displacement; Super resolution; Variational method; Zooming

Indexed keywords

GAUSS PYRAMID; PYRAMID TRANSFORM; SMALL MOTION DISPLACEMENT; SUPER RESOLUTION; VARIATIONAL METHODS; ZOOMING;

NUMERICAL ANALYSIS; NUMERICAL METHODS; OPTICAL RESOLVING POWER; ORDINARY DIFFERENTIAL EQUATIONS;

OPTICAL FLOWS;

EID: 79952040109     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2010.11.010     Document Type: Article

References (101)

1. A. Giachetti, M. Campani, and V. Torre The use of optical flow for road navigation IEEE Robotics and Automation 14 1998 34 48 (Pubitemid 128742151)
2. A. Lookingbill, J. Rogers, D. Lieb, and S. Thrun Reverse optical flow for self-supervised adaptive autonomous robot navigation International Journal of Computer Vision 74 2007 287 302 (Pubitemid 47142803)
3. N. Papenberg, A. Bruhn, T. Brox, S. Didas, and J. Weickert Highly accurate optic flow computation with theoretically justified warping International Journal of Computer Vision 67 2006 141 158 10.1007/s11263-005- 3960-y
4. 〈 http://i21www.ira.uka.de/imagesequences/
5. 〈 http://vision.middlebury.edu/flow/data/.
6. 〈 http://www.mi.auckland.ac.nz/.
7. 〈 http://www.cs.otago.ac.nz/research/vision/Downloads/index.html 〉.
8. J. Modersitzki, Numerical Methods for Image Registration, Oxford University Press, 2004.
9. H. Koestler, I. Christadler, U. Ruede, Robust and efficient multigrid techniques for the optical flow problem using different regularizers, Lehrstuhlbericht 05-6, Uni Erlangen-Neurberg. 〈 http://www.10.informatik. uni-erlangen.de/Publications/TechnicalReports/ 〉, 2005.
10. Y. Mochizuki, Y. Kameda, A. Imiya, T. Sakai, T. Imaizumi, Two step variational method for subpixel optical flow computation, in: Lecture Notes in Computer Science, vol. 5876, 2009, pp. 11091118.
11. P. Ruhnau, T. Kohlberger, C. Schnrr, and H. Nobach Variational optical flow estimation for particle image velocimetry Experiments in Fluids 38 2005 21 32 (Pubitemid 40454042)
12. M.V.W. Zibetti, F.S.V. Bazan, and J. Mayer Determining the regularization parameters for super-resolution problems Signal Processing 88 2008 2890 2901
13. D. Rajan, and S. Chaudhuri Generalized interpolation and its application in super-resolution Image and Vision Computing 19 2001 957 969 (Pubitemid 33019027)
14. T. Amiaz, E. Lubetzky, and N. Kiryati Coarse to over-fine optical flow estimation Pattern Recognition 40 2007 2496 2503 (Pubitemid 46669575)
15. W.T. Freeman, T.R. Jones, and E.C. Pasztor Example-based super-resolution IEEE Computer Graphics and Applications March/April 2002 56 65 (Pubitemid 34265891)
16. M. Elad, and D. Datsenko Example-based regularization deployed to super-resolution reconstruction of a single image The Computer Journal 52 2009 15 30
17. 1-norm near-solution approximates the sparsest near-solution Communications on Pure and Applied Mathematics 59 2006 907 934
18. M. Aharon, M. Elad, and A. Bruckstein K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation IEEE Transactions on Signal Processing 54 2006 4311 4322 (Pubitemid 44637761)
19. P.O. Hoyer, and A. Hyvrinen A multi-layer sparse coding network learns contour coding from natural images Vision Research 42 2002 1593 1605 (Pubitemid 34628785)
20. J.D. van Ouwerkerk Image super-resolution survey Image and Vision Computing 24 2006 1039 1052
21. J.-J. Wang, S.-H. Zhu, and Y. Gong Resolution enhancement based on learning the sparse association of image patches Pattern Recognition Letters 31 2010 1 10
22. X. Li Super-resolution for synthetic zooming EURASIP Journal on Applied Signal Processing 2006 1 12
23. M.V. Joshi, S. Chaudhuri, and R. Panuganti Super-resolution imaging: use of zoom as a cue Image and Vision Computing 22 2004 1185 1196
24. F. Malgouyres, and F. Guichard Edge direction preserving image zooming: a mathematical and numerical analysis SIAM Journal on Numerical Analysis 39 2000 1 37
25. A. Gotchev, E. Egiazarian, J. Vesma, T. Saramaki, Edge-preserving image resizing using modified B-splines, in: Proceedings of IEEE ICASP2001, 2001, pp. 18651868. (Pubitemid 32838971)
26. X. Li, and M.T. Orchard New edge-directed interpolation IEEE Transactions on Image Processing 10 2001 1521 1527 (Pubitemid 32981825)
27. T. Blu, M. Unser, Image interpolation and resampling, in: Handbook of Medical Imaging, Processing and Analysis, Academic Press, 2000, pp. 393420.
28. L. Baboulaz, P.L. Dragotti, Image super-resolution with B-spline kernels, in: Proceedings of Seventh IMA, 2006, pp. 114117.
29. R. Panda, and B.N. Chatterji Least squares generalized B-spline signal and image processing Signal Processing 81 2001 2005 2017 (Pubitemid 32833111)
30. M. Unser Splines: a perfect fit for signal and image processing Signal Processing Magazine 16 1999 22 38 (Pubitemid 129604862)
31. H. Stark, Image Recovery: Theory and Application 1992 Academic Press New York
32. D. Youla Generalized image restoration by the method of alternating orthogonal projections IEEE Transactions on Circuits and Systems 25 1978 694 702 (Pubitemid 9394315)
33. P.J.S.G. Ferreira Interpolation and the discrete PapoulisGerchberg algorithm IEEE Transactions on Signal Processing 42 1994 2596 2606
34. G. Wahba, and J. Wendelberger Some new mathematical methods for variational objective analysis using splines and cross-validation Monthly Weather Review 108 1980 36 57
35. L.C. Pickup, D.P. Capel, S.J. Roberts, and A. Zisserman Bayesian methods for image super-resolution The Computer Journal 52 2009 101 113
36. R. Fransens, Ch. Strecha, and L. Van Gool A probabilistic approach to optical flow based super-resolution Proceedings of Workshop on Generative Model Base Vision 2004 6 12
37. M.E. Tipping, and Ch.M. Bishop Bayesian images super-resolution Advances in Neural Information Processing Systems 13 2003 1303 1310
38. J. Weickert, and Ch. Schnoerr Variational optic flow computation with a spatio-temporal smoothness constraint Journal of Mathematical Imaging and Vision 14 2001 245 255 (Pubitemid 32638802)
39. A. Bab-Hadiashar, and D. Suter Robust optic flow computation International Journal of Computer Vision 29 1998 59 77 (Pubitemid 128523367)
40. E.P. Ong, and M. Spann Robust optical flow computation based on least-median-of-squares regression International Journal of Computer Vision 31 1999 51 89
41. J. Colliez, F. Dufrenoisa, and D. Hamada Optic flow estimation by support vector regression Engineering Applications of Artificial Intelligence 19 2006 761 768 (Pubitemid 44485477)
42. A. Imiya, K. Iwawaki, and K. Kawamoto An efficient statistical method for subpixel optical flow detection Engineering Applications of Artificial Intelligence 15 2002 169 176 (Pubitemid 34992085)
43. T. Hermosilla, E. Bermejo, A. Balaguer, and L.A. Ruiz Non-linear fourth-order image interpolation for subpixel edge detection and localization Image and Vision Computing 6 2008 1240 1248
44. D.G. Tzikas, A.C. Likas, and N.P. Galatsanos The variational approximation for Bayesian inference (Life after the EM algorithm) IEEE Signal Processing Magazine 25 2008 131 146
45. D.G. Sheppard, B.R. Hunt, and M.W. Marcellin Iterative multiframe super-resolution algorithms for atmospheric turbulence-degraded imagery Journal of the Optical Society of America A 15 1998 978 992 (Pubitemid 128572096)
46. Y.-N. Chen, W.-G. Jin, L. Zhao, and F.-W. Li A subpixel motion estimation algorithm based on digital correlation for illumination variant and noise image sequences OptikInternational Journal for Light and Electron Optics 120 2009 835 844
47. Z.-Z. Wang, and F.-H. Qi Analysis of multiframe super-resolution reconstruction for image anti-aliasing and deblurring Image and Vision Computing 23 2005 393 404
48. S. Borman, and R.L. Stevenson Linear models for multiframe super-resolution restoration under nonaffine registration and spatially varying PSF Proceedings of SPIE 5299 2004 234 245
49. H.-Y. Lin, and K.-J. Li Motion blur removal and its application to vehicle speed detection Proceedings of ICIP04 2004 3407 3410 (Pubitemid 40820806)
50. J.-F. VidCai, H. Ji, C.-Q. Liu, and Z.-W. Shen Blind motion deblurring from a single image using sparse approximation Proceedings of CVPR09 2009 104 111
51. P. Vandewalle, L. Baboulaz, P.L. Dragotti, and M. Vetterli Subspacebased methods for image registration and super-resolution Proceedings of ICIP08 2008 645 648
52. I. Tsubaki, T. Komatsu, T. Saito, Interframe motion deblurring using spatio-temporal regularization, in: ICIP07, 2007, pp. 409412.
53. V. Argyriou A study of sub-pixel motion estimation using phase correlation Proceedings of 17th BMVC 2006 1019 1028
54. A. Kirsch An Introduction to the Mathematical Theory of Inverse Problems 1996 Springer-Verlag New York
55. B. Chalmond Modeling and Inverse Problems in Image Analysis 2003 Springer-Verlag Berlin
56. P. Rodŕguez, and B. Wohlberg Efficient minimization method for a generalized total variation functional IEEE Transactions on Image Processing 18 2009 322 332
57. B. Wohlberg, and P. Rodriguez An iteratively reweighted norm algorithm for minimization of total variation functionals IEEE Signal Processing Letters 14 2007 948 951 (Pubitemid 350201251)
58. L.I. Rudin, S. Osher, and E. Fatemi Nonlinear total variation based noise removal algorithms Physica D: Nonlinear Phenomena 60 1992 259 268
59. A. Tarantols Inverse Problem Theory and Model Parameter Estimation 2005 SIAM
60. L. Bar, B. Berkels, M. Rumpf, and G. Sapiro A variational framework for simultaneous motion estimation and restoration of motion blurred video Proceedings of ICCV07 2007 1 8
61. T. Pock, Fast total variation for computer vision, Ph.D. Thesis, TU Graz, 2008.
62. W. Trobin, Local, semi-local, and global optimization for motion estimator, Ph.D. Thesis, TU Graz, 2009.
63. M.J. Black, and P. Anandan The robust estimation of multiple motions: parametric and piecewise-smooth flow fields Computer Vision and Image Understanding 63 1996 75 104 (Pubitemid 126342808)
64. S. Roth, and M.J. Black On the spatial statistics of optical flow Proceedings of ICCV05 2005 42 49 (Pubitemid 44054939)
65. B.K.P. Horn, and B.G. Schunck Determining optical flow Artificial Intelligence 17 1981 185 204
66. J.L. Barron, D.J. Fleet, and S.S. Beauchemin Performance of optical flow techniques International Journal of Computer Vision 12 1994 43 77
67. S.S. Beauchemin, and J.L. Barron The computation of optical flow ACM Computer Surveys 26 1995 433 467
68. B. Fischer, and J. Modersitzki A unified approach to fast image registration and a new curve based registration technique Linear Algebra and its Applications 380 2004 107 124
69. J. Weickert, A. Bruhn, N. Papenberg, T. Brox, Variational optic flow computation: from continuous models to algorithms, In: L. Alvarez (Ed.), Proceedings of IWCVIA03, Cuadernos del Instituto Universitario de Ciencias y Tecnologias Ciberneticas, University of Las Palmas de Gran Canaria, Spain, February 2004, vol. 0026, pp. 16.
70. J. Weickert Applications of nonlinear diffusion in image processing and computer vision Acta Mathematica Universitatis Comenianae 70 2001 33 50
71. 1 regularization: a comparative study and two new approaches Lecture Notes in Computer Science vol. 4701 2007 286 297
72. 1-optical-flow image registration Proceedings of MICCAI 2007, Lecture Notes in Computer Science vol. 4791 2007 511 518
73. 1 optical flow Proceedings of the 29th DAGM Symposium on Pattern Recognition, Lecture Notes in Computer Science vol. 4713 2007 214 223
74. A. Marquina, and S.J. Osher Image super-resolution by TV-regularization and Bergman iteration Journal of Scientific Computing 37 2008 367 382
75. 1 Regularized super-resolution from unregistered omnidirectional images Proceedings of ICASSP09 2009 829 832
76. Y.-Y. Shin, O.-S. Chang, and J. Xu Convergence of fixed point iteration for deblurring and denoising problem Applied Mathematics and Computation 189 2007 1178 1185 (Pubitemid 46802733)
77. 1-norm minimization Mathematics of Computation 78 2009 2127 2136
78. A. Chambolle An algorithm for total variation minimization and applications Journal of Mathematical Imaging and Vision 20 2004 89 97
79. P.J. Burt, and E.H. Adelson The Laplacian pyramid as a compact image coding IEEE Transactions on Communications 31 1983 532 540
80. S. Hwan, S.H. Hwang, and U.K. Lee A hierarchical optical flow estimation algorithm based on the interlevel motion smoothness constraint Pattern Recognition 26 1993 939 952
81. A. Imiya, Y. Kameda, N. Ohnishi, Decomposition and construction of neighbourhood operations using linear algebra, in: Lecture Notes in Computer Science, vol. 4992, 2008, pp. 6980. (Pubitemid 351632244)
82. G. Strang Computational Science and Engineering 2007 Wellesley-Cambridge Press
83. Y. Abe, and Y. Iiguni Image restoration from a downsampled image by using the DCT Signal Processing 87 2007 2370 2380 (Pubitemid 46855914)
84. G. Strang, and T. Nguyen Wavelets and Filter Banks 1996 Wellesley-Cambridge Press
85. J.W. Demmel Applied Numerical Linear Algebra 1997 SIAM
86. R.S. Varga Matrix Iteration Analysis second ed. 2000 Springer
87. Q. Guo, M.K. Mandal, and M.Y. Li Efficient HodgeHelmholtz decomposition of motion fields Pattern Recognition Letters 26 2005 493 501 (Pubitemid 40220144)
88. Q. Guo, M.K. Mandal, G. Liu, and K.M. Kavanagh Cardiac video analysis using HodgeHelmholtz field decomposition Computers in Biology and Medicine 36 2006 1 20 (Pubitemid 41735393)
89. B. Palit, A. Basu, M.K. Mandal, Applications of the discrete Hodge Helmholtz decomposition to image and video processing, in: Lecture Notes in Computer Science, vol. 3776, 2005, pp. 497502.
90. J. Yuan, Ch. Schoerr, and G. Steidl Simultaneous higher-order optical flow estimation and decomposition SIAM Journal on Scientific Computing 29 2007 2283 2304
91. A. Imiya Formal polynomials for image processing Advances in Imaging and Electron Physics 101 1997 99 142 (Pubitemid 127133857)
92. W.-K. Ching, K.M. Ng, K.N. Sze, and A. Yau Super-resolution image reconstruction using multisensors Numerical Linear Algebra with Applications 25 2005 271 281 (Pubitemid 40855211)
93. R. Kimme Demosaicing: image reconstruction from color CCD samples IEEE Transactions on Image Processing 8 1999 1221 1228
94. T. Gotoh, and M. Okutomi Direct super-resolution and registration using raw CFA images Proceedings of CVPR'04 vol. 2 2004 600 607
95. J. Canny A computational approach to edge detection IEEE Transactions on Pattern Analysis and Machine Intelligence 8 1986 679 698
96. H. Enomoto, T. Katayama, Structure lines of images, in: Proceedings of Third IJCPR, 1976, pp. 811815.
97. H. Enomoto, N. Yonezaki, and Y. Watanabe Application of structure lines to surface construction and 3-dimensional analysis K.-S. Fu, T.L. Kunii, Picture Engineering 1982 Springer Berlin 106 137
98. W.M. Krueger, and K. Phillips The geometry of differential operator with application to image processing IEEE Transactions on Pattern Analysis and Machine Intelligence 11 1989 1252 1264 (Pubitemid 20642574)
99. L. Najman, and M. Schmitt Watershed of a continuous function Signal Processing 38 1994 99 112
100. J.-F. Aujol Some first-order algorithms for total variation based image restoration Journal of Mathematical Imaging and Vision 34 2009 307 327
101. 1 norm for image restoration SIAM Journal on Scientific Computing 27 2006 1881 1902 (Pubitemid 44784221)