Efficient sparse-to-dense optical flow estimation using a learned basis and layers

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 120-130

  Wulff, Jonas ^a   Black, Michael J ^a  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; FLOW FIELDS; IMAGE MATCHING; OPTICAL FLOWS; STRUCTURAL FRAMES;

DENSE OPTICAL FLOW; DIFFERENT LAYERS; FLOW ALGORITHM; NATURAL FLOW; PRINCIPAL COMPONENTS; SPARSE FEATURES; STATE-OF-THE-ART PERFORMANCE; WEIGHTED SUM;

PATTERN RECOGNITION;

EID: 84959241392     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298607     Document Type: Conference Paper

References (55)

1. http://pcaflow. is. tue. mpg. de
2. P. Anandan. A computational framework and an algorithm for the measurement of visual motion. Inter-national Journal of Computer Vision, 2(3):283-310, 1989
3. S. Baker, D. Scharstein, J. Lewis, S. Roth, M. J. Black, and R. Szeliski. A database and evaluation methodology for optical flow. International Journal of Com-puter Vision, 92(1):1-31, 2011
4. L. Bao, Q. Yang, and H. Jin. Fast edge-preserving PatchMatch for large displacement optical flow. Im-age Processing, IEEE Transactions on, 23(12):4996-5006, Dec 2014
5. D. I. Barnea and H. Silverman. A class of algorithms for fast digital image registration. Computers, IEEE Transactions on, C-21(2):179-186, Feb 1972
6. M. J. Black and P. Anandan. The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. Computer Vision and Image Understand-ing, 63(1):75-104, 1996
7. M. J. Black and Y. Yacoob. Recognizing facial expressions in image sequences using local parameterized models of image motion. International Journal of Computer Vision, 25(1):23-48, 1997
8. Y. Boykov, O. Veksler, and R. Zabih. Fast approximate energy minimization via graph cuts. Pattern Analy-sis and Machine Intelligence, IEEE Transactions on, 23(11):1222-1239, Nov 2001
9. T. Brox and J. Malik. Large displacement optical flow: Descriptor matching in variational motion estimation. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 33(3):500-513, March 2011
10. D. J. Butler, J. Wulff, G. B. Stanley, and M. J. Black. A naturalistic open source movie for optical flow evaluation. In A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, and C. Schmid, editors, Computer Vision-ECCV 2012, volume 7577 of Lecture Notes in Com-puter Science, pages 611-625. Springer Berlin Heidelberg, 2012
11. Z. Chen, H. Jin, Z. Lin, S. Cohen, and Y. Wu. Large displacement optical flow from nearest neighbor fields. In Computer Vision and Pattern Recogni-tion (CVPR), 2013 IEEE Conference on, pages 2443-2450, June 2013
12. M. Chessa, F. Solari, S. P. Sabatini, and G. M. Bisio. Motion interpretation using adjustable linear models. In BMVC, pages 1-10, 2008
13. T. Darrell and A. Pentland. Robust estimation of a multi-layered motion representation. In Visual Mo-tion, 1991., Proceedings of the IEEE Workshop on, pages 173-178, Oct 1991
14. R. Fablet and M. Black. Automatic detection and tracking of human motion with a view-based representation. In A. Heyden, G. Sparr, M. Nielsen, and P. Johansen, editors, Computer Vision-ECCV 2002, volume 2350 of Lecture Notes in Computer Science, pages 476-491. Springer Berlin Heidelberg, 2002
15. D. J. Fleet, M. J. Black, Y. Yacoob, and A. D. Jepson. Design and use of linear models for image motion analysis. International Journal of Computer Vision, 36(3):171-193, 2000
16. A. Geiger, P. Lenz, C. Stiller, and R. Urtasun. Vision meets robotics: The KITTI dataset. Interna-tional Journal of Robotics Research, 32(11):1231-1237, Sept. 2013
17. A. Geiger, J. Ziegler, and C. Stiller. StereoScan: Dense 3D reconstruction in real-time. In Intelligent Vehicles Symposium (IV), 2011 IEEE, pages 963-968, June 2011
18. D. Gibson and M. Spann. Robust optical flow estimation based on a sparse motion trajectory set. Im-age Processing, IEEE Transactions on, 12(4):431-445, April 2003
19. J. Gibson and O. Marques. Sparse regularization of TV-L1 optical flow. In A. Elmoataz, O. Lezoray, F. Nouboud, and D. Mammass, editors, Image and Signal Processing, volume 8509 of Lecture Notes in Computer Science, pages 460-467. Springer International Publishing, 2014
20. T. Guthier, J. Eggert, and V. Willert. Unsupervised learning of motion patterns. In European Symposium on Artificial Neural Networks, Computational Intelli-gence and Machine Learning, volume 20, pages 323-328, Bruges, April 2012
21. S. Hauberg, A. Feragen, and M. Black. Grassmann averages for scalable robust PCA. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Confer-ence on, pages 3810-3817, June 2014
22. K. He, J. Sun, and X. Tang. Guided image filtering. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(6):1397-1409, June 2013
23. A. Jepson and M. Black. Mixture models for optical flow computation. In Computer Vision and Pat-tern Recognition (CVPR), 1993 IEEE Conference on, pages 760-761, Jun 1993
24. R. Kennedy and C. Taylor. Optical flow with geometric occlusion estimation and fusion of multiple frames. In X.-C. Tai, E. Bae, T. Chan, and M. Lysaker, editors, Energy Minimization Methods in Computer Vision and Pattern Recognition, volume 8932 of Lecture Notes in Computer Science, pages 364-377. Springer International Publishing, 2015
25. P. Krähenbühl and V. Koltun. Efficient nonlocal regularization for optical flow. In A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, and C. Schmid, editors, Com-puter Vision-ECCV 2012, volume 7572 of Lecture Notes in Computer Science, pages 356-369. Springer Berlin Heidelberg, 2012
26. M. Lang, O. Wang, T. Aydin, A. Smolic, and M. Gross. Practical temporal consistency for imagebased graphics applications. ACM Trans. Graph., 31(4):34:1-34:8, July 2012
27. V. Lempitsky, S. Roth, and C. Rother. Fusionflow: Discrete-continuous optimization for optical flow estimation. In Computer Vision and Pattern Recognition (CVPR), 2008 IEEE Conference on, pages 1-8, June 2008
28. M. Leordeanu, A. Zanfir, and C. Sminchisescu. Locally affine sparse-to-dense matching for motion and occlusion estimation. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 1721-1728, Dec 2013
29. C. Liu, J. Yuen, and A. Torralba. Sift flow: Dense correspondence across scenes and its applications. Pat-tern Analysis and Machine Intelligence, IEEE Trans-actions on, 33(5):978-994, May 2011
30. J. Lu, H. Yang, D. Min, and M. Do. Patch Match Filter: Efficient edge-aware filtering meets randomized search for fast correspondence field estimation. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 1854-1861, June 2013
31. B. D. Lucas and T. Kanade. An iterative image registration technique with an application to stereo vision. In IJCAI, volume 81, pages 674-679, 1981
32. O. Mac Aodha, A. Humayun, M. Pollefeys, and G. Brostow. Learning a confidence measure for optical flow. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(5):1107-1120, May 2013
33. M. Mohamed, H. Rashwan, B. Mertsching, M. Garcia, and D. Puig. Illumination-robust optical flow using a local directional pattern. Circuits and Systems for Video Technology, IEEE Transactions on, 24(9):1499-1508, Sept 2014
34. M. Nicolescu and G. Medioni. Layered 4D representation and voting for grouping from motion. Pat-tern Analysis and Machine Intelligence, IEEE Trans-actions on, 25(4):492-501, April 2003
35. J. Rannacher. Realtime 3D motion estimation on graphics hardware. Undergraduate Thesis, Heidelberg University, 2009
36. R. Roberts and F. Dellaert. Direct superpixel labeling for mobile robot navigation using learned general optical flow templates. In Intelligent Robots and Sys-tems (IROS 2014), 2014 IEEE/RSJ International Con-ference on, pages 1032-1037, Sept 2014
37. R. Roberts, C. Potthast, and F. Dellaert. Learning general optical flow subspaces for egomotion estimation and detection of motion anomalies. In Computer Vision and Pattern Recognition (CVPR), 2009 IEEE Conference on, pages 57-64, June 2009
38. D. Rosenbaum, D. Zoran, and Y. Weiss. Learning the local statistics of optical flow. In C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Weinberger, editors, Advances in Neural Information Processing Systems 26, pages 2373-2381. MIT Press, 2013
39. S. Roth and M. J. Black. On the spatial statistics of optical flow. International Journal of Computer Vision, 74(1):33-50, 2007
40. C. Rother, V. Kolmogorov, and A. Blake. "grabcut": Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph., 23(3):309-314, Aug. 2004
41. C. Sanderson. Armadillo: An open source C++ linear algebra library for fast prototyping and computationally intensive experiments. Technical report, NICTA, 2010
42. T. Schoenemann and D. Cremers. A coding-cost framework for super-resolution motion layer decomposition. Image Processing, IEEE Transactions on, 21(3):1097-1110, March 2012
43. D. Sun, C. Liu, and H. Pfister. Local layering for joint motion estimation and occlusion detection. In Com-puter Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1098-1105, June 2014
44. D. Sun, S. Roth, and M. Black. A quantitative analysis of current practices in optical flow estimation and the principles behind them. International Journal of Computer Vision, 106(2):115-137, 2014
45. D. Sun, E. Sudderth, and M. Black. Layered segmentation and optical flow estimation over time. In Com-puter Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 1768-1775, June 2012
46. D. Sun, J. Wulff, E. Sudderth, H. Pfister, and M. Black. A fully-connected layered model of foreground and background flow. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 2451-2458, June 2013
47. N. Sundaram, T. Brox, and K. Keutzer. Dense point trajectories by gpu-accelerated large displacement optical flow. Technical Report UCB/EECS-2010-104, EECS Department, University of California, Berkeley, Jul 2010
48. M. Tao, J. Bai, P. Kohli, and S. Paris. Simpleflow: A non-iterative, sublinear optical flow algorithm. Com-puter Graphics Forum, 31(2pt1):345-353, 2012
49. J. Wang and E. Adelson. Representing moving images with layers. Image Processing, IEEE Transactions on, 3(5):625-638, Sep 1994
50. P. Weinzaepfel, J. Revaud, Z. Harchaoui, and C. Schmid. DeepFlow: Large displacement optical flow with deep matching. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 1385-1392, Dec 2013
51. M. Werlberger, T. Pock, and H. Bischof. Motion estimation with non-local total variation regularization. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 2464-2471, June 2010
52. M. Werlberger, W. Trobin, T. Pock, A. Wedel, D. Cremers, and H. Bischof. Anisotropic Huber-L1 optical flow. In BMVC, London, UK, September 2009
53. L. Xu, J. Jia, and Y. Matsushita. Motion detail preserving optical flow estimation. Pattern Analy-sis and Machine Intelligence, IEEE Transactions on, 34(9):1744-1757, Sept 2012
54. C. Zach, T. Pock, and H. Bischof. A duality based approach for realtime TV-L1 optical flow. In F. Hamprecht, C. Schnrr, and B. Jhne, editors, Pattern Recog-nition, volume 4713 of Lecture Notes in Computer Science, pages 214-223. Springer Berlin Heidelberg, 2007
55. K. Zuiderveld. Contrast limited adaptive histogram equalization. In P. S. Heckbert, editor, Graphics Gems IV, pages 474-485. Academic Press Professional, Inc., San Diego, CA, USA, 1994.