Layered RGBD scene flow estimation

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 548-556

  Sun, Deqing ^a   Sudderth, Erik B ^b   Pfister, Hanspeter ^a  

^a HARVARD UNIVERSITY   (United States)

^b BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; MOTION ESTIMATION;

COMPUTATIONAL BOTTLENECKS; DEPTH INFORMATION; LAYERED APPROACHES; MOTION BOUNDARY; OCCLUSION REASONING; OCCLUSION REGION; REAL-WORLD SEQUENCES; SCENE SEGMENTATION;

PATTERN RECOGNITION;

EID: 84959188779     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298653     Document Type: Conference Paper

References (51)

1. http://people. seas. harvard. edu/dqsun/
2. http://www. mathworks. com/matlabcentral/fileexchange/26186-absolute-orientation-horn-s-method
3. Y. Amit and D. Geman. Shape quantization and recognition with randomized trees. Neural computation, 9(7):1545-1588, 1997
4. S. Ayer and H. S. Sawhney. Layered representation of motion video using robust maximum-likelihood estimation of mixture models and MDL encoding. In IEEE International Conference on Computer Vision, 1995
5. S. Baker, D. Scharstein, J. P. Lewis, S. Roth, M. J. Black, and R. Szeliski. A database and evaluation methodology for optical flow. IJCV, 92(1):1-31, March 2011
6. J. T. Barron and J. Malik. Intrinsic scene properties from a single rgb-d image. IEEE Conference on Computer Vision and Pattern Recognition, 2013
7. T. Basha, Y. Moses, and N. Kiryati. Multi-view scene flow estimation: A view centered variational approach. IJCV, 101(1):6-21, 2013
8. L. Breiman. Random forests. Machine learning, 45(1):5-32, 2001
9. T. Brox, A. Bruhn, N. Papenberg, and J. Weickert. High accuracy optical flow estimation based on a theory for warping. In European Conference on Computer Vision, pages 25-36, 2004
10. T. Brox and J. Malik. Large displacement optical flow: Descriptor matching in variational motion estimation. IEEE TPAMI, 33(3):500-513, Mar. 2011
11. D. J. Butler, J. Wulff, G. B. Stanley, and M. J. Black. A naturalistic open source movie for optical flow evaluation. In European Conference on Computer Vision, IV, pages 611-625, 2012
12. T. Darrell and A. Pentland. Cooperative robust estimation using layers of support. IEEE TPAMI, 17(5):474-487, May 1995
13. A. Geiger, P. Lenz, and R. Urtasun. Are we ready for autonomous driving? the kitti vision benchmark suite. In IEEE Conference on Computer Vision and Pattern Recognition, 2012
14. S. Ghuffar, N. Brosch, N. Pfeifer, and M. Gelautz. Motion estimation and segmentation in depth and intensity videos. Integrated Computer-Aided Engineering, 2014
15. J.-M. Gottfried, J. Fehr, and C. S. Garbe. Computing range flow from multi-modal kinect data. In Advances in Visual Computing, pages 758-767. Springer, 2011
16. M. Grundmann, V. Kwatra, M. Han, and I. Essa. Efficient hierarchical graph-based video segmentation. IEEE Con-ference on Computer Vision and Pattern Recognition, pages 2141-2148, 2010
17. S. Hadfield and R. Bowden. Scene particles: Unregularized particle based scene flow estimation. IEEE TPAMI, 36:3, 2013
18. E. Herbst, X. Ren, and D. Fox. Rgb-d flow: Dense 3-d motion estimation using color and depth. In Robotics and Au-tomation (ICRA), 2013 IEEE International Conference on, pages 2276-2282. IEEE, 2013
19. B. Horn and B. Schunck. Determining optical flow. Artificial Intelligence, 16:185-203, Aug. 1981
20. B. K. Horn. Closed-form solution of absolute orientation using unit quaternions. JOSA A, 4(4):629-642, 1987
21. M. Irani, P. Anandan, and D. Weinshall. From reference frames to reference planes: Multi-view parallax geometry and applications. In European Conference on Computer Vi-sion, 1998
22. A. Jepson and M. J. Black. Mixture models for optical flow computation. In IEEE Conference on Computer Vision and Pattern Recognition, pages 760-761, 1993
23. M. Kumar, P. Torr, and A. Zisserman. Learning layered motion segmentations of video. IJCV, 76(3):301-319, March 2008
24. V. Lempitsky, S. Roth, and C. Rother. FusionFlow: Discretecontinuous optimization for optical flow estimation. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1-8, 2008
25. A. Levin, D. Lischinski, and Y. Weiss. Colorization using optimization. In ACM TOG, volume 23, pages 689-694. ACM, 2004
26. J. McCann and N. S. Pollard. Local layering. Siggraph, 28(3), Aug. 2009
27. J. Quiroga, T. Brox, F. Devernay, and J. Crowley. Dense semi-rigid scene flow estimation from rgbd images. In Eu-ropean Conference on Computer Vision, 2014
28. J. Quiroga, F. Devernay, J. L. Crowley, et al. Local/global scene flow estimation. In ICIP-IEEE International Confer-ence on Image Processing, 2013
29. C. E. Rasmussen. http://www. gaussianprocess. org/gpml/code/matlab/util/minimize. m
30. D. Scharstein and R. Szeliski. High-accuracy stereo depth maps using structured light. In IEEE Conference on Com-puter Vision and Pattern Recognition, volume 1, pages I-195. IEEE, 2003
31. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In IEEE Con-ference on Computer Vision and Pattern Recognition, pages 1297-1304. IEEE, 2011
32. N. Silberman, D. Hoiem, P. Kohli, and R. Fergus. Indoor segmentation and support inference from rgbd images. In European Conference on Computer Vision, pages 746-760, 2012
33. S. Song and J. Xiao. Tracking revisited using rgbd camera: Unified benchmark and baselines. In IEEE Inter-national Conference on Computer Vision, pages 233-240. IEEE, 2013
34. S. Song and J. Xiao. Sliding shapes for 3d object detection in depth images. In European Conference on Computer Vision, pages 634-651. Springer, 2014
35. E. Sudderth and M. Jordan. Shared segmentation of natural scenes using dependent Pitman-Yor processes. In Neural Information Processing Systems, pages 1585-1592, 2009
36. D. Sun, C. Liu, and H. Pfister. Local layering for joint motion estimation and occlusion detection. In IEEE Conference on Computer Vision and Pattern Recognition, 2014
37. D. Sun, S. Roth, and M. J. Black. Secrets of optical flow estimation and their principles. In IEEE Conference on Com-puter Vision and Pattern Recognition, pages 2432-2439, 2010
38. D. Sun, S. Roth, and M. J. Black. A quantitative analysis of current practices in optical flow estimation and the principles behind them. IJCV, 106(2):15-137, 2014
39. D. Sun, E. B. Sudderth, and M. J. Black. Layered image motion with explicit occlusions, temporal consistency, and depth ordering. In Neural Information Processing Systems, pages 2226-2234, 2010
40. D. Sun, E. B. Sudderth, and M. J. Black. Layered segmentation and optical flow estimation over time. In IEEE Con-ference on Computer Vision and Pattern Recognition, pages 1768-1775, 2012
41. D. Sun, J. Wulff, E. B. Sudderth, H. Pfister, and M. J. Black. A fully-connected layered model of foreground and background flow. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2451-2458, 2013
42. S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade. Three-dimensional scene flow. In IEEE International Con-ference on Computer Vision, volume 2, pages 722-729. IEEE, 1999
43. C. Vogel, K. Schindler, and S. Roth. Piecewise rigid scene flow. In IEEE International Conference on Computer Vision, December 2013
44. J. Y. A. Wang and E. H. Adelson. Representing moving images with layers. IEEE TIP, 3(5):625-638, Sept. 1994
45. P. Weinzaepfel, J. Revaud, Z. Harchaoui, and C. Schmid. DeepFlow: Large displacement optical flow with deep matching. In IEEE International Conference on Computer Vision, 2013
46. Y. Weiss. Smoothness in layers: Motion segmentation using nonparametric mixture estimation. In IEEE Conference on Computer Vision and Pattern Recognition, pages 520-526, 1997
47. M. Werlberger, T. Pock, and H. Bischof. Motion estimation with non-local total variation regularization. In IEEE Con-ference on Computer Vision and Pattern Recognition, 2010
48. M. Werlberger, W. Trobin, T. Pock, A. Wedel, D. Cremers, and H. Bischof. Anisotropic Huber-L1 optical flow. In BMVC, pages 108. 1-108. 11, 2009
49. L. Xu, J. Jia, and Y. Matsushita. Motion detail preserving optical flow estimation. IEEE TPAMI, 34(9):1744-1757, 2012
50. K. Yamaguchi, D. A. McAllester, and R. Urtasun. Robust monocular epipolar flow estimation. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1862-1869, 2013
51. H. Zimmer, A. Bruhn, J. Weickert, L. Valgaerts, A. Salgado, B. Rosenhahn, and H.-P. Seidel. Complementary optic flow. In EMMCVPR, 2009.