Local scene flow by tracking in intensity and depth

Journal of Visual Communication and Image Representation

Volumn 25, Issue 1, 2014, Pages 98-107

  Quiroga, Julian ^a,b   Devernay, Frédéric ^a   Crowley, James ^a  

^a INRIA RHÔNE ALPES   (France)

^b PONTIFICIA UNIVERSIDAD JAVERIANA   (Colombia)

Author keywords

3D motion estimation; Brightness consistency; Depth data; Image tracking; Image warping; Locally rigid motion; Optical flow; Scene flow

Indexed keywords

3D MOTION ESTIMATION; DEPTH DATA; IMAGE TRACKING; IMAGE WARPING; LOCALLY-RIGID MOTION; SCENE FLOW;

MOTION ESTIMATION; OPTICAL FLOWS;

THREE DIMENSIONAL;

EID: 84891625488     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2013.03.018     Document Type: Article

References (41)

1. S. Vedula, S. Baker, P. Rander, R. Collins, Three-dimensional scene flow, in: International Conference on Computer Vision, 1999, pp. 722-729. (Pubitemid 32079937)
2. I. Laptev, T. Lindeberg, Space-time interest points, in: European Conference on Computer Vision, 2003, pp. 432-439.
3. J. Niebles, C. Chen, L. Fei-Fei, Modelling temporal structure of decomposable motion segments for activity classification, in: European Conference on Computer Vision, 2010, pp. 392-405.
4. M. Raptis, S. Soatto, Tracklet descriptors for action modelling and video analysis, in: European Conference on Computer Vision, 2010, pp. 577-590.
5. R. Messing, C. Pal, H. Kautz, Activity recognition using the velocity histories of tracked keypoints, in: International Conference on Computer Vision, 2009, pp. 104-111.
6. P. Matikainen, M. Hebert, R. Sukthankar, Trajectons: Action recognition through the motion analysis of tracked features, in: International Conference on Computer Vision Workshops, 2009, pp. 514-521.
7. H. Wang, A. Kläser, C. Schmid, C.-L. Liu, Action recognition by dense trajectories, in: Conference on Computer Vision and Pattern Recognition, 2011, pp. 3169-3176.
8. A. Letouzey, B. Petit, E. Boyer, Scene flow from depth and color images, in: Proceedings of the British Machine Vision Conference, 2011, pp. 1-11.
9. S. Hadfield, R. Bowden, Kinecting the dots: Particle based scene flow form depth sensors, in: International Conference on Computer Vision, 2011, pp. 2290-2295.
10. W. Li, Z. Zhang, Z. Liu, Action recognition based on a bag of 3D points, in: Conference on Computer Vision and Pattern Recognition Workshops, 2010, pp. 9-14.
11. B. Ni, G. Wang, P. Moulin, RGBD-HuDaAct: A color-depth video database for human daily activity, in: Conference on Computer Vision and Pattern Recognition Workshops, 2011, pp. 1147-1153.
12. A. Bobick, and J. Davis The representation and recognition of action using temporal templates IEEE Transactions on Pattern Analysis and Machine Intelligence 23 2001 257 267 (Pubitemid 32286632)
13. S. Baker, and I. Matthews Lucas-Kanade 20 years on: A unifying framework International Journal of Computer Vision 56 2004 221 255
14. S. Vedula, S. Baker, P. Render, R. Collins, and T. Kanade Three-dimensional scene flow IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 275 280
15. Y. Zhang, C. Kambhamettu, On 3D scene flow and structure estimation, in: Conference on Computer Vision and Pattern Recognition, 2001, pp. 778-785.
16. R. Li, and S. Sclaroff Multi-scale 3D scene flow from binocular stereo Computer Vision and Image Understanding 110 2008 75 90 (Pubitemid 351375438)
17. A. Wedel, C. Rabe, T. Vaudrey, T. Brox, U. Franke, D. Cremers, Efficient dense scene flow from sparse of dense stereo data, in: European Conference on Computer Vision, 2008, pp. 739-751.
18. F. Huguet, F. Devernay, A variational method for scene flow estimation from stereo sequences, in: International Conference on Computer Vision, 2007, pp. 1-7.
19. T. Basha, Y. Moses, N. Kiryati, Multi-view scene flow estimation: A view centered variational approach, in: Conference on Computer Vision and Pattern Recognition, 2010, pp. 1506-1513.
20. C. Vogel, K. Schindler, S. Roth, 3D scene flow estimation with a rigid motion prior, in: International Conference on Computer Vision, 2011, pp. 1291-1298.
21. L. Valgaerts, A. Bruhn, H. Zimmer, J. Weickert, C. Stoll, S. Theobalt, Joint estimation of motion, structure and geometry from stereo sequences, in: European Conference on Computer Vision, 2010, pp. 568-581.
22. J. Neumann, and Y. Aloimonos Spatio-temporal stereo using multi-resolution division surfaces International Journal of Computer Vision 2002 181 193 (Pubitemid 34428430)
23. Y. Fukurawa, J. Ponce, Dense 3d motion capture from synchronized video streams, in: Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
24. R. Carceroni, and K. Kutulakos Multi-view scene captured by surfer sampling: From video streams to non-rigid 3D motion International Journal of Computer Vision 110 2008 75 90
25. F. Devernay, D. Mateus, M. Guilbert, Multi-camera scene flow by tracking 3D points and surfels, in: Conference on Computer Vision and Pattern Recognition, 2006, pp. 2203-2212. (Pubitemid 44931586)
26. H. Spies, B. Jahne, J. Barron, Dense range flow from depth and intensity data, in: International Conference on Pattern Recognition, 2000, pp. 131-134.
27. T. Lukins, R. Fisher, Colour constrained 4D flow, in: British Machine Vision Conference, 2005.
28. J. Fang, T. Huang, Solving three-dimensional small-rotation motion equations, in: Conference on Computer Vision and Pattern Recognition, 1983.
29. H. Longuet-Higgins, and K. Prazdny The interpretation of a moving retinal image Royal Society London 208 1980 385 397 (Pubitemid 11234921)
30. B. Horn, and E. Weldon Direct methods for recovering motion International Journal of Computer Vision 2 1988 51 76
31. G. Adiv Determining three-dimensional motion and structure from optical flow generated by several moving objects IEEE Transactions on Pattern Analysis and Machine Intelligence 7 1985 384 401
32. J. Bergen, P. Anandan, K. Hanna, R. Hingorani, Hierarchical model-based motion estimation, in: European Conference on Computer Vision, 1992, pp. 237-252.
33. B. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: International Joint Conference on Artificial Intelligence, 1981, pp. 674-679. (Pubitemid 14478744)
34. T. Brox, A. Bruhn, N. Papenberg, J. Weickert, High accuracy optical flow estimation based on a theory for warping, in: European Conference on Computer Vision, 2004, pp. 25-36.
35. P. Green Iteratively reweighted least squares for maximum likelihood estimation, and some robust and resistant alternatives Journal of the Royal Statistical Society 46 1984 149 192
36. J. Shi, C. Tomasi, Good features to track, in: Conference on Computer Vision and Pattern Recognition, 1994, pp. 593-600.
37. D. Scharstein, R. Szeliski, High-accuracy stereo depth maps using structured light, in: Conference on Computer Vision and Pattern Recognition, 2003, pp. 195-202.
38. J. Bouguet, Pyramidal implementation of the Lucas-Kanade feature tracker, Open CV Documentation, Technical Report, Intel Corporation, Microporcessor Research Labs, 1999.
39. S. Baker, D. Scharstein, J. Lewis, S. Roth, M. Black, R. Szeliski, A database and evaluation methodology for optical flow, in: International Conference on Computer Vision, 2007, pp. 1-8.
40. D. Herrera, J. Kannala, J. Heikkila, Accurate and practical calibration of a depth and color camera pair, in: International Conference on Computer Analysis of Images and Patterns, 2011, pp. 437-445.
41. J. Quiroga, F. Devernay, J. Crowley, Scene flow by tracking in intensity and depth data, in: Conference on Computer Vision and Pattern Recognition Workshops, 2012, pp. 50-57.