Motion estimation and segmentation in depth and intensity videos

Integrated Computer-Aided Engineering

Volumn 21, Issue 3, 2014, Pages 203-218

  Ghuffar, Sajid ^a   Brosch, Nicole ^a   Pfeifer, Norbert ^a   Gelautz, Margrit ^a  

^a VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

motion estimation; optical flow; range flow; segmentation; ToF camera

Indexed keywords

CAMERAS; IMAGE SEGMENTATION; OPTICAL FLOWS;

INTENSITY INFORMATION; MOTION ESTIMATION ALGORITHM; MOTION INFORMATION; QUANTITATIVE AND QUALITATIVE ANALYSIS; RANGE FLOW; SEGMENTATION TECHNIQUES; TIME-OF-FLIGHT CAMERAS; TOF CAMERAS;

MOTION ESTIMATION;

EID: 84902212314     PISSN: 10692509     EISSN: 18758835     Source Type: Journal    
DOI: 10.3233/ICA-130456     Document Type: Article

References (65)

1. G. Adiv, Determining three-dimensional motion and structure from optical flow generated by several moving objects, IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-7(4) (1985), 384-401.
2. S. Baker, D. Scharstein, J. Lewis, S. Roth, M.J. Black and R. Szeliski, A database and evaluation methodology for optical flow, International Journal of Computer Vision 92(1) (2011), 1-31.
3. J.L. Barron, D.J. Fleet and S.S. Beauchemin, Performance of optical flow techniques, International Journal of Computer Vision 12(1) (1994), 43-77.
4. M. Bleyer and M. Gelautz, Graph-cut-based stereo matching using image segmentation with symmetrical treatment of occlusions, Signal Processing: Image Communication 22(2) (2007), 127-143.
5. T. Brox and J. Malik, Object segmentation by long term analysis of point trajectories. in Proceedings of the European Conference on Computer vision. Part. V (2010), 282-295.
6. A. Bruhn, J. Weickert and C. Schnörr, Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods, International Journal of Computer Vision 61(3) (2005), 211-231.
7. J.S. Cardoso, J.C.S. Cardoso and L. Corte-Real, Object-based spatial segmentation of video guided by depth and motion information, in: Workshop on Motion and Video Computing, 2007.
8. P.M. Ciarelli, E.O.T. Salles and E. Oliveira, Human automatic detection and tracking for outdoor video, Integrated Computer-Aided Engineering 18(4) (2011), 379-390.
9. R. del Riego, J. Otero and J. Ranilla, A low-cost 3D human interface device using gpu-based optical flow algorithms, Integrated Computer-Aided Engineering 18(4) (2011), 391-400.
10. P.F. Felzenszwalb and D.P. Huttenlocher, Efficient graphbased image segmentation. International Journal of Computer Vision 59(2) (2004), 167-181.
11. C. Fermüller and Y. Aloimonos, Qualitative egomotion, International Journal of Computer Vision 15(1) (1995), 7-29.
12. S. Filin and N. Pfeifer, Segmentation of airborne laser scanning data using a slope adaptive neighborhood, ISPRS Journal of Photogrammetry and Remote Sensing 60(2) (2006), 71-80.
13. S. Ghuffar, N. Brosch, N. Pfeifer and M. Gelautz, Motion segmentation in videos from time of flight cameras, in: Proceedings of the International Conference on Systems, Signals and Image Processing (2012), 328-332.
14. S. Ghuffar, C. Ressl and N. Pfeifer, Relative orientation of videos from range imaging cameras, in: Proceedings SPIE 8791, Videometrics, Range Imaging, and Applications XII; and Automated Visual Inspection (2013), 879114.
15. S. Ghuffar, B. Székely, A. Roncat and N. Pfeifer, Landslide displacement monitoring using 3D range flow on airborne and terrestrial lidar data, Remote Sensing 5(6) (2013), 2720-2745.
16. J. Giralt, L. Rodriguez-Benitez, J. Moreno-Garcia, C. Solana-Cipres and L. Jimenez, Lane mark segmentation and identification using statistical criteria on compressed video, Integrated Computer-Aided Engineering 20(2) (2013), 143-155.
17. J.M. Gottfried, J. Fehr and C. Garbe, Computing range flow from multi-modal Kinect data, in: Advances in Visual Computing, 6938 of Lecture Notes in Computer Science, Springer, (2011), 758-767.
18. M. Grundmann, V. Kwatra, M. Han and I. Essa, Efficient hierarchical graph-based video segmentation, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2010), 1-14.
19. G.M. Hegde and C. Ye, A recursive planar feature extraction method for 3D range data segmentation, in: Proceedings of International Conference on Systems, Man and Cybernetics (2011), 3119-3124.
20. R. Hoffman and A.K. Jain, Segmentation and classification of range images, IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-9(5) (1987), 608-620.
21. P.W. Holland and R.E.Welsch, Robust regression using iteratively reweighted least-squares, Communications in Statistics-Theory and Methods 6(9) (1977), 813-827.
22. M. Holte, T. Moeslund and P. Fihl, View-invariant gesture recognition using 3D optical flow and harmonic motion context, Computer Vision and Image Understanding 114(12) (2010), 1353-1361.
23. B.K.P. Horn and J.G. Harris, Rigid body motion from range image sequences, Computer Vision, Graphics and Image Processing: Image Understanding 53(1) (1991), 1-13.
24. B.K.P. Horn and B.G. Schunck, Determining optical flow, Artificial Intelligence 17(1) (1981), 185-203.
25. B.K.P. Horn and E.J. Weldon, Direct methods for recovering motion, International Journal of Computer Vision 2(1) (1988), 51-76.
26. W. Karel, Integrated range camera calibration using image sequences from hand held operation, in Proceedings of International Society for Photogrammetry and Remote Sensing XXIst Congress-Volume XXXVII (2008), 945-951.
27. W. Karel, P. Dorninger and N. Pfeifer, In situ determination of range camera quality parameters by segmentation, in: Proceedings of the International Conference on Optical 3-DMeasurement Techniques (2007), 109-116.
28. W. Karel, S. Ghuffar and N. Pfeifer, Modelling and compensating internal light scattering in time of flight range cameras, The Photogrammetric Record 27(138) (2012), 155-174.
29. M. Lang, O. Wang, T. Aydin, A. Smolic and M. Gross, Practical temporal consistency for image-based graphics applications, ACM Transactions on Graphics 31(4) (2012), 341-348.
30. J. Leens, S. Piérard, O. Barnich, M. Van Droogenbroeck and J.-M. Wagner, Combining color, depth, and motion for video segmentation, in: Computer Vision Systems, 5815 of Lecture Notes in Computer Science (2009), 104-113.
31. N. Lertchuwongsa, M. Gouiffès and B. Zavidovique, Enhancing a disparity map by color segmentation, Integrated Computer-Aided Engineering 19(4) (2012), 381-397.
32. J. Lezama, K. Alahari, J. Sivic and I. Laptev, Track to the future: Spatio-temporal video segmentation with long-range motion cues, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2011), 3369-3376.
33. D. Li, L. Xu, E.D. Goodman, Y. Xu and Y. Wu, Integrating a statistical background-foreground extraction algorithm and SVMclassifier for pedestrian detection and tracking, Integrated Computer-Aided Engineering 20(3) (2013), 201-216.
34. D.D. Lichti, C. Kim and S. Jamtsho, An integrated bundle adjustment approach to range camera geometric self-calibration, ISPRS Journal of Photogrammetry and Remote Sensing 65(4) (2010), 360-368.
35. B.D. Lucas and T. Kanade, An iterative image registration technique with an application to stereo vision, in: Proceedings of the International Joint Conference on Artificial Intelligence (1981), 674-679.
36. Y. Ma and Q. Chen, Depth assisted occlusion handling in video object tracking, in: Advances in Visual Computing, 6453 of Lecture Notes in Computer Science (2010), 449-460.
37. D.A. Machado, G. Giraldi and A.A. Novotny, Multi-object segmentation approach based on topological derivative and level set method, Integrated Computer-Aided Engineering 18(4) (2011), 301-311.
38. J. Min, M. Powell and K.W. Bowyer, Automated performance evaluation of range image segmentation algorithms, Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 34(1) (2004), 263-271.
39. F. Mufti and R. Mahony, Statistical analysis of signal measurement in time-of-flight cameras, ISPRS Journal of Photogrammetry and Remote Sensing 66(5) (2011), 720-731.
40. L. Ng and V. Solo, Errors-in-variables modeling in optical flow estimation, IEEE Transactions on Image Processing 10(10) (2001), 1528-1540.
41. J.C. Noyer, P. Lanvin and M. Benjelloun, Correlation-based particle filter for 3D object tracking, Integrated Computer-Aided Engineering 16(2) (2009), 165-177.
42. P. Ochs and T. Brox, Object segmentation in video: A hierarchical variational approach for turning point trajectories into dense regions, in: Proceedings of the IEEE International Conference on Computer Vision (2011), 1583-1590.
43. J. Quiroga, F. Devernay and J. Crowley, Scene flow by tracking in intensity and depth data, in: IEEE Conference on Computer Vision and Pattern Recognition Workshops (2012), 50-57.
44. F. Remondino and D. Stoppa, ToF range-imaging cameras, Springer, 2012.
45. A. Sánchez, E.O. Nunes and A. Conci, Using adaptive background subtraction into a multi-level model for traffic surveillance, Integrated Computer-Aided Engineering 19(3) (2012), 239-256.
46. P. Sand and S. Teller, Particle video: Long-range motion estimation using point trajectories, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2006), 2195-2202.
47. M. Schmidt, M. Jehle and B. Jahne, Range flow estimation based on photonic mixing device data, International Journal of Intelligent Systems Technologies and Applications 5(3) (2008), 380-392.
48. R. Schnabel, R. Wahl and R. Klein, Efficient ransac for point-cloud shape detection. Computer Graphics Forum 26(2) (2007), 214-226.
49. T. Schuchert, T. Aach and H. Scharr, Range flow for varying illumination. in: Proceedings of the European Conference on Computer Vision: Part I (2008), 509-522.
50. H. Spies and J.L. Barron, Evaluating the range flow motion constraint. in: Proceedings of the International Conference on Pattern Recognition 3 (2002), 517-520.
51. H. Spies, H. Haußecker, B. Jähne and J.L. Barron, Differential range flow estimation. in: Proceedings of the German Association for Pattern Recognition Symposium (1999), 309-316.
52. H. Spies, B. Jahne and J.L. Barron, Regularized range flow, in: Proceedings of the European Conference on Computer Vision: Part II, 2000, pp. 785-799.
53. H. Spies, B. Jahne and J.L. Barron, Range flow estimation, Computer Vision and Image Understanding 85 (2002), 209-231.
54. D. Sun, S. Roth and M.J. Black, Secrets of optical flow estimation and their principles, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2010), 2432-2439.
55. N. Sundaram, T. Brox and K. Keutzer, Dense point trajectories by gpu-accelerated large displacement optical flow, in: Proceedings of the European Conference on Computer Vision: Part I (2010), 438-451.
56. R. Szeliski, Computer vision: Algorithms and applications, Springer, 2010.
57. R. Tron and R. Vidal, A benchmark for the comparison of 3-d motion segmentation algorithms, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2007), 1-8.
58. S. Vedula, S. Baker, P. Rander, R. Collins and T. Kanade, Three-dimensional scene flow, in: Proceedings of the IEEE International Conference on Computer Vision 2 (1999), 722-729.
59. F. Verbist, N. Deligiannis, M. Jacobs, J. Barbarien, P. Schelkens and A. Munteanu, Maximum likelihood motion compensation for distributed video coding, Integrated Computer-Aided Engineering 19(3) (2012), 215-227.
60. S. Wang, H. Yu and R. Hu, 3D video based segmentation and motion estimation with active surface evolution, Journal of Signal Processing Systems (2012), 21-34.
61. A.Wedel, T. Brox, T. Vaudrey, C. Rabe, U. Franke and D. Cremers, Stereoscopic scene flow computation for 3D motion understanding. International Journal of Computer Vision 95(1) (2011), 29-51.
62. M.Werlberger, W. Trobin, T. Pock, A.Wedel, D. Cremers and H. Bischof, Anisotropic huber-l1 optical flow, in: Proceedings of the British Machine Vision Conference (2009), 1-11.
63. M. Yamamoto, P. Boulanger, J. Beraldin andM. Rioux, Direct estimation of range flow on deformable shape from a video rate range camera, IEEE Transactions on Pattern Analysis and Machine Intelligence 15(1) (1993), 82-89.
64. X. Yin and N. Noguchi, Motion detection and tracking using the 3D-camera. in: Proceedings of the International Federation of Automatic Control World Congress (2011), 14139-14144.
65. C. Zhang, L. Wang and R. Yang, Semantic segmentation of urban scenes using dense depth maps, in: Proceedings of the European Conference on Computer vision: Part IV (2010), 708-721.