A new approach to motion pattern recognition and its application to optical flow estimation

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 37, Issue 1, 2007, Pages 39-51

  Chamorro Martínez, Jesús ^a   Fernández Valdivia, Joaquín ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

Motion segmentation; Multiple motions; Optical flow; Spatio temporal

Indexed keywords

APPROXIMATION THEORY; COMPUTER SIMULATION; ESTIMATION; MATHEMATICAL MODELS; OPTICAL FLOWS; PATTERN RECOGNITION; PROBABILITY; SIGNAL FILTERING AND PREDICTION;

MOTION PATTERN RECOGNITION; MOTION SEGEMENTATION; MULTIPLE MOTIONS;

MOTION COMPENSATION;

EID: 33845770295     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2006.876044     Document Type: Article

References (45)

1. F. Moscheni, S. Bhattacharjee, and M. Kunt, "Spatiotemporal segmentation based on region merging," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 9, pp. 897-915, Sep. 1998.
2. A. R. Mansouri and J. Konrad, "Multiple motion segmentation with level sets," IEEE Trans. Image Process., vol. 12, no. 2, pp. 201-220, Feb. 2003.
3. D. Tweed and A. Calway, "Integrated segmentation and depth ordering of motion layers in image sequences," Image Vision Comput., vol. 20, pp. 709-724, 2002.
4. P.H. S. Torr, "Geometric motion segmentation and model selection," Phil. Trans. R. Soc. A, vol. 356, pp. 1321-1340, 1998.
5. R. Vidal and R. Hartley, "Motion segmentation with missing data using power factorization and GPCA," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., 2004, vol. 2, pp. 310-316.
6. K. Kanatani, "Motion segmentation by subspace separation and model selection," in Proc. IEEE Int. Conf. Comput. Vision, 2001, vol. 2, pp. 586-591.
7. M. Han and T. Kanade, "Multiple motion scene reconstruction with uncalibrated cameras," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 7, pp. 884-894, Jul. 2003.
8. C. Y. Vincent and T. Tjahjadi, "Obstacle detection by direct estimation of multiple motion and scene structure from a moving stereo rig," in Proc. IEEE Int. Conf. Syst, Man, Cybern., 2003, vol. 3, pp. 2326-2331.
9. R. Vidal and S. Sastry, "Optimal segmentation of dynamic scenes from two perspective views," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., 2003, vol. 1, pp. 281-286.
10. R. Hartley and R. Vidal, "The multibody trifocal tensor: Motion segmentation from 3 perspective views," in Proc. IEEE Comput. Soc. Conf. Comput. Vision. Pattern Recognit., 2004, vol. 1, pp. 769-775.
11. W.-S. Tong, C.-K. Tang, and G. Medioni, "Simultaneous two-view epipolar geometry estimation and motion segmentation by 4D tensor voting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1167-1184, Sep. 2004.
12. K. Korimilli and S. Sarkar, "Motion segmentation based on perceptual organization of spatio-temporal volumes," in Proc. 15th Int. Conf. Pattern Recognit., 2000, vol. 3, pp. 844-849.
13. E. H. Adelson and J. R. Bergen, "Spatiotemporal energy models for the perception of motion," J. Opt. Soc. Amer. A., vol. 2, no. 2, pp. 284-299, Feb. 1985.
14. H. Liu, M. Hong, M. Herman, and A. Chellappa, "A general motionmodel and spatio-temporal filters for computing optical flow," Int. J. Comput. Vision, vol. 22, no. 2, pp. 141-172, 1997.
15. L. Wiskott, "Segmentation from motion: Combining Gabor and Mallat wavelets to overcome the aperture and correspondence problem," Pattern Recognit., vol. 32, pp. 1751-1766, 2007.
16. O. Nestares, C. Miravet, J. Santamaria, and R. Navarro, "Automatic segmentation of low visibility moving objects through energy analysis of the local 3D spectrum," in Proc. SPIE, 1999, vol. 3642, pp. 13-22.
17. F. Dekeyser, P. Bouthemy, and P. Perez, "Spatio-temporal wiener filtering of image sequences using a parametric motion model," in Proc. Int. Conf. Image Process., 2000, vol. 1, pp. 208-211.
18. A. B. Watson and A. J. Ahumada. (1983). A look at motion in the frequency domain. NASA Goddard Space Flight Center, Greenbelt, MD, Tech. Rep., NASA Tech. Memo. TM-84352. [Online]. Available: http://vision.arc.nasa.gov/publications/LookAtMotion.pdf
19. S. S. Beauchemin and J. L. Barron, "On the Fourier properties of discontinuous motion," J. Math. Imag. Vision, vol. 13, pp. 155-172, 2000.
20. S. S. Beauchemin and J. L. Barron, "The frequency structure of 1D occluding image sequences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 2, pp. 200-206, Feb. 2000.
21. W. Yu, S. Beauchemin, and K. Daniilidis, "Oriented structure of the occlusion distortion: Is it reliable?," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1286-1290, Sep. 2002.
22. J. Chamorro-Martinez, J. Fdez-Valdivia, and J. Martinez-Baena, "A spatio-temporal filtering approach to motion segmentation," in Pattern Recognition and Image Analysis, F. J. Perales, A. J. C. Campilho, N. Perez de la Blanca, and A. Sanfeliu, Eds. Berlin, Germany: Springer-Verlag, Jun. 2003, pp. 193-203.
23. H.-Y. Wang and K.-K. Ma, "Accurate optical flow estimation using adaptive scale-space and 3Dstructure tensor," in Proc. IEEE ICIP, 2002, vol. 2, pp. 301-304.
24. M. Pingault, E. Bruno, and D. Pellerin, "A robust multiscale B-spline function decomposition for estimatingmotion transparency," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1416-1426, Nov. 2003.
25. B. G. Schunck, "Image flow segmentation and estimation by constraint line clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 10, pp. 1010-1027, Oct. 1989.
26. H. Nagel and W. Enkelmann, "An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 5, pp. 565-593, Sep. 1986.
27. M. J. Black and P. Anandan, "The robust estimation of multiple motion: Parametric and piecewise smooth flow fields," Comput. Vision Image Understanding, vol. 63, no. 1, pp. 75-104, 1996.
28. D. J. Heeger, "Model for the extraction of image flow," J. Opt. Soc. Amer. A., vol. 4, no. 8, pp. 1455-1571, 1987.
29. O. Nestares and R. Navarro, "Probabilistic estimation of optical flow in multiple band-pass directional channels," Image Vision Comput., vol. 19, no. 6, pp. 339-351, 2001.
30. E. Memin and P. Perez, "Dense estimation and object-based segmentation of the optical flow with robust techniques," IEEE Trans. Image Process., vol. 7, no. 5, pp. 703-719, May 1998.
31. T. Brox, A. Bruhn, N. Papenberg, and J.Weickert, "High accuracy optical flow estimation based on a theory for warping," in Proc. ECCV 2004, Lecture Notes in Computer Science, vol. 3024, T. Pajdla and J. Matas, Eds. Berlin, Germany: Springer-Verlag, 2004, pp. 25-36.
32. J. Chamorro-Martinez and J. Fdez-Valdivia, "Optical flow estimation based on the extraction ofmotion patterns," in Proc IEEE ICIP, Barcelona, Spain, Sep. 2003, vol. 1, pp. 925-928.
33. J. G. Daugman, "Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression," IEEE Trans. Acoust., Speech Signal Process., vol. 36, no. 7, pp. 1169-1179, Jul. 1988.
34. M. Hawken and A. Parker, "Spatial properties of neurons in the monkey striate cortex," in Proc. R. Soc. Lond., B, 1987, vol. 231, pp. 251-288.
35. D. J. Field, "Relations between the statistics of natural images and the response properties of cortical cells," J. Opt. Soc. Amer. A., vol. 4, no. 12, pp. 2379-2394, 1987.
36. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice Hall, 1988.
37. M. C. Morrone and R. A. Owens, "Feature detection from local energy," Pattern Recognit. Lett., vol. 6, pp. 303-313, 1987.
38. M. C. Morrone and D. C. Burr, "Feature detection in human vision: A phase-dependent energy model," in Proc. R. Soc. Lond., B, 1988, vol. 235, pp. 221-245.
39. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-8, no. 6, pp. 679-698, Nov. 1986.
40. R. Rodriguez-Sanchez, J. A. Garcia, J. Fdez-Valdivia, and X. R. Fdez-Vidal, "The RGFF representation model: A system for the automatically learned partitioning of 'visual patterns' in digital images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 10, pp. 1044-1072, Oct. 1999.
41. N. Graham, Visual Pattern Analyzers. London, U.K.: Oxford Univ. Press, 1989.
42. J. L. Barron, D. J. Fleet, S. Beauchemin, and S., "Performance of optical flow techniques," Int. J. Comput. Vision, vol. 12, no. 1, pp. 43-77, 1994.
43. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artif. Intell., vol. 17, pp. 185-203, 1981.
44. B. Lucas and T. Kanade, "An interactive image registration technique with an application to stereo vision," in DARPA Proc. Image Understanding Workshop, 1981, pp. 121-130.
45. E. P. Simoncelli, E. H. Adelson, and D. J. Heeger, "Probability distributions of optical flow," in IEEE Proc. CVPR'91, 1991, pp. 310-315.