Robust video stabilization based on particle filter tracking of projected camera motion

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 19, Issue 7, 2009, Pages 945-954

  Yang, Junlan ^a   Schonfeld, Dan ^a   Mohamed, Magdi ^b  

^a 1120 Science and Engineering Offices   (United States)

^b MOTOROLA INC   (United States)

Author keywords

Bootstrap filtering; Monte Carlo methods; Motion analysis; Particle filtering; Video stabilization

Indexed keywords

AFFINE MODEL; BOOTSTRAP FILTERING; CAMERA MOTIONS; ERROR VARIANCE; HAND-HELD CAMERAS; IMAGE SEQUENCE; IMAGE TRANSFORMS; MOTION ANALYSIS; MOVING PLATFORM; NOVEL TECHNIQUES; OBJECT TRACKING; PARTICLE FILTER; PARTICLE FILTERING; POST PROCESS; SCALE INVARIANT FEATURE TRANSFORMS; SIMULATED EXPERIMENTS; VIDEO SEQUENCES; VIDEO STABILIZATION; VISUAL QUALITIES;

ACOUSTIC SIGNAL PROCESSING; AIR FILTERS; CAMERAS; COMPUTER GRAPHICS; DISTRIBUTED COMPUTER SYSTEMS; IMAGE REGISTRATION; NONLINEAR FILTERING; STABILIZATION; TARGET TRACKING; VIDEO RECORDING;

MONTE CARLO METHODS;

EID: 68249121797     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2009.2020252     Document Type: Article

References (35)

1. N. Gordon, M. Arulampalam, S. Maskell, and T. Clapp, "A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174-188, Feb. 2002.
2. S. Erturk, "Digital image stabilization with sub-image phase correlation based global motion estimation," IEEE Trans. Consumer Electron., vol. 49, no. 4, pp. 1320-1325, Nov. 2003.
3. S. Erturk and T. Dennis, "Image sequence stabilization based on DFT filtering," Proc. IEEE Image Vision Signal Process., vol. 127, no. 2, pp. 95-102, Apr. 2000.
4. A. Litvin, J. Konrad, and W. Karl, "Probabilistic video stabilization using kalman filtering and mosaicking," in Proc. Image Video Commun. IS&T/SPIE Symp. Electron. Imaging, Santa Clara, CA, pp. 663-674, 2003.
5. C. Morimoto and R. Chellappa, "Fast electronic digital image stabilization for off-road navigation," Real-Time Imaging, vol. 2, pp. 285-296, 1996.
6. C. Morimoto and R. Chellappa, "Fast 3-D stabilization and mosaic construction," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 660-665.
7. J. Jin, Z. Zhu, and G. Xu, "Digital video sequence stabilization based on 2.5-D motion estimation inertial motion filtering," Real-Time Imaging, vol. 7, pp. 357-365, 2001.
8. Z. Duric and A. Rosenfeld, "Image sequence stabilization in real time," Real-Time Imaging, vol. 2, pp. 271-284, 1996.
9. A. Censi, A. Fusiello, and V. Roberto, "Image stabilization by feature tracking," in Proc. Int. Conf. Anal. Process., Venice, Italy, 1999, pp. 665-667.
10. Y. Liang, H. Tyan, and S. Chen, "Video stabilization for a camcorder mounted on a moving vehicle," IEEE Trans. Veh. Technol., vol. 53, no. 6, pp. 1636-1648, Nov. 2004.
11. J. Chang, W. Hu, M. Cheng, and B. Chang, "Digital image translation and rotation motion stabilization using optical flow technique," IEEE Trans. Consumer Electron., vol. 48, no. 1, pp. 108-115, Feb. 2002.
12. S. Ko, S. Lee, S. Jeon, and E. Kang, "Fast digital image stabilizer based on gray-coded bit-plane matching," IEEE Trans. Consumer Electron., vol. 45, no. 3, pp. 598-603, Aug. 1999.
13. J. Pail, Y. Park, and D. Kim, "An adaptive motion decision system for digital image stabilizer based on edge pattern matching," IEEE Trans. Consumer Electron., vol. 38, no. 3, pp. 607-615, Aug. 1992.
14. S. Piva, M. Zara, G. Gera, and C. Reegazzoni, "Color-based video stabilization for real-time on-board object detection on high-speed trains," in Proc. IEEE Conf. Advanced Video Signal Based Surveillance, Miami, FL, 2003, pp. 299-304.
15. C. Chen, J. Yang, D. Schonfeld, and M. Mohamed, "Pose estimation from video sequences based on sylvester's equation," in Proc. SPIE Electron. Imaging, Conf. Visual Commun. Image Process., San Jose, CA, 2007, pp. 1S.1-1S.12.
16. R. Kalman, "A new approach to linear filtering and prediction problems," Trans. ASME, J. Basic Eng. Ser. D, vol. 82, pp. 35-45, 1960.
17. N. Gordon, D. Salmond, and A. Smith, "Novel approach to non-linear and non-gaussian bayesian state estimation," Proc. IEEE-F, vol. 140, no. 2, pp. 107-113, Apr. 1993.
18. M. Isard and A. Blake, "Condensation conditional density propagation for visual tracking," Int. J. Comput. Vision, vol. 29, no. 1, pp. 5-28, Aug. 1998.
19. A. Doucet, J. Freitas, and N. Gordon, Sequential Monte Carlo Methods in Practice. 1st ed. New York: Springer-Verlag, 2001, ch. 2, sec. 2, pp. 15-38.
20. A. Doucet, S. Godsill, and C. Andrieu, "On sequential monte carlo sampling methods for bayesian filtering," Statist. Computing, vol. 10, no. 3, pp. 197-208, 2000.
21. M. Isard and A. Blake, "A smoothing filter for condensation," in Proc. 5th Eur. Conf. Comput. Vision, vol. 1. Freiburg, Germany, 1998, pp. 767-781.
22. M. Klass, M. Briers, N. de Freitas, A. Doucet, S. Maskell, and D. Lang, "Fast particle smoother: If I had a million particles," in Proc. 23rd Int. Conf. Mach. Learning, Pittsburgh, PA, 2006, pp. 25-29.
23. W. Fong, S. Godsill, A. Doucet, and M. West, "Monte carlo smoothing with application to audio signal enhancement," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 438-449, Feb. 2002.
24. M. Isard and A. Blake, "Icondensation: Unifying low-level and high-level tracking in a stochastic framework," in Proc. 5th Eur. Conf. Comput. Vision, vol. 1. Freiburg, Germany, 1998, pp. 893-908.
25. Y. Rui and Y. Chen, "Better proposal distributions: Object tracking using unscented particle filter," in Proc. IEEE Conf. Comput. Vision Pattern Recognition, Kauai, Hawaii, 2001, pp. 786-793.
26. N. Bouaynaya, W. Qu, and D. Schonfeld, "An online motion-based particle filter for head tracking applications," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Philadelphia, PA, 2005, pp. 225-228.
27. J. M. Odobez and D. Gatica-Perez, "Embedding motion in model-based stochastic tracking," in Proc. Int. Conf. Pattern Recognition, vol. 2. Cambridge, U.K., 2004, pp. 815-818.
28. Y. Matsushita, E. Ofek, X. Tang, and H. Shum, "Full-frame video stabilization," in Proc. IEEE Int. Conf. Comput. Vision Pattern Recognition, San Diego, CA, 2005, pp. 50-57.
29. D. A. Forsyth and J. Ponce, Computer Vision: A Modern Approach. 1st ed. Englewood Cliffs, NJ: Prentice Hall, 2002, ch. 2, sec. 1.2, pp. 9-16.
30. R. Haralick, H. Joo, C. Lee, X. Zhuang, V. Vaidya, and M. Kim, "Pose estimation from corresponding point data," IEEE Trans. Syst., Man. Cybern., vol. 19, no. 6, pp. 1426-1446, Dec. 1989.
31. D. Crisan and A. Doucet, "A survey of convergence results on particle filtering methods for practitioners," IEEE Trans. Signal Process., vol. 50, no. 3, pp. 736-746, Mar. 2002.
32. J. MacCormick and M. Isard, "Partitioned sampling, articulated objects, and interface-quality hand tracking," in Proc. ECCV, vol. 2. Dublin, Ireland, 2000, pp. 3-19.
33. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, Dec. 2004.
34. C. Morimoto and R. Chellappa, "Evaluation of image stabilization algorithms," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. 5. Seattle, WA, 1998, pp. 2789-2792.
35. S. I. Resnick, A Probability Path. 1st ed. Cambridge, MA: Birkhauser, 2001, ch. 7, sec. 7.4, pp. 213-219.