Real-time video stabilization without phantom movements for micro aerial vehicles

Eurasip Journal on Image and Video Processing

Volumn 2014, Issue 1, 2014, Pages

  Aguilar, Wilbert G ^a   Angulo, Cecilio ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

Filter; Micro aerial vehicles; Motion intention; Real time; Video stabilization

Indexed keywords

AIRCRAFT CONTROL; AMPHIBIOUS VEHICLES; LOW PASS FILTERS; MICRO AIR VEHICLE (MAV); STABILIZATION; VEHICLES; VIDEO SIGNAL PROCESSING;

FILTER; MICRO AERIAL VEHICLE; MOTION INTENTION; REAL TIME; VIDEO STABILIZATION;

SECURITY SYSTEMS;

EID: 84938082458     PISSN: 16875176     EISSN: 16875281     Source Type: Journal    
DOI: 10.1186/1687-5281-2014-46     Document Type: Article

References (47)

1. Kendoul F: Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems.J. Field Robot 2012,29(2):315–378. 10.1002/rob.20414
2. Duric Z, Rosenfeld A: Shooting a smooth video with a shaky camera.Mach. Vis. Appl 2003,13(5–6):303–313.
3. Battiato S, Gallo G, Puglisi G, Scellato S: SIFT features tracking for video stabilization. In 14th International Conference on Image Analysis and Processing, 2007. ICIAP 2007. Modena, 10–14 Sept; 2007:825–830.
4. Hsu Y-F, Chou C-C, Shih M-Y: Moving camera video stabilization using homography consistency. In 2012 19th IEEE International Conference on Image Processing (ICIP). Lake Buena Vista,30 Sept–3 Oct; 2012:2761–2764.
5. Song C, Zhao H, Jing W, Zhu H: Robust video stabilization based on particle filtering with weighted feature points.Consum. Electron. IEEE Trans 2012,58(2):570–577.
6. Grundmann M, Kwatra V, Essa I: Auto-directed video stabilization with robust l1 optimal camera paths. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Colorado Springs, 20–25 June; 2011:225–232.
7. Chang H-C, Lai S-H, Lu K-R: A robust and efficient video stabilization algorithm. In 2004 IEEE International Conference on Multimedia and Expo, 2004. ICME ’04. Taipei,27–30 June; 2004:29–321.
8. Strzodka R, Garbe C: Real-time motion estimation and visualization on graphics cards.IEEE Vis 2004, 2004:545–552.
9. Lee K-Y, Chuang Y-Y, Chen B-Y, Ouhyoung M: Video stabilization using robust feature trajectories. In 2009 IEEE 12th International Conference on Computer Vision. Kyoto, 27 Sept–4; Oct 2009:1397–1404.
10. Yang J, Schonfeld D, Mohamed M: Robust video stabilization based on particle filter tracking of projected camera motion.Circuits Syst. Video Technol. IEEE Trans 2009,19(7):945–954.
11. Wang C, Kim J-H, Byun K-Y, Ni J, Ko S-J: Robust digital image stabilization using the Kalman filter.Consum. Electron. IEEE Trans 2009,55(1):6–14.
12. Canny J: A computational approach to edge detection.Pattern Anal. Mach. Intell. IEEE Trans 1986,PAMI-8(6):679–698.
13. Harris C, Stephens M: A combined corner and edge detector.Proceedings of The Fourth Alvey Vision Conference 31 Aug–2 Sept 1988, 147–151.
14. Miksik O, Mikolajczyk K: Evaluation of local detectors and descriptors for fast feature matching. In 2012 21st International Conference on Pattern Recognition (ICPR). Tsukuba; 11–15 Nov 2012:2681–2684.
15. Leutenegger S, Chli M, Siegwart RY: BRISK: Binary Robust Invariant Scalable Keypoints. In 2011 IEEE International Conference on Computer Vision (ICCV). Barcelona; 6–13 Nov 2011:2548–2555.
16. Alahi A, Ortiz R, Vandergheynst P: Freak: Fast retina keypoint. In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Providence; 16–21 June 2012:510–517.
17. Rublee E, Rabaud V, Konolige K, Bradski G: ORB: an efficient alternative to SIFT or SURF. In 2011 IEEE International Conference on Computer Vision (ICCV). Barcelona; 6–13 Nov 2011:2564–2571.
18. Lowe DG: Object recognition from local scale-invariant features. In The Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999. Kerkyra; 20–25 Sept 1999:1150–11572.
19. Bay H, Tuytelaars T, Gool L: SURF: Speeded Up Robust Features. In Computer Vision – ECCV 2006. Edited by: A Leonardis, H Bischof, A Pinz, and (eds.). Springer, Berlin; 2006:404–417.
20. Luo J, Oubong G: A Comparison of SIFT, PCA-SIFT and SURF.Int. J. Image Process. (IJIP) 2009,3(4):143–152.
21. Fischler MA, Bolles RC: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography.Commun. ACM 1981,24(6):381–395. 10.1145/358669.358692
22. Tordoff B, Murray D: Guided sampling and consensus for motion estimation. In Computer Vision – ECCV 2002. Edited by: A Heyden, G Sparr, M Nielsen, P Johansen, and (eds.). Springer, Berlin; 2002:82–96.
23. Choi S, Kim T, Yu W: Performance evaluation of RANSAC family. In Proceedings of the British Machine Vision Conference 2009. London; 7–10 Sept 2009:81–18112.
24. Derpanis KG: Overview of the RANSAC algorithm. Technical report, Computer Science, York University; 2010.
25. Matsushita Y, Ofek E, Ge W, Tang X, Shum H-Y: Full-frame video stabilization with motion inpainting.Pattern Anal. Mach. Intell. IEEE Trans 2006,28(7):1150–1163.
26. Rawat P, Singhai J: Adaptive motion smoothening for video stabilization.Int. J. Comput 2013,72(20):14–20.
27. Wu S, Zhang DC, Zhang Y, Basso J, Melle M: Adaptive smoothing in real-time image stabilization. In Visual Information Processing XXI. Baltimore; 24–25 April 2012.
28. Wang Y, Hou Z, Leman K, Chang R: Real-time video stabilization for unmanned aerial vehicles. In MVA2011 IAPR Conference on Machine Vision Applications. Nara; 13–15 June 2011:336–339.
29. Wang Y, Chang R, Chua T: Video stabilization based on high degree b-spline smoothing. In 2012 21st Conference on Pattern Recognition (ICPR). Tsukuba; 11–15 Nov 2012:3152–3155.
30. Ryu YG, Roh HC, Chung M-J: Long-time video stabilization using point-feature trajectory smoothing. In 2011 IEEE International Conference on Consumer Electronics (ICCE). Las Vegas; 9–12 Jan 2011:189–190.
31. Jing D, Yang X: Real-time video stabilization based on smoothing feature trajectories.Appl. Mech. Mater 2014,519—520(1662–7482):640–643.
32. Mikolajczyk K, Schmid C: Scale & affine invariant interest point detectors.Int. J. Comput. Vis 2004,60(1):63–86.
33. Faugeras O, Luong Q-T, Papadopoulou T: The Geometry of Multiple Images: the Laws That Govern the Formation of Images of a Scene and Some of Their Applications. MIT Press, Cambridge; 2001.
34. Forsyth DA, Ponce J: Computer Vision: a Modern Approach. Prentice Hall, Upper Saddle River; 2002.
35. Hartley R, Zisserman A: Multiple View Geometry in Computer Vision. Cambridge University Press, New York; 2003.
36. Aguilar WG, Angulo C: Estabilización robusta de vídeo basada en diferencia de nivel de gris.Proceedings of the 8th Congress of Science and Technology ESPE 2013 Sangolquí, 5–7 June 2013.
37. Aguilar WG, Angulo C: Robust video stabilization based on motion intention for low-cost micro aerial vehicles. In 2014 11th International Multi-conference on Systems, Signals and Devices (SSD). Barcelona; 11–14 Feb 2014:1–6.
38. Vazquez M, Chang C: Real-time video smoothing for small RC helicopters. In IEEE International Conference on Systems, Man and Cybernetics, 2009. SMC 2009. San Antonio; 11–14 Oct 2009.
39. Bailey SW, Bodenheimer B: A comparison of motion capture data recorded from a Vicon system and a Microsoft Kinect sensor. In Proceedings of the ACM Symposium on Applied Perception. SAP ’12. ACM, New York; 2012:121–121.
40. Xu J, Chang H-W, Yang S, Wang M: Fast feature-based video stabilization without accumulative global motion estimation.Consum. Electron. IEEE Trans 2012,58(3):993–999.
41. Niskanen M, Silven O, Tico M: Video stabilization performance assessment. In 2006 IEEE International Conference on Multimedia and Expo. Toronto; 9–12 July 2006:405–408.
42. Kang S-J, Wang T-S, Kim D-H, Morales A, Ko S-J: Video stabilization based on motion segmentation.2012 IEEE International Conference on Consumer Electronics (ICCE) 2012, 416–417.
43. Fang C-L, Tsai T-H, Chang C-H: Video stabilization with local rotational motion model. In 2012 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS). Kaohsiung; 2–5 Dec 2012:551–554.
44. Yilmaz A, Javed O, Shah M: Object tracking: a survey.ACM Comput. Surv 2006.,38(13):
45. Zhang Z: A flexible new technique for camera calibration.Pattern Anal. Mach. Intell. IEEE Trans 2000,22(11):1330–1334. 10.1109/34.888718
46. Aguilar WG, Costa R, Angulo C, Molina L: Control autónomo de cuadricópteros para seguimiento de trayectorias. In Proceedings of the 9th Congress of Science and Technology ESPE 2014. Sangolquí; 28–30 May 2014.
47. Aguilar WG, Angulo C: Estabilización de vídeo en micro vehículos aéreos y su aplicación en la detección de caras. In Proceedings of the 9th Congress of Science and Technology ESPE 2014. Sangolquí; 28–30 May 2014.