A robust real-time embedded vision system on an unmanned rotorcraft for ground target following

IEEE Transactions on Industrial Electronics

Volumn 59, Issue 2, 2012, Pages 1038-1049

  Lin, Feng ^a   Dong, Xiangxu ^a   Chen, Ben M ^a   Lum, Kai Yew ^a   Lee, Tong H ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Image processing; real time systems; target detection and following; unmanned aerial vehicles (UAVs); vision systems

Indexed keywords

ACTUAL FLIGHT; COLOR CAMERAS; FEATURE-BASED; GROUND TARGET; HARDWARE CONSTRUCTION; MULTI-THREAD; MULTIPLE TASKS; NAVIGATION SENSORS; ON-BOARD SOFTWARES; OVERALL VISION; SYSTEMATIC DESIGNS; VISION ALGORITHMS; VISION FEEDBACK; VISION SYSTEMS;

AIRCRAFT; FLIGHT CONTROL SYSTEMS; HELICOPTER ROTORS; IMAGE PROCESSING; ROTORS; UNMANNED AERIAL VEHICLES (UAV); UNMANNED VEHICLES;

REAL TIME SYSTEMS;

EID: 80054803865     PISSN: 02780046     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIE.2011.2161248     Document Type: Article

References (40)

1. M. J. Adriaans, R. C. Cribbs, B. T. Ingram, and B. P. Gupta, "A160 Hummingbird unmanned air vehicle development program," in Proc. AHS Int. Specialists'Meeting-Unmanned Rotorcraft: Des., Control Test., Chandler, AZ, 2007.
2. O. Amidi, T. Kanade, and R.Miller, "Vision-based autonomous helicopter research at Carnegie Mellon Robotics Institute 1991-1997," in Proc. Amer. Helicopter Soc. Int. Conf., Gifu, Japan, 1998, pp. 1-12.
3. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, no. 1, pp. 43-77, Feb. 1994.
4. Y. Boykov and D. P. Huttenlocher, "Adaptive Bayesian recognition in tracking rigid objects," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Hilton Head, SC, 2000, pp. 697-704.
5. G. R. Bradski and S. Clara, "Computer vision face tracking for use in a perceptual user interface," Intel Technology Journal Q2 '98, pp. 1-15, 1998.
6. G. W. Cai, B. M. Chen, K. M. Peng, M. B. Dong, and T. H. Lee, "Modeling and control of the yaw channel of a UAV helicopter," IEEE Trans. Ind. Electron., vol. 55, no. 9, pp. 3426-3434, Sep. 2008.
7. R. Canals, A. Roussel, J. L. Famechon, and S. Treuillet, "A biprocessororiented vision-based target tracking system," IEEE Trans. Ind. Electron., vol. 49, no. 2, pp. 500-506, Apr. 2002.
8. M. E. Campbell and W. W. Whitacre, "Cooperative tracking using vision measurements on seascan UAVs," IEEE Trans. Control Syst. Technol., vol. 15, no. 4, pp. 613-626, Jul. 2007.
9. F. Chaumette and S. Hutchinson, "Visual servo control Part I: Basic approaches," IEEE Robot. Autom. Mag., vol. 13, no. 4, pp. 82-90, Dec. 2006.
10. F. Chaumette and S. Hutchinson, "Visual servo control Part II: Advanced approaches," IEEE Robot. Autom. Mag., vol. 14, no. 1, pp. 109-118, Mar. 2007.
11. C. Chen and Y. F. Zheng, "Passive and active stereo vision for smooth surface detection of deformed plates," IEEE Trans. Ind. Electron., vol. 42, no. 3, pp. 300-306, Jun. 1995.
12. Y. Cheng, "Mean shift, mode seeking, and clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 8, pp. 790-799, Aug. 1995.
13. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 564-577, May 2003.
14. B. Enderle, "Commercial applications of UAVs in Japanese agriculture," presented at the AIAA 1st Unmanned Aerospace Vehicles, Systems, Technologies, and Operations( UAV) Conf., Portsmouth, VA, 2002, AIAA-2002-3400.
15. J. Ferruz, V. M. Vega, A. Ollero, and V. Blanco, "Reconfigurable control architecture for distributed systems in the HERO autonomous helicopter," IEEE Trans. Ind. Electron., vol. 58, no. 12, pp. 5311-5318, Dec. 2011.
16. G. Franklin, J. D. Powell, and A. E. Naeini, Feedback Control of Dynamic Systems, 4th ed. Upper Saddle River, NJ: Prentice-Hall, 2002.
17. N. Guenard, T. Hamel, and R. Mahony, "A practical visual servo control for an unmanned aerial vehicle," IEEE Trans. Robot., vol. 24, no. 2, pp. 331-340, Apr. 2008.
18. S. Hrabar, G. S. Sukhatme, P. Corke, K. Usher, and J. Roberts, "Combined optic-flow and stereo-based navigation of urban canyons for a UAV," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2005, pp. 3309-3316.
19. W. M. Hu, T. N. Tan, L. Wang, and S. Maybank, "A survey on visual surveillance of object motion and behaviors," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 34, no. 3, pp. 334-352, Aug. 2004.
20. Y. Hu, W. Zhao, and L. Wang, "Vision-based target tracking and collision avoidance for two autonomous robotic fish," IEEE Trans. Ind. Electron., vol. 56, no. 5, pp. 1401-1410, May 2009.
21. M. Isard and A. Blake, "Condensation conditional density propagation for visual tracking," Int. J. Comput. Vis., vol. 29, no. 1, pp. 5-28, 1998.
22. E. N. Johnson, A. J. Calise, Y. Watanabe, J. Ha, and J. C. Neidhoefer, "Real-time vision-based relative aircraft navigation," J. Aerosp. Comput., Inf. Commun., vol. 4, no. 4, pp. 707-738, 2007.
23. J. Kim and S. Sukkarieh, "SLAM aided GPS/INS navigation in GPS denied and unknown environments," in Proc. Int. Symp. GNSS/GPS, Sydney, Australia, 2004.
24. X. R. Li and V. P. Jilkov, "Survey of maneuvering target tracking, Part I: Dynamic models," IEEE Trans. Aerosp. Electron. Syst., vol. 39, no. 4, pp. 1333-1364, Oct. 2003.
25. F. Lin, K. Y. Lum, B. M. Chen, and T. H. Lee, "Development of a visionbased ground target detection and tracking system for a small unmanned helicopter," Sci. China-Series F: Inf. Sci., vol. 52, no. 11, pp. 2201-2215, Nov. 2009.
26. B. Ludington, E. Johnso, and G. Vachtsevanos, "Augmenting UAV autonomy," IEEE Robot. Autom. Mag., vol. 13, no. 3, pp. 63-71, Sep. 2006.
27. M. Meingast, C. Geyer, and S. Sastry, "Vision based terrain recovery for landing unmanned aerial vehicles," in Proc. IEEE Conf. Decision Control, Atlantis, Bahamas, 2004, pp. 1670-1675.
28. L. Mejias, S. Saripalli, P. Cervera, and G. S. Sukhatme, "Visual servoing of an autonomous helicopter in urban areas using feature tracking," J. Field Robot., vol. 23, no. 3/4, pp. 185-199, Apr. 2006.
29. R. Nelson and J. R. Corby, "Machine vision for robotics," IEEE Trans. Ind. Electron., vol. IE-30, no. 3, pp. 282-291, Aug. 1983.
30. F. Porikli, "Achieving real-time object detection and tracking under extreme conditions," J. Real-Time Image Process., vol. 1, no. 1, pp. 33-40, Oct. 2006.
31. F. Sadjadi, "Theory of invariant algebra and its use in automatic target recognition," in Physics of Automatic Target Recognition, vol. 3. New York: Springer-Verlag, 2007, pp. 23-40.
32. Z. Sarris and S. Atlas, "Survey of UAV applications in civil markets," in Proc. 9th Mediterranean Conf. Control Autom., Dubrovnik, Croatia, 2001, vol. WA2-A, pp. 1-11.
33. A. R. Smith, "Color gamut transform pairs," in Proc. 5th Annu. Conf. Comput. Graph. Interactive Tech., New York, 1978, pp. 12-19.
34. O. Spinka, O. Holub, and Z. Hanzalek, "Low-cost reconfigurable control system for small UAVs," IEEE Trans. Ind. Electron., vol. 58, no. 3, pp. 880-889, Mar. 2011.
35. T. Y. Tian, C. Tomasi, and D. J. Heeger, "Comparison of approaches to egomotion computation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, 1996, pp. 315-320.
36. S. Tsugawa, "Vision-based vehicles in Japan: Machine vision systems and driving control systems," IEEE Trans. Ind. Electron., vol. 41, no. 4, pp. 398-405, Aug. 1994.
37. H. Veeraraghavan, P. Schrater, and N. Papanikolopoulos, "Robust target detection and tracking through integration of motion, color and geometry," Comput. Vis. Image Understand., vol. 103, no. 2, pp. 121-138, Aug. 2006.
38. C. R. Wren, A. Azarbayejani, T. Darrell, and A. P. Pentland, "Pfinder: Real-time tracking of the human body," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 780-785, Jul. 1997.
39. D. Xu, L. Han, M. Tan, and Y. F. Li, "Ceiling-based visual positioning for an indoor mobile robot with monocular vision," IEEE Trans. Ind. Electron., vol. 56, no. 5, pp. 1617-1628, May 2009.
40. Q. M. Zhou and J. K. Aggarwalb, "Object tracking in an outdoor environment using fusion of features and cameras," Image Vis.Comput., vol. 24, no. 11, pp. 1244-1255, Nov. 2006.