A novel line of sight control system for a robot vision tracking system, using vision feedback and motion-disturbance feedforward compensation

Robotica

Volumn 31, Issue 1, 2013, Pages 99-112

  Park, Jaehong ^e   Hwang, Wonsang ^a   Kwon, Hyunil ^b   Kim, Kwangsoo ^c   Cho, Dong Il Dan ^d  

^a LG Display Co Ltd   (South Korea)

^b LG Electronics Inc   (South Korea)

^c Hanbat National University   (South Korea)

^d Department of Aerospace Engineering   (South Korea)

^e NONE

Author keywords

Disturbance compensator; Extended kalman filter; Feedback controller; Feedforward controller; Line of sight control system; Slip detector; Vision tracking system

Indexed keywords

DISTURBANCE COMPENSATOR; FEED-FORWARD CONTROLLERS; FEEDBACK CONTROLLER; LINE-OF-SIGHT CONTROL; VISION TRACKING SYSTEMS;

CAMERAS; CONTROL SYSTEMS; EXTENDED KALMAN FILTERS; FEEDBACK CONTROL; FEEDFORWARD CONTROL; ROBOTS; TARGET TRACKING; WHEELS;

COMPUTER VISION;

EID: 84870588034     PISSN: 02635747     EISSN: 14698668     Source Type: Journal    
DOI: 10.1017/S0263574712000124     Document Type: Article

References (33)

1. M. Lenderman, Experience the Message: How Experiential Marketing Is Changing the Brand World (Carroll & Graf Publishers, New York, 2006).
2. D. Kragić and M. Vincze, "Vision for robotics, " Found. Trends Robot. 1(1), 1-78 (2010).
3. S. Nadimi and B. Bhanu, "Multistrategy Fusion Using Mixture Model for Moving Object Detection, " Proceedings of the International Conference on Multisensor Fusion and Integration for Intelligent Systems 2001, Germany (Aug. 20-22, 2001) pp. 317-322.
4. Z. Jia, A. Balasuriya and S. Challa, "Vision based target tracking for autonomous land vehicle navigation: A brief survey, " Recent Patents Comput. Sci. 2, 32-42 (2009).
5. N. Pinto, D. D. Cox and J. J. DiCarlo, "Why is real-world visual object recognition hard?, " PLoS Comp. Bio. 4(1), 151-156 (2004).
6. D. Kragić and H. H. Christensen, "Cue integration for visual servoing, " IEEE Trans. Robot. Autom. 17(1), 18-27 (2001).
7. Y. Cai, N. de Freitas and J. J. Little, "Robust Visual Tracking for Multiple Targets, " Proceedings of the European Conference Computer Vision, Austria (May 7-13, 2006) pp. 107-118.
8. P. Nillius, J. Sullivan and S. Carlsson, "Multi-Target Tracking-Linking Identities Using Baysian Network Inference, " Proceedings of the 2006 IEEE Computer Vision and Pattern Recognition (CVPR 2006), Wasington, DC (Jun. 17-22, 2006) pp. 2187-2194.
9. B. Jung and G. S. Sukhatme, "Real-time motion tracking from a mobile robot, " Int. J. Soc. Robot., 2(1), 63-78 (2010).
10. M. Dai, T. Raphan and B. Cohen, "Adaptation of the angular vestibulo-ocular reflex to head movements in rotating frames of reference, " Exp. Brain Res. 195(4), 553-567 (2009).
11. M. Hwangbo, J.-S. Kim and T. Kanade, "Inertial-Aided KLT Feature Tracking for a Moving Camera, " Proceedings of the 2009 IEEE/RSJ International Conference Intelligent Robots and Systems, St. Louis, MO (Oct. 10-15, 2009) pp. 1909-1916.
12. Z. Jia, A. Balasuriya and S. Challa, "Sensor fusion-based visual target tracking for autonomous vehicles with the out-of-sequence measurements solution, " Robot. Auton. Syst. 56(2), 57-176 (2006).
13. M. Ribo, M. Bradner and A. Pinz, "A flexible software architecture for hybrid tracking, " J. Robot. Syst. 21(2), 53-63 (2004).
14. D. Xu and Y. F. Li, "A New Pose Estimation Method based on Inertial and Visual Sensors for Autonomous Robots, " Proceedings of the IEEE International Conference on Robotics and Biomimetics, Sanya, China (Dec. 15-18, 2007) pp. 405-410.
15. L. Lobo and J. Dias, "Inertial sensed ego-motion for 3D vision, " J. Robot. Syst., 21(1), 3-12 (2004).
16. T. Shibata and S. Schaal, "Biomimetic gaze stabilization based on feedback-error-learning with nonparametric regression networks, " Neural Netw. 14, 201-216 (2007).
17. S. Xie, J. Luo, Z. Gong, W. Ding, H. Zou and X. Fu, "Biomimetic Control of Pan-tilt-zoom Camera for Visual Tracking Based-on an Autonomous Helicopter, " Proceedings of the 2007 IEEE/RSJ International Conference Intelligent Robots and Systems, San Diego, CA (Oct. 29-Nov. 2, 2007) pp. 2138-2143.
18. A. Lenz, T. Balakrishnan, A. G. Pipe and C. Melhuish, "An adaptive gaze stabilization controller inspired by the vestibulo-ocular reflex, " Bioinsp. Biomim. 3, 1-11 (2008).
19. H. K. Ouh, W. Bahn, J. Park, W. S. Hwang, H. I. Kwon, K. S. Kim and D. I. Cho, "VOR Based Target Tracking System with an Accelerometer for Mobile Robots, " Proceedings of the 6th International Conferenceon Ubiquitous Robots and Ambient Intelligence, Gwangju, Korea (Oct. 28-31, 2009) pp. 133-137.
20. N. Dieringer, "Vestibular system, " In: Encyclopedia of Life Sciences (John Wiley & Sons, Hoboken, NJ, 2006).
21. J. S. Lim, T. H. Lee, T. D. Ahn, K. H. Yoo, A. R. Lee and D. I. Cho, "Sensor Fusion for Mobile Robot Navigation Using Accelerometers and Odometer, " Proceedings of the 13th International Conferenceon Advanced Robotics, Jeju, Korea (Aug. 21-24, 2007) pp. 343-348.
22. R. Mazl and L. Preucil, "Vehicle localization using inertial sensors and GPS, " Springer Tracts Adv. Robot. 24, 135-144 (2006).
23. A, V. Oppenheim and R. W. Schafer, Discrete-Time Signal Processing, 3rd Ed. (Pearson Prentice Hall, Upper Saddle River, NJ, 2010).
24. R. Y. Tsai, "A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras lenses, " IEEE Trans. Robot. Autom. 3(2), 323-344 (1987).
25. H. Bay, T. Tuytelaars and L. V. Gool, "Speeded-up robust features (SURF), " Comput. Vis. Image Underst. 110(3), 346-359 (2008).
26. A. Alessandri, G. Bartolini, P. Pavanati, E. Punta and A. Vinci, "An Application of the Extended Kalman Filter for Integrated Navigation in Mobile Robotics, " Proceedings of the American Control Conference 1997, Albuquerque, NM, (Jun. 4-6, 1997) pp. 527-531.
27. J. Park, W. Hwang, H. Kwon, J. Kim, C. Lee, M. L. Anjum, K. Kim and D. Cho, "High Performance Vision Tracking System for Mobile Robot Using Sensor Data Fusion with Kalman Filter, " Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan (Oct. 18-22, 2010), pp. 3778-3783.
28. L. Ojeda, G. Reina, D. Cruz and J. Borenstein, "The FLEXnav precision dead-reckoning system, " Int. J. Veh. Auton. Syst. 4(2-4), 173-195 (2008).
29. D. Simon, Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches (John Wiley & Sons, Hoboken, NJ, 2006).
30. L.Armesto, J.Tornero andM.Vincze, "On multi-rate fusion for non-linear sampled-data systems: Application to a 6D tracking system, " Robot. Auton. Syst. 56(8), 706-715 (2008).
31. L. Ojeda, G. Reina and J. Borenstein, "Experimental Results from FLEXnav: An Expert Rule-Based Dead-Reckoning System for Mars Rovers, " Proceedings of the 2004 IEEE Aerospace Conference, Big Sky, MT, USA (Mar. 6-13, 2004) pp. 816-825.
32. A. I. Mourikis, S. I. Roumeliotis and J. W. Burdick, "SC-KF mobile robot localization: a stochastic cloning kalman filter for processing relative-state measurements, " IEEE Trans. Robot. 52(10), 1813-1825 (2007).
33. M. Seyr and S. Jakubek, "Proprioceptive Navigation, Slip Estimation and Slip Control for Autonomous Wheeled Mobile Robots, " Proceedings of the 2006 IEEE International Conference on Robotics, Automation and Mechatronics, Bangkok, Thailand (Jun. 7-9, 2006) pp. 1-6.