Robust face tracking control of a mobile robot using self-tuning Kalman filter and echo state network

Asian Journal of Control

Volumn 12, Issue 4, 2010, Pages 488-509

  Tsai, Chi Yi ^a   Dutoit, Xavier ^c   Song, Kai Tai ^b   van Brussel, Hendrik ^c   Nuttin, Marnix ^c  

^a TAMKANG UNIVERSITY   (Taiwan)

^b NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^c UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Echo state network; Face tracking; Illumination variation; Visual state estimation; Visual tracking control

Indexed keywords

3D MODELING; FACE RECOGNITION; KALMAN FILTERS; MACHINE DESIGN; MOBILE ROBOTS; NAVIGATION; STATE ESTIMATION; TRACKING (POSITION); UNCERTAINTY ANALYSIS;

COLORED OBSERVATION NOISE; ECHO STATE NETWORKS; EXTERNAL UNCERTAINTIES; FACE TRACKING; ILLUMINATION VARIATION; REAL-TIME FACE TRACKING; SELF-TUNING ALGORITHMS; VISUAL TRACKING CONTROL;

VISUAL SERVOING;

EID: 77955314175     PISSN: 15618625     EISSN: None     Source Type: Journal    
DOI: 10.1002/asjc.204     Document Type: Article

References (38)

1. Mraiottini, G. L., G. Oriolo, and D. Prattichizzo, "Image-based visual servoing for nonholonomic mobile robots using epipolar geometry," IEEE Trans. Robot., Vol. 23, No. 1, pp. 87-100 (2007).
2. Chen, J., W. E. Dixon, D. M. Dawson, and M. McIntyre, "Homography-based visual servo tracking control of a wheeled mobile robot," IEEE Trans. Robot., Vol. 22, No. 2, pp. 407-416 (2006).
3. Coulaud, J-B., G. Campion, G. Bastin, and M. D. Wan, "Stability analysis of a vision-based control design for an autonomous mobile robot," IEEE Trans. Robot., Vol. 22, No. 5, pp. 1062-1069 (2006).
4. Malis, E. and S. Benhimane, "A unified approach to visual tracking and servoing," J. Robot. Auton. Syst., Vol. 52, No. 1, pp. 39-52 (2005).
5. Freda, L. and G. Oriolo, "Vision-based interception of a moving target with a nonholonomic mobile robot," J. Robot. Auton. Syst., Vol. 55, No. 6, pp. 419-432(2007).
6. Han, Y and H. Hahn, "Visual tracking of a moving target using active contour based SSD algorithm," J. Robot. Auton. Syst., Vol. 53, No. 3-4, pp. 265-281 (2005).
7. Chou, Y.-T. and P. Bajcsy, "Toward face detection, pose estimation and human recognition from hyperspectral imagery," Automated Learning Group, National Center for Supercomputing Applications, Technical Report (2004).
8. Sobottka, K. and I. Pitas, "Face localization and feature extraction based on shape and color information," Proc. IEEE Int. Conf. Image Process., Lausanne, Switzerland, pp. 483-486 (1996).
9. Jang, G.-J. and I.-S. Kweon, "Robust object tracking using an adaptive color model," Proc. IEEE Int. Conf. Robot. Autom., Seoul, Korea, pp. 1677-1682(2001).
10. Stern, H. and B. Efros, "Adaptive color space switching for face tracking in multi-colored lighting environments," Proc. 5th IEEE Int. Conf. Auton. Face Gesture Recognit., Washington, DC, pp. 236-241 (2002).
11. Lee, Y-B., B.-J. You, and S.-W. Lee, "A realtime color-based object tracking robust to irregular illumination variation," Proc. IEEE Int. Conf. Robot. Autom., Seoul, Korea, pp. 1659-1664 (2001).
12. Yang, M.-H., D. J. Kriegman, and N. Ahuja, "Detecting faces in images: a survey," IEEE Trans. Pattern Anal. Mach. Intell, Vol. 24, No. 1, pp. 34-58 (2002).
13. Chaumette, F. and S. Hutchinson, "Visual servo control part I: basic approaches [tutorial]," IEEE Robot. Autom. Mag., Vol. 13, No. 4, pp. 82-90 (2006).
14. Chaumette, F. and S. Hutchinson, "Visual servo control part II: advanced approaches [tutorial]," IEEE Robot. Autom. Mag., Vol. 14, No. 1, pp. 109-118(2007).
15. Ma, Y., J. Košecká, and S. S. Sastry, "Vision guided navigation for a nonholonomic mobile robot," IEEE Trans. Robot. Autom., Vol. 15, No. 3, pp. 521-536 (1999).
16. Zhang, H. and J. P. Ostrowski, "Visual motion planning for mobile robots," IEEE Trans. Robot. Autom., Vol. 18, No. 2, pp. 199-208 (2002).
17. Fang, Y, W. E. Dixon, D. M. Dawson, and P. Chawda, "Homography-based visual servo regulation of mobile robots," IEEE Trans. Syst. Man Cybern. Part B-Cybern., Vol. 35, No. 5, pp. 1041-1049 (2005).
18. Xu, L.-Q. and D. C. Hogg, "Neural networks in human motion tracking - An experimental study," Image Vis. Comput., Vol. 15, No. 8, pp. 607-615 (1997).
19. Ghosh, B. K. and E. P. Loucks, "A perspective theory for motion and shape estimation in machine vision," SIAM J. Control Optim., Vol. 33, No. 5, pp. 1530-1559 (1995).
20. Ghosh, B. K., H. Inaba, and S. Takahashi, "Identification of Riccati dynamics under perspective and orthographic observations," IEEE Trans. Autom. Control, Vol. 45, No. 7, pp. 1267-1278(2000).
21. Chen, X. and H. Kano, "A new state observer for perspective systems," IEEE Trans. Autom. Control, Vol. 47, No. 4, pp. 658-663 (2002).
22. Dixon, W. E., Y Fang, D. M. Dawson, and T. J. Flynn, "Range identification for perspective vision systems," IEEE Trans. Autom. Control, Vol. 48, No. 12, pp. 2232-2238 (2003).
23. Chitrakaran, V., D. M. Dawson, W. E. Dixon, and J. Chen, "Identification of a moving object's velocity with a fixed camera," Automatica, Vol. 41, No. 3, pp. 553-562 (2005).
24. Tsai, C.-Y and K.-T. Song, "Dynamic visual tracking control of a mobile robot with image noise and occlusion robustness," Image Vis. Comput., Vol. 27, No. 8, pp. 1007-1022 (2009).
25. Tsai, C.-Y, K.-T. Song, X. Dutoit, H. Van Brussel, and M. Nuttin, "Robust mobile robot visual tracking control system using self-tuning Kalman filter," Proc. IEEE Int. Symp. Comp. Intell. Robot. Autom., Jacksonville, Florida, pp. 161-166 (2007).
26. Schutter, J. D., J. D. Geeter, T. Lefebvre, and H. Bruyninckx, "Kalman filters: a tutorial," Journal A, Vol. 40, No. 4, pp. 52-59 (1999).
27. Korniyenko, O. V., M. S. Sharawi, and D. N. Aloi, "Neural network based approach for tuning Kalman filter," Proc. IEEE Int. Conf. Electron. /Inf. Technol, Lincoln, Nebraska, pp. 1-5 (2005).
28. Xiong, S.-S. and Z.-Y. Zhou, "Neural filtering of colored noise based on Lalman Filter structure," IEEE Trans. Instrument. Measure, Vol. 52, No. 3, pp. 742-747 (2003).
29. Jaeger, H. "The 'Echo State' approach to analysing and training recurrent neural networks," German National Research Center for Information Technology, Technical Report (2001).
30. Gibson, J. D., B. Koo, and S. D. Gray, "Filtering of colored noise for speech enhancement and coding," IEEE Trans. Signal Process., Vol. 39, No. 8, pp. 1732-1742 (1991).
31. Tsai, C.-Y. and K.-T. Song, "Visual tracking control of a wheeled mobile robot with system model and velocity quantization robustness," IEEE Trans. Control Syst. Technol, Vol. 17, No. 3, pp. 520-527 (2009).
32. Jaeger, H., M. Lukoševičius, D. Popovici, and U. Siewert, "Optimization and applications of Echo state networks with leaky integrator neurons," Neural Netw., Vol. 20, No. 3, pp. 335-352 (2007).
33. Schrauwen, B., J. Defour, D. Verstraeten, and J. Van Campenhout, "The introduction of time scales in reservoir computing, applied to isolated digits recognition," Proc. Springer Int. Conf. Artif. Neural Netw., Part I- Lec. Notes Comput. Sci., Porto, Portugal, pp. 471-479 (2007).
34. Jaeger, H., "A tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the 'echo state network' approach," German National Research Center for Information Technology, Technical Report (2002).
35. Garcia, C. and G. Tziritas, "Face detection using quantized skin color regions merging and wavelet packet analysis," IEEE Trans. Multimedia, Vol. 1, No. 3, pp. 264-277 (1999).
36. Song, K.-T. and W.-J. Chen, "Face recognition and tracking for human-robot interaction," Proc. IEEE Int. Conf. Syst. Man Cybern., Hague, Netherlands, pp. 2877-2882 (2004).
37. Bradski, G. R. and S. Clara, "Computer vision face tracking for use in a perceptual user interface," Intell. Technol. J., Vol. 2, No. 2, pp. 1-15 (1998).
38. The experiment video website, http://isci.cn.nctu.edu.tw/video/RVTS_ESN/.