Sensor fusion-based visual target tracking for autonomous vehicles with the out-of-sequence measurements solution

Robotics and Autonomous Systems

Volumn 56, Issue 2, 2008, Pages 157-176

  Jia, Zhen ^a   Balasuriya, Arjuna ^a   Challa, Subhash ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Autonomous vehicles; Extended Kalman Filtering; Image segmentation and clustering; Optical flow; Out of sequence measurements (OOSM); Sensor data fusion; Stereo vision; Target tracking

Indexed keywords

ALGORITHMS; EXTENDED KALMAN FILTERS; OPTICAL FLOWS; POSITION MEASUREMENT; SENSOR DATA FUSION; STATE ESTIMATION; STEREO VISION; UNMANNED VEHICLES;

AUTONOMOUS VEHICLES; OUT-OF-SEQUENCE MEASUREMENTS (OOSM); STEREO CAMERAS;

TARGET TRACKING;

EID: 38649114389     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2007.05.014     Document Type: Article

References (31)

1. Bar-Shalom Y. Update with out-of-sequence measurements in tracking: Exact solution. IEEE Transactions on Aerospace and Electronic Systems 38 3 (2002) 769-777
2. Bar-Shalom Y., Chen H., and Mallick M. One-step solution for the multistep out-of-sequence-measurement problem in tracking. IEEE Transactions on Aerospace and Electronic Systems 40 1 (2004) 27-37
3. Bar-Shalom Y., Li X.R., and Kirubarajan T. Estimation with Applications to Tracking and Navigation (2001), Wiley, New York, USA
4. Barron J.L., Fleet D.J., and Beauchemin S.S. Performance of optical flow techniques. International Journal of Computer Vision 12 1 (1994) 43-77
5. Brox T., Bruhn A., Papenberg N., and Weickert J. High accuracy optical flow estimation based on a theory for warping. Proceedings of 8th European Conference on Computer Vision. Lecture Notes in Computer Science vol. 3024 (2004), Springer, Prague, Czech Republic 25-36
6. Challa S., Evans R.J., and Wang X. A bayesian solution and its approximations to out-of-sequence measurement problem. Journal of Information Fusion 4 (2003) 185-199
7. Chang J.Y., Hu W.F., Cheng M.H., and Chang B.S. Digital image translational and rotational motion stabilization using optical flow technique. IEEE Transactions on Consumer Electronics 48 1 (2002) 108-115
8. D. Cremers, A variational framework for image segmentation combining motion estimation and shape regularization, in: Proceedings of 2003 IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, Madison, Wisconsin, USA, June 2003, pp. 53-58
9. T. Dang, C. Hoffmann, C. Stiller, Fusing optical flow and stereo disparity for object tracking, in: Proceedings of the 5th IEEE International Conference on Intelligent Transportation Systems, 2002 pp. 112-117
10. DeSouza G.N., and Kak A.C. Vision for mobile robot navigation: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 2 (2002) 237-267
11. Fang Y., Masaki I., and Horn B. Depth-based target segmentation for intelligent vehicles: Fusion of radar and binocular stereo. IEEE Transactions on Intelligent Transportation Systems 3 September (2002) 196-202
12. G. Farneback, Very high accuracy velocity estimation using orientation tensors, parametric motion, and simultaneous segmentation of the motion field, in: Proceedings of the Eighth IEEE International Conference on Computer Vision, vol. I, July 2001 pp. 171-177
13. Forsyth D.A., and Ponce J. Computer Vision: A Modern Approach (2002), Prentice Hall, USA
14. Horn B.K.P. Robot Vision (1986), MIT Press, USA
15. Hu W., Tan T., Wang L., and Maybank S. A survey on visual surveillance of object motion and behaviors. IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews 34 3 (2004) 334-352
16. Zhen Jia, A. Balasuriya, S. Challa, Motion based 3d target tracking with interacting multiple linear dynamic models, in: Proceedings of the 15th British Machine Vision Conference, United Kindom, September 2004
17. Zhen Jia, A. Balasuriya, S. Challa, Visual information and camera motion fusion for 3d target tracking, in: Proceedings of the Eighth International Conference on Control, Automation, Robotics and Vision, Kunming, China, December 2004, pp. 2296-2301
18. Zhen Jia, A. Balasuriya, S. Challa, Sensor fusion based 3d target visual tracking for autonomous vehicles with imm, in: Proceedings of 2005 IEEE International Conference on Robotics and Automation, ICRA 2005 Barcelona, Spain, April 2005, pp. 1841-1846
19. A. Kosaka, M. Meng, A.C. Kak, Vision-guided mobile robot navigation using retroactive updating of position uncertainty, in: Proceedings of 1993 IEEE International Conference on Robotics and Automation, vol. 2, May 1993, pp. 1-7
20. Matthews I., Ishikawaa T., and Baker S. The template update problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 6 (2004) 810-815
21. Morioka K., Lee J.H., and Hashimoto H. Human-following mobile robot in a distributed intelligent sensor network. IEEE Transactions on Industrial Electronics 51 1 (2004) 229-237
22. K. Muhlmann, D. Maier, R. Hesser, R. Manner, Calculating dense disparity maps from color stereo images, an efficient implementation, in: Proceedings of the IEEE Workshop on Stereo and Multi-Baseline Vision, December 2001, pp. 30-36
23. S. Nadimi, B. Bhanu, Multistrategy fusion using mixture model for moving object detection, in: Proceedings of International Conference on Multisensor Fusion and Integration for Intelligent Systems, August 2001, pp. 317-322
24. R. Okada, Y. Shirai, J. Miura, Tracking a person with 3-d motion by integrating optical flow and depth, in: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, March 2000, pp. 336-341
25. Peterfreund N. Robust tracking of position and velocity with kalman snakes. IEEE Transactions on Pattern Analysis and Machine Intelligence 21 6 (1999) 564-569
26. S. Ray, R.H. Turi, Determination of number of clusters in k-means clustering and application in colour image segmentation, in: Proceedings of the 4th International Conference on Advances in Pattern Recognition and Digital Techniques, ICAPRDT'99, New Delhi, India, 1999, pp. 137-143
27. M. Ridley, E. Nettleton, S. Sukkarieh, H. Durrant-Whyte, Tracking in decentralised air-ground sensing networks, in: Proceedings of the Fifth International Conference on Information Fusion, vol. 1, July 2002, pp. 616-623
28. Wang H., Kirubarajan T., Li Y., and Bar-shalom Y. Precision large scale air traffic surveillance using imm/assignment estimators. IEEE Transactions on Aerospace and Electronic Systems 35 1 (1999) 255-266
29. Wettergreen D., Gaskett C., and Zelinsky A. Development of a visually-guided autonomous underwater vehicle. Proceedings of Conference on OCEANS vol. 2 (1998) 1200-1204
30. Yamane T., Shirai Y., and Miura J. Person tracking by integrating optical flow and uniform brightness regions. Proceedings of IEEE International Conference on Robotics and Automation vol. 4 (1998) 3267-3272
31. Yang F., and Balasuriya A. Optical flow based speed estimation in auv target tracking. Proceedings of MTS/IEEE Conference and Exhibition on OCEANS vol. 4 (2001) 2377-2382