Tracking objects with generic calibrated sensors: An algorithm based on color and 3D shape features

Robotics and Autonomous Systems

Volumn 58, Issue 6, 2010, Pages 784-795

  Taiana, M ^a   Santos, J ^a   Gaspar, J ^a   Nascimento, J ^a   Bernardino, A ^a   Lima, P ^a  

^a INSTITUTO SUPERIOR TÉCNICO   (Portugal)

Author keywords

Omnidirectional vision; Particle filtering; Tracking

Indexed keywords

3-D SHAPE; 3D MOTION; 3D OBJECT; 3D RECONSTRUCTION; 3D TRACKING; COLOR DISTRIBUTION; COLOR SEGMENTATION; GROUND TRUTH; ILLUMINATION CHANGES; LARGE CLASS; MOTION BLUR; NON-LINEARITY; OBSERVATION MODEL; OMNI-DIRECTIONAL SENSORS; OMNI-DIRECTIONAL VISION; OPTICAL DISTORTION; PARTICLE FILTERING; PROJECTION MODELS; SELF MOTION; SHAPE BASED; SPECIAL POINTS; TRACKING APPLICATION; TRACKING OBJECTS; TRACKING SEQUENCE; VISION SENSORS;

COLOR; IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; NONLINEAR FILTERING; OPTICAL DATA PROCESSING; SENSORS; TRACKING (POSITION);

THREE DIMENSIONAL;

EID: 77953130992     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2010.02.010     Document Type: Article

References (34)

1. P. Lima, A. Bonarini, C. Machado, F. Marchese, F. Ribeiro, D. Sorrenti, Omni-directional catadioptric vision for soccer robots, 2001.
2. Gaspar J., Winters N., and Santos-Victor J. Vision-based navigation and environmental representations with an omnidirectional camera. IEEE Transactions on Robotics and Automation 16 6 (2000)
3. Boult T., Gao X., Michaels R., and Eckmann M. Omni-directional visual surveillance. Image and Vision Computing 22 7 (2004) 515-534
4. Kuniyoshi Y., Kita N., Rougeaux S., and Suehiro T. Active stereo vision system with foveated wide angle lenses. ACCV'95: Invited Session Papers (1996), Springer-Verlag, London, UK 191-200
5. Lepetit V., and Fua P. Monocular model-based 3d tracking of rigid objects: A survey. Foundations and Trends in Computer Graphics and Vision 1 1 (2005) 1-89
6. Doucet A., de Freitas N., and Gordon N. In: Gordon (Ed). Sequential Monte Carlo Methods in Practice (2001), Springer Verlag
7. Isard M., and Blake A. Condensation: conditional density propagation for visual tracking. International Journal of Computer Vision 28 1 (1998) 5-28
8. Wu Y. Robust visual tracking by integrating multiple cues based on co-inference learning. International Journal of Computer Vision 58 1 (2004) 55-71
9. Z. Khan, T. Balch, F. Dellaert, A rao - blackwellized particle filter for eigentracking, in: Proc. of Int. Conf. on Computer Vision and Pattern Recognition, CVPR'04, vol. 2, 2004, pp. 980-986.
10. Changjiang Yang, Ramani Duraiswami, Larry Davis, Fast multiple object tracking via a hierarchical particle filter, in: Proc. of Int. Conf. on Computer Vision and Pattern Recognition, CVPR'05, 2005, pp. 212-219.
11. Ya-Dong Wang, Jian-Kang Wu, Ashraf A. Kassim, Particle filter for visual tracking using multiple cameras, in: Proc. of IAPR Conf. on Machine Vision Applications, MVA'05, 2005, pp. 298-301.
12. K. Choo, D.J. Fleet, People tracking using hybrid monte carlo filtering, in: Proc. Int. Conf. on Computer Vision, ICCV'01, 2001 pp. 321-328.
13. G. Klein, D. Murray, Full-3d edge tracking with a particle filter, in: Proc. of BMVC 2006, Edinburgh, Scotland, 2006, pp. III:1119.
14. M. Pupilli, A. Calway, Real-time camera tracking using known 3d models and a particle filter, in: Proc. of ICPR (1), Hong Kong, 2006, pp. 199-203.
15. Osawa T., Wu X., Wakabayashi K., and Yasuno T. Human tracking by particle filtering using full 3d model of both target and environment. ICPR (2) (2006), IEEE Computer Society 25-28
16. Montesano L., Lopes M., Bernardino A., and Santos-Victor J. Learning object affordances: From sensory motor maps to imitation. IEEE Transactions on Robotics 24 1 (2008) 15-26
17. M. Taiana, J. Gaspar, J. Nascimento, A. Bernardino, P. Lima, 3D tracking by catadioptric vision based on particle filters, in: Proc. of the Robocup Symposium, Atlanta, 2007.
18. M. Tajana, J. Gaspar, J. Nascimento, A. Bernardino, P. Lima, On the use of perspective catadioptric sensors for 3d model-based tracking with particle filters, in: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, 2007 pp. 2747-2752.
19. M. Taiana, J. Nascimento, J. Gaspar, A. Bernardino, Sample-based 3D tracking of colored objects: a flexible architecture, in: Proc. of BMVC 2008, Leeds, 2008.
20. M. Taiana, J. Santos, J. Gaspar, J. Nascimento, A. Bernardino, P. Lima, Color 3D model-based tracking with arbitrary projection models, in: Workshop Proceedings of SIMPAR 2008: Omnidirectional Robot Vision, Venice, Italy, 2008, pp. 206-217.
21. H. Bakstein, T. Pajdla, Panoramic mosaicing with a 180 deg field of view lens, in: IEEE Workshop on Omnidirectional Vision, 2002, pp. 60-67.
22. Micusik B., and Pajdla T. Estimation of omnidirectional camera model from epipolar geometry. IEEE CVPR (2003) 485-490
23. Hicks R., and Bajcsy R. Catadioptric sensors that approximate wide-angle perspective projections. IEEE CVPR (2000) 545-551
24. J. Gaspar, C. Deccó, Jun Okamoto Jr, J. Santos-Victor, Constant resolution omnidirectional cameras, in: IEEE Workshop on Omni-directional Vision, 2002 pp. 27-34.
25. Geyer C., and Daniilidis K. A unifying theory for central panoramic systems and practical applications. IEEE CVPR (2000) 445-461
26. Baker S., and Nayar S.K. A theory of single-viewpoint catadioptric image formation. International Journal of Computer Vision 35 2 (1999) 175-196
27. Benosman R., and Kang S. Panoramic Vision (2001), Springer Verlag
28. Barrera P., Cañas J.M., and Matellán V. Visual object tracking in 3d with color based particle filter. Proc. of World Academy of Science, Eng. and Tech., vol. 4 (2005)
29. Pérez P., Vermaak J., and Blake A. Data fusion for visual tracking with particles. Proceedings of the IEEE 92 3 (2004) 495-513
30. Comaniciu D., Ramesh V., and Meer P. Real-time tracking of non-rigid objects using mean shift. Proc. Conf. on Comp. Vision Pattern Rec., vol. 2 (2000) 142-149
31. K. Okuma, A. Taleghani, N. de Freitas, J.J. Little, D.G. Lowe, A boosted particle filter: multitarget detection and tracking, in: Proc. ECCV, 2004, pp. 28-39.
32. Nascimento J., and Marques J.S. Robust shape tracking with multiple models in ultrasound images. IEEE Transactions on Image Processing 17 3 (2008) 392-406
33. H. Costelha, N. Ramos, J. Estilita, J. Santos, M. Taiana, J. Torres, T. Antunes, P. Lima, Isocrob 2007 team description paper, Technical Report, Instituto Superior Técnico, 2007.
34. J. Messias, J. Santos, J. Estilita, P. Lima, Monte Carlo localization based on gyrodometry and line-detection, in: ROBOTICA2008, 8th Conference on Mobile Robots and Competitions, 2008.