Adaptive multi-modal stereo people tracking without background modelling

Journal of Visual Communication and Image Representation

Volumn 19, Issue 2, 2008, Pages 75-91

  Muñoz Salinas, Rafael ^a   García Silvente, Miguel ^b   Medina Carnicer, Rafael ^a  

^a UNIVERSITY OF CÓRDOBA   (Spain)

^b UNIVERSITY OF GRANADA   (Spain)

Author keywords

Colour processing; Confidence measure; Particle filtering; People tracking; Real time imaging; Stereo vision

Indexed keywords

ALGORITHMS; IMAGING SYSTEMS; MODEL CHECKING; REAL TIME SYSTEMS; STEREO VISION; THREE DIMENSIONAL;

COLOUR PROCESSING; CONFIDENCE MEASURES; PARTICLE FILTERING; PEOPLE TRACKING; REAL-TIME IMAGING;

OBJECT RECOGNITION;

EID: 37349033159     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2007.07.004     Document Type: Article

References (63)

1. Aherne F., Thacker N., and Rockett P. The Bhattacharyya metric as an absolute similarity measure for frequency coded data. Kybernetica 32 (1997) 1-7
2. Argyrs A.A., and Lourakis M.I. Three-dimensional tracking of multiple skin-colored regions by a moving stereoscopic system. Applied Optics 43 (2004) 366-378
3. Bar-Shalom Y., and Fortmann T.E. Tracking and Data Association (1988), Academic Press, New York
4. A.M. Baumberg, D.C. Hogg, An efficient method for contour tracking using active shape models, in: IEEE Workshop on Motion of Non-Rigid and Articulated Objects, 1994, pp. 194-199.
5. D. Beymer, K. Konolige, Real-time tracking of multiple people using continuous detection, in: Proceedings of International Conference on Computer Vision, 1999.
6. S. Birchfield, Elliptical head tracking using intensity gradients and color histograms, in: IEEE Conference on Computer Vision and Pattern Recognition, 1998, pp. 232-237.
7. Blake A., Curwen R., and Zisserman A. A framework for spatiotemporal control in the tracking of visual contours. International Journal of Computer Vision 11 (1993) 127-145
8. Böhme H.-J., Wilhelm T., Key J., Schauer C., Schröter C., Gross H.-M., and Hempel T. An approach to multi-modal human-machine interaction for intelligent service robots. Robotics and Autonomous Systems 44 (2003) 83-96
9. Brown M.Z., Burschka D., and Hager G.D. Advances in computational stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 (2003) 993-1008
10. Hue C., Cadre J.L., and Perez P. Sequential Monte Carlo methods for multiple target tracking and data fusion. IEEE Transaction on Signal Processing 50 (2002) 309-325
11. Cipolla R., and Yamamoto M. Stereoscopic tracking of bodies in motion. Image and Vision Computing 8 (1990) 85-90
12. Colombo C., Bimbo AD., and Valli A. Visual capture and understanding of hand pointing actions in a 3-D environment. IEEE Transactions On Systems, Man and Cybernetics-Part B 33 (2003) 677-686
13. D. Comaniciu, V. Ramesh, P. Meer, Real-time tracking of non-rigid objects using mean shift, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 2000, pp. 142-149.
14. T. Darrell, D. Demirdjian, N. Checka, P. Felzenszwalb, Plan-view trajectory estimation with dense stereo background models, in: Eighth IEEE International Conference on Computer Vision (ICCV 2001), vol. 2, 2001, pp. 628-635.
15. Darrell T., Gordon G., Harville M., and Woodfill J. Integrated person tracking using stereo, color, and pattern detection. International Journal of Computer Vision 37 (2000) 175-185
16. W. Du, J. Piater, Tracking by cluster analysis of feature points and multiple particle filters, in: IEEE Conference on Advanced Video and Signal Based Surveillance, 2005, pp. 165-170.
17. J.-O. Eklundh, P. Nordlund, T. Uhlin, Issues in active vision: attention and cue integration/selection, in: British Machine Vision Conference, 1996, pp. 1-12.
18. Foley J.D., and van Dam A. Fundamentals of Interactive Computer Graphics (1982), Addison Wesley, Reading, MA
19. D. Franklin, R.E. Kahn, M.J. Swain, R.J. Firby. Happy patrons make better tippers: creating a robot waiter using Perseus and the animate agent architecture, in: International Conference of Automatic Face and Gesture Recognition, 1996, pp. 14-16.
20. Fritsch J., Kleinehagenbrock M., Lang S., Plötz T., Fink G.A., and Sagerer G. Multi-modal anchoring for human-robot interaction. Robotics and Autonomous Systems 43 (2003) 133-147
21. S.S. Ghidary, Y. Nakata, T. Takamori, M. Hattori. Human detection and localization at indoor environment by home robot, in: IEEE International Conference on Systems, Man, and Cybernetics, vol. 2, 2000, pp. 1360-1365.
22. Gordon N., and Salmand D. Bayesian state estimation for tracking and guidance using the bootstrap filter. Journal of Guidance, Control and Dynamics 18 (1995) 1434-1443
23. D. Grest, R. Koch, Realtime multi-camera person tracking for immersive environments, in: IEEE Sixth Workshop on Multimedia Signal Processing, 2004, pp. 387-390.
24. I. Haritaoglu, D. Beymer, M. Flickner, Ghost 3D: detecting body posture and parts using stereo, in: Workshop on Motion and Video Computing, 2002, pp. 175-180.
25. Harville M. Stereo person tracking with adaptive plan-view templates of height and occupancy statistics. Image and Vision Computing 2 (2004) 127-142
26. M. Harville, Li Dalong, Fast integrated person tracking and activity recognition with plan-view templates from a single stereo camera, in: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004, pp. 398-405.
27. K. Hayashi, M. Hashimoto, K. Sumi, K. Sasakawa. Multiple-person tracker with a fixed slanting stereo camera. In Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004, pp. 681-686.
28. N. Hirai, H. Mizoguchi, Visual tracking of human back and shoulder for person following robot, in: IEEE/ASME International Conference on Advanced Intelligent Mechatronics, vol. 1, 2003, pp. 527-532.
29. M. Isard, A. Blake, Countour tracking by stochastic propagation of conditional density, in: European Conference on Computer Vision, 1996, pp. 343-356.
30. Isard M., and Blake A. CONDENSATION-conditional density propagation for visual tracking. International Journal of Computer Vision 29 (1998) 5-28
31. R.E. Kahn, M.J. Swain, P.N. Prokopowicz, R.J. Firby, Gesture recognition using the Perseus architecture, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '96), 1996, pp. 734-741.
32. Kailath T. The divergence and Bhattacharyya distance measures in signal selection. IEEE Transactions on Communication Technology 15 (1967) 52-60
33. Khan Z., Balch T., and Dellaert F. MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 (2005) 1805-1819
34. Kitagawa G. Monte Carlo filter and smoother for non-gaussian nonlinear state space models. Journal of Computational and Graphical Statistics 5 (1996) 1-25
35. B. Kwolek, Color vision based person following with a mobile robot, in: Third International Workshop on Robot Motion and Control, vol. 1, 2002, pp. 375- 380.
36. R. Lienhart, J. Maydt, An extended set of haar-like features for rapid object detection, in: IEEE Conference on Image Processing, 2002, pp. 900-903.
37. Malis E., Chaumette F., and Boudet S. 2 1/2d visual servoing. IEEE Transactions on Robotics and Automation 15 2 (1999) 238-250
38. B. Martinkauppi, M. Soriano, M. Pietikainen, Detection of skin color under changing illumination: a comparative study, in: Twelvth International Conference on Image Analysis and Processing, 2003, pp. 652-657.
39. B. Menser, M. Brunig, Face detection and tracking for video coding applications, in: Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers, 2000, pp. 49-53.
40. Mohan R., Medioni G., and Nevatia R. Stereo error detection, correction, and evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence 11 (1989) 113-120
41. F. Moreno, A. Tarrida, J. Andrade-Cetto, A. Sanfeliu, 3D real-time head tracking fusing color histograms and stereovision, in: International Conference on Pattern Recognition, 2002, pp. 368- 371.
42. Muñoz Salinas R., Aguirre E., and García-Silvente M. People detection and tracking using stereo vision and color. Image and Vision Computing 25 6 (2007) 995-1007
43. R. Muñoz Salinas, E. Aguirre, M. García-Silvente, A. González, A fuzzy system for visual detection of interest in human-robot interaction, in: Second International Conference on Machine Intelligence (ACIDCA-ICMI'2005), 2005, pp. 574-581.
44. Muñoz Salinas R., Aguirre E., García-Silvente M., and González A. People detection and tracking through stereo vision for human-robot interaction. Lectures Notes on Artificial Intelligence 3789 (2005) 337-346
45. Nummiaro K., Koller-Meier E., and Van Gool L. An adaptive color-based particle filter. Image and Vision Computing 21 (2003) 99-110
46. Okuma K., Taleghani A., De Freitas D., Little J.J., and Lowe D.G. A boosted particle filter: multi target detection and tracking. Lectures Notes in Computer Science 3021 (2004) 28-39
47. Intel, OpenCV: Open source Computer Vision library, .
48. R. Patil, P.E. Rybski, T. Kanade, M.M. Veloso, People detection and tracking in high resolution panoramic video mosaic, in: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2004), 2004, pp. 1323-1328.
49. Reid D. An algorithm for tracking multiple targets. IEEE Transaction on Automation and Control 24 (1979) 84-90
50. Rodriguez J.J., and Aggarwal J.K. Stochastic analysis of stereo quantization error. IEEE Transactions on Pattern Analysis and Machine Intelligence 12 (1990) 467-470
51. H. Saito, K. Ishimura, M. Hattori, T. Takamori, Multi-modal human robot interaction for map generation, in: 41st SICE Annual Conference (SICE 2002), vol. 5, 2002, pp. 2721- 2724.
52. C. Schlegel, J. Illmann, H. Jaberg, M. Schuster, R. Wörz, Vision based person tracking with a mobile robot, in: Ninth British Machine Vision Conference (BMVC '98), vol. 1, 1998, pp. 418-427.
53. L.G. Shapiro, Object and concept recognition for content-based image retrieval. .
54. H. Sidenbladh, D. Kragic, H.I. Christensen, A person following behaviour for a mobile robot, in: IEEE International Conference on Robotics and Automation, vol. 1, 1999, pp. 670-675.
55. Sigal L., Sclaroff S., and Athitsos V. Skin color-based video segmentation under time-varying illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 (2004) 862-877
56. Snidaro L., Micheloni C., and Chiavedale C. Video security for ambient intelligence. IEEE Transactions on Systems, Man and Cybernetics, Part A 35 (2005) 133-144
57. J. Vermaak, A. Doucet, P. Perez, Maintaining multimodality through mixture tracking, in: Ninth IEEE International Conference on Computer Vision, 2003, pp. 1110-1116.
58. Vermaak J., Godsill S.J., and Perez P. Monte Carlo filtering for multi-target tracking and data association. IEEE Transactions on Aerospace and Electronic Systems 41 (2005) 309-332
59. W.E. Vieux, K. Schwerdt, J.L. Crowley. Face-tracking and coding for video compression, in: International Conference on Computer Vision Systems, 1999, pp. 151-160.
60. P. Viola, M. Jones, Rapid object detection using a boosted cascade of simple features, in: IEEE Conference on Computer Vision and Pattern Recognition, 2001, pp. 511-518.
61. Wilhelm T., Bḧome H.J., and Gross H.M. A multi-modal system for tracking and analyzing faces on a mobile robot. Robotics and Autonomous Systems 48 (2004) 31-40
62. Wren C.R., Azarbayejani A., Darrell T., and Pentland A.P. Pfinder: real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 (1997) 780-785
63. Zhao L., and Thorpe C.E. Stereo- and neural network-based pedestrian detection. IEEE Transactions on Intelligent Transportation Systems 1 3 (2000) 148-154