Dynamical information fusion of heterogeneous sensors for 3D tracking using particle swarm optimization

Information Fusion

Volumn 12, Issue 4, 2011, Pages 275-283

  Kirchmaier, Ulrich ^a   Hawe, Simon ^a   Diepold, Klaus ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Audiovisual fusion; Object tracking; Particle swarm optimization; Stereo vision

Indexed keywords

3-D SPACE; 3D TRACKING; ADAPTIVE MEAN SHIFTS; AUDIO AND VIDEO; AUDIO DATA; AUDIO-VISUAL FUSION; CAMSHIFT; CLASSICAL METHODS; DIMENSIONAL POSITION; DIRECT DETERMINATION; DIRECTIONAL INFORMATION; GENERALIZED CROSS CORRELATIONS; HETEROGENEOUS SENSORS; HETEROGENOUS SENSORS; OBJECT TRACKING; PARTICLE SWARM; STEREO AUDIO; THREE-DIMENSIONAL OBJECT; TRACKING PERFORMANCE; TRACKING SYSTEM; VIDEO DATA;

COMPUTATIONAL COMPLEXITY; IMAGE SEGMENTATION; INFORMATION FUSION; SENSORS; STEREO VISION; THREE DIMENSIONAL;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 79958224404     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2010.06.005     Document Type: Article

References (31)

1. A. Leykin, and R. Hammoud Pedestrian tracking by fusion of thermal-visible surveillance videos MVA Machine Visions and Applications Journal 2008 1 9
2. N. Poh, and J. Korczak Hybrid biometric person authentication using face and voice features Lecture Notes in Computer Science 2091 2001 348 353 (Pubitemid 33292028)
3. A. Christian, and B. Avery Digital smart kiosk project SIGCHI Conference on Human Factors in Computing Systems 1998 ACM Press/Addison-Wesley Publishing Co. Los Angeles, California, United States 155 162
4. M. Brandstein, and D. Ward Microphone Arrays, Signal Processing Techniques and Applications 2001 Springer-Verlag Chapter 2/10, pp. 203-222
5. N. Checka, K. Wilson, Person tracking using audio-video sensor fusion, in: Sow Procedings, Massachusetts Institute of Technologie Oxygen Research Group, 2002.
6. H. Asoh et al, An application of a particle filter to bayesian multiple sound source tracking with audio and video information fusion, in: Proceedings of the Seventh International Conference on Information Fusion, International Society of Information Fusion, Mountain View, CA, 2004, pp. 805-812.
7. D.N. Zotkin, R. Duraiswami, and L.S. Davis Joint audio-visual tracking using particle filters EURASIP Journal on Applied Signal Processing 2002 2002 1154 1164
8. M.J. Beal, N. Jojic, and H. Attias A graphical model for audiovisual object tracking IEEE Transactions on Pattern Analysis and Machine Intelligence 25 7 2003 828 836
9. X. Zou, B. Bhanu, Tracking humans using multi-modal fusion, in: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR'05 - Workshops, IEEE Computer Society, Washington, DC, USA, 2005, p. 4.
10. F. Asano Detection and separation of speech event using audio and video information fusion and its application to robust speech interface EURASIP Journal on Applied Signal Processing 2004 11 2004 1727 1738
11. A. Noulas, B. Kröse, Probabilistic audio visual sensor fusion for speaker detection, Tech. Rep., University of Amsterdam Intelligent Autonomous Systems, July 2006.
12. R.O. Schmidt Multiple emitter location and signal parameter estimation IEEE Transactions on Antennas and Propagation AP-34 3 1986 276 280
13. J. Fritsch, M. Kleinehagenbrock, S. Lang, G. Fink, and G. Sagerer Audiovisual person tracking with a mobile robot Proceedings of the International Conference on Intelligent Autonomous Systems 2004 IOS Press 898 906
14. G.R. Bradski Computer vision face tracking for use in a perceptual user interface Intel Technology Journal Q2 1998 15
15. F. Keyrouz, U. Kirchmaier, K. Diepold, Three dimensional object tracking based on audiovisual fusion using particle swarm optimization, in: VDE 11th International Conference on Information Fusion, 2008, pp. 611-615.
16. J. Kennedy, R. Eberhart, Particle swarm optimization, in: Proceedings of the 1995 IEEE International Conference on Neural Networks, Piscataway, NJ, 1995, pp. 1942-1948.
17. P. Saisan, S. Medasani, Y. Owechko, Multi-view classifier swarms for pedestrian detection and tracking, Computer Vision and Pattern Recognition Workshop 0 (2005) 18. doi: http://doi.ieeecomputersociety.org/10.1109/CVPR.2005. 499.
18. Y. Owechko, S. Medasani, Cognitive swarms for rapid detection of objects and associations in visual imagery, in: Proceedings of the 2005 IEEE Swarm Intelligence Symposium, SIS, 2005, pp. 420-423.
19. Y. Zheng, Y. Meng, Adaptive object tracking using particle swarm optimization, in: Proceedings of the 2007 IEEE International Symposium on Computational Intelligence in Robotics and Automation, Jacksonville, FL, USA, 2007, pp. 43-48. (Pubitemid 47515065)
20. H. Teutsch, Wavefield decomposition using microphone arrays and its application acoustic scene analysis, Ph.D. thesis, TU Erlangen, 2005.
21. C.H. Knapp, and G.C. Carter The generalized cross correlation method for estimation of time delay IEEE Transactions on Acoustics, Speech and Signal Processing 24 4 1976 320 327
22. V.C. Raykar, Csmc 660 project solutions optimization methods for sound source localization using microphone arrays, Tech. Rep., University of Maryland Institute For Advanced Computer Studies, December 2002.
23. R. Isermann Identifikation dynamischer Systeme 2 second ed. 1992 Springer-Verlag
24. K. Fukunaga, and L. Hostetler The estimation of the gradient of a density function, with applications in pattern recognition IEEE Transactions on Information Theory IT 21 1 1975 32 40
25. R. Belaroussi, M. Milgram, Face detection and skin color based tracking: a comparative study, in: Proceedings of the 2007 International Conference on Image Processing, Computer Vision and Pattern Recognition, IPCV, CSREA Press, 2007, pp. 506-512.
26. M.J. Swain, and D.H. Ballard Color indexing International Journal of Computer Vision 7 1 1991 1727 1738
27. R. Hartley, and A. Zisserman Multiple View Geometry in Computer Vision 2003 Cambridge University Press
28. R.E. Kalman A new approach to linear filtering and prediction problems Transactions of the ASME - Journal of Basic Engineering 82 1960 35 45
29. S. Hawe, U. Kirchmaier, K. Diepold, Mutant: a modular and generic tool for multi-sensor data processing, in: 12th International Conference on Information Fusion, Seattle, 2009.
30. Intel, Opencv computer vision library, 2006. intel.com/technology/ computing/opencv/index.htm.
31. F. Talantzis, A. Pnevmatikakis, L.C. Polymenakos, Real time audio-visual person tracking, in: IEEE 8th Workshop on Multimedia Signal Processing, 2006, pp. 243-247.