Probabilistic integration of sparse audio-visual cues for identity tracking

MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops

Volumn , Issue , 2008, Pages 151-158

  Bernardin, Keni ^a   Stiefelhagen, Rainer ^a   Waibel, Alex ^a  

^a UNIVERSITY OF KARLSRUHE   (Germany)

Author keywords

Human perception; Modality fusion; Sensor fusion; Smart environments

Indexed keywords

AUDIO-VISUAL; AUDIO-VISUAL CORPORA; AUDIO-VISUAL SENSORS; HUMAN PERCEPTION; INTELLIGENT SERVICES; KEY FACTORS; MODALITY FUSION; MULTIPLE USER; NOVEL TECHNIQUES; PROBABILISTIC INTEGRATION; PROBABILISTIC MODELS; SENSOR FUSION; SMART ENVIRONMENT; SMART ENVIRONMENTS; SMART ROOMS; USER COOPERATION;

CAMERAS; IMAGE RETRIEVAL; METHOD OF MOMENTS; MULTIMEDIA SYSTEMS; SENSORS;

POSITIVE IONS;

EID: 70350645426     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1459359.1459380     Document Type: Conference Paper

References (24)

1. I. McCowan, D. Gatica-Perez, S. Bengio, G. Lathoud, M. Barnard, D. Zhang, "Automatic Analysis of Multimodal Group Actions in Meetings". IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, No. 3, pp. 305-317, March, 2005.
2. R. Stiefelhagen, "Tracking Focus of Attention in Meetings". IEEE Int. Conf. on Multimodal Interfaces - ICMI 2002, Pittsburgh, 2002.
3. T. Choudhury, B. Clarkson, T. Jebara and A. Pentland, "Multimodal Person Recognition using Unconstrained Audio and Video". Second Conference on Audio- and Video-based Biometric Person Authentication '99 (AVBPA '99), pp. 176-181, Washington DC
4. J. Yang, X. Zhu, R. Gross, J. Kominek, Y. Pan, A. Waibel, "Multimodal people ID for a multimedia meeting browser". Proceedings of the 7th ACM International Conference on Multimedia '99, Orlando, FL
5. A. Hampapur, S. Pankanti, A. W. Senior, Y.-L. Tian, L. Brown, R. M. Bolle, "Face Cataloger: Multi-Scale Imaging for Relating Identity to Location". IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS 2003), July 2003, Miami, FL.
6. S. Stillman, R. Tanawongsuwan, and I. Essa, "A system for tracking and recognizing multiple people with multiple cameras". Technical Report GIT-GVU-98-25, Georgia Inst. of Tech., Graphics, Visualization, and Usability Center, 1998.
7. S. Stillman and I. Essa, "Towards reliable multimodal sensing in aware environments" Perceptual User Interfaces (PUI) Workshop, 2001.
8. M. Trivedi, I. Mikic and S. Bhonsle, "Active Camera Networks and Semantic Event Databases for Intelligent Environments". IEEE Workshop on Human Modeling, Analysis and Synthesis, June 2000.
9. Dimitrios Makris, Tim Ellis, James Black, "Bridging the Gaps between Cameras". IEEE Conference on Computer Vision and Pattern Recognition (CVPR'04) - Vol. 2, 2004
10. W. Zajdel, B. J. A. Kröse, "A sequential Bayesian algorithm for surveillance with nonoverlapping cameras". IJPRAI, Vol. 19, No. 8, Dec 2005
11. T. Gehrig, K. Nickel, H. K. Ekenel, U. Klee, and J. McDonough, "Kalman Filters for Audio-Video Source Localization". IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, October. 2005.
12. H. K. Ekenel, R. Stiefelhagen, "Local Appearance based Face Recognition Using Discrete Cosine Transform". 13th European Signal Processing Conference (EUSIPCO), Antalya Turkey, September 2005.
13. H. K. Ekenel, R. Stiefelhagen, "A Generic Face Representation Approach for Local Appearance based Face Verification". CVPR IEEE Workshop on Face Recognition Grand Challenge Experiments, San Diego, CA, USA, June 2005.
14. H. K. Ekenel, Q. Jin, "ISL Person Identification Systems in the CLEAR Evaluations". Proceedings of the first International CLEAR evaluation workshop, Southampton, UK, April 2006.
15. K. Bernardin, A. Elbs, R. Stiefelhagen, "Multiple Object Tracking Performance Metrics and Evaluation in a Smart Room Environment". 6th IEEE Int. Workshop on Visual Surveillance, VS 2006, Graz, Austria, May 2006
16. K. Bernardin and R. Stiefelhagen, "Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics". EURASIP Journal on Image and Video Processing, Special Issue on Video Tracking in Complex Scenes for Surveillance Applications, Vol. 2008, Article ID 246309, May 2008
17. K. Bernardin and R. Stiefelhagen, "Audio-Visual Multi-Person Tracking and Identi cation for Smart Environments". ACM Multimedia 2007, Augsburg, Germany, September 2007
18. K. Bernardin, T. Gehrig, R. Stiefelhagen, "Multi-Level Particle Filter Fusion of Features and Cues for Audio-Visual Person Tracking". Multimodal Technologies for Perception of Humans, Joint Proceedings of the CLEAR 2007 and RT 2007 Evaluation Workshops, May 2007, Baltimore, MD, USA, Springer LNCS 4625, 2008
19. R. Stiefelhagen, K. Bernardin, R. Bowers, T. Rose, M. Michel and J. Garofolo, "The CLEAR 2007 Evaluation". Multimodal Technologies for Perception of Humans, Joint Proceedings of the CLEAR 2007 and RT 2007 Evaluation Workshops, May 2007, Baltimore, MD, USA, Springer LNCS 4625, 2008
20. D. Mostefa, N. Moreau, K. Choukri, G. Potamianos, S. M. Chu, A. Tyagi, J. R. Casas, J. Turmo, L. Christoforetti, F. Tobia, A. Pnevmatikakis, V. Mylonakis, F. Talantzis, S. Burger, R. Stiefelhagen, K. Bernardin, and C. Rochet, "The CHIL Audiovisual Corpus for Lecture and Meeting Analysis Inside Smart Rooms". In Language Resources and Evaluation, No. 41, Springer, 2007.
21. Rainer Stiefelhagen, Jonathan Fiscus and Rachel Bowers, "Multimodal Technologies for Perception of Humans, Joint Proceedings of the CLEAR 2007 and RT 2007 Evaluation Workshops". Springer Lecture Notes in Computer Science, No. 4625, 2008.
22. J. Munkres, "Algorithms for the Assignment and Transportation Problems". Journal of the Society of Industrial and Applied Mathematics, Vol. 5(1), pp. 32-38, March 1957.
23. T. Kailath, "The Divergence and Bhattacharyya Distance Measures in Signal Selection". IEEE Trans. on Comm. Technology, Vol. 15, pp. 52{60, Feb. 1967
24. CLEAR - Classification of Events, Activities and Relationships, http://www.clear-evaluation.org/