Evaluating integrated speech- and image understanding

Proceedings - 4th IEEE International Conference on Multimodal Interfaces, ICMI 2002

Volumn , Issue , 2002, Pages 9-14

  Bauckhage, C ^a   Fritsch, J ^a   Rohifing, K J ^a   Wachsmuth, S ^a   Sagerer, G ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN COMPUTER INTERACTION; IMAGE UNDERSTANDING; INTERACTIVE COMPUTER SYSTEMS; SPEECH PROCESSING;

AUTOMATIC SPEECH PROCESSING; HUMAN MACHINE INTERACTION; INTELLIGENT INTERFACE; INTERACTIVE SYSTEM; MULTI-MODAL INTERACTIONS; PERFORMANCE ASSESSMENT; TIME SCALE ANALYSIS; USABILITY STUDIES;

IMAGE PROCESSING;

EID: 5044228200     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMI.2002.1166961     Document Type: Conference Paper

References (24)

1. www.service-robots.org.
2. P. McKevitt, editor. Integration of natural language and vision processing. Kluver Academic Press, Dordrecht, 1994.
3. G. Sagerer and S. Wachsmuth, editors. Intergration of Speech and Image Understanding. IEEE Computer Society, 1999.
4. S. Wachsmuth, G. A. Fink, and G. Sagerer. Integration of parsing and incremental speech recognition. In Proc. EUSIPCO., volume 1, pages 371-375, 1998.
5. S. Kronenberg and F. Kummert. Soft unification: Towards robust parsing of spontanous speech. In Int. Conf. on Artificial Intelligence and Soft Computing, pages 381-385, 1999.
6. F. Kummert, G.A. Fink, G. Sagerer, and E. Braun. Hybrid Object Recognition in Image Sequences. In Proc. ICPR, volume II, pages 1165-1170, 1998.
7. C. Bauckhage, S. Kronenberg, F. Kummert, and G. Sagerer. Grammars and Discourse Theory to Describe and Recognize Mechanical Assemblies. In Lecture Notes in Computer Science 1876, pages 173-182. Springer, 2000.
8. C. Bauckhage, J. Fritsch, F. Kummert, and G. Sagerer. Towards a Vision System for Supervising Assembly Processes. In Proc. Symp. on Intelligent Robotic Systems, pages 89-98, 1999.
9. H. Brandt-Pook, G. A. Fink, S. Wachsmuth, and G. Sagerer. Integrated recognition and interpretaion of speech for a construction task domain. In Proc. Int. Conf. on Human-Computer Interaction, volume 1, pages 550-554, 1999.
10. C. Bauckhage, G.A. Fink, J. Fritsch, F. Kummert, F. Lömker, G. Sagerer, and S. Wachsmuth. An Integrated System for Cooperative Man-Machine Interaction. In Proc. IEEE Int. Symp. on Computational Intelligence in Robotics and Automation, 2001.
11. T. Takahashi, S. Nakanishi, Y. Kuno, and Y. Shirai. Helping Computer Vision by Verbal and Nonverbal Communication. In Proc. ICPR, pages 1216-1218, 1998.
12. T. Brondsted, L. B. Larsen, M. Manthey, P. McKevitt, T. Moeslund, and K. G. Olesen. The Intellimedia Workbench - a Generic Environment for Multimodal Systems. In Proc ICSLP, pages 273-276, 1998.
13. J. Pearl. Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann, San Francisco, 1988.
14. S. Wachsmuth and G. Sagerer. Bayesian Networks for Speech and Image Integration. In Proc. AAAI, 2002. to appear.
15. G. Socher, G. Sagerer, and P. Perona. Bayesian reasoning on qualitative descriptions from images and speech. Image and Vision Computing, 18:155-172, 2000.
16. S. Wachsmuth and G. Sagerer. Integrated Analysis of Speech and Images as a Probabilistic Decoding Process. In Proc. ICPR, 2002. to appear.
17. A. Waibel, B. Suhm, M.T. Vo, and J. Yang. Multimodal interfaces for multimedia information agents. In Proc. ICASSP, volume I, pages 167-170, 1997.
18. S. Oviatt and R. VanGent. Error resolution during multimodal human-computer interaction. In Proc ICSLP, volume I, pages 204-207, 1996.
19. G. Lindegaard. Usability Testing and System Evaluation. Chapman & Hall, London, 1994.
20. C.-P. Tung and A.C. Kak. Integrating Sensing, Task Planning and Execution for Robotic Assembly. IEEE Trans. on Robotics and Automation, 12(2):187-201, 1996.
21. H.-J. Park, B.K. Kim, and K.Y. Lim. Measuring the Machine Intelligence Quotient (MIQ) of Human-Machine Cooperative Systems. IEEE Trans. on Systems, Man, and Cybernetics, 31(2):89-96, 2001.
22. J. Preece, Y. Rogers, and H.C. Sharp. Beyond human-computer interaction. Wiley & Sons, Chichester, 2002.
23. G. A. Fink. Developing HMM-based recognizers with ESMERALDA. In V. Matoušek, P. Mautner, J. Ocelíková, and P. Sojka, editors, Lecture Notes in Artificial Intelligence, volume 1692, pages 229-234. Springer, 1999.
24. G. Sagerer and H. Niemann. Semantic Networks for Understanding Scenes. Plenum, New York, 1997.