Combining speech and haptics for intuitive and efficient navigation through image databases

ICMI'03: Fifth International Conference on Multimodal Interfaces

Volumn , Issue , 2003, Pages 180-187

  Käster, Thomas ^a   Pfeiffer, Michael ^a   Bauckhage, Christian ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

And vision processing; Content based image retrieval; Fusion of haptics; Multimodal interface evaluation; Speech

Indexed keywords

DATABASE SYSTEMS; HAPTIC INTERFACES; NATURAL LANGUAGE PROCESSING SYSTEMS; NAVIGATION; PROBABILITY; SEMANTICS; SPEECH PROCESSING;

BAYESIAN NETWORKS; FUSION OF HAPTICS; IMAGE DATABASES; MULTIMODAL INTERFACE EVALUATION; VISION PROCESSING;

IMAGE RETRIEVAL;

EID: 5044234061     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/958468.958469     Document Type: Conference Paper

References (30)

1. C. Bauckhage, J. Fritsch, K.J. Rohlfing, S. Wachsmuth, and G. Sagerer. Evaluating Integrated Speech- and Image Understanding. In Proc. IEEE Int. Conf. on Multimodal Interfaces (ICMI), pages 9-14, 2002.
2. A. Ben-Hur, D. Horn, H. Siegelmann, and V. Vapnik. Support Vector Clustering. Journal of Machine Learning Research, 2:125-137, 2001.
3. N. Beringer, U. Kartal, K. Louka, F. Schiel, and U. Türk. PROMISE - A Procedure for Multimodal Interactive System Evaluation. In Proc. Workshop 'Multimodal Ressources and Multimodal System Evaluation', Las Palmas, Spain, 2002.
4. H. Brandt-Pook, G.A. Fink, S. Wachsmuth, and G. Sagerer. Integrated Recognition and Interpretaion of Speech for a Construction Task Domain. In Proc. Int. Conf. on Human Computer Interaction (HCI), volume 1, pages 550-554, 1999.
5. T. Brondsted, L.B. Larsen, M. Manthey, P. McKevitt, T. Moeslund, and K.G. Olesen. The Intellimedia Workbench - A Generic Environment for Multimodal Systems. In Proc. ICSLP, pages 273-276, 1998.
6. C. Carson, S. Belongie, H. Greenspan, and J. Malik. Blobworld: Image Segmentation Using Expectation Maximization and its Application to Image Querying. IEEE PAMI, 24(8):1026-1038, 2002.
7. I.J. Cox, M.L. Miller, T.P. Minka, Thomas Papathomas, and Peter N. Yianilos. The Bayesian Image Retrieval System, PicHunter: Theory, Implementation and Psychophysical Experiments. IEEE Trans. on Image Processing, 9(1), 2000.
8. J. Fauqueur and N. Boujemaa. Image Retrieval by Regions: Coarse Segmentation and Fine Color Description. In Int. Conf. on Visual Information Systems, 2002.
9. G.A. Fink. Developing HMM-based Recognizers with ESMERALDA. In V. Matoušek, P. Mautner, J. Ocelíková, and P. Sojka, editors, Lecture Notes in Artificial Intelligence, volume 1692, pages 229-234. Springer, 1999.
10. J. Fritsch, M. Kleinehagenbrock, S. Lang, T. Plötz, G.A. Fink, and G. Sagerer. Multi-Modal Anchoring for Human-Robot-Interaction. Robotics and Autonomous System, 43(2-3): 133-147, 2003.
11. C. Harris and M. Stephens. A Combined Corner and Edge Detector. In 4th Alvey Vision Conference, pages 147-151, 1988.
12. K. Isbister and C. Nass. Consistency of Personality in Interactive Characters: Verbal Cues, Non-Verbal Cues, and User Characteristics. Int. Journal of Human-Computer Studies, 53:251-267, 2000.
13. T. Kämpfe, T. Käster, M. Pfeiffer, H.Ritter, and G. Sagerer, INDI - Intelligent Database Navigation by Interactive and Intuitive Content-Based Image Retrieval. In Proc. IEEE ICIP, volume III, pages 921-924, 2002.
14. G. Lindegaard. Usability Testing and System Evaluation. Chapman & Hall, London, 1994.
15. P. Montesinos, V. Gouet, and R. Deriche. Differential Invariants for Color Images. In Proc. IEEE ICPR, 1998.
16. S. Oviatt and P. Cohen. Multimodal Interfaces That Process What Comes Naturally. Communications of the ACM, 43(3):45-53, 2000.
17. J. Pearl. Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann, San Francisco, 1988.
18. T. Plötz and G.A. Fink. Robust Time-Synchronous Environmental Adaptation for Continuous Speech Recognition Systems. In Proc. ICSLP, volume 2, pages 1409-1412, 2002.
19. J. Preece, Y. Rogers, and H.C. Sharp. Beyond Human-Computer Interaction. Wiley & Sons, Chichester, 2002.
20. Y. Rui and T. Huang. Relevance Feedback: A Power Tool for Interactive Content-Based Image Retrieval. IEEE Trans. on Circuits and Video Tech., 8(5), 1998.
21. Y. Rui, T. Huang, and S. Chang. Image Retrieval: Current Techniques, Promising Directions and Open Issues. Journal of Visual Communication and Image Representation, 10(4):39-62, 1999.
22. N. Sebe and M.S. Lew. Color Indexing Using Wavelet-based Salient Points. In IEEE Int. Conf. on Multimedia and Expo, pages 311-314, 2000.
23. M.A. Stricker and M. Orengo. Similarity of Color Images. In Storage and Retrieval for Image and Video Databases (SPIE), pages 381-392, 1995.
24. M.J. Swain and D.H. Ballard. Color Indexing. Int. Journal of Computer Vision, 7(1): 11-32, 1991.
25. T. Takahashi, S. Nakanishi, Y. Kuno, and Y. Shirai. Helping Computer Vision by Verbal and Nonverbal Communication. In Proc. ICPR, pages 1216-1218, 1998.
26. D. Tax and R. Duin. Support Vector Domain Description. Pattern Recognition Letters, 20(11-13):1191-1199, 1999.
27. M. Unser. Sum and Difference Histograms for Texture Analysis. IEEE PAMI, 8:118-125, 1986.
28. S. Wachsmuth, G.A. Fink, and G. Sagerer. Integration of Parsing and Incremental Speech Recognition. In Proc. EUSIPCO., volume 1, pages 371-375, 1998.
29. S. Wachsmuth and G. Sagerer. Bayesian Networks for Speech and Image Integration. In Proc. AAAI, pages 300-306, 2002.
30. A. Waibel, B. Suhm, M.T. Vo, and J. Yang. Multimodal Interfaces for Multimedia Information Agents. In Proc. ICASSP, volume I, pages 167-170, 1997.