Multimodal communication error detection for driver-car interaction

ICINCO 2007 - 4th International Conference on Informatics in Control, Automation and Robotics, Proceedings

Volumn 1 RA, Issue , 2007, Pages 365-371

  Wang, Sy Bor ^a   Demirdjian, David ^a   Darrell, Trevor ^a   Kjellström, Hedvig ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Audio Visual Recognition; Conversational systems; System Error Identification

Indexed keywords

AMBIENT NOISE; AUDIO-VISUAL; AUDIO-VISUAL RECOGNITION; AUTOMATIC DETECTION; CELL PHONE; COMMUNICATION ERRORS; CONVERSATIONAL SYSTEMS; DRIVER-CAR INTERACTION; FREE CONTROL; MULTIMODAL COMMUNICATIONS; RECOGNITION ERROR; SPEECH RECOGNITION SYSTEMS; SYSTEM ERROR IDENTIFICATION; VISUAL MODALITIES;

AUDIO SYSTEMS; IDENTIFICATION (CONTROL SYSTEMS); RADIO NAVIGATION; ROBOTICS; SPEECH COMMUNICATION; SPEECH RECOGNITION;

ERROR DETECTION;

EID: 67649995881     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Barkhuysen, P., Krahmer, E., and Swerts, M. (2004). Audiovisual perception of communication problems. In Speech Prosody.
2. Boersma, P. (1993). Accurate short-term analysis of the fundamental frequency and the harmonis-to-noise ratio of a sampled sound. In IFA.
3. Boersma, P. (2001). Praat, a system for doing phonetics by computer. Glot International, 5(9/10):341-345.
4. Chen, L., Huang, T. S., Miyasato, T., and Nakatsu, R. (1998). Multimodal human emotion/expression recognition. In International Conference on Face and Gesture Recognition.
5. Childers, D. G. (1978). Modern Spectrum Analysis. IEEE Press.
6. Fischler, M. A. and Bolles, R. C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381-395.
7. Hirschberg, J., Litman, D., and Swerts, M. (2001). Identifying user corrections automatically in spoken dialogue systems. In 2nd Meeting of the North American Chapter of the Association for Computational Linguistics on Language Technologies.
8. Kittler, J., Hatef, M., Duin, R., and Matas, J. (1998). On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3):226-239.
9. Litman, D., Hirschberg, J., and Swerts, M. (2001). Predicting user reactions to system error. In ACL.
10. Massaro, D. (1987). Speech Perception By Ear and Eye. Lawrence Erlbaum Associates, Hillsdale, NJ, USA.
11. Morency, L., Rahimi, A., and Darrell, T. (2003). Adaptive view-based appearance models. In IEEE Conference on Computer Vision and Pattern Recognition, pages 803-810.
12. Oviatt, S. L. and VanGent, R. (1998). Error resolution during multimodal human-computer interaction. In SpeechCommunication.
13. Quattoni, A., Collins, M., and Darrell, T. (2004). Conditional random fields for object recognition. In Neural Information Processing Systems.
14. Rabiner, L. R. (1989). A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257-286.
15. Sebe, N., Lew, M., Cohen, I., Sun, Y., Gevers, T., and Huang, T. S. (2004). Authentic facial expression analysis. In International Conference on Automatic Face and Gesture Recognition.
16. Summerfield, Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. In Dodd, B. and Campbell, R., editors, Hearing by Eye, pages 3-51. Lawrence Erlbaum Associates, Hillsdale, NJ, USA.
17. Viola, P. and Jones, M. J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2): 137-154.
18. Wang, S., Quattoni., A., Morency, L.-R, Demirdjian, D., and Darrell, T. (2006). Hidden conditional random fields for gesture recognition. In IEEE Conference on Computer Vision and Pattern Recognition.
19. Zeng, Z., Tu, J., Liu, M., Zhang, T., Rizzolo, N., Zhang, Z., Huang, T. S., Roth, D., and Levinson, S. (2004). Bi-modal hci-related affect recognition. In International Conference on Multimodal Interfaces.