Multimodal interface research: A science without borders

6th International Conference on Spoken Language Processing, ICSLP 2000

Volumn , Issue , 2000, Pages

  Oviatt, Sharon ^a  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPONENT TECHNOLOGIES; CROSS FERTILIZATION; INTERNATIONAL GROUP; MEDICAL COMMUNITY; MULTI-DISCIPLINARY RESEARCH; MULTI-MODAL INTERFACES; NOCV1; RESEARCH CHALLENGES; SCIENTIFIC PROGRESS;

EID: 85009060662     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Adjoudani, A. & Benoit, C., 1995. "Audio-visual speech recognition compared across two architectures", Proceedings of the Eurospeech Conference, Madrid, Spain, vol. 2, 1563-1566.
2. Banse, R., & Scherer, K., 1996. "Acoustic profiles in vocal emotion expression", Journal of Personality and Social Psychology, 70(3), 614-636.
3. Benoit, C. & Le Goff, B., 1998. "Audio-visual speech synthesis from French text: Eight years of models, designs and evaluation at the ICP", Speech Communication, 26, 117-129.
4. Bernstein, L. & Benoit, C., 1996. "For speech perception by humans or machines, three senses are better than one", Proceedings of the International Conference on Spoken Language Processing, vol. 3, 1477-1480.
5. Brooke, M., 1996. "Using the visual component in automatic speech recognition", Proceedings of the International Conference on Spoken Language Processing, vol. 3, 1656-1659.
6. Choudhury, T., Clarkson, B., Jebara, T. & Pentland, S., March 1999. "Multimodal person recognition using unconstrained audio and video", Proceedings of the 2nd International Conference on Audio-and-Video-based Biometric Person Authentication, Wash., DC, 176-81.
7. Cohen, P. R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., & Clow, J., 1997. "Quickset: Multimodal interaction for distributed applications", Proceedings of the Fifth ACM International Multimedia Conference, ACM Press: New York, 31-40.
8. Gong, Y., 1995. "Speech recognition in noisy environments", Speech Communication, 16, 261-291.
9. International Conference on Multimodal Interfaces (ICMI'2000), Oct. 14-16, 2000. Beijing, China, (URL: http://www.ia.ac.cn/nlpr/ICMI2000/)
10. Iverson, P., Bernstein, L., & Auer, E., 1998. "Modeling the interaction of phonemic intelligibility and lexical structure in audiovisual word recognition", Speech Communication, 26(1-2), 45-63. North Holland.
11. Junqua, J. C., 1993. "The Lombard reflex and its role on human listeners and automatic speech recognizers", Journal of the Acoustical Society of America, 93(1), 510-24.
12. McLeod, A. & Summerfield, Q., 1987. "Quantifying the contribution of vision to speech perception in noise", British Journal of Audiology, 21, 131-141.
13. McGrath, M. & Summerfield, Q., 1985. "Intermodal timing relations and audio-visual speech recognition by normalhearing adults", Journal of the Acoustical Society of America, 77(2), 678-685.
14. Munhall, K., Oct. 2000. "Studies of audiovisual speech perception using production-based animation", International Conference on Spoken Language Processing, Beijing China, to be presented in special session on Multimodal and Transmodal Human-Computer Interaction.
15. Nakamura, S., Ito, H. & Shikano, K., Oct. 2000. "Stream weight optimization of speech and lip image sequence for audio-visual speech recognition", International Conference on Spoken Language Processing, Beijing China, to be presented in special session on Multimodal and Transmodal Human-Computer Interaction.
16. Neti, C., Iyengar, G., Potamianos, G. & Senior, A., Oct. 2000. "Perceptual interfaces for information interaction: Joint processing of audio and visual information for human-computer interaction", International Conference on Spoken Language Processing, Beijing China, to be presented in special session on Multimodal and Transmodal Human-Computer Interaction.
17. Oviatt, S. L., 1999. "Mutual disambiguation of recognition errors in a multimodal architecture", Proceedings of the Conference on Human Factors in Computing Systems (CHI'99), ACM Press: New York, 576-583.
18. Oviatt, S. L., Oct. 2000. "Multimodal signal processing in naturalistic noisy environments", Proceedings of the International Conference on Spoken Language Processing, to be presented in Beijing China.
19. Oviatt, S. L., MacEachern, M., & Levow, G., 1998. "Predicting hyperarticulate speech during human-computer error resolution", Speech Communication, 24, 87-110.
20. Oviatt, S. L., Cohen, P. R., Wu, L., Vergo, J., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J. & Ferro, D., in press (2000). "Designing the user interface for multimodal speech and gesture applications: State-of-the-art systems and research directions", Human Computer Interaction, (to be reprinted in J. Carroll (ed.) Human-Computer Interaction in the New Millennium, Addison-Wesley Press: Boston).
21. Pankanti, S., Bolle, R. M., & Jain, A. (Eds.), 2000. "Biometrics: The future of identification", Computer, 33(2), 46-80.
22. Physicians without borders/Medecins sans frontiers (URL: http://www.dwb.org/).
23. Pick, H. L., Siegel, G. M., Fox, P. W., Garber, S. R. & Kearney, J. K., 1989. "Inhibiting the Lombard effect", Journal of the Acoustical Society of America, 85(2), 894-900.
24. Robert-Ribes, J. Schwartz, J.-L., Lallouache, T. & Escudier, P., 1998. "Complementarity and synergy in bimodal speech: Auditory, visual, and audio-visual identification of French oral vowels in noise", Journal of the Acoustical Society of America, 103(6), 3677-3689.
25. Rogozan, A. & Deglise, P. "Adaptive fusion of acoustic and visual sources for automatic speech recognition", Speech Communication, 26(1-2), 149-161.
26. Rubin, P., Vatikiotis-Bateson, E., & Benoit, C. (eds.), 1998. "Special issue on audio-visual speech processing", Speech Communication, 26, 1-2.
27. Stork, D. G., & Hennecke, M. E. (Eds.), 1995. Speechreading by Humans and Machines. New York: Springer Verlag.
28. Sumby, W. H. & Pollack, I., 1954. "Visual contribution to speech intelligibility in noise", Journal of the Acoustical Society of America, 26, 212-215.
29. Tomlinson, M. J., Russell, M. J. & Brooke, N. M., 1996. "Integrating audio and visual information to provide highly robust speech recognition", Proceedings of the IEEE ICASSP, 821-824.
30. Turk, M. & Robertson, G. (Eds.), 2000. "Perceptual user interfaces", Communications of the ACM (special issue), 43(3), 32-70.
31. Wu, L., Oviatt, S., & Cohen, P., 1999. "Multimodal integration: A statistical view", IEEE Transactions on Multimedia, 1 (4) 334-342.
32. Zhai, S., Morimoto, C., & Ihde, S., 1999. "Manual and gaze input cascaded (MAGIC) pointing", Proceedings of the Conference on Human Factors in Computing Systems (CHI'99). ACM Press: New York, 246-253.