Multimodal interaction on PDA?s integrating speech and pen inputs

EUROSPEECH 2003 - 8th European Conference on Speech Communication and Technology

Volumn , Issue , 2003, Pages 2225-2228

  Dusan, Sorin ^a   Gadbois, Gregory J ^b   Flanagan, James ^a  

^a RUTGERS UNIVERSITY   (United States)

^b HandHeld Speech LLC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INTERACTIVE COMPUTER SYSTEMS; MICROCOMPUTERS; SPEECH;

MOBILE COMPUTERS; MULTI-MODAL INTERACTIONS; PORTABLE COMPUTERS; SPEECH AND PEN INPUT; SPEECH ENGINE; USER SATISFACTION;

SPEECH COMMUNICATION;

EID: 34548277079     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Bolt, R., "Put-that-there: Voice and gesture at the graphics interface", Computer Graphics, 14(3), pp. 262-270, 1980.
2. Oviatt, S.L., DeAngeli, A., and Kuhn, K., "Integration and Synchronization of Input Modes During Multimodal Human Computer Interaction", Proc. Conference on Human Factors in Computing Systems, Atlanta, GA, ACM Press, pp. 415-422, 1997.
3. Cohen P. R., et al. "QuickSet: Multimodal Interaction for Distributed Applications", Proc. of the 5th International Multimedia Conference, pp. 31-40, ACM Press, 1997.
4. Johnston, M., "Multimodal language processing", Proc. of ICSLP, Sydney, Australia, 1998.
5. Sharma, R., Pavlovic, V., and Huang T., "Toward multimodal human-computer interface", Proc. IEEE, vol. 86, no. 5, pp. 853-869, 1998.
6. Dusan, S., and Flanagan, J., "A System for Multimodal Dialogue and Language Acquisition", In Speech Technology and Human-ComputerDialogue, Romanian Academic Publishers, Bucharest, Romania, April 2003.
7. Oviatt, S. L. et al., "Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research Directions". Human-Computer Interaction, Vol.15, pp. 263-322, 2000.
8. Oviatt, S., "Multimodal Interactive Maps: Designing for Human Performance", Human-Computer Interaction, Vol.12, pp. 93-129, 1997.
9. Den Os, E., De Koning, N., Jongebloed, H., and Boves, L., "Usability of a Speech Centric Multimodal Directory Assistance Service", Proc. of the Intern. Workshop on Information Presentation and Natural Multimodal Dialogue, Verona, Italy, pp. 65-69, 2001.
10. Huang, X. et al., "MIPAD: A Multimodal Interaction Prototype", Proc. of the ICASSP 2001.
11. Johnston, M. et al., "MATCH: An Architecture for Multimodal Dialog Systems", Proc. of ACL-02, Philadelphia, 2002.
12. Comerford, L., Frank, D., Gopalakrishnan, P., Gopinath, R., and Sedivy, J., "The IBM Personal Speech Assistant", Proc. of the ICASSP 2001.
13. Gadbois, G., HandHeld Speech, LLC, http://www.handheldspeech.com
14. Dusan S., and Flanagan, J. "Adaptive Dialog Based Upon Multimodal Language Acquisition," Proc. of the 4th IEEE International Conference on Multimodal Interfaces, Pittsburgh, Pennsylvania, USA, pp. 135-140, 2002.
15. Cohen, P. R., Coulston, R., and Krout, K. "Multimodal Interaction During Multiparty Dialogues: Initial Results," Proc. of the 4th IEEE International Conference on Multimodal Interfaces, Pittsburgh, Pennsylvania, USA, pp. 448-453, 2002.