Using confidence scores to improve hands-free speech based navigation in continuous dictation systems

ACM Transactions on Computer-Human Interaction

Volumn 11, Issue 4, 2004, Pages 329-356

  Feng, Jinjuan ^a   Sears, Andrew ^a  

^a UNIVERSITY OF MARYLAND BALTIMORE COUNTY   (United States)

Author keywords

Confidence score; Navigation; Simulation; Speech recognition

Indexed keywords

CONFIDENCE SCORE; DICTATION-ORIENTED APPLICATIONS; HANDS-FREE INTERACTIONS; SPEECH-BASED TECHNIQUES;

DICTATING MACHINES; DISPLAY DEVICES; ERROR DETECTION; NAVIGATION SYSTEMS; SIGNAL PROCESSING; SPEECH RECOGNITION;

HUMAN COMPUTER INTERACTION;

EID: 10844260787     PISSN: 10730516     EISSN: None     Source Type: Journal    
DOI: 10.1145/1035575.1035576     Document Type: Article

References (28)

1. BOUWMAN, G., STURM, J., AND BOVES, L. 1999. Incorporating confidence measures in the dutch train timetable information system developed in the ARISE project. In Proceedings of International Conference on Acoustics, Speech and Signal Processing, Vol. 1, 493-496, Phoenix.
2. BOUWMAN, G., BOVES, L., AND KOOLWAAIJ, J. 2000. Weighting phone confidence measures for automatic speech recognition. In Proceedings of the COST249 Workshop on Voice Operated Telecom Services. 59-62.
3. CHASE, L. 1997a. Error-responsive feedback mechanisms for speech recognizers. Ph.D. Thesis. School of Computer Science, Carnegie Mellon University, Pittsburgh, PA.
4. CHASE, L. 1997b. Word and acoustic confidence annotation for large vocabulary speech recognition. Eurospeech-97. 815-818.
5. CHRISTIAN, K., KULES, B., SHNEIDERMAN, B., AND YOUSSEF, A. 2000. A comparison of voice controlled and mouse controlled web browsing. In Proceedings of Assets 2000. 72-79.
6. DANIS, C., COMERFORD, L., JANKE, E., DAVIES, K., DEVRIES, J., AND BERTRAND, A. 1994. Storywriter: A Speech Oriented Editor, In CHI 94 Conference Companion. 277-278.
7. DE MAURO, C., GORI, M., MAGGINI, M., AND MARTINELLI, E. 2001. Easy access to graphical interfaces by voice mouse, demauro@dii.unisi.it.
8. FENG, J., SEARS, A., AND KARAT, C.-M. 2003. A longitudinal investigation of hands-free speech-based navigation during dictation. UMBC Tech. Rep. available from the authors.
9. GILLICK, L., ITO, Y., AND YOUNG, J. 1997. A probabilistic approach to confidence estimation and evaluation. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing. 879-882.
10. GUNAWARDANA, A., HON, H., AND JIANG, L. 1998. Word-based acoustic confidence measures for large-vocabulary speech recognition. In Proceedings of ICSLP-98, Sydney, Australia, Vol. 3, 791-794.
11. Hazen, T. J. and Bazzi, I. 2001. A comparison and combination of methods for OOV word detection and word confidence scoring. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing. 397-400.
12. HAZEN, T. J., POLIFRONI, J., AND SENEFF, S. 2002. Recognition confidence scoring for use in speech understanding systems. Computer Speech and Language 16, 1, 49-67.
13. KARAT, C.-M., HALVERSON, C., KARAT, J., AND HORN, D. 1999. Patterns of entry and correction in large vocabulary continuous speech recognition systems. In Proceedings of CHI 99. 568-575.
14. KARAT, C.-M., VERGO, J., AND NAHAMOO, D. 2003. Conversational interface technologies. In J. Jacko and A. Sears, Eds. The Human-Computer Interaction Handbook. LEA: NJ. 169-186.
15. KEMP, T. AND SCHAAF, T. 1997. Estimating confidence using word lattices. In Eurospeech, 1997, Vol. 1, 371-373.
16. LITMAN, D., WALKER, M., AND KEARNS, M. S. 1999. Automatic detection of poor speech recognition at the dialogue level. In Proceedings of the 37th Annual Meeting for Computational Linguistics. 309-316.
17. MAISON, B. AND GOPINATH, R. A. 2001. Robust confidence annotation and rejection for continuous speech recognition. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing. 389-392.
18. MANARIS, B. AND HARKREADER, A. 1998. SUITEKeys: A speech understanding interface for the motor-control challenged. In Proceedings of the 3rd International ACM SIGCAPH Conference on Assistive Technologies (ASSETS'98). 108-115.
19. MCNAIR, A. AND WAIBEL, A. 1994. Improving recognizer acceptance through robust, natural speech repair. In Proceedings of the International Conference on Spoken Language Processing. 1299-1302.
20. MOU, X. AND ZUE, V. 2000. The use of dynamic reliability scoring in speech recognition. In Proceedings of the 6th International Conference on Spoken Language Processing.
21. OVIATT, S. L. 1997. Multimodal interactive maps: Designing for human performance. Human-Computer Interaction 12, 93-129.
22. OVIATT, S. L. 2000. Taming speech recognition errors within a multimodal interface. Comm. ACM 43, 9, 45-51.
23. OVIATT, S. L. 2003. Multimodal interfaces. In J. A. Jacko and A. Sears, Eds. The Human-Computer Interaction Handbook. Mahwah, NJ: Lawrence Erlbaum Assoc. 286-304.
24. OVIATT, S. L., COHEN, P. R., WU, L.,VERGO, J., DUNCAN, L., SUHM, B., BERS, J., HOLZMAN, T., WINOGRAD, T., LANDAY, J., LARSON, J., AND FERRO, D. 2000. Designing the user interface for multimodal speech and gesture applications: State-of-the-art systems and research directions. Human Computer Interaction 15, 4, 263-322.
25. SEARS, A., FENG, J., OSEITUTU, K., AND KARAT, C.-M. 2003. Hands-free speech-based navigation during dictation: Difficulties, consequences, and solutions. Human Computer Interaction 18, 3, 229-257.
26. SEARS, A., KARAT, C.-M., OSEITUTU, K., KARIMULLAH, A., AND FENG, J. 2001. Productivity, satisfaction, and interaction strategies of individual with spinal cord injuries and traditional users interacting with speech recognition software. Universal Access in the Information Society 1, 4-15.
27. SETLUR, A. R., SUKKAR, R. A, AND JACOB, J. 1996. Correcting recognition errors via discriminative utterance verification. In Proceedings of ICSLP'96, Vol. II, 602-605.
28. SUHM, B., MYERS, B., AND WAIBEL, A. 2001. Multimodal error correction for speech user interfaces. ACM Trans. Comp.-Hum. Interact. 8, 1, 60-98.