The Integrality of Speech in Multimodal Interfaces

ACM Transactions on Computer-Human Interaction

Volumn 5, Issue 4, 1998, Pages 303-325

  Grasso, Michael A ^a   Ebert, David S ^a   Finin, Timothy W ^a  

^a Baltimore County   (United States)

Author keywords

Design; Direct manipulation; Experimentation; Human Factors; input devices; integrality; Measurement; medical informatics; multimodal; natural language processing; pathology; perceptual structure; Performance; separability; speech recognition; Theory

Indexed keywords

EID: 84999118324     PISSN: 10730516     EISSN: 15577325     Source Type: Journal    
DOI: 10.1145/300520.300521     Document Type: Article

References (38)

1. Alwang, G. and Stinson, C. 1998. Speech recognition: Finding its voice. PC Mag. 17, 18, 191-204.
2. Buxton, B. 1993. HCI and the inadequacies of direct manipulation systems. SIGCHI Bull. 25, 1 (Jan. 1993), 21-22.
3. Casali, S. P., Williges, B. H., and Dryden, R. D. 1990. Effects of recognition accuracy and vocabulary size of a speech recognition system on task performance and user acceptance. Hum. Factors 32, 2 (Apr. 1990), 183-196.
4. Cohen, P. R. 1992. The role of natural language in a multimodal interface. In Proceedings of the 5th Annual ACM Symposium on User Interface Software and Technology (UIST ‘92, Monterey, CA, Nov. 15-18), J. Mackinlay and M. Green, Eds. ACM Press, New York, NY, 143-149.
5. Cohen, P. R. and Oviatt, S. L. 1994. The role of voice in human-machine communication. In Voice Communication between Humans and Machines, D. B. Roe and J. G. Wilpon, Eds. National Academy Press, Washington, DC, 34-75.
6. Cole, R., Hirschman, L., Atlas, L., Beckman, M., Biermann, A., Bush, M., Clements, M., Cohen, J., Garcia, O., Hanson, B., Hermansky, H., Levinson, S., Mckeown, K., Morgan, N., Novick, D. G., Ostendorf, M., Oviatt, S., Price, P., Silverman, H., Spitz, J., Waibel, A., Weinstein, C., Zahorian, S., and Zue, V. 1995. The challenge of spoken language systems: Research directions for the Nineties. IEEE Trans. Speech Audio Process. 3, 1 (Jan.), 1-21.
7. Dillon, T. W., Mcdowell, D., Norcio, A. F., and Dehaemer, M. J. 1995. Nursing acceptance of a speech-input interface: A preliminary investigation. Comput. Nursing 12, 6, 264-271.
8. Garner, W. R. 1974. The Processing of Information and Structure. Lawrence Erlbaum Assoc. Inc., Hillsdale, NJ.
9. Graso, M. A. 1995. Automated speech recognition in medical applications. M.D. Comput. 12, 1, 16-23.
10. Grasso, M. A. and Grasso, C. T. 1994. Feasibility study of voice-driven data collection in animal drug toxicology studies. Comput. Bio. Med. 24, 4, 289-294.
11. Grasso, M. A., Ebert, D. S., and Finin, T. W. 1997. Acceptance of a speech interface for biomedical data collection. In Proceedings of the AMIA 1997 Fall Symposium. American Medical Informatics Assoc., Washington, DC, 739-743.
12. Jacob, R. J. K., Sibert, L. E., Mcfarlane, D. C., and Mullen, M. P. 1994. Integrality and separability of input devices. ACM Trans. Comput. Hum. Interact. 1, 1 (Mar. 1994), 3-26.
13. Jones, D. M., Hapeshi, K., and Frankish, C. 1990. Design guidelines for speech recognition interfaces. Appl. Ergonom. 20, 1, 40-52.
14. Landau, J. A., Normich, K. H., and Evans, S. J. 1989. Automatic speech recognition-Can it improve the man-machine interface in medical expert systems?. Int. J. Biomed. Comput. 24, 111-117.
15. Nctr. 1985. Post experiment information system pathology code table reference manual. TDMS Doc. 1118-PCT-4.0. National Center for Toxicological Research, Jefferson, AK.
16. Oviatt, S. L. 1996. Multimodal interfaces for dynamic interactive maps. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI ‘96). ACM Press, New York, NY, 95-102.
17. Oviatt, S. L. and Olsen, E. 1994. Integration themes in multimodal human-computer interaction. In Proceedings of the International Conference on Spoken Language Processing. Accoustical Society of Japan, Japan, 551-554.
18. Peacocke, R. D. and Graf, D. H. 1990. An introduction to speech and speaker recognition. Computer 23, 8 (Aug. 1990), 26-33.
19. Pomerantz, J. R. and Lockhead, G. R. 1991. Perception of structure: An overview. In The Perception of Structure. American Psychological Association, Washington, DC, 1-20.
20. Shepard, R. N. 1991. Integrality versus separability of stimulus dimension: From an early convergence to evidence to a proposed theoretical basis. In The Perception of Structure. American Psychological Association, Washington, DC, 53-71.
21. Shneiderman, B. 1983. Direct manipulation: A step beyond programming languages. Computer 16, 8, 57-69.
22. Shneiderman, B. 1993. Sparks of Innovation in Human-Computer Interaction. Ablex Publishing Corp., Norwood, NJ.
23. Arthur, K., Booth, K. S., and Ware, C. 1993. Evaluating 3D task performance for fish tank virtual worlds. ACM Trans. Inf. Syst. 11, 3, 239-265.
24. Blake, R. and Overton, R. 1979. The site of binocular rivalry suppression. Perception. 8, 143-152.
25. Bolter, J., Hodges, L. F., Meyer, T., and Nichols, A. 1995. Integrating perceptual and symbolic information in VR. IEEE Comput. Graph. Appl. 15, 4, 8-11.
26. Deering, M. 1992. High resolution virtual reality. In Proceedings of SIGGRAPH ‘92. Comput. Graph. 26, 2, 195-202.
27. Drasic, D. and Milgram, P. 1991. Positioning accuracy of a virtual stereographic pointer in a real StereoGraphic video world. In Stereoscopic Displays and Applications II, SPIE, vol. 1457. 1-11.
28. Fitts, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exper. Psychol. 47.
29. Furedy, J. J. and Stanley, G. 1970. The apparent size of “projected” afterimages under conditions where size constancy holds. Perception Psychophys. 7, 165-167.
30. Johnsgard, T. 1994. Fitts’ Law with a virtual reality glove and a mouse: Effects of gain. In Graphics Interface Proceedings. 8-15.
31. Liang, J. and Green, M. 1994. JDCAD: A highly interactive 3D modeling system. Comput. Graph. 18, 4, 499-506.
32. Mackenzie, I. S. 1992. Fitts’ Law as a research and design tool in human-computer interaction. Human-Comput. Interact. 7, 1, 91-139.
33. Mackenzie, I. S. and Buxton, W. 1992. Extending Fitts’ Law to two-dimensional tasks. In ACM CHI’92 Conference Proceedings. ACM, New York, 219-226.
34. Ware, C. and Jessome, D. 1988. Using the Bat: A six dimensional mouse for object placement. IEEE Comput. Graph. Appl. 8, 5, 41-49.
35. Ware, C. and Balakrishnan, R. 1994. Reaching for objects in VR displays: Lag and frame rate. ACM Trans. Comput.-Human Interact. 1, 4 (Dec)., 331-356.
36. Whisenand, T. G. and Emurion, H. H. 1995. Some effects of angle of approach on icon selection. Conference Companion, In Proceedings of CHI'94. ACM, New York, 298-299.
37. Wolfe, J. M. 1986. Stereopsis and binocular rivalry. Psychol. Rev. 93, 3, 269-282.
38. Zhai, S., Buxton, W. and Milgram, P. 1994. The “silk cursor”: Investigating transparency for 3D target acquisition. In Proceedings of CHI'94. ACM, New York, 459-464.