VoicePen: Augmenting pen input with simultaneous non-linguistic vocalization

Proceedings of the 9th International Conference on Multimodal Interfaces, ICMI'07

Volumn , Issue , 2007, Pages 178-185

  Harada, Susumu ^a   Saponas, T Scott ^a   Landay, James A ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Multimodal input; Pen based interface; Voice based interface

Indexed keywords

HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; PLANNING; RESOURCE ALLOCATION;

CONTINUOUS INPUTS; DIGITAL PENS; FEASIBILITY STUDIES; INTERACTION TECHNIQUES; MULTIMODAL INPUT; OBJECT MANIPULATIONS; PEN INPUTS; PEN PRESSURES; PEN-BASED INTERFACE; TABLET COMPUTERS; TRAINING PEOPLES; TWO PARAMETERS; VOICE-BASED INTERFACE; VOWEL SOUNDS;

LINGUISTICS;

EID: 57649155321     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1322192.1322225     Document Type: Conference Paper

References (31)

1. Balakrishnan, R., and Hinckley, K. The role of kinesthetic reference frames in two-handed input performance. In UIST '99: Proc. 12th annual ACM symposium on User interface software and technology (New York, NY, USA, 1999), ACM Press, pp. 171-178.
2. Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. Toolglass and magic lenses: the see-through interface. In SIGGRAPH '93: Proc. 20th annual conf on Computer graphics and interactive techniques (New York, NY, USA, 1993), ACM Press, pp. 73-80.
3. Bilmes, J. A., Li, X., Malkin, J., Kilanski, K., Wright, R., Kirchhoff, K., Subramanya, A., Harada, S., Landay, J. A., Dowden, P., and Chizeck, H. The Vocal Joystick: A voice-based human-computer interface for individuals with motor impairments. In HLT '05: Proc. conf. on Human Language Technology and Empirical Methods in Natural Language Processing (Morristown, NJ, USA, 2005), Association for Computational Linguistics, pp. 995-1002.
4. Butler, C. G., and Amant, R. S. HabilisDraw DT: a bimanual tool-based direct manipulation drawing environment. In CHI '04: Proc. SIGCHI conf. on Human factors in computing systems (New York, NY, USA, 1994), ACM Press, pp. 1301-1304.
5. Buxton, W., and Myers, B. A study in two-handed input. In CHI '86: Proc: SIGCHI conf. on Human factors in computing systems (New York, NY, USA, 1986), ACM Press, pp. 321-326.
6. Cohen, P. R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., and Clow, J. Quickset: multimodal interaction for distributed applications. In MULTIMEDIA '97: Proc. fifth ACM international conf. on Multimedia (New York, NY, USA, 1997), ACM Press, pp. 31-40.
7. Davis, R. C., Saponas, T. S., Shilman, M., and Landay, J. A. SketchWizard: Wizard of Oz Prototyping of Pen-based User Interfaces. UIST '07 (to appear).
8. Fitzmaurice, G. W., Ishii, H., and Buxton, W. A. S. Bricks: laying the foundations for graspable user interfaces. In CHI '95: Proc. SIGCHI conf on Human factors in computing systems (New York, NY, USA, 1995), ACM Press/Addison-Wesley Publishing Co., pp. 442-449.
9. Gross, M. D., and Do, E. Y.-L. Ambiguous intentions: a paper-like interface for creative design. In UIST '96: Proc. 9th annual ACMsymposium on User interface software and technology (New York, NY, USA, 1996), ACM Press, pp. 183-192.
10. Guiard, Y. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 19 (1987), 486-517.
11. Harada, S., Landay, J. A., Malkin, J., Li, X., and Bilmes, J. A. The Vocal Joystick: evaluation of voice-based cursor control techniques. In Assets '06: Proc. international ACM SIGACCESS conf on Computers and accessibility (New York, NY, USA, 2006), ACM Press, pp. 197-204.
12. Hinckley, K., Pausch, R., Proffitt, D., Patten, J., and Kassell, N. Cooperative bimanual action. In CHI '97: Proc. SIGCHI conf on Human factors in computing systems (New York, NY, USA, 1997), ACM Press, pp. 27-34.
13. Hinckley, K., Czerwinski, M., and Sinclair, M. Interaction and modeling techniques for desktop two-handed input. In UIST '98: Proc. 11th annualACMsymposium on User interface software and technology (New York, NY, USA, 1998), ACM Press, pp. 49-58.
14. Igarashi, T., and Hinckley, K. Speed-dependent automatic zooming for browsing large documents. In UIST '00: Proc. 13th annual ACMsymposium on User interface software and technology (New York, NY, USA, 2000), ACM Press, pp. 139-148.
15. Igarashi, T., and Hughes, J. F. Voice as sound: using non-verbal voice input for interactive control. In UIST '01: Proc. 14th annual ACM symposium on User interface software and technology (New York, NY, USA, 2001), ACM Press, pp. 155-156.
16. Jul, S., and Furnas, G. W. Critical zones in desert fog: aids to multiscale navigation. In UIST '98: Proc. 11th annual ACM symposium on User interface software and technology (New York, NY, USA, 1998), ACM Press, pp. 97-106.
17. Julia, L., and Faure, C. Pattern recognition and beautification for a pen based interface. In ICDAR '95: Proc. Third International Conf. on Document Analysis and Recognition (Volume 1) (Washington, DC, USA, 1995), IEEE Computer Society, p. 58.
18. Kabbash, P., Buxton, W., and Sellen, A. Two-handed input in a compound task. In CHI '94: Proc. SIGCHI conf on Human factors in computing systems (New York, NY, USA, 1994), ACM Press, pp. 417-423.
19. Kurtenbach, G., Fitzmaurice, G., Baudel, T., and Buxton, B. The design of a GUI paradigm based on tablets, two-hands, and transparency. In CHI '97: Proc. SIGCHI conf on Human factors in computing systems (New York, NY, USA, 1997), ACM Press, pp. 35-42.
20. Leganchuk, A., Zhai, S., and Buxton, W. Manual and cognitive benefits of two-handed input: an experimental study. ACM Transactions on Computer-Human Interaction (TOCHI) 5, 4 (1998), 326-359.
21. Malkin, J., Li, X., and Bilmes, J. Energy and loudness for speed control in the Vocal Joystick. In IEEE Automatic Speech Recognition and Understanding Workshop (November 2005).
22. Mihara, Y., Shibayama, E., and Takahashi, S. The migratory cursor: accurate speech-based cursor movement by moving multiple ghost cursors using non-verbal vocalizations. In Assets '05: Proc. 7th intl. ACM SIGACCESS conf on Computers and accessibility (New York, NY, USA, 2005), ACM Press, pp. 76-83.
23. Newman, M. W., Lin, J., Hong, J. I., and Landay, J. A. Denim: An informal web site design tool inspired by observations of practice. Human-Computer Interaction 18, 3 (2003), 259-324.
24. Oviatt, S., Cohen, P., Wu, L., Vergo, J., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J. A., Larson, J., and Ferro, D. Designing the user interface for multimodal speech and pen-based gesture applications: State-of-the-art systems and future research directions. Human-Computer Interaction 15 (2000), 263-322.
25. Owen, R., Kurtenbach, G., Fitzmaurice, G., Baudel, T., and Buxton, B. When it gets more difficult, use both hands: exploring bimanual curve manipulation. In GI '05: Proc. 2005 conf. on Graphics interface (Univ. of Waterloo, Waterloo, Ontario, Canada, 2005), Canadian Human-Computer Communications Society, pp. 17-24.
26. Ramos, G., and Balakrishnan, R. Fluid interaction techniques for the control and annotation of digital video. In UIST '03: Proc. 16th annual ACM symposium on User interface software and technology (New York, NY, USA, 2003), ACM Press, pp. 105-114.
27. Ramos, G. A., and Balakrishnan, R. Pressure marks. In CHI '07: Proc. SIGCHI conf. on Human factors in computing systems (New York, NY, USA, 2007), ACM Press, pp. 1375-1384.
28. Ramos, G., Boulos, M., and Balakrishnan, R. Pressure widgets. In CHI '04: Proc. SIGCHI conf. on Human factors in computing systems (New York, NY, USA, 2004), ACM Press, pp. 487-494.
29. Ramos, G., and Balakrishnan, R. Zliding: fluid zooming and sliding for high precision parameter manipulation. In UIST '05: Proc. 18th annual ACMsymposium on User interface software and technology (New York, NY, USA, 2005), ACM Press, pp. 143-152.
30. Raisamo, R. An alternative way of drawing. In CHI '99: Proc. SIGCHI conf. on Human factors in computing systems (New York, NY, USA, 1999), ACM Press, pp. 175-182.
31. Sporka, A. J., Kurniawan, S. H., and Slavík, P. Whistling user interface (U3I). In User Interfaces for All (2004), pp. 472-478.