Writing with music: Exploring the use of auditory feedback in gesture interfaces

ACM Transactions on Applied Perception

Volumn 7, Issue 3, 2010, Pages

  Andersen, Tue Haste ^a   Zhai, Shumin ^b  

^a UNIVERSITY OF COPENHAGEN   (Denmark)

^b IBM ALMADEN RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDITORY FEEDBACK; FORMAL EXPERIMENTS; GESTURE INTERACTION; GESTURE INTERFACES; PEN GESTURE; RECOGNITION PROCESS; RESEARCH AND DEVELOPMENT; SHAPE DISTANCES; STEPPING STONE; SUBJECTIVE ASPECTS; TIGHTLY-COUPLED; VISUAL FEEDBACK;

EXPERIMENTS; FEEDBACK; GESTURE RECOGNITION; VISUAL COMMUNICATION; WEARABLE COMPUTERS;

STATE FEEDBACK;

EID: 77954090550     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1773965.1773968     Document Type: Article

References (41)

1. ALGAZI, V. R., DUDA, R. O., THOMPSON, D. M., AND AVENDANO, C. 2001. The cipic hrtf database. In Proceedings of the Workshop on Applications of Signal Processing to Audio and Electroacoustics. IEEE, Los Alamitos, CA, 99-102.
2. BLATTNER, M., SUMIKAWA, D., AND GREENBERGc, R. 1990. Earcons and icons: Their structure and common design principles. Hum. Comput. Interact. 16, 523.531.
3. BLYTHE, M., MONK, A., OVERBEEKE, C., AND WRIGHT, P., Eds. 2003. Funology: From Usability to User Enjoyment. Kluwer, Dordrecht, The Netherlands.
4. BREWSTER, S., LUMSDEN, J., AND ET. AL., M. B. 2003. Multimodal 'eyes-free' interaction techniques for wearable devices. In Proceedings of the Conference on Human Factor in Computing Systems. ACM, New York, 473-480.
5. BROADBENT, D. 1977. The hidden pre-attentive processes. Am. Psychol. 32, 2, 109-118.
6. BUXTON, W. 1995. Readings in Human Computer Interaction: Towards the Year 2000. Morgan Kaufmann Publishers, San Francisco, 525.
7. CHIN, J., DIEHL, V., AND NORMAN, K. 1988. Development of an instrument measuring user satisfaction of the human-computer interface. In Proceedings of the Conference on Human Factor in Computing Systems. ACM, New York, 213-218.
8. CLARKE, E. 1999. Rhythm and timing in music. In The Psychology of Music 2nd Ed. Deutsch, D. Ed., Academic Press, San Diego, CA, 473-500.
9. DEATHERAGE, B. H. 1972. Human Engineering Guide to Equipment Design. Revised Ed. John Wiley and Sons, New York, NJ, 123-160.
10. FLETCHER, H., BLACKHAM, E., AND STRATTON, R. 1962. Quality of piano tones. J. Acoust. Soc. Am. 34, 6, 749-761.
11. GAVER, W. 1989. The SonicFinder: An interface that uses auditory icons. Hum. Comput. Interact. 4, 1, 67-94.
12. GHEZ, C., RIKAKIS, T., DUBOIS, R. L., AND COOK, P. 2000. An auditory display system for aiding interjoint coordination. In Proceedings of the International Conference on Auditory Display. ACM, New York.
13. GOLDBERG, D. AND RICHARDSON, C. 1993. Touch-typing with a stylus. In Proceedings of the Conference on Human Factor in Computing Systems. ACM, New York, 80-87.
14. JäRVELäINEN, H., VäLIMäKI, V., AND KARJALAINEN, M. 2001. Audibility of the timbral effects of inharmonicity in stringed instrument tones. Acoust. Res. Lett. Online 2, 79.84.
15. KRAMER, G. 1994. Auditory Display: Sonification, Audification, and Auditory Interface. Addison-Wesley, Reading, MA, 1-77.
16. KRISTENSSON, P.-O. AND ZHAI, S. 2004. Shark2: A large vocabulary shorthand writing system for pen-based computers. In Proceedings of the Symposium on User Interface Software and Technology. ACM, New York, 43-52.
17. KURTENBACH, G. AND BUXTON, W. 1994. User learning and performance with marking menus. In Proceedings of the Conference on Human Factor in Computing Systems. ACM, New York, 258-264.
18. LACUANITI, F., TERZUOLO, C., AND VIVIANI, P. 1983. The law relating the kinematic and figural aspects of drawing movements. Acta Psychologica 54, 115.130.
19. LEGGE, D., STEINBERG, H., AND SUMMERFIELD, A. 1964. Simple measures of handwriting as indices of drug effects. Percept. Motor Skills 18, 549.558.
20. LOEB, R. AND FITCH, W. 2002. A laboratory evaluation of an auditory display designed to enhance intraoperative monitoring. Anesthesia Analgesia 94, 362.368.
21. LUSCHEI, E., SASLOW, C., AND GLICKSTEIN, M. 1967. Muscle potentials in reaction time. Exp. Neurol. 18, 429.442.
22. MACKENZIE, I. 2002. Kspc (keystrokes per character) as a characteristic of text entry techniques. In Proceedings of the Conference on Mobile Human Computer Interaction. Springer-Verlag, Berlin, 195-210.
23. MACMILLAN, K., DROETTBOOM, M., AND FUJINAGA, I. 2001. Audio latency measurements of desktop operating systems. In Proceedings of the International Computer Music Conference. 259-262.
24. NORMAN, D. 2004. Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, New York.
25. OLIVE, T. AND PIOLAT, A. 2002. Suppressing visual feedback in written composition: Effects on processing demands and coordination of the writing processes. Int. J. Psych. 37, 4, 209-218.
26. PATTERSON, R. 1989. Guidelines for the design of auditory warning sounds. In Proceedings of the Institute of Acoustics Spring Conference. Vol. 2. Institute of Acoustics, 17-24.
27. PIRHONEN, A., BREWSTER, S., AND HOLGUIN, C. 2002. Gestural and audio metaphors as a means of control for mobile devices. In Proceedings of Conference on Human Factor in Computing Systems. ACM, New York, 291-298.
28. SEARS, A. AND ARORA, R. 2002. Data entry for mobile devices: An empirical comparison of novice performance with jot and graffiti. Interact. Comput. 14, 413.433.
29. SHEA, C., WULF, G., PARK, J., AND GAUNT, B. 2001. Effects of an auditory model on the learning of relative and absolute timing. J. Motor Behav. 33, 2, 127-138. (Pubitemid 32494511)
30. SINGH, P. 1987. Perceptual organization of complex-tone sequences: A tradeoff between pitch and timbre? J. Acoust. Soc. Am. 82, 886.899.
31. SMYTH, M. AND SILVERS, G. 1987. Functions of vision in the control of handwriting. Acta Psychologica 66, 47.64.
32. TEULINGS, H. L. AND SCHOMAKER, L. 1993. Invariant properties between stroke features in handwriting. Acta Psychologica 82, 69-88.
33. TRACTINSKY, N., KATZ, A., AND IKAR, D. 2000. What is beautiful is usable. Interact. Comput. 13, 127.145.
34. VAN DOORN, R. AND KEUSS, P. 1992. The role of vision in the temporal and spatial control of handwriting. Acta Psychologica 81, 269.286.
35. VAN DOORN, R. AND KEUSSc, P. 1993. Does production of letter strokes in handwriting benefit from vision? Acta Psychologica 82, 275.290.
36. WELCH, R. 1999. Meaning, attention, and the "unity assumption" in the intersensory bias of spatial and temporal perceptions. In Cognitive Contributions to the Perception of Spatial and Temporal Events, Elsevier.
37. WOBBROCK, J. O., MYERS, B. A., AND KEMBEL, J. A. 2003. Edgewrite: A stylus-based text entry method designed for high accuracy and stability of motion. In Proceedings of the ACM Symposium on User Interface Software and Technology. ACM, New York, 61-70.
38. WOODS, D. 1995. The alarm problem and directed attention in dynamic fault management. Ergonomics 38, 11, 2371-2394.
39. WRIGHT, C. E. 1990. Generalized motor programs: Reexamining claims of effector independence in writing. In Attention and Performance XIII, Erlbaum, Hillsdale, NJ, 294-320.
40. YOST, W. A. 1994. Fundamentals of Hearing: An Introduction 3rd Ed. Academic Press, New York.
41. ZHAI, S. AND KRISTENSSON, P.-O. 2003. Shorthand writing on stylus keyboard. In Proceedings of the Conference on Human Factor in Computing Systems. ACM, New York, 97-104.