Earpod: Eyes-free menu selection using touch input and reactive audio feedback

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2007, Pages 1395-1404

  Zhao, Shengdong ^a   Dragicevic, Pierre ^a   Chignell, Mark ^a   Balakrishnan, Ravin ^a   Baudisch, Patrick ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Auditory menu; Gestural interaction

Indexed keywords

AUDIO ACOUSTICS; INTERACTIVE COMPUTER GRAPHICS; OPTICAL FEEDBACK; STATIC ANALYSIS; USER INTERFACES;

AUDITORY FEEDBACK; AUDITORY MENU; EARPOD; GESTURAL INTERACTIONS;

VOICE ACTIVATED INPUT DEVICES;

EID: 35348816864     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1240624.1240836     Document Type: Conference Paper

References (45)

1. KidsClick! web search for kids by librarians: http://sunsite.berkeley. edu/KidsClick!/.
2. Wikipedia: http://www.wikipedia.org/.
3. Barry, A. (1997). SpeechSkimmer: a system for interactively skimming recorded speech. ACM Transactions on Computer-Human Interaction, 4(1). p. 3-38.
4. Bernstein, L. (1997). Detection and discrimination of interaural disparities: Modern earphone-based studies, in Binaural and Spatial Hearing in Real and Virtual Environments, R.H. Gilkey et. al. Editors. Lawrence Erlbaum. p. 117-138.
5. Berry, G. (1997). The Esterel Primer. Technical report, Ecole des Mines de Paris and INRIA.
6. Blattner, M., Sumikawa, D., and Greenberg, R. (1989). Earcons and icons: Their structure and common design principles. Human Computer Interaction, 4(1). p. 11-44.
7. Brewster, S., Lumsden, J., Bell, M., Hall, M., and Tasker, S. (2003). Multimodal 'eyes-free' interaction techniques for wearable devices. ACM CHI Conference on Human Factors in Computing Systems, p. 473-480.
8. Brewster, S. (1998). Using nonspeech sounds to provide navigation cues. ACM Transactions on Computer-Human Interaction. 5(3). p. 224-259.
9. Brewster, S., and Cryer, P. (1999). Maximising Screen Space on Mobile Computing Devices. ACM CHI Conference on Human Factors in Computing Systems (Extended Abstracts), p. 224-225.
10. Brewster, S., Wright, P., and Edwards, A. (1993). An evaluation of earcons for use in auditory human-computer interfaces. ACM CHI Conference on Human Factors in Computing Systems, p. 222-227.
11. Callahan, J., Hopkins, D., Weiser, M. and Shneiderman, B. (1988). An empirical comparison of pie vs. linear menus. ACM CHI Conference on Human Factors in Computing Systems, p. 95-100.
12. Doel, K., and Pai, D. (2001). A Java audio synthesis system for programmers. International Conference on Auditory Display.
13. Gaver, W. (1989). The Sonic Finder: An interface that uses auditory icons. Human Computer Interaction, 4(1). p. 67-94.
14. Gaver, W., and Smith, R. (1991). Auditory icons in large-scale collaborative environments. ACM SIGCHI Bulletin, 23(1). p. 96.
15. Guo, J., and Guo, A. (2005). Crossmodal interaction between olfactory and visual learning in Drosophik Science, 309. p. 307-310.
16. Harrison, B., Fishkin, K., Gujar, A., Mochon, C., and Want, R. (1998). Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. ACM CHI Conference on Human Factors in Computing Systems, p. 17-24.
17. Kurtenbach, G. (1993). The design and evaluation of marking menus. Ph.D. Thesis, University of Toronto.
18. Liao, C., Guimbretiere, F., and Loeckenhoff, C. (2006). Pentop feedback for paper-based interfaces. ACM UIST Symposium on User Interface Software and Technology, p. 201-210.
19. Luk, J., Pasquero, J., Little, J., MacLean, K., Levesque, V., Hayward, V. (2006). A role for haptics in mobile interaction: initial design using a handheld tactile display prototype. ACM CHI Conference on Human Factors in Computing Systems, p. 171-180.
20. Marics, M., and Engelbeck, G. (1997). Designing voice menu applications for telephones, in Handbook of Human-Computer Interaction, Helander, M., Landauer, T., and Prabhu, P. Editors. Elsevier, p. 1085-1102.
21. Miller, D. (1981). The depth/breadth tradeoff in hierarchical computer menus. Human Factors Society Conference, p. 296-300.
22. Minoru, K., Chris, S. (1997). Dynamic SoundScape: mapping time to space for audio browsing. ACM CHI Conference on Human Factors in Computing Systems, p. 194-201.
23. Mynatt, E. (1995). Transforming graphical interfaces into auditory interfaces. ACM CHI Conference Companion on Human Factors in Computing Systems, p. 67-68.
24. Norman, K. (1991). The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface. Ablex Publishing Corporation.
25. Oulasvirta, A., Tamminen, S., Roto, V., and Kuorelahti, J. (2005). Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI. ACM CHI Conference on Human Factors in Computing Systems, p. 919-928.
26. Paap, K., and Cooke, N. (1997). Designing menus, in Handbook of Human-Computer Interaction, Helander, M., Landauer, T., and Prabhu, P. Editors. Elsevier, p. 533-572.
27. Pascoe, J., Ryan, N., and Morse, D. (2000). Using while moving: HCI issues in fieldwork environments. ACM Transactions on Computer-Human Interaction, 7(3). p. 417-437.
28. Pauws, S., Bouwhuis, D., and Eggen, B. (2000). Programming and enjoying music with your eyes closed. ACM CHI Conference on Human Factors in Computing Systems, p. 376-383.
29. Pirhonen, A., Brewster, S., and Holguin, C. (2002). Gestural and audio metaphors as a means of control for mobile devices. ACM CHI Conference on Human Factors in Computing Systems, p. 291-298.
30. Ranjan, A., Balakrishnan, R., and Chignell, M. (2006). Searching in audio: the utility of transcripts, dichotic presentation, and time-compression. ACM CHI Conference on Human Factors in Computing Systems, p. 721-730.
31. Resnick, P., and Virzi, R. (1992). Skip and scan: cleaning up telephone interface. ACM CHI Conference on Human Factors in Computing Systems, p. 419-426.
32. Roberts, T., and Engelbeck, G. (1989). The effects of device technology on the usability of advanced telephone functions. ACM CHI Conference on Human Factors in Computing Systems, p. 331-337.
33. Rosenberger, J., and Gaseo, M. (1983). Comparing location estimators: Trimmed means, medians, and trimean. in Understanding robust and exploratory data analysis, Hoagan, D., Mosteller, F., and Tukey, J., Editors. John Wiley: New York.
34. Roy, D. and Schmandt, C. (1996). NewsComm: a hand-held interface for interactive access to structured audio. ACM CHI Conference on Human Factors in Computing Systems, p. 173-180.
35. Sawhney, N., and Schmandt, C. (2000). Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. ACM Transactions Computer-Human Interactaction, 7(3). p. 353-383.
36. Schmandt, C. (1998). Audio hallway: a virtual acoustic environment for browsing. ACM UIST Symposium on User Interface Software and Technology, p. 163-170.
37. Schmandt, C., Lee, K., Kim, J., and Ackerman, M. (2004). Impromptu: managing networked audio applications for mobile users. ACM MobiSYS Conference on Mobile Systems, Applications, and Services, p. 59-69.
38. Shneiderman, B. (2004). Design the user interface: strategies for effective human-computer-interaction. Addison-Wesley.
39. Stifelman, L., Arons, B., and Schmandt, C. (2001). The audio notebook: paper and pen interaction with structured speech. ACM CHI Conference on Human Factors in Computing Systems, p. 182-189.
40. Stifelman, L., Arons, B., Schmandt, C., and Hulteen, E. (1993) VoiceNotes: a speech interface for a hand-held voice notetaker. ACM CHI Conference on Human Factors in Computing Systems, p. 179-186.
41. Suhm, B., Freeman, B., and Getty, B. (2001). Curing the menu blues in touch-tone voice interfaces. ACM CHI Conference on Human Factors in Computing Systems (Extended Abstracts), p. 131-132.
42. Witten, I., Cleary, J., and Greenberg, S. (1984). On frequency-based menu-splitting algorithms. International Journal of Man-Machine Studies, 21(2). p. 135-148.
43. Yin, M., and Zhai, S. (2006). The benefits of augmenting telephone voice menu navigation with visual browsing and search. ACM CHI Conference on Human Factors in Computing Systems, p. 319-328.
44. Zhao, S., Agrawala, M., and Hinckley, K. (2006). Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus. ACM CHI Conference on Human Factors in Computing Systems, p. 1077-1086.
45. Zhao, S., and Balakrishnan, R. (2004). Simple vs. compound mark hierarchical marking menus. ACM UIST Symposium on User Interface Software and Technology, p. 33-42.