Exploring the use of structured musical stimuli to communicate simple diagrams: The role of context

International Journal of Human Computer Studies

Volumn 62, Issue 1, 2005, Pages 21-40

  Alty, James L ^a   Rigas, Dimitrios ^b  

^a MIDDLESEX UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF BRADFORD   (United Kingdom)

Author keywords

Auditory channel; Communication metaphors; Earcons; Graphics; Miusic; Structured musical stimuli; User interfaces

Indexed keywords

COMPUTER GRAPHICS; COMPUTER SOFTWARE; DATA PROCESSING; DATA STORAGE EQUIPMENT; MATHEMATICAL MODELS; NAVIGATION; USER INTERFACES;

AUDITORY CHANNELS; COMMUNICATION METAPHORS; EARCONS; STRUCTURED MUSICAL STIMULI;

COMPUTER MUSIC;

EID: 10644260566     PISSN: 10715819     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2004.08.003     Document Type: Article

References (51)

1. Alty, J.L., 1995. Can we use music in computer-human interaction. In: Kirby, M.A.R., Dix, A.J., Finlay, J.E. (Eds.), Proceedings of HCI'95, People and Computers X., pp. 409-423.
2. Alty, J.L., Rigas, D.I., 1998. Communicating graphical information to visually impaired users using structured musical stimuli: the role of context. In: CHI-98, in Human in Factors in Computing systems Los Angeles USA April 1998. ACM Press, New York, pp. 574-581.
3. Brewster, S.A., 1994. Providing a structured method for integrating non-speech audio into human-computer interfaces. Ph.D. Thesis, University of York, England, UK.
4. Brewster, S.A., 1998. Using earcons to improve the usability of a graphics package. In: Johnson, H., Nigay, L., Roast, C, (Eds.), Proceedings of HCI'98: People and Computers XIII, Sheffield, UK, Springer and British Computer Society, pp. 287-302.
5. Blattner, M.M., Sumikawa, D.A., Greenberg, R.M., 1989. Earcons and icons: their structure and common design principles. Human-Computer Interaction, vol. 4, Lawrence Erlbaum Associates, Inc., pp. 11-44.
6. Blattner, M.M., Greenberg, R.M., Kamegai, M., 1992. Listening to turbulence: an example of scientific audiolization. In: Blattner, M.M., Dannenberg, R.B. (Eds.), Multimedia Interface Design, pp. 87-102 (Chapter 6).
7. Brewster, S.A., 2002. Visualization tools for blind people using multiple modalities. Disability and Rehabilitation Technology 24 (11-12), 613-621.
8. Brewster, S.A., Wright, P.C., Dix, C., Edwards, A.D.N., 1995. The sonic enhancement of graphical buttons. In: Nordby, M., Helmersen, P., Gilmore, D., Arnesen, S. (Eds.), Proceedings of Interact'95, Lillehammer, Norway, Chapman & Hall, London, pp. 43-48.
9. Brown, L., Brewster, S.A., Ramloll, R., Reidel, B., Yu, W., 2002. Browsing modes for exploring sonified line graphs. In: Proceedings of British HCI 2002, vol. II, London, UK, BCS, pp. 2-5.
10. Cohen, M., 1993. Throwing, pitching and catching sound: audio window models and modes. Man-Machine Studies 39, 269-304.
11. Cohen, M., Ludwig, L.F., 1991. Multidimensional audio window management. Man-Machine Studies 34, 319-336.
12. Delis, D., Fleer, J., Kerr, P., 1978. Memory for music. Perception and Psychophysics 23, 215-218.
13. Deutsch, D., 1970. Tones and numbers: specificity of interference in short-term memory. Science 168, 1604-1665.
14. Deutsch, D., 1972. Mapping of interactions in the pitch memory store. Science 175, 1020-1022.
15. Deutsch, D., 1973. Interference in memory between tones adjacent in the musical scale. Experimental Psychology 100, 228-231.
16. Deutsch, D., 1980. The processing of structured and unstructured tonal sequences. Perception and Psychophysics 28, 381-389.
17. Deutsch, D., Feroe, J., 1975. Disinhibition in pitch memory. Perception and Psychophysics 17, 320-324.
18. Dufresne, A., Martial, O., Ramstein, C., 1995. Multimodal user interface system for blind and visually occupied users: ergonomie evaluation of the haptic and auditive dimensions. In: INTERACT 1995. Lillehammer, Norway, pp. 163-168.
19. Edwards, A.D.N., 1987. Adapting user interfaces for visually disabled users. Ph.D. Thesis, Open University, Milton Keynes, UK.
20. Edwards, A.D.N., 1989. Soundtrack: an auditory interface for blind users. Human Computer Interaction 4 (1), 45-66.
21. Edwards, A.D.N. (Ed.), 1995. Extra-ordinary Human-Computer Interaction. Cambridge University Press, Cambridge.
22. Kennedy, J.M., Gabias, P., Nicholls, A., 1991. Tactile pictures. In: The Psychology of Touch. Lawrence Erlbaum, Hillsdale, NJ., pp. 1-9.
23. Kennel, A.R., 1996. Audiograf: a diagram-reader for the blind. In: ASSETS '96, pp. 51-56.
24. Kurze, M., 1996. Studying and designing tactile drawings of real-world objects and scenes using a newly developed prototype set. In: Burger, D. (Ed.), Proceedings of the New Technologies in the Education of the Handicapped, Paris, Colloque INSERM, John Libbey Eurotext Ltd., pp. 257-260.
25. Ludwig, L.F., 1989. Real-time multi-media teleconferencing: integrating new technology. Technical report, Bellcore Integrated Media Architecture Laboratory, Red Bank, NJ., USA.
26. Ludwig, L.F., Pincever, N., 1989. Audio windowing and methods for its realisation. Technical Report Technical Memorandum TM-NPL-01 5361, Bell Communications Research.
27. Ludwig, L.F., Pincever, N., Cohen, M., 1990. Extending the notion of a window system in audio. IEEE Computer 23, 66-72.
28. Mansur, D.L., Blattner, M.M., Joy, K.I., 1985. Sound-graphs: a numerical data analysis method for the blind. In: 18th Hawaii International Conference on Systems Science, IEEE, New York, pp. 163-174.
29. Martial, O., Dufresne, A., 1993. Audicon: easy access to graphical user interfaces for blind persons, designing for and with people. In: HCI International 1993, Fifth International Conference on Human-Computer Interaction, Florida, USA, August 1993, pp. 808-813.
30. Martial, O., Garon, S., 1996. How the visually impaired learn to work with windows. In: Burger, D. (Ed.), Proceedings of the New Technologies in the Education of the Handicapped, Paris, Colloque INSERM, John Libbey Eurotext Ltd., pp. 249-255.
31. Miller, G.A., 1956. The magical number seven plus or minus two: some limitations on our capacity for processing information. Psychology Review 63, 81-97.
32. Mynatt, E.D., Weber, G., 1994. Nonvisual presentation of graphical user interfaces: contrasting two approaches. In: Proceedings of the CHI '94 Conference on Human Factors in Computer Systems, Boston, USA, ACM, New York, pp. 166-172.
33. Pitt, I.J., Edwards, A.D.N., 1991. Navigating the interface by sound for blind users. In: Diaper, D., Hammond, N. (Eds.), People and Computers, vol. VI. Cambridge University Press, Cambridge, pp. 373-383.
34. Raman, T.V., 1994. Emacspeak-Direct Speech Access. Proceedings of the Second Annual ACM Conference on Assistive Technologies (ASSETS '96), April 1996.
35. Raman, T.V., Krishnamoorthy, M.S., 1992. Congrats: a system for converting graphics to sound. Proceedings of IEEE on John's Hopkin's National Search for Computing Applications to Assist Persons with Disabilities. February, pp. 170-172.
36. Rigas, D.I., 1996. Guidelines for auditory interface design: an empirical investigation. Ph.D. Thesis, Loughborough University, Leicestershire, UK., 1996.
37. Rigas, D.I., Alty, J.L., 1997. The use of music in a graphical interface for the visually impaired. In: INTERACT-97, International Conference on Human-Computer Interaction, Sydney, Australia, Chapman & Hall, London, pp. 228-235.
38. Rigas, D.I., Alty, J.L., 1998. How can multimedia designers utilise timbre? In: Johnson, H., Nigay, L., Roast, C. (Eds.), Proceedings of HCI'98: People and Computers XIII, Sheffield, UK, Springer and British Computer Society, pp. 273-286.
39. Rigas, D.I., Alty, J.L., 2005. The rising pitch metaphor: an empirical study. International Journal of Human-Computer Studies, (in press).
40. Rigas, D.I., Alty, J.L., Long, F.W., 1997. Can music support interfaces to complex databases? In: EUROMICRO-97, New Frontiers of Information Technology, Budapest, Hungary, IEEE Computer Society, Silver Spring, MD, pp. 78-84.
41. Rigas, D.I., Kirby, M.A.R., O'Connel, D., 1999. Audiotest: utilising audio to communicate information in program debugging. In: Proceedings of HCI International '99 (the 8th International Conference on Human-Computer Interaction), Munich, Germany, Lawrence Erlbaum Associates, pp. 1293-1297.
42. Rigas, D.I., Memery, D., Hopwood, D., Rodrigues, M.A., 2000. Empirically derived issues in auditory information processing for mobile telephony. In: International Conference on Information Technology: Coding and Computing. Nevada, USA, IEEE, Computer Society, Silver Spring, MD, pp. 462-469.
43. Sloboda, J.A., 1985. The musical mind. The Cognitive Psychology of Music. Clarendon Press, Oxford, England.
44. Smith, S., Bergeron, R.D., Grinstein, G.G., 1992. Stereophonic and surface sound generation for exploratory data analysis. In: Blattner, M.M., Dannenberg, R.B. (Eds.), Multimedia Interface Design, pp. 173-182 (Chapter 11).
45. Sumikawa, D.A., Blattner, M.M., Joy, K.I., Greenberg, R.M., 1986. Guidelines for the syntactic design of audio cues in computer interfaces. In: Proceedings of the Nineteenth Annual Hawaii International Conference on System Sciences, Honolulu, Hawaii.
46. Vickers, P., Alty, J.L., 2002a. When bugs sing. Interacting with Computers 14 (6), 795-821.
47. Vickers, P., Alty, J.L., 2002b. Musical program auralisation: a structured approach to motif design. Interacting with Computers 14 (5), 456-484.
48. Vickers, P., Alty, J.L., 2002c. Using music to communicate computing information. Interacting with Computers 14 (5), 434-455.
49. Wilding, J.M., 1982. Perception-From Sense to Object. Hutchinson, London.
50. Yu, W., Brewster, S.A., 2003. Evaluation of multimodal graphs for blind people. Journal of Universal Access in the Information Society 2 (2), 105-124.
51. Yu, W., Kangas, K., Brewster, S.A., 2003. Web-based haptic applications to allow blind people to create virtual graphs. In: Proceedings of 11th Haptic Symposium, Los Angeles, CA, IEEE Press, New York, 318-325.