Using music to communicate computing information

Interacting with Computers

Volumn 14, Issue 5, 2002, Pages 435-456

  Vickers, Paul ^a   Alty, James L ^b  

^a NORTHUMBRIA UNIVERSITY   (United Kingdom)

^b LOUGHBOROUGH UNIVERSITY   (United Kingdom)

Author keywords

Auditory display; Communication; Music; Program auralisation; Visualisation

Indexed keywords

ACOUSTIC WAVE EFFECTS; AUDIO SYSTEMS; COMMUNICATION CHANNELS (INFORMATION THEORY); HIGH LEVEL LANGUAGES; HUMAN COMPUTER INTERACTION; IMAGE SENSORS; VISUALIZATION;

PROGRAM AURALISATION;

COMPUTER MUSIC;

EID: 0036811721     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0953-5438(02)00003-6     Document Type: Article

References (53)

1. Alty J.L. Can we use music in computer-human communication? Kirby M.A.R., Dix A.J., Finlay J.E., People and Computers vol. X. 1995;409-423 Cambridge University Press, Cambridge.
2. Alty, J.L., Rigas, D.I., 1998. Communicating graphical information to blind users using music: the role of context in design. Proceedings of CHI 98 Conference on Human Factors in Computing Systems, Los Angeles, CA, April 18-23, ACM Press, ISBN 0-201-30987-4.
3. Blattner M.M., Sumikawa D.A., Greenberg R.M. Earcons and icons: their structure and common design principles. Human Computer Interaction. 4:1989;11-44.
4. Blattner M.M., Greenberg R.M., Kamegai M. Listening to turbulence: an example of scientific audiolization. Blattner M.M., Dannenberg R.M., Multimedia Interface Design. 1992;87-102 ACM Press, Wokingham.
5. Bly, S.A., 1982. Sound and computer information presentation. PhD Thesis. University of California, Davis, 1982.
6. Boardman, D.B., Mathur, A.P., 1993. Preliminary Report on Design Rationale, Syntax, and Semantics of LSL: A Specification Language for Program Auralization. Department of Computer Sciences, Purdue University, W. Lafayette, IN.
7. Bock, D.S., 1995. Auditory software fault diagnosis using a sound domain specification language. PhD Thesis. Syracuse University, Syracuse, 1995.
8. Braut, C., 1994. The musician's guide to MIDI Sybex, Alemeda, CA. ISBN 0-7821-1285-4.
9. Brewster, S.A., 1996. A sonically enhanced interface toolkit. Proceedings of ICAD '96 Third International Conference on Auditory Display, Palo Alto, Xerox PARC, Palo Alto, CA, November 4-6.
10. Brewster S. Navigating telephone-based interfaces with earcons. Thimbleby H., O'Conaill B., Thomas P., People and Computers. vol. XII:1997;39-56 Springer, Berlin.
11. Brewster, S., 1998. Sonically enhanced drag and drop. Proceedings of ICAD '98 Fifth International Conference on Auditory Display. British Computer Society, Glasgow, November 1-4, ISBN 1 902505 05 0.
12. Brewster S., Crease M. Making menus musical. Howard S., Hammond J., Lingaard G., Proceedings of Interact '97. 1997;389-396 Chapman & Hall, London.
13. Brewster S.A., Wright P.C., Edwards A.D.N. A detailed investigation into the effectiveness of earcons. Kramer G., Auditory Display. 1994;471-498 Addison-Wesley, Reading, MA.
14. Brown M.H., Hershberger J. Color and sound in algorithm animation. Computer. 25:(12):1992;52-63.
15. Buxton B. Using our ears: an introduction to the use of nonspeech audio cues. Farrel E.J., Extracting Meaning from Complex Data: Processing, Display, Interaction. vol. 1259:1990;124-127 SPIE, San Jose, CA.
16. Crowder R.G., Pitt M.A. Research on memory/imagery for musical timbre. Reisberg D., Auditory Imagery. 1992;29-44 Lawrence Erlbaum Associates, Hillsdale, NJ.
17. Deutsch D., The Psychology of Music. 1998;Academic Press, New York. ISBN 0122135652.
18. Deutsch D., Feroe J. The internal representation of pitch sequences in tonal music. Psychological Review. 88:1981;503-522.
19. Dibben N. The cognitive reality of hierarchic structure in tonal and atonal music. Music Perception. 12:(1):1994;1-26.
20. DiGiano, C.J., Baecker, R.M., 1992. Program auralization: sound enhancements to the programming environment. Proceedings of Graphics Interface '92.
21. Dufresne, A., Martial, O., Ramstein, C., Mabilleau, P., 1996. Sound, space and metaphor: multimodal access to windows for blind users. Proceedings of the ICAD '96 Third International Conference on Auditory Display, Palo Alto, Xerox PARC, Palo Alto, CA, November 4-6.
22. Edwards A.D.N. Soundtrack: an auditory interface for blind users. Human Computer Interaction. 4:(1):1989;45-66.
23. Gaver W.W. Auditory icons: using sound in computer interfaces. Human Computer Interaction. 2:1986;167-177.
24. Gaver W.W. The sonicfinder: an interface that uses auditory icons. Human Computer Interaction. 4:(1):1989;67-94.
25. Gaver, W.W., Smith, R.B., O'Shea, T., 1991. Effective sounds in complex systems: the ARKola simulation. Proceedings of the CHI '91 Conference on Human Factors in Computing Systems, ACM Press/Addison-Wesley, New Orleans.
26. Halpern A.R. Musical aspects of auditory imagery. Reisberg D., Auditory Imagery. 1992;1-28 Lawrence Erlbaum Associates, Hillsdale, NJ.
27. Hankinson, J.C.K., Edwards, A.D.N., 1999. Designing earcons with musical grammars. ACM Special Interest Group on Computers and the Physically Handicapped (ACM SIGCAPH), vol. 65, pp. 16-20.
28. Hankinson, J.C.K., Edwards, A.D.N., 2000. Musical phrase-structured audio communication. Proceedings of ICAD 2000 Sixth International Conference on Auditory Display, International Community for Auditory Display, Atlanta, GA, 2-5 April, ISBN 0-9670904-1-5.
29. Hotchkiss, R.S., Wampler, C.L., 1991. The auditorialization of scientific information. Proceedings of Supercomputing '91, ACM Press.
30. Jackson, J.A., Francioni, J.M., 1992. Aural signatures of parallel programs. Proceedings of the 25th Hawaii International Conference on System Sciences.
31. Jackson J.A., Francioni J.M. Synchronization of visual and aural parallel program performance data. Kramer G., Auditory Display. 1994;291-306 Addison-Wesley, Reading, MA.
32. Jameson D.H. Sonnet: audio-enhanced monitoring and debugging. Kramer G., Auditory Display. 1994;253-265 Addison-Wesley, Reading, MA.
33. Kennel, A.R., 1996. AudioGraf: a diagram-reader for the blind. Second Annual ACM Conference on Assistive Technologies. pp. 51-56.
34. Kramer G. Preface. Kramer G., Auditory Display. 1994;xxiii-xxxviii Addison-Wesley, Reading, MA.
35. Lamont, A., Dibben, N., 1997. Perceived similarity of musical motifs: an exploratory study. Proceedings of SIMCAT '97. Edinburgh.
36. Leplatre, G., Brewster, S.A., 1998. An investigation of using music to provide navigation cues. Proceedings of ICAD '98 Fifth International Conference on Auditory Display. British Computer Society, Glasgow, November 1-4, ISBN 1 902505 05 0.
37. Lerdahl F., Jackendoff R. A Generative Theory Of Tonal Music. 1983;MIT Press, Cambridge, MA.
38. Martial, O., Dufresne, A., 1993. Audicon: easy access to graphical user interfaces for blind persons - Designing for and with people. Proceedings of the Fifth International Conference on Human-Computer Interaction, vol. 2, pp. 808-813.
39. Mathur, A.P., Boardman, D.B., Khandelwal, V., 1994. LSL: a specification language for program auralization. Proceedings of the ICAD '94 Second International Conference on Auditory Display. Santa Fe Institute, Santa Fe, NM, November 7-9.
40. Mayer-Kress G., Bargar R., Choi I. Musical structures in data from chaotic attractors. Kramer G., Auditory Display. 1994;341-368 Addison-Wesley, Reading, MA.
41. Mezrich J.J., Frysinger S., Slivjanovski R. Dynamic representation of multivariate time series data. Journal of the American Statistical Association. 79:(385):1984;34-40.
42. Mynatt E.D. Auditory presentation of graphical user interfaces. Kramer G., Auditory Display. 1994;533-556 Addison-Wesley, Reading, MA.
43. Mynatt E.D. Designing auditory cues for mercator. Howard S., Hammond J., Lingaard G., Proceedings of the Interact '97. 1997;236-243 Chapman & Hall, London.
44. Narmour E. Some major theoretical problems concerning the concept of hierarchy in the analysis of tonal music. Music Perception. 1:(2):1984;129-199.
45. Parncutt R. Harmony: A Psychoacoustical Approach. 1989;Springer, Berlin.
46. Rigas, D.I., Alty, J.L., 1997. The use of music in a graphical interface for the visually impaired. In: Howard, S., Hammond, J., Lingaard, G. (Eds.), Proceedings of Interact '97, Sydney. Chapman & Hall, London.
47. Schenker H. Free Composition. 1979;Longman, London.
48. Sloboda J.A., The Psychology of Music. 1985;Clarendon Press, Oxford.
49. Smith, S., 1990. Human perception and visualization. Proceedings of Visualization '90. IEEE Computer Society Press.
50. Sonnenwald, D.H., Gopinath, B., Haberman, G.O., Keese, W.M., III, Myers, J.S., 1990. InfoSound: an audio aid to program comprehension. Proceedings of the 23rd Hawaii International Conference on System Sciences. IEEE Computer Society Press.
51. Swain J.P. The need for limits in hierarchical theories of music. Music Perception. 4:1986;121-148.
52. Walker, B.N., Kramer, G., Lane, D.M., 2000. Psychophysical scaling of sonification mappings. Proceedings of the ICAD 2000 Sixth International Conference on Auditory Display. International Community for Auditory Display, Atlanta, GA, 2-5 April, ISBN 0-9670904-1-5.
53. Williams D.M.L., Duncumb I., Alty J.L. Matching goals to tasks: an approach based on expressiveness. Cunningham S., Sasse A., Winder R., People and Computers vol. XI. 1996;333-349 Springer, London.