A review of methods and frameworks for sonic interaction design: Exploring existing approaches

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5954 LNCS, Issue , 2010, Pages 41-67

  Brazil, Eoin ^a  

^a UNIVERSITY OF LIMERICK   (Ireland)

Author keywords

Auditory display; Auditory icons; Conceptual design; Design methods for sonic interaction; Earcons; Everyday sounds; Sonic interaction design

Indexed keywords

AUDITORY DISPLAY; AUDITORY ICONS; DESIGN METHODS FOR SONIC INTERACTION; EARCONS; EVERYDAY SOUND; SONIC INTERACTION DESIGN;

COMPUTER MUSIC; CONCEPTUAL DESIGN;

HUMAN COMPUTER INTERACTION;

EID: 78651227613     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-12439-6_3     Document Type: Conference Paper

References (82)

1. Widmer, G., Rocchesso, D., Välimäki, V., Erkut, C., Gouyon, F., Pressnitzer, D., Penttinen, H., Polotti, P., Volpe, G.: Sound and music computing: Research trends and some key issues. Journal of New Music Research 36(3), 169-184 (2007)
2. Melles, G.: An enlarged pragmatist inquiry paradigm for methodological pluralism in academic design research. Artifact 2(1), 3-11 (2008)
3. Morse, J.M.: Principles of mixed methods and multimethod research design. In: Handbook of Mixed Methods in Social and Behavioral Research. Sage, Thousand Oaks (2003)
4. Brazil, E., Fernström, J.M.: Investigating ambient auditory information systems. In: ICAD 2007, Montreal, Canada, June 26-29, 2007, pp. 326-333 (2007)
5. Brewster, S.A.: Non-speech auditory output. In: The Human Computer Interaction Handbook, pp. 220-239. Lawrence Erlbaum Associates, Mahwah (2002)
6. Mynatt, E.: Designing with auditory icons. In: Kramer, G., Smith, S. (eds.) Second International Conference on Auditory Display (ICAD 1994), Santa Fe, New Mexico, Santa Fe Institute, pp. 109-119 (1994)
7. Frauenberger, C., Stockman, T., Bourguet, M.L.: A survey on common practice in designing audio in the user interface. In: Proceedings of BCS HCI 2007, British HCI Group (2007)
8. Hug, D.: Towards a heremeneutics and typology of sound for interactive commodities. In: CHI'08 Workshop on Sonic Interaction Design: Sound, Information, and Experience, pp. 11-16 (2008)
9. Blauert, J., Jekosch, U.: Sound-quality evaluaiton: A multi-layered problem. Acta Acustica 83, 747-753 (1997)
10. Jekosch, U.: Assigning Meaning to Sounds - Semiotics in the Context of Product- Sound Design. In: Communication Acoustics, pp. 193-219. Springer, Berlin (2005)
11. Blauert, J.: Cognitive and aesthetic aspects of noise engineering. In: Proc. of Internoise 1996, Cambridge, USA (1996)
12. Cain, J.: Experience-based design: Towards a science of artful business innovation. Design Management Journal, 10-14 (Fall 1998)
13. Sanders, E.B.N., Dandavate, U.: Design for experience: New tools. In: Proc. of the First International Conference on Design and Emotion, pp. 87-92. Delft University of Technology, Delft (1999)
14. Mäkelä, A., Suri, J.F.: Supporting users' creativity: Design to induce pleasurable experiences. In: Proc. of the Conference on Affective Human Factors, pp. 387-391. Asean Academic Press, London (2001)
15. Jääskö, V., Mattelmäki, T.: Observing and probing. In: Proc. of DPPI 2003, ACM, New York (2003)
16. Alben, L.: Quality of experience: Defining the criteria for effective interaction design. Interactions 3(11) (May-June 1993)
17. Wright, P.C., McCarthy, J., Meekison, L.: Making Sense of Experience. In: Funology: From Usability to Enjoyment, pp. 43-53. Kluwer Academic Publishers, Dordrecht (2003)
18. Pine, B.J.I., Gilmore, J.H.: Welcome to the experience economy. Harvard Business Review 76(4), 97-105 (1998)
19. Overbeeke, C.J., Wensveen, S.A.G.: Reflection on pleasure: From perception to experience, from affordances to irresistibles. In: Proc. of DPPI 2003, pp. 92-97. ACM Press, New York (2003)
20. Kelly, G.A.: The Psychology of Personal Constructs, Norton (1955)
21. Fransella, F., Bell, R., Bannister, D.: A manual for repertory grid technique. John Wiley and Sons, Chichester (2004)
22. Bonebright, T.: Perceptual structure of everyday sounds: A multidimensional scaling approach. In: Hiipakka, J., Zacharov, N., Takala, T. (eds.) ICAD, Helsinki, Finland, Laboratory of Acoustics and Audio Signal Processing and the Telecommunications Software and Multimedia Laboratory, pp. 73-78. Univeristy of Helsinki, Espoo (2001)
23. Scavone, G.P., Lakatos, S., Cook, P.R.: Knowledge acquisition by listeners in a source learning task using physical models. J. Acoustic Society of America 107(5), 2817-2818 (2000)
24. Coleman, G.W.: The Sonic Mapping Tool. PhD thesis, University of Dundee (August 2008)
25. Barrass, S.: Auditory Information Design. PhD thesis, Australian National University (1997)
26. Tomico, O., Pifarré, M., Lloveras, J.: Needs, desires and fantasies: techniques for analyzing user interaction from a subjective experience point of view. In: Proceedings of NordiCHI 2006, pp. 4-9. ACM Press, New York (2006)
27. Fernström, M., Brazil, E., Bannon, L.: Hci design and interactive sonification for fingers and ears. IEEE Multimedia 12(2), 36-44 (2005)
28. Houix, O., Lemaitre, G., Misdariis, N., Susini, P.: Closing the loop of sound evaluation and design (closed) deliverable 4.1 everyday sound classification part 2 experimental classification of everyday sounds. FP6-NEST-PATH project no: 29085 Project Deliverable 4.1 Part 2, IRCAM (June 1, 2007)
29. Stone, H., Sidel, J.L.: Sensory Evaluation Practices, 3rd edn. Academic Press, London (2004)
30. Jaeger, S.R., Rossiter, K.L., Lau, K.: Consumer perceptions of novel fruit and familiar fruit: A repertory grid application. J. of the science of food and agriculture 85, 480-488 (2005)
31. Berg, J.: Opaque - a tool for the elicitation and grading of audio quality attributes. In: Proc. of the 118th Convention of the Audio Engineering Society, Barcelona, Spain (May 2005)
32. Choisel, C., Wickelmaier, F.: Extraction of auditory features and elicitation ofattributes for theassessment of multichannel reproduced sound. In: Proc. of the 118th Convention of the Audio Engineering Society, Barcelona, Spain (May 2005)
33. Fleshman Murphy, S.M.: Transition from Diagnosis to Treatment: Changes in Cancer Patients' Constructions of Physicians and Self during the Early Phase of Treatment. PhD thesis, Texas Tech University, Texas, USA (December 2008)
34. Ballas, J.A.: Common factors in the identification of an assortment of brief everyday sounds. J. of Experimental Psychology 19(2), 250-267 (1993)
35. McAdams, S., Winsberg, S., Donnadieu, S., Soete, G.D., Krimphoff, J.: Perceptual scaling of synthesized musical timbres: common dimensions, specificities and latent subject classes. Psychological Research 58, 177-192 (1995)
36. Brazil, E., Fernström, M., Ottaviani, L.: A new experimental technique for gathering similarity ratings for sounds. In: ICAD 2003, pp. 238-242 (2003)
37. 37.Özcan, E., Van Egmond, R.: Characterizing descriptions of product sounds. In: Proc. of ICAD 2005, Limerick, Ireland, pp. 55-60 (2005)
38. Schafer, R.M.: The soundscape- Our sonic environment and the tuning of the world. Destiny Books, Rochester (1977)
39. Gaver, W.W.: Using and creating auditory icons. In: Kramer, G. (ed.) Auditory Display: Sonification, Audification and Auditory interfaces, pp. 417-446. Addison- Wesley Publishing Company, Reading (1994)
40. DeWitt, A., Bresin, R.: Sound design for affective interactive. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 523-533. Springer, Heidelberg (2007)
41. Fernström, M., Brazil, E.: The shannon portal: Designing an auditory display for casual users in a public environment. In: Proc. of ICAD 2009, Copenhagen, Denmark (2009)
42. Bly, S.: Multivariate data analysis. In: Auditory Display: Sonification, Audification and Auditory interfaces, pp. 405-416. Addison-Wesley Publishing Company, Reading (1994)
43. Dourish, P.:Where the Action Is: The Foundations of Embodied Interaction (Bradford Books). The MIT Press, Cambridge (2004)
44. Fujita, M.: On activating human communications with pet-type robot aibo. Proc. of the IEEE 92(11), 1804-1813 (2004)
45. Turkle, S., Taggart, W., Kidd, C.D., Dasté, O.: Relational artifacts with children and elders: the complexities of cybercompanionship. Connection Science 18(4), 347-361 (2006)
46. Reeves, B., Nass, C.: The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press, Cambridge (1996)
47. Okunu, H.G., Nakadai, K., Kitano, H.: Realizing personality in audio-visually triggered non-verbal behaviors. In: Proc. of IEEE 2003 International Conference on Robotics and Automation, Taipei, Taiwan, September 14-19, 2003, pp. 392-397 (2003)
48. Kiesler, D.J.: The 1982 interpersonal circle: A taxonomy for complementarity in human transactions. Psychological Review 90(3), 185-214 (1983)
49. Russell, J.A., Weiss, A., Mendelsohn, G.A.: Affect grid: A single-item scale of pleasure and arousal. J. of Personality and Social Psychology 57(3), 493-502 (1989)
50. Barrass, S.: Clothing the homunculus. Visual Communication 7(3), 317-329 (2008)
51. Pellarin, L., Böttcher, N., Olsen, J.M., Gregersen, O., Serafin, S., Guglielmi, M.: Connecting strangers at a train station. In: Proc. of the 2005 conference on New Interfaces For Musical Expression (NIME), pp. 152-155 (2005)
52. Franinovic, K., Visell, Y.: Recycled soundscapes. In: Proc. of Designing interactive systems: processes, practices, methods, and techniques (DIS), pp. 317-317 (2004)
53. Rocchesso, D., Bresin, R.: Emerging sounds for disappearing computers. In: Streitz, N.A., Kameas, A.D., Mavrommati, I. (eds.) The Disappearing Computer. LNCS, vol. 4500, pp. 233-254. Springer, Heidelberg (2007)
54. Visell, Y., Franinovic, K., Scott, J.: Closing the loop of sound evaluation and design (closed) deliverable 3.2 experimental sonic objects: Concepts, development, and prototypes. FP6-NEST-PATH project no: 29085 Project Deliverable 3.2, HGKZ, Zurich (2008)
55. Rocchesso, D., Polotti, P.: Designing continuous multisensory interaction. In: Sonic Interaction Design: a Conf. Human Factors in Computing Systems (CHI) Workshop. COST Action IC061, April 2008, pp. 3-9 (2008)
56. Lemaitre, G., Houix, O., Visell, Y., Franinovic, K., Misdariis, N., Susini, P.: Toward the design and evaluation of continuous sound in tangible interfaces: The spinotron. International Journal of Human-Computer Studies 67, 976-993 (2009)
57. Diaper, D.: Understanding task analysis for human-computer interaction. In: Diaper, D., Stanton, N.A. (eds.) The Handbook of Task Analysis for Human-Computer Interaction, pp. 5-47. Lawrence Erlbaum Associates, Mahwah (2003)
58. Back, M., Des, D.: Micro-narratives in sound design: Context, character, and caricature in waveform manipulation. In: International Conference on Auditory Display ICAD 1996 (1996)
59. Hug, D.: Using a systematic design process to investigate narrative sound design strategies for interactive commodities. In: ICAD 2009, Copenhagen, Denmark, pp. 19-26 (2009)
60. Barrass, S.: A comprehensive framework for auditory display: Comments on barrass icad 1994. ACM Trans. On Applied Perception 2(4), 403-406 (2005)
61. Adcock, M., Barrass, S.: Cultivating design patterns for auditory displays. In: Proc. of ICAD 2004, Sydney, Australia, July 6-9 (2004)
62. Frauenberger, C., Stockman, T.: Auditory display design-an investigation of a design pattern approach. International Journal of Human-Computer Studies 67(11), 907-922 (2009)
63. Halpin, H., Robu, V., Shepherd, H.: The complex dynamics of collaborative tagging. In: Proc. of the 16th International Conference on World Wide Web (WWW 2007), pp. 211-220 (2007)
64. Brazil, E., Fernström, M.: Empirically based auditory display design. In: Sound and Music Computing Conference (SMC 2009), Porto, Portugal, pp. 7-12 (2009)
65. Papp, A.L.: Presentation of Dynamically Overlapping Auditory Messages in User Interfaces. Phd thesis, University of California (1997)
66. McGookin, D.: Understanding and Improving the Identification of Concurrently Presented Earcons. PhD thesis, University of Glasgow (2004)
67. Bonebright, T.L., Miner, N.E., Goldsmith, T.E., Caudell, T.P.: Data collection and analysis techniques for evaluating the perceptual qualities of auditory stimuli. ACM Transactions on Applied Perceptions 2(4), 505-516 (2005)
68. Vanderveer, N.J.: Ecological Acoustics- Human Perception of Environmental Sounds. Phd, University of Cornell (1979)
69. Jensen, J.J., Skov, M.B.: A review of research methods in children's technology design. In: Proc. of IDC 2005, Boulder, Colorado, USA, June 8-10 2005, pp. 80-87 (2005)
70. Hall, T.: Disappearing technology, emerging interactivity: a study of the design of novel computing to enhance children's learning experience in museums. PhD thesis, Department of Computer Science and Information Systems, University of Limerick (November 2004)
71. Sinclair, J., Hingston, P., Masek, M.: Considerations for the design of exergames. In: GRAPHITE 2007: Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia, Perth, Australia, pp. 289-295. ACM Press, New York (2007)
72. Lopez, M.J., Pauletto, S.: The design of an audio film for the visually impaired. In: Proc. of ICAD 2009, Copenhagen, Denmark (2009)
73. Barrass, S.: Haptic and Audio Interaction Design (chapter Haptic-Audio Narrative: from Physical Simulation to Imaginative Stimulation). In: McGookin, D., Brewster, S. (eds.) HAID 2006. LNCS, vol. 4129, pp. 157-165. Springer, Heidelberg (2006)
74. Hug, D.: Genie in a bottle: Object-sound reconfigurations for interactive commodities. In: Proc. of Audio Mostly Conference, Pitea, Sweden, pp. 56-63 (2008)
75. Chion, M.: Audio-Vision: Sound on Screen, 1st edn. Columbia University Press (1994)
76. Richard, F., Roussaire, V.: Sound design of the passenger compartment - process ad tool for the control of engine sound character. In: Proc. of "Les journées du design sonore (IRCAM, SFA)", Centre Georges Pompidou, Paris, October 13-15 (2004)
77. Le Nindre, B.: Brand sound identity: the case of sporty vehicles. In: Proc. of Les journées du design sonore (IRCAM, SFA)", Centre Georges Pompidou, Paris, October 13-15 (2004)
78. Tourila, H., Monteleone, E.: Sensory food science in the changing society: opportunities, needs, and challengers. In: Trends in Food Science and Technology (2008) (article in Press, Corrected Proof)
79. Moskowitz, H.R., Gofman, A.: Selling Blue Elephants: How to make great products that people want before they even know they want them. Wharton School Publishing, Upper Saddle River (2007)
80. Moskowitz, H.R., Hartmann, J.: Consumer research: creating a solid base for innovative strategies. Trends in Food Science and Technology 19, 581-589 (2008)
81. Wensveen, S.A.G., Overbeeke, K., Djajadiningrat, T.: Push me, shove me and i show you how you fell: recognising mood from emotionally rich interaction. In: Proc. of DIS 2002, pp. 335-340. ACM Press, London (2002)
82. Hassenzahl, M., Wessler, R.: Capturing design space from a user perspective: the repertory grid revisited. International Journal of Human-Computer Interaction 12(3,4), 441-459 (2000)