Gestural attributions as semantics in user interface sound design

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5934 LNAI, Issue , 2009, Pages 257-268

  Tuuri, Kai ^a  

^a UNIVERSITY OF JYVÄSKYLÄ   (Finland)

Author keywords

Gestures; Semantics; Sound design; User interfaces

Indexed keywords

BODY MOVEMENTS; GESTURES; HUMAN COGNITION; LITERATURE REVIEWS; SOUND DESIGNS; THEORETICAL FRAMEWORK;

DESIGN; HUMAN COMPUTER INTERACTION; KNOWLEDGE MANAGEMENT; SEMANTICS;

USER INTERFACES;

EID: 78650370518     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-12553-9_23     Document Type: Conference Paper

References (29)

1. Mott, R.L.: Sound effects: Radio, TV and Film. Focal Press, Boston (1990).
2. Leman, M.: Embodied Music Cognition and Mediation Technology. MIT Press, Cambridge (2008).
3. Shannon, C.E., Weaver, W.: The Mathematical Theory of Communication. The University of Illinois Press, Urbana (1949).
4. Czaja, S.J.: Systems design and evaluation. In: Salvendy, G. (ed.) Handbook of human factors and ergonomics, 2nd edn., pp. 17-40. Wiley, New York (1997).
5. Bannon, L.J.: A human-centred perspective on interaction design. In: Pirhonen, A., Isomäki, H., Roast, C., Saariluoma, P. (eds.) Future interaction design, pp. 31-51. Springer, Heidelberg (2005).
6. Brewster, S., Wright, P., Edwards, A.: A detailed investigation into the effectiveness of earcons. In: Kramer, G. (ed.) Auditory display, pp. 471-498. Addison-Wesley, Reading (1994).
7. Rocchesso, D., Serafin, S., Behrendt, F., Bernardini, N., Bresin, R., Eckel, G., Franinovic, K., Hermann, T., Pauletto, S., Susini, P., Visell, Y.: Sonic interaction design: sound, information and experience. In: CHI 2008 extended abstracts on Human factors in computing systems. ACM Press, New York (2008).
8. Rizzolatti, G., Arbib, M.A.: Language within our grasp. Trends in Neurosciences 21, 188-194 (1998).
9. Svanaes, D.: Kinaesthetic thinking. Computers in Human Behavior 13(4), 443-463 (1997).
10. Gibson, J.J.: The ecological approach to visual perception. Houghton Mifflin, Boston (1979).
11. Varela, F., Thompson, E., Rosch, E.: The Embodied Mind. MIT Press, Cambridge (1991).
12. Rizzolatti, G., Craighero, L.: The mirror-neuron system. Annual Review of Neuroscience 27, 169-192 (2004).
13. Gallese, V., Eagle, M.N., Migone, P.: Intentional Attunement: Mirror Neurons and the Neural Underpinnings of Interpersonal Relations. J. Am. Psychoanal. Assoc. 55(1), 131-175 (2007).
14. Kohler, E., Keysers, C., Umiltá, M.A., Fogassi, L., Gallese, V., Rizzolatti, G.: Hearing sounds, understanding actions: action representation in mirror neurons. Science 297, 846-848 (2002).
15. Merleau-Ponty, M.: Phenomenology of Perception. Routledge, London (1945/1996).
16. Johnson, M.: The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason. University of Chicago, Chicago (1987).
17. Almäng, J.: Intentionality and intersubjectivity. Ph.D. thesis, Goteborg. Goteborg Universitet, Sweden (2007).
18. Scherer, K.R., Bänziger, T.: Emotional expression in prosody: a review and an agenda for future research. In: Proc. of SP 2004, Nara, Japan, pp. 359-366 (2004).
19. Brunswik, E.: Perception and the representative design of psychological experiments, 2nd edn. University of California Press, Berkeley (1956).
20. Searle, J.R.: Mind, language and society. Basic Books, New York (1998).
21. Juslin, P.N., Laukka, P.: Communication of emotions in vocal expression and music performance: Different channels, same code? Psych. Bull. 129(5), 770-814 (2003).
22. Tuuri, K., Pirhonen, A., Välkkynen, P.: Bodily Engagement in Multimodal Interaction: A Basis for a New Design Paradigm? In: Kurkovsky, S. (ed.) Multimodality in Mobile Computing and Mobile Devices. IGI Global, Hershey (2009).
23. Godøy, R.I.: Gestural-sonorous objects: embodied extensions of Schaeffer's conceptual apparatus. Organised Sound 11(02), 149-157 (2006).
24. Avanzini, F., Serafin, S., Rocchesso, D.: Friction sounds for sensory substitution. In: Proc. of ICAD 2004, Sydney, Australia (2004).
25. Vitale, R., Bresin, R.: Emotional Cues in Knocking Sounds. In: Proc. of ICMPC 10 (abstract only), Sapporo, Japan, p. 276 (2008).
26. Fernald, A.: Human maternal vocalizations to infants as biologically relevant signals: An evolutionary perspective. In: Barkow, J., Cosmides, L., Tooby, J. (eds.) The Adapted Mind: Evolutionary Psychology and the Generation of Culture, pp. 391-428. Oxford University Press, Oxford (1992).
27. Tuuri, K., Eerola, T.: Could function-specific prosodic cues be used as a basis for non-speech user interface sound design? In: Proc. of ICAD 2008, Paris, France (2008).
28. Feyereisen, P., de Lannoy, J.-D.: Gestures and speech: Psychological investigations. Cambridge University Press, New York (1991).
29. Tuuri, K., Pirhonen, A., Eerola, T.: Design and Evaluation of Prosody Based Non- Speech Audio Feedback for Physical Training Application (journal submission).