An enhanced musical experience for the deaf: Design and evaluation of a music display and a haptic chair

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2009, Pages 337-346

  Nanayakkara, Suranga ^a   Taylor, Elizabeth ^a   Wyse, Lonce ^a   Ong, S H ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Assistive technology; Deaf; Haptic. music visualisation

Indexed keywords

AUDITION; HUMAN ENGINEERING;

ASSISTIVE TECHNOLOGY; COMPUTER DISPLAY; DEAF; DESIGN AND EVALUATIONS; MULTI DIMENSIONAL; PROTOTYPE SYSTEM; VISUAL DISPLAY; VISUAL EFFECTS;

AUDIO ACOUSTICS;

EID: 84860817130     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1518701.1518756     Document Type: Conference Paper

References (25)

1. Can you feel it? Speaker allows deaf musicians to feel music, Brunel University press release. http://www.brunel.ac.uk/news/pressoffice/ pressreleases/2005/cdata/october/vibrato.
2. Chew E. Modelling tonality: Applications to music cognition. In Proc. of Cog Sci 2001, 206-211.
3. Csikszentmihalyi, M. Beyond boredom and anxiety, Jossey-bass Press, San Francisco, CA, USA, 1975.
4. Evans, B. Foundations of a visual music. Computer Music Journal 29, 4 (2005), 11-24.
5. Fischinger, O. Ten films, Los Angeles, Center for Visual Music CVM (2006).
6. Glennie, D. E. Hearing essay. http://www.evelyn.co.uk/live/hearing-essay. htm.
7. Gunther, E., Davenport, G., and O'Modhrain, S. Cutaneous grooves: Composing for the sense of touch. In Proc. ofNIME 2002, 1-6.
8. Haptic chair with visual input: Music excerpts used in the experiment. http://artsandcreativitylab.org/publication/chi09-music-tracks.
9. Ho-Ching, F. W., Mankoff, J., and Landay, J. A. Can you see what I hear? The design and evaluation of a peripheral sound display for the deaf. In Proc. of CHI 2003, ACM Press (2003), 161-168.
10. Jone, A., and Tyler, C. Neuroscience, history and the arts synesthesia: Is F-sharp colored Violet? Journal of the History of the Neurosciences, 13, 1 (2004), 58-65.
11. Jackson, S. A., and Marsh, H. W. Development and validation of a scale to measure optimal experience: The flow state scale. Journal of Sport and Exercise Psychology, 18 (1996), 17-35.
12. Jones, R., and Nevile, B. Creating visual music in jitter: Approaches and techniques. Computer Music Journal, 29, 4 (2005), 55-70.
13. Karam, M., Nespoli, G., Russo, F., and Fels, D. I. Modelling perceptual elements of music in a vibrotactile display for deaf users: A field study. In Proc. of ACHl 2009.
14. Karam, M., Russo, F., Branje, C., Price, E., and Fels, D. I. Towards a model human cochlea: Sensory substitution for crossmodal audio-tactile displays. In Proc. of GI 2008, 267-274.
15. Lenhardt, M., Skellett, R., Wang, P., and Clarke, A. Human ultrasonic speech perception. Science, 253 (1991), 82-85.
16. Lowis, M. J. Music as a trigger for peak experiences among a college staff population, Creativity Research Journal, 14, 3 (2002), 351-359.
17. Marks, L. E. On associations of light and sound: The mediation of brightness, pitch, and loudness. American Journal of Psychology, 87, 1-2 (1974), 173-188.
18. Matthes, O. Flashserver external for Max/MSP, version 1.1, 2002. http://www.nullmedium.de/dev/flashserver.
19. Matthews, T., Fong, J., and Mankoff, J. Visualizing non-speech sounds for the deaf. In Proc. of ASSETS (2005), 52-59.
20. Mitroo, J. B., Herman, N., and Badler, N. I. Movies from music: Visualizing musical compositions. In Proc. ofSIGGRAPH 1979, ACM Press (1979), 218-225.
21. Nanayakkara, S. C., Taylor, E., Wyse, L. L., and Ong, S. H. Towards building an experiential music visualizer. In proc. oflClCS 2007, IEEE (2007), 1-5.
22. Palmer, R. Tac-tile sounds system (TTSS). http://www.kolumbus.fi/riitta. lahtinen/tactile.html.
23. Scheirer, E. Music listening systems. Ph.D. dissertation, Massachusetts Institute of Technology (2000).
24. Shibata, D. Brains of deaf people "hear" music. International Arts-Medicine Association Newsletter, 16, 4(2001). http://www.iamaonline.org/ Dec01IAMA-NL.PDF.
25. Verillo, R. T. Vibration sensing in humans. Music Perception, 9, 3, (1991), 281 -302.