Towards a model human cochlea: sensory substitution for crossmodal audio-tactile displays

Proceedings - Graphics Interface

Volumn , Issue , 2008, Pages 267-274

  Karam, Maria ^a   Russo, Frank ^b   Branje, Carmen ^a   Price, Emily ^a   Fels, Deborah I ^a  

^a Centre for Learning Technologies

^b Department of Psychology ^*

Author keywords

H.1.2 Information Systems ; H5.2 Information interfaces and presentations ; Human information processing; Software psychology ; User Interfaces Haptic I O; User Machine Systems Human factors

Indexed keywords

H.1.2 [INFORMATION SYSTEMS]; H5.2 [INFORMATION INTERFACES AND PRESENTATIONS]; HUMAN INFORMATION PROCESSING; SOFTWARE PSYCHOLOGY]; USER/MACHINE SYSTEMS [HUMAN FACTORS;

AUDIO ACOUSTICS; BIONICS; DESIGN; HUMAN ENGINEERING; INFORMATION SYSTEMS;

HAPTIC INTERFACES;

EID: 63549117037     PISSN: 07135424     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Emotichair: Emotional music excerpts used in the experiment. http://ryerson.ca/ m2karam/MusicTracks.html, 2007.
2. Backchair. Purdue: Backchair project. Web Resource, 2007.
3. D. Birnbaum and M. Wanderley. A systematic approach to musical vibrotactile feedback. In In Proceedings of the 2007 International Computer Music Conference (ICMC-07), 2007.
4. S. Brewster and L. M. Brown. Tactons: structured tactile messages for non-visual information display. In AU1C '04: Proceedings of the fifth conference on Australasian user interface, pages 15-23, Darlinghurst, Australia, Australia, 2004. Australian Computer Society, Inc.
5. A. Chang, S. O'Modhrain, R. Jacob, E. Gunther, and H. Ishii. Corn-touch: design of a vibrotactile communication device. In DIS '02: Proceedings of the 4th conference on Designing interactive systems, pages 312-320, New York, NY, USA, 2002. ACM.
6. P. Ekman. The Handbook of Cognition and Emotion, chapter Basic Emotions, pages 45-60. John Wiley & Sons, Ltd, Sussex, U.K., 1999.
7. E. Gunther, G. Davenport, and S. O'Modhrain. Cutaneous grooves: composing for the sense of touch. In NIME '02: Proceedings of the 2002 conference on New interfaces for musical expression, pages 1-6, Singapore, Singapore, 2002. National University of Singapore.
8. D. Holten, J. J. V. Wijk, and J.-B. Martens. A perceptually based spectral model for isotropic textures. ACM Trans. Appl. Percept., 3(4):376-398, 2006.
9. G. Hie and W. Thompson. A comparison of acoustic cues in music and speech for three dimensions of affect. Music Perception, 23:319-329, 2006.
10. A. Israr, H. Z. Tan, and C. M. Reed. Frequency and amplitude discrimination along the kinesthetic-cutaneous continuum in the presence of masking stimuli. The Journal of the Acoustical Society of America, 120(5):2789-2800, 2006.
11. K. Kaczmarek, J. Webster, P. Bach-y Rita, and W. Tompkins. Elec-trotactile and vibrotactile displays for sensory substitution systems. Biomedical Engineering, IEEE Transactions on, 38(1): 1-16, Jan 1991.
12. K. Kahol and S. Panchanathan. Distal object perception through haptic user interfaces for individuals who are blind. SIGACCESS Access. Comput., (84):3O-33, 2006.
13. K. Kallinen. Emotional ratings of music excerpts in the western art music repertoire and their self-organisation in the kohonen neural network. Psychology of Music, 33(4):373-393, 2005.
14. V. Lévesque, J. Pasquero, V. Hay ward, and M. Legault. Display of virtual braille dots by lateral skin deformation: feasibility study. ACM Trans. Appl. Percept., 2(2): 132-149, 2005.
15. J. G. Linvill and J. C. Bliss. A direct translation reading aid for the blind. Proceedings of the IEEE, 54:40 -51, 1966.
16. M. T. Marshall and M. M. Wanderley. Vibrotactile feedback in digital musical instruments. In NIME '06: Proceedings of the 2006 conference on New interfaces for musical expression, pages 226-229, Paris, France, France, 2006. KCAM &8212; Centre Pompidou.
17. T. L. McDaniel and S. Panchanathan. A visio-haptic wearable system for assisting individuals who are blind. SIGACCESS Access. Comput., (86): 12-15, 2006.
18. J. B. Mitroo, N. Herman, and N. I. Badler. Movies from music: Visualizing musical compositions. In SIGGRAPH '79: Proceedings of the 6th annual conference on Computer graphics and interactive techniques, pages 218-225, New York, NY, USA, 1979. ACM Press.
19. J. Pickett. Tactual communication of speech sounds to the deaf. Journal of Speech and Hearing Research, (6):207-222, 1963.
20. Pyramat. Pyramaf. Sound rocker. Web Resource, 2007.
21. J. A. Russell and A. Weiss. Affect grid: A single=item scale of pleasure and arousal. Journal of Personality and Social Psychology, (57):493-502, 1989.
22. F. A. Russo, L. L. Cuddy, A. Galembo, and W. F. Thompson. Sensitivity to tonality across the pitch range. Perception, 36:781-790, 2007.
23. H. Shin, M. Sohn, and J. Park. A design of cell-based pin-array tactile display. In ICAT '05: Proceedings of the 2005 international conference on Augmented tele-existence, pages 251-252, New York, NY, USA, 2005. ACM Press.
24. Somaseat. Somaseat. Web Resource, 2007.
25. C. Strumf. Tonpsychologie, volume 1. S. Hirzel, Leipzig, 1883.
26. TactileSound. Tactile sound. Web Resource, 2007.
27. Tadoma. The tadoma method. Web Resource, 2007.
28. H. Z. Tan and A. Pentland. Tactual displays for sensory substitution and wearable computers. In SIGGRAPH '05: ACM SIGGRAPH 2005 Courses, page 105, New York, NY, USA, 2005. ACM Press.
29. J. B. F. Van Erp, H. A. H. C. Van Veen, C. Jansen, and T. Dobbins. Waypoint navigation with a vibrotactile waist belt. ACM Trans. Appl. Percept., 2(2): 106-117, 2005.
30. B. N. Walker, J. Lindsay, and J. Godfrey. The audio abacus: representing numerical values with nonspeech sound for the visually impaired. In Assets '04: Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility, pages 9-15, New York, NY, USA, 2004. ACM Press.
31. S. Wall and S. Brewster. Feeling what you hear: tactile feedback for navigation of audio graphs. In CHI '06: Proceedings of the S1GCH1 conference on Human Factors in computing systems, pages 1123- 1132, New York, NY, USA, 2006. ACM Press.
32. Y. Yokokohji, R. L. Hollis, and T. Kanade. Wysiwyf display: A vi-sual/haptic interface to virtual environment. Presence: Teleoper. Virtual Environ., 8(4):412-434, 1999.