Sonification of spatial information: Audio-tactile exploration strategies by normal and blind subjects

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5615 LNCS, Issue PART 2, 2009, Pages 557-563

  Olivetti Belardinelli, Marta ^a,b   Federici, Stefano ^b,c   Delogu, Franco ^a   Palmiero, Massimiliano ^b  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b ECONA   (Italy)

^c UNIVERSITY OF PERUGIA   (Italy)

Author keywords

Audio tactile exploration strategies; Blindness; Mental mapping; Sonification

Indexed keywords

AUDIO-TACTILE EXPLORATION STRATEGIES; BLINDNESS; MENTAL MAPPING; META-ANALYSIS; SONIFICATION; SONIFICATIONS; SPATIAL INFORMATIONS; TACTILE EXPLORATION;

EYE PROTECTION; KNOWLEDGE MANAGEMENT; UBIQUITOUS COMPUTING;

HUMAN COMPUTER INTERACTION;

EID: 70350307183     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-02710-9_62     Document Type: Conference Paper

References (39)

1. Alty, J.L., Rigas, D.: Communicating graphical information to blind users using music: the role of context. In: ACM CHI, pp. 574-581. ACM Press/Addison-Wesley Publishing Co, New York (1998)
2. Amedi, A., Stern, W.M., Camprodon, J.A., Bermpohl, F., Merabet, L., Rotman, S., Hemond, C., Meijer, P., Pascual-Leone, A.: Shape conveyed by visualto-auditory sensory substitution activates the lateral occipital complex. Nat. Neurosci. 10(6), 687-689 (2007)
3. Avraamides, M., Loomis, J., Klatzky, R.L., Golledge, R.G.: Functional equivalence of spatial representations derived from vision and language: Evidence from allocentric judgments. J. Exp. Psychol. Learn. 30, 801-814 (2004)
4. Berman, L., Danicic, S., Gallagher, K., Gold, N.: The Sound of Software: Using Sonification to Aid Comprehension. In: 14th IEEE International Conference on Program Comprehension, ICPC, IEEEXPLORE (2006)
5. Candey, R.M., Schertenleib, A.M., Diaz Merced, W.L.: Sonify sonification tool for space physics. In: ICAD, pp. 289-290 (2006)
6. Davies, T.C., Patla, A.E.: Obstacle Avoidance Strategies Using a Sonic Pathfinder. In: Canadian Society of Biomechanics, Halifax, Nova Scotia (2004)
7. Delogu, F., Federici, S., Olivetti Belardinelli, M.: La rappresentazione di mappe sonificate in soggetti ciechi: modalità e strategie di esplorazione audio-tattile. In 14th AIP (2008)
8. Delogu, F., Olivetti Belardinelli, M., Palmiero, M., Pasqualotto, E., Zhao, H., Plaisant, C., Federici, S.: Interactive sonification for blind people exploration of geo-referenced data: comparison between a keyboard-exploration and a haptic-exploration interfaces. In: Cogn. Process. 7 (suppl. 1), pp. 178-179 (2006)
9. Evreinova, T., Vesterinen, L., Evreinov, G., Raisamo, R.: Exploration of directional-predictive sounds for nonvisual interaction with graphs. Knowl. Inf. Syst. 13(2), 221-241 (2007)
10. Garcia-Ruiz, M.A., Arthur, E., Aquino-Santos, R., Vargas Martin, M., Mendoza-Quezada, R.: Using Sonification to Teach Network Intrusion Detection: A Preliminary Usability Study. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications, pp. 849-857. AACE, Cheasepeake (2007)
11. Golledge, R.G., Loomis, J.M., Klatzky, R.L., Flury, A., Yang, X.L.: Designing a personal guidance system to aid navigation without sight: progress on the GIS component. Int. J. Geo. Inf. Sci. 5(4), 373-395 (1991)
12. Guizatdinova, I., Guo, Z.: Sonification of Facial Expressions. University of Tampere, New Interaction Techniques Finland (2003)
13. Heuten, W., Wichmann, D., Boll, S.: Interactive 3D Sonification for the Exploration of City Maps. In: NordiCHI, pp. 155-164 (2006)
14. Heyes, T.: Sonic Pathfinder. Electr. & Wireless World 90, 26-29 (1984)
15. Kawai, Y., Kobayashi, M., Minagawa, H., Miyakawa, M., Tomita, F.: A Support System for Visually Impaired Persons Using Three-Dimensional Virtual Sound. In: ICCHP 2000, pp. 327-334 (2000)
16. Kay, L.: Auditory perception of objects by blind persons, using a bioacoustic high resolution sonar. J. Acoustical Soc. Am. 107, 3266-3275 (2000)
17. Kay, L.: Bioacoustic spatial perception by humans: a controlled laboratory measurement of spatial resolution without distal cues. J. Acoustical Soc. Am. 109, 803-808 (2001)
18. Klatzky, R.L., Golledge, R.G., Loomis, J.M., Cicinelli, J.G., Pellegrino, J.W.: Performance of blind and sighted persons on spatial tasks. J. Visual. Impair. Blin. 89, 70-82 (1995)
19. Kramer, G., Walker, B.N., Bonebright, T., Cook, P., Flowers, J., Miner, N., et al.: The Sonification Report: Status of the Field and Research Agenda. In: Report prepared for the National Science Foundation by members of the International Community for Auditory Display. International Community for Auditory Display (ICAD), Santa Fe, NM (2006)
20. Lakatos, S.: Recognition of complex auditory-spatial patterns. Perception 22(3), 363-374 (1993)
21. Maffiolo, V., Chateau, N., Mersiol, M.: The impact of the sonification of a vocal server on its usability and its user-frendliness. In: ICAD, pp. 130-134. Published by Advanced Telecommunications Research Institute (ATR), Kyoto (2002)
22. Mansur, D.L., Blattner, M., Joy, K.: Sound-Graphs: A numerical data analysis method for the blind. J. of Med. Sys. 9, 163-174 (1985)
23. Meijer, P.B.: An experimental system for auditory image representations. IEEE Trans. Biomed. Eng. 39, 112-121 (1992)
24. Merabet, L., Pogge, D., Stern, W., Bhatt, E., Hemond, C., Maguire, S., Meijer, P., Pascual-Leone, A.: Activation of visual cortex using crossmodal retinotopic Mapping. In: 14th HBM, the Annual Meeting of the Organization for Human Brain Mapping, Melburne, Australia (2008)
25. Milios, E., Kapralos, B., Kopinska, A., Stergiopoulos, S.: Sonification of range information for 3-D space perception. IEEE Trans. Neural Sys. Rehab. and Eng. 11(4), 416-421 (2003)
26. Millar, S.: Understanding and representing space: theory and evidence from studies with blind and sighted children. Oxford University Press, Oxford (1994)
27. Olivetti Belardinelli, M., Delogu, F., Palmiero, M., Federici, S., Pasqualotto, E., Zaho, H., Plaisant, C.: Interactive sonification of geographical maps: a behavioural study with blind subjects. In: 15th ESCOP (2007)
28. Parente, P., Bishop, G.: BATS: the blind audio tactile mapping system. In: ACM Annual Southeast Regional Conference (2003)
29. Pauletto, S., Hunt, A.: A Toolkit for Interactive Sonification. In: ICAD (2004)
30. Pfeiffer, D.G., Maffiolo, V., Chateau, N., Mersiol, M.: Listen and Learn: an Investigation of Sonification as an Instructional Variable to Improve Understanding of Complex Environments. Comput. Hum. Behav. 28(2), 475-485 (2008)
31. Poguntke, M., Ellis, K.: Auditory attention control for human-computer interaction. In: Human System Interactions IEEEXPLORE, pp. 231-236 (2008)
32. Postma, A., Zuidhoek, S., Noordzij, M.L., Kappers, A.M.L.: Keep an eye on your hands: on the role of visual mechanisms in processing of haptic space. Cogn. Process. 9(1), 6-68 (2008)
33. Ramloll, R., Yu, W., Riedel, B., Brewster, S.A.: Using non-speech sounds to improve access to 2D tabular numerical information for visually impaired users. In: Annual conference of British Computer Society (BCS) IHM-HCI, pp. 515-530. Springer, Heidelberg (2001)
34. Ungar, S.: Cognitive mapping without visual experience. In: Kitchin, R., Freundschuh, S. (eds.) Cogntive Mapping: Past, Present and Future, pp. 221-248. Routledge, London (2000)
35. Wickens, C.D.: Processing resources in attention. In: Parasuraman, R., Davies, R. (eds.) Varieties of attention, pp. 63-101. Academic Press, New York (1984)
36. Zhao, H., Plaisant, C., Shneiderman, B., Duraiswami, R.: Sonification of geo-referenced data for auditory information seeking: design principle and pilot study. In: ICAD (2004)
37. Zhao, H., Smith, B.K., Norman, K., Plaisant, C., Shneiderman, B.: Interactive Sonification of Choropleth Maps: Design and Evaluation. IEEE Multimedia 12(2), 26-35 (2005)
38. Zhao, H., Shneiderman, B., Plaisant, C.: Listening to Choropleth Maps: Interactive Sonification of Geo-referenced Data for Users with Vision Impairment. In: Lazar, J. (ed.) Universal Usability, pp. 141-174. John Wiley & Sons Ltd., Hoboken (2008)
39. Zuidhoek, S.: Representation of space based on haptic input. Febodruck, Utrecht (2005)