From signal to substance and back: Insights from environmental sound research to auditory display design

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5954 LNCS, Issue , 2010, Pages 306-329

  Gygi, Brian ^a   Shafiro, Valeriy ^b  

^a VA NORTHERN CALIFORNIA HEALTH CARE SYSTEM   (United States)

^b RUSH UNIVERSITY MEDICAL CENTER   (United States)

Author keywords

Auditory display; Auditory icons; Environmental sounds; Special populations

Indexed keywords

ACOUSTIC INFORMATION; AUDITORY DISPLAY; AUDITORY ICONS; ENVIRONMENTAL SOUNDS; HEARING-IMPAIRED LISTENERS; IDENTIFIABILITY; MUSICAL SOUNDS; NATURALLY OCCURRING; NORMAL-HEARING LISTENERS; PARAMETERIZING; SEMANTIC CONTENT; SOUND SOURCE; SPECIAL POPULATIONS;

ACOUSTIC PROPERTIES; COMPUTER MUSIC; SEMANTICS;

AUDITION;

EID: 78651245198     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-12439-6_16     Document Type: Conference Paper

References (81)

1. Gygi, B.: Studying environmental sounds the Watson way. J. Acoust. Soc. Am. 115(5), 2574 (2004)
2. Mynatt, E.: Designing with auditory icons. In: Proceedings of the 2nd International Conference on Auditory Display (ICAD 1994), Santa Fe, NM, U.S, pp. 109-119 (1994)
3. Zhao, F., Stephens, S.D.G., Sim, S.W., Meredith, R.: The use of qualitative questionnaires in patients having and being considered for cochlear implants. Clin. Otolaryngol. 22, 254-259 (1997)
4. Warren, R.M.: Auditory perception and speech evolution. Annals of the New York Academy of Sciences, Origins and Evolution of Language 280, 708-717 (1976)
5. Gaver, W.W.: Auditory icons: using sound in computer interfaces. Hum. Comput. Interact. 2(2), 167-177 (1986)
6. Gaver, W.W.: The SonicFinder: An Interface that Uses Auditory Icons. Hum. Comput. Interact. 4(1), 67-94 (1989)
7. Kunkler-Peck, A.J., Turvey, M.T.: Hearing shape. J. Exp. Psychol. Human 26(1), 279-294 (2000)
8. Carello, C., Anderson, K.L., Kunkler-Peck, A.J.: Perception of object length by sound. Psychol. Sci. 9(3), 211-214 (1998)
9. Li, X., Logan, R.J., Pastore, R.E.: Perception of acoustic source characteristics: Walking sounds. J. Acoust. Soc. Am. 90(6), 3036-3049 (1991)
10. Keller, P., Stevens, C.: Meaning From Environmental Sounds: Types of Signal-Referent Relations and Their Effect on Recognizing Auditory Icons. J. Exp. Psychol.-Appl. 10(1), 3-12 (2004)
11. Absar, R., Guastavino, C.: Usability of Non-Speech Sounds in User Interfaces. In: Proceedings of the 14th International Conference on Auditory Display Paris, France, pp. 1-8 (2008)
12. Fernstroem, M., Brazil, E., Bannon, L.: HCI Design and Interactive Sonification for Fingers and Ears. IEEE MultiMedia 12(2), 36-44 (2005)
13. Watson, C.S., Kidd, G.R.: Factors in the design of effective auditory displays. In: Proceedings of the 2nd International Conference on Auditory Display (ICAD 1994), Santa Fe, NM, U.S, pp. 293-303 (1994)
14. Mynatt, E.: Designing with auditory icons. In: Proceedings of the 2nd International Conference on Auditory Display (ICAD 1994), pp. 109-119. International Community for Auditory Display, Santa Fe, NM, U.S (1994)
15. Gaver, W.W.: Using and creating auditory icons. In: Kramer, G. (ed.) SFI studies in the sciences of complexity, pp. 417-446. Addison Wesley, Longman (1992)
16. Ballas, J.: Delivery of information through sound. In: Kramer, G. (ed.) SFI studies in the sciences of complexity, pp. 79-94. Addison Wesley, Longman (1992)
17. Ballas, J.A.: What is that sound? Some implications for sound design. In: Design Sonore, Paris, pp. 1-12 (2002)
18. Lucas, P.A.: An evaluation of the communicative ability of auditory icons and earcons. In: Proceedings of the 2nd International Conference on Auditory Display (ICAD 1994), Santa Fe, NM, U.S, pp. 121-128 (1994)
19. Lass, N.J., Eastman, S.K., Parrish, W.C., Ralph, D.: Listeners' identification of environmental sounds. Percept. Motor. Skill. 55(1), 75-78 (1982)
20. Miller, J.D., Tanis, D.C.: Recognition memory for common sounds. Psychon. Sci. 23(4), 307-308 (1973)
21. Lawrence, D.M., Banks, W.P.: Accuracy of recognition memory for common sounds. Bull. Psychonom. Soc. 1(5A), 298-300 (1973)
22. Vanderveer, N.J.: Ecological acoustics: Human perception of environmental sounds. Dissertation Abstracts International 40(9-B), 4543 (1980)
23. Ballas, J.A.: Common factors in the identification of an assortment of brief everyday sounds. J. Exp. Psychol. Human 19(2), 250-267 (1993)
24. Fabiani, M., Kazmerski, V.A., Cycowicz, Y.M.: Naming norms for brief environmental sounds: Effects of age and dementia. Psychophys. 33(4), 462-475 (1996)
25. Gygi, B., Kidd, G.R., Watson, C.S.: Spectral-temporal factors in the identification of environmental sounds. J. Acoust. Soc. Am. 115(3), 1252-1265 (2004)
26. Marcell, M.M., Borella, D., Greene, M., Kerr, E., Rogers, S.: Confrontation naming of environmental sounds. J. Clin. Exp. Neuropsyc. 22(6), 830-864 (2000)
27. Myers, L.L., Letowski, T.R., Abouchacra, K.S., Kalb, J.T., Haas, E.C.: Detection and recognition of octave-band sound effects. J Am. Acad. Otolayrn 7, 346-357 (1996)
28. Shafiro, V.: Identification of environmental sounds with varying spectral resolution. Ear. Hear. 29(3), 401-420 (2008)
29. Shafiro, V., Gygi, B., Cheng, M.-Y., Mulvey, M., Holmes, B.: Perception of speech and environmental sounds in cochlear implant patients. J. Acoust. Soc. Am. 123(5), 3303 (2008)
30. Guillaume, A., Pellieux, L., Chastres, V., Blancard, C.: How long does it take to identify everyday sounds. In: ICAD 2004 -Tenth Meeting of the International Conference on Auditory Display, Sydney, Australia, pp. ICAD04-1-ICAD04-4 (2004)
31. Gygi, B.: From acoustics to perception: How to listen to meaningful sounds in a meaningful way. J. Acoust. Soc. Am. 113(4), 2326 (2003)
32. Warren, W.H., Verbrugge, R.R.: Auditory perception of breaking and bouncing events: A case study in ecological acoustics. J. Exp. Psychol. Human. 10(5), 704-712 (1984)
33. Gaver, W.W.: What in the world do we hear? An ecological approach to auditory event perception. Ecol. Psychol. 5(1), 1-29 (1993)
34. Mynatt, E.D.: Transforming graphical interfaces into auditory interfaces for blind users. Hum. Comput. Interact. 12(1), 7-45 (1997)
35. Bilger, R.C., Nuetzel, J.M., Rabinowitz, W.M., Rzeczkowski, C.: Standardization of a test of speech perception in noise. J. Speech. Hear. Res. 27, 32-48 (1984)
36. Hafter, E.R., Saberi, K.: A level of stimulus representation model for auditory detection and attention. J. Acoust. Soc. Am. 110(3), 1489 (2001)
37. Schlauch, R.S., Hafter, E.R.: Listening bandwidths and frequency uncertainty in pure-tone signal detection. J. Acoust. Soc. Am. 90, 1332-1339 (1991)
38. Watson, C.S., Foyle, D.C.: Central factors in the discrimination and identification of complex sounds. J. Acoust. Soc. Am. 78(1), 375-380 (1985)
39. Ballas, J.A., Mullins, T.: Effects of context on the identification of everyday sounds. Hum. Perform. 4(3), 199-219 (1991)
40. Gygi, B., Shafiro, V.: The Incongruency Advantage for Environmental Sounds Presented in Natural Auditory Scenes. Submitted (2008)
41. Gordon, R.D.: Attentional allocation during the perception of scenes. J. Exp. Psychol. Human. 30, 760-777 (2004)
42. Lucas, P.A.: An evaluation of the communicative ability of auditory icons and earcons. In: Proceedings of the 2nd International Conference on Auditory Display (ICAD 1994), pp. 121-128. International Community for Auditory Display, Santa Fe, NM, U.S (1994)
43. Petrie, H., Morley, S.: The use of non-speech sounds in non-visual interfaces to the MS Windows GUI for blind computer users. In: Proceedings of the 5th International Conference on Auditory Display (ICAD 1998), pp. 1-5. University of Glasgow, U.K (1998)
44. Kidd, G.R., Watson, C.S.: The perceptual dimensionality of environmental sounds. Noise Cont. Eng. J. 51(4), 216-231 (2003)
45. Gaver, W.W.: How do we hear in the world? Explorations in ecological acoustics. Ecol. Psychol. 5(4), 285-313 (1993)
46. William, W.G.: Auditory icons: using sound in computer interfaces. Hum. Comput. Interact. 2(2), 167-177 (1986)
47. Coleman, P.D.: An analysis of cues to auditory depth perception in free space. Psychological Bulletin 60(3), 302 (1963)
48. Freed, D.: Auditory correlates of perceived mallet hardness for a set of recorded percussive sound events. J. Acoust. Soc. Am. 87(1), 311-322 (1990)
49. Grey, J.M.: Multidimensional perceptual scaling of musical timbres. J. Acoust. Soc. Am. 61(5), 1270-1277 (1977)
50. Lakatos, S., McAdams, S., Caussé, R.: The representation of auditory source characteristics: Simple geometric form. Percept. Psychophys. 59(8), 1180-1190 (1997)
51. Gygi, B., Kidd, G.R., Watson, C.S.: Similarity and Categorization of Environmental Sounds. Percept. Psychophys. 69(6), 839-855 (2007)
52. Aramaki, M., Kronland-Martinet, R.: Analysis-synthesis of impact sounds by real-time dynamic filtering. IEEE T Speech Audi P 14(2), 1-9 (2006)
53. Avanzini, F.: Synthesis of Environmental Sounds in Interactive Multimodal Systems. In: Proceedings of the 13th International Conference on Auditory Display (ICAD 2007), Montreal, Canada, pp. 181-188 (2007)
54. Lee, J.-F., Shen, I.Y., Crouch, J., Aviles, W., Zeltzer, D., Durlach, N.: Using physically based models for collision-sound synthesis in virtual environments. J. Acoust. Soc. Am. 95(5), 2967 (1994)
55. Cook, P.R.: Physically inspired sonic modeling (PhISM): Synthesis of percussive sounds. Comput. Music J. 21, 38-49 (1997)
56. Rath, M.: An expressive real-time sound model of rolling. In: The 6th International Conference on Digital Audio Effects (DAFX 2003), pp. 165-168. University of London, Queen Mary (2003)
57. Stoelinga, C., Chaigne, A.: Time-Domain Modeling and Simulation of Rolling Objects. Acta Acust United Ac 93, 290-304 (2007)
58. van den Doel, K.: Physically-Based Models for Liquid Sounds. In: Tenth Meeting of the International Conference on Auditory Display, Sydney, Australia, pp. 1-8 (2004)
59. Avanzini, F., Serafin, S., Rocchesso, D.: Modeling Interactions Between Rubbed Dry Surfaces Using an Elasto-Plastic Friction Model. In: Proceedings of the COST-G6 Conf. Digital Audio Effects (DAFX 2002), Hamburg, pp. 111-116 (2002)
60. Lakatos, S., Cook, P.C., Scavone, G.P.: Selective attention to the parameters of a physically informed sonic model. J. Acoust. Soc. Am. 107(5,Pt1), L31-L36 (2000)
61. Lutfi, R.A., Liu, C.-J.: Individual differences in source identification from synthesized impact sounds. J. Acoust. Soc. Am. 122(2), 1017-1028 (2007)
62. Reed, R.K., Kidd, G.R.: Detection of Spectral Changes in Everyday Sounds. Indiana University, Unpublished data (2007)
63. Fernström, M., Brazil, E.: Human-Computer Interaction Design based on Interactive Sonification - Hearing Actions or Instruments/Agents. In: Proceedings of the 2004 International Workshop on Interactive Sonification, pp. 1-4. Bielefeld University, Germany (2004)
64. Heller, L.M.W.: When sound effects are better than the real thing. J. Acoust. Soc. Am. 111(5 pt.2), 2339 (2002)
65. Moore, B.C.J.: Cochlear hearing loss, pp. 47-88. Whurr Publishers, London (1998)
66. Badran, S., Osama, E.L.: Speech and environmental sound perception difficulties by patients with hearing loss requiring and using hearing aid. Indian J. Oto. 4(1), 13-16 (1998)
67. Shannon, R.V., Zeng, F.-G., Kamath, V., Wygonski, J., et al.: Speech recognition with primarily temporal cues. Science 270(5234), 303-304 (1995)
68. Reed, C.M., Delhorne, L.A.: Reception of Environmental Sounds Through Cochlear Implants. Ear. Hear. 26(1), 48-61 (2005)
69. Inverso, D.: Cochlear Implant-Mediated Perception of Nonlinguistic Sounds, Unpublished Thesis, Gallaudet University (2008)
70. Bronkhorst, A.W., Plomp, R.: Effect of multiple speechlike maskers on binaural speech recognition in normal and impaired hearing. J. Acoust. Soc. Am. 92(6), 3132 (1992)
71. Festen, J.M., Plomp, R.: Effects of fluctuating noise and interfering speech on the speechreception threshold for impaired and normal hearing. J. Acoust. Soc. Am. 88(4), 1725 (1990)
72. Loizou, P.C., Hu, Y., Litovsky, R., Yu, G., Peters, R., Lake, J., Roland, P.: Speech recognition by bilateral cochlear implant users in a cocktail-party setting. J. Acoust. Soc. Am. 125(1), 372 (2009)
73. Cherry, C.: Some experiments on the recognition of speech with one and with two ears. J. Acoust. Soc. Am. 26, 975-979 (1953)
74. Salthouse, T.A.: The processing-speed theory of adult age differences in cognition. Psychol. Rev. 103(3), 403-428 (1996)
75. Divenyi, P.L., Stark, P.B., Haupt, K.: Decline of Speech Understanding and Auditory Thresholds in the Elderly. J. Acoust. Soc. Am. 118, 1089-1100 (2005)
76. Humes, L.E., Lee, J.H., Coughlin, M.P.: Auditory measures of selective and divided attention in young and older adults using single-talker competition. J. Acoust. Soc. Am. 120(5), 2926 (2006)
77. Mynatt, E.D.: Transforming graphical interfaces into auditory interfaces for blind users. Hum. Comput. Interact. 12(1), 7-45 (1997)
78. Roth, P., Petrucci, L., Pun, T., Assimacopoulos, A.: Auditory browser for blind and visually impaired users. In: CHI 1999 extended abstracts on Human factors in computing systems, pp. 1-2. ACM, Pittsburgh (1999)
79. Cobb, N.J., Lawrence, D.M., Nelson, N.D.: Report on blind subjects' tactile and auditory recognition for environmental stimuli. Percept Mot Skills 48(2), 363-366 (1979)
80. Petrie, H., Morley, S.: The use of non-speech sounds in non-visual interfaces to the MS Windows GUI for blind computer users. In: Proceedings of the 5th International Conference on Auditory Display (ICAD 1998), pp. 1-5. British Computer Society, University of Glasgow, U.K (1998)
81. Wersényi, G.: Evaluation of auditory representations for selected applications of a graphical user interface. In: Proceedings of the 15th International Conference on Auditory Display (ICAD 2009), Re: New - Digital Arts Forum, Copenhagen, Denmark, pp. 41-48 (2009)