General functions and specific applications of environmental sound research

Frontiers in Bioscience

Volumn 12, Issue 8, 2007, Pages 3152-3166

  Gygi, Brian ^a   Shafiro, Valeriy ^b  

^a East Bay Institute for Research and Education   (United States)

^b RUSH UNIVERSITY   (United States)

Author keywords

Auralization; Ecological acoustics; Environmental sounds; Practical applications; Review; Sonification

Indexed keywords

ENVIRONMENT; REVIEW; SOUND;

ENVIRONMENT; SOUND;

EID: 34347235817     PISSN: 27686701     EISSN: 27686698     Source Type: Journal    
DOI: 10.2741/2303     Document Type: Article

References (131)

1. French, N. R. & J. C. Steinberg: Factors governing the intelligibility of speech sounds. J Acoust Soc Am, 19, 90-119 (1947)
2. Warren, R. M.: Perceptual restoration of missing speech sounds. Science, 167, 393-395 (1970)
3. Divenyi, P. L. & K. M. Haupt: Audiological correlates of speech understanding deficits in elderly listeners with mild-to-moderate hearing loss. I. Age and laterality effects. Ear Hear, 18, 42-61 (1997) (Pubitemid 27100544)
4. Humes, L. E., B. U. Watson, L. A. Christensen, C. G. Cokely, D. C. Halling & L. Lee: Factors associated with individual differences in clinical measures of speech recognition among the elderly. J Speech Hear Res, 37, 465-474 (1994) (Pubitemid 24116508)
5. Surprenant, A. M. & C. S. Watson: Individual differences in the processing of speech and nonspeech sounds by normal-hearing listeners. J Acoust Soc Am, 110, 2085-2095 (2001) (Pubitemid 32959708)
6. Mattingly, I. G. & A. M. Liberman: Specialized perceiving systems for speech and other biologically significant sounds. In: Functions of the Auditory System. Eds: G. M. Edelman, W. E. Gall & W. M. Cowan. Wiley, New York (1988)
7. Bilger, R. C., J. M. Nuetzel, W. M. Rabinowitz & C. Rzeczkowski: Standardization of a test of speech perception in noise. J Speech Hear Res, 27, 32-48 (1984) (Pubitemid 14135538)
8. Warren, W. H. & R. R. Verbrugge: Auditory perception of breaking and bouncing events: A case study in ecological acoustics. J Exp Psychol Human, 10, 704-712 (1984)
9. Li, X., R. J. Logan & R. E. Pastore: Perception of acoustic source characteristics: Walking sounds. J Acoust Soc Am, 90, 3036-3049 (1991)
10. Repp, B. H.: The sound of two hands clapping: an exploratory study. J Acoust Soc Am, 81, 1100-9 (1987)
11. Lass, N. J., S. K. Eastman, W. C. Parrish, S. K. A. & D. Ralph: Listeners' identification of environmental sounds. Percept Motor Skill, 55, 75-78 (1982)
12. Lawrence, D. M. & W. P. Banks: Accuracy of recognition memory for common sounds. Bull Psychonom Soc, 1, 298-300 (1973)
13. Shafiro, V.: Perceiving the sources of environmental sounds with a varying number of spectral channels. Dissertation Abstracts International: Section B: The Sciences & Engineering, 64, 6361 (2004). Available from http://www.rushu.rush.edu/cds/arl/Publications/Shafiro-dissertation.pdf
14. Marcell, M. M., D. Borella, M. Greene, E. Kerr & S. Rogers: Confrontation Naming of Environmental Sounds. J Clin Exp Neuropsyc, 22, 830-864 (2000) (Pubitemid 32187330)
15. Shafiro, V.: Identification of environmental sounds with varying spectral resolution. J Acoust Soc Am, manuscript in preparation, (2005)
16. Gygi, B., G. R. Kidd & C. S. Watson: Spectraltemporal factors in the identification of environmental sounds. J Acoust Soc Am, 115, 1252-65 (2004) (Pubitemid 38298575)
17. Watson, C. S. & G. R. Kidd: On the lack of association between basic auditory abilities, speech processing and other cognitive skills. Sem Hear, 23, 83-93 (2002) (Pubitemid 34260839)
18. Zhao, F., S. D. G. Stephens, S. W. Sim & R. Meredith: The use of qualitative questionnaires in patients having and being considered for cochlear implants. Clin Otolaryngol, 22, 254-259. (1997) (Pubitemid 28344978)
19. Tyler, R. S.: Advantages and disadvantages expected and reported by cochlear implant patients. Am J Otol, 15, 523-531 (1994) (Pubitemid 24227170)
20. Warren, R. M.: Auditory perception and speech evolution. In: Annals of the New York Academy of Sciences, Origins and Evolution of Language. 708-717 (1976)
21. Cycowicz, Y. M. & D. Friedman: Effect of sound familiarity on the event-related potentials elicited by novel environmental sounds. Brain Cognit, 36, 30-51 (1998) (Pubitemid 28108404)
22. Ogburn Yeager, A. C.: Processing of Lexical and Environmental Stimuli in Aphasia. Dissertation Abstracts International, B: Sciences and Engineering, 64, 2157-B (2003)
23. Myers, L. L., T. R. Letowski, K. S. Abouchacra, J. T. Kalb & E. C. Haas: Detection and recognition of octaveband sound effects. J Am Acad Audiol, 7, 346-357 (1996)
24. Anderson, L. M., B. E. Mulligan, L. S. Goodman & H. Z. Regen: Effect of sound on preferences for outdoor settings. Environ Behav, 15, 539-566. (1983)
25. Cermak, G. W. & P. C. Cornillon: Multidimensional analyses of judgments about traffic noise. J Acoust Soc Am, 59, 1412-1420 (1976)
26. Kryter, K. D.: The effects of noise on man. Academic Press, New York (1985)
27. Versfeld, N. J. & J. Vos: Annoyance caused by sounds of wheeled and tracked vehicles. J Acoust Soc Am, 101, 2677-2685 (1997)
28. Vos, J.: Annoyance caused by simultaneous impulse, road-traffic, and aircraft sounds: A quantitative model. J Acoust Soc Am, 91, 3330-3345 (1992)
29. Truax, B.: Acoustic Communication. Ablex Publishing, Westport, Connecticut. (2001)
30. Ballas, J. A.: Common factors in the identification of an assortment of brief everyday sounds. J Exp Psychol Human, 19, 250-267 (1993)
31. Bjork, E. A.: The perceived quality of natural sounds. Acustica, 57, 185-188 (1985)
32. Lee, J.-F., I. Y. Shen, J. Crouch, W. Aviles, D. Zeltzer & N. Durlach: Using physically based models for collisionsound synthesis in virtual environments. J Acoust Soc Am, 95, 2967 (1994)
33. Borg, E.: Ecological aspects of auditory rehabilitation. Acta Oto-Laryngol, 120., 234-241 (2000)
34. Ramsdell, D. A.: The psychology of the hard-ofhearing and the deafened adult. In: Hearing and deafness. Eds: H. David & S. R. Silverman. Holt, Rinehart & Winston, New York 499-510 (1978)
35. Dorman, M. F.: Speech perception by adults. In: Cochlear Implants: Audiological Foundations. Ed: R. S. Tyler. Singular Publishing Group, San Diego, CA. (1993)
36. Badran, S. & E. L. Osama: Speech and environmental sound perception difficulties by patients with hearing loss requiring and using hearing aid. Indian J Oto, 4, 13-16 (1998)
37. Borg, E., M. Wilson & E. Samuelsson: Towards an ecological audiology: stereophonic listening chamber and acoustic environmental tests. Scand Audiol, 27, 195-206 (1998) (Pubitemid 28497886)
38. Peltonen, V., A. Eronen, M. Parviainen & A. Klapuri: Recognition of Everyday Auditory Scenes: Potentials, Latencies and Cues. 110th Conference of the Audio Engineering Society, (2001).
39. Chute, P., M. E. Nevins & S. Parisier: Managing educational issues through the process of implantation. In: Cochlear implant rehabilitation in children and adults. Ed: D. J. Allum. Whurr Publishers, (1996)
40. Clark, G.: Cochlear implants: Fundamentals and applications. Springer-Verlag, New York (2003)
41. Fabiani, M., V. A. Kazmerski & Y. M. Cycowicz: Naming norms for brief environmental sounds: Effects of age and dementia. Psychophysiology, 33, 462-475 (1996) (Pubitemid 26230733)
42. Finitzo-Hieber, T., I. J. Gerling, N. D. Matkin & E. Cherow-Skalka: A sound effects recognition test for the pediatric audiological evaluation. Ear Hear, 1, 271-276. (1980) (Pubitemid 11212558)
43. Schnider, A., D. F. Benson, D. N. Alexander & A. Schnider-Klaus: Non-Verbal Environmental Sound Recognition after Unilateral Hemispheric Stroke. Brain, 117, 281-287 (1994) (Pubitemid 24155500)
44. Baddeley, A. D. & B. A. Wilson: A case of word deafness with preserved span: Implications for the structure and function of short-term memory. Cortex, 29, 741-748 (1993) (Pubitemid 24014622)
45. Piccirilli, M., T. Sciarma & S. Luzzi: Modularity of music: Evidence from a case of pure amusia. J Neurol, 69, 541-545 (2000)
46. Plante, E., C. Van Petten & A. J. Senkfor: Electrophysiological Dissociation between Verbal and Nonverbal Semantic Processing in Learning Disabled Adults. Neuropsychologia, 38, 1669-1684 (2000)
47. Dick, F., J. Bussiere & A. P. Saygin: The Effects of Linguistic Mediation on the Identification of Environmental Sounds. Cent Res Lang News, 14, 3-9 (2002)
48. Baracca, E., C. Longhini, S. Aggia, D. Mele, M. Vaccari, L. Longhini & R. Pansini: Dynamic spectral analysis applied to the study of heart sounds. Acta Cardiol, 45, 505-510. (1990)
49. Mansy, H. A., T. J. Royston & R. H. Sandler: Acoustic characteristics of air cavities at low audible frequencies with application to pneumoperitoneum detection. Med Biol Eng Comput, 39, 159-167 (2001) (Pubitemid 32318488)
50. Rangayyan, R. M. & R. J. Lehner: Phonocardiogram signal analysis: a review. Crit Rev Biomed Eng, 15, 211-236 (1987)
51. Johnson, T. H. L.: Expertise in cardiac auscultation: Perception of relative intensities and timing of second heart sound components. Dissertation Abstracts International Sec B, 45, 3646 (1984)
52. Etchells, E., C. Bell & K. Robb: Does this patient have an abnormal systolic murmur? J Audio Eng Soc, 277, 564-71 (1997) (Pubitemid 27083987)
53. Mangione, R., F. Guyon, L. Taine, Z. Q. Wen, D. Roux, A. Vergnaud, B. Maugey-Laulom, J. Horovitz & R. Saura: Pregnancy outcome and prognosis in fetuses with increased first-trimester nuchal translucency. Fetal Diagn Ther, 16, 360-3 (2001) (Pubitemid 33033375)
54. Fiebig, A. & B. Schulte-Fortkamp: Soundscapes and their influence on inhabitants-New findings with the help of a grounded theory approach. J Acoust Soc Am, 115, 2496 (2004)
55. Flick, U.: Subjective soundscapes qualitative research in the experience and evaluation of environmental noise. J Acoust Soc Am, 115, 2495 (2004)
56. Schafer, R. M.: The tuning of the world. Knopf, New York (1977)
57. Chowning, J.: The Synthesis of Complex Audio Spectra by Means of Frequency Modulation. J Audio Eng Soc, 21, 526-534 (1973)
58. Cook, P. R.: Real Sound Synthesis for Interactive Applications. A. K. Peters, Ltd., Massachusetts (2002)
59. Gaver, W. W.: How do we hear in the world? Explorations in ecological acoustics. Ecol Psychol, 5, 285-313 (1993)
60. Rocchesso, D. & F. Fontana: The Sounding Object. The Sounding Object Project (2003).
61. van den Doel, K.: Physically-Based Models For Liquid Sounds. Tenth Meeting of the International Conference on Auditory Display, (2004).
62. Aramaki, M. & R. Kronland-Martinet: Analysis-Synthesis of Impact Sounds by Real-Time Dynamic Filtering. IEEE T Speech Audi P (Manuscript submitted 2004)
63. Lutfi, R., E. Oh, E. Storm & J. M. Alexander: Classification and identification of recorded and synthesized impact sounds by practiced listeners, musicians, and nonmusicians. J Acoust Soc Am, 118, 393-404 (2005) (Pubitemid 40981495)
64. Kleiner, M.: Auralization: An overview. J Audio Eng Soc, 41, 861-874 (1993)
65. Kramer, G.: An Introduction to Auditory Display. In: Auditory Display: Sonification, Audification, and Auditory Interfaces. Santa Fe Institute Studies in the Sciences of Complexity. Ed: G. Kramer. Addison Wesley, Reading, MA: (1994)
66. Hayward, C.: Listening to the Earth Sing. In: Auditory Display: Sonification, Audification, and Auditory Interfaces. Santa Fe Institute Studies in the Sciences of Complexity. Ed: G. Kramer. Addison Wesley, Reading, MA: (1994)
67. Gaver, W. W.: The SonicFinder: An Interface that Uses Auditory Icons. HCI, 4, 67-94 (1989)
68. Brunswik, E.: Representative design and probabilistic theory in a functional psychology. Psychol Rev, 62, 193-217 (1955)
69. Peterson, G. & H. Barney: Control methods used in a study of vowels. J Acoust Soc Am, 24, 175-184 (1952)
70. Stevens, K. N. & A. S. House: Development of a quantitative description of vowel articulation. J Acoust Soc Am, 27, 484-493 (1955)
71. Strange, W., J. J. Jenkins & T. L. Johnson: Dynamic specification of coarticulated vowels. J Acoust Soc Am, 74, 695-705 (1983)
72. Fowler, C. A.: Sound-producing sources as objects of perception: Rate normalization and nonspeech perception. J Acoust Soc Am, 88, 1236-1249 (1990) (Pubitemid 20324393)
73. Fowler, C. A. & L. D. Rosenblum: Duplex Perception: A Comparison of Monosyllables and Slamming Doors. J Exp Psychol Human742-754 (1990)
74. Gibson, J. J.: Survival in a world of probable objects. In: The essential Brunswik: Beginnings, explications, applications. Eds: K. R. Hammond & T. R. Stewart. Oxford University Press, Oxford, England 244-246 (1957/2001)
75. Brunswik, E.: The conceptual framework of psychology. In: International encyclopedia of unified science. University of Chicago Press., Chicago 656-760 (1952)
76. Gaver, W. W.: What in the world do we hear? An ecological approach to auditory event perception. Ecol Psychol, 5, 1-29 (1993)
77. De Coensel, B., D. Botteldooren & T. De Muer: 1/f Noise in Rural and Urban Soundscapes. Acta Acust United Ac, 89, 287-295 (2003)
78. Boersma, H. F.: Characterization of the natural ambient sound environment: Measurements in open agricultural grassland. J Acoust Soc Am, 101, 2104-2110. (1997) (Pubitemid 27163974)
79. Gygi, B., G. R. Kidd & C. S. Watson: Identification and similarity judgments of environmental sounds. J Acoust Soc Am, 107, 2820 (2000)
80. Gygi, B.: Parsing the Blooming Buzzing Confusion: Identifying Natural Auditory Scenes. Speech Separation and Comprehension in Complex Acoustic Environments, (2004).
81. Plomp, R.: Perception of speech as a modulated signal. In: Proceedings of the Tenth International Congress of Phonetic Sciences. Eds: M. P. R. van der Broecke & A. Cohen. Foris, Dordrecht 29-40 (1983)
82. Bregman, A. S.: Auditory scene analysis: hearing in complex environments. In: Thinking in sound: The cognitive psychology of human audition. Eds: S. McAdams & E. Bigand. Clarendon Press, Oxford 10-36 (1991)
83. Nelken, I., Y. Rotman & O. B. Yosef: Responses of auditory-cortex neurons to structural features of natural sounds. Nature, 397, 154-157 (1999)
84. Houtgast, T. & H. J. M. Steeneken: A review of the MTF concept in room acoustics and its use for estimating speech intelligibility in auditoria. J Acoust Soc Am, 77, 1069-1077 (1985)
85. Richards, D. G. & R. H. Wiley: Reverberations and amplitude fluctuations in the propagation of sound in a forest: implication for animal communication. Am Nat, 115, 381-399 (1980)
86. Patterson, R. D., K. Robinson, J. Holdsworth, D. McKeown, C. Zhang & M. Allerhand: Complex sounds and auditory images. Adv Biosci, 83, 429-446 (1992)
87. Theunissen, F. E. & A. J. Doupe: Temporal and spectral sensitivity of complex auditory neurons in the nucleus HVc of male zebra finches. J Neurosci, 18, 3786-3802 (1998) (Pubitemid 28225686)
88. Schreiner, C. E. & J. V. Urbas: Representation of amplitude modulation in the auditory cortex of the cat. II. Comparison between cortical fields. Hear Res, 32, 49-63 (1988) (Pubitemid 18064720)
89. Theunissen, F. E. & A. J. Doupe: Spectral-temporal receptive fields of nonlinear auditory neurons obtained using natural sounds. J Neurosci, 20, 2315-2331 (2000) (Pubitemid 30230085)
90. Depireux, D. A., J. Z. Simon, D. J. Klein & S. A. Shamma: Spectro-Temporal Response Field Characterization With Dynamic Ripples in Ferret Primary Auditory Cortex. J Neurol, 85, 1220-1234 (2001) (Pubitemid 32209608)
91. Rieke, F., D. A. Bodnar & W. Bialek: Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferents. Proc Biol Sci, 262, 259-65 (1995) (Pubitemid 26023704)
92. Attias, H. & C. E. Schreiner: Coding of Naturalistic Stimuli by Auditory Midbrain Neurons. In: Advances in Neural Info Processing Systems. Ed: M. Mozer. MIT Press, Cambridge, MA (1998)
93. Attneave, F.: Some informational aspects of visual perception. Psychol Rev, 61, 183-93. (1954)
94. Atick, J.: Could information theory provide an ecological theory of sensory processing? Network, 3, 213-51 (1992)
95. Schwartz, O. & E. P. Simoncelli: Natural sound statistics and divisive normalization in the auditory system. In: Advances in Neural Information Processing Systems. Eds: T. K. Leen, T. G. Dietterich & V. Tresp. MIT Press, Cambridge, MA (2001)
96. Bell, A. J. & T. J. Sejnowski: Learning the higherorder structure of a natural sound. Network - Comp Neural, 7, (1996)
97. Lewicki, M. S.: Efficient coding of natural sounds. Nat Neurosci, 5, 356-363 (2002) (Pubitemid 34279816)
98. Gfeller, K., J. F. Knutson, G. Woodworth, S. Witt & B. DeBus: Timbral recognition and appraisal by adult cochlear implant users and normal-hearing adults. J Am Acad Audiol, 9, 1-19 (1998)
99. Gygi, B. & P. L. Divenyi: Identifiability of Time-Reversed Environmental Sounds. Abstracts of the Twentyseventh Midwinter Research Meeting, Association for Research in Otolaryngology, 27, (2004)
100. Lakatos, S., S. McAdams & R. Caussé: The representation of auditory source characteristics: Simple geometric form. Percept Psychophys, 59, 1180-1190 (1997) (Pubitemid 127459257)
101. Freed, D.: Auditory correlates of perceived mallet hardness for a set of recorded percussive sound events. J Acoust Soc Am, 87, 311-322 (1990)
102. Gygi, B.: Factors in the identification of environmental sounds. Dissertation Abstracts International: Section B: The Sciences & Engineering, 62, 3843 (2002)
103. Gygi, B.: Studying environmental sounds the Watson way. J Acoust Soc Am, 115, 2574 (2004)
104. Ballas, J. A. & J. H. Howard: Interpreting the language of environmental sounds. Environ Behav, 19, 91-114 (1987)
105. Gygi, B.: Unpublished data. (2004).
106. Ballas, J. A. & T. Mullins: Effects of context on the identification of everyday sounds. Hum Perform, 4, 199-219 (1991)
107. Heller, L. M. W., L.: When sound effects are better than the real thing. J Acoust Soc Am, 111, 2339 (2002)
108. Shafiro, V. & B. Gygi: How to select stimuli for environmental sound research and where to find them. Behav Res Meth Instr, 36, 590-598 (2004) (Pubitemid 40251409)
109. Stuart, G. P. & D. M. Jones: Priming the Identification of Environmental Sounds. Q J Exp Psychol, 3, 741-761 (1995)
110. Miller, J. D. & D. C. Tanis: Recognition memory for common sounds. Psychon Sci, 23, 307-308 (1973)
111. Ferrara, R. A., C. R. Puff, G. A. Gioia & J. M. Richards: Effects of incidental and intentional learning instructions on the free recall of naturalistic sounds. Bull Psychonom Soc, 11, 353-355 (1978)
112. Chiu, C. Y. P. & D. L. Schacter: Auditory Priming for Nonverbal Information: Implicit and Explicit Memory for Environmental Sounds. Conscious Cogn, 4, 440-458 (1995)
113. Chiu, C.-Y. P.: Specificity of auditory implicit and explicit memory: Is perceptual priming for environmental sounds exemplar specific? Mem Cognition, 28, 1126-1139 (2000)
114. Bartlett, J. C.: Remembering Environmental Sounds: The Role of Verbalization at Input. Mem Cognition, 5, 404-414 (1977) (Pubitemid 8161470)
115. Bartlett, J. C.: The coding of environmental sounds. Dissertation Abstracts International, 36, 5825-5826 (1976)
116. Spreen, O. & E. Strauss: A compendium of neuropsychological tests: Administration, norms, and commentary. Oxford University Press., New York (1991)
117. Leung, Y. Y., S. Smith, S. Parker & R. Martin: Learning and Retention of Auditory Warnings. The Fourth International Conference On Auditory Display, (1997).
118. Neuhoff, J. G. & L. M. Heller: One small step: Sound sources and events as the basis for auditory graphs. First International Symposium on Auditory Graphs, (2005).
119. Ise, S. & K. Ueno: Study on a role of voluntary action in sound perception. ForumAcusticum, (2005).
120. Wang, D.-Y. D., R. W. Proctor & D. F. Pick: Stimulus-Response Compatibility Effects For Warning Signals And Steering Response. Second International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, (2003).
121. Sarvazyan, A.: Audible-frequency medical diagnostic methods: Past, present and future. J Acoust Soc Am, 117, 2586 (2005)
122. Mansy, H. A., T. J. Royston, R. A. Balk & R. H. Sandler: Pneumothorax detection using pulmonary acoustic transmission measurements. Med Biol Eng Comput, 40(5), 520-525 (2002) (Pubitemid 35356064)
123. Waubke, H.: Order Tracking for the Detection of Gear Noise. HASSIP (Harmonic Analysis and Statistics for Signal and Image Processing) Workshop: Application Of Time Frequency Analysis In Acoustics, (2005).
124. Van Hirtum, A., J.-M. Aerts, D. Berckmans, B. Moreaux & P. Gustin: On-line cough recognizer system. J Acoust Soc Am, 106, 2191 (1999)
125. Lawrence, D. M., N. J. Cobb & J. I. Beard: Comparison of accuracy in auditory and tactile recognition memory for environmental stimuli. Percept Mot Skills, 48, 63-6 (1979)
126. Cobb, N. J., D. M. Lawrence & N. D. Nelson: Report on blind subjects' tactile and auditory recognition for environmental stimuli. Percept Mot Skills, 48, 363-6 (1979) (Pubitemid 10193422)
127. Lawrence, D. M. & N. J. Cobb: Cross-modal utilization of information: recognition memory for environmental stimuli. Percept Mot Skills, 47, 1203-6 (1978)
128. Warren, W. H., E. E. Kim & R. Husney: The way the ball bounces: Visual and auditory perception of elasticity and control of the bounce pass. Perception, 16, 309-336 (1987)
129. Sekuler, A. B. & R. Sekule: Collisions between moving visual targets: What controls alternative ways of seeing an ambiguous display? Perception, 28, 415-432 (1999)
130. Ecker, A. J. & L. M. Heller: Auditory-visual interactions in the perception of a ball's path. Perception, 34, 59-75 (2005) (Pubitemid 40345925)
131. Helfer, K. S. & R. L. Freyman: The role of visual speech cues in reducing energetic and informational masking. J Acoust Soc Am, 117, 842-849 (2005) (Pubitemid 40223444)