On the effectiveness of vocal imitations and verbal descriptions of sounds

Journal of the Acoustical Society of America

Volumn 135, Issue 2, 2014, Pages 862-873

  Lemaitre, Guillaume ^a   Rocchesso, Davide ^a  

^a UNIVERSITY IUAV OF VENICE   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

FORCED-CHOICE EXPERIMENT; IDENTIFIABILITY; RECOGNITION ACCURACY; SYNTHESIZED SOUNDS;

ACOUSTICS;

PHYSICS;

EID: 84900614610     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.4861245     Document Type: Article

References (42)

1. Ballas, J. A. (1993). "Common factors in the identification of an assortment of brief everyday sounds," J. Exp. Psychol. 19, 250-267. 10.137/0096-1523.19.2.250
2. Cronbach, L. J. (1951). "Coefficient alpha and the internal structure of tests," Psychometrika 16, 297-334. 10.1007/BF02310555
3. Ekman, I., and Rinott, M. (2010). "Using vocal sketching for designing sonic interactions," in DIS'10: Proceedings of the 8th ACM Conference on Designing Interactive Systems (Association for Computing Machinery, New York), pp. 123-131.
4. Gaver, W. W. (1993). "How do we hear in the world? Explorations in ecological acoustics," Ecol. Psychol. 5, 285-313. 10.1207/s15326969eco0504- 2
5. Gazzola, V., Aziz-Zadeh, L., and Keysers, C. (2006). "Empathy and the somatotopic auditory mirror system in humans," Curr. Biol. 16, 1824-1829. 10.1016/j.cub.2006.07.072
6. Gillet, O., and Richard, G. (2005). "Drum loops retrieval from spoken queries," J. Intell. Inf. Syst. 24, 160-177.
7. Grassi, M. (2005). "Do we hear size or sound? Balls dropped on plates," Percep. Psychophys. 67, 274-284. 10.3758/BF03206491
8. Grassi, M., Pastore, M., and Lemaitre, G. (2013). "Looking at the world with your ears: How do we get the size of an object from its sound?," Acta Psychol. 143, 96-104. 10.1016/j.actpsy.2013.02.005
9. Gygi, B. (2001). "Factors in the identification of environmental sounds," Ph.D. thesis, Dep. of Psychol., Indiana University, Bloomington, IN.
10. Gygi, B., Kidd, G. R., and Watson, C. S. (2004). "Spectral-temporal factors in the identification of environmental sounds," J. Acoust. Soc. Am. 115, 1252-1265. 10.1121/1.1635840
11. Hashimoto, T., Usui, N., Taira, M., Nose, I., Haji, T., and Kojima, S. (2006). "The neural mechanism associated with the processing of onomatopoeic sounds," Neuroimage 31, 1762-1770. 10.1016/j.neuroimage.2006. 02.019
12. Heller, L. M., and Wolf, L. (2002). "When sound effects are better than the real thing," J. Acoust. Soc. Am. 111, 2339. 10.1121/1.4777825
13. Houix, O., Lemaitre, G., Misdariis, N., Susini, P., and Urdapilleta, I. (2012). "A lexical analysis of environmental sound categories," J. Exp. Psychol. 18, 52-80. 10.1037/a0026240
14. Ishihara, K., Nakatani, T., Ogata, T., and Okuno, H. G. (2004). "Automatic soundimitation word recognition from environmental sounds focusing on ambiguity problem in determining phonemes," in PRICAI, Lecture Notes in Computer Science, edited by C. Zhang, H. W. Guesgen, and W.-K. Yeap (Springer, New York), Vol. 3157, pp. 909-918.
15. Ishihara, K., Tsubota, Y., and Okuno, H. G. (2003). "Automatic transcription of environmental sounds into sound-imitation words based on Japanese syllable structure," in Proceedings of Eurospeech 2003 (International Speech Communication Association, Geneva, Switzerland), Vol. 3185-3188.
16. Iwasaki, N., Vinson, D. P., and Vigliocco, G. (2007). "What do English speakers know about gera-gera and yota-yota? A cross-linguistic investigation of mimetic words for laughing and walking," Jpn. Lang. Educ. Globe 17, 53-78.
17. James, T. W., VanDerKlok, R. M., Stevenson, R. A., and Harman James, K. (2011). "Multisensory perception of action in posterior temporal and parietal cortices," Neuropsychologia 49, 108-114. 10.1016/j. neuropsychologia.2010.10.030
18. Lass, N. J., Eastham, S. K., Parrish, W. C., Sherbick, K. A., and Ralph, D. M. (1982). "Listener's identification of environmental sounds," Perceptual Mot. Skills 55, 75-78. 10.2466/pms.1982.55.1.75
19. Lass, N. J., Eastham, S. K., Wright, T. L., Hinzman, A. H., Mills, K. J., and Hefferin, A. L. (1983). "Listener's identification of human-imitated sounds," Perceptual Mot. Skills 57, 995-998. 10.2466/pms.1983.57.3.995
20. Lass, N. J., Hinzman, A. H., Eastham, S. K., Wright, T. L., Mills, K. J., Bartlett, B. S., and Summers, P. A. (1984). "Listener's discrimination of real and human-imitated sounds," Perceptual Mot. Skills 58, 453-454. 10.2466/pms.1984.58.2.453
21. Lemaitre, G., Dessein, A., Susini, P., and Aura, K. (2011). "Vocal imitations and the identification of sound events," Ecol. Psychol. 23, 267-307. 10.1080/10407413.2011.617225
22. Lemaitre, G., and Heller, L. M. (2012). "Auditory perception of material is fragile, while action is strikingly robust," J. Acoust. Soc. Am. 131, 1337-1348. 10.1121/1.3675946
23. Lemaitre, G., and Heller, L. M. (2013). "Evidence for a basic level in a taxonomy of everyday action sounds," Exp. Brain Res. 226, 253-264. 10.1007/s00221-013-3430-7
24. Lemaitre, G., Houix, O., Misdariis, N., and Susini, P. (2010). "Listener expertise and sound identification influence the categorization of environmental sounds," J. Exp. Psychol. 16, 16-32.
25. Lemaitre, G., Houix, O., Visell, Y., Franinović, K., Misdariis, N., and Susini, P. (2009). "Toward the design and evaluation of continuous sound in tangible interfaces: The Spinotron," Int. J. Hum. Comput. Stud. 67, 976-993. 10.1016/j.ijhcs.2009.07.002
26. Nakano, T., and Goto, M. (2009). "Vocalistener: A singing-to-singing synthesis system based on iterative parameter estimation," in Proceedings of the Sound and Music Computing (SMC) Conference 2009 (The Sound and Music Computing Network, Porto, Portugal), pp. 343-348.
27. Nakano, T., Ogata, J., Goto, M., and Hiraga, Y. (2004). "A drum pattern retrieval method by voice percussion," in Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR 2004) (The International Society for Music Information Retrieval, Barcelona, Spain), pp. 550-553.
28. Newman, F. (2004). MouthSounds: How to Whistle, Pop, Boing and Honk for All Occasions... and Then Some (Workman Publishing Company, New York), 127 pages.
29. Oswalt, R. L. (1994). "Inanimate imitatives," in Sound Symbolism, edited by L. Hinton, J. Nichols, and J. Ohala (Cambridge University Press, Cambridge, UK), pp. 293-306.
30. Patel, A., and Iversen, J. (2003). "Acoustical and perceptual comparison of speech and drum sounds in the North India tabla tradition: An empirical study of sound symbolism," in Proceedings of the 15th International Congress of Phonetic Sciences (Universita Autònoma de Barcelona, Barcelona, Spain), pp. 925-928.
31. Peeters, G., Giordano, B. L., Susini, P., Misdariis, N., and McAdams, S. (2011). "The timbre toolbox: Extracting audio descriptors from musical signals," J. Acoust. Soc. Am. 130, 2902-2916. 10.1121/1.3642604
32. Rhodes, R. (1994). "Aural images," in Sound Symbolism, edited by L. Hinton, J. Nichols, and J. Ohala (Cambridge University Press, Cambridge, UK), pp. 276-291.
33. Rocchesso, D., Bresin, R., and Fernström, M. (2003). "Sounding objects," IEEE Multimedia 10, 42-52. 10.1109/MMUL.2003.1195160
34. Sobkowiak, W. (1990). "On the phonostatistics of English onomatopoeia "Stud. Anglica Posnaniensia 23, 15-30.
35. Strange, W., and Shafer, V. (2008). "Speech perception in second language learners: The reeducation of selective perception," in Phonology and Second Language Acquisition, edited by J. G. Hansen Edwards and M. L. Zampini (John Benjamin Publishing Company, Philadelphia, PA), Chap. 6, pp. 153-192.
36. Sundaram, S., and Narayanan, S. (2006). "Vector-based representation and clustering of audio using onomatopoeia words," in Proceedings of the American Association for Artificial Intelligence (AAAI) Symposium Series (American Association for Artificial Intelligence, Arlington, VA), pp. 55-58.
37. Sundaram, S., and Narayanan, S. (2008). "Classification of sound clips by two schemes: using onomatopeia and semantic labels," in Proceedings of the IEEE Conference on Multimedia and Expo (ICME) (Institute of Electrical and Electronics Engineers, Hanover, Germany), pp. 1341-1344.
38. Takada, M., Fujisawa, N., Obata, F., and Iwamiya, S. (2010). "Comparisons of auditory impressions and auditory imagery associated with onomatopoeic representations for environmental sounds," EURASIP J. Audio Speech Music Processing 674248.
39. Takada, M., Tanaka, K., and Iwamiya, S. (2006). "Relationships between auditory impressions and onomatopoeic features for environmental sounds," Acoust. Sci. Technol. 27, 67-79. 10.1250/ast.27.67
40. Takada, M., Tanaka, K., Iwamiya, S., Kawahara, K., Takanashi, A., and Mori, A. (2001). "Onomatopeic features of sounds emitted from laser printers and copy machines and their contributions to product image," in Proceedings of the International Conference on Acoustics ICA 2001 (International Commission for acoustics, Rome, Italy), CD-ROM available from http://www.icacommission.org/Proceedings/ICA2001Rome/ (date last viewed 08/09/2013).
41. Vanderveer, N. J. (1979). "Ecological acoustics: human perception of environmental sounds," Ph.D. thesis, Cornell University, Ithaca, NY.
42. Auchowski, R. (1998). "Stops and other sound-symbolic devices expressing the relative length of referent sounds in onomatopoeia," Stud. Anglica Posnaniensia 33, 475-485.