Non-verbal imitations as a sketching tool for sound design

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8905, Issue , 2014, Pages 558-574

  Lemaitre, Guillaume ^a   Susini, Patrick ^b   Rocchesso, Davide ^c   Lambourg, Christophe ^a   Boussard, Patrick ^a  

^a GENESIS Acoustics   (France)

^b SORBONNE UNIVERSITÉ   (France)

^c UNIVERSITY IUAV OF VENICE   (Italy)

Author keywords

Cognition; Imitations; Perception; Recognition; Sound design; Vocal imitations

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SCIENCE; COMPUTERS; SENSORY PERCEPTION;

COGNITION; IMITATIONS; RECOGNITION; SOUND DESIGNS; VOCAL IMITATIONS;

COMPUTER MUSIC;

EID: 84918528644     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-319-12976-1_34     Document Type: Conference Paper

References (40)

1. Ballas, J.A.: Common factors in the identification of an assortment of brief everyday sounds. J. Exp. Psychol. Hum. Percept. Perform. 19(2), 250–267 (1993)
2. Blommer, M., Amman, S., Abhyankar, S., Dedecker, B.: Sound quality metric development for wind buffetting and gusting noise. In: Proceedings of the Noise and Vibration Conference and Exhibition, Traverse City, MI. Society of Automotive Engineers International, Warrendale, PA (2003). SAE Technical paper series 2003– 01-1509
3. Buxton, B.: Sketching the User Experience. Morgan Kaufman as an imprint of Elsevier, San Francisco (2007)
4. Ekman, I., Rinott, M.: Using vocal sketching for designing sonic interactions. In: DIS’10: Proceedings of the 8th ACM Conference on Designing Interactive Systems, pp. 123–131. Association for Computing Machinery, New York (2010)
5. Faure, A.: Des sons aux mots: comment parle-t-on du timbre musical? Unpublished doctoral dissertation, Ecole de Hautes Etudes en Sciences Sociales, Paris, France (2000)
6. Gaver, W.W.: How do we hear in the world? Explorations in ecological acoustics. Ecol. Psychol. 5(4), 285–313 (1993)
7. Gaver, W.W.: What do we hear in the world? An ecological approach to auditory event perception. Ecol. Psychol. 5(1), 1–29 (1993)
8. Gillet, O., Richard, G.: Drum loops retrieval from spoken queries. J. Intell. Inf. Syst. 24(2/3), 160–177 (2005)
9. Hashimoto, T., Usui, N., Taira, M., Nose, I., Haji, T., Kojima, S.: The neural mechanism associated with the processing of onomatopoeic sounds. Neuroimage 31, 1762–1170 (2006)
10. Houix, O., Lemaitre, G., Misdariis, N., Susini, P., Urdapilleta, I.: A lexical analysis of environmental sound categories. J. Exp. Psychol. Appl. 18(1), 52–80 (2012)
11. Ishihara, K., Nakatani, T., Ogata, T., Okuno, H.G.: Automatic sound-imitation word recognition from environmental sounds focusing on ambiguity problem in determining phonemes. In: Zhang, C., W. Guesgen, H., Yeap, W.-K. (eds.) PRICAI 2004. LNCS (LNAI), vol. 3157, pp. 909–918. Springer, Heidelberg (2004)
12. Ishihara, K., Tsubota, Y., Okuno, H.G.: Automatic transcription of environmental sounds into sound-imitation words based on japanese syllable structure. In: Proceedings of Eurospeech 2003, pp. 3185–3188. International Speech Communication Association, Geneva (2003)
13. Iwasaki, N., Vinson, D.P., Vigliocco, G.: What do English speakers know about gera-gera and yota-yota? A cross-linguistic investigation of mimetic words for laughing and walking. Japanese-language Educ. Around Globe 17, 53–78 (2007)
14. Kahn, M.S., Högström, C.: Determination of sound quality of HVAC systems on trains using multivariate analysis. Noise Control Eng. J. 49(6), 276–283 (2001)
15. Lass, N.J., Eastham, S.K., Parrish, W.C., Sherbick, K.A., Ralph, D.M.: Listener’s identification of environnmental sounds. Percept. Mot. Skills 55, 75–78 (1982)
16. Lass, N.J., Eastham, S.K., Wright, T.L., Hinzman, A.H., Mills, K.J., Hefferin, A.L.: Listener’s identification of human-imitated sounds. Percept. Mot. Skills 57, 995–998 (1983)
17. Lass, N.J., Hinzman, A.H., Eastham, S.K., Wright, T.L., Mills, K.J., Bartlett, B.S., Summers, P.A.: Listener’s discrimination of real and human-imitated sounds. Percept. Mot. Skills 58, 453–454 (1984)
18. Lemaitre, G., Dessein, A., Susini, P., Aura, K.: Vocal imitations and the identification of sound events. Ecol. Psychol. 23, 267–307 (2011)
19. Lemaitre, G., Heller, L.M.: Auditory perception of material is fragile, while action is strikingly robust. J. Acoust. Soc. Am. 131(2), 1337–1348 (2012)
20. Lemaitre, G., Houix, O., Misdariis, N., Susini, P.: Listener expertise and sound identification influence the categorization of environmental sounds. J. Exp. Psy-chol. Appl. 16(1), 16–32 (2010)
21. Lemaitre, G., Rocchesso, D.: On the effectiveness of vocal imitation and verbal descriptions of sounds. J. Acoust. Soc. Am. 135(2), 862–873 (2014)
22. Lemaitre, G., Susini, P., Winsberg, S., Letinturier, B., McAdams, S.: The sound quality of car horns: a psychoacoustical study of timbre. Acta Acust. United Acust. 93(3), 457–468 (2007)
23. Lemaitre, G., Susini, P., Winsberg, S., Letinturier, B., McAdams, S.: The sound quality of car horns: designing new representative sounds. Acta Acust. United Acust. 95(2), 356–372 (2009)
24. Nakano, T., Goto, M.: Vocalistener: a singing-to-singing synthesis system based on iterative parameter estimation. In: Proceedings of the Sound and Music Computing (SMC) Conference 2009, pp. 343–348. The Sound and Music Computing Network, Porto (2009)
25. Nakano, T., Ogata, J., Goto, M., Hiraga, Y.: A drum pattern retrieval method by voice percussion. In: Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR 2004), pp. 550–553. The International Society for Music Information Retrieval, Barcelona (2004)
26. Norman, D.: The Design of Everyday Things. Basic Books, New York (2002)
27. Oswalt, R.L.: Inanimate imitatives. In: Hinton, L., Nichols, J., Ohala, J. (eds.) Sound Symbolism, pp. 293–306. Cambridge University Press, Cambridge (1994)
28. Patel, A., Iversen, J.: Acoustical and perceptual comparison of speech and drum sounds in the North India tabla tradition: an empirical study of sound symbolism. In: Proceedings of the 15th International Congress of Phonetic Sciences, pp. 925–928. Universita Autònoma de Barcelona, Barcelona (2003)
29. Pharies, D.A.: Sound symbolism in the Romance languages. Ph.D. thesis, University of California, Berkeley (1979)
30. Rhodes, R.: Aural images. In: Hinton, L., Nichols, J., Ohala, J. (eds.) Sound Symbolism, pp. 276–291. Cambridge University Press, Cambridge (1994)
31. Serafin, S., Franinović, K., Hermann, T., Lemaitre, G., Rinott, M., Rocchesso, D.: Sonic interaction design. In: Hermann, T., Hunt, A., Neuhoff, J.G. (eds.) Sonifica-tion Handbook, chap. 5, pp. 87–110. Logos Verlag, Berlin (2011)
32. Sobkowiak, W.: On the phonostatistics of English onomatopoeia. Studia Anglica Posnaniensia 23, 15–30 (1990)
33. Strange, W., Shafer, V.: Speech perception in second language learners: the reeducation of selective perception. In: Hansen Edwards, J.G., Zampini, M.L. (eds.) Phonology and Second Language Acquisition, chap. 6, pp. 153–192. John Benjamin Publishing Company, Philapelphia (2008)
34. Sundaram, S., Narayanan, S.: Vector-based representation and clustering of audio using onomatopoeia words. In: Proceedings of the American Association for Artificial Intelligence (AAAI) Symposium Series, pp. 55–58. American Association for Artificial Intelligence, Arlington (2006)
35. Sundaram, S., Narayanan, S.: Classification of sound clips by two schemes: using onomatopeia and semantic labels. In: Proceedings of the IEEE Conference on Multimedia and Exposition (ICME), pp. 1341–1344. Institute of Electrical and Electronics Engineers, Hanover (2008)
36. Takada, M., Tanaka, K., Iwamiya, S., Kawahara, K., Takanashi, A., Mori, A.: Onomatopeic features of sounds emitted from laser printers and copy machines and their contributions to product image. In: Proceedings of the International Conference on Acoustics ICA 2001. International Commission for acoustics, Rome, Italy (2001). CD-ROM available from http://www.icacommission.org/ Proceedings/ICA2001Rome/. date last viewed 08 Sep 2013, paper ID: 3C.16.01
37. Takada, M., Fujisawa, N., Obata, F., Iwamiya, S.: Comparisons of auditory impressions and auditory imagery associated with onomatopoeic representations for environmental sounds. EURASIP J. Audio, Speech, Music Process. 2010, Article ID 674248, 8p (2010)
38. Takada, M., Tanaka, K., Iwamiya, S.: Relationships between auditory impressions and onomatopoeic features for environmental sounds. Acoust. Sci. Technol. 27(2), 67–79 (2006)
39. Troubetzkoy, N.S.: Principe de Phonologie. Librairie Klincksieck, Paris (1949)
40. Zuchowski, R.: Stops and other sound-symbolic devices expressing the relative length of referent sounds in onomatopoeia. Stud. Anglica Posnaniensia 33, 475–485 (1998)