Vocal imitations of non-vocal sounds

PLoS ONE

Volumn 11, Issue 12, 2016, Pages 1DUMMMY-

  Lemaitre, Guillaume ^a   Houix, Olivier ^a   Voisin, Frédéric ^a   Misdariis, Nicolas ^a   Susini, Patrick ^a  

^a Université Pierre et Marie Curie   (France)

Author keywords

[No Author keywords available]

Indexed keywords

CAR DRIVING; CASE REPORT; COMPUTER INTERFACE; HUMAN; IMITATION; REPRODUCTION; SOUND; VOCALIZATION; VOICE; ACOUSTICS; ADULT; ANIMAL; AUDITORY STIMULATION; FEMALE; HEARING; MALE; PHYSIOLOGY; VIDEORECORDING; YOUNG ADULT;

ACOUSTIC STIMULATION; ACOUSTICS; ADULT; ANIMALS; AUDITORY PERCEPTION; FEMALE; HEARING; HUMANS; IMITATIVE BEHAVIOR; MALE; SOUND; VIDEO RECORDING; VOICE; YOUNG ADULT;

EID: 85029340764     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0168167     Document Type: Article

References (99)

1. Porcello T. Speaking of sound: language and the professionalization of sound-recording engineers. Social Studies of Science. 2004; 34(5):733-758. doi: 10.1177/0306312704047328
2. Wright P. Linguistic description of auditory signals. Journal of applied psychology. 1971; 55(3):244-250. doi: 10.1037/h0031025
3. Houix O, Lemaitre G, Misdariis N, Susini P, Urdapilleta I. A lexical analysis of environmental sound categories. Journal of Experimental Psychology: Applied. 2012; 18(1):52-80. PMID: 22122114
4. Lemaitre G, Susini P, Rocchesso D, Lambourg C, Boussard P. Non-Verbal Imitations as a Sketching Tool for Sound Design. In: Aramaki M, Derrien O, Kronland-Martinet R, Ystad S, editors. Sound, Music, and Motion. Lecture Notes in Computer Sciences. Berlin, Heidelberg, Germany: Springer; 2014. p. 558-574.
5. Lemaitre G, Dessein A, Susini P, Aura K. Vocal imitations and the identification of sound events. Ecological Psychology. 2011; 23:267-307. doi: 10.1080/10407413.2011.617225
6. Lemaitre G, Rocchesso D. On the effectiveness of vocal imitation and verbal descriptions of sounds. Journal of the Acoustical Society of America. 2014; 135(2):862-873. doi: 10.1121/1.4861245 PMID: 25234894
7. Lemaitre G, Jabbari A, Misdariis N, Houix O, Susini P. Vocal imitations of basic auditory features. The Journal of the Acoustical Society of America. 2016; 139(1):290-300. doi: 10.1121/1.4939738 PMID: 26827025
8. Heyes C. Causes and consequences of imitations. TRENDS in cognitive sciences. 2001; 5(6):253-261. doi: 10.1016/S1364-6613(00)01661-2 PMID: 11390296
9. Zentall TR. Imitation by Animals How do they do it? Current Directions in Psychological Science. 2003; 12(3):91-95. doi: 10.1111/1467-8721.01237
10. Mercado E III, Mantell JT, Pfordresher PQ. Imitating sounds: A cognitive approach to understanding vocal imitation. Comparative Cognition & Behavior Reviews. 2014; 9. doi: 10.3819/ccbr.2014.90002
11. Kuhl PK, Meltzoff AN. Infant vocalizations in response to speech: Vocal imitation and developmental change. The journal of the Acoustical Society of America. 1996; 100(4):2425-2438. doi: 10.1121/1. 417951 PMID: 8865648
12. Meltzoff AN, Prinz W. The imitative mind. Development, evolution and brain bases. Cambridge, UK: Cambridge University Press; 2002.
13. Subiaul F, Anderson S, Brandt J, Elkins J. Multiple imitation mechanisms in children. Developmental psychology. 2012; 48(4):1165. doi: 10.1037/a0026646 PMID: 22201448
14. Chartrand TL, Bargh JA. The chameleon effect: the perception-behavior link and social interaction. Journal of Personality and Social Psychology. 1999; 76(6):893-910. doi: 10.1037/0022-3514.76.6.893 PMID: 10402679
15. Gentilucci M, Bernardis P. Imitation during phoneme production. Neuropsychologia. 2006; 45(3): 608-615. doi: 10.1016/j.neuropsychologia.2006.04.004 PMID: 16698051
16. Pardo JS. On phonetic convergence during conversational interaction. Journal of the Acoustical Society of America. 2006; 119(4):2382-2393. doi: 10.1121/1.2178720 PMID: 16642851
17. Miller RM, Sanchez K, Rosemblum LD. Alignment to visual speech information. Attention, perception and psychophysics. 2010; 72(6):1614-1625. doi: 10.3758/APP.72.6.1614 PMID: 20675805
18. Revis J, De Looze C, Giovanni A. Vocal flexibility and prosodic strategies in a professional impersonator. Journal of Voice. 2013; 27(4):524-e23. doi: 10.1016/j.jvoice.2013.01.008 PMID: 23453593
19. Pfordresher PQ, Brown S. Poor-pitch singing in the absence of "tone deafness". Music Perception. 2007; 25(2):95-115. doi: 10.1525/mp.2007.25.2.95
20. Pfordresher PQ, Brown S, Meier KM, Belyk M, Liotti M. Imprecise singing is widespread. The Journal of the Acoustical Society of America. 2010; 128(4):2182-2190. doi: 10.1121/1.3478782 PMID: 20968388
21. Wilson M. Perceiving imitatible stimuli: consequences of isomorphism between input and output. Psychological Bulletin. 2001; 127(4):543. doi: 10.1037/0033-2909.127.4.543 PMID: 11439711
22. De Torcy T, Clouet A, Pillot-Loiseau C, Vaissière J, Brasnu D, Crevier-Buchman L. A video-fiberscopic study of laryngopharyngeal behaviour in the human beatbox. Logopedics Phoniatrics Vocology. 2014; 39(1):38-48. doi: 10.3109/14015439.2013.784801
23. Sapthavee A, Yi P, Sims HS. Functional endoscopic analysis of beatbox performers. Journal of Voice. 2014; 28(3):328-331. doi: 10.1016/j.jvoice.2013.11.007 PMID: 24368015
24. de Saussure F. Cours de linguistique générale. Paris, France: Payot; 1916.
25. Sobkowiak W. On the phonostatistics of English onomatopoeia. Studia Anglica Posnaniensia. 1990; 23:15-30.
26. Zuchowski R. Stops and other sound-symbolic devices expressing the relative length of referent sounds in onomatopoeia. Studia Anglica Posnaniensia. 1998; 33:475-485.
27. Ohno M, Sato T, Tanaka K. Creation of sounds from linguistic information (continuous sounds). In: Proceedings of the 18th International Conference on Acoustics ICA 2004, Kyoto, Japan. Tokyo, Japan: Acoustical Society of Japan; 2004. p. 3295-3298.
28. Sato T, Ohno M, Tanaka K. Extraction of physical characteristics from onomatopoeia-Relationship between actual sounds, uttered sounds and their corresponding onomatopoeia. In: Proceedings of the 4th European Congress on Acoustics-Forum Acusticum, Budapest, Hungary. Madrid, Spain: European Acoustics Association; 2005. p. 1763-1768.
29. Takada M, Tanaka K, Iwamiya S. Relationships between auditory impressions and onomatopoeic features for environmental sounds. Acoustic Science and Technology. 2006; 27(2):67-79. doi: 10.1250/ ast.27.67
30. Takada M, Fujisawa N, Obata F, Iwamiya S. Comparisons of auditory impressions and auditory imagery associated with onomatopoeic representations for environmental sounds. EURASIPJournal on Audio, Speech, and Music Processing. 2010;.
31. Assaneo MF, Nichols JI, Trevisan MA. The anatomy of onomatopoeia. PLoS ONE. 2011; 6(12): e28317. doi: 10.1371/journal.pone.0028317 PMID: 22194825
32. Schmidtke DS, Conrad M, Jacobs AM. Phonological iconicity. Frontiers in Psychology. 2014; 5. doi: 10. 3389/fpsyg.2014.00080
33. Köhler W. Gestalt Psychology. New York, NY: Liveright Publishing Corporation; 1947.
34. Nielsen A, Rendall D. The sound of round: Evaluating the sound-symbolic role of consonants in the classic Takete-Maluma phenomenon. Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale. 2011; 65(2):115. doi: 10.1037/a0022268 PMID: 21668094
35. Patel A, Iversen J. Acoustical and perceptual comparison of speech and drum sounds in the North India tabla tradition: an empirical study of sound symbolism. In: Proceedings of the 15th International Congress of Phonetic Sciences. Barcelona, Spain: Universita Autònoma de Barcelona; 2003. p. 925-928.
36. Iwasaki N, Vinson DP, Vigliocco G. What do English speakers know about gera-gera and yota-yota? A cross-linguistic investigation of mimetic words for laughing and walking. Japanese-language education around the globe. 2007; 17:53-78.
37. Yoshida H. A cross-linguistic study of sound symbolism in children's verb learning. Journal of Cognition and Development. 2012; 13(2):232-265. doi: 10.1080/15248372.2011.573515 PMID: 23807870
38. Corballis MC. From hand to mouth: the origins of language. Princeton, NJ: Princeton University Press; 2002.
39. Larsson M. Tool-use-associated sound in the evolution of language. Animal cognition. 2015; 18(5): 993-1005. doi: 10.1007/s10071-015-0885-x PMID: 26118672
40. Ma W, Thompson WF. Human emotions track changes in the acoustic environment. Proceedings of the National Academy of Sciences. 2015; 112(47):14563-14568. doi: 10.1073/pnas.1515087112
41. Perlman M, Dale R, Lupyan G. Iconicity can ground the creation of vocal symbols. Royal Society open science. 2015; 2(8):150152. doi: 10.1098/rsos.150152 PMID: 26361547
42. Rhodes R. Aural Images. In: Hinton L, Nichols J, Ohala J, editors. Sound Symbolism. Cambridge, UK: Cambridge University Press; 1994. p. 276-291.
43. Takada M, Tanaka K, Iwamiya S, Kawahara K, Takanashi A, Mori A. Onomatopeic Features of Sounds Emitted from Laser Printers and Copy Machines and Their Contributions to Product Image. In: Proceedings of the International Conference on Acoustics ICA 2001, Rome, Italy. Rome, Italy: Acoustical Society of Italy; 2001. p. 3C.16.01.
44. Lesaffre M, Moelants D, Leman M. Spontaneous user behavior in "vocal" queries for music information retrieval. In: Hewlett WB, Selfridge-Field E, editors. music query methods models and user studies (Computing in musicology 13). Cambridge, MA: CCARH and the MIT Press; 2004. p. 129-146.
45. Sundaram S, Narayanan S. Classification of sound clips by two schemes: using onomatopeia and semantic labels. In: Proceedings of the IEEE conference on multimedia and expo (ICME). Hanover, Germany: Institute of Electrical and Electronics Engineers; 2008. p. 1341-1344.
46. Gillet O, Richard G. Drum loops retrieval from spoken queries. Journal of Intelligent Information Systems. 2005; 24(2/3):160-177.
47. Esling P, Agon C. Multiobjective time series matching for audio classification and retrieval. IEEE Transactions on Audio, Speech, and Language Processing. 2013; 21(10):2057-2072. doi: 10.1109/TASL. 2013.2265086
48. Rocchesso D, Lemaitre G, Susini P, Ternström S, Boussard P. Sketching sound with voice and gesture. ACM Interactions. 2015; 22(1):38-41. doi: 10.1145/2685501
49. Del Piccolo A, Rocchesso D. Non-speech voice for sonic interaction: a catalogue. Journal on Multimodal User Interfaces. 2016; p. 1-17.
50. Misdariis N, Cera A, Levallois E, Locqueteau C. Do electric cars have to make noise? An emblematic opportunity for designing sounds and soundscapes. In: Proceedings of the 11th Congrès Français d'Acoustique and the 2012 Annual IOA Meeting, Acoustics 2012, Nantes, France. Paris, France: Society Française d'Acoustique; 2012. p. 1045-1050.
51. Ward PH, Sanders JW, Goldman R, Moore GP. Diplophonia. The Annals of otology, rhinology, and laryngology. 1969; 78(4):771-777. doi: 10.1177/000348946907800409 PMID: 5799401
52. Klingholz F. Overtone singing: productive mechanisms and acoustic data. Journal of Voice. 1993; 7(2): 118-122. doi: 10.1016/S0892-1997(05)80340-6 PMID: 8353624
53. Suied C, Drémeau A, Pressnitzer D, Daudet L. Auditory sketches: sparse representations of sounds based on perceptual models. In: Aramaki M, Barthet M, Kronland-Martinet R, Ystad S, editors. From Sounds to Music and Emotions, 9th International Symposium, CMMR 2012, London, UK, June 19-22, 2012, Revised Selected Papers. vol. 7900 of Lecture Notes in Computer Science. Berlin/Heidelberg, Germany: Springer; 2013. p. 154-170.
54. Lemaitre G, Houix O, Misdariis N, Susini P. Listener expertise and sound identification influence the categorization of environmental sounds. Journal of Experimental Psychology: Applied. 2010; 16(1):16-32. PMID: 20350041
55. Lemaitre G, Heller LM. Evidence for a basic level in a taxonomy of everyday action sounds. Experimental Brain Research. 2013; 226(2):253-264. doi: 10.1007/s00221-013-3430-7 PMID: 23411674
56. Parizet E, Brocard J, Piquet B. Influence of noise and vibration to comfort in diesel engine cars running at idle. Acta Acustica united with Acustica. 2004; 90:987-993.
57. Parizet E, Guyader E, Nosulenko V. Analysis of car door closing sound quality. Applied acoustics. 2008; 69:12-22. doi: 10.1016/j.apacoust.2006.09.004
58. Lemaitre G, Vartanian C, Lambourg C, Boussard P. A psychoacoustical study of wind buffeting noise. Applied acoustics. 2015; 95:1-12. doi: 10.1016/j.apacoust.2015.02.011
59. Ih JG, Lim DH, Shin SH, Park Y. Experimental design and assessment of product sound quality: application to a vacuum cleaner. Noise control engineering journal. 2003; 51(4):244-252. doi: 10.3397/1. 2839720
60. Jeon JY, You J, Chang HY. Sound radiation and sound quality characteristics of refrigerator noise in real living environments. Applied acoustics. 2007; 68:1118-1134. doi: 10.1016/j.apacoust.2006.06.005
61. Penna Leite R, Paul S, Gerges SNY. A sound quality-based investagation of the HVAC system noise of an automobile model. Applied Acoustics. 2009; 70:636-645. doi: 10.1016/j.apacoust.2008.06.010
62. Stanton NA, Edworthy J, editors. Human Factors in Auditory Warnings. Farnham, UK: Ashgate Publishing Ltd.; 1999.
63. Lemaitre G, Susini P, Winsberg S, Letinturier B, McAdams S. The Sound Quality of Car Horns: Designing New Representative Sounds. Acta Acustica united with Acustica. 2009; 95(2):356-372. doi: 10. 3813/AAA.918158
64. Suied C, Susini P, McAdams S. Evaluating warning sound urgency with reaction times. Journal of Experimental Psychology: Applied. 2008; 14(3):201-212. PMID: 18808274
65. Lemaitre G, Heller LM. Auditory perception of material is fragile, while action is strikingly robust. Journal of the Acoustical Society of America. 2012; 131(2):1337-1348. doi: 10.1121/1.3675946 PMID: 22352507
66. Peeters G, Deruty E. Sound indexing using morphological description. IEEE Transactions on audio, speech, and language processing. 2010; 18(3):675-687. doi: 10.1109/TASL.2009.2038809
67. Helgason P. Sound initiation and source types in human imitations of sounds. In: Proceedings of FONE-TIK 2014. Stockholm, Sweden: Stockholm University; 2014. p. 83-88.
68. Cartwright M, Pardo B. VocalSketch: vocally imitating audio concepts. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 2015, Seoul, Republic of Korea. New York, NY: Association for Computing Machinery; 2015. p. 43-46.
69. Augoyard JF. L'entretien sur écoute réactivée. In: Grosjean M, Thibaud JP, editors. L'espace urbain en méthodes. Marseille, France: Parenthèses; 2001. p. 127-152.
70. Chi T, Ru P, Shamma S. Multiresolution spectrotemporal analysis of complex sounds. Journal of the Acoustical Society of America. 2005; 118(2):887-906. doi: 10.1121/1.1945807 PMID: 16158645
71. Yang X, Wang K, Shamma SA. Auditory representations of acoustic signals. IEEE Transactions on Information Theory. 1992; 38(2):824-839. doi: 10.1109/18.119739
72. Schwarz D, Rodet X, et al. Spectral envelope estimation and representation for sound analysis-synthesis. In: Proceedings of the International Computer Music Conference (ICMC), Beijing, China. San Francisco, CA: International Computer Music Association; 1999. p. 351-354.
73. Roebel A. On sinusoidal modeling of nonstationary signals. The Journal of the Acoustical Society of America. 2008; 123(5):3803-3803. doi: 10.1121/1.2935499
74. Macmillan NA, Creelman CD. Detection theory. A user's guide. 2nd ed. Mahwah, NJ: Lawrence Erlbaum Associates; 2005.
75. Stanislaw H, Todorov N. Calculation of signal detection theory measures. Behavior research methods, instruments, & computers. 1999; 31(1):137-149. doi: 10.3758/BF03207704
76. Agus TR, Suied C, Thorpe SJ, Pressnitzer D. Fast recognition of musical sounds based on timbre. The Journal of the Acoustical Society of America. 2012; 131(5):4124-4133. doi: 10.1121/1.3701865 PMID: 22559384
77. Isnard V, Taffou M, Viaud-Delmon I, Suied C. Auditory sketches: very sparse representations of signals are still recognizable. PLOS One. 2016; 11(3):e0150313. doi: 10.1371/journal.pone.0150313 PMID: 26950589
78. Moore BC. Temporal integration and context effects in hearing. Journal of Phonetics. 2003; 31(3): 563-574. doi: 10.1016/S0095-4470(03)00011-1
79. De Götzen A, Bernardini N, Arfib D. Traditional (?) implementations of a phase-vocoder: The tricks of the trade. In: Proceedings of the COST G-6 Conference on Digital Audio Effects (DAFX-00), Verona, Italy. Verona, Italy: Dipartmento Scientifico e Tecnologico, Università di Verona, Italy; 2000.
80. Marchetto E, Peeters G. A set of audio features for the morphological description of vocal imitations. In: Proceedings of the 18th International Conference on Digital Audio Effects (DAFX-2015). Trondheim, Norway: Department of Music and Department of Electronics and Telecommunication, Norwegian University of Science and Technology; 2015. p. 207-214.
81. Camacho A, Harris JG. A sawtooth waveform inspired pitch estimator for speech and music. The Journal of the Acoustical Society of America. 2008; 124(3):1638-1652. doi: 10.1121/1.2951592 PMID: 19045655
82. Peeters G, Giordano BL, Susini P, Misdariis N, McAdams S. The timbre toolbox: Extracting audio descriptors from musical signals. Journal of the Acoustical Society of America. 2011; 130(5):2902. doi: 10.1121/1.3642604 PMID: 22087919
83. Hutchins S, Roquet C, Peretz I. The vocal generosity effect: How bad can your singing be? Music Perception. 2012; 30(2):147-159. doi: 10.1525/mp.2012.30.2.147
84. Delle Monache S, Rocchesso D, Baldan S, Mauro DA. Growing the practice of vocal sketching. In: Proceedings of the 21st International Conference on Auditory Display (ICAD-2015), Graz, Austria. Graz, Austria: Institute of Electronic Music and Acoustics (IEM), University of Music and Performing Arts Graz (KUG); 2015. p. 58-64.
85. McAdams S. Recognition of auditory sound sources and events. In: McAdams S, Bigand E, editors. Thinking in sound: the cognitive psychology of human audition. Oxford, UK: Oxford University Press; 1993. p. 146-198.
86. Eysenck MW, Keane MT. Cognitive psychology: A student's handbook. Hove, UK: Taylor & Francis; 2000.
87. Houix O, Delle Monache S, Lachambre H, Lemaitre G, Rocchesso D. Innovative tools for sound sketching combining vocalizations and gestures. In: Proceedings of Audio Mostly. Norrköping, Sweden: The Visualization Center C; 2016.
88. Brass M, Heyes C. Imitation: is cognitive neuroscience solving the correspondence problem? TRENDS in cognitive sciences. 2005; 9(10):489-495. doi: 10.1016/j.tics.2005.08.007 PMID: 16126449
89. Pfordresher PQ, Mantell JT. Singing with yourself: evidence for an inverse modeling account of poorpitch singing. Cognitive psychology. 2014; 70:31-57. doi: 10.1016/j.cogpsych.2013.12.005 PMID: 24480454
90. Mantell JT, Pfordresher PQ. Vocal imitation of song and speech. Cognition. 2013; 127(2):177-202. doi: 10.1016/j.cognition.2012.12.008 PMID: 23454792
91. McAdams S, Winsberg S, Donnadieu S, Soete GD, Krimphoff J. Perceptual Scaling of synthesized musical timbres: common dimensions, specificities and latent subject classes. Psychological Research. 1995; 58:177-192. doi: 10.1007/BF00419633 PMID: 8570786
92. Caclin A, Brattico E, Tervaniemi M, Näätänen R, Morlet D, Giard MH, et al. Separate neural processing of timbre dimensions in auditory sensory memory. Journal of Cognitive Neuroscience. 2006; 18(12): 1959-1972. doi: 10.1162/jocn.2006.18.12.1959 PMID: 17129184
93. Misdariis N, Minard A, Susini P, Lemaitre G, McAdams S, Parizet E. Environmental sound perception: meta-description and modeling based on independent primary studies. Eurasip Journal on Speech, Audio and Music Processing. 2010; 2010. doi: 10.1155/2010/362013
94. Aucouturier JJ, Bigand E. Mel Cepstrum & Ann Ova: The Difficult Dialog Between MIR and Music Cognition. In: Proceedings of the International Conference on Music Information Retrieval (ISMIR). Porto, Portugal: INESC TEC; 2012. p. 397-402.
95. Pachet F, Roy P. Analytical features: a knowledge-based approach to audio feature generation. EURA-SIP Journal on Audio, Speech, and Music Processing. 2009; 2009(1):1. doi: 10.1155/2009/153017
96. Patil K, Pressnitzer D, Shamma S, Elhilali M. Music in our ears: the biological bases of musical timbre perception. PLoS Compututational Biology. 2012; 8(11):e1002759. doi: 10.1371/journal.pcbi.1002759
97. Siedenburg K, Fujinaga I, McAdams S. A Comparison of Approaches to Timbre Descriptors in Music Information Retrieval and Music Psychology. Journal of New Music Research. 2016; 45(1):27-41. doi: 10.1080/09298215.2015.1132737
98. Agus TR, Thorpe SJ, Pressnitzer D. Rapid Formation of robust auditory memories: insights from noise. Neuron. 2010; 66:610-618. doi: 10.1016/j.neuron.2010.04.014 PMID: 20510864
99. Pressnitzer D, Agus T, Suied C. Acoustic timbre recognition. Encyclopedia of Computational Neuroscience. 2015; p. 128-133.