Timbre perception of sounds from impacted materials: Behavioral, electrophysiological and acoustic approaches

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5493 LNCS, Issue , 2009, Pages 1-17

  Aramaki, Mitsuko ^a,b   Besson, Mireille ^a,b   Kronland Martinet, Richard ^c   Ystad, Sølvi ^c  

^a CNRS   (France)

^b AIX MARSEILLE UNIVERSITY   (France)

^c LABORATOIRE DE MÉCANIQUE ET D ACOUSTIQUE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC DATA; BEHAVIORAL DATA; BRAIN ELECTRICAL ACTIVITY; EVENT-RELATED BRAIN POTENTIAL; MORPHING; NEURAL PROCESS; SPECTRAL CONTENT; TEMPORAL DYNAMICS;

ACOUSTICS; BRAIN; ELECTROPHYSIOLOGY; GLASS;

COMPUTER MUSIC;

EID: 68749083822     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-02518-1_1     Document Type: Conference Paper

References (60)

1. Michaels, C.F., Carello, C.: Direct perception. Prentice-Hall, Englewood Cliffs (1981)
2. Grey, J.M.: Multidimensional perceptual scaling of musical timbres. Journal of the Acoustical Society of America 61(5), 1270-1277 (1977)
3. Krumhansl, C.L.: Why is musical timbre so hard to understand. In: Structure and perception of electroacoustic sound and music. Elsevier, Amsterdam (1989)
4. Krimphoff, J., McAdams, S., Winsberg, S.: Caractérisation du timbre des sons complexes. ii: Analyses acoustiques et quantification psychophysique. Journal de Physique 4(C5), 625-628 (1994)
5. McAdams, S., Winsberg, S., Donnadieu, S., De Soete, G., Krimphoff, J.: Perceptual scaling of synthesized musical timbres: common dimensions, specificities, and latent subject classes. Psychological Research 58, 177-192 (1995)
6. von Helmholtz, H.L.F.: On the sensations of tone as the physiological basis for the theory of music, 2nd edn (1877)
7. Sethares, W.A.: Local consonance and the relationship between timbre and scale. Journal of the Acoustical Society of America 94(3), 1218-1228 (1993)
8. Vassilakis, P.N.: Selected Reports in Ethnomusicology (Perspectives in Systematic Musicology). In: Auditory roughness as a means of musical expression, Department of Ethnomusicology, University of California, vol. 12, pp. 119-144 (2005)
9. Freed, D. J.: Auditory correlates of perceived mallet hardness for a set of recorded percussive events. Journal of the Acoustical Society America 87(1), 311-322 (1990)
10. Tucker, S., Brown, G.J.: Investigating the perception of the size, shape and material of damped and free vibrating plates. Technical Report CS-02-10, Université de Sheffield, Department of Computer Science (2002)
11. van den Doel, K., Pai, D.K.: The sounds of physical shapes. Presence 7(4), 382-395 (1998)
12. KunklerPeck, A.J., Turvey, M.T.: Hearing shape. J. of Experimental Psychology: Human Perception and Performance 26(1), 279-294 (2000)
13. Carello, C., Anderson, K.L., KunklerPeck, A.J.: Perception of object length by sound. Psychological Science 9(3), 211-214 (1998)
14. Lutfi, R.A., Oh, E.L.: Auditory discrimination of material changes in a struckclamped bar. Journal of the Acoustical Society of America 102(6), 3647-3656 (1997)
15. Rocchesso, D., Fontana, F.: The sounding object (2003)
16. Lakatos, S., McAdams, S., Caussé, R.: The representation of auditory source characteristics: simple geometric form. Perception & Psychophysics 59, 1180-1190 (1997)
17. Wildes, R.P., Richards, W.A.: Recovering material properties from sound. In: Richards, W.A. (ed.), ch. 25, pp. 356-363. MIT Press, Cambridge (1988)
18. Gaver, W.W.: How do we hear in the world? explorations of ecological acoustics. Ecological Psychology 5(4), 285-313 (1993)
19. Klatzky, R.L., Pai, D.K., Krotkov, E.P.: Perception of material from contact sounds. Presence: Teleoperators and Virtual Environments 9(4), 399-410 (2000)
20. Giordano, B.L., McAdams, S.: Material identification of real impact sounds: Effects of size variation in steel, wood, and plexiglass plates. Journal of the Acoustical Society of America 119(2), 1171-1181 (2006)
21. Chaigne, A., Lambourg, C.: Time-domain simulation of damped impacted plates: I. theory and experiments. Journal of the Acoustical Society of America 109(4), 1422-1432 (2001)
22. Valette, C., Cuesta, C.: Mécanique de la corde vibrante (Mechanics of vibrating string). Traité des Nouvelles Technologies, série Mécanique. Hermès (1993)
23. Risset, J.-C., Wessel, D.L.: Exploration of timbre by analysis and synthesis. In: The psychology of music, 2nd edn. Cognition and Perception, pp. 113-169. Academic Press, London (1999)
24. Donders, F.C.: On the speed of mental processes. Acta Psychol. 30, 412-431 (1969)
25. Sternberg, S.: Memoryscanning: mental processes revealed by reactiontime experiments. American Scientist 57(4), 421-457 (1969)
26. Rugg, M.D., Coles, M.G.H.: The ERP and Cognitive Psychology: Conceptual issues. In: Electrophysiology of mind. Eventrelated brain potentials and cognition. Oxford Psychology, vol. 25, pp. 27-39. Oxford University Press, Oxford (1995)
27. Eggermont, J.J., Ponton, C.W.: The neurophysiology of auditory perception: from singleunits to evoked potentials. Audiology & Neuro-Otology 7, 71-99 (2002)
28. Näätänen, R.: Attention and brain function. Erlbaum, Hillsdale, NJ (1992)
29. Goydke, K.N., Altenmuller, E., Moller, J., Munte, J.: Changes in emotional tones and instrumental timbre are reflected by the mismatch negativity. Cognitive Brain Research 21, 351-359 (2004)
30. Tervaniemi, M.: Musical sound processing in the human brain: evidence from electric and magnetic recordings. Annals of the New York Academy of Sciences 930, 259-272 (2001)
31. Tervaniemi, M., Winkler, I., Näätänen, R.: Pre-attentive categorization of sounds by timbre as revealed by eventrelated potentials. NeuroReport 8, 2571-2574 (1997)
32. Toiviainen, P., Tervaniemi, M., Louhivuori, J., Saher, M., Huotilainen, M., Näätänen, R.: Timbre similarity: convergence of neural, behavioral, and computational approaches. Music Perception 16, 223-241 (1998)
33. Caclin, A., Brattico, E., Tervaniemi, M., Näätänen, R., Morlet, D., Giard, M.-H., McAdams, S.: Separate neural processing of timbre dimensions in auditory sensory memory. Journal of Cognitive Neuroscience 18(12), 1959-1972 (2006)
34. De Baene, W., Vandierendonck, A., Leman, M., Widmann, A., Tervaniemi, M.: Roughness perception in sounds: behavioral and erp evidence. Biological Psychology 67, 319-330 (2004)
35. Meyer, M., Baumann, S., Jancke, L.: Electrical brain imaging reveals spatiotemporal dynamics of timbre perception in humans. NeuroImage 32, 1510-1523 (2006)
36. Shahin, A., Bosnyak, D.J., Trainor, L.J., Roberts, L.E.: Enhancement of neuroplastic p2 and nlc auditory evoked potentials in musicians. The Journal of Neuroscience 23(12), 5545-5552 (2003)
37. Shahin, A., Roberts, L.E., Pantev, C., Trainor, L.J., Ross, B.: Modulation of p2 auditoryevoked responses by the spectral complexity of musical sounds. NeuroReport 16(16), 1781-1785 (2005)
38. PascualMarqui, R.D., Michel, C.M., Lehmann, D.: Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. International Journal of Psychophysiology 18, 49-65 (1994)
39. Sutton, S., Braren, M., Zubin, J., John, E.R.: Evoked potential correlates of stimulus uncertainty. Science 150, 1187-1188 (1965)
40. Donchin, E., Coles, M.G.H.: Is the p300 component a manifestation of context updating? Behavioral and Brain Sciences 11, 357-374 (1988)
41. Ritter, W., Simson, R., Vaughan, H.G.: Eventrelated potential correlates of two stages of information processing in physical and semantic discrimination tasks. Psychophysiology 20, 168-179 (1983)
42. Aramaki, M., Kronland-Martinet, R.: Analysis-synthesis of impact sounds by realtime dynamic filtering. IEEE Transactions on Audio, Speech, and Language Processing 14(2), 695-705 (2006)
43. Parncutt, R.: Harmony - A Psychoacoustical Approach. Springer, Heidelberg (1989)
44. Aramaki, M., Baillères, H., Brancheriau, L., Kronland-Martinet, R., Ystad, S.: Sound quality assessment of wood for xylophone bars. Journal of the Acoustical Society of America 121 (4), 2407-2420 (2007)
45. Jasper, H.H.: The tentwenty electrode system of the international federation. Electroen-cephalography and Clinical Neurophysiology 10, 371-375 (1958)
46. Delorme, A., Makeig, S.: Eeglab: an open source toolbox for analysis of single-trial eeg dynamics. Journal of Neuroscience Methods 134, 9-21 (2004)
47. Beauchamp, J.W.: Synthesis by spectral amplitude and " brightness" matching of analyzed musical instrument tones. Journal of the Audio Engineering Society 30(6), 396-406 (1982)
48. Marozeau, J., de Cheveigné, A., McAdams, S., Winsberg, S.: The dependency of timbre on fundamental frequency. Journal of the Acoustical Society of America 114, 2946-2957 (2003)
49. McAdams, S.: Perspectives on the contribution of timbre to musical structure. Computer Music Journal 23(3), 85-102 (1999)
50. Plomp, R., Levelt, W.J.M.: Tonal consonance and critical bandwidth. Journal of the Acoustical Society of America 38, 548-560 (1965)
51. Terhardt, E.: On the perception of periodic sound fluctuations (roughness). Acustica 30(4), 201-213 (1974)
52. Vassilakis, P.N.: Sra: A web-based research tool for spectral and roughness analysis of sound signals. In: Proceedings of the 4th Sound and Music Computing (SMC) Conference, pp. 319-325 (2007)
53. Aramaki, M., Brancheriau, L., Kronland-Martinet, R., Ystad, S.: Perception of impacted materials: sound retrieval and synthesis control perspectives. In: Ystad, S., Kronland-Martinet, R., Jensen, K. (eds.) Computer Music Modeling and Retrieval - Genesis of Meaning of Sound and Music. LNCS, vol. 5493, pp. 134-146. Springer, Heidelberg (2009)
54. Hyde, M.: The n1 response and its applications. Audiology & Neuro-Otology 2, 281-307 (1997)
55. Gordon, J.W.: The perceptual attack time of musical tones. Journal of Acoustical Society of America 82(1), 88-105 (1987)
56. Kuriki, S., Kanda, S., Hirata, Y: Effects of musical experience on different components of meg responses elicited by sequential piano-tones and chords. The Journal of Neuroscience 26(15), 4046-4053 (2006)
57. Kushnerenko, E., Ceponiene, R., Fellman, V., Huotilainen, M., Winkler, I.: Event-related potential correlates of sound duration: similar pattern from birth to adulthood. NeuroRe-port 12(17), 3777-3781 (2001)
58. Walter, W.G., Cooper, R., Aldridge, V.J., McCallum, W.C., Winter, A.L.: Contingent negative variation: an electrical sign of sensorimotor association and expectancy in the human brain. Nature 230, 380-384 (1964)
59. King, J., Kutas, M.: Who did what and when? using word- and clause-level erps to monitor working memory usage in reading. Journal of Cognitive Neuroscience 7(3), 376-395 (1995)
60. Alain, C., Schuler, B.M., McDonald, K.L.: Neural activity associated with distinguishing concurrent auditory objects. Journal of Acoustical Society of America 111(2), 990-995 (2002)