Controlling the perceived material in an impact sound synthesizer

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 2, 2011, Pages 301-314

  Aramaki, Mitsuko ^a,b   Besson, Mireille ^a,b   Kronland Martinet, Richard ^c   Ystad, Sølvi ^c  

^a Institut de Microbiologie de la Mediterranee   (France)

^b AIX MARSEILLE UNIVERSITY   (France)

^c LABORATOIRE DE MÉCANIQUE ET D ACOUSTIQUE   (France)

Author keywords

Analysissynthesis; control; event related potentials; impact sounds; mapping; material; sound categorization; timbre

Indexed keywords

ANALYSISSYNTHESIS; EVENT RELATED POTENTIALS; IMPACT SOUND; SOUND CATEGORIZATION; TIMBRE;

ACOUSTIC WAVES; ARCHITECTURAL ACOUSTICS; BRAIN; DAMPING; ELECTROPHYSIOLOGY; MATERIALS PROPERTIES;

IDENTIFICATION (CONTROL SYSTEMS);

EID: 78049309055     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2047755     Document Type: Article

References (60)

1. M. V. Mathews, "The digital computer as a musical instrument", Science, vol. 142, no. 3592, pp. 553-557, 1963.
2. R. Moog, "Position and force sensors and their application tokeyboards and related controllers", in Proc. AES 5th Int. Conf.: Music Digital Technol., 1987, pp. 179-181, A. E. S. New York, Ed.
3. M. Battier, "L'approche gestuelle dans l'histoire de la lutherie électronique. Etude d'un cas: Le theremin", Proc. Colloque International, ser. Collection Eupalinos, Editions Parenthèses, 1999, Les nouveaux gestes de la musique.
4. J. Tenney, "Sound-generation by means of a digital computer", J. Music Theory, vol. 7, no. 1, Spring, 1963.
5. A. Camurri, M. Ricchetti, M. Di Stefano, and A. Stroscio, "Eyesweb-Toward gesture and affect recognition in dance/music interactive systems", in Proc. Colloquio di Informatica Musicale, 1998.
6. P. Gobin, R. Kronland-Martinet, G. A. Lagesse, T. Voinier, and S. Ystad, From Sounds to Music: Different Approaches to Event Piloted Instruments, ser. Lecture Notes in Computer Science.: Springer-Verlag, 2003, vol. 2771, pp. 225-246.
7. M. Wanderley and M. Battier, "Trends in gestural control of music", IRCAM-Centre Pompidou, 2000.
8. J.-C. Risset and D. L. Wessel, "Exploration of timbre by analysis and synthesis", in The Psychology of Music, ser. Cognition and Perception, 2nd ed. New York: Academic, 1999, pp. 113-169.
9. D. L. Wessel, "Timbre space as a musical control structure", Comput. Music J., vol. 3, no. 2, pp. 45-52, 1979.
10. S. Ystad and T. Voinier, "A virtually-real flute", Comput. Music J., vol. 25, no. 2, pp. 13-24, Summer, 2001.
11. J. M. Grey, "Multidimensional perceptual scaling of musical timbres", J. Acoust. Soc. Amer., vol. 61, no. 5, pp. 1270-1277, 1977.
12. C. L. Krumhansl, "Why is musical timbre so hard to understand", in Structure and Perception of Electroacoustic Sound and Music. Amsterdam, The Netherlands: Elsevier, 1989.
13. J. Krimphoff, S. McAdams, and S. Winsberg, "Caractérisation du timbre des sons complexes. II: Analyses acoustiques et quantification psychophysique [characterization of timbre of complex sounds. II: Acoustical analyses and psychophysical quantification]", J. Phys., vol. 4, no. C5, pp. 625-628, 1994.
14. S. McAdams, S. Winsberg, S. Donnadieu, G. D. Soete, and J. Krimphoff, "Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes", Psychol. Res., vol. 58, pp. 177-192, 1995.
15. W. A. Sethares, "Local consonance and the relationship between timbre and scale", J. Acoust. Soc. Amer., vol. 94, no. 3, pp. 1218-1228, 1993.
16. P. N. Vassilakis, "Auditory roughness as a means of musical expression", Dept. of Ethnomusicology, Univ. of California, Selected reports in ethnomusicology (perspectives in systematic musicology), 2005, vol. 12, pp. 119-144.
17. R. P. Wildes and W. A. Richards, Recovering Material Properties From Sound, W. A. Richards, Ed. Cambridge, MA: MIT Press, 1988, ch. 25, pp. 356-363.
18. W. W. Gaver, "How do we hear in the world? explorations of ecological acoustics", Ecol. Psychol., vol. 5, no. 4, pp. 285-313, 1993.
19. R. Lutfi and E. Oh, "Auditory discrimination of material changes in a struck-clamped bar", J. Acoust. Soc. Amer., vol. 102, no. 6, pp. 3647-3656, 1997.
20. R. L. Klatzky, D. K. Pai, and E. P. Krotkov, "Perception of material from contact sounds", Presence: Teleoperators and Virtual Environments, vol. 9, no. 4, pp. 399-410, 2000.
21. B. L. Giordano and S. McAdams, "Material identification of real impact sounds: Effects of size variation in steel, wood, and Plexiglas plates", J. Acoust. Soc. Amer., vol. 119, no. 2, pp. 1171-1181, 2006.
22. M. Aramaki, M. Besson, R. Kronland-Martinet, and S. Ystad, "Timbre perception of sounds from impacted materials: Behavioral, electrophysiological and acoustic approaches", in Computer Music Modeling and Retrieval-Genesis of Meaning of Sound and Music, ser. LNCS, 5. Ystad, R. Kronland-Martinet, and K. Jensen, Eds. Berlin, Heidelberg, Germany: Springer-Verlag, 2009, vol. 5493, pp. 1-17.
23. M. Aramaki, R. Kronland-Martinet, T. Voinier, and S. Ystad, "A percussive sound synthesizer based on physical and perceptual attributes", Comput. Music J., vol. 30, no. 2, pp. 32-41, 2006.
24. M. Aramaki, R. Kronland-Martinet, T. Voinier, and S. Ystad, "Timbre control of a real-time percussive synthesizer", in Proc. 19th Int. Congr. Acoust. (CD-ROM), 2007, 84-87985-12-2.
25. M. Aramaki, C. Gondre, R. Kronland-Martinet, T. Voinier, and S. Ystad, "Thinking the sounds: An intuitive control of an impact sound synthesizer", in Proc. 15th Int. Conf. Auditory Display (ICAD 2009), 2009.
26. K. Steiglitz and L. E. McBride, "A technique for the identification of linear systems", IEEE Trans. Autom. Control, vol. AC-10, no. 10, pp. 461-464, Oct. 1965.
27. R. Roy and T. Kailath, "Esprit-estimation of signal parameters via rotational invariance techniques", IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 7, pp. 984-995, Jul. 1989.
28. R. O. Schmidt, "Multiple emitter location and signal parameter estimation", IEEE Trans. Antennas Propagat., vol. AP-34, no. 3, pp. 276-280, Mar. 1986.
29. R. Badeau, B. David, and G. Richard, "High-resolution spectral analysis of mixtures of complex exponentials modulated by polynomials", IEEE Trans. Signal Process., vol. 54, no. 4, pp. 1341-1350, Apr. 2006.
30. L.-M. Reissell and D. K. Pai, "High resolution analysis of impact sounds and forces", in Proc. WHC'07:2nd Joint EuroHaptics Conf. Symp. Haptic Interfaces for Virtual Environment and Teleoperator Syst., Washington, DC, 2007, pp. 255-260, IEEE Computer Society.
31. M. Aramaki and R. Kronland-Martinet, "Analysis-synthesis of impact sounds by real-time dynamic filtering", IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 2, pp. 695-705, Mar. 2006.
32. R. Kronland-Martinet, P. Guillemain, and S. Ystad, "Modelling of natural soundsby time-frequency and wavelet representations", Organised Sound, vol. 2, no. 3, pp. 179-191, 1997.
33. R. Parncutt, Harmony-A Psychoacoustical Approach. Berlin/Heidelberg, Germany: Springer, 1989.
34. A. Chaigne and C. Lambourg, "Time-domain simulation of damped impacted plates: I. Theory and experiments", J. Acoust. Soc. Amer., vol. 109, no. 4, pp. 1422-1432, 2001.
35. T. Ono and M. Norimoto, "Anisotropy of dynamic young's modulus and internal friction in wood", Jpn. J. Appl. Phys., vol. 24, no. 8, pp. 960-964, 1985.
36. S. McAdams, A. Chaigne, and V. Roussarie, "The psychomechanics of simulated sound sources: Material properties of impacted bars", J. Acoust. Soc. Amer., vol. 115, no. 3, pp. 1306-1320, 2004.
37. M. Aramaki, H. Baillères, L. Brancheriau, R. Kronland-Martinet, and S. Ystad, "Sound quality assessment of wood for xylophone bars", J. Acoust. Soc. Amer., vol. 121, no. 4, pp. 2407-2420, 2007.
38. [Online]. Available: http://www.lma.cnrs-mrs.fr/~kronland/Categorization/ sounds.html, last checked: Oct. 2009
39. M. Aramaki, L. Brancheriau, R. Kronland-Martinet, and S. Ystad, "Perception of impacted materials: Sound retrieval and synthesis control perspectives", in Computer Music Modeling and Retrieval-Genesis of Meaning of Sound and Music, ser. LNCS, S. Ystad, R. Kronland-Martinet, and K. Jensen, Eds. Berlin, Heidelberg, Germany: Springer-Verlag, 2009, vol. 5493, pp. 134-146.
40. M. D. Rugg and M. G. H. Coles, "The ERP and cognitive psychology: Conceptual Issues", in Electrophysiology of Mind. Event-Related Brain Potentials and Cognition, ser. Oxford Psychology. New York: Oxford Univ. Press, 1995, pp. 27-39, no. 25.
41. J. Eggermont and C. Ponton, "The neurophysiology of auditory perception: From single-units to evoked potentials", Audiol. Neuro-Otol., vol. 7, pp. 71-99, 2002.
42. A. Shahin, L. E. Roberts, C. Pantev, L. J. Trainor, and B. Ross, "Modulation of p2 auditory-evoked responses by the spectral complexity of musical sounds", NeuroReport, vol. 16, no. 16, pp. 1781-1785, 2005.
43. S. Kuriki, S. Kanda, and Y. Hirata, "Effects of musical experience on different components of meg responses elicited by sequential pianotones and chords", J. Neurosci., vol. 26, no. 15, pp. 4046-4053, 2006.
44. E. Kushnerenko, R. Ceponiene, V. Fellman, M. Huotilainen, and I. Winkler, "Event-related potential correlates of sound duration: Similar pattern from birth to adulthood", NeuroReport, vol. 12, no. 17, pp. 3777-2781, 2001.
45. C. Alain, B. M. Schuler, and K. L. McDonald, "Neural activity associated with distinguishing concurrent auditory objects", J. Acoust. Soc. Amer., vol. 111, no. 2, pp. 990-995, 2002.
46. S. McAdams, "Perspectives on the contribution of timbre to musical structure", Comput. Music J., vol. 23, no. 3, pp. 85-102, 1999.
47. H.-G. Kim, N. Moreau, and T. Sikora, MPEG-7 Audio and Beyond: Audio Content Indexing and Retrieval. New York: Wiley, 2005.
48. G. Peeters, "A Large set of audio features for sound description (similarity and description) in the Cuidado Project", IRCAM, Paris, France, 2004, Tech. Rep.
49. J. Marozeau, A. de Cheveigné, S. McAdams, and S. Winsberg, "The dependency of timbre on fundamental frequency", J. Acoust. Soc. Amer., vol. 114, pp. 2946-2957, 2003.
50. J. W. Beauchamp, "Synthesis by spectral amplitude and "brightness" matching of analyzed musical instrument tones", J. Audio Eng. Soc., vol. 30, no. 6, pp. 396-406, 1982.
51. R. Plomp and W. J. M. Levelt, "Tonal consonance and critical bandwidth", J. Acoust. Soc. Amer., vol. 38, pp. 548-560, 1965.
52. E. Terhardt, "On the perception of periodic sound fluctuations (roughness)", Acustica, vol. 30, no. 4, pp. 201-213, 1974.
53. P. N. Vassilakis, "SRA: A web-based research tool for spectral and roughness analysis of sound signals", in Proc. 4th Sound Music Comput. (SMC) Conf., 2007, pp. 319-325.
54. [Online]. Available: http://www.cycling74.com/, last checked: Octob. 2009
55. D. Rocchesso and F. Fontana, 2003, "The Sounding Object", [Online]. Available: http://www.soundobject.org/SobBook/Sob-Book-JUL03.pdf last checked: Oct. 2009
56. M. Hyde, "The N1 response and its applications", Audiol. Neuro-Otol., vol. 2, pp. 281-307, 1997.
57. C. Valette and C. Cuesta, Mécanique de la corde vibrante (Mechanics of vibrating string), ser. Traité des Nouvelles Technologies, série Mécanique. London, U. K.: Hermès, 1993.
58. N. H. Fletcher and T. D. Rossing, The Physics of Musical Instruments (Second Edition). Berlin, Germany: Springer-Verlag, 1998.
59. E. Zwicker and H. Fastl, Psychoacoustics, Facts and Models. Berlin, Germany: Springer-Verlag, 1990.
60. H. L. F. von Helmholtz, On the Sensations of Tone as the Physiological Basis for the Theory of Music, 2nd ed. New York: Dover, 1877, reprinted 1954.