Exploring perceptual and acoustical correlates of polyphonic timbre

Music Perception

Volumn 27, Issue 3, 2010, Pages 223-241

  Alluri, Vinoo ^a   Toiviainen, Petri ^a  

^a UNIVERSITY OF JYVÄSKYLÄ   (Finland)

Author keywords

Acoustic features; Bipolar scales; Computational analysis; Modeling; Polyphonic timbre

Indexed keywords

EID: 76249129219     PISSN: 07307829     EISSN: 15338312     Source Type: Journal    
DOI: 10.1525/mp.2010.27.3.223     Document Type: Article

References (71)

1. AUCOUTURIER, J. J. (2006). Dix expériences sur la modélisation du timbre polyphonique [Ten experiments on the modelling of polyphonic timbre]. Unpublished doctoral dissertation, Universite Paris 6, France.
2. AUCOUTURIER, J. J., & PACHET, F. (2003). Representing musical genre: A state of the art. Journal of New Music Research, 32, 83-93.
3. AUCOUTURIER, J. J., & PACHET, F. (2007). The influence of polyphony on the dynamical modeling of musical timbre. Pattern Recognition Letters, 28, 654-661.
4. BARBEDO, J. G. A., & LOPES, A. (2007).Automatic genre classification of musical signals. The European Association for Signal Processing Journal on Advances in Signal Processing, 2007, 157-168.
5. BEAUCHAMP, J. W. (1982). Synthesis by spectral amplitude and "brightness" matching of analyzed musical instrument tones. The Journal of Audio Engineering Society, 30, 396-406.
6. BERGER, H. M., & FALES, C. (2004). The match of perceptual and acoustic features over time. In P. D. Greene & T. Porcello (Eds.), Wired for Sound: Engineering and Technologies in Sonic Cultures (p. 181).Middletown, CT:Wesleyan University Press.
7. BOX, G., & COX, D. (1964). An analysis of transformations. Journal of the Royal Statistical Society.Series B (Methodological), 26, 211-252.
8. CACLIN, A., MCADAMS, S., SMITH, B. K., & GIARD, M. H. (2008). Interactive processing of timbre dimensions: An exploration with event-related potentials. Journal of Cognitive Neuroscience, 20, 49-64.
9. CACLIN, A., MCADAMS, S., SMITH, B. K., & WINSBERG, S. (2005). Acoustic correlates of timbre space dimensions: A confirmatory study using synthetic tones. Journal of the Acoustical Society of America, 118, 471-482.
10. COSI, P., DE POLI, G., & LAUZZANA, G. (1994). Auditory modelling and self-organizing neural networks for timbre classification. Journal of New Music Research, 23, 71-98.
11. DARKE, G. (2005). Assessment of timbre using verbal attributes. In C. Traube & S. Lacasse (Eds.), Proceedings of the Second Conference on Interdisciplinary Musicology (pp. 1-12). Montreal, Quebec, Canada: Université de Montréal.
12. DAVIS, S. B., & MERMELSTEIN, P. (1980). Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences, Institute of Electrical and Electronics Engineers, Transactions on Acoustics, Speech, and Signal Processing, 28, 357-366.
13. DE POLI, G., & PRANDONI, P. (1997). Sonological models for timbre characterization. Journal of New Music Research, 26, 170-197.
14. DE POLI, G., PRANDONI, P., & TONELLA, P. (1993) Timbre clustering by self-organizing neural networks. In G. Haus & I. Pighi (Eds.), Proceedings of X Colloquium on Musical Informatics (pp. 102-108).Milan: Associazione di Informatica Musicale Italiana.
15. DISLEY, A. C., & HOWARD, D. M. (2004). Spectral correlates of timbral semantics relating to the pipe organ. Proceedings of the Joint Baltic-Nordic Acoustics Meeting (pp. 1-12).Mariehamn, Åland.
16. DISLEY, A. C., HOWARD, D. M., & HUNT, A. D. (2006). Timbral description of musical instruments. In M. Baroni, A. R. Addessi, R. Caterina, & M. Costa (Eds.), International Conference on Music Perception and Cognition, 61-68.
17. Bologna, Italy: Society for Music Perception and Cognition (SMPC) and European Society for the Cognitive Sciences of Music (ESCOM).
18. EEROLA, T., ALLURI, V., & FERRER, R. (2008). Emotional connotations of isolated instruments sounds. In S.W. Yi (Ed.), Proceedings of the 10th International Conference on Music Perception and Cognition (pp. 483-489). Sapporo, Japan: University of Hokkaido.
19. FITZGERALD, R. A., & LINDSAY, A. T. (2004). Tying semantic labels to computational descriptors of similar timbres. Proceedings of Sound and Music Computing. Paris: IRCAM. Retrieved December 7, 2009, from http://smcnetwork.org/ files/proceedings/2004/P45.pdf
20. FLETCHER, H., & MUNSON, W. A. (1933). Loudness, its definition, measurement and calculation. Journal of the Acoustical Society of America, 5, 82-108.
21. FLEXER, A., PAMPALK, E., & WIDMER, G. (2005). Hidden Markov models for spectral similarity of songs. Proceedings of the 8th International Conference on Digital Audio Effects (pp. 131-136).Madrid, Spain: International Conference on Digital Audio Effects.
22. GJERDINGEN, R., O., & PERROTT, D. (2008). Scanning the dial: The rapid recognition of music genres. Journal of New Music Research, 37, 93-100.
23. GOUNAROPOULOS, A., & JOHNSON, C. G. (2006). Synthesising timbres and timbre-changes from adjectives/adverbs. Lecture Notes in Computer Science, 3907, 664-675.
24. GREY, J. M. (1977).Multidimensional perceptual scaling of musical timbres. Journal of the Acoustical Society of America. 61, 1270-1277.
25. GREY, J. M., & GORDON, J. W. (1978). Perceptual effects of spectral modifications on musical timbres. Journal of the Acoustical Society of America, 63, 1493-1500.
26. HARRIS, R. J. (2001). A primer of multivariate statistics. New York: Academic Press.
27. HELMHOLTZ , H. L. F. VON (1885/1954). On the sensations of tone as a physiological basis for the theory of music (A. J. Ellis, Trans. of the 1877 German edition). New York: Dover.
28. IVERSON, P., & KRUMHANSL, C. L. (1993). Isolating the dynamic attributes of musical timbre. Journal of the Acoustical Society of America, 94, 2595-2603.
29. JIANG, D. N., LU, L., ZHANG, H. J., TAO, J. H., & CAI, L. H. (2002).Music type classification by spectral contrast feature. Proceedings of the IEEE International Conference on Multimedia and Expo, Vol.1 (pp. 113-116). Lausanne, Switzerland: IEEE Computer Society.
30. KAISER, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20, 141-151.
31. KENDALL, R. A., & CARTERETTE, E. C. (1993a).Verbal attributes of simultaneous wind instrument timbres: I. von Bismarck adjectives.Music Perception, 10, 445-467.
32. KENDALL, R. A., & CARTERETTE, E.C. (1993b).Verbal attributes of simultaneous wind instrument timbres: II. Adjectives induced from Piston's Orchestration. Music Perception, 10, 469-502.
33. LAKATOS, S. (2000). A common perceptual space for harmonic and percussive timbres. Perception and Psychophysics, 62, 426-1439.
34. LARTILLOT, O., & TOIVIAINEN, P. (2007). MIR in Matlab (II): A toolbox for musical feature extraction from audio, In S. Dixon, D. Bainbridge, & Rainer Typke (Eds.), Proceedings of the 8th International Conference on Music Information Retrieval (pp. 237-244).Vienna, Austria: Austrian Computer Society.
35. LAUKKA, P., JUSLIN, P. N., & BRESIN, R. (2005). A dimensional approach to vocal expression of emotion.Cognition and Emotion, 19, 633-653.
36. LEMAN, M., VERMEULEN, V., DE VOOGDT, L., MOELANTS, D., & LESAFFRE, M. (2005) Prediction of musical affect using a combination of acoustic structural cues, Journal of New Music Research, 34, 39-67.
37. LEMAN, M., VERMEULEN, V., DE VOOGDT, L., TAELMAN, J., MOELANTS, D. & LESAFFRE, M. (2004). Correlation of gestural music audio cues and perceived expressive qualities. In R. Goebel, J. Siekmann, & W.Wahlster (Eds.), Lecture Notes in Artificial Intelligence (pp. 40-54). Heidelberg, Germany: Springer Verlag.
38. LI, X., & STERN, R. M. (2004). Feature generation based on maximum normalized acoustic likelihood for improved speech recognition, Proceedings of Institute of Electrical and Electronics Engineers Transactions on Speech and Audio Processing (pp. 545-548). Piscataway, NJ: IEEE.
39. LIU, D., LU, L., & ZHANG, H. J. (2003). Automatic mood detection from acoustic music data. In H. H. Hoos & D. Bainbridge (Eds.), Proceedings of the 4th International Conference on Music Information Retrieval (pp. 81-87). Baltimore, Maryland: Johns Hopkins University.
40. LOGAN, B., & SALOMON, A. (August, 2001). A music similarity function based on signal analysis. Proceedings of the Institute of Electrical and Electronics Engineers International Conference on Multimedia and Expo (pp. 745-748). Tokyo, Japan: IEEE Computer Society.
41. LOUREIRO, M. A., DE PAULA, H. B., & YEHIA, H. C. (2004). Timbre classification of a single musical instrument. Proceedings of the 5th International Conference on Music Information Retrieval (pp. 546-549). Barcelona: Universitat Pompeu Fabra.
42. LU, L., LIU, D., & ZHANG, H. J. (2006). Automatic mood detection and tracking of music audio signals. Institute of Electrical and Electronics Engineers Transactions on Audio, Speech, and Language Processing, 14, 5-18.
43. LUKASIK, E., (2005). Towards timbre-driven semantic retrieval of violins. Proceedings of the Fifth International Conference on Intelligent Systems Design and Applications (pp. 55-60). Wroclaw, Poland: EEE Computer Society.
44. MCADAMS, S. (1999). Perspectives on the contribution of timbre to musical structure. Computer Music Journal, 23, 85-102.
45. MCADAMS, S., WINSBERG, S., DE SOETE, G., & KRIMPHOFF, J. (1995). Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes, Psychological Research, 58, 177-192.
46. MCKINNEY, M. F., & BREEBAART, J. (2003). Features for audio and music classification. In H. H. Hoos & D. Bainbridge (Eds.), Proceedings of the 4th International Conference on Music Information Retrieval (pp. 151-158). Paris: IRCAM.
47. MION, L., & DE POLI, G. (2008). Score-independent audio features for description of music expression. Institute of Electrical and Electronics Engineers, Transactions on Audio Speech and Language Processing, 16, 458-466.
48. MORAVEC, O., & STEPANEK, J. (2003).Verbal description of musical sound timbre in Czech language. In A. Askenfelt, S. Felicette, E. Jansson, & J. Sundberg (Eds.), Proceedings of the Stockholm Music Acoustics Conference (pp. 643-645). Stockholm: University of Stockholm.
49. NYKÄNEN, A., & JOHANSSON, Ö. (2003). Development of a language for specifying saxophone timbre. In A. Askenfelt, S. Felicette, E. Jansson, & J. Sundberg (Eds.), Proceedings of the Stockholm Music Acoustic Conference (pp. 647-650). Stockholm: University of Stockholm.
50. OSGOOD, C. E., SUCI, G. J., & TANNENBAUM, P. H. (1957). The measurement of meaning. Urbana, IL: University of Illinois Press.
51. PAMPALK, E., FLEXER, A. & WIDMER, G. (2005). Improvements of audio-based music similarity and genre classification. Proceedings of Sixth International Symposium on Music Information Retrieval (pp. 628-633). London: Queen Mary, University of London.
52. PERETZ, I., GAGNON, L., & BOUCHARD, B. (1998).Music and emotion: Perceptual determinants, immediacy, and isolation after brain damage. Cognition, 68, 111-141.
53. PRATT, R. L., & DOAK P. E. (1976). A subjective rating scale for timbre, Journal of Sound and Vibration, 43, 317-328.
54. PYE, D. (2000). Content-based methods for the management of digital music. Proceedings of the 2000 Institute of Electrical and Electronics Engineers, Inc. International Conference on Acoustic Speech and Signal Processing (pp. 2437-2440). Los Alamitos, CA: IEEE Computer Society.
55. SARKAR, M., VERCOE, B., & YANG, Y. (2007).Words that describe timbre: A study of auditory perception through language. In J. Cross, J.Hawkins, P. Rebuschat, & M. Rohrmeier (Eds.), Language and Music as Cognitive Systems Conference (pp. 37-38). Cambridge, UK: University of Cambridge
56. SCHERER, K. R., & OSHINSKY, J. S. (1977). Cue utilization in emotion attribution from auditory stimuli. Motivation and Emotion, 1, 331-346.
57. SCHULLER, B., WALLHOFF, F., ARSIC, D., & RIGOLL, G. (2006). Musical signal type discrimination based on large open feature sets. Proceedings of Institute of Electrical and Electronics Engineers. International Conference on Multimedia and Expo (pp. 1089-1092). Los Alamitos, CA: IEEE Computer Society.
58. SETHARES, W. A. (1998). Tuning, timbre, spectrum, scale. Berlin: Springer-Verlag.
59. SHANNON, C. E. (1948). A mathematical theory of communication. Bell Systems Technical Journal, 27, 379-423.
60. TABACHNICK, B. G., & FIDELL, L. S. (2001). Using multivariate statistics (4th ed.). Boston, MA: Allyn and Bacon.
61. TERASAWA, H., SLANEY, M., & BERGER, J. (2005). Perceptual distance in timbre space. Proceedings of International Conference on Auditory Display (pp. 61 - 68). Limerick: International Community for Auditory Display.
62. TOIVIAINEN, P., KAIPAINEN, M., & LOUHIVUORI, J. (1995). Musical timbre: Similarity ratings correlate with computational feature space distances. Journal of New Music Research, 24, 282-298.
63. TOIVIAINEN, P., TERVANIEMI, M., LOUHIVUORI, J., SAHER, M., HUOTILAINEN, M., & NÄÄTÄNEN, R. (1998). Timbre similarity: Convergence of neural, behavioral, and computational approaches.Music Perception, 16, 223-242.
64. TURNBULL, D., BARRINGTON, L., & LANCKRIET, G. (2006). Modeling music and words using a multi-class naive bayes approach. Proceedings of the International Symposium on Music Information Retrieval (pp. 254-259).Victoria, Canada: University of Victoria.
65. TURNBULL, D., BARRINGTON, L., TORRES, D., & LANCKRIET, G. (2007). Towards musical query-by-semantic-description using the cal500 data set. In W. Kraaij, A. P. de Vries, C. L. A. Clarke, N. Fuhr, & N. Kando (Eds.), Proceedings of the 30th Annual International Association for Computing Macinery Special Interest Group on Information Retrieval Conference on Research and Development in Information Retrieval (pp. 439-446). Amsterdam: ACM SIGIR.
66. TURNBULL, D., BARRINGTON, L., TORRES, D., & LANCKRIET, G. (2008). Semantic annotation and retrieval of music and sound effects. Institute of Electrical and Electronics Engineers. Transactions on Audio, Speech and Language Processing, 16, 467-476.
67. TZANETAKIS, G., & COOK, P. (2002).Music genre classification of audio signals. Institute of Electrical and Electronics Engineers. Transactions on Speech and Audio Processing, 10, 293-302.
68. VON BISMARCK, G. (1974). Sharpness as an attribute of the timbre of steady sounds. Acustica 30, 159-172.
69. WHITMAN, B., & ELLIS, D. (2004). Automatic record reviews. Proceedings of the Fifth International Symposium on Music Information Retrieval (pp. 470-477). Barcelona: Universitat Pompeu Fabra.
70. YANG, Y. H., LIN, Y. C., SU, Y. F., & CHEN, H. H. (2008). A regression approach to music emotion recognition. Institute of Electrical and Electronics Engineers. Transactions on Audio, Speech and Language Processing, 16, 448-457.
71. ZHU, J., XUE, X., & LU, H. (2004).Musical genre classification by instrumental features. Proceedings of the International Computer Music Conference (pp. 580-583).Miami: International Computer Music Association.