Semantic structures of timbre emerging from social and acoustic descriptions of music

Eurasip Journal on Audio, Speech, and Music Processing

Volumn 2011, Issue 1, 2011, Pages 1-16

  Ferrer, Rafael ^a   Eerola, Tuomas ^a  

^a UNIVERSITY OF JYVÄSKYLÄ   (Finland)

Author keywords

Music information retrieval; Natural language processing; Social media; Timbre; Vector based semantic analysis

Indexed keywords

ACOUSTIC VARIABLES MEASUREMENT; ECOLOGY; NATURAL LANGUAGE PROCESSING SYSTEMS; SOCIAL NETWORKING (ONLINE);

MUSIC INFORMATION RETRIEVAL; NATURAL LANGUAGE PROCESSING; SEMANTIC ANALYSIS; SOCIAL MEDIA; TIMBRE;

SEMANTICS;

EID: 84960366721     PISSN: 16874714     EISSN: 16874722     Source Type: Journal    
DOI: 10.1186/1687-4722-2011-11     Document Type: Article

References (74)

1. O Celma, X Serra, FOAFing the Music: Bridging the semantic gap in music recommendation. Web Semantics. Science, Services and Agents on the World Wide Web. 6(4), 250–256 (2008). [Semantic Web Challenge 2006/2007]. doi:10.1016/j.websem.2008.09.004
2. J Grey, Multidimensional Perceptual Scaling of Musical Timbres. The Journal of the Acoustical Society of America. 61(5), 1270–1277 (1977). doi:10.1121/1.381428
3. S McAdams, S Winsberg, S Donnadieu, G De Soete, J Krimphoff, Perceptual Scaling of Synthesized Musical Timbres: Common dimensions, specificities and latent subject classes. Psychological Research. 58(3), 177–192 (1995). doi:10.1007/BF00419633
4. J Burgoyne, S McAdams, A Meta-analysis of Timbre Perception Using Nonlinear Extensions to CLAS-CAL. Computer Music Modeling and Retrieval. Sense of Sounds, 181–202 (2009)
5. JJ Aucouturier, F Pachet, M Sandler, The Way it Sounds: Timbre models for analysis and retrieval of music signals. Multimedia, IEEE Transactions on. 7(6), 1028–1035 (2005)
6. V Alluri, P Toiviainen, Exploring Perceptual and Acoustical Correlates of Polyphonic Timbre. Music Perception. 27(3), 223–242 (2010). doi:10.1525/mp.2010.27.3.223
7. P Lamere, Social Tagging and Music Information Retrieval. Journal of New Music Research. 37(2), 101–114 (2008). doi:10.1080/09298210802479284
8. JJ Aucouturier, E Pampalk, Introduction-From Genres to Tags: A little epistemology of music information retrieval research. Journal of New Music Research. 37(2), 87–92 (2008). doi:10.1080/09298210802479318
9. C Held, U Cress, Learning by Foraging: The impact of social tags on knowledge acquisition, in Learning in the Synergy of Multiple Disciplines. 4th European Conference on Technology Enhanced Learning, Nice, France, (2009)
10. F Hesse, Use and Acquisition of Externalized Knowledge, in Learning in the Synergy of Multiple Disciplines. 4th European Conference on Technology Enhanced Learning, (Nice, France: Springer, 2009), p. 5
11. E Chi, Augmented Social Cognition: Using social web technology to enhance the ability of groups to remember, think, and reason, in Proceedings of the 35th SIGMOD International Conference on Management of Data, Providence, Rhode Island, USA, (2009)
12. H Kim, S Decker, J Breslin, Representing and Sharing Folksonomies with Semantics. Journal of Information Science. 36, 57–72 (2010). doi:10.1177/0165551509346785
13. A Mathes, Folksonomies-cooperative Classification and Communication through Shared Metadata. http://www.adammathes.com/academic/computer-mediated-communication/folksonomies.html (2004)
14. H Lin J Davis, Y Zhou, An Integrated Approach to Extracting Ontological Structures from Folksonomies, in Proceedings of the 6th European Semantic Web Conference on The Semantic Web. Research and Applications, (Heraklion, Greece: Springer, 2009), p. 668
15. S Deerwester, S Dumais, G Furnas, T Landauer, R Harshman, Indexing by Latent Semantic Analysis. Journal of the American Society for Information Science. 41(6), 391–407 (1990). doi:10.1002/(SICI)1097-4571(199009)41:63.0.CO;2-9
16. J Bellegarda, Latent Semantic Mapping: Principles and applications. Synthesis Lectures on Speech and Audio Processing. 3, 1–101 (2007). doi:10.2200/S00048ED1V01Y200609SAP003
17. S Sundaram, S Narayanan, Audio Retrieval by Latent Perceptual Indexing, in Acoustics, Speech and Signal Processing, 2008. ICASSP 2008. IEEE International Conference on, (IEEE, 2008), pp. 49–52
18. S Dumais, Latent Semantic Analysis. Annual Review of Information Science and Technology (ARIST). 38, 189–230 (2004)
19. T Eerola, R Ferrer, Setting the Standards: Normative data on audio-based musical features for musical genres, in Proceedings of the 7th Triennial Conference of European Society for the Cognitive Sciences of Music, Jyväskylä, Finland, (2009)
20. M Levy, M Sandler, Learning Latent Semantic Models for Music from Social Tags. Journal of New Music Research. 37(2), 137–150 (2008). doi:10.1080/09298210802479292
21. T Bertin-Mahieux, D Eck, F Maillet, P Lamere, Autotagger: A model for predicting social tags from acoustic features on large music databases. Journal of New Music Research. 37(2), 115–135 (2008). doi:10.1080/09298210802479250
22. P Rentfrow, S Gosling, Message in a Ballad. Psychological Science. 17(3), 236–242 (2006). doi:10.1111/j.1467-9280.2006.01691.x
23. M Delsing, T ter Bogt, R Engels, W Meeus, Adolescents’ Music Preferences and Personality Characteristics. European Journal of Personality. 22(2), 109–130 (2008). doi:10.1002/per.665
24. I Popescu, G Altmann, Word Frequency Studies (Berlin: Walter de Gruyter, 2009)
25. M Levy, M Sandler, A Semantic Space for Music Derived from Social Tags, in Proceedings of the 8th International Society for Music Information Retrieval Conference, vol. 1, ed. by Dixon S, Bainbridge D, Typke R (Vienna, Austria: Österreichische Computer Gesellschaft, 2007), p. 12
26. B Zhang, Q Xiang, H Lu, J Shen, Y Wang, Comprehensive Query-dependent Fusion Using Regression-on-folksonomies: A case study of multimodal music search, in Proceedings of the seventeen ACM international conference on Multimedia, Beijing, China: ACM, pp. 213–222 (2009)
27. H Halpin, V Robu, H Shepherd, The Complex Dynamics of Collaborative Tagging, in Proceedings of the 16th international conference on World Wide Webal Conference on World Wide Web, Banff, Alberta, Canada: ACM, p. 220 (2007)
28. J Brank, M Grobelnik, D Mladenic, Automatic Evaluation of Ontologies, in Natural Language Processing and Text Mining, ed. by Kao A, RPoteet S (USA: Springer, 2007)
29. J Siskind, Learning Word-to-meaning Mappings, in Models of Language Acquisition. Inductive and deductive approaches, USA: Oxford University Press, pp. 121–153 (2000)
30. G Zipf, Human Behavior and the Principle of Least Effort, An introduction to human ecology (addison-wesley press, 1949)
31. J Gower, P Legendre, Metric and Euclidean Properties of Dissimilarity Coefficients. Journal of Classification. 3, 5–48 (1986). doi:10.1007/BF01896809
32. M Walesiak, A Dudek, ClusterSim. Searching for optimal clustering procedure for a data set (2011). http://CRAN.R-project.org/package=clusterSim [R package version 0.39-2]
33. R Development Core Team, R A language and environment for statistical computing, (R Foundation for Statistical Computing, Vienna, Austria, 2009). http://www.R-project.org [ISBN 3-900051-07-0]
34. A Jain, R Dubes, Algorithms for Clustering Data (Englewood Cliffs, NJ: Prentice Hall, 1988)
35. P Langfelder, B Zhang, S Horvath, DynamicTreeCut. Methods for detection of clusters in hierarchical clustering dendrograms (2009). http://www.genetics.ucla.edu/labs/horvath/CoexpressionNetwork/BranchCutting/ [R package version 1.20]
36. G Tzanetakis, P Cook, Musical Genre Classification of Audio Signals. IEEE Transactions on Speech and Audio Processing. 10(5), 293–302 (2002). doi:10.1109/TSA.2002.800560
37. R Gjerdingen, D Perrott, Scanning the Dial: The rapid recognition of music genres. Journal of New Music Research. 37(2), 93–100 (2008). doi:10.1080/09298210802479268
38. M Hoffman, D Blei, P Cook, Easy as CBA: A simple probabilistic model for tagging music, in Proceedings of the 10th International Society for Music Information Retrieval Conference, Kobe, Japan, (2009)
39. MI Mandel, DPW Ellis, A Web-based Game for Collecting Music Metadata. Journal of New Music Research. 37(2), 151–165 (2008). doi:10.1080/09298210802479300
40. D Turnbull, L Barrington, D Torres, G Lanckriet, Towards Musical Query-bysemantic- description Using the CAL500 Data Set, in Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ‘07, New York, NY, USA: ACM, pp. 439–446 (2007)
41. K Jacobson, M Sandler, B Fields, Using Audio Analysis and Network Structure to Identify Communities in On-line Social Networks of Artists, in Proceedings of the 9th International Society for Music Information Retrieval Conference, ed. by Bello JP, Chew E, Turnbull D (Philadelphia, USA, 2008), pp. 269–274
42. C Laurier, O Meyers, J Serrà, M Blech, P Herrera, X Serra, Indexing Music by Mood: Design and integration of an automatic content-based annotator. Multimedia Tools and Applications. 48, 161–184 (2010). [Springerlink link: http://www.springerlink.com/content/jj01750u20267426]. doi:10.1007/s11042-009-0360-2
43. J Bello, J Pickens, A Robust Mid-level Representation for Harmonic Content in Music Signals, in Proceedings of the 6th International Society for Music Information Retrieval Conference, London, UK, pp. 304–311 (2005)
44. S Chu, S Narayanan, CC Kuo, Environmental Sound Recognition With Timefrequency Audio Features. Audio, Speech, and Language Processing, IEEE Transactions on. 17(6), 1142–1158 (2009)
45. E Pampalk, A Rauber, D Merkl, Content-based Organization and Visualization of Music Archives, in Proceedings of the tenth ACM international conference on Multimedia, Juan les Pins, France: ACM, p. 579 (2002)
46. G Peeters, A Large Set of Audio Features for Sound Description (Similarity and Classification) in the CUIDADO Project. CUIDADO IST Project Report 1–25 (2004)
47. P Juslin, Cue Utilization in Communication of Emotion in MusicPerformance: Relating performance to perception. Journal of Experimental Psychology. Human perception and performance., 6 26, 1797–1812 (2000)
48. P Laukka, P Juslin, R Bresin, A Dimensional Approach to Vocal Expression of Emotion. Cognition and Emotion. 19(5), 633–653 (2005). doi:10.1080/02699930441000445
49. K Jensen, Timbre Models of Musical Sounds (Department of Computer Science, University of Copenhagen, 1999)
50. W Sethares, Tuning, Timbre, Spectrum, Scale (Springer Verlag, 2005)
51. J Bello, C Duxbury, M Davies, M Sandler, On the use of Phase and Energy for Musical Onset Detection in the Complex Domain. Signal Processing Letters, IEEE. 11(6), 553–556 (2004). doi:10.1109/LSP.2004.827951
52. O Lartillot, P Toiviainen, T Eerola, A Matlab Toolbox for Music Information Retrieval, in Data Aalysis, Machine Learning and Applications, ed. by Preisach C, Burkhardt H, Schmidt-Thieme L, Decker R (Berlin, Germany: Springer, 2008), pp. 261–268. Studies in Classification, Data Analysis, and Knowledge Organization
53. C Harte, M Sandler, M Gasser, Detecting Harmonic Change in Musical Audio, in Proceedings of the 1st ACM Workshop on Audio and Music Computing Multimedia, Santa Barbara, CA, USA: ACM, p. 26 (2006)
54. I Guyon, A Elisseeff, An Introduction to Variable and Feature Selection. Journal of Machine Learning Research. 3, 1157–1182 (2003)
55. G Tzanetakis, P Cook, Manipulation, Analysis and Retrieval Systems for Audio Signals, PhD thesis, (Princeton University, Princeton, NJ, 2002)
56. J Fox, G Monette, Generalized Collinearity Diagnostics. Journal of the American Statistical Association. 87(417), 178–183 (1992). doi:10.2307/2290467
57. L Breiman, Random Forests. Machine Learning. 45, 5–32 (2001). doi:10.1023/A:1010933404324
58. B Ripley, Pattern Recognition and Neural Networks, (Cambridge: Cambridge University Press, 1996)
59. K Archer, R Kimes, Empirical Characterization of Random Forest Variable Importance Measures. Computational Statistics and Data analysis. 52(4), 2249–2260 (2008). doi:10.1016/j.csda.2007.08.015
60. H Pang, A Lin, M Holford, B Enerson, B Lu, M Lawton, E Floyd, H Zhao, Pathway Analysis Using Random Forests Classification and Regression. Bioinformatics. 22(16), 2028 (2006). doi:10.1093/bioinformatics/btl344
61. L Nieweglowski, CLV: Cluster validation techniques (2009). http://CRAN.Rproject.org/package=clv [R package version 0.3-2]
62. J Gower, Some Distance Properties of Latent Root and Vector Methods Used in Multivariate Analysis. Biometrika. 53(3-4), 325 (1966). doi:10.1093/biomet/53.3-4.325
63. M Cox, T Cox, Multidimensional Scaling: Handbook of data visualization, (USA: Chapman and Hall, 2001)
64. I Borg, P Groenen, Modern Multidimensional Scaling: Theory and applications, (Springer Verlag, 2005)
65. JJ Aucouturier, B Defreville, F Pachet, The Bag-of-frames Approach to Audio Pattern Recognition: A sufficient model for urban soundscapes but not for polyphonic music. The Journal of the Acoustical Society of America. 122(2), 881–891 (2007). doi:10.1121/1.2750160
66. C McKay, I Fujinaga, Musical Genre Classification: Is it worth pursuing and how can it be improved. in Proceedings of the 7th International Society for Music Information Retrieval Conference 101–6 (2006)
67. D Balota, J Cohane, Semantic Memory, in Learing and Memory: A comprehensive reference, Volume 2 Cognitive Pyshology of Memory, ed. by Byrne JH, III HLR (Oxford, UK: Academic Press, 2008), pp. 511–534
68. G Sandell, Macrotimbre: Contribution of attack, steady state, and verbal attributes. The Journal of the Acoustical Society of America. 103, 2966 (1998)
69. R Ferrer, Embodied Cognition Applied to Timbre and Musical Appreciation: Theoretical Foundation. British Postgraduate Musicology. 10, http://www.bpmonline.org.uk/bpm10/ferrer_rafael-embodied_cognition_applied_to_timbre_and_musical_appreciation_theoretical_foundation.pdf (2009)
70. Kao A Poteet SR (eds.), Natural Language Processing and Text Mining (Springer Verlag, 2006)
71. C Manning, H Schütze, Foundations of Statistical Natural Language Processing (MIT Press, 2002)
72. S Bird, E Klein, E Loper, Natural Language Processing with Python (Oreilly and Associates Inc, 2009)
73. W Francis, H Kucera, Brown Corpus. A Standard Corpus of Present-Day Edited American English, for use with Digital Computers (Department of Linguistics, Brown University, Providence, Rhode Island, USA, 1979)
74. Fellbaum C (ed.), WordNet: An electronic lexical database (Language, speech, and communication, Cambridge, Mass: MIT Press, 1998)