Analyzing free-hand sound-tracings of melodic phrases

Applied Sciences (Switzerland)

Volumn 8, Issue 1, 2018, Pages

  Kelkar, Tejaswinee ^a   Jensenius, Alexander Refsum ^a  

^a UNIVERSITY OF OSLO   (Norway)

Author keywords

Melody; Motion; Multi modality; Shape; Sound tracing

Indexed keywords

EID: 85040788641     PISSN: None     EISSN: 20763417     Source Type: Journal    
DOI: 10.3390/app8010135     Document Type: Article

References (68)

1. Kennedy, M. Rutherford-Johnson, T.; Kennedy, J. The Oxford Dictionary of Music, 6th ed.; Oxford University Press: Oxford, UK, 2013. Available online: http://www.oxfordreference.com/view/10.1093/acref/9780199578108.001.0001/acref-9780199578108 (accessed on 16 January 2018)
2. Godøy, R.I.; Haga, E.; Jensenius, A.R. Playing "Air Instruments": Mimicry of Sound-Producing Gestures by Novices and Experts; International Gesture Workshop; Springer: Berlin/Heidelberg, Germany, 2005; pp. 256-267
3. Kendon, A. Gesture: Visible Action as Utterance; Cambridge University Press: Cambridge, UK, 2004
4. Clayton, M.; Sager, R.;Will, U. In time with the music: The concept of entrainment and its significance for ethnomusicology. In European Meetings in Ethnomusicology; ESEM Counterpoint 1; Romanian Society for Ethnomusicology: Bucharest, Romania, 2005; Volume 11, pp. 1-82
5. Zbikowski, L.M. Musical gesture and musical grammar: A cognitive approach. In New Perspectives on Music and Gesture; Ashgate Publishing Ltd.: Farnham, UK, 2011; pp. 83-98
6. Lakoff, G.; Johnson, M. Conceptual metaphor in everyday language. J. Philos. 1980, 77, 453-486
7. Zbikowski, L.M. Metaphor and music theory: Reflections from cognitive science. Music Theory Online 1998, 4, 1-8
8. Shayan, S.; Ozturk, O.; Sicoli, M.A. The thickness of pitch: Crossmodal metaphors in Farsi, Turkish, and Zapotec. Sens. Soc. 2011, 6, 96-105
9. Eitan, Z.; Schupak, A.; Gotler, A.; Marks, L.E. Lower pitch is larger, yet falling pitches shrink. Exp. Psychol. 2014, 61, 273-284
10. Eitan, Z.; Timmers, R. Beethoven's last piano sonata and those who follow crocodiles: Cross-domain mappings of auditory pitch in a musical context. Cognition 2010, 114, 405-422
11. Rusconi, E.; Kwan, B.; Giordano, B.L.; Umilta, C.; Butterworth, B. Spatial representation of pitch height: The SMARC effect. Cognition 2006, 99, 113-129
12. Huron, D. The melodic arch in Western folksongs. Comput. Musicol. 1996, 10, 3-23
13. Fedorenko, E.; Patel, A.; Casasanto, D.; Winawer, J.; Gibson, E. Structural integration in language and music: Evidence for a shared system. Mem. Cognit. 2009, 37, 1-9
14. Patel, A.D. Music, Language, and the Brain; Oxford University Press: New York, NY, USA, 2010
15. Adami, A.G.; Mihaescu, R.; Reynolds, D.A.; Godfrey, J.J. Modeling prosodic dynamics for speaker recognition. In Proceedings of the 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'03), Hong Kong, China, 6-10 April 2003; Volume 4
16. Dowling, W.J. Scale and contour: Two components of a theory of memory for melodies. Psychol. Rev. 1978, 85, 341-354
17. Dowling, W.J. Recognition of melodic transformations: Inversion, retrograde, and retrograde inversion. Percept. Psychophys. 1972, 12, 417-421
18. Schindler, A.; Herdener, M.; Bartels, A. Coding of melodic gestalt in human auditory cortex. Cereb. Cortex 2012, 23, 2987-2993
19. Trehub, S.E.; Becker, J.; Morley, I. Cross-cultural perspectives on music and musicality. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2015, 370, 20140096
20. Trehub, S.E.; Bull, D.; Thorpe, L.A. Infants' perception of melodies: The role of melodic contour. Child Dev. 1984, 55, 821-830
21. Trehub, S.E.; Thorpe, L.A.; Morrongiello, B.A. Infants' perception of melodies: Changes in a single tone. Infant Behav. Dev. 1985, 8, 213-223
22. Morrongiello, B.A.; Trehub, S.E.; Thorpe, L.A.; Capodilupo, S. Children's perception of melodies: The role of contour, frequency, and rate of presentation. J. Exp. Child Psychol. 1985, 40, 279-292
23. Adams, C.R. Melodic contour typology. Ethnomusicology 1976, 20, 179-215
24. Tierney, A.T.; Russo, F.A.; Patel, A.D. The motor origins of human and avian song structure. Proc. Natl. Acad. Sci. USA 2011, 108, 15510-15515
25. Díaz, M.A.R.; García, C.A.R.; Robles, L.C.A.; Altamirano, J.E.X.; Mendoza, A.V. Automatic infant cry analysis for the identification of qualitative features to help opportune diagnosis. Biomed. Signal Process. Control 2012, 7, 43-49
26. Parsons, D. The Directory of Tunes and Musical Themes; S. Brown: Cambridge, UK, 1975
27. Quinn, I. The combinatorial model of pitch contour. Music Percept. Interdiscip. J. 1999, 16, 439-456
28. Narmour, E. The Analysis and Cognition of Melodic Complexity: The Implication-Realization Model; University of Chicago Press: Chicago, IL, USA, 1992
29. Marvin, E.W. A Generalized Theory of Musical Contour: Its Application to Melodic and Rhythmic Analysis of Non-Tonal Music and Its Perceptual and Pedagogical Implications. Ph.D. Thesis, University of Rochester, Rocheste, NY, USA, 1988
30. Schmuckler, M.A. Testing models of melodic contour similarity. Music Percept. Interdiscip. J. 1999, 16, 295-326
31. Schmuckler, M.A. Melodic contour similarity using folk melodies. Music Percept. Interdiscip. J. 2010, 28, 169-194
32. Schmuckler, M.A. Expectation in music: Investigation of melodic and harmonic processes. Music Percept. Interdiscip. J. 1989, 7, 109-149
33. Eerola, T.; Himberg, T.; Toiviainen, P.; Louhivuori, J. Perceived complexity of western and African folk melodies by western and African listeners. Psychol. Music 2006, 34, 337-371
34. Eerola, T.; Bregman, M. Melodic and contextual similarity of folk song phrases. Musicae Sci. 2007, 11, 211-233
35. Eerola, T. Are the emotions expressed in music genre-specific? An audio-based evaluation of datasets spanning classical, film, pop and mixed genres. J. New Music Res. 2011, 40, 349-366
36. Salamon, J.; Peeters, G.; Röbel, A. Statistical Characterisation of Melodic Pitch Contours and its Application for Melody Extraction. In Proceedings of the ISMIR, Porto, Portugal, 8-12 October 2012; pp. 187-192
37. Bittner, R.M.; Salamon, J.; Bosch, J.J.; Bello, J.P. Pitch Contours as a Mid-Level Representation for Music Informatics. In Proceedings of the Audio Engineering Society Conference: 2017 AES International Conference on Semantic Audio, Erlangen, Germany, 22-24 June 2017
38. Rao, P.; Ross, J.C.; Ganguli, K.K.; Pandit, V.; Ishwar, V.; Bellur, A.; Murthy, H.A. Classification of melodic motifs in raga music with time-series matching. J. New Music Res. 2014, 43, 115-131
39. Gómez, E.; Bonada, J. Towards computer-assisted flamenco transcription: An experimental comparison of automatic transcription algorithms as applied to a cappella singing. Comput. Music J. 2013, 37, 73-90
40. Walker, P.; Bremner, J.G.; Mason, U.; Spring, J.; Mattock, K.; Slater, A.; Johnson, S.P. Preverbal infants are sensitive to cross-sensory correspondences much ado about the null results of Lewkowicz and Minar (2014). Psychol. Sci. 2014, 25, 835-836
41. Timmers, R.; Li, S. Representation of pitch in horizontal space and its dependence on musical and instrumental experience. Psychomusicol. Music Mind Brain 2016, 26, 139-148
42. Leman, M. Embodied Music Cognition and Mediation Technology; MIT Press: Cambridge, MA, USA, 2008
43. Godøy, R.I. Motor-mimetic music cognition. Leonardo 2003, 36, 317-319
44. Jensenius, A.R. Action-Sound: Developing Methods and Tools to Study Music-Related Body Movement. Ph.D. Thesis, University of Oslo, Oslo, Norway, 2007
45. Jensenius, A.R.; Kvifte, T.; Godøy, R.I. Towards a gesture description interchange format. In Proceedings of the 2006 Conference on New Interfaces for Musical Expression, IRCAM-Centre Pompidou, Paris, France, 4-8 June 2006; pp. 176-179
46. Gritten, A.; King, E. Music and Gesture; Ashgate Publishing, Ltd.: Hampshire, UK, 2006
47. Gritten, A.; King, E. New Perspectives on Music and Gesture; Ashgate Publishing, Ltd.: Surrey, UK, 2011
48. Molnar-Szakacs, I.; Overy, K. Music and mirror neurons: From motion to 'e'motion. Soc. Cognit. Affect. Neurosci. 2006, 1, 235-241
49. Sievers, B.; Polansky, L.; Casey, M.; Wheatley, T. Music and movement share a dynamic structure that supports universal expressions of emotion. Proc. Natl. Acad. Sci. USA 2013, 110, 70-75
50. Buteau, C.; Mazzola, G. From contour similarity to motivic topologies. Musicae Sci. 2000, 4, 125-149
51. Clayton, M.; Leante, L. Embodiment in Music Performance. In Experience and Meaning in Music Performance; Oxford University Press: New York, NY, USA, 2013; pp. 188-207
52. Rahaim, M. Musicking Bodies: Gesture and Voice in Hindustani Music; Wesleyan University Press: Middletown, CT, USA, 2012
53. Huron, D.; Shanahan, D. Eyebrow movements and vocal pitch height: Evidence consistent with an ethological signal. J. Acoust. Soc. Am. 2013, 133, 2947-2952
54. Savage, P.E.; Tierney, A.T.; Patel, A.D. Global music recordings support the motor constraint hypothesis for human and avian song contour. Music Percept. Interdiscip. J. 2017, 34, 327-334
55. Godøy, R.I.; Haga, E.; Jensenius, A.R. Exploring Music-Related Gestures by Sound-Tracing: A Preliminary Study. 2006. Available online: https://www.duo.uio.no/bitstream/handle/10852/26899/Godxy_2006b. pdf?sequence=1&isAllowed=y (accessed on 16 January 2018)
56. Glette, K.H.; Jensenius, A.R.; Godøy, R.I. Extracting Action-Sound Features From a Sound-Tracing Study. 2010. Available online: https://www.duo.uio.no/bitstream/handle/10852/8848/Glette_2010.pdf? sequence=1&isAllowed=y (accessed on 16 January 2018)
57. Küssner, M.B. Music and shape. Lit. Linguist. Comput. 2013, 28, 472-479
58. Roy, U.; Kelkar, T.; Indurkhya, B. TrAP: An Interactive System to Generate Valid Raga Phrases from Sound-Tracings. In Proceedings of the NIME, London, UK, 30 June-3 July 2014; pp. 243-246
59. Kelkar, T. Applications of Gesture and Spatial Cognition in Hindustani VocalMusic. Ph.D. Thesis, International Institute of Information Technology, Hyderabad, India, 2015
60. Nymoen, K.; Godøy, R.I.; Jensenius, A.R.; Torresen, J. Analyzing Correspondence Between Sound Objects and Body Motion. ACM Trans. Appl. Percept. 2013, 10, 9
61. Nymoen, K.; Caramiaux, B.; Kozak, M.; Torresen, J. Analyzing Sound-Tracings: A Multimodal Approach to Music Information Retrieval. In Proceedings of the 1st International ACM Workshop on Music Information Retrieval with User-centered and Multimodal Strategies (MIRUM '11), Scottsdale, AZ, USA, 30 November 2011; ACM: New York, NY, USA, 2011; pp. 39-44
62. Ollen, J.E. A Criterion-Related Validity Test of Selected Indicators of Musical Sophistication Using Expert Ratings. Ph.D. Thesis, The Ohio State University, Columbus, OH, USA, 2006
63. Nymoen, K.; Torresen, J.; Godøy, R.; Jensenius, A. A statistical approach to analyzing sound-tracings. In Speech, Sound and Music Processing: Embracing Research in India; Springer: Berlin/Heidelberg, Germany, 2012; pp. 120-145
64. Schmuckler, M.A. Components of melodic processing. In Oxford Handbook of Music Psychology; Oxford Uniersity Press: Oxford, UK, 2009; p. 93
65. Godøy, R.I. Gestural affordances of musical sound. In Musical Gestures: Sound, Movement, and Meaning; Routledge: New York, NY, USA, 2010; pp. 103-125
66. Paschalidou, S.; Clayton, M.; Eerola, T. Effort in Interactions with Imaginary Objects in Hindustani Vocal Music-Towards Enhancing Gesture-Controlled Virtual Instruments. In Proceedings of the 2017 International Symposium onMusical Acoust, Montreal, QC, Canada, 18-22 June 2017
67. Paschalidou, S.; Clayton, M. Towards a sound-gesture analysis in Hindustani Dhrupad vocal music: Effort and raga space. In Proceedings of the ICMEM, University of Sheffield, Sheffield, UK, 23-25March 2015; Volume 23, p. 25
68. Pearson, L.; others. Gesture in Karnatak Music: Pedagogy and Musical Structure in South India. Ph.D. Thesis, Durham University, Durham, UK, 2016