Exploring Sound-Motion Similarity in Musical Experience

Journal of New Music Research

Volumn 45, Issue 3, 2016, Pages 210-222

  Godøy, Rolf Inge ^a   Song, Minho ^a   Nymoen, Kristian ^a   Haugen, Mari Romarheim ^a   Jensenius, Alexander Refsum ^a  

^a UNIVERSITY OF OSLO   (Norway)

Author keywords

motor theory; music; shape cognition; similarity; sound motion

Indexed keywords

EID: 84989244093     PISSN: 09298215     EISSN: 17445027     Source Type: Journal    
DOI: 10.1080/09298215.2016.1184689     Document Type: Article

References (54)

1. A.Berthoz, (1997). Le sense du mouvement. Paris:Odile Jacob.
2. A.Bregman, (1990). Auditory scene analysis. Cambridge, MA:MIT Press.
3. J.K.Bizley, & Y.E.Cohen, (2013). The what, where and how of auditory-object perception. Nature Reviews Neuroscience, 14, 693–707.
4. B.Caramiaux, F.Bevilacqua, & N.Schnell, (2010). Towards a gesture-sound cross-modal analysis. In S.Kopp & I.Wachsmuth (Eds.), Gesture in embodied communication and human-computer interaction (Lecture Notes in Computer Science Series, Vol. 5934, pp. 158–170). Berlin:Springer.
5. M.Chion, (1983). Guide des objets sonores. Paris:INA/GRM Buchet/Chastel.
6. F.Delalande, M.Formosa, M.Frémiot, P.Gobin, P.Malbosc, J.Mandelbrojt, & E.Pedler, (1996). Les unités sémiotiques temporelles:Éléments nouveaux d’analyse musicale. Marseille:ÉditionsMIM-DocumentsMusurgia.
7. R.O.Duda, P.E.Hart, & D.G.Stork, (2001). Pattern classification. New York:John Wiley and Sons.
8. Z.Eitan, (2013). How pitch and loudness shape musical space and motion:New findings and persisting questions. In S.L.Tan, A.Cohen, S.Lipscomb, & R.Kendall (Eds.), The psychology of music in multimedia (pp. 161–187). Oxford:Oxford University Press.
9. Z.Eitan, & R.Y.Granot, (2006). How music moves:Musical parameters and listeners’ images of motion. Music Perception, 23(3), 221–247.
10. B.Galantucci, C.A.Fowler, & M.T.Turvey, (2006). The motor theory of speech perception reviewed. Psychonomic Bulletin and Review, 13(3), 361–377.
11. C.Gerischer, (2006). O suingue baiano:Rhythmic feeling and microrhythmic phenomena in Brazilian percussion. Ethnomusicology, 50(1), 99–119.
12. R.I.Godøy, (2006). Gestural-sonorous objects:Embodied extensions of Schaeffer’s conceptual apparatus. Organised Sound, 11(2), 149–157.
13. R.I.Godøy, (2013). Quantal elements in musical experience. In R.Bader (Ed.), Sound–perception–performance (Current Research in Systematic Musicology, Vol. 1, pp. 113–128). Berlin:Springer.
14. R.I.Godøy, (2014). Understanding coarticulation in musical experience. In M.Aramaki, M.Derrien, R.Kronland-Martinet, & S.Ystad (Eds.), Sound, music, and motion (Lecture Notes in Computer Science, pp. 535–547). Berlin:Springer.
15. R.I.Godøy, (in press). Key-postures, trajectories and sonic shapes. H.Leech-Wilkinson, & H.Prior (Eds.) Music and shape. Oxford:Oxford University Press.
16. R.I.Godøy, E.Haga, & A.R.Jensenius, (2006a). Playing ‘air instruments’:Mimicry of sound-producing gestures by novices and experts. In S.Gibet, N.Courty, & J.-F.Kamp (Eds.), GW 2005 (Lecture Notes in Artificial Intelligence, Vol. 3881, pp. 256–267). Berlin:Springer.
17. R.I.Godøy, E.Haga, & A.R.Jensenius, (2006b). Exploring music-related gestures by sound-tracing:A preliminary study. In K.Ng (Ed.), Proceedings of the 2nd ConGAS International Symposium on Gesture Interfaces for Multimedia Systems. May 9–10 2006, Leeds, UK. Retrieved from http://folk.uio.no/alexanje/research/papers/godoy-congas-leeds2006.pdf
18. R.I.Godøy, A.R.Jensenius, & K.Nymoen, (2010). Chunking in music by coarticulation. Acta Acoustica United with Acoustica, 96(4), 690–700.
19. R.I.Godøy, & H.Jørgensen, (2001). Musical imagery. Lisse:Swets & Zeitlinger.
20. R.I.Godøy, & M.Leman, (2010). Musical gestures:Sound, movement, and meaning. New York:Routledge.
21. F.Gouyon, (2007). Microtiming in ‘samba de roda’:Preliminary experiments with polyphonic audio. In M.H.Cruz Torres (Ed.), Proceedings of the Brazilian Symposium on Computer Music (SBCM) 2007, S\~{a}o Paulo, 1st to the 3rd of September, 2007 (pp. 197–203).
22. E.Haga, (2008). Correspondences between music and body movement (Ph.D. thesis), University of Oslo, Oslo, Norway.
23. S.Harnad, (Ed.). (1987). Categorical perception. Cambridge:Cambridge University Press.
24. T.Hermann, A.Hunt, & J.G.Neuhoff, (Eds.). (2011). The sonification handbook. Berlin:Logos Verlag.
25. M.Jeannerod, (2006). Motor cognition. Oxford:Oxford University Press.
26. A.R.Jensenius, K.A.V.Bjerkestrand, & V.Johnson, (2014). How still is still? Exploring standstill for artistic applications. International Journal of Arts and Technology, 7(2), 207–222.
27. A.R.Jensenius, & R.I.Godøy, (2013). Sonifying the shape of human body motion using motiongrams. Empirical Musicology Review, 8, 73–83.
28. S.T.Klapp, & R.J.Jagacinski, (2011). Gestalt principles in the control of motor action. Psychological Bulletin, 137(3), 443–462.
29. S.T.Klapp, J.M.Nelson, & R.J.Jagacinski, (1998). Can people tap concurrent bimanual rhythms independently? Journal of Motor Behavior, 30(4), 301–322.
30. M.B.Küssner, & D.Leech-Wilkinson, (2014). Investigating the influence of musical training on cross-modal correspondences and sensorimotor skills in a real-time drawing paradigm. Psychology of Music, 42(3), 448–469.
31. R.V.Laban, (1980). The mastery of movement (4th ed. by Lisa Ullmann). Plymouth:Northcote House Publishers.
32. S.Lacey, & R.Lawson, (Eds.). (2013). Multisensory imagery. New York:Springer.
33. A.M.Liberman, & I.G.Mattingly, (1985). The motor theory of speech perception revised. Cognition, 21, 1–36.
34. I.D.Loram, C.van De Kamp, M.Lakie, H.Gollee, & P.J.Gawthrop, (2014). Does the motor system need intermittent control? Exercise and Sport Science Review, 42(3), 117–125.
35. F.Macpherson, (2011). Cross-modal experiences. Proceedings of the Aristotelian Society, 111(3), 429–468.
36. H.McGurk, & J.MacDonald, (1976). Hearing lips and seeing voices. Nature, 264, 746–748.
37. A.Merer, S.Ystad, R.Kronland-Martinet, & M.Aramaki, (2008). Semiotics of sounds evoking motions:Categorization and acoustic features. In R.Kronland-Martinet, S.Ystad, & K.Jensen (Eds.), CMMR 2007 (Lecture Notes in Computer Science, Vol. 4969, pp. 139–158). Heidelberg:Springer.
38. S.A.Mudd, (1963). Spatial stereotypes of four dimensions of pure tone. Journal of Experimental Psychology, 66, 347–352.
39. L.Naveda, (2011). Gesture in samba:A cross-modal analysis of dance and music from the Afro-Brazilian culture (Ph.D. thesis), Ghent University, Ghent, Belgium.
40. K.Nymoen, R.I.Godøy, A.R.Jensenius, & J.Torresen, (2013). Analyzing correspondence between sound objects and body motion. ACM Transactions on Applied Perception, 10(2), Article 9 (22pp). doi:http://dx.doi.org/10.1145/2465780.2465783
41. J.Petitot, (1985). Morphogenèse du sens I. Paris:Presses Universitaires de France.
42. M.Proctor, E.Bresch, D.Byrd, K.Nayak, & S.Narayanan, (2013). Paralinguistic mechanisms of production in human ‘beatboxing’:A real-time magnetic resonance imaging study. Journal of the Acoustical Society of America, 133(2), 1043–1054.
43. P.Schaeffer, (1966). Traité des objets musicaux. Paris:Éditions du Seuil.
44. K.Schulze, F.Vargha-Khadem, & M.Mishkin, (2012). Test of a motor theory of long-term auditory memory. Proceedings of the National Academy of Sciences, 109(18), 7121–7125.
45. M.Schutz, & S.Lipscomb, (2007). Vision influences perceived note length. Perception, 36, 888–897.
46. A.Schneider, (2010). Music and gestures:A historical introduction and survey of earlier research. In R.I.Godøy & M.Leman (Eds.), Musical gestures:Sound, movement, and meaning (pp. 69–100). New York:Routledge.
47. J.A.Sloboda, (2000). Individual differences in music performance. Trends in Cognitive Science, 4(10), 397–403.
48. R.Thom, (1983). Paraboles et catastrophes. Paris:Flammarion.
49. W.Thompson, F.A.Russo, & S.Livingstone, (2010). Facial expressions of singers influence perceived pitch relations. Psychonomic Bulletin and Review, 17, 317–322.
50. A.Truslit, (2015). Gestaltung und Bewegung in der Musik:ein tönendes Buch vom musikalischen Vortrag und seinem bewegungserlebten Gestalten und Hören (with DVDs). Ausburg:Wissner Musikbuch.
51. P.Walker, J.G.Bremner, U.Mason, J.Spring, K.Mattock, A.Slater, & S.P.Johnson, (2010). Preverbal infants’ sensitivity to synaesthetic cross-modality correspondences. Psychological Science, 21(1), 21–25.
52. M.M.Wanderley, (2002). Quantitative analysis of non-obvious performer gestures. In I.Wachsmuth & T.Sowa (Eds.), Gesture and sign language in human-computer interaction (Lecture Notes in Computer Science, Vol. 2298, pp. 241–253). Berlin:Springer.
53. A.H.D.Watson, (2006). What can studying musicians tell us about motor control of the hand? Journal of Anatomy, 208(4), 527–542.
54. M.Wilson, & G.Knoblich, (2005). The case for motor involvement in perceiving conspecifics. Psychological Bulletin, 131(3), 460–473.