Introduction to gestural similarity in music. An application of category theory to the orchestra

Journal of Mathematics and Music

Volumn 12, Issue 2, 2018, Pages 63-87

  Mannone, Maria ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

category theory; composition; fuzzy logic; gesture; interdisciplinary studies; orchestral conducting; performance; similarity; visual arts

Indexed keywords

EID: 85052293402     PISSN: 17459737     EISSN: 17459745     Source Type: Journal    
DOI: 10.1080/17459737.2018.1450902     Document Type: Article

References (60)

1. Alunni, Charles., 2004. “Diagrammes et Catégories comme Prolégomènes à la Question: Qu’est-ce que s’orienter Diagrammatiquement dans la Pensée?” In Penser par le diagramme–de Gilles Deleuze à Gilles Châtelet. Paris: Presse Universitaire de Vincennes.
2. Antoniadis, Pavlos, and Frédéric, Bevilacqua. 2016. “Processing of Symbolic Music Notation via Multimodal Performance Data: Brian Ferneyhough’s Lemma–Icon–Epigram for Solo Piano, Phase 1.” In Proceedings of TENOR 2016, 28–29 May 2016, Anglia Ruskin University, Cambridge, UK. http://tenor2016.tenor-conference.org/papers/18_Antoniadis_tenor2016.pdf.
3. Bachratá, Petra., 2011. “Modèles Musicaux Interactifs Basés sur le Geste pour l’Analyse et la Composition de Musique Mixte.” Revue Francophone d’Informatique Musicale, Maison des Science de l’Homme, Paris Nord n° 1–Automne 2011, http://revues.mshparisnord.org/rfim/index.php?id=123.
4. Barbieri, Filippo, Antonio Buonocore, Riccardo Dalla Volta, and Maurizio Gentilucci. 2009. “How Symbolic Gestures and Words Interact with Each Other.” Brain and Language 110 (1). doi: 10.1016/j.bandl.2009.01.002.
5. beim Graben, Peter, and Reinhard, Blutner. 2017. “Toward a Gauge Theory of Musical Forces.” In Proceedings of the 10th International Conference on Quantum Interaction (QI 2016), 20–22 July 2016, San, Francisco, CA, edited by Jose Acacio de Barros, Bob Coecke, and Emmanuel Pothos, 99–111, Vol. 10106 of Lecture Notes in Computer Science. Cham, Switzerland: Springer International Publishing. doi:10.1007/978-3-319-52289-0_8.
6. beim Graben, Peter, and Roland Potthast., 2009. “Inverse Problems in Dynamic Cognitive Modeling.” Chaos 19 (1): Article ID 015103. doi: 10.1063/1.3097067.
7. Bénabou, Jean., 1967. “Introduction to bicategories.” In Reports of the Midwest Category Seminar, 1–77. Berlin: Springer.
8. Berlin, Brent., 2006. “The First Congress of Ethnozoological Nomenclature.” Journal of the Royal Anthropological Institute 12 (s1): S23–S44. doi: 10.1111/j.1467-9655.2006.00271.x
9. Bevilacqua, Frédéric, Norbert, Schell, Nicolas, Rasamimanana, Bruno, Zamborlin, and Fabrice, Guédy. 2011. Musical Robots and Interactive Multimodal Systems. Chap. 8 in Online Gesture Analysis and Control of Audio Processing, 127–142. Basel, Switzerland: Springer-Verlag. doi:10.1007/978-3-642-22291-7_8.
10. Bevilacqua, Frédéric, Bruno, Zamborlin, Anthony, Sypniewski, Norbert, Schnell, Fabrice, Guédy, and Nicolas, Rasamimanana. 2010. “Continuous Realtime Gesture Following and Recognition.” In Gesture in Embodied Communication and Human–Computer Interaction, Proceedings of the 8th International Gesture Workshop (GW), Bielefeld, Germany, 25–27 February 2009 73–84, edited by Stefan Kopp and Ipke Wachsmuth, 73–84, Vol. 5934 in the series Lecture Notes in Computer Science. Heidelberg: Springer-Verlag. doi:10.1007/978-3-642-12553-9_7.
11. Buteau, Chantal, and Guerino Mazzola., 2000. “From Contour Similarity to Motivic Topology.” Musicae Scientiae 4 (2). doi: 10.1177/102986490000400201.
12. Cont, Arshia, Shlomo, Dubnov, and Gérard, Assayag. 2011. “On the Information Geometry of Audio Streams with Applications to Similarity Computing.” IEEE Transactions on Audio, Speech, and Language Processing 19 (4): 837–846. doi: 10.1109/TASL.2010.2066266.
13. Françoise, Jules, Baptiste Caramiaux, and Frédéric Bevilacqua., 2012. “A Hierarchical Approach for the Design of Gesture to Sound Mappings.” In Proceedings of the 9th Sound and Music Conference (SMC 2012), 11–14 July 2012, Copenhagen.
14. Gentilucci, Maurizio, and Paolo, Bernardis. 2006. “Speech and Gesture Share the Same Communication System.” Neurospychologia 44 (2): 178–190. doi: 10.1016/j.neuropsychologia.2005.05.007.
15. Gentilucci, Maurizio, and Paolo, Bernardis. 2007. “Imitation During Phoneme Production.” Neuropsychologia 45 (3): 608–615. doi: 10.1016/j.neuropsychologia.2006.04.004.
16. Gentilucci, Maurizio, and Riccardo Dalla Volta. 2008. “Spoken Language and Arm Gestures Are Controlled by the Same Motor Control System.” Quarterly Journal of Experimental Psychology 61 (6): 944–957. doi: 10.1080/17470210701625683.
17. Gentilucci, Maurizio, Riccardo Dalla, Volta, and Claudia, Gianelli. 2008. “When the Hands Speak.” Journal of Physiology–Paris 102 (1–3): 21–30. doi: 10.1016/j.jphysparis.2008.03.002.
18. Godøy, Rolf, and Marc, Leman, eds. 2009. Musical Gestures: Sound, Movement and Meaning. New York: Routledge.
19. Henrotte, Gayle., 1992. “Music and Gesture: A Semiotic Inquiry.” American Journal of Semiotics 9 (4): 103–113. doi: 10.5840/ajs19929410
20. Iazzetta, Fernando., 2000. “Meaning in Musical Gesture.” In Trends in Gestural Control of Music, edited by M.M. Wanderley and M. Battier. Centre Pompidou, Paris: IRCAM. http://www.music.mcgill.ca/~mwanderley/Trends/Trends_in_Gestural_Control_of_Music/DOS/P.Iaz.pdf.
21. Joyal, A., 2002. “Quasi-categories and Kan complexes.” Journal of Pure and Applied Algebra 175 (1–3): 207–222. doi: 10.1016/S0022-4049(02)00135-4
22. Joyal, André. 2008. “The Theory of Quasi-Categories and Its Applications.” Centre de Recerca Matematica Barcelona 45, II. http://mat.uab.cat/∼kock/crm/hocat/advanced-course/Quadern45-2.pdf.
23. Knees, Peter, and Markus, Schedl. 2016. Music Similarity and Retrieval–An Introduction to Audio- and Web-Based Strategies, Vol. 36 of The Information Retrieval Series. Berlin: Springer-Verlag. doi: 10.1007/978-3-662-49722-7.
24. Kosko, Bart., 1994. Fuzzy Thinking: The New Science of Fuzzy Logic. Westport, CT: Hyperion Press.
25. Kubovy, Michael, and Michael, Schutz. 2010. “Audio-Visual Objects.” Review of Philosophy and Psychology 1 (1): 41–61. doi: 10.1007/s13164-009-0004-5
26. Larson, Steve., 2012. Musical Forces: Motion, Metaphor, and Meaning in Music. Bloomington, IN: Indiana University Press.
27. Lawvere, William, and Stephen, Schanuel. 2009. Conceptual Mathematics: A First Introduction to Categories. Cambridge, UK: Cambridge University Press.
28. Leinster, Tom., 1998. “Basic Bicategories.” arXiv https://arxiv.org/pdf/math/9810017v1.pdf.
29. Lurie, Jacob., 2008. “What is an ∞-Category?” Notices of the American Mathematical Society 55 (8): 949–950.
30. Lurie, Jacob., 2009. Higher topos theory, Annals of Mathematics Studies, xviii+925, Vol. 170, Princeton, NJ: Princeton University Press. doi: 10.1515/9781400830558.
31. Mac Lane, Saunders., 1971. Categories for the Working Mathematician. Vol. 5 of the series Graduate Texts in Mathematics. New York: Springer Science+Business Media. doi: 10.1007/978-1-4757-4721-8.
32. Mannone, Maria., 2011. Dalla Musica all’Immagine, dall’Immagine alla Musica. Relazioni matematiche fra composizione musicale e arte figurativa [From Music to Images, from Images to Music. Mathematical Relations between Musical Composition and Figurative Art]. Palermo, Italy: Edizioni Compostampa.
33. Mannone, Maria., 2017. “Musical Gestures between Scores and Acoustics: A Creative Application to Orchestra.” Ph.D. thesis, University of Minnesota.
34. Mannone, Maria, and Giuseppe, Compagno. 2014. “Characterization of the Degree of Musical Non-Markovianity.” arXiv http://arxiv.org/pdf/1306.0229v2.pdf.
35. Mannone, Maria, Rosario Lo Franco, and Giuseppe Compagno., 2013. “Comparison of Non-Markovianity Criteria in a Qubit System under Random External Fields.” Physica Scripta (2013): Article ID T153:014047. doi: 10.1088/0031-8949/2013/T153/014047.
36. Mannone, Maria, and Guerino, Mazzola. 2015. “Hypergestures in Complex Time: Creative Performance between Symbolic and Physical Reality.” In Proceedings of the 5th Biennial International Mathematics and Computation in Music Conference (MCM), London, UK, 22–25 June 2015, edited by Tom Collins, David Meredith, and Anja Volk, 137–148, Cham, Switzerland: Springer International Publishing. doi:10.1007/978-3-319-20603-5_14.
37. Mayerthaler, Willi., 1987. “System-Independent Morphological Naturalness.” In Leitmotifs in Natural Morphology, Vol. 10 of Studies in Language Companion Series, edited by W. U. Dressler, W. Mayerthaler, O. Panagl, and W. U. Wurzel, 25–58, Amsterdam: John Benjamins. doi: 10.1075/slcs.10.13may.
38. Mazzola, Guerino, ed. 2002. The Topos of Music: Geometric Logic of Concepts, Theory, and Performance. Basel, Switzerland: Birkhäuser Verlag. doi: 10.1007/978-3-0348-8141-8.
39. Mazzola, Guerino., 2011. Musical Performance, a Comprehensive Approach: Theory, Analytical Tools, and Case Studies. In the series Computational Music Science. Berlin: Springer-Verlag. doi: 10.1007/978-3-642-11838-8.
40. Mazzola, Guerino, and Moreno Andreatta., 2007. “Diagrams, Gestures and Formulae in Music.” Journal of Mathematics and Music 1 (1): 23–46. doi: 10.1080/17459730601137716.
41. Mazzola, Guerino, René Guitart, Jocelyn Ho, Alex Lubet, Maria Mannone, Matt Rahaim, and Florian Thalmann., 2017. The Topos of Music III: Gestures–Musical Multiverse Ontologies. 2nd ed. In the series Computational Music Science. Cham, Switzerland: Springer International Publishing. doi: 10.1007/978-3-319-64481-3.
42. Mazzola, Guerino, and Maria Mannone., 2016. “Global Functorial Hypergestures over General Skeleta for Musical Performance.” Journal of Mathematics and Music 10 (3): 227–243. doi:10.1080/17459737.2016.1195456.
43. Mazzola, Guerino, Joomi, Park, and Florian, Thalmann. 2011. Musical Creativity: Strategies and Tools in Composition and Improvisation. In the series Computational Music Science. Berlin: Springer-Verlag.
44. Nobile, Luca., 2013. “Words in the Mirror: Analysing the Sensorimotor Interface between Phonetics and Semantics in Italian.” In Semblance and Signification: Iconicity in Language and Literature 10, edited by Pascal, Michelucci, Olga, Fischer, and Christina, Ljungberg, 101–131. Amsterdam: John Benjamins.
45. Nobile, Luca., 2015. “Phonemes as Images: An Experimental Inquiry into Shape-Sound Symbolism Applied to the Distinctive Features of French.” In Iconicity: East Meets West, edited by William J. Herlofsky, Kazuko Shinohara, Masako Hiraga, and Kimi Akita, 71–91, Vol. 14 of the series Iconicity in Language and Literature. Amsterdam: John Benjamins.
46. Ohala, John., 1982. “The Voice of Dominance.” Journal of the Acoustical Society of America 72 (S66). doi: 10.1121/1.2020007.
47. Primas, Hans., 2007. “Non-Boolean Descriptions for Mind–Matter Problems.” Mind and Matter 5 (1): 7–44.
48. Rinman, Marie-Louise, Anders, Friberg, Ivar, Kjellmo, Antonio, Camurri, Damien, Cirotteau, Sofia, Dahl, Barbara, Mazzarino, Bendik, Bendikesen, and Hugh, McCarthy. 2003. “EPS–An Interactive Collaborative Game Using Non-Verbal Communication.” In Proceedings of the Stockholm Music Acoustics Conference (SMAC), 6–9 August 2003, Stockholm, Sweden.
49. Roffler, Suzanne, and Robert, Butler. 1968. “Factors that Influence the Localization of Sound in the Vertical Plane.” Journal of the Acoustical Society of America 43: 1255–1259. doi: 10.1121/1.1910976
50. Schoenberg, Arnold., 1983 edition. Theory of Harmony. Translated by Roy E. Carter. Berkeley, CA: University of California Press.
51. Schutz, Michael, and Scott, Lipscomb. 2007. “Hearing Gestures, Seeing Music: Vision Influences Perceived Tone Duration.” Perception 36 (6): 888–897. doi: 10.1068/p5635.
52. Sessions, Roger, and Edward T. Cone. 1979. Roger Sessions on Music, Collected Essays. Princeton, NJ: Princeton Legacy Library.
53. Spence, Charles., 2011. “Crossmodal Correspondences: A Tutorial Review.” Attention, Perception, and Psychophysics 73 (4): 971–995. doi: 10.3758/s13414-010-0073-7.
54. Spivak, David., 2013. 18-S996: Category Theory for Scientists, MIT, Cambridge, MA. http://math.mit.edu/~dspivak/teaching/sp13/CT4S--static.pdf.
55. Uznadze, Dimitri. 1924. “Ein experimenteller Beitrag zum Problem der psychologischen Grundlagen der Namengebung” [An experimental contribution to the problem of the psychological foundations of naming]. Psychologische Forschung 5 (1–2): 24–43. http://pubman.mpdl.mpg.de/pubman/item/escidoc:2403335:2/component/escidoc:2403334/Usnadze_1924_Gradients.pdf. doi: 10.1007/BF00402395
56. Visi, Federico, Rodrigo, Schramm, and Eduardo, Miranda. 2014. “Gesture in Performance with Traditional Musical Instruments and Electronics: Use of Embodied Music Cognition and Multimodal Motion Capture to Design Gestural Mapping Strategies.” In Proceedings of the 2014 International Workshop on Movement and Computing (MOCO), 16–17 June 2014, Paris. doi: 10.1145/2617995.2618013.
57. Wieland, Renate, and Jürgen, Uhde. 2002. Forschendes Üben: Wege instrumentalen Lernens: Über den Interpreten und den Körper als Instrument der Musik. Neumünster, Germany: Bärenreiter.
58. Winter, Michael., 2004. “Goguen Categories.” Journal on Relational Methods in Computer Science 1: 339–357. http://www.cosc.brocku.ca/Faculty/Winter/JoRMiCS/Vol1/PDF/v1n14.pdf.
59. Zbikowski, Lawrence Michael., 2002. Conceptualizing Music: Cognitive Structure, Theory, and Analysis, Vol. 1 of series AMS Studies in Music. New York: Oxford University Press.
60. Zwiebach, Barton., 2004. A First Course in String Theory. Cambridge, UK: Cambridge University Press.