A composition algorithm based on crossmodal taste-music correspondences

Frontiers in Human Neuroscience

Volumn , Issue MARCH 2012, 2012, Pages

  Mesz, Bruno ^a   Sigman, Mariano ^b   Trevisan, Marcos ^b  

^a Laboratory of Musical Research and Production (LIPM)   (Argentina)

^b UNIVERSIDAD DE BUENOS AIRES   (Argentina)

Author keywords

Algorithm; Composition; Cross modal; Language; Music; Semantics; Taste

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY DISCRIMINATION; AUDITORY FEEDBACK; AUDITORY STIMULATION; BITTER TASTE; CONTROLLED STUDY; FEMALE; GESTURE; HUMAN; HUMAN EXPERIMENT; LANGUAGE PROCESSING; LEARNING ALGORITHM; MALE; MUSIC; NORMAL HUMAN; PROCESS DEVELOPMENT; SCORING SYSTEM; SEMANTICS; STIMULUS RESPONSE; SWEETNESS; TASK PERFORMANCE; TASTE DISCRIMINATION;

EID: 84933676674     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2012.00071     Document Type: Article

References (43)

1. Askenfelt, A. and Janson, E. (1990) "From touch to string vibrations - the initial course of piano tone", in The Acoustics of the Piano, ed. A. Askenfelt (Stockholm: Royal Swedish Academy of Music).
2. AzzigottiURL: http://zztt.org/exe/kimi.
3. Bradley, M. M., and Lang, P. J. (1999). Affective norms for English words (ANEW): Instruction manual and affective ratings. Technical Report C-1, The Center for Research in Psychophysiology, University of Florida.
4. Cambouropoulos, E. (1997) "Musical rhythm: A formal model for determining local boundaries, accents and metre in a melodic surface" in Music, Gestalt and Computing- Studies in Systematic and Cognitive Musicology, ed. M. Leman (Berlin: Springer Verlag).
5. Cariani, P. (2004). A temporal model for pitch multiplicity and tonal consonance. Proc of the 8th Internat Conf Music Percept and Cogn, ed. S.D. Lipscomb, R. Ashley, R.O. Gjerdingen, P.Webster (Adelaide, Australia: Causal Productions).
6. Chemillier, M. (2003) Synchronization of musical words. Theoretical Computer Science 310, 35-60.
7. Chomsky, N. (1988) Language and problems of language, (Cambridge, MA: MIT Press).
8. Crisinel, A. S. and Spence, C. (2009). Implicit association between basic tastes and pitch. Neurosci Lett 464, 39-42.
9. Crisinel, A. S. and Spence, C. (2010). As bitter as a trombone: synesthetic correspondences in nonsynesthetes between tastes/flavors and musical notes. Atten Percept Psychophys 72, 1994-2002.
10. Crisinel, A. S. and Spence, C. (2010b). A sweet sound? Food names reveal implicit associations between taste and pitch. Perception 39, 417-25.
11. Crisinel, A-S., Cosser, S., King, S., Jones, R., Petrie, J. and Spence, C. (2011). A bittersweet symphony: Systematically modulating the taste of food by changing the sonic properties of the soundtrack playing in the background. Food quality and preference, doi:10.1016/j.foodqual.2011.08.009.
12. Debussy, C. (1913) Préludes, book 2:111, http://imslp.org/wiki/Preludes_(Book_2)_(De- bussy,_Claude).
13. Driver, J. and Spence C. (2000). Multisensory perception: beyond modularity and convergence. Curr. Biol. 10, R731-R735.
14. EngineURL: http://www.peachnote.com.
15. Evans, K. K. and Treisman, A. (2010) Natural cross-modal mappings between visual and auditory features. J Vis. 10(1):6, 1-12.
16. Fastl, H. and Zwicker, E. (2007). Psychoacoustics. Facts and Models (Berlin: Springer).
17. Fraisse, P. (1982) 'Rhythm and Tempo', in Psychology of Music, ed. D. Deutsch, 149-80. (New York: Academic).
18. Greimel, E., Macht, M., Krumhuber, E., Ellgring, H. (2006). Facial and affective reactions to tastes and their modulation by sadness and joy. Physiology & Behavior 89 (2006) 261-269.
19. Jackendoff, R. and Lerdahl, F. (2006). The capacity for music: what is it, and what's special about it? Cognition 100, 33-72.
20. Jentschke, S., Koelsch, S., and Friederici, A. D. (2005). Investigating the relationship of music and language in children: influences of musical training and language impairment. Ann N YAcad Sci, 1060, 231-42.
21. Jentschke, S., Koelsch, S., S. Sallat, S. and Friederici, A. D. (2008). Children with specific language impairment also show impairment of music-syntactic processing. J Cogn Neu- rosci 20, 1940-51.
22. Koelsch, S., Kasper, E., Sammler, D., Schulze, K., Gunter, T. and Friederici, A. D. (2004). Music, language and meaning: brain signatures of semantic processing. Nat Neurosci 7, 302-7.
23. Koelsch, S. (2011) Towards a neural basis of processing musical semantics. Phys Life Rev 8, 89-105.
24. Levitan, C. A., Zampini, M., Li, R. and Spence, C. (2008). Assessing the role of color cues and people's beliefs about color-flavor associations on the discrimination of the flavor of sugar-coated chocolates. Chem Senses 33, 415-23.
25. Luck, G., Toiviainen, P., Erkkila, J., Lartillot, O., Riikkila, K., Makela, A., Pyhaluoto, K., Plomp, R. and Levelt, W. J. M. (1965). Tonal consonance and critical bandwidths Journal of the Acoustical Society of America 38, 548-560.
26. Martino, G. and Marks, L. E. (2000). Cross-modal interaction between vision and touch: the role of synesthetic correspondence. Perception, 29 745-54.
27. Mesz, B., Trevisan, M. A. and Sigman, M. (2011). The taste of music. Perception 40, 209-219.
28. Mullensiefen, D. and Frieler K. (2004). Cognitive adequacy in the measurement of melodic similarity: algorithmic vs human judgment. Computing in Musicology 13, 147-176.
29. Parise, C. and Spence, C. (2008). Synaesthetic congruency modulates the temporal Ventriloquism effect. Neurosci. Lett. 442, 257-61.
30. Patel, A. D. (2003). Language, music, syntax and the brain. Nat Neurosci 6, 674-81.
31. PetrucciURL: http://imslp.org/wiki.
32. Raine, H., Varkila, L. and Varri, J. (2008). Modelling the relationships between emotional responses to, and musical content of music therapy improvisations. Psychology of Music 36:1, 25-45.
33. Ramachandran, V. S. and Hubbard, E. M. (2003). Hearing colors, tasting shapes. Sci Am 288, 52-9.
34. Scherer, K.R. (1986). Vocal Affect Expression: A Review and a Model for Future Research. Psychological Bulletin 99 (2), 143-165.
35. Shukla, M., Nespor, M. and Mehler, J. (2007). An interaction between prosody and statistics in the segmentation of fluent speech. Cogn Psychol 54, 1-32.
36. Simner, J., (2009). Synaesthetic visuo-spatial forms: Viewing sequences in space. Cortex 45, 1138-1147.
37. Simner, J., Cuskley, C. and Kirby, S. (2010). What sound does that taste? Cross-modal mappings across gustation and audition. Perception 39, 553-69.
38. Spence, C. (2011). Crossmodal correspondences: A tutorial review. Atten Percept & Psy- chophys 73:4, 971-995.
39. Steiner, J. E. (1979). "Human facial expressions in response to taste and smell stimulation", in Advances in child development and behavior, eds. H. W. Reese & L. P. Lipsitt (New York: Academic Press).
40. Toolbox: https://www.jyu.fi/hum/laitokset/musiikki/en/research/coe/materials/midi toolbox/
41. Traunmuller, H. and Eriksson, A. (2010). Acoustic effects of variation in vocal effort by men, women, and children. Jour. Acoust. Soc. Am. 107(6), 3438-3451.
42. Walsh, V. (2003). A theory of magnitude: common cortical metrics of time, space and quantity. Trends in Cognitive Sciences 7, 483-488.
43. Zatorre, R. J., Chen, J. L. and Penhune, V. B. (2007). When the brain plays music: auditory-motor interactions in music perception and production. Nat Rev Neurosci 8, 547-58.