From sound to shape: Auditory perception of drawing movements

Journal of Experimental Psychology: Human Perception and Performance

Volumn 40, Issue 3, 2014, Pages 983-994

  Thoret, Etienne ^a   Aramaki, Mitsuko ^a   Kronland Martinet, Richard ^a   Velay, Jean Luc ^b   Ystad, Sølvi ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

^b AIX MARSEILLE UNIVERSITÉ   (France)

Author keywords

Action perception; Biological motion; Friction sound synthesis

Indexed keywords

ADOLESCENT; ADULT; ART; CONCEPT FORMATION; FEMALE; FRICTION; GESTURE; HEARING; HUMAN; MALE; MOVEMENT PERCEPTION; PATTERN RECOGNITION; PERCEPTIVE DISCRIMINATION; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSICS; SOUND DETECTION; YOUNG ADULT;

ADOLESCENT; ADULT; ART; AUDITORY PERCEPTION; CONCEPT FORMATION; DISCRIMINATION (PSYCHOLOGY); FEMALE; FORM PERCEPTION; FRICTION; GESTURES; HUMANS; MALE; MOTION PERCEPTION; PATTERN RECOGNITION, PHYSIOLOGICAL; PSYCHOACOUSTICS; PSYCHOMOTOR PERFORMANCE; SOUND LOCALIZATION; YOUNG ADULT;

EID: 84901625317     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0035441     Document Type: Article

References (61)

1. Aramaki, M., Besson, M., Kronland-Martinet, R., & Ystad, S. (2011). Controlling the perceived material in an impact sound synthesizer. Audio, Speech, and Language Processing, 19, 301-314. doi:10.1109/ TASL.2010.2047755
2. Bangert, M., Peschel, T., Schlaug, G., Rotte, M., Drescher, D., Hinrichs, H., ... Altenmüller, E. (2006). Shared network for auditory and motor processing in professional pianists: Evidence from fMRI conjunction. Neuroimage, 30, 917-926. doi:10.1016/j.neuroimage.2005.10.044
3. Carello, C., Anderson, K. L., & Kunkler-Peck, A. J. (1998). Perception of object length by sound. Psychological Science, 9, 211-214. doi:10.1111/ 1467-9280.00040
4. Carlyon, R. P., Macherey, O., Frijns, J. H. M., Axon, P. R., Kalkman, R. K., Boyle, P., ... Dauman, R. (2010). Pitch comparisons between electrical stimulation of a cochlear implant and acoustic stimuli presented to a normalhearing contralateral ear. Journal of the Association for Research in Otolaryngology, 11, 625-640. doi:10.1007/s10162-010-0222-7
5. Castiello, U., Giordano, B. L., Begliomini, C., Ansuini, C., & Grassi, M. (2010). When ears drive hands: The influence of contact sound on reaching to grasp. PLoS One, 5, e12240. doi:10.1371/journal.pone.0012240
6. Cisek, P., & Kalaska, J. F. (2010). Neural mechanisms for interacting with a world full of action choices. Annual Review of Neuroscience, 33, 269-298. doi:10.1146/annurev.neuro.051508.135409
7. Dayan, E., Casile, A., Levit-Binnun, N., Giese, M. A., Hendler, T., & Flash, T. (2007). Neural representations of kinematics laws of motion: Evidence for action-perception coupling. Proceedings of the National Academy of Sciences of the United States of American, 104, 20582-20587. doi:10.1073/pnas.0710033104
8. Frémiot, M., Mandelbrojt, J., Formosa, M., Delalande, G., Pedler, E., Malbosc, P., & Gobin, P. (1996). Les Unités Sémiotiques Temporelles: éléments nouveaux d'analyse musicale. diffusion ESKA. MIM Laboratoire Musique et Informatique de Marseille, documents musurgia edition [The temporal semiotic unities: new element of musical analyses].
9. Freyd, J. J. (1983a). Representing the dynamics of a static form. Memory & Cognition, 11, 342-346. doi:10.3758/BF03202447
10. Freyd, J. J. (1983b). The mental representation of movement when static stimuli are viewed. Perception & Psychophysics, 33, 575-581. doi: 10.3758/BF03202940
11. Gaver, W. W. (1993a). What in the world do we hear?: An ecological approach to auditory event perception. Ecological Psychology, 5(1), 1-29. doi:10.1207/s15326969eco0501_1
12. Gaver, W. W. (1993b). How do we hear the world? Explanations in ecological acoustics. Ecological Psychology, 5, 285-313. doi:10.1207/ s15326969eco0504_2
13. Gibson, J. J. (1966). The senses considered as perceptual systems, Boston, MA: Houghton Mifflin
14. Giordano, B. L., & McAdams, S. (2006). Material identification of real impact sounds: Effects of size variation in steel, glass, wood and plexiglass plates. Journal of the Acoustical Society of America, 119, 1171-1181. doi:10.1121/1.2149839
15. Giordano, B. L., Rocchesso, D., & McAdams, S. (2010). Integration of acoustical information in the perception of impacted sound sources: The role of information accuracy and exploitability. Journal Experimental Psychology: Human perception and Performance, 36, 462-476. doi: 10.1037/a0018388
16. Grassi, M. (2005). Do we hear size or sound: Balls dropped on plates. Perception & Psychophysics, 67, 274-284. doi:10.3758/BF03206491
17. Grassi, M., Pastore, M., & Lemaitre, G. (2013). Looking at the world with your ears: How do we get the size of an object from its sound? Acta Psychologica, 143, 96-104. doi:10.1016/j.actpsy.2013.02.005
18. Griffiths, T. D., & Warren, J. D. (2004). What is an auditory object? Nature Reviews Neuroscience, 5, 887-892. doi:10.1038/nrn1538
19. Hommel, B. (2004). Event files: Feature binding in and across perception and action. Trends in Cognitive Sciences, 8, 494-500. doi:10.1016/j.tics .2004.08.007
20. Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning, Behavioral and Brain Sciences, 24, 849-878. doi:10.1017/ S0140525X01000103
21. Honing, H. (2003). The final ritard: On music, motion, and kinematic models. Computer Music Journal, 27, 66 -72. doi:10.1162/ 014892603322482538
22. Houben, M. M. J., Kohlrausch, A., & Hermes, D. J. (2004). Perception of the size and speed of rolling balls by sound. Speech Communication, 43, 331-345. doi:10.1016/j.specom.2004.03.004
23. Houben, M. M. J., Kohlrausch, A., & Hermes, D. J. (2005). The contribution of spectral and temporal information to the auditory perception of the size and speed of rolling balls. Acta acustica united with Acustica, 91, 1007-1015.
24. James, K. H., & Gauthier, I. (2006). Letter processing automatically recruits a sensory? Motor brain network. Neuropsychologia, 44, 2937-2949. doi:10.1016/j.neuropsychologia.2006.06.026
25. Jeannerod, M. (1995). Mental imagery in the motor context. Neuropsychologia, 33, 1419-1432. doi:10.1016/0028-3932(95)00073-C
26. Johnson, M. L., & Larson, S. (2003). Something in the way she moves, metaphors of musical motion, Metaphor and Symbol, 18, 63-84. doi: 10.1207/S15327868MS1802_1
27. Klatzky, R. L., Pai, D. K., & Krotkov, E. P. (2000). Perception of material from contact sounds. Presence: Teleoperators & Virtual Environments, 9, 399-410. doi:10.1162/105474600566907
28. Kohler, E., Keysers, C., Umilta, M. A., Fogassi, L., Gallese, V., & Rizzolatti, G. (2002). Hearing sounds, understanding actions: Action representation in mirror neurons. Science, 297, 846-848. doi:10.1126/ science.1070311
29. Kunkler-Peck, A. J., & Turvey, M. T. (2000). Hearing shape. Journal of Experimental Psychology: Human Perception and Performance, 26, 279-294. doi:10.1037/0096-1523.26.1.279
30. Lacquaniti, F., Terzuolo, C., & Viviani, P. (1983). The law relating the kinematic and figural aspects of drawing movements. Acta Psychologica, 54, 115-130. doi:10.1016/0001-6918(83)90027-6
31. Lakatos, S., McAdams, S., & Caussé, R. (1997). The representation of auditory source characteristics: Simple geometric form. Perception & Psychophysics, 59, 1180-1190. doi:10.3758/BF03214206
32. Lemaitre, G., & Heller, L. M. (2012). Auditory perception of material is fragile, while action is strikingly robust. Journal of the Acoustical Society of America, 131, 1337-1348. doi:10.1121/1.3675946
33. Lewis, J. W., Wightman, F. L., Brefczynski, J. A., Phinney, R. E., Binder, J. R., & DeYoe, E. A. (2004). Human brain regions involved in recognizing environmental sounds. Cerebral Cortex, 14, 1008-1021. doi: 10.1093/cercor/bhh061
34. Li, X., Logan, R. J., & Pastore, R. E. (1991). Perception of acoustic source characteristics: Walking sounds. Journal of the Acoustical Society of America, 90, 3036-3049. doi:10.1121/1.401778
35. Liberman, A. M., Cooper, F. S., Shankweiler, D. P., & Studdert-Kennedy, M. (1967). Perception of the speech code. Psychological Review, 74, 431-461. doi:10.1037/h0020279
36. Liberman, A. M., & Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition, 21, 1-36. doi:10.1016/0010-0277(85)90021-6
37. Longcamp, M., Anton, J. L., Roth, M., & Velay, J. L. (2003). Visual presentation of single letters activates a premotor area involved in writing. Neuroimage, 19, 1492-1500. doi:10.1016/S1053-8119(03)00088-0
38. Longcamp, M., Boucard, C., Gilhodes, J. C., Anton, J. L., Roth, M., Nazarian, B., & Velay, J. L. (2008). Learning through hand-or typewriting influences visual recognition of new graphic shapes: Behavioral and functional imaging evidence. Journal of Cognitive Neuroscience, 20, 802-815. doi:10.1162/jocn.2008.20504
39. Longcamp, M., Tanskanen, T., & Hari, R. (2006). The imprint of action: Motor cortex involvement in visual perception of handwritten letters. Neuroimage, 33, 681-688. doi:10.1016/j.neuroimage.2006.06.042
40. McAdams, S. (1993). Recognition of sound sources and events. In S. McAdams & E. Bigand (Eds.), Thinking in sound: The cognitive psychology of human audition (pp. 146-198). New York, NY: Oxford University Press.
41. McAdams, S., Chaigne, A., & Roussarie, V. (2004). The psychomechanics of simulated sound sources: Material properties of impacted bars. Journal of the Acoustical Society of America, 115, 1306-1320. doi:10.1121/1.1645855
42. Merer, A., Aramaki, M., Ystad, S., & Kronland-Martinet, R. (2013). Perceptual characterization of motion evoked by sounds for synthesis control purposes. ACM Transaction on Applied Perception (TAP), 10, 1. doi:10.1145/2422105.2422106
43. Merer, A., Ystad, S., Kronland-Martinet, R., & Aramaki, M. (2008). Semiotics of sounds evoking motions: Categorization and acoustic features. In R. Kronland-Martinet, S. Ystad, & K. Jensen (Eds.), CMMR 2007. Sense of sounds (pp. 139-158). Berlin, Germany: Springer, LNCS.
44. Norman, J. (2002). Two visual systems and two theories of perception: An attempt to reconcile the constructivist and ecological approaches. Behavioral and Brain Sciences, 25, 73-96.
45. Prinz, W. (1997). Perception and action planning. European Journal of Cognitive Psychology, 9, 129-154. doi:10.1080/713752551
46. Repp, B. H. (1987). The sound of two hands clapping: An exploratory study. Journal of the Acoustical Society of America, 81, 1100-1109. doi:10.1121/1.394630
47. Richardson, M. J. E., & Flash, T. (2002). Comparing smooth arm movements with the two-thirds power law and the related segmented-control hypothesis. The Journal of Neuroscience, 22, 8201-8211.
48. Schomaker, L. R. B., & Plamondon, R. (1990). The relation between pen force and pen-point kinematics in handwriting. Biological Cybernetics, 63, 277-289. doi:10.1007/BF00203451
49. Sokal, R. R., & Rohlf, F. J. (1962). The comparison of dendrograms by objective methods. Taxon, 11, 33-40. doi:10.2307/1217208
50. Van den Doel, K., Kry, P. G., & Pai, D. K. (2001). FoleyAutomatic: Physically-based sound effects for interactive simulation and animation. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques ACM, 537-544.
51. Viviani, P. (2002). Motor competence in the perception of dynamic events: A tutorial. In W. Prinz & B. Hommel (Eds.), Common mechanisms in perception and action (pp. 406-442). New York, NY: Oxford University Press.
52. Viviani, P., Baud-Bovy, G., & Redolfi, M. (1997). Perceiving and tracking kinesthetic stimuli: Further evidence of motor-perceptual interactions. Journal of Experimental Psychology: Human Perception and Performance, 23, 1232-1252. doi:10.1037/0096-1523.23.4.1232
53. Viviani, P., & Flash, T. (1995). Minimum-jerk, two-thirds power law, and isochrony: Converging approaches to movement planning. Journal of Experimental Psychology: Human Perception and Performance, 21, 32-53. doi:10.1037/0096-1523.21.1.32
54. Viviani, P., & McCollum, G. (1983). The relation between linear extent and velocity in drawing movements. Neuroscience, 10, 211-218. doi: 10.1016/0306-4522(83)90094-5
55. Viviani, P., & Stucchi, N. (1989). The effect of movement velocity on form perception: Geometric illusions in dynamic displays. Perception & Psychophysics, 46, 266-274. doi:10.3758/BF03208089
56. Viviani, P., & Stucchi, N. (1992). Biological movements look uniform: Evidence of motor-perceptual interactions. Journal of Experimental Psychology: Human Perception and Performance, 18, 603-623. doi: 10.1037/0096-1523.18.3.603
57. Viviani, P., & Terzuolo, C. (1982). Trajectory determines movement dynamics. Neuroscience, 7, 431-437. doi:10.1016/0306-4522(82)90277-9
58. Warren, W. H., & Verbrugge, R. R. (1984). Auditory perception of breaking and bouncing events: A case study in ecological acoustics. Journal of Experimental Psychology: Human Perception and Performance, 10, 704-712. doi:10.1037/0096-1523.10.5.704
59. Wildes, R. P., & Richards, W. A. (1988). Recovering material properties from sound. In W. A. Richards (Ed.), Natural computation (pp. 356-363). Cambridge, MA: MIT Press.
60. Young, W., Rodger, M., & Craig, C. M. (2013). Perceiving and reenacting spatiotemporal characteristics of walking sounds. Journal of Experimental Psychology: Human Perception and Performance, 39, 464-476. doi:10.1037/a0029402
61. Zatorre, R. J., Chen, J. L., & Penhune, V. B. (2007). When the brain plays music: Auditory-motor interactions in music perception and production. Nature Reviews Neuroscience, 8, 547-558. doi:10.1038/nrn2152